2024-09-19T09:32:19.547 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T09:32:19.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:32:19.664 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911928' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNbe+jjsnp1/QuKUM/mtFHm0zetjToG2aRccC1/ZKGsGctE5L17bm5NLNub2qRrv6ftH4l4VgyYLKdN1nyvVJno= smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs2APerDsbdw8gROC+zee5vblqmo010ZN0tl0fmiyHsdtNhrKUw4kd4Bu6WE+2P2uXIafib2PeHdkOkDDfdE7I= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJLKgwKE76EgLcjyRNoiSuVsw8oP+X8O+2GENZCOrIE767UJDO+5RH2HsDqCtzI2OD4jYRijUtpLiVcWaL5BAn8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T09:32:19.664 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T09:32:19.665 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T09:32:19.665 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T09:32:19.667 INFO:teuthology.task.internal:Checking packages... 2024-09-19T09:32:19.687 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T09:32:19.687 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:32:19.687 INFO:teuthology.packaging:ref: None 2024-09-19T09:32:19.687 INFO:teuthology.packaging:tag: None 2024-09-19T09:32:19.687 INFO:teuthology.packaging:branch: squid 2024-09-19T09:32:19.687 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:32:19.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T09:32:19.949 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T09:32:19.950 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T09:32:19.956 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T09:32:19.956 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T09:32:19.963 INFO:teuthology.task.internal:Saving configuration 2024-09-19T09:32:19.982 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T09:32:19.988 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T09:32:20.014 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:25:44.480653', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNbe+jjsnp1/QuKUM/mtFHm0zetjToG2aRccC1/ZKGsGctE5L17bm5NLNub2qRrv6ftH4l4VgyYLKdN1nyvVJno='} 2024-09-19T09:32:20.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:25:44.484147', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs2APerDsbdw8gROC+zee5vblqmo010ZN0tl0fmiyHsdtNhrKUw4kd4Bu6WE+2P2uXIafib2PeHdkOkDDfdE7I='} 2024-09-19T09:32:20.062 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:25:44.482624', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJLKgwKE76EgLcjyRNoiSuVsw8oP+X8O+2GENZCOrIE767UJDO+5RH2HsDqCtzI2OD4jYRijUtpLiVcWaL5BAn8='} 2024-09-19T09:32:20.062 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T09:32:20.068 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T09:32:20.068 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T09:32:20.068 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T09:32:20.068 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T09:32:20.150 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb4bbfdc4c0>, signals=[15]) 2024-09-19T09:32:20.150 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T09:32:20.156 INFO:teuthology.task.internal:Opening connections... 2024-09-19T09:32:20.156 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:32:20.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:32:20.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T09:32:20.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:32:20.309 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:32:20.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:32:20.386 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T09:32:20.393 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-19T09:32:20.412 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-19T09:32:20.412 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-19T09:32:20.470 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-09-19T09:32:20.470 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-09-19T09:32:20.470 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-09-19T09:32:20.470 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:32:20.470 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-09-19T09:32:20.470 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:32:20.471 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:32:20.471 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-09-19T09:32:20.471 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:32:20.471 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:32:20.471 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:32:20.471 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:32:20.471 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:32:20.471 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:32:20.472 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-19T09:32:20.492 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-09-19T09:32:20.511 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-09-19T09:32:20.511 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-09-19T09:32:20.570 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-09-19T09:32:20.570 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-09-19T09:32:20.570 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-09-19T09:32:20.570 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:32:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-09-19T09:32:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:32:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:32:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-09-19T09:32:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:32:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:32:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:32:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:32:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:32:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:32:20.571 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-09-19T09:32:20.592 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-19T09:32:20.611 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-19T09:32:20.611 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-19T09:32:20.669 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-19T09:32:20.669 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-19T09:32:20.669 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-19T09:32:20.669 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:32:20.669 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-19T09:32:20.669 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:32:20.669 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:32:20.669 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-19T09:32:20.669 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:32:20.669 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:32:20.670 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:32:20.670 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:32:20.670 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:32:20.670 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:32:20.670 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-19T09:32:20.692 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T09:32:20.702 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T09:32:20.768 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T09:32:20.769 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:32:20.771 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:32:20.774 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:32:20.791 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T09:32:20.797 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T09:32:20.797 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:32:20.829 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:32:20.832 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:32:20.922 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T09:32:20.997 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T09:32:21.011 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T09:32:21.011 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T09:32:21.011 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T09:32:21.012 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:32:21.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:32:21.029 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-19T09:32:21.086 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-503.el9.x86_64 2024-09-19T09:32:21.087 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.14.0-503.el9.x86_64 2024-09-19T09:32:21.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum install -y kernel 2024-09-19T09:32:23.513 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-19T09:32:26.923 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 20 MB 00:02 2024-09-19T09:32:33.431 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-19T09:32:35.807 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-19T09:32:36.927 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-19T09:32:42.517 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-09-19T09:32:44.490 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T09:32:44.490 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T09:32:44.589 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-19T09:32:44.602 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T09:32:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-09-19T09:32:44.602 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T09:32:44.602 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-19T09:32:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T09:32:44.603 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-19T09:32:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T09:32:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T09:32:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T09:32:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:32:44.603 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-19T09:32:44.603 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T09:32:44.603 INFO:teuthology.orchestra.run.smithi018.stdout:Install 4 Packages 2024-09-19T09:32:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:32:44.604 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 79 M 2024-09-19T09:32:44.604 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 126 M 2024-09-19T09:32:44.604 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-19T09:32:44.734 INFO:teuthology.orchestra.run.smithi018.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 332 kB/s | 36 kB 00:00 2024-09-19T09:32:45.118 INFO:teuthology.orchestra.run.smithi018.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-19T09:32:45.560 INFO:teuthology.orchestra.run.smithi018.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-19T09:32:45.827 INFO:teuthology.orchestra.run.smithi018.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-19T09:32:45.827 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:32:45.827 INFO:teuthology.orchestra.run.smithi018.stdout:Total 64 MB/s | 79 MB 00:01 2024-09-19T09:32:46.537 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-19T09:32:46.912 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-19T09:32:46.912 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-19T09:32:47.908 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-19T09:32:47.908 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-19T09:32:50.503 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-19T09:32:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:32:51.244 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:32:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:32:54.164 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:32:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:32:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:04.485 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:43.562 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:43.604 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:33:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:33:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:33:44.735 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:33:44.735 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:33:44.735 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-19T09:33:44.735 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T09:33:44.735 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T09:33:44.735 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T09:33:44.735 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T09:33:44.735 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:33:44.736 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-19T09:33:45.066 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:33:45.156 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:33:45.156 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:33:45.156 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T09:33:45.156 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T09:33:45.157 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T09:33:45.157 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T09:33:45.157 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T09:33:45.157 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:33:45.215 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:33:45.216 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:33:45.216 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-09-19T09:33:45.250 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-09-19T09:33:45.250 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-09-19T09:33:45.250 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-09-19T09:33:45.250 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 82.el9 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8274670 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T09:33:45.251 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-09-19T09:33:45.252 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-09-19T09:33:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:33:45.252 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T09:33:45.252 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T09:33:45.252 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T09:33:45.252 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-09-19T09:33:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:33:45.252 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T09:33:45.253 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T09:33:45.253 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 5.14.0-508.el9.x86_64 2024-09-19T09:33:45.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T09:33:45.966 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-09-19T09:33:47.283 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T09:33:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-09-19T09:33:47.300 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-19T09:33:47.316 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.6QJVBBbE0S 2024-09-19T09:33:47.316 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6QJVBBbE0S 2024-09-19T09:33:47.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.6QJVBBbE0S 2024-09-19T09:33:47.528 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.6QJVBBbE0S is 6KB 2024-09-19T09:33:47.576 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.6QJVBBbE0S 2024-09-19T09:33:47.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T09:33:47.652 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T09:33:47.653 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T09:33:47.653 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T09:33:47.653 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T09:33:47.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T09:33:47.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-09-19T09:34:17.857 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T09:34:17.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:34:17.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:34:36.349 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-09-19T09:34:45.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:34:45.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:34:48.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-09-19T09:35:00.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:35:00.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:35:32.215 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-19T09:35:32.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:35:32.573 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T09:35:32.574 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-19T09:35:32.589 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-508.el9.x86_64 2024-09-19T09:35:32.590 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T09:35:32.590 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T09:35:32.590 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T09:35:33.591 DEBUG:teuthology.parallel:result is None 2024-09-19T09:35:33.591 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T09:35:33.598 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T09:35:33.599 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:35:33.601 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:35:33.604 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:35:33.623 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T09:35:33.629 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T09:35:33.639 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T09:35:33.639 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:35:33.660 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:35:33.663 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:35:33.866 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T09:35:33.872 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T09:35:33.872 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:35:33.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:35:33.891 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:35:33.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:35:33.908 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:35:33.910 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:35:33.933 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:35:33.981 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:35:33.989 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:35:33.993 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:35:34.006 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:35:34.010 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:35:34.021 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:35:34.022 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T09:35:34.103 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T09:35:34.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:35:34.107 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:35:34.109 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:35:34.138 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T09:35:34.147 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T09:35:34.147 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:35:34.178 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:35:34.180 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:35:34.198 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:35:34.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:35:34.337 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:35:34.422 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:35:34.467 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:35:34.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:35:34.536 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:35:34.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:35:34.632 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:35:34.719 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:35:34.764 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:35:34.764 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:35:34.832 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:35:34.877 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:35:34.944 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:35:34.988 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:35:35.030 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:35:35.030 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:35:35.096 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-19T09:35:35.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-09-19T09:35:35.102 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-19T09:35:35.140 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:35:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:35:35.176 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:35:35.665 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T09:35:35.673 INFO:teuthology.task.internal:Starting timer... 2024-09-19T09:35:35.673 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T09:35:35.686 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T09:35:35.694 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T09:35:35.694 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-09-19T09:35:35.752 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-09-19T09:35:35.754 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2024-09-19T09:35:35.815 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2024-09-19T09:35:35.817 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-19T09:35:35.861 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-19T09:35:35.863 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T09:35:35.863 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-09-19T09:35:35.887 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-09-19T09:35:35.888 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2024-09-19T09:35:35.915 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2024-09-19T09:35:35.916 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-19T09:35:35.941 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-19T09:35:35.941 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi049.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-09-19T09:35:35.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:35:35.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:35:35.970 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:35:36.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:35:36.000 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:35:36.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:35:36.026 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T09:35:36.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:35:36.061 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:35:36.096 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:35:36.127 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T09:35:36.137 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T09:35:36.140 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T09:35:36.253 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T09:35:36.264 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T09:35:36.265 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi049.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T09:39:44.495 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-09-19T09:39:44.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:39:44.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:39:44.616 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-19T09:39:44.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:39:44.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T09:39:44.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:39:44.779 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-09-19T09:39:44.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T09:39:44.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T09:39:44.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:39:44.937 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-19T09:39:45.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T09:39:45.030 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T09:39:45.041 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T09:39:45.041 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:39:45.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:39:45.044 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:39:45.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:39:45.047 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:39:45.047 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:39:45.074 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:39:45.075 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:39:45.089 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:39:45.091 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:39:45.102 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:39:45.114 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2024-09-19T09:39:45.117 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-09-19T09:39:45.118 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:39:45.126 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2024-09-19T09:39:45.129 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-09-19T09:39:45.141 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:39:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:39:45.145 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-19T09:39:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:39:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-19T09:39:45.160 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:39:45.171 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:39:45.185 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:39:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:39:45.219 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:39:45.219 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-19T09:39:45.219 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.219 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.219 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.219 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.248 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:39:45.252 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:39:45.252 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-19T09:39:45.252 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.252 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.253 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.253 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:39:45.253 INFO:teuthology.run_tasks:Running task install... 2024-09-19T09:39:45.260 DEBUG:teuthology.task.install:project ceph 2024-09-19T09:39:45.261 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T09:39:45.264 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T09:39:45.264 INFO:teuthology.task.install:Using flavor: default 2024-09-19T09:39:45.269 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T09:39:45.269 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T09:39:45.270 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:39:45.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:39:45.273 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:39:45.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:39:45.274 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:39:45.274 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:39:45.418 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:39:45.419 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:39:45.426 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:39:45.426 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:39:45.435 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:39:45.435 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:39:45.528 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:39:45.528 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:39:45.528 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:39:45.537 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:39:45.537 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:39:45.537 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:39:45.542 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:39:45.542 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:39:45.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:39:45.556 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:39:45.556 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:39:45.563 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:39:45.563 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:39:45.569 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:39:45.569 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:39:45.625 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:39:45.629 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:39:45.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:39:45.703 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:39:45.704 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:39:45.713 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:39:45.768 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-09-19T09:39:45.768 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-19T09:39:45.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-09-19T09:39:45.770 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-19T09:39:45.779 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2024-09-19T09:39:45.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2024-09-19T09:39:45.995 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-19T09:39:46.014 INFO:teuthology.orchestra.run.smithi049.stdout:45 files removed 2024-09-19T09:39:46.018 INFO:teuthology.orchestra.run.smithi018.stdout:45 files removed 2024-09-19T09:39:46.022 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:39:46.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:39:46.045 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:39:46.565 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-19T09:39:46.611 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 298 kB/s | 84 kB 00:00 2024-09-19T09:39:46.613 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-19T09:39:46.841 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-19T09:39:46.903 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T09:39:46.906 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T09:39:47.108 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T09:39:47.179 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T09:39:47.181 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T09:39:48.862 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.3 MB 00:01 2024-09-19T09:39:48.925 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-19T09:39:50.689 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-19T09:39:51.340 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.3 MB 00:04 2024-09-19T09:39:52.126 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-09-19T09:39:53.058 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-19T09:39:58.214 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.5 MB 00:03 2024-09-19T09:39:58.679 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-19T09:39:59.358 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-19T09:39:59.964 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-19T09:40:00.177 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-19T09:40:00.810 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T09:40:00.942 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-19T09:40:01.173 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T09:40:01.880 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T09:40:06.524 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T09:40:06.587 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-19T09:40:07.510 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-19T09:40:08.730 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:40:08.731 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:40:08.742 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:40:08.743 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:40:08.743 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:40:08.744 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:40:08.744 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:40:08.745 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:40:08.746 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:40:08.748 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:40:08.749 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:40:08.756 INFO:teuthology.orchestra.run.smithi049.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:40:08.757 INFO:teuthology.orchestra.run.smithi049.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:40:08.758 INFO:teuthology.orchestra.run.smithi049.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:40:08.758 INFO:teuthology.orchestra.run.smithi049.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:40:08.760 INFO:teuthology.orchestra.run.smithi049.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:40:08.763 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:40:08.763 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:40:08.812 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-19T09:40:08.829 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:40:08.838 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:40:08.839 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:40:08.840 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:40:08.841 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:40:08.842 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:40:08.843 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:40:08.844 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:40:08.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:40:08.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:40:08.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:40:08.848 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:40:08.849 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:40:08.849 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:40:08.849 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:40:08.849 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:40:08.849 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:40:08.849 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:40:08.849 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:40:08.849 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:40:08.849 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:40:08.849 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:40:08.850 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:40:08.850 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:40:08.850 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:40:08.850 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:40:08.850 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:40:08.850 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:40:08.850 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:40:08.850 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:40:08.850 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:40:08.850 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout:Install 148 Packages 2024-09-19T09:40:08.851 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 8 Packages 2024-09-19T09:40:08.852 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:40:08.852 INFO:teuthology.orchestra.run.smithi049.stdout:====================================================================================== 2024-09-19T09:40:08.852 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-19T09:40:08.852 INFO:teuthology.orchestra.run.smithi049.stdout:====================================================================================== 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:40:08.853 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:40:08.854 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:40:08.855 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:40:08.856 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2024-09-19T09:40:08.856 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:40:08.857 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:40:08.858 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:40:08.858 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:40:08.858 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:40:08.858 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:40:08.858 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:40:08.858 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:40:08.858 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:40:08.858 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:40:08.859 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:40:08.860 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:40:08.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:40:08.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:40:08.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:40:08.864 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:40:08.864 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:40:08.864 INFO:teuthology.orchestra.run.smithi049.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:40:08.864 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:40:08.864 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:40:08.864 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:40:08.864 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:40:08.864 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:40:08.865 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:40:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:Installing weak dependencies: 2024-09-19T09:40:08.867 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:40:08.867 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:40:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T09:40:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:====================================================================================== 2024-09-19T09:40:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:Install 148 Packages 2024-09-19T09:40:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 8 Packages 2024-09-19T09:40:08.867 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:40:08.867 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 226 M 2024-09-19T09:40:08.867 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-19T09:40:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 226 M 2024-09-19T09:40:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T09:40:09.434 INFO:teuthology.orchestra.run.smithi049.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 48 kB/s | 6.6 kB 00:00 2024-09-19T09:40:09.547 INFO:teuthology.orchestra.run.smithi162.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 45 kB/s | 6.6 kB 00:00 2024-09-19T09:40:09.642 INFO:teuthology.orchestra.run.smithi049.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.2 MB/s | 896 kB 00:00 2024-09-19T09:40:09.718 INFO:teuthology.orchestra.run.smithi049.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.9 MB/s | 145 kB 00:00 2024-09-19T09:40:09.799 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:40:09.800 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:40:09.814 INFO:teuthology.orchestra.run.smithi018.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:40:09.815 INFO:teuthology.orchestra.run.smithi018.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:40:09.816 INFO:teuthology.orchestra.run.smithi018.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:40:09.817 INFO:teuthology.orchestra.run.smithi018.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:40:09.818 INFO:teuthology.orchestra.run.smithi049.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-19T09:40:09.819 INFO:teuthology.orchestra.run.smithi018.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:40:09.822 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:40:09.823 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:40:09.890 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-19T09:40:09.904 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T09:40:09.904 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-19T09:40:09.904 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:40:09.905 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:40:09.906 INFO:teuthology.orchestra.run.smithi018.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:40:09.907 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:40:09.908 INFO:teuthology.orchestra.run.smithi018.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:40:09.909 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:40:09.910 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:40:09.911 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:40:09.912 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:40:09.913 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:40:09.914 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:40:09.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:40:09.916 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T09:40:09.917 INFO:teuthology.orchestra.run.smithi018.stdout:Install 148 Packages 2024-09-19T09:40:09.918 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 8 Packages 2024-09-19T09:40:09.918 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:40:09.918 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 226 M 2024-09-19T09:40:09.918 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-19T09:40:09.964 INFO:teuthology.orchestra.run.smithi162.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.1 MB/s | 896 kB 00:00 2024-09-19T09:40:09.969 INFO:teuthology.orchestra.run.smithi049.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-19T09:40:10.069 INFO:teuthology.orchestra.run.smithi049.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 6.8 MB/s | 2.4 MB 00:00 2024-09-19T09:40:10.089 INFO:teuthology.orchestra.run.smithi162.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.1 MB/s | 145 kB 00:00 2024-09-19T09:40:10.294 INFO:teuthology.orchestra.run.smithi049.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-19T09:40:10.511 INFO:teuthology.orchestra.run.smithi049.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 17 MB/s | 21 MB 00:01 2024-09-19T09:40:10.569 INFO:teuthology.orchestra.run.smithi049.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 433 kB/s | 25 kB 00:00 2024-09-19T09:40:10.598 INFO:teuthology.orchestra.run.smithi162.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 4.5 MB/s | 5.4 MB 00:01 2024-09-19T09:40:10.665 INFO:teuthology.orchestra.run.smithi162.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 4.1 MB/s | 2.4 MB 00:00 2024-09-19T09:40:10.862 INFO:teuthology.orchestra.run.smithi018.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 20 kB/s | 6.6 kB 00:00 2024-09-19T09:40:10.945 INFO:teuthology.orchestra.run.smithi049.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 16 MB/s | 11 MB 00:00 2024-09-19T09:40:11.019 INFO:teuthology.orchestra.run.smithi162.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 3.7 MB/s | 1.5 MB 00:00 2024-09-19T09:40:11.028 INFO:teuthology.orchestra.run.smithi049.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 2.7 MB/s | 228 kB 00:00 2024-09-19T09:40:11.103 INFO:teuthology.orchestra.run.smithi049.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 362 kB/s | 27 kB 00:00 2024-09-19T09:40:11.179 INFO:teuthology.orchestra.run.smithi049.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 422 kB/s | 32 kB 00:00 2024-09-19T09:40:11.287 INFO:teuthology.orchestra.run.smithi049.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-19T09:40:11.379 INFO:teuthology.orchestra.run.smithi049.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.7 MB/s | 163 kB 00:00 2024-09-19T09:40:11.463 INFO:teuthology.orchestra.run.smithi049.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.5 MB/s | 127 kB 00:00 2024-09-19T09:40:11.545 INFO:teuthology.orchestra.run.smithi018.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.3 MB/s | 896 kB 00:00 2024-09-19T09:40:11.563 INFO:teuthology.orchestra.run.smithi049.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 4.9 MB/s | 506 kB 00:00 2024-09-19T09:40:11.721 INFO:teuthology.orchestra.run.smithi018.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 830 kB/s | 145 kB 00:00 2024-09-19T09:40:11.947 INFO:teuthology.orchestra.run.smithi049.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 9.0 MB/s | 17 MB 00:01 2024-09-19T09:40:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 543 kB/s | 45 kB 00:00 2024-09-19T09:40:12.122 INFO:teuthology.orchestra.run.smithi049.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.5 MB/s | 136 kB 00:00 2024-09-19T09:40:12.206 INFO:teuthology.orchestra.run.smithi049.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.9 MB/s | 161 kB 00:00 2024-09-19T09:40:12.281 INFO:teuthology.orchestra.run.smithi049.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 7.4 MB/s | 5.3 MB 00:00 2024-09-19T09:40:12.287 INFO:teuthology.orchestra.run.smithi018.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.1 MB/s | 5.4 MB 00:01 2024-09-19T09:40:12.306 INFO:teuthology.orchestra.run.smithi049.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 3.1 MB/s | 320 kB 00:00 2024-09-19T09:40:12.348 INFO:teuthology.orchestra.run.smithi049.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T09:40:12.382 INFO:teuthology.orchestra.run.smithi049.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.3 MB/s | 99 kB 00:00 2024-09-19T09:40:12.406 INFO:teuthology.orchestra.run.smithi162.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 2.7 MB/s | 4.7 MB 00:01 2024-09-19T09:40:12.424 INFO:teuthology.orchestra.run.smithi049.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-19T09:40:12.513 INFO:teuthology.orchestra.run.smithi018.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 6.8 MB/s | 1.5 MB 00:00 2024-09-19T09:40:12.516 INFO:teuthology.orchestra.run.smithi049.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-19T09:40:12.580 INFO:teuthology.orchestra.run.smithi018.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.8 MB/s | 2.4 MB 00:00 2024-09-19T09:40:12.608 INFO:teuthology.orchestra.run.smithi049.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 347 kB/s | 32 kB 00:00 2024-09-19T09:40:12.701 INFO:teuthology.orchestra.run.smithi049.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.6 MB/s | 146 kB 00:00 2024-09-19T09:40:12.892 INFO:teuthology.orchestra.run.smithi049.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 6.1 MB/s | 3.1 MB 00:00 2024-09-19T09:40:13.218 INFO:teuthology.orchestra.run.smithi049.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 6.9 MB/s | 3.6 MB 00:00 2024-09-19T09:40:13.318 INFO:teuthology.orchestra.run.smithi049.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.4 MB/s | 249 kB 00:00 2024-09-19T09:40:13.355 INFO:teuthology.orchestra.run.smithi018.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 5.6 MB/s | 4.7 MB 00:00 2024-09-19T09:40:13.401 INFO:teuthology.orchestra.run.smithi049.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 592 kB/s | 49 kB 00:00 2024-09-19T09:40:13.502 INFO:teuthology.orchestra.run.smithi049.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 164 kB/s | 16 kB 00:00 2024-09-19T09:40:13.602 INFO:teuthology.orchestra.run.smithi049.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.8 MB/s | 285 kB 00:00 2024-09-19T09:40:13.919 INFO:teuthology.orchestra.run.smithi049.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 2.4 MB/s | 765 kB 00:00 2024-09-19T09:40:14.011 INFO:teuthology.orchestra.run.smithi049.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 199 kB/s | 18 kB 00:00 2024-09-19T09:40:14.186 INFO:teuthology.orchestra.run.smithi049.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 5.7 MB/s | 7.4 MB 00:01 2024-09-19T09:40:14.378 INFO:teuthology.orchestra.run.smithi049.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 217 kB/s | 80 kB 00:00 2024-09-19T09:40:14.457 INFO:teuthology.orchestra.run.smithi162.stdout:(8/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 4.9 MB/s | 17 MB 00:03 2024-09-19T09:40:14.532 INFO:teuthology.orchestra.run.smithi162.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 336 kB/s | 25 kB 00:00 2024-09-19T09:40:14.605 INFO:teuthology.orchestra.run.smithi018.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 8.5 MB/s | 11 MB 00:01 2024-09-19T09:40:14.663 INFO:teuthology.orchestra.run.smithi018.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 432 kB/s | 25 kB 00:00 2024-09-19T09:40:14.816 INFO:teuthology.orchestra.run.smithi162.stdout:(10/156): ceph-common-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 21 MB 00:05 2024-09-19T09:40:14.820 INFO:teuthology.orchestra.run.smithi049.stdout:(40/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 11 MB/s | 49 MB 00:04 2024-09-19T09:40:14.845 INFO:teuthology.orchestra.run.smithi049.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 409 kB/s | 191 kB 00:00 2024-09-19T09:40:14.933 INFO:teuthology.orchestra.run.smithi162.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.9 MB/s | 228 kB 00:00 2024-09-19T09:40:14.999 INFO:teuthology.orchestra.run.smithi162.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 406 kB/s | 27 kB 00:00 2024-09-19T09:40:15.075 INFO:teuthology.orchestra.run.smithi162.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 424 kB/s | 32 kB 00:00 2024-09-19T09:40:15.233 INFO:teuthology.orchestra.run.smithi162.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 4.6 MB/s | 751 kB 00:00 2024-09-19T09:40:15.272 INFO:teuthology.orchestra.run.smithi018.stdout:(10/156): ceph-common-19.1.1-361.g2f599a46.el9. 4.5 MB/s | 21 MB 00:04 2024-09-19T09:40:15.292 INFO:teuthology.orchestra.run.smithi162.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T09:40:15.313 INFO:teuthology.orchestra.run.smithi049.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 2.6 MB/s | 1.2 MB 00:00 2024-09-19T09:40:15.342 INFO:teuthology.orchestra.run.smithi162.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T09:40:15.379 INFO:teuthology.orchestra.run.smithi049.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 672 kB/s | 801 kB 00:01 2024-09-19T09:40:15.421 INFO:teuthology.orchestra.run.smithi049.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 983 kB/s | 106 kB 00:00 2024-09-19T09:40:15.434 INFO:teuthology.orchestra.run.smithi162.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.4 MB/s | 506 kB 00:00 2024-09-19T09:40:15.439 INFO:teuthology.orchestra.run.smithi018.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 5.9 MB/s | 17 MB 00:02 2024-09-19T09:40:15.455 INFO:teuthology.orchestra.run.smithi049.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 399 kB/s | 253 kB 00:00 2024-09-19T09:40:15.464 INFO:teuthology.orchestra.run.smithi018.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.2 MB/s | 228 kB 00:00 2024-09-19T09:40:15.488 INFO:teuthology.orchestra.run.smithi049.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-19T09:40:15.489 INFO:teuthology.orchestra.run.smithi018.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 541 kB/s | 27 kB 00:00 2024-09-19T09:40:15.523 INFO:teuthology.orchestra.run.smithi018.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 543 kB/s | 32 kB 00:00 2024-09-19T09:40:15.530 INFO:teuthology.orchestra.run.smithi049.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-19T09:40:15.568 INFO:teuthology.orchestra.run.smithi162.stdout:(18/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 3.4 MB/s | 11 MB 00:03 2024-09-19T09:40:15.573 INFO:teuthology.orchestra.run.smithi018.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T09:40:15.607 INFO:teuthology.orchestra.run.smithi018.stdout:(16/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.3 MB/s | 751 kB 00:00 2024-09-19T09:40:15.618 INFO:teuthology.orchestra.run.smithi162.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 909 kB/s | 45 kB 00:00 2024-09-19T09:40:15.632 INFO:teuthology.orchestra.run.smithi018.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T09:40:15.655 INFO:teuthology.orchestra.run.smithi049.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 7.4 MB/s | 943 kB 00:00 2024-09-19T09:40:15.668 INFO:teuthology.orchestra.run.smithi162.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T09:40:15.681 INFO:teuthology.orchestra.run.smithi049.stdout:(49/156): python3-urllib3-1.26.5-6.el9.noarch.r 951 kB/s | 215 kB 00:00 2024-09-19T09:40:15.691 INFO:teuthology.orchestra.run.smithi018.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 5.9 MB/s | 506 kB 00:00 2024-09-19T09:40:15.727 INFO:teuthology.orchestra.run.smithi162.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T09:40:15.766 INFO:teuthology.orchestra.run.smithi018.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 604 kB/s | 45 kB 00:00 2024-09-19T09:40:15.772 INFO:teuthology.orchestra.run.smithi049.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 915 kB/s | 107 kB 00:00 2024-09-19T09:40:15.789 INFO:teuthology.orchestra.run.smithi049.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-19T09:40:15.815 INFO:teuthology.orchestra.run.smithi049.stdout:(52/156): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-19T09:40:15.819 INFO:teuthology.orchestra.run.smithi162.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.4 MB/s | 320 kB 00:00 2024-09-19T09:40:15.833 INFO:teuthology.orchestra.run.smithi018.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T09:40:15.890 INFO:teuthology.orchestra.run.smithi049.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-19T09:40:15.900 INFO:teuthology.orchestra.run.smithi018.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.4 MB/s | 161 kB 00:00 2024-09-19T09:40:15.907 INFO:teuthology.orchestra.run.smithi049.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 279 kB/s | 33 kB 00:00 2024-09-19T09:40:15.928 INFO:teuthology.orchestra.run.smithi162.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.7 MB/s | 300 kB 00:00 2024-09-19T09:40:15.975 INFO:teuthology.orchestra.run.smithi018.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.2 MB/s | 320 kB 00:00 2024-09-19T09:40:15.986 INFO:teuthology.orchestra.run.smithi162.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T09:40:15.990 INFO:teuthology.orchestra.run.smithi049.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-09-19T09:40:16.016 INFO:teuthology.orchestra.run.smithi049.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-19T09:40:16.042 INFO:teuthology.orchestra.run.smithi018.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T09:40:16.053 INFO:teuthology.orchestra.run.smithi162.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.3 MB/s | 85 kB 00:00 2024-09-19T09:40:16.099 INFO:teuthology.orchestra.run.smithi049.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-19T09:40:16.109 INFO:teuthology.orchestra.run.smithi018.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.5 MB/s | 99 kB 00:00 2024-09-19T09:40:16.158 INFO:teuthology.orchestra.run.smithi049.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.7 MB/s | 3.0 MB 00:00 2024-09-19T09:40:16.183 INFO:teuthology.orchestra.run.smithi049.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 271 kB/s | 45 kB 00:00 2024-09-19T09:40:16.184 INFO:teuthology.orchestra.run.smithi018.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-19T09:40:16.217 INFO:teuthology.orchestra.run.smithi049.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-19T09:40:16.276 INFO:teuthology.orchestra.run.smithi049.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-19T09:40:16.301 INFO:teuthology.orchestra.run.smithi049.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 208 kB/s | 24 kB 00:00 2024-09-19T09:40:16.334 INFO:teuthology.orchestra.run.smithi049.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 404 kB/s | 47 kB 00:00 2024-09-19T09:40:16.393 INFO:teuthology.orchestra.run.smithi049.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-19T09:40:16.401 INFO:teuthology.orchestra.run.smithi018.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 6.9 MB/s | 5.3 MB 00:00 2024-09-19T09:40:16.419 INFO:teuthology.orchestra.run.smithi049.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-19T09:40:16.444 INFO:teuthology.orchestra.run.smithi049.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-19T09:40:16.477 INFO:teuthology.orchestra.run.smithi018.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-19T09:40:16.554 INFO:teuthology.orchestra.run.smithi162.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 4.8 MB/s | 5.3 MB 00:01 2024-09-19T09:40:16.561 INFO:teuthology.orchestra.run.smithi018.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 382 kB/s | 32 kB 00:00 2024-09-19T09:40:16.588 INFO:teuthology.orchestra.run.smithi049.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-19T09:40:16.612 INFO:teuthology.orchestra.run.smithi162.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T09:40:16.619 INFO:teuthology.orchestra.run.smithi018.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 7.1 MB/s | 3.1 MB 00:00 2024-09-19T09:40:16.653 INFO:teuthology.orchestra.run.smithi018.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.6 MB/s | 146 kB 00:00 2024-09-19T09:40:16.663 INFO:teuthology.orchestra.run.smithi162.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 636 kB/s | 32 kB 00:00 2024-09-19T09:40:16.728 INFO:teuthology.orchestra.run.smithi049.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-19T09:40:16.772 INFO:teuthology.orchestra.run.smithi162.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 4.3 MB/s | 3.1 MB 00:00 2024-09-19T09:40:16.805 INFO:teuthology.orchestra.run.smithi162.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.0 MB/s | 146 kB 00:00 2024-09-19T09:40:16.844 INFO:teuthology.orchestra.run.smithi049.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-19T09:40:17.020 INFO:teuthology.orchestra.run.smithi018.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 8.9 MB/s | 3.6 MB 00:00 2024-09-19T09:40:17.095 INFO:teuthology.orchestra.run.smithi018.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.3 MB/s | 249 kB 00:00 2024-09-19T09:40:17.162 INFO:teuthology.orchestra.run.smithi018.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 742 kB/s | 49 kB 00:00 2024-09-19T09:40:17.221 INFO:teuthology.orchestra.run.smithi018.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 281 kB/s | 16 kB 00:00 2024-09-19T09:40:17.296 INFO:teuthology.orchestra.run.smithi018.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T09:40:17.430 INFO:teuthology.orchestra.run.smithi018.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.6 MB/s | 765 kB 00:00 2024-09-19T09:40:17.505 INFO:teuthology.orchestra.run.smithi018.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 244 kB/s | 18 kB 00:00 2024-09-19T09:40:17.522 INFO:teuthology.orchestra.run.smithi162.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 4.8 MB/s | 3.6 MB 00:00 2024-09-19T09:40:17.653 INFO:teuthology.orchestra.run.smithi162.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 1.9 MB/s | 249 kB 00:00 2024-09-19T09:40:17.703 INFO:teuthology.orchestra.run.smithi162.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 988 kB/s | 49 kB 00:00 2024-09-19T09:40:17.713 INFO:teuthology.orchestra.run.smithi018.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 7.0 MB/s | 7.4 MB 00:01 2024-09-19T09:40:17.745 INFO:teuthology.orchestra.run.smithi162.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 395 kB/s | 16 kB 00:00 2024-09-19T09:40:17.845 INFO:teuthology.orchestra.run.smithi162.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.8 MB/s | 285 kB 00:00 2024-09-19T09:40:17.979 INFO:teuthology.orchestra.run.smithi162.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.6 MB/s | 765 kB 00:00 2024-09-19T09:40:18.029 INFO:teuthology.orchestra.run.smithi162.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 366 kB/s | 18 kB 00:00 2024-09-19T09:40:18.146 INFO:teuthology.orchestra.run.smithi162.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 5.5 MB/s | 7.4 MB 00:01 2024-09-19T09:40:18.263 INFO:teuthology.orchestra.run.smithi162.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 341 kB/s | 80 kB 00:00 2024-09-19T09:40:18.347 INFO:teuthology.orchestra.run.smithi162.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-19T09:40:18.355 INFO:teuthology.orchestra.run.smithi018.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 13 MB/s | 49 MB 00:03 2024-09-19T09:40:18.414 INFO:teuthology.orchestra.run.smithi162.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-19T09:40:18.448 INFO:teuthology.orchestra.run.smithi162.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-19T09:40:18.506 INFO:teuthology.orchestra.run.smithi162.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T09:40:18.540 INFO:teuthology.orchestra.run.smithi162.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-19T09:40:18.565 INFO:teuthology.orchestra.run.smithi162.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T09:40:18.578 INFO:teuthology.orchestra.run.smithi049.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-19T09:40:18.590 INFO:teuthology.orchestra.run.smithi162.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T09:40:18.622 INFO:teuthology.orchestra.run.smithi018.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 71 kB/s | 80 kB 00:01 2024-09-19T09:40:18.633 INFO:teuthology.orchestra.run.smithi162.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-19T09:40:18.766 INFO:teuthology.orchestra.run.smithi162.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 6.9 MB/s | 943 kB 00:00 2024-09-19T09:40:18.817 INFO:teuthology.orchestra.run.smithi162.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-19T09:40:18.867 INFO:teuthology.orchestra.run.smithi162.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-19T09:40:18.892 INFO:teuthology.orchestra.run.smithi162.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-19T09:40:18.943 INFO:teuthology.orchestra.run.smithi162.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-19T09:40:18.968 INFO:teuthology.orchestra.run.smithi162.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-19T09:40:19.069 INFO:teuthology.orchestra.run.smithi162.stdout:(54/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-19T09:40:19.081 INFO:teuthology.orchestra.run.smithi018.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 586 kB/s | 801 kB 00:01 2024-09-19T09:40:19.094 INFO:teuthology.orchestra.run.smithi162.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 145 kB/s | 18 kB 00:00 2024-09-19T09:40:19.136 INFO:teuthology.orchestra.run.smithi162.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-19T09:40:19.148 INFO:teuthology.orchestra.run.smithi018.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 244 kB/s | 191 kB 00:00 2024-09-19T09:40:19.178 INFO:teuthology.orchestra.run.smithi162.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-19T09:40:19.203 INFO:teuthology.orchestra.run.smithi162.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 674 kB/s | 45 kB 00:00 2024-09-19T09:40:19.270 INFO:teuthology.orchestra.run.smithi162.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-19T09:40:19.312 INFO:teuthology.orchestra.run.smithi162.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-19T09:40:19.346 INFO:teuthology.orchestra.run.smithi162.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-19T09:40:19.371 INFO:teuthology.orchestra.run.smithi162.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-09-19T09:40:19.390 INFO:teuthology.orchestra.run.smithi018.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 330 kB/s | 253 kB 00:00 2024-09-19T09:40:19.438 INFO:teuthology.orchestra.run.smithi162.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-09-19T09:40:19.463 INFO:teuthology.orchestra.run.smithi162.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-19T09:40:19.505 INFO:teuthology.orchestra.run.smithi162.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-19T09:40:19.622 INFO:teuthology.orchestra.run.smithi162.stdout:(66/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-19T09:40:19.698 INFO:teuthology.orchestra.run.smithi162.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 21 MB/s | 4.9 MB 00:00 2024-09-19T09:40:19.740 INFO:teuthology.orchestra.run.smithi162.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-19T09:40:19.790 INFO:teuthology.orchestra.run.smithi162.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-19T09:40:19.815 INFO:teuthology.orchestra.run.smithi018.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 160 kB/s | 106 kB 00:00 2024-09-19T09:40:19.815 INFO:teuthology.orchestra.run.smithi162.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-19T09:40:20.082 INFO:teuthology.orchestra.run.smithi018.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 195 kB/s | 135 kB 00:00 2024-09-19T09:40:20.095 INFO:teuthology.orchestra.run.smithi049.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 681 kB/s | 1.0 MB 00:01 2024-09-19T09:40:20.149 INFO:teuthology.orchestra.run.smithi018.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 1.1 MB/s | 1.2 MB 00:01 2024-09-19T09:40:20.258 INFO:teuthology.orchestra.run.smithi162.stdout:(71/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 8.5 MB/s | 49 MB 00:05 2024-09-19T09:40:20.291 INFO:teuthology.orchestra.run.smithi162.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.1 MB/s | 1.0 MB 00:00 2024-09-19T09:40:20.295 INFO:teuthology.orchestra.run.smithi049.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 437 kB/s | 87 kB 00:00 2024-09-19T09:40:20.316 INFO:teuthology.orchestra.run.smithi018.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 4.1 MB/s | 689 kB 00:00 2024-09-19T09:40:20.417 INFO:teuthology.orchestra.run.smithi162.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 9.2 MB/s | 5.8 MB 00:00 2024-09-19T09:40:20.442 INFO:teuthology.orchestra.run.smithi162.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 476 kB/s | 87 kB 00:00 2024-09-19T09:40:20.483 INFO:teuthology.orchestra.run.smithi018.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-09-19T09:40:20.517 INFO:teuthology.orchestra.run.smithi162.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2024-09-19T09:40:20.541 INFO:teuthology.orchestra.run.smithi018.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-19T09:40:20.542 INFO:teuthology.orchestra.run.smithi162.stdout:(76/156): python3-colorama-0.4.6-3.el9.noarch.r 488 kB/s | 61 kB 00:00 2024-09-19T09:40:20.567 INFO:teuthology.orchestra.run.smithi018.stdout:(50/156): python3-requests-2.25.1-8.el9.noarch. 166 kB/s | 125 kB 00:00 2024-09-19T09:40:20.568 INFO:teuthology.orchestra.run.smithi162.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi018.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 443 kB/s | 22 kB 00:00 2024-09-19T09:40:20.593 INFO:teuthology.orchestra.run.smithi162.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-19T09:40:20.627 INFO:teuthology.orchestra.run.smithi162.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 305 kB/s | 26 kB 00:00 2024-09-19T09:40:20.634 INFO:teuthology.orchestra.run.smithi018.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 786 kB/s | 33 kB 00:00 2024-09-19T09:40:20.652 INFO:teuthology.orchestra.run.smithi162.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 228 kB/s | 19 kB 00:00 2024-09-19T09:40:20.678 INFO:teuthology.orchestra.run.smithi162.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-19T09:40:20.702 INFO:teuthology.orchestra.run.smithi162.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 459 kB/s | 35 kB 00:00 2024-09-19T09:40:20.709 INFO:teuthology.orchestra.run.smithi018.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-09-19T09:40:20.745 INFO:teuthology.orchestra.run.smithi162.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-19T09:40:20.751 INFO:teuthology.orchestra.run.smithi018.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-09-19T09:40:20.770 INFO:teuthology.orchestra.run.smithi162.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-19T09:40:20.804 INFO:teuthology.orchestra.run.smithi162.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T09:40:20.804 INFO:teuthology.orchestra.run.smithi018.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T09:40:20.843 INFO:teuthology.orchestra.run.smithi018.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-19T09:40:20.879 INFO:teuthology.orchestra.run.smithi162.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-19T09:40:20.885 INFO:teuthology.orchestra.run.smithi018.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T09:40:20.904 INFO:teuthology.orchestra.run.smithi162.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 315 kB/s | 42 kB 00:00 2024-09-19T09:40:20.919 INFO:teuthology.orchestra.run.smithi018.stdout:(58/156): python3-urllib3-1.26.5-6.el9.noarch.r 257 kB/s | 215 kB 00:00 2024-09-19T09:40:20.929 INFO:teuthology.orchestra.run.smithi162.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-19T09:40:20.955 INFO:teuthology.orchestra.run.smithi162.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-19T09:40:20.988 INFO:teuthology.orchestra.run.smithi162.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 869 kB/s | 51 kB 00:00 2024-09-19T09:40:21.022 INFO:teuthology.orchestra.run.smithi162.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-19T09:40:21.044 INFO:teuthology.orchestra.run.smithi018.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-19T09:40:21.047 INFO:teuthology.orchestra.run.smithi162.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 581 kB/s | 54 kB 00:00 2024-09-19T09:40:21.079 INFO:teuthology.orchestra.run.smithi049.stdout:(73/156): openblas-openmp-0.3.26-2.el9.x86_64.r 1.1 MB/s | 4.9 MB 00:04 2024-09-19T09:40:21.095 INFO:teuthology.orchestra.run.smithi018.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-19T09:40:21.097 INFO:teuthology.orchestra.run.smithi162.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-09-19T09:40:21.123 INFO:teuthology.orchestra.run.smithi162.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 586 kB/s | 44 kB 00:00 2024-09-19T09:40:21.128 INFO:teuthology.orchestra.run.smithi018.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-19T09:40:21.154 INFO:teuthology.orchestra.run.smithi018.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-09-19T09:40:21.187 INFO:teuthology.orchestra.run.smithi049.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 566 kB/s | 61 kB 00:00 2024-09-19T09:40:21.196 INFO:teuthology.orchestra.run.smithi018.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-09-19T09:40:21.209 INFO:teuthology.orchestra.run.smithi162.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.9 MB/s | 221 kB 00:00 2024-09-19T09:40:21.232 INFO:teuthology.orchestra.run.smithi162.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-19T09:40:21.237 INFO:teuthology.orchestra.run.smithi018.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 928 kB/s | 38 kB 00:00 2024-09-19T09:40:21.263 INFO:teuthology.orchestra.run.smithi018.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-19T09:40:21.391 INFO:teuthology.orchestra.run.smithi162.stdout:(97/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-19T09:40:21.425 INFO:teuthology.orchestra.run.smithi162.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 220 kB/s | 47 kB 00:00 2024-09-19T09:40:21.450 INFO:teuthology.orchestra.run.smithi162.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-19T09:40:21.475 INFO:teuthology.orchestra.run.smithi162.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 688 kB/s | 58 kB 00:00 2024-09-19T09:40:21.500 INFO:teuthology.orchestra.run.smithi162.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-19T09:40:21.525 INFO:teuthology.orchestra.run.smithi162.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 842 kB/s | 64 kB 00:00 2024-09-19T09:40:21.551 INFO:teuthology.orchestra.run.smithi162.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 592 kB/s | 45 kB 00:00 2024-09-19T09:40:21.597 INFO:teuthology.orchestra.run.smithi049.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 1.2 MB/s | 5.8 MB 00:04 2024-09-19T09:40:21.618 INFO:teuthology.orchestra.run.smithi162.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-19T09:40:21.629 INFO:teuthology.orchestra.run.smithi049.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 554 kB/s | 245 kB 00:00 2024-09-19T09:40:21.638 INFO:teuthology.orchestra.run.smithi018.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.0 MB/s | 3.0 MB 00:01 2024-09-19T09:40:21.643 INFO:teuthology.orchestra.run.smithi162.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 156 kB/s | 22 kB 00:00 2024-09-19T09:40:21.669 INFO:teuthology.orchestra.run.smithi162.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 6.0 MB/s | 308 kB 00:00 2024-09-19T09:40:21.721 INFO:teuthology.orchestra.run.smithi049.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.0 MB/s | 248 kB 00:00 2024-09-19T09:40:21.738 INFO:teuthology.orchestra.run.smithi049.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-19T09:40:21.830 INFO:teuthology.orchestra.run.smithi049.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-19T09:40:21.836 INFO:teuthology.orchestra.run.smithi162.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 101 kB/s | 19 kB 00:00 2024-09-19T09:40:21.861 INFO:teuthology.orchestra.run.smithi162.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:40:21.886 INFO:teuthology.orchestra.run.smithi162.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:40:21.912 INFO:teuthology.orchestra.run.smithi162.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T09:40:21.930 INFO:teuthology.orchestra.run.smithi049.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-09-19T09:40:21.953 INFO:teuthology.orchestra.run.smithi162.stdout:(111/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-19T09:40:21.987 INFO:teuthology.orchestra.run.smithi162.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-19T09:40:22.030 INFO:teuthology.orchestra.run.smithi049.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 589 kB/s | 172 kB 00:00 2024-09-19T09:40:22.038 INFO:teuthology.orchestra.run.smithi162.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-19T09:40:22.063 INFO:teuthology.orchestra.run.smithi162.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:40:22.088 INFO:teuthology.orchestra.run.smithi162.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T09:40:22.105 INFO:teuthology.orchestra.run.smithi018.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.4 MB/s | 1.6 MB 00:00 2024-09-19T09:40:22.113 INFO:teuthology.orchestra.run.smithi162.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-19T09:40:22.155 INFO:teuthology.orchestra.run.smithi162.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-09-19T09:40:22.181 INFO:teuthology.orchestra.run.smithi162.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-19T09:40:22.206 INFO:teuthology.orchestra.run.smithi049.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-19T09:40:22.256 INFO:teuthology.orchestra.run.smithi162.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-09-19T09:40:22.290 INFO:teuthology.orchestra.run.smithi162.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-09-19T09:40:22.314 INFO:teuthology.orchestra.run.smithi018.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-09-19T09:40:22.315 INFO:teuthology.orchestra.run.smithi162.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-19T09:40:22.323 INFO:teuthology.orchestra.run.smithi049.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-19T09:40:22.349 INFO:teuthology.orchestra.run.smithi162.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.3 MB/s | 220 kB 00:00 2024-09-19T09:40:22.374 INFO:teuthology.orchestra.run.smithi162.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-19T09:40:22.381 INFO:teuthology.orchestra.run.smithi018.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T09:40:22.399 INFO:teuthology.orchestra.run.smithi162.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-09-19T09:40:22.406 INFO:teuthology.orchestra.run.smithi049.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 667 kB/s | 250 kB 00:00 2024-09-19T09:40:22.425 INFO:teuthology.orchestra.run.smithi162.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-19T09:40:22.432 INFO:teuthology.orchestra.run.smithi049.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 710 kB/s | 77 kB 00:00 2024-09-19T09:40:22.448 INFO:teuthology.orchestra.run.smithi018.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 2.6 MB/s | 910 kB 00:00 2024-09-19T09:40:22.450 INFO:teuthology.orchestra.run.smithi162.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-19T09:40:22.475 INFO:teuthology.orchestra.run.smithi162.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T09:40:22.501 INFO:teuthology.orchestra.run.smithi162.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-19T09:40:22.507 INFO:teuthology.orchestra.run.smithi049.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-09-19T09:40:22.526 INFO:teuthology.orchestra.run.smithi162.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:40:22.549 INFO:teuthology.orchestra.run.smithi049.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-19T09:40:22.551 INFO:teuthology.orchestra.run.smithi162.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:40:22.577 INFO:teuthology.orchestra.run.smithi162.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:40:22.619 INFO:teuthology.orchestra.run.smithi162.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-19T09:40:22.644 INFO:teuthology.orchestra.run.smithi162.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-19T09:40:22.648 INFO:teuthology.orchestra.run.smithi018.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.5 MB/s | 4.9 MB 00:01 2024-09-19T09:40:22.666 INFO:teuthology.orchestra.run.smithi049.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-19T09:40:22.669 INFO:teuthology.orchestra.run.smithi162.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-19T09:40:22.695 INFO:teuthology.orchestra.run.smithi162.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T09:40:22.720 INFO:teuthology.orchestra.run.smithi162.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T09:40:22.745 INFO:teuthology.orchestra.run.smithi162.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-19T09:40:22.766 INFO:teuthology.orchestra.run.smithi049.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 510 kB/s | 51 kB 00:00 2024-09-19T09:40:22.771 INFO:teuthology.orchestra.run.smithi162.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:40:22.781 INFO:teuthology.orchestra.run.smithi018.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 657 kB/s | 87 kB 00:00 2024-09-19T09:40:22.791 INFO:teuthology.orchestra.run.smithi049.stdout:(90/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 559 kB/s | 159 kB 00:00 2024-09-19T09:40:22.796 INFO:teuthology.orchestra.run.smithi162.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T09:40:22.821 INFO:teuthology.orchestra.run.smithi162.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T09:40:22.846 INFO:teuthology.orchestra.run.smithi162.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T09:40:22.865 INFO:teuthology.orchestra.run.smithi018.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.4 MB/s | 1.0 MB 00:00 2024-09-19T09:40:22.866 INFO:teuthology.orchestra.run.smithi049.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 536 kB/s | 54 kB 00:00 2024-09-19T09:40:22.872 INFO:teuthology.orchestra.run.smithi162.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T09:40:22.907 INFO:teuthology.orchestra.run.smithi018.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T09:40:22.914 INFO:teuthology.orchestra.run.smithi162.stdout:(143/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-09-19T09:40:22.947 INFO:teuthology.orchestra.run.smithi162.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-19T09:40:22.973 INFO:teuthology.orchestra.run.smithi162.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-19T09:40:22.975 INFO:teuthology.orchestra.run.smithi049.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-09-19T09:40:22.998 INFO:teuthology.orchestra.run.smithi162.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T09:40:23.007 INFO:teuthology.orchestra.run.smithi018.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T09:40:23.024 INFO:teuthology.orchestra.run.smithi162.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-19T09:40:23.074 INFO:teuthology.orchestra.run.smithi162.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T09:40:23.075 INFO:teuthology.orchestra.run.smithi049.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-09-19T09:40:23.099 INFO:teuthology.orchestra.run.smithi018.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-19T09:40:23.141 INFO:teuthology.orchestra.run.smithi018.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 616 kB/s | 26 kB 00:00 2024-09-19T09:40:23.183 INFO:teuthology.orchestra.run.smithi018.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-19T09:40:23.192 INFO:teuthology.orchestra.run.smithi049.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.9 MB/s | 221 kB 00:00 2024-09-19T09:40:23.258 INFO:teuthology.orchestra.run.smithi018.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-19T09:40:23.300 INFO:teuthology.orchestra.run.smithi018.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 834 kB/s | 35 kB 00:00 2024-09-19T09:40:23.301 INFO:teuthology.orchestra.run.smithi049.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 332 kB/s | 36 kB 00:00 2024-09-19T09:40:23.341 INFO:teuthology.orchestra.run.smithi162.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 10 MB/s | 3.4 MB 00:00 2024-09-19T09:40:23.391 INFO:teuthology.orchestra.run.smithi162.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 7.3 MB/s | 2.3 MB 00:00 2024-09-19T09:40:23.409 INFO:teuthology.orchestra.run.smithi049.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-09-19T09:40:23.441 INFO:teuthology.orchestra.run.smithi162.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 824 kB/s | 41 kB 00:00 2024-09-19T09:40:23.517 INFO:teuthology.orchestra.run.smithi162.stdout:(152/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.4 MB/s | 3.2 MB 00:00 2024-09-19T09:40:23.537 INFO:teuthology.orchestra.run.smithi049.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-19T09:40:23.542 INFO:teuthology.orchestra.run.smithi162.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.4 MB/s | 249 kB 00:00 2024-09-19T09:40:23.609 INFO:teuthology.orchestra.run.smithi162.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 6.7 MB/s | 1.8 MB 00:00 2024-09-19T09:40:23.635 INFO:teuthology.orchestra.run.smithi049.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 578 kB/s | 58 kB 00:00 2024-09-19T09:40:23.684 INFO:teuthology.orchestra.run.smithi162.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-09-19T09:40:23.744 INFO:teuthology.orchestra.run.smithi049.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 884 kB/s | 96 kB 00:00 2024-09-19T09:40:23.834 INFO:teuthology.orchestra.run.smithi162.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 1.4 MB 00:00 2024-09-19T09:40:23.841 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:40:23.841 INFO:teuthology.orchestra.run.smithi162.stdout:Total 15 MB/s | 226 MB 00:14 2024-09-19T09:40:23.844 INFO:teuthology.orchestra.run.smithi049.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 637 kB/s | 64 kB 00:00 2024-09-19T09:40:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 448 kB/s | 45 kB 00:00 2024-09-19T09:40:24.028 INFO:teuthology.orchestra.run.smithi049.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-09-19T09:40:24.184 INFO:teuthology.orchestra.run.smithi018.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.2 MB/s | 5.8 MB 00:01 2024-09-19T09:40:24.203 INFO:teuthology.orchestra.run.smithi049.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-19T09:40:24.262 INFO:teuthology.orchestra.run.smithi049.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T09:40:24.276 INFO:teuthology.orchestra.run.smithi018.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-19T09:40:24.296 INFO:teuthology.orchestra.run.smithi049.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T09:40:24.321 INFO:teuthology.orchestra.run.smithi049.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-19T09:40:24.360 INFO:teuthology.orchestra.run.smithi018.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T09:40:24.418 INFO:teuthology.orchestra.run.smithi018.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T09:40:24.446 INFO:teuthology.orchestra.run.smithi049.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-19T09:40:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T09:40:24.471 INFO:teuthology.orchestra.run.smithi049.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:40:24.496 INFO:teuthology.orchestra.run.smithi049.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:40:24.522 INFO:teuthology.orchestra.run.smithi049.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T09:40:24.547 INFO:teuthology.orchestra.run.smithi049.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-19T09:40:24.577 INFO:teuthology.orchestra.run.smithi018.stdout:(86/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-09-19T09:40:24.589 INFO:teuthology.orchestra.run.smithi049.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-19T09:40:24.619 INFO:teuthology.orchestra.run.smithi018.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-09-19T09:40:24.623 INFO:teuthology.orchestra.run.smithi049.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-19T09:40:24.648 INFO:teuthology.orchestra.run.smithi049.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:40:24.674 INFO:teuthology.orchestra.run.smithi049.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T09:40:24.678 INFO:teuthology.orchestra.run.smithi018.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-19T09:40:24.699 INFO:teuthology.orchestra.run.smithi049.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-19T09:40:24.719 INFO:teuthology.orchestra.run.smithi018.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T09:40:24.724 INFO:teuthology.orchestra.run.smithi049.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-19T09:40:24.757 INFO:teuthology.orchestra.run.smithi049.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-19T09:40:24.764 INFO:teuthology.orchestra.run.smithi018.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-19T09:40:24.791 INFO:teuthology.orchestra.run.smithi049.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-19T09:40:24.795 INFO:teuthology.orchestra.run.smithi018.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-09-19T09:40:24.816 INFO:teuthology.orchestra.run.smithi049.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-19T09:40:24.837 INFO:teuthology.orchestra.run.smithi018.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-19T09:40:24.892 INFO:teuthology.orchestra.run.smithi049.stdout:(121/156): python3-grpcio-1.46.7-10.el9.x86_64. 27 MB/s | 2.0 MB 00:00 2024-09-19T09:40:24.904 INFO:teuthology.orchestra.run.smithi018.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.2 MB/s | 5.1 MB 00:01 2024-09-19T09:40:24.917 INFO:teuthology.orchestra.run.smithi049.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T09:40:24.930 INFO:teuthology.orchestra.run.smithi018.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-09-19T09:40:24.967 INFO:teuthology.orchestra.run.smithi049.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-19T09:40:24.971 INFO:teuthology.orchestra.run.smithi018.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 864 kB/s | 36 kB 00:00 2024-09-19T09:40:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-19T09:40:25.013 INFO:teuthology.orchestra.run.smithi018.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-19T09:40:25.018 INFO:teuthology.orchestra.run.smithi049.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-19T09:40:25.039 INFO:teuthology.orchestra.run.smithi018.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-09-19T09:40:25.043 INFO:teuthology.orchestra.run.smithi049.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 773 kB/s | 19 kB 00:00 2024-09-19T09:40:25.069 INFO:teuthology.orchestra.run.smithi049.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-19T09:40:25.081 INFO:teuthology.orchestra.run.smithi018.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T09:40:25.092 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-19T09:40:25.110 INFO:teuthology.orchestra.run.smithi049.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 25 MB/s | 1.0 MB 00:00 2024-09-19T09:40:25.136 INFO:teuthology.orchestra.run.smithi049.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:40:25.139 INFO:teuthology.orchestra.run.smithi018.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-19T09:40:25.161 INFO:teuthology.orchestra.run.smithi049.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:40:25.164 INFO:teuthology.orchestra.run.smithi018.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-19T09:40:25.186 INFO:teuthology.orchestra.run.smithi049.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:40:25.206 INFO:teuthology.orchestra.run.smithi018.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-19T09:40:25.211 INFO:teuthology.orchestra.run.smithi049.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-19T09:40:25.232 INFO:teuthology.orchestra.run.smithi018.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-09-19T09:40:25.237 INFO:teuthology.orchestra.run.smithi049.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-19T09:40:25.244 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-19T09:40:25.244 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-19T09:40:25.270 INFO:teuthology.orchestra.run.smithi049.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-09-19T09:40:25.296 INFO:teuthology.orchestra.run.smithi049.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T09:40:25.315 INFO:teuthology.orchestra.run.smithi018.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-19T09:40:25.321 INFO:teuthology.orchestra.run.smithi049.stdout:(136/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-19T09:40:25.346 INFO:teuthology.orchestra.run.smithi049.stdout:(137/156): python3-routes-2.5.1-5.el9.noarch.rp 7.4 MB/s | 188 kB 00:00 2024-09-19T09:40:25.371 INFO:teuthology.orchestra.run.smithi049.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:40:25.374 INFO:teuthology.orchestra.run.smithi018.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T09:40:25.397 INFO:teuthology.orchestra.run.smithi049.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T09:40:25.416 INFO:teuthology.orchestra.run.smithi018.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T09:40:25.422 INFO:teuthology.orchestra.run.smithi049.stdout:(140/156): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-19T09:40:25.441 INFO:teuthology.orchestra.run.smithi018.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-19T09:40:25.447 INFO:teuthology.orchestra.run.smithi049.stdout:(141/156): python3-webob-1.8.8-2.el9.noarch.rpm 9.0 MB/s | 230 kB 00:00 2024-09-19T09:40:25.473 INFO:teuthology.orchestra.run.smithi049.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T09:40:25.515 INFO:teuthology.orchestra.run.smithi049.stdout:(143/156): python3-werkzeug-2.0.3-3.el9.1.noarc 10 MB/s | 427 kB 00:00 2024-09-19T09:40:25.531 INFO:teuthology.orchestra.run.smithi049.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-19T09:40:25.565 INFO:teuthology.orchestra.run.smithi049.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-19T09:40:25.575 INFO:teuthology.orchestra.run.smithi018.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-19T09:40:25.608 INFO:teuthology.orchestra.run.smithi018.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-19T09:40:25.624 INFO:teuthology.orchestra.run.smithi049.stdout:(146/156): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-19T09:40:25.633 INFO:teuthology.orchestra.run.smithi018.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-09-19T09:40:25.684 INFO:teuthology.orchestra.run.smithi018.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-19T09:40:25.718 INFO:teuthology.orchestra.run.smithi018.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 445 kB/s | 49 kB 00:00 2024-09-19T09:40:25.743 INFO:teuthology.orchestra.run.smithi018.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-19T09:40:25.793 INFO:teuthology.orchestra.run.smithi018.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T09:40:25.819 INFO:teuthology.orchestra.run.smithi018.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:40:25.844 INFO:teuthology.orchestra.run.smithi018.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T09:40:25.869 INFO:teuthology.orchestra.run.smithi018.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-19T09:40:25.903 INFO:teuthology.orchestra.run.smithi018.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-09-19T09:40:25.928 INFO:teuthology.orchestra.run.smithi018.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-19T09:40:25.962 INFO:teuthology.orchestra.run.smithi018.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T09:40:25.974 INFO:teuthology.orchestra.run.smithi049.stdout:(147/156): librados2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 3.4 MB 00:00 2024-09-19T09:40:25.995 INFO:teuthology.orchestra.run.smithi018.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-19T09:40:26.029 INFO:teuthology.orchestra.run.smithi018.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-19T09:40:26.063 INFO:teuthology.orchestra.run.smithi018.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-19T09:40:26.079 INFO:teuthology.orchestra.run.smithi018.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 652 kB/s | 11 kB 00:00 2024-09-19T09:40:26.096 INFO:teuthology.orchestra.run.smithi018.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-19T09:40:26.113 INFO:teuthology.orchestra.run.smithi018.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-19T09:40:26.130 INFO:teuthology.orchestra.run.smithi018.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-19T09:40:26.147 INFO:teuthology.orchestra.run.smithi018.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-19T09:40:26.206 INFO:teuthology.orchestra.run.smithi018.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2024-09-19T09:40:26.207 INFO:teuthology.orchestra.run.smithi049.stdout:(148/156): librbd1-19.1.1-361.g2f599a46.el9.x86 14 MB/s | 3.2 MB 00:00 2024-09-19T09:40:26.256 INFO:teuthology.orchestra.run.smithi018.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-09-19T09:40:26.282 INFO:teuthology.orchestra.run.smithi018.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-09-19T09:40:26.307 INFO:teuthology.orchestra.run.smithi018.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-19T09:40:26.332 INFO:teuthology.orchestra.run.smithi018.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T09:40:26.357 INFO:teuthology.orchestra.run.smithi018.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-19T09:40:26.383 INFO:teuthology.orchestra.run.smithi018.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T09:40:26.408 INFO:teuthology.orchestra.run.smithi018.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-19T09:40:26.434 INFO:teuthology.orchestra.run.smithi018.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-19T09:40:26.459 INFO:teuthology.orchestra.run.smithi018.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-19T09:40:26.484 INFO:teuthology.orchestra.run.smithi018.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:40:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 851 kB/s | 36 kB 00:00 2024-09-19T09:40:26.551 INFO:teuthology.orchestra.run.smithi018.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-19T09:40:26.577 INFO:teuthology.orchestra.run.smithi018.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T09:40:26.602 INFO:teuthology.orchestra.run.smithi018.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T09:40:26.627 INFO:teuthology.orchestra.run.smithi018.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T09:40:26.653 INFO:teuthology.orchestra.run.smithi018.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-09-19T09:40:26.687 INFO:teuthology.orchestra.run.smithi018.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-19T09:40:26.720 INFO:teuthology.orchestra.run.smithi018.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-19T09:40:26.854 INFO:teuthology.orchestra.run.smithi018.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-19T09:40:26.858 INFO:teuthology.orchestra.run.smithi049.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.6 MB/s | 2.3 MB 00:00 2024-09-19T09:40:27.008 INFO:teuthology.orchestra.run.smithi049.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 12 MB/s | 1.8 MB 00:00 2024-09-19T09:40:27.074 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-19T09:40:27.074 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-19T09:40:27.117 INFO:teuthology.orchestra.run.smithi049.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 377 kB/s | 41 kB 00:00 2024-09-19T09:40:27.130 INFO:teuthology.orchestra.run.smithi018.stdout:(148/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.9 MB/s | 16 MB 00:02 2024-09-19T09:40:27.234 INFO:teuthology.orchestra.run.smithi049.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-19T09:40:27.246 INFO:teuthology.orchestra.run.smithi018.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 6.5 MB/s | 3.4 MB 00:00 2024-09-19T09:40:27.296 INFO:teuthology.orchestra.run.smithi018.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.1 MB/s | 3.2 MB 00:00 2024-09-19T09:40:27.375 INFO:teuthology.orchestra.run.smithi049.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 1.4 MB 00:00 2024-09-19T09:40:27.534 INFO:teuthology.orchestra.run.smithi049.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-09-19T09:40:27.871 INFO:teuthology.orchestra.run.smithi018.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 71 kB/s | 41 kB 00:00 2024-09-19T09:40:27.876 INFO:teuthology.orchestra.run.smithi049.stdout:(155/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:05 2024-09-19T09:40:28.214 INFO:teuthology.orchestra.run.smithi018.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2024-09-19T09:40:28.235 INFO:teuthology.orchestra.run.smithi049.stdout:(156/156): python3-babel-2.9.1-2.el9.noarch.rpm 769 kB/s | 6.0 MB 00:07 2024-09-19T09:40:28.239 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:40:28.240 INFO:teuthology.orchestra.run.smithi049.stdout:Total 12 MB/s | 226 MB 00:19 2024-09-19T09:40:28.256 INFO:teuthology.orchestra.run.smithi018.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:01 2024-09-19T09:40:28.664 INFO:teuthology.orchestra.run.smithi018.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 314 kB/s | 249 kB 00:00 2024-09-19T09:40:29.189 INFO:teuthology.orchestra.run.smithi018.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-19T09:40:29.264 INFO:teuthology.orchestra.run.smithi018.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:01 2024-09-19T09:40:29.273 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:40:29.273 INFO:teuthology.orchestra.run.smithi018.stdout:Total 12 MB/s | 226 MB 00:19 2024-09-19T09:40:29.454 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T09:40:29.621 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T09:40:29.621 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T09:40:30.508 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-19T09:40:30.678 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-19T09:40:30.679 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-19T09:40:31.546 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T09:40:31.546 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T09:40:33.021 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-19T09:40:33.021 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-19T09:40:33.355 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-19T09:40:33.446 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:40:33.485 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:40:33.537 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:40:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:40:33.597 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:40:33.639 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:40:34.042 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:40:34.165 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:40:34.287 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:40:34.333 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:40:34.424 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:40:34.462 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:40:34.612 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:40:34.668 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:40:34.696 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:40:34.799 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:40:34.822 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:40:34.885 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:40:34.907 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:40:34.935 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:40:35.075 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:40:35.221 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:40:35.355 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:40:35.456 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:35.779 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:35.894 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:40:36.007 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:40:36.050 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:40:36.085 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:40:36.159 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:40:36.211 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:40:36.251 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:40:36.326 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:40:36.369 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:40:36.397 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:40:36.467 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:40:36.520 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:40:36.550 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:40:36.585 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:40:36.662 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:40:36.696 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:40:36.739 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:40:36.777 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:40:36.847 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:40:36.891 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:40:36.966 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:40:37.100 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:40:37.153 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:40:37.688 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:40:37.765 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:40:37.794 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:40:37.837 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:40:37.883 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:40:37.933 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:40:38.091 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:40:38.109 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T09:40:38.150 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:40:38.206 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:40:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:40:38.295 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:40:38.335 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:40:38.345 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:40:38.371 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:40:38.418 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:40:38.454 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:40:38.497 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:40:38.539 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:40:38.568 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:40:38.608 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:40:38.640 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:40:38.678 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:40:38.689 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:40:38.741 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:40:38.783 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:40:38.886 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:40:38.925 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:40:38.964 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:40:38.990 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:40:39.015 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:40:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:40:39.089 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:40:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:40:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:40:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:40:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:40:39.411 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-19T09:40:39.432 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:40:39.438 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:40:39.473 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:40:39.501 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:40:39.535 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:40:39.545 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:40:39.583 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:40:39.590 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:40:39.594 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:40:39.631 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:40:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:40:39.652 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:40:39.669 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:40:39.679 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:40:39.697 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:40:39.704 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:40:39.722 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:40:39.737 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:40:39.774 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:40:39.779 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:40:39.784 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:40:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:40:39.822 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:40:39.876 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:40:39.898 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:40:39.909 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:40:39.921 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:40:39.953 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:40:39.984 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:40:40.097 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:40:40.117 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:40:40.156 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:40:40.168 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:40:40.243 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:40:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:40:40.379 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:40:40.389 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:40:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:40:40.478 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:40.508 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:40:40.547 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:40:40.555 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:40:40.777 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:40:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:40:40.888 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:40:40.892 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:40:40.918 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:40:40.941 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:40:40.946 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:40:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:40:40.984 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:40:40.992 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:40:41.019 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:40:41.030 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:40:41.052 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:40:41.066 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:40:41.072 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:40:41.138 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:40:41.141 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:40:41.183 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:40:41.192 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:40:41.232 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:40:41.233 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:40:41.271 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:40:41.276 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:40:41.307 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:40:41.319 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:40:41.335 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:40:41.407 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:40:41.444 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:40:41.459 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:40:41.488 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:40:41.505 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:40:41.524 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:40:41.534 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:40:41.562 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:40:41.602 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:40:41.611 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:40:41.635 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:40:41.679 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:40:41.700 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:41.707 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:40:41.755 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:41.771 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:40:41.813 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:40:41.890 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:40:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:40:42.035 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:40:42.091 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:40:42.115 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:40:42.234 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:40:42.259 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:40:42.269 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:40:42.312 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:40:42.374 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:40:42.387 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:40:42.439 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:40:42.478 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:40:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:40:42.563 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:40:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:40:42.646 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:40:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:40:42.722 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:40:42.739 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:40:42.752 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:40:42.773 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:40:42.796 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:40:42.817 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:40:42.854 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:40:42.874 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:40:42.896 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:40:42.906 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:40:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:40:42.986 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:40:43.051 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:40:43.059 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:40:43.108 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:40:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:40:43.164 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:40:43.196 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:40:43.237 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:40:43.275 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:40:43.312 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:40:43.342 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:40:43.359 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:40:43.394 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:40:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:40:43.438 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:40:43.492 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:40:43.597 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:40:43.631 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:40:43.673 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:40:43.692 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:40:43.714 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:40:43.719 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:40:43.752 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:40:43.821 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:40:43.856 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:40:43.896 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:40:43.921 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:40:43.946 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:40:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:40:44.024 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:40:44.043 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:40:44.062 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:40:44.079 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:40:44.099 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:40:44.122 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:40:44.152 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:40:44.160 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:40:44.195 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:40:44.198 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:40:44.211 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:40:44.223 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:40:44.229 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:40:44.257 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:40:44.274 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:40:44.296 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:40:44.341 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:40:44.376 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:40:44.377 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:40:44.418 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:40:44.451 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:40:44.454 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:40:44.493 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:40:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:40:44.526 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:40:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:40:44.617 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:40:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:40:44.666 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:40:44.675 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:40:44.697 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:40:44.732 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:40:44.766 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:40:44.767 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:40:44.794 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:40:44.805 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:40:44.810 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:40:44.853 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:40:44.857 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:40:44.866 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:40:44.896 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:40:44.997 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:40:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:40:45.087 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:40:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:40:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:40:45.278 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:40:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:40:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:40:45.588 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:40:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:40:45.629 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:40:45.658 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:40:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:40:45.696 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:40:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:40:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:40:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:40:45.808 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:40:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:40:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:40:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:40:45.904 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:40:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:40:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:40:45.994 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:40:46.039 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:40:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:40:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:40:46.229 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:40:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:40:46.264 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:40:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:40:46.341 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:40:47.019 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:40:47.067 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:40:47.113 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:40:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:40:47.147 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:40:47.251 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:40:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:40:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:40:47.439 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:40:47.476 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:40:47.627 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:47.660 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:47.668 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:40:47.707 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:40:47.796 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:40:48.210 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:48.255 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:40:48.346 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:40:48.346 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:40:48.346 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:40:48.346 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:40:48.381 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:40:48.438 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:40:48.497 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:40:48.525 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:40:48.554 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:40:48.586 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:40:48.627 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:40:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:40:48.949 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:40:49.040 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:40:49.070 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:40:49.107 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:40:49.614 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:40:49.643 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:40:49.715 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:40:49.745 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:40:49.978 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:40:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:40:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:40:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:40:50.444 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:40:50.485 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:40:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:40:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:40:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:40:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:40:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:40:51.262 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:40:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:40:52.176 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:52.225 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:52.797 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:52.836 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:40:52.929 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:40:52.929 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:40:52.929 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:40:52.929 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:40:52.962 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:53.763 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:40:54.408 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:40:54.501 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:40:54.501 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:40:54.502 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:40:54.502 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:40:54.534 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:41:00.078 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:41:00.078 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-19T09:41:00.078 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-19T09:41:00.078 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-19T09:41:00.078 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-19T09:41:00.078 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-19T09:41:00.078 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-19T09:41:00.078 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-19T09:41:00.078 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:00.254 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:41:00.273 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:41:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:41:00.274 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:01.774 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:41:01.801 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:41:01.802 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:01.802 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:41:01.802 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:41:01.802 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:41:01.802 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:02.042 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:41:02.066 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:41:02.066 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:02.066 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:41:02.067 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:41:02.067 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:41:02.067 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:02.501 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:41:02.525 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:41:02.525 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:02.525 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:41:02.525 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:41:02.525 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:41:02.525 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:02.631 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:41:02.688 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:41:02.751 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:41:02.937 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:41:02.993 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:41:03.079 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:41:03.194 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:41:03.341 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:41:03.386 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:41:03.426 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:41:03.455 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:41:03.825 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:41:03.853 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:41:03.885 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:41:03.949 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:41:03.985 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:41:05.038 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:41:05.070 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:41:05.205 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:41:05.206 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2024-09-19T09:41:05.206 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2024-09-19T09:41:05.206 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2024-09-19T09:41:05.206 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2024-09-19T09:41:05.206 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2024-09-19T09:41:05.206 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /root 2024-09-19T09:41:05.206 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2024-09-19T09:41:05.206 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:05.382 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:41:05.399 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:41:05.399 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:05.399 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:41:05.399 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:06.039 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:41:06.070 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:41:06.175 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:41:06.351 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:41:06.381 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:41:06.405 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:41:06.405 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:06.406 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:41:06.406 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:41:06.406 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:41:06.406 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:06.457 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:41:06.469 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:41:06.566 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:41:06.622 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:41:06.843 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:41:06.843 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-09-19T09:41:06.843 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-09-19T09:41:06.844 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-09-19T09:41:06.844 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-09-19T09:41:06.844 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-09-19T09:41:06.844 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-09-19T09:41:06.844 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-09-19T09:41:06.844 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:06.926 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:41:06.954 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:41:06.954 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:06.954 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:41:06.954 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:41:06.955 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:41:06.955 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:41:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:41:07.056 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:07.057 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:41:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:07.193 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:41:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:41:07.218 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:07.218 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:41:07.218 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:41:07.218 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:41:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:07.546 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:41:07.576 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:41:07.600 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:41:07.600 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:07.601 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:41:07.601 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:41:07.601 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:41:07.601 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:07.644 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:41:07.667 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:41:07.667 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:07.667 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:41:07.667 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:07.678 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:41:07.703 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:41:07.703 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:07.703 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:41:07.703 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:41:07.703 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:41:07.703 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:07.719 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:41:07.743 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:41:07.744 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:07.744 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:41:07.744 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:41:07.744 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:41:07.744 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:41:07.867 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:41:07.930 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:41:08.045 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:41:08.069 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:41:08.069 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:08.069 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:41:08.069 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:41:08.069 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:41:08.070 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:08.123 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:41:08.171 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:41:08.251 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:41:08.340 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:41:08.481 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:41:08.529 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:41:08.561 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:41:08.588 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:41:08.591 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:41:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:41:08.620 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:08.620 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:41:08.620 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:41:08.620 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:41:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:08.867 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:41:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:41:08.891 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:08.891 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:41:08.892 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:41:08.892 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:41:08.892 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:08.935 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:41:08.962 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:41:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:41:09.057 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:41:09.084 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:41:09.351 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:41:09.375 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:41:09.376 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:09.376 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:41:09.376 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:41:09.376 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:41:09.376 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:09.490 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:41:09.548 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:41:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:41:09.807 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:41:09.861 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:41:09.943 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:41:10.049 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:41:10.191 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:41:10.192 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:41:10.228 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:41:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:41:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:41:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:41:10.777 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:41:10.802 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:41:10.835 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:41:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:41:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:41:11.241 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:41:11.270 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:41:11.379 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:41:11.548 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:41:11.581 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:41:11.605 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:41:11.605 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:11.605 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:41:11.605 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:41:11.606 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:41:11.606 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:11.656 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:41:11.667 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:41:11.769 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:41:11.822 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:41:12.036 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:41:12.077 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:41:12.649 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:41:12.691 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:41:12.732 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:41:12.764 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:41:12.791 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:41:12.796 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:41:12.833 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:41:12.858 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:41:12.858 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:12.858 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:41:12.858 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:41:12.859 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:41:12.859 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:12.901 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:41:12.925 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:41:12.925 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:12.925 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:41:12.925 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:12.976 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:41:12.984 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:41:13.009 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:41:13.009 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:13.009 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:41:13.009 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:41:13.009 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:41:13.010 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:13.022 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:41:13.052 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:41:13.081 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:41:13.095 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:41:13.128 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:41:13.135 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:41:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:41:13.344 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:41:13.368 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:41:13.368 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:13.368 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:41:13.369 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:41:13.369 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:41:13.369 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:41:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:41:13.472 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:41:13.473 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:13.473 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:41:13.473 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:41:13.473 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:41:13.473 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:13.522 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:41:13.534 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:41:13.650 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:41:13.721 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:41:13.755 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:13.801 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:13.822 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:14.678 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:41:14.702 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:41:14.733 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:41:14.758 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:41:14.758 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:14.758 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:41:14.758 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:41:14.758 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:41:14.759 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:14.774 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:41:14.808 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:41:14.815 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:41:14.832 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:41:14.832 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:14.833 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:41:14.833 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:14.892 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:41:14.898 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:41:14.917 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:41:14.917 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:14.917 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:41:14.917 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:41:14.917 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:41:14.917 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:14.927 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:41:14.954 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:41:14.987 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:41:14.987 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:41:15.080 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:41:15.080 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:41:15.164 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:41:15.189 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:41:15.195 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:15.195 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:41:15.276 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:41:15.276 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:41:15.276 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:41:15.276 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:41:15.276 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:41:15.277 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:15.374 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:41:15.475 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:41:15.546 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:18.181 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:41:18.223 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:41:18.264 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:41:18.295 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:41:18.323 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:41:18.516 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:41:18.572 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:41:18.599 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:41:18.629 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:41:18.667 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:41:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:19.398 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:19.419 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:20.122 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:41:20.164 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:41:20.205 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:41:20.236 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:41:20.264 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:41:20.317 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:41:20.411 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:41:20.453 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:41:20.474 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:41:20.527 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:41:20.536 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:41:20.557 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:41:20.580 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:41:20.587 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:41:20.606 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:41:20.632 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:41:20.632 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:41:20.633 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:41:20.707 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:41:20.707 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:41:20.775 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:41:20.799 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:41:20.805 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:20.805 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:21.002 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:21.002 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:41:21.094 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:41:21.161 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:21.214 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:21.256 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:21.277 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:41:21.319 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:21.319 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:41:21.319 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:41:21.319 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:41:21.319 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:41:21.319 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:41:21.319 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:41:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:41:21.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:41:21.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:41:21.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:41:21.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:41:21.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:41:21.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:41:21.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:41:21.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:41:21.321 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:41:21.333 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:41:21.333 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:41:21.333 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:41:21.334 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:41:21.335 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:41:21.336 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:41:21.337 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:41:21.338 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:41:21.339 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:41:21.340 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:41:21.341 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:41:21.342 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:41:21.343 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:41:21.344 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:41:22.199 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:41:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:41:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:41:22.434 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:41:22.472 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:41:22.506 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:41:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:41:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:41:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:41:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:41:22.692 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:41:22.717 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:41:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:22.902 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:41:22.902 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:41:22.978 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:41:23.048 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:23.941 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:23.941 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:41:23.942 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:23.943 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:23.944 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:41:23.945 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:41:23.946 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:41:23.946 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:41:23.946 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.946 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.946 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.946 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:41:23.946 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:41:23.946 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:41:23.946 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:41:23.946 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:41:23.947 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:41:23.948 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:41:23.949 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:41:23.950 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:41:23.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:41:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:41:23.953 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:41:23.954 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:41:23.954 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.954 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.954 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:23.954 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:41:23.954 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:41:23.954 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:41:23.954 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:41:23.954 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:41:23.954 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:41:23.955 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:41:23.955 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:41:23.955 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-19T09:41:24.420 DEBUG:teuthology.parallel:result is None 2024-09-19T09:41:26.756 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:26.757 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:41:26.757 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:41:26.757 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:41:26.757 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:41:26.757 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:41:26.757 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:41:26.757 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:41:26.757 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:41:26.757 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:41:26.757 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:41:26.758 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:41:26.759 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:41:26.759 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:41:26.759 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:41:26.759 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:41:26.759 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:41:26.759 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:41:26.759 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:41:26.771 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:41:26.771 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:41:26.771 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:41:26.771 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:41:26.771 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:41:26.771 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:41:26.771 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:41:26.771 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:41:26.771 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:41:26.772 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:41:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:41:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:41:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:41:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:41:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:41:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:41:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:41:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:41:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:41:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:41:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:41:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:41:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:41:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:41:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:41:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:41:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:41:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:41:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:41:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:41:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:41:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:41:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:41:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:41:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:41:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:41:28.666 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:41:28.667 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:41:28.668 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:41:28.669 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:41:28.670 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:41:28.671 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:41:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:41:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:41:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:41:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:41:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:41:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:41:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:41:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:41:28.672 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:41:28.673 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:41:28.674 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:41:28.675 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:41:28.676 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:41:28.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:41:28.678 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:41:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:41:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:41:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:41:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:41:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:41:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:41:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:41:28.679 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:41:29.591 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:29.591 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:29.591 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2024-09-19T09:41:29.591 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:29.591 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:41:29.592 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:29.593 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:29.594 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.595 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:41:29.596 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:41:29.597 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:41:29.598 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:41:29.599 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:41:29.600 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.601 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:41:29.602 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:41:29.603 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:41:29.604 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:41:29.604 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:41:29.604 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:41:29.604 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T09:41:30.123 DEBUG:teuthology.parallel:result is None 2024-09-19T09:41:31.297 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:41:31.297 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:41:31.298 INFO:teuthology.orchestra.run.smithi018.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:31.299 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:31.300 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:41:31.301 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:41:31.302 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.303 INFO:teuthology.orchestra.run.smithi018.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:41:31.303 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:41:31.303 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:41:31.303 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:41:31.303 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:41:31.303 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:41:31.303 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:41:31.303 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:41:31.304 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:41:31.305 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:41:31.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:41:31.307 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:41:31.308 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:41:31.309 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:41:31.310 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:41:31.311 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:41:31.311 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:41:31.311 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-19T09:41:31.742 DEBUG:teuthology.parallel:result is None 2024-09-19T09:41:31.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:41:31.882 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:41:31.905 INFO:teuthology.orchestra.run.smithi018.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:41:31.906 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:41:31.906 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:41:31.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:41:32.049 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:41:32.076 INFO:teuthology.orchestra.run.smithi049.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:41:32.077 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:41:32.077 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:41:32.079 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:41:32.221 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:41:32.248 INFO:teuthology.orchestra.run.smithi162.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:41:32.249 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:41:32.249 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:41:32.252 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T09:41:32.252 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:41:32.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:41:32.285 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:41:32.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:41:32.319 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:41:32.319 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:41:32.352 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T09:41:32.352 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:41:32.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:41:32.382 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:41:32.451 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:41:32.451 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:41:32.482 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:41:32.552 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:41:32.553 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:41:32.582 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:41:32.651 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T09:41:32.652 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:41:32.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:41:32.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:41:32.756 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:41:32.756 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:41:32.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:41:32.858 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:41:32.858 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:41:32.891 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:41:32.964 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T09:41:32.964 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:41:32.964 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:41:32.996 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:41:33.067 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:41:33.067 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:41:33.098 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:41:33.169 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:41:33.169 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:41:33.198 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:41:33.264 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T09:41:33.359 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-19T09:41:33.360 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:41:33.360 INFO:tasks.cephadm:Cluster fsid is 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:41:33.360 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T09:41:33.360 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.18', 'mon.b': '172.21.15.49', 'mon.c': '172.21.15.162'} 2024-09-19T09:41:33.361 INFO:tasks.cephadm:First mon is mon.a on smithi018 2024-09-19T09:41:33.361 INFO:tasks.cephadm:First mgr is x 2024-09-19T09:41:33.361 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T09:41:33.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname $(hostname -s) 2024-09-19T09:41:33.393 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname $(hostname -s) 2024-09-19T09:41:33.425 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-09-19T09:41:33.453 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T09:41:33.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:41:33.601 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T09:41:33.748 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:41:33.750 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T09:41:33.750 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T09:41:33.750 DEBUG:teuthology.orchestra.run.smithi018:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:34.158 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:41 /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:34.159 DEBUG:teuthology.orchestra.run.smithi049:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:34.674 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:41 /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:34.675 DEBUG:teuthology.orchestra.run.smithi162:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:35.440 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:41 /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:35.441 DEBUG:teuthology.orchestra.run.smithi018:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:35.461 DEBUG:teuthology.orchestra.run.smithi049:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:35.481 DEBUG:teuthology.orchestra.run.smithi162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:35.518 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T09:41:35.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:41:35.521 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:41:35.524 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:41:37.045 INFO:teuthology.orchestra.run.smithi018.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:41:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:41:37.217 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:42:07.980 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T09:42:07.980 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:42:07.981 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:42:07.981 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-09-19T09:42:07.981 INFO:teuthology.orchestra.run.smithi162.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:42:07.981 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-19T09:42:07.981 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi049.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi049.stdout: "repo_digests": [ 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi049.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:42:26.485 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:42:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:42:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:42:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: "repo_digests": [ 2024-09-19T09:42:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:42:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:42:26.486 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:42:26.512 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph 2024-09-19T09:42:26.568 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph 2024-09-19T09:42:26.603 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-09-19T09:42:26.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /etc/ceph 2024-09-19T09:42:26.664 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /etc/ceph 2024-09-19T09:42:26.694 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-09-19T09:42:26.723 INFO:tasks.cephadm:Writing seed config... 2024-09-19T09:42:26.724 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T09:42:26.724 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T09:42:26.725 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T09:42:26.726 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T09:42:26.726 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T09:42:26.726 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T09:42:26.726 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T09:42:26.726 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T09:42:26.726 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T09:42:26.726 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T09:42:26.726 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T09:42:26.726 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T09:42:26.727 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T09:42:26.728 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T09:42:26.728 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T09:42:26.728 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T09:42:26.728 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T09:42:26.728 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T09:42:26.728 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T09:42:26.728 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T09:42:26.728 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T09:42:26.728 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T09:42:26.728 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T09:42:26.729 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:42:26.729 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T09:42:26.746 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5b174660-766b-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T09:42:26.746 DEBUG:teuthology.orchestra.run.smithi018:mon.a> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T09:42:26.788 DEBUG:teuthology.orchestra.run.smithi018:mgr.x> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T09:42:26.830 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T09:42:26.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 5b174660-766b-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.18 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:42:27.039 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:42:27.039 INFO:teuthology.orchestra.run.smithi018.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '5b174660-766b-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.18', '--skip-admin-label'] 2024-09-19T09:42:27.039 INFO:teuthology.orchestra.run.smithi018.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T09:42:27.040 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying podman|docker is present... 2024-09-19T09:42:27.064 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:42:27.064 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying lvm2 is present... 2024-09-19T09:42:27.065 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying time synchronization is in place... 2024-09-19T09:42:27.072 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:42:27.073 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:42:27.079 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:42:27.079 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T09:42:27.086 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout enabled 2024-09-19T09:42:27.093 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout active 2024-09-19T09:42:27.093 INFO:teuthology.orchestra.run.smithi018.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:42:27.093 INFO:teuthology.orchestra.run.smithi018.stdout:Repeating the final host check... 2024-09-19T09:42:27.116 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:42:27.116 INFO:teuthology.orchestra.run.smithi018.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T09:42:27.117 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl is present 2024-09-19T09:42:27.117 INFO:teuthology.orchestra.run.smithi018.stdout:lvcreate is present 2024-09-19T09:42:27.123 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:42:27.123 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:42:27.130 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:42:27.130 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T09:42:27.137 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout enabled 2024-09-19T09:42:27.144 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout active 2024-09-19T09:42:27.144 INFO:teuthology.orchestra.run.smithi018.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:42:27.144 INFO:teuthology.orchestra.run.smithi018.stdout:Host looks OK 2024-09-19T09:42:27.144 INFO:teuthology.orchestra.run.smithi018.stdout:Cluster fsid: 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:42:27.144 INFO:teuthology.orchestra.run.smithi018.stdout:Acquiring lock 140414658233344 on /run/cephadm/5b174660-766b-11ef-bceb-c7b262605968.lock 2024-09-19T09:42:27.144 INFO:teuthology.orchestra.run.smithi018.stdout:Lock 140414658233344 acquired on /run/cephadm/5b174660-766b-11ef-bceb-c7b262605968.lock 2024-09-19T09:42:27.144 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying IP 172.21.15.18 port 3300 ... 2024-09-19T09:42:27.145 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying IP 172.21.15.18 port 6789 ... 2024-09-19T09:42:27.145 INFO:teuthology.orchestra.run.smithi018.stdout:Base mon IP(s) is [172.21.15.18:3300, 172.21.15.18:6789], mon addrv is [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-19T09:42:27.148 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.18 metric 100 2024-09-19T09:42:27.148 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.18 metric 100 2024-09-19T09:42:27.151 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T09:42:27.151 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T09:42:27.151 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-09-19T09:42:27.153 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T09:42:27.153 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T09:42:27.153 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:42:27.154 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T09:42:27.154 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:42:27.154 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:42:27.154 INFO:teuthology.orchestra.run.smithi018.stdout:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-09-19T09:42:27.154 INFO:teuthology.orchestra.run.smithi018.stdout:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-09-19T09:42:27.155 INFO:teuthology.orchestra.run.smithi018.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T09:42:27.155 INFO:teuthology.orchestra.run.smithi018.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T09:42:27.155 INFO:teuthology.orchestra.run.smithi018.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:42:27.604 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T09:42:27.605 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:42:27.605 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T09:42:27.605 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T09:42:27.605 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T09:42:27.605 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T09:42:27.605 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T09:42:28.425 INFO:teuthology.orchestra.run.smithi018.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T09:42:28.426 INFO:teuthology.orchestra.run.smithi018.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T09:42:28.426 INFO:teuthology.orchestra.run.smithi018.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T09:42:29.431 INFO:teuthology.orchestra.run.smithi018.stdout:stat: stdout 167 167 2024-09-19T09:42:29.431 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial keys... 2024-09-19T09:42:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQAF8utmC2yJLRAAFYkPipmK15m/0Ez5XrxGAA== 2024-09-19T09:42:31.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQAG8utmw8vMJxAAgo4ABEmyIBPPwa8TITQjAQ== 2024-09-19T09:42:32.138 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQAH8utm1vWiIBAAspzx4AK4pCJeBjh6ZUT2Ew== 2024-09-19T09:42:32.139 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial monmap... 2024-09-19T09:42:33.102 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:42:33.102 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T09:42:33.102 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:42:33.102 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:42:33.103 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool for a [v2:172.21.15.18:3300,v1:172.21.15.18:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:42:33.103 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-09-19T09:42:33.103 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: set fsid to 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:42:33.103 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:42:33.103 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:42:33.103 INFO:teuthology.orchestra.run.smithi018.stdout:Creating mon... 2024-09-19T09:42:34.057 INFO:teuthology.orchestra.run.smithi018.stdout:create mon.a on 2024-09-19T09:42:34.279 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T09:42:34.432 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T09:42:34.601 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5b174660-766b-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-5b174660-766b-11ef-bceb-c7b262605968.target. 2024-09-19T09:42:34.601 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5b174660-766b-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-5b174660-766b-11ef-bceb-c7b262605968.target. 2024-09-19T09:42:34.856 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:42:34.856 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T09:42:35.021 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5b174660-766b-11ef-bceb-c7b262605968.target.wants/ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-5b174660-766b-11ef-bceb-c7b262605968@.service. 2024-09-19T09:42:35.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:35 smithi018 ceph-mon[30586]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:42:35.534 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:35 smithi018 bash[30567]: 24c66e5d6fbe9fa5090df75581c59386119d4f2de59a4fcffbcdfff3f89d13eb 2024-09-19T09:42:35.548 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:42:35.549 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-19T09:42:35.556 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:42:35.556 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T09:42:35.556 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-19T09:42:35.556 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:42:35.556 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mon to start... 2024-09-19T09:42:35.557 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mon... 2024-09-19T09:42:35.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:35 smithi018 systemd[1]: Started Ceph mon.a for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:42:36.615 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout id: 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout services: 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.514668s) 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout data: 2024-09-19T09:42:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.940+0000 7fb1396aa640 1 Processor -- start 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.940+0000 7fb1396aa640 1 -- start start 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.940+0000 7fb1396aa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13407c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.940+0000 7fb1396aa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb13407c8f0 con 0x7fb13407dec0 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.941+0000 7fb132ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13407c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.941+0000 7fb132ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13407c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46974/0 (socket says 172.21.15.18:46974) 2024-09-19T09:42:36.617 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.941+0000 7fb132ffd640 1 -- 172.21.15.18:0/1925591268 learned_addr learned my addr 172.21.15.18:0/1925591268 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.941+0000 7fb132ffd640 1 -- 172.21.15.18:0/1925591268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13407ca70 con 0x7fb13407dec0 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.943+0000 7fb132ffd640 1 --2- 172.21.15.18:0/1925591268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13407c320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009e80 tx=0x7fb12c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244a7efb1c83ce14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.943+0000 7fb131ffb640 1 -- 172.21.15.18:0/1925591268 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12c036070 con 0x7fb13407dec0 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.943+0000 7fb131ffb640 1 -- 172.21.15.18:0/1925591268 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c031400 con 0x7fb13407dec0 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.943+0000 7fb131ffb640 1 -- 172.21.15.18:0/1925591268 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12c031700 con 0x7fb13407dec0 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.944+0000 7fb1396aa640 1 -- 172.21.15.18:0/1925591268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 msgr2=0x7fb13407c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.944+0000 7fb1396aa640 1 --2- 172.21.15.18:0/1925591268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13407c320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009e80 tx=0x7fb12c02a7a0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.944+0000 7fb1396aa640 1 -- 172.21.15.18:0/1925591268 shutdown_connections 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.944+0000 7fb1396aa640 1 --2- 172.21.15.18:0/1925591268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13407c320 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.944+0000 7fb1396aa640 1 -- 172.21.15.18:0/1925591268 >> 172.21.15.18:0/1925591268 conn(0x7fb134102e80 msgr2=0x7fb1341052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:36.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.944+0000 7fb1396aa640 1 -- 172.21.15.18:0/1925591268 shutdown_connections 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.944+0000 7fb1396aa640 1 -- 172.21.15.18:0/1925591268 wait complete. 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.945+0000 7fb1396aa640 1 Processor -- start 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.945+0000 7fb1396aa640 1 -- start start 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.945+0000 7fb1396aa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13419d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.945+0000 7fb1396aa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb13407cfa0 con 0x7fb13407dec0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.945+0000 7fb132ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13419d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.945+0000 7fb132ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13419d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46976/0 (socket says 172.21.15.18:46976) 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.945+0000 7fb132ffd640 1 -- 172.21.15.18:0/87515423 learned_addr learned my addr 172.21.15.18:0/87515423 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.945+0000 7fb132ffd640 1 -- 172.21.15.18:0/87515423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13419d590 con 0x7fb13407dec0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.946+0000 7fb132ffd640 1 --2- 172.21.15.18:0/87515423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13419d050 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb12c034040 tx=0x7fb12c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.946+0000 7fb12bfff640 1 -- 172.21.15.18:0/87515423 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12c041020 con 0x7fb13407dec0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.946+0000 7fb12bfff640 1 -- 172.21.15.18:0/87515423 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c03c660 con 0x7fb13407dec0 2024-09-19T09:42:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.946+0000 7fb12bfff640 1 -- 172.21.15.18:0/87515423 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12c036040 con 0x7fb13407dec0 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.946+0000 7fb1396aa640 1 -- 172.21.15.18:0/87515423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb13419d820 con 0x7fb13407dec0 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.946+0000 7fb1396aa640 1 -- 172.21.15.18:0/87515423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1341a0510 con 0x7fb13407dec0 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.946+0000 7fb12bfff640 1 -- 172.21.15.18:0/87515423 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb12c044020 con 0x7fb13407dec0 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.946+0000 7fb12bfff640 1 -- 172.21.15.18:0/87515423 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb12c03d940 con 0x7fb13407dec0 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.947+0000 7fb1396aa640 1 -- 172.21.15.18:0/87515423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb13407c3a0 con 0x7fb13407dec0 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:35.949+0000 7fb12bfff640 1 -- 172.21.15.18:0/87515423 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb12c04b030 con 0x7fb13407dec0 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:36.010+0000 7fb1396aa640 1 -- 172.21.15.18:0/87515423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fb13402d910 con 0x7fb13407dec0 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:36.011+0000 7fb12bfff640 1 -- 172.21.15.18:0/87515423 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fb12c03d420 con 0x7fb13407dec0 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:36.011+0000 7fb1396aa640 1 -- 172.21.15.18:0/87515423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 msgr2=0x7fb13419d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:36.011+0000 7fb1396aa640 1 --2- 172.21.15.18:0/87515423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13419d050 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb12c034040 tx=0x7fb12c004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:36.011+0000 7fb1396aa640 1 -- 172.21.15.18:0/87515423 shutdown_connections 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:36.011+0000 7fb1396aa640 1 --2- 172.21.15.18:0/87515423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb13407dec0 0x7fb13419d050 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:36.011+0000 7fb1396aa640 1 -- 172.21.15.18:0/87515423 >> 172.21.15.18:0/87515423 conn(0x7fb134102e80 msgr2=0x7fb134103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:36.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:36.012+0000 7fb1396aa640 1 -- 172.21.15.18:0/87515423 shutdown_connections 2024-09-19T09:42:36.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:36.012+0000 7fb1396aa640 1 -- 172.21.15.18:0/87515423 wait complete. 2024-09-19T09:42:36.621 INFO:teuthology.orchestra.run.smithi018.stdout:mon is available 2024-09-19T09:42:36.621 INFO:teuthology.orchestra.run.smithi018.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T09:42:36.733 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:42:36.733 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: monmap epoch 1 2024-09-19T09:42:36.733 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:42:36.733 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: last_changed 2024-09-19T09:42:32.493034+0000 2024-09-19T09:42:36.733 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: created 2024-09-19T09:42:32.493034+0000 2024-09-19T09:42:36.733 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: min_mon_release 19 (squid) 2024-09-19T09:42:36.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: election_strategy: 1 2024-09-19T09:42:36.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:42:36.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: fsmap 2024-09-19T09:42:36.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:42:36.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: mgrmap e1: no daemons active 2024-09-19T09:42:36.734 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:36 smithi018 ceph-mon[30586]: from='client.? 172.21.15.18:0/87515423' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T09:42:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:42:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:42:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout fsid = 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:42:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-19T09:42:37.622 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:42:37.623 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:42:37.624 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:42:37.624 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.010+0000 7f4ed2fa1640 1 Processor -- start 2024-09-19T09:42:37.624 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.011+0000 7f4ed2fa1640 1 -- start start 2024-09-19T09:42:37.624 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.011+0000 7f4ed2fa1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc10a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.624 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.011+0000 7f4ed2fa1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc07be70 con 0x7f4ecc107fd0 2024-09-19T09:42:37.624 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.011+0000 7f4ed1f9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc10a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.624 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.011+0000 7f4ed1f9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc10a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46822/0 (socket says 172.21.15.18:46822) 2024-09-19T09:42:37.624 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.011+0000 7f4ed1f9f640 1 -- 172.21.15.18:0/1886288624 learned_addr learned my addr 172.21.15.18:0/1886288624 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.012+0000 7f4ed1f9f640 1 -- 172.21.15.18:0/1886288624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ecc10a900 con 0x7f4ecc107fd0 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.012+0000 7f4ed1f9f640 1 --2- 172.21.15.18:0/1886288624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc10a3c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009e80 tx=0x7f4ec802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bbb7f8b96a5d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.013+0000 7f4ed0f9d640 1 -- 172.21.15.18:0/1886288624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ec8036070 con 0x7f4ecc107fd0 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.013+0000 7f4ed0f9d640 1 -- 172.21.15.18:0/1886288624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec8031400 con 0x7f4ecc107fd0 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.013+0000 7f4ed0f9d640 1 -- 172.21.15.18:0/1886288624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ec8031700 con 0x7f4ecc107fd0 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.013+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/1886288624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 msgr2=0x7f4ecc10a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.013+0000 7f4ed2fa1640 1 --2- 172.21.15.18:0/1886288624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc10a3c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009e80 tx=0x7f4ec802a7a0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.013+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/1886288624 shutdown_connections 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.013+0000 7f4ed2fa1640 1 --2- 172.21.15.18:0/1886288624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc10a3c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.013+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/1886288624 >> 172.21.15.18:0/1886288624 conn(0x7f4ecc101bb0 msgr2=0x7f4ecc103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.013+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/1886288624 shutdown_connections 2024-09-19T09:42:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.013+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/1886288624 wait complete. 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.014+0000 7f4ed2fa1640 1 Processor -- start 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.014+0000 7f4ed2fa1640 1 -- start start 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.014+0000 7f4ed2fa1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.014+0000 7f4ed2fa1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc10ad70 con 0x7f4ecc107fd0 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.014+0000 7f4ed1f9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.014+0000 7f4ed1f9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc19ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46836/0 (socket says 172.21.15.18:46836) 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.014+0000 7f4ed1f9f640 1 -- 172.21.15.18:0/480026855 learned_addr learned my addr 172.21.15.18:0/480026855 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.015+0000 7f4ed1f9f640 1 -- 172.21.15.18:0/480026855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ecc19b1a0 con 0x7f4ecc107fd0 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.015+0000 7f4ed1f9f640 1 --2- 172.21.15.18:0/480026855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc19ac60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8034040 tx=0x7f4ec8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.015+0000 7f4ebeffd640 1 -- 172.21.15.18:0/480026855 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ec8041070 con 0x7f4ecc107fd0 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.015+0000 7f4ebeffd640 1 -- 172.21.15.18:0/480026855 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec803c650 con 0x7f4ecc107fd0 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.015+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/480026855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ecc19b430 con 0x7f4ecc107fd0 2024-09-19T09:42:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.015+0000 7f4ebeffd640 1 -- 172.21.15.18:0/480026855 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ec8036040 con 0x7f4ecc107fd0 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.015+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/480026855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ecc19e120 con 0x7f4ecc107fd0 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.015+0000 7f4ebeffd640 1 -- 172.21.15.18:0/480026855 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ec8044070 con 0x7f4ecc107fd0 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.015+0000 7f4ebeffd640 1 -- 172.21.15.18:0/480026855 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4ec8046c20 con 0x7f4ecc107fd0 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.016+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/480026855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ecc108430 con 0x7f4ecc107fd0 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.018+0000 7f4ebeffd640 1 -- 172.21.15.18:0/480026855 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4ec8046e20 con 0x7f4ecc107fd0 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.078+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/480026855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f4ecc02da30 con 0x7f4ecc107fd0 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.081+0000 7f4ebeffd640 1 -- 172.21.15.18:0/480026855 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f4ec803c950 con 0x7f4ecc107fd0 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.081+0000 7f4ebeffd640 1 -- 172.21.15.18:0/480026855 <== mon.0 v2:172.21.15.18:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ec8031400 con 0x7f4ecc107fd0 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.082+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/480026855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 msgr2=0x7f4ecc19ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.082+0000 7f4ed2fa1640 1 --2- 172.21.15.18:0/480026855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc19ac60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8034040 tx=0x7f4ec8004a40 comp rx=0 tx=0).stop 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.082+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/480026855 shutdown_connections 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.082+0000 7f4ed2fa1640 1 --2- 172.21.15.18:0/480026855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ecc107fd0 0x7f4ecc19ac60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.082+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/480026855 >> 172.21.15.18:0/480026855 conn(0x7f4ecc101bb0 msgr2=0x7f4ecc102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:37.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.082+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/480026855 shutdown_connections 2024-09-19T09:42:37.628 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.082+0000 7f4ed2fa1640 1 -- 172.21.15.18:0/480026855 wait complete. 2024-09-19T09:42:37.628 INFO:teuthology.orchestra.run.smithi018.stdout:Generating new minimal ceph.conf... 2024-09-19T09:42:37.722 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:37 smithi018 ceph-mon[30586]: from='client.? 172.21.15.18:0/480026855' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:42:37.722 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:37 smithi018 ceph-mon[30586]: from='client.? 172.21.15.18:0/480026855' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T09:42:38.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.993+0000 7f389bcba640 1 Processor -- start 2024-09-19T09:42:38.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.993+0000 7f389bcba640 1 -- start start 2024-09-19T09:42:38.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.993+0000 7f389bcba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f38941069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.993+0000 7f389bcba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3894106f90 con 0x7f38941065c0 2024-09-19T09:42:38.618 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.994+0000 7f3899a56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f38941069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.994+0000 7f3899a56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f38941069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46852/0 (socket says 172.21.15.18:46852) 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.994+0000 7f3899a56640 1 -- 172.21.15.18:0/1044747035 learned_addr learned my addr 172.21.15.18:0/1044747035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.994+0000 7f3899a56640 1 -- 172.21.15.18:0/1044747035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38941077c0 con 0x7f38941065c0 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.995+0000 7f3899a56640 1 --2- 172.21.15.18:0/1044747035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f38941069c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3890009820 tx=0x7f389002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488c83055fab011b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.995+0000 7f3898a54640 1 -- 172.21.15.18:0/1044747035 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3890037070 con 0x7f38941065c0 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.995+0000 7f3898a54640 1 -- 172.21.15.18:0/1044747035 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3890032900 con 0x7f38941065c0 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.995+0000 7f3898a54640 1 -- 172.21.15.18:0/1044747035 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3890030850 con 0x7f38941065c0 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.995+0000 7f389bcba640 1 -- 172.21.15.18:0/1044747035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 msgr2=0x7f38941069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.995+0000 7f389bcba640 1 --2- 172.21.15.18:0/1044747035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f38941069c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3890009820 tx=0x7f389002a270 comp rx=0 tx=0).stop 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.995+0000 7f389bcba640 1 -- 172.21.15.18:0/1044747035 shutdown_connections 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.995+0000 7f389bcba640 1 --2- 172.21.15.18:0/1044747035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f38941069c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.619 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.995+0000 7f389bcba640 1 -- 172.21.15.18:0/1044747035 >> 172.21.15.18:0/1044747035 conn(0x7f3894101d70 msgr2=0x7f3894104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.996+0000 7f389bcba640 1 -- 172.21.15.18:0/1044747035 shutdown_connections 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.996+0000 7f389bcba640 1 -- 172.21.15.18:0/1044747035 wait complete. 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.996+0000 7f389bcba640 1 Processor -- start 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.996+0000 7f389bcba640 1 -- start start 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.996+0000 7f389bcba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f3894191780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.996+0000 7f389bcba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f389410ab70 con 0x7f38941065c0 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.996+0000 7f3899a56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f3894191780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.996+0000 7f3899a56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f3894191780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46854/0 (socket says 172.21.15.18:46854) 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.996+0000 7f3899a56640 1 -- 172.21.15.18:0/366385341 learned_addr learned my addr 172.21.15.18:0/366385341 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.997+0000 7f3899a56640 1 -- 172.21.15.18:0/366385341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3894191cc0 con 0x7f38941065c0 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.997+0000 7f3899a56640 1 --2- 172.21.15.18:0/366385341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f3894191780 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f38900097f0 tx=0x7f3890030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.620 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.997+0000 7f388affd640 1 -- 172.21.15.18:0/366385341 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3890037040 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.997+0000 7f388affd640 1 -- 172.21.15.18:0/366385341 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3890040070 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.997+0000 7f389bcba640 1 -- 172.21.15.18:0/366385341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389418feb0 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.997+0000 7f388affd640 1 -- 172.21.15.18:0/366385341 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f389003a390 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.997+0000 7f389bcba640 1 -- 172.21.15.18:0/366385341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3894190390 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.997+0000 7f388affd640 1 -- 172.21.15.18:0/366385341 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f389003a5e0 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.997+0000 7f388affd640 1 -- 172.21.15.18:0/366385341 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3890045950 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:37.998+0000 7f389bcba640 1 -- 172.21.15.18:0/366385341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3894106a40 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:38.000+0000 7f388affd640 1 -- 172.21.15.18:0/366385341 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3890045460 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:38.061+0000 7f389bcba640 1 -- 172.21.15.18:0/366385341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f3894195090 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:38.061+0000 7f388affd640 1 -- 172.21.15.18:0/366385341 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f389003b430 con 0x7f38941065c0 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:38.062+0000 7f389bcba640 1 -- 172.21.15.18:0/366385341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 msgr2=0x7f3894191780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.621 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:38.062+0000 7f389bcba640 1 --2- 172.21.15.18:0/366385341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f3894191780 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f38900097f0 tx=0x7f3890030d80 comp rx=0 tx=0).stop 2024-09-19T09:42:38.622 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:38.062+0000 7f389bcba640 1 -- 172.21.15.18:0/366385341 shutdown_connections 2024-09-19T09:42:38.622 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:38.062+0000 7f389bcba640 1 --2- 172.21.15.18:0/366385341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38941065c0 0x7f3894191780 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.622 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:38.062+0000 7f389bcba640 1 -- 172.21.15.18:0/366385341 >> 172.21.15.18:0/366385341 conn(0x7f3894101d70 msgr2=0x7f3894102c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.622 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:38.062+0000 7f389bcba640 1 -- 172.21.15.18:0/366385341 shutdown_connections 2024-09-19T09:42:38.622 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:38.062+0000 7f389bcba640 1 -- 172.21.15.18:0/366385341 wait complete. 2024-09-19T09:42:38.622 INFO:teuthology.orchestra.run.smithi018.stdout:Restarting the monitor... 2024-09-19T09:42:38.882 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:38 smithi018 ceph-mon[30586]: from='client.? 172.21.15.18:0/366385341' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:38.882 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:38 smithi018 systemd[1]: Stopping Ceph mon.a for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:42:39.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:38 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a[30582]: 2024-09-19T09:42:38.879+0000 7fd2b47e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:42:39.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:38 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a[30582]: 2024-09-19T09:42:38.879+0000 7fd2b47e9640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T09:42:39.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:39 smithi018 podman[30829]: 2024-09-19 09:42:39.023563448 +0000 UTC m=+0.235012033 container died 24c66e5d6fbe9fa5090df75581c59386119d4f2de59a4fcffbcdfff3f89d13eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:42:39.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:39 smithi018 podman[30829]: 2024-09-19 09:42:39.354532474 +0000 UTC m=+0.565981049 container cleanup 24c66e5d6fbe9fa5090df75581c59386119d4f2de59a4fcffbcdfff3f89d13eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:42:39.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:39 smithi018 bash[30829]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:42:39.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:39 smithi018 podman[30842]: 2024-09-19 09:42:39.52199218 +0000 UTC m=+0.499641084 container remove 24c66e5d6fbe9fa5090df75581c59386119d4f2de59a4fcffbcdfff3f89d13eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:42:40.001 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:39 smithi018 systemd[1]: ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T09:42:40.002 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:39 smithi018 systemd[1]: Stopped Ceph mon.a for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:42:40.002 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:39 smithi018 systemd[1]: Starting Ceph mon.a for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:42:40.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 podman[30937]: 2024-09-19 09:42:39.90279236 +0000 UTC m=+0.016925023 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:42:40.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 podman[30937]: 2024-09-19 09:42:40.006019988 +0000 UTC m=+0.120152649 container create f2f6048d23fd9748f5263094c6f5a26bf3bf68c9e01815f28daa420aa8376411 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-19T09:42:40.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 podman[30937]: 2024-09-19 09:42:40.200133677 +0000 UTC m=+0.314266331 container init f2f6048d23fd9748f5263094c6f5a26bf3bf68c9e01815f28daa420aa8376411 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:42:40.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 podman[30937]: 2024-09-19 09:42:40.203328825 +0000 UTC m=+0.317461478 container start f2f6048d23fd9748f5263094c6f5a26bf3bf68c9e01815f28daa420aa8376411 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:42:40.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:42:40.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: pidfile_write: ignore empty --pid-file 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: load: jerasure load: lrc 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Git sha 0 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: DB SUMMARY 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: DB Session ID: AKC133QI61VTTOBGJQF7 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T09:42:40.270 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105610 ; 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.env: 0x55ed40d47940 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.info_log: 0x55ed41a436e0 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.statistics: (nil) 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.use_fsync: 0 2024-09-19T09:42:40.271 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.db_log_dir: 2024-09-19T09:42:40.272 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.wal_dir: 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.write_buffer_manager: 0x55ed41a52dc0 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:42:40.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:42:40.274 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:42:40.274 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:42:40.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:42:40.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:42:40.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.unordered_write: 0 2024-09-19T09:42:40.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:42:40.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:42:40.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:42:40.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:42:40.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.row_cache: None 2024-09-19T09:42:40.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.wal_filter: None 2024-09-19T09:42:40.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.wal_compression: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:42:40.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:42:40.277 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_open_files: -1 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Compression algorithms supported: 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: kZSTD supported: 0 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:42:40.278 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.merge_operator: 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_filter: None 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:42:40.279 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ed41a43320) 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_type: 0 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout: data_block_index_type: 0 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_shortening: 1 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:42:40.280 INFO:journalctl@ceph.mon.a.smithi018.stdout: checksum: 4 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: no_block_cache: 0 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache: 0x55ed41a371f0 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_options: 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: capacity : 536870912 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: num_shard_bits : 4 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: strict_capacity_limit : 0 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_compressed: (nil) 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: persistent_cache: (nil) 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_size: 4096 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_size_deviation: 10 2024-09-19T09:42:40.281 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_restart_interval: 16 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_block_restart_interval: 1 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: metadata_block_size: 4096 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: partition_filters: 0 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: use_delta_encoding: 1 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: filter_policy: bloomfilter 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: whole_key_filtering: 1 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: verify_compression: 0 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: format_version: 5 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: enable_index_compression: 1 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_align: 0 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: max_auto_readahead_size: 262144 2024-09-19T09:42:40.282 INFO:journalctl@ceph.mon.a.smithi018.stdout: prepopulate_block_cache: 0 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compression: NoCompression 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.num_levels: 7 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:42:40.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:42:40.284 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:42:40.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:42:40.286 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:42:40.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.ttl: 2592000 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:42:40.288 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3a7d5c11-0525-4f94-80a6-fb69ba0c8555 2024-09-19T09:42:40.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738960231465, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738960232997, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100598, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98492, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14397, "raw_average_key_size": 49, "raw_value_size": 90738, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726738960, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3a7d5c11-0525-4f94-80a6-fb69ba0c8555", "db_session_id": "AKC133QI61VTTOBGJQF7", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738960233139, "job": 1, "event": "recovery_finished"} 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ed41a64e00 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: DB pointer 0x55ed41b60000 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** DB Stats ** 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:42:40.290 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** Compaction Stats [default] ** 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: L0 2/0 100.10 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: Sum 2/0 100.10 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T09:42:40.291 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** Compaction Stats [default] ** 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 109.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:42:40.292 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative compaction: 0.00 GB write, 20.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval compaction: 0.00 GB write, 20.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout: Block cache BinnedLRUCache@0x55ed41a371f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: starting mon.a rank 0 at public addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] at bind addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: mon.a@-1(???) e1 preinit fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: mon.a@-1(???).mds e1 new map 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: mon.a@-1(???).mds e1 print_map 2024-09-19T09:42:40.293 INFO:journalctl@ceph.mon.a.smithi018.stdout: e1 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout: btime 2024-09-19T09:42:35:497798+0000 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout: legacy client fscid: -1 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout: No filesystems configured 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T09:42:40.294 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 bash[30937]: f2f6048d23fd9748f5263094c6f5a26bf3bf68c9e01815f28daa420aa8376411 2024-09-19T09:42:40.295 INFO:teuthology.orchestra.run.smithi018.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T09:42:40.563 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 systemd[1]: Started Ceph mon.a for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:42:40.563 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:42:40.563 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: monmap epoch 1 2024-09-19T09:42:40.563 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:42:40.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: last_changed 2024-09-19T09:42:32.493034+0000 2024-09-19T09:42:40.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: created 2024-09-19T09:42:32.493034+0000 2024-09-19T09:42:40.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T09:42:40.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: election_strategy: 1 2024-09-19T09:42:40.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:42:40.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: fsmap 2024-09-19T09:42:40.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:42:40.564 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:40 smithi018 ceph-mon[30956]: mgrmap e1: no daemons active 2024-09-19T09:42:42.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:41 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/952026970' entity='client.admin' 2024-09-19T09:42:44.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.646+0000 7f8a2465e640 1 Processor -- start 2024-09-19T09:42:44.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.646+0000 7f8a2465e640 1 -- start start 2024-09-19T09:42:44.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.646+0000 7f8a2465e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:44.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.646+0000 7f8a2465e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c108080 con 0x7f8a1c1076b0 2024-09-19T09:42:44.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.646+0000 7f8a223fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:44.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.646+0000 7f8a223fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46860/0 (socket says 172.21.15.18:46860) 2024-09-19T09:42:44.895 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.646+0000 7f8a223fa640 1 -- 172.21.15.18:0/387296020 learned_addr learned my addr 172.21.15.18:0/387296020 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.647+0000 7f8a223fa640 1 -- 172.21.15.18:0/387296020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1c1088b0 con 0x7f8a1c1076b0 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.649+0000 7f8a223fa640 1 --2- 172.21.15.18:0/387296020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c107ab0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009e80 tx=0x7f8a0c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80f57576e24c5f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.649+0000 7f8a213f8640 1 -- 172.21.15.18:0/387296020 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a0c036070 con 0x7f8a1c1076b0 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.649+0000 7f8a213f8640 1 -- 172.21.15.18:0/387296020 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a0c0318c0 con 0x7f8a1c1076b0 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.649+0000 7f8a213f8640 1 -- 172.21.15.18:0/387296020 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a0c007ab0 con 0x7f8a1c1076b0 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.649+0000 7f8a2465e640 1 -- 172.21.15.18:0/387296020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 msgr2=0x7f8a1c107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.649+0000 7f8a2465e640 1 --2- 172.21.15.18:0/387296020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c107ab0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009e80 tx=0x7f8a0c02a7a0 comp rx=0 tx=0).stop 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.650+0000 7f8a2465e640 1 -- 172.21.15.18:0/387296020 shutdown_connections 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.650+0000 7f8a2465e640 1 --2- 172.21.15.18:0/387296020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c107ab0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.650+0000 7f8a2465e640 1 -- 172.21.15.18:0/387296020 >> 172.21.15.18:0/387296020 conn(0x7f8a1c102e80 msgr2=0x7f8a1c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.650+0000 7f8a2465e640 1 -- 172.21.15.18:0/387296020 shutdown_connections 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.650+0000 7f8a2465e640 1 -- 172.21.15.18:0/387296020 wait complete. 2024-09-19T09:42:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.650+0000 7f8a2465e640 1 Processor -- start 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.650+0000 7f8a2465e640 1 -- start start 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a2465e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c19d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a2465e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c10bc60 con 0x7f8a1c1076b0 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a223fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c19d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a223fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c19d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46862/0 (socket says 172.21.15.18:46862) 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a223fa640 1 -- 172.21.15.18:0/952026970 learned_addr learned my addr 172.21.15.18:0/952026970 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a223fa640 1 -- 172.21.15.18:0/952026970 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1c19ddb0 con 0x7f8a1c1076b0 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a223fa640 1 --2- 172.21.15.18:0/952026970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c19d870 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c02ad90 tx=0x7f8a0c031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a1b7fe640 1 -- 172.21.15.18:0/952026970 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a0c036050 con 0x7f8a1c1076b0 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a1b7fe640 1 -- 172.21.15.18:0/952026970 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a0c042070 con 0x7f8a1c1076b0 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a2465e640 1 -- 172.21.15.18:0/952026970 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1c19e040 con 0x7f8a1c1076b0 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a1b7fe640 1 -- 172.21.15.18:0/952026970 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a0c03d7e0 con 0x7f8a1c1076b0 2024-09-19T09:42:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.651+0000 7f8a2465e640 1 -- 172.21.15.18:0/952026970 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1c1a0d30 con 0x7f8a1c1076b0 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.652+0000 7f8a1b7fe640 1 -- 172.21.15.18:0/952026970 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a0c03da90 con 0x7f8a1c1076b0 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.652+0000 7f8a1b7fe640 1 -- 172.21.15.18:0/952026970 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a0c007e00 con 0x7f8a1c1076b0 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.652+0000 7f8a2465e640 1 -- 172.21.15.18:0/952026970 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1c107b30 con 0x7f8a1c1076b0 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.655+0000 7f8a1b7fe640 1 -- 172.21.15.18:0/952026970 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8a0c0072f0 con 0x7f8a1c1076b0 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.714+0000 7f8a2465e640 1 -- 172.21.15.18:0/952026970 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f8a1c1a1310 con 0x7f8a1c1076b0 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.716+0000 7f8a1b7fe640 1 -- 172.21.15.18:0/952026970 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f8a0c047460 con 0x7f8a1c1076b0 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.717+0000 7f8a2465e640 1 -- 172.21.15.18:0/952026970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 msgr2=0x7f8a1c19d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.717+0000 7f8a2465e640 1 --2- 172.21.15.18:0/952026970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c19d870 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c02ad90 tx=0x7f8a0c031ca0 comp rx=0 tx=0).stop 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.717+0000 7f8a2465e640 1 -- 172.21.15.18:0/952026970 shutdown_connections 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.717+0000 7f8a2465e640 1 --2- 172.21.15.18:0/952026970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a1c1076b0 0x7f8a1c19d870 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.717+0000 7f8a2465e640 1 -- 172.21.15.18:0/952026970 >> 172.21.15.18:0/952026970 conn(0x7f8a1c102e80 msgr2=0x7f8a1c103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.717+0000 7f8a2465e640 1 -- 172.21.15.18:0/952026970 shutdown_connections 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:40.717+0000 7f8a2465e640 1 -- 172.21.15.18:0/952026970 wait complete. 2024-09-19T09:42:44.898 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T09:42:45.140 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:42:45.140 INFO:teuthology.orchestra.run.smithi018.stdout:Creating mgr... 2024-09-19T09:42:45.141 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T09:42:45.141 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T09:42:46.158 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:42:46.158 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T09:42:46.440 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5b174660-766b-11ef-bceb-c7b262605968.target.wants/ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-5b174660-766b-11ef-bceb-c7b262605968@.service. 2024-09-19T09:42:46.731 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:46 smithi018 systemd[1]: Starting Ceph mgr.x for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:42:47.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:46 smithi018 podman[31165]: 2024-09-19 09:42:46.63330528 +0000 UTC m=+0.016556924 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:42:48.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:47 smithi018 podman[31165]: 2024-09-19 09:42:47.693523588 +0000 UTC m=+1.076775225 container create b85b3a7035bbb9b049886077b0cbd0cc2a83327a8165ad7e0f097dcd107348b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:42:49.809 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:49 smithi018 podman[31165]: 2024-09-19 09:42:49.449716053 +0000 UTC m=+2.832967704 container init b85b3a7035bbb9b049886077b0cbd0cc2a83327a8165ad7e0f097dcd107348b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T09:42:49.810 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:49 smithi018 podman[31165]: 2024-09-19 09:42:49.453567874 +0000 UTC m=+2.836819510 container start b85b3a7035bbb9b049886077b0cbd0cc2a83327a8165ad7e0f097dcd107348b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:42:49.810 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:49 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:49.591+0000 7f1559fde040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:42:49.810 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:49 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:49.651+0000 7f1559fde040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:42:49.810 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:49 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:49.806+0000 7f1559fde040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:42:50.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:49 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:49.875+0000 7f1559fde040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:42:50.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:50 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:50.031+0000 7f1559fde040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:42:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:42:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-19T09:42:50.382 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:42:50.383 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T09:42:50.383 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-19T09:42:50.383 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:42:50.391 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:42:50.391 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-19T09:42:50.399 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:42:50.399 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T09:42:50.399 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-19T09:42:50.399 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T09:42:50.399 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr to start... 2024-09-19T09:42:50.399 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr... 2024-09-19T09:42:50.515 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:50 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:50.177+0000 7f1559fde040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:42:50.516 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:50 smithi018 bash[31165]: b85b3a7035bbb9b049886077b0cbd0cc2a83327a8165ad7e0f097dcd107348b2 2024-09-19T09:42:50.516 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:50 smithi018 systemd[1]: Started Ceph mgr.x for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:42:50.516 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:50 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:50.512+0000 7f1559fde040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:42:50.780 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:50 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:50.576+0000 7f1559fde040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:42:51.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:50 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:50.769+0000 7f1559fde040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:42:52.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:51 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1617838674' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:42:52.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:51 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:51.700+0000 7f1559fde040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:42:52.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:51 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:51.772+0000 7f1559fde040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:42:52.472 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:42:52.476 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:42:52.476 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:42:52.477 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:42:52.477 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:42:52.477 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:42:52.477 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:42:52.477 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:52.477 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:42:52.478 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:42:52.478 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:42:52.478 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:42:52.478 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:42:52.478 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:42:52.478 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:42:52.478 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-19T09:42:52.478 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:42:52.479 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:52.479 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:42:52.479 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:42:52.479 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:52.479 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:42:52.479 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:52.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:42:52.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:42:52.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:42:52.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:42:52.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:42:52.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:42:52.496 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:52.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:42:52.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:42:52.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:42:52.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:42:52.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:42:52.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:42:52.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:42:52.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:42:52.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:42:52.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:52.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:42:52.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:52.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:42:35:497798+0000", 2024-09-19T09:42:52.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:42:52.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:42:52.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:52.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:42:52.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:42:52.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:42:52.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:42:52.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:42:52.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:42:52.499 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:42:52.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:42:52.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:42:52.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:52.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:42:52.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:52.500 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:42:35.498416+0000", 2024-09-19T09:42:52.501 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:42:52.501 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:52.501 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:42:52.501 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:42:52.501 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.828+0000 7f493787f640 1 Processor -- start 2024-09-19T09:42:52.501 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.828+0000 7f493787f640 1 -- start start 2024-09-19T09:42:52.502 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.828+0000 7f493787f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f493010a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.502 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.828+0000 7f493787f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f493007be10 con 0x7f49301081f0 2024-09-19T09:42:52.502 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.829+0000 7f493561b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f493010a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.502 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.829+0000 7f493561b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f493010a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55224/0 (socket says 172.21.15.18:55224) 2024-09-19T09:42:52.502 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.829+0000 7f493561b640 1 -- 172.21.15.18:0/879737889 learned_addr learned my addr 172.21.15.18:0/879737889 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:52.502 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.829+0000 7f493561b640 1 -- 172.21.15.18:0/879737889 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493010ab20 con 0x7f49301081f0 2024-09-19T09:42:52.503 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.830+0000 7f493561b640 1 --2- 172.21.15.18:0/879737889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f493010a5e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f492c009820 tx=0x7f492c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be22e76ed287834f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.503 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.830+0000 7f4927fff640 1 -- 172.21.15.18:0/879737889 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492c037070 con 0x7f49301081f0 2024-09-19T09:42:52.503 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.830+0000 7f4927fff640 1 -- 172.21.15.18:0/879737889 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f492c032900 con 0x7f49301081f0 2024-09-19T09:42:52.503 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.830+0000 7f4927fff640 1 -- 172.21.15.18:0/879737889 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492c030850 con 0x7f49301081f0 2024-09-19T09:42:52.503 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.830+0000 7f493787f640 1 -- 172.21.15.18:0/879737889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 msgr2=0x7f493010a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.504 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.830+0000 7f493787f640 1 --2- 172.21.15.18:0/879737889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f493010a5e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f492c009820 tx=0x7f492c02a270 comp rx=0 tx=0).stop 2024-09-19T09:42:52.504 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.831+0000 7f493787f640 1 -- 172.21.15.18:0/879737889 shutdown_connections 2024-09-19T09:42:52.504 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.831+0000 7f493787f640 1 --2- 172.21.15.18:0/879737889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f493010a5e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.504 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.831+0000 7f493787f640 1 -- 172.21.15.18:0/879737889 >> 172.21.15.18:0/879737889 conn(0x7f4930101d70 msgr2=0x7f4930104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:52.504 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.831+0000 7f493787f640 1 -- 172.21.15.18:0/879737889 shutdown_connections 2024-09-19T09:42:52.504 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.831+0000 7f493787f640 1 -- 172.21.15.18:0/879737889 wait complete. 2024-09-19T09:42:52.505 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.831+0000 7f493787f640 1 Processor -- start 2024-09-19T09:42:52.505 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.831+0000 7f493787f640 1 -- start start 2024-09-19T09:42:52.505 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.831+0000 7f493787f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f4930107a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:52.505 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.831+0000 7f493787f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f493010ba90 con 0x7f49301081f0 2024-09-19T09:42:52.505 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.832+0000 7f493561b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f4930107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:52.505 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.832+0000 7f493561b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f4930107a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55238/0 (socket says 172.21.15.18:55238) 2024-09-19T09:42:52.505 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.832+0000 7f493561b640 1 -- 172.21.15.18:0/1617838674 learned_addr learned my addr 172.21.15.18:0/1617838674 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:52.505 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.832+0000 7f493561b640 1 -- 172.21.15.18:0/1617838674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4930107fb0 con 0x7f49301081f0 2024-09-19T09:42:52.505 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.832+0000 7f493561b640 1 --2- 172.21.15.18:0/1617838674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f4930107a70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f492c032ce0 tx=0x7f492c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:52.505 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.832+0000 7f49267fc640 1 -- 172.21.15.18:0/1617838674 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492c042070 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.832+0000 7f49267fc640 1 -- 172.21.15.18:0/1617838674 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f492c0308c0 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.832+0000 7f493787f640 1 -- 172.21.15.18:0/1617838674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49301061a0 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.832+0000 7f49267fc640 1 -- 172.21.15.18:0/1617838674 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492c037040 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.832+0000 7f493787f640 1 -- 172.21.15.18:0/1617838674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49301066e0 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.833+0000 7f49267fc640 1 -- 172.21.15.18:0/1617838674 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f492c045070 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.833+0000 7f49267fc640 1 -- 172.21.15.18:0/1617838674 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f492c047bc0 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.833+0000 7f493787f640 1 -- 172.21.15.18:0/1617838674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4930108650 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.836+0000 7f49267fc640 1 -- 172.21.15.18:0/1617838674 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f492c03c800 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.898+0000 7f493787f640 1 -- 172.21.15.18:0/1617838674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f49301069e0 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.898+0000 7f49267fc640 1 -- 172.21.15.18:0/1617838674 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1292 (secure 0 0 0) 0x7f492c03c9e0 con 0x7f49301081f0 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.900+0000 7f493787f640 1 -- 172.21.15.18:0/1617838674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 msgr2=0x7f4930107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:52.506 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.900+0000 7f493787f640 1 --2- 172.21.15.18:0/1617838674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f4930107a70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f492c032ce0 tx=0x7f492c032d10 comp rx=0 tx=0).stop 2024-09-19T09:42:52.507 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.900+0000 7f493787f640 1 -- 172.21.15.18:0/1617838674 shutdown_connections 2024-09-19T09:42:52.507 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.900+0000 7f493787f640 1 --2- 172.21.15.18:0/1617838674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49301081f0 0x7f4930107a70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:52.507 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.900+0000 7f493787f640 1 -- 172.21.15.18:0/1617838674 >> 172.21.15.18:0/1617838674 conn(0x7f4930101d70 msgr2=0x7f4930102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:52.507 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.900+0000 7f493787f640 1 -- 172.21.15.18:0/1617838674 shutdown_connections 2024-09-19T09:42:52.507 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:51.900+0000 7f493787f640 1 -- 172.21.15.18:0/1617838674 wait complete. 2024-09-19T09:42:52.507 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (1/15)... 2024-09-19T09:42:52.819 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:52 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:52.546+0000 7f1559fde040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:42:52.819 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:52 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:52.667+0000 7f1559fde040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:42:52.819 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:52 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:52.816+0000 7f1559fde040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:42:53.109 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:52 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:52.880+0000 7f1559fde040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:42:53.109 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:53.035+0000 7f1559fde040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:42:53.109 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:53.106+0000 7f1559fde040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:42:53.385 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:53.169+0000 7f1559fde040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:42:53.385 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:53.334+0000 7f1559fde040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:42:53.683 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:53.402+0000 7f1559fde040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:42:53.683 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:53.471+0000 7f1559fde040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:42:53.683 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:53.557+0000 7f1559fde040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:42:53.683 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:53.619+0000 7f1559fde040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:42:53.684 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:53.680+0000 7f1559fde040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:42:54.831 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:42:54.514+0000 7f1559fde040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:42:54.831 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: Activating manager daemon x 2024-09-19T09:42:54.831 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: mgrmap e2: x(active, starting, since 0.00275638s) 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/1644065637' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/1644065637' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/1644065637' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/1644065637' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/1644065637' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: Manager daemon x is now available 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/1644065637' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/1644065637' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/1644065637' entity='mgr.x' 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/1644065637' entity='mgr.x' 2024-09-19T09:42:54.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:54 smithi018 ceph-mon[30956]: from='mgr.14100 172.21.15.18:0/1644065637' entity='mgr.x' 2024-09-19T09:42:55.547 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:42:55.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:42:55.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:42:55.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:42:55.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:42:55.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:42:55.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:42:55.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:55.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:42:55.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:42:55.548 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:42:55.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:42:35:497798+0000", 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:42:55.551 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:42:35.498416+0000", 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:42:55.552 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.906+0000 7f0a97b70640 1 Processor -- start 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.906+0000 7f0a97b70640 1 -- start start 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.907+0000 7f0a97b70640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a90105d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.907+0000 7f0a97b70640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0a90106350 con 0x7f0a90105980 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.907+0000 7f0a9590c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a90105d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.907+0000 7f0a9590c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a90105d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55336/0 (socket says 172.21.15.18:55336) 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.907+0000 7f0a9590c640 1 -- 172.21.15.18:0/2844288786 learned_addr learned my addr 172.21.15.18:0/2844288786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.907+0000 7f0a9590c640 1 -- 172.21.15.18:0/2844288786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a90108960 con 0x7f0a90105980 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.908+0000 7f0a9590c640 1 --2- 172.21.15.18:0/2844288786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a90105d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009820 tx=0x7f0a8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73eeedd1c6c4f3de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:55.553 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.908+0000 7f0a9490a640 1 -- 172.21.15.18:0/2844288786 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a8c037070 con 0x7f0a90105980 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.908+0000 7f0a9490a640 1 -- 172.21.15.18:0/2844288786 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a8c032900 con 0x7f0a90105980 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.908+0000 7f0a9490a640 1 -- 172.21.15.18:0/2844288786 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a8c030850 con 0x7f0a90105980 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.909+0000 7f0a97b70640 1 -- 172.21.15.18:0/2844288786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 msgr2=0x7f0a90105d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.909+0000 7f0a97b70640 1 --2- 172.21.15.18:0/2844288786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a90105d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009820 tx=0x7f0a8c02a270 comp rx=0 tx=0).stop 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.909+0000 7f0a97b70640 1 -- 172.21.15.18:0/2844288786 shutdown_connections 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.909+0000 7f0a97b70640 1 --2- 172.21.15.18:0/2844288786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a90105d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.909+0000 7f0a97b70640 1 -- 172.21.15.18:0/2844288786 >> 172.21.15.18:0/2844288786 conn(0x7f0a90101510 msgr2=0x7f0a90103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.909+0000 7f0a97b70640 1 -- 172.21.15.18:0/2844288786 shutdown_connections 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.909+0000 7f0a97b70640 1 -- 172.21.15.18:0/2844288786 wait complete. 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.909+0000 7f0a97b70640 1 Processor -- start 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.909+0000 7f0a97b70640 1 -- start start 2024-09-19T09:42:55.554 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a97b70640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a901081e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a97b70640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9010bb90 con 0x7f0a90105980 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a9590c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a901081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a9590c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a901081e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55348/0 (socket says 172.21.15.18:55348) 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a9590c640 1 -- 172.21.15.18:0/632292087 learned_addr learned my addr 172.21.15.18:0/632292087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a9590c640 1 -- 172.21.15.18:0/632292087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a90108720 con 0x7f0a90105980 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a9590c640 1 --2- 172.21.15.18:0/632292087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a901081e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009940 tx=0x7f0a8c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a86ffd640 1 -- 172.21.15.18:0/632292087 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a8c042070 con 0x7f0a90105980 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a86ffd640 1 -- 172.21.15.18:0/632292087 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a8c0308c0 con 0x7f0a90105980 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a86ffd640 1 -- 172.21.15.18:0/632292087 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a8c037040 con 0x7f0a90105980 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a97b70640 1 -- 172.21.15.18:0/632292087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a90106910 con 0x7f0a90105980 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.910+0000 7f0a97b70640 1 -- 172.21.15.18:0/632292087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a90106e50 con 0x7f0a90105980 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.911+0000 7f0a86ffd640 1 -- 172.21.15.18:0/632292087 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 2) ==== 46217+0+0 (secure 0 0 0) 0x7f0a8c045070 con 0x7f0a90105980 2024-09-19T09:42:55.555 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.911+0000 7f0a97b70640 1 -- 172.21.15.18:0/632292087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a90105e00 con 0x7f0a90105980 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.912+0000 7f0a86ffd640 1 -- 172.21.15.18:0/632292087 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0a8c06be80 con 0x7f0a90105980 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.914+0000 7f0a86ffd640 1 -- 172.21.15.18:0/632292087 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0a8c02fd90 con 0x7f0a90105980 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.974+0000 7f0a97b70640 1 -- 172.21.15.18:0/632292087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0a90107730 con 0x7f0a90105980 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.975+0000 7f0a86ffd640 1 -- 172.21.15.18:0/632292087 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1292 (secure 0 0 0) 0x7f0a8c0327b0 con 0x7f0a90105980 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.975+0000 7f0a97b70640 1 -- 172.21.15.18:0/632292087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 msgr2=0x7f0a901081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.975+0000 7f0a97b70640 1 --2- 172.21.15.18:0/632292087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a901081e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009940 tx=0x7f0a8c032ce0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.975+0000 7f0a97b70640 1 -- 172.21.15.18:0/632292087 shutdown_connections 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.975+0000 7f0a97b70640 1 --2- 172.21.15.18:0/632292087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a90105980 0x7f0a901081e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.975+0000 7f0a97b70640 1 -- 172.21.15.18:0/632292087 >> 172.21.15.18:0/632292087 conn(0x7f0a90101510 msgr2=0x7f0a90102060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.976+0000 7f0a97b70640 1 -- 172.21.15.18:0/632292087 shutdown_connections 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:54.976+0000 7f0a97b70640 1 -- 172.21.15.18:0/632292087 wait complete. 2024-09-19T09:42:55.556 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (2/15)... 2024-09-19T09:42:55.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:55 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/632292087' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:42:55.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:55 smithi018 ceph-mon[30956]: mgrmap e3: x(active, since 1.00597s) 2024-09-19T09:42:57.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:57 smithi018 ceph-mon[30956]: mgrmap e4: x(active, since 2s) 2024-09-19T09:42:59.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:42:58 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2897728883' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:42:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 18, 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:59.519 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:42:59.520 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:42:59.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:42:59.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:42:35:497798+0000", 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:42:59.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:42:35.498416+0000", 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.645+0000 7ff7ddeae640 1 Processor -- start 2024-09-19T09:42:59.530 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.645+0000 7ff7ddeae640 1 -- start start 2024-09-19T09:42:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.645+0000 7ff7ddeae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d8109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.645+0000 7ff7ddeae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d810a260 con 0x7ff7d8109890 2024-09-19T09:42:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.645+0000 7ff7d77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d8109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.645+0000 7ff7d77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d8109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38476/0 (socket says 172.21.15.18:38476) 2024-09-19T09:42:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.645+0000 7ff7d77fe640 1 -- 172.21.15.18:0/1152966361 learned_addr learned my addr 172.21.15.18:0/1152966361 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.646+0000 7ff7d77fe640 1 -- 172.21.15.18:0/1152966361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d810aae0 con 0x7ff7d8109890 2024-09-19T09:42:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.646+0000 7ff7d77fe640 1 --2- 172.21.15.18:0/1152966361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d8109c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009820 tx=0x7ff7c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ad8f7c009b5776 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.647+0000 7ff7d67fc640 1 -- 172.21.15.18:0/1152966361 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7c8037070 con 0x7ff7d8109890 2024-09-19T09:42:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.647+0000 7ff7d67fc640 1 -- 172.21.15.18:0/1152966361 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7c8032900 con 0x7ff7d8109890 2024-09-19T09:42:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.647+0000 7ff7d67fc640 1 -- 172.21.15.18:0/1152966361 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7c8030850 con 0x7ff7d8109890 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.647+0000 7ff7ddeae640 1 -- 172.21.15.18:0/1152966361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 msgr2=0x7ff7d8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.647+0000 7ff7ddeae640 1 --2- 172.21.15.18:0/1152966361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d8109c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009820 tx=0x7ff7c802a270 comp rx=0 tx=0).stop 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.647+0000 7ff7ddeae640 1 -- 172.21.15.18:0/1152966361 shutdown_connections 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.647+0000 7ff7ddeae640 1 --2- 172.21.15.18:0/1152966361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d8109c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.647+0000 7ff7ddeae640 1 -- 172.21.15.18:0/1152966361 >> 172.21.15.18:0/1152966361 conn(0x7ff7d807cea0 msgr2=0x7ff7d807d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.647+0000 7ff7ddeae640 1 -- 172.21.15.18:0/1152966361 shutdown_connections 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.647+0000 7ff7ddeae640 1 -- 172.21.15.18:0/1152966361 wait complete. 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.648+0000 7ff7ddeae640 1 Processor -- start 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.648+0000 7ff7ddeae640 1 -- start start 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7ddeae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d819d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7ddeae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d810de90 con 0x7ff7d8109890 2024-09-19T09:42:59.532 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7d77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d819d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7d77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d819d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38492/0 (socket says 172.21.15.18:38492) 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7d77fe640 1 -- 172.21.15.18:0/2897728883 learned_addr learned my addr 172.21.15.18:0/2897728883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7d77fe640 1 -- 172.21.15.18:0/2897728883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d819dd90 con 0x7ff7d8109890 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7d77fe640 1 --2- 172.21.15.18:0/2897728883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d819d850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8032ce0 tx=0x7ff7c8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7d4ff9640 1 -- 172.21.15.18:0/2897728883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7c8042070 con 0x7ff7d8109890 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7ddeae640 1 -- 172.21.15.18:0/2897728883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d819e020 con 0x7ff7d8109890 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7d4ff9640 1 -- 172.21.15.18:0/2897728883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7c80308c0 con 0x7ff7d8109890 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7d4ff9640 1 -- 172.21.15.18:0/2897728883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7c8037040 con 0x7ff7d8109890 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.649+0000 7ff7ddeae640 1 -- 172.21.15.18:0/2897728883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d81a0d10 con 0x7ff7d8109890 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.650+0000 7ff7d4ff9640 1 -- 172.21.15.18:0/2897728883 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7ff7c8045070 con 0x7ff7d8109890 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.650+0000 7ff7ddeae640 1 -- 172.21.15.18:0/2897728883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d8109d10 con 0x7ff7d8109890 2024-09-19T09:42:59.533 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.651+0000 7ff7d4ff9640 1 --2- 172.21.15.18:0/2897728883 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7ff7c0039160 0x7ff7c003b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.651+0000 7ff7d4ff9640 1 -- 172.21.15.18:0/2897728883 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff7c806c230 con 0x7ff7d8109890 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.651+0000 7ff7d6ffd640 1 --2- 172.21.15.18:0/2897728883 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7ff7c0039160 0x7ff7c003b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.651+0000 7ff7d6ffd640 1 --2- 172.21.15.18:0/2897728883 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7ff7c0039160 0x7ff7c003b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0098c0 tx=0x7ff7cc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.656+0000 7ff7d4ff9640 1 -- 172.21.15.18:0/2897728883 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff7c804b170 con 0x7ff7d8109890 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.900+0000 7ff7ddeae640 1 -- 172.21.15.18:0/2897728883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff7d81a1390 con 0x7ff7d8109890 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.900+0000 7ff7d4ff9640 1 -- 172.21.15.18:0/2897728883 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7ff7c803cd50 con 0x7ff7d8109890 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.902+0000 7ff7ddeae640 1 -- 172.21.15.18:0/2897728883 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7ff7c0039160 msgr2=0x7ff7c003b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.902+0000 7ff7ddeae640 1 --2- 172.21.15.18:0/2897728883 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7ff7c0039160 0x7ff7c003b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0098c0 tx=0x7ff7cc006db0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.902+0000 7ff7ddeae640 1 -- 172.21.15.18:0/2897728883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 msgr2=0x7ff7d819d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.902+0000 7ff7ddeae640 1 --2- 172.21.15.18:0/2897728883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d819d850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8032ce0 tx=0x7ff7c8032d10 comp rx=0 tx=0).stop 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.902+0000 7ff7ddeae640 1 -- 172.21.15.18:0/2897728883 shutdown_connections 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.902+0000 7ff7ddeae640 1 --2- 172.21.15.18:0/2897728883 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7ff7c0039160 0x7ff7c003b620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.534 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.902+0000 7ff7ddeae640 1 --2- 172.21.15.18:0/2897728883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d8109890 0x7ff7d819d850 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:59.535 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.902+0000 7ff7ddeae640 1 -- 172.21.15.18:0/2897728883 >> 172.21.15.18:0/2897728883 conn(0x7ff7d807cea0 msgr2=0x7ff7d81074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:59.535 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.903+0000 7ff7ddeae640 1 -- 172.21.15.18:0/2897728883 shutdown_connections 2024-09-19T09:42:59.535 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:58.903+0000 7ff7ddeae640 1 -- 172.21.15.18:0/2897728883 wait complete. 2024-09-19T09:42:59.535 INFO:teuthology.orchestra.run.smithi018.stdout:mgr is available 2024-09-19T09:43:00.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:00 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2193096164' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:43:00.729 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:43:00.736 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:43:00.736 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout fsid = 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:43:00.736 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-09-19T09:43:00.736 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:43:00.736 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:43:00.736 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:43:00.736 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.920+0000 7f3d94656640 1 Processor -- start 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.920+0000 7f3d94656640 1 -- start start 2024-09-19T09:43:00.737 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.921+0000 7f3d94656640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c10a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.921+0000 7f3d94656640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c07be70 con 0x7f3d8c108190 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.921+0000 7f3d923f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c10a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.921+0000 7f3d923f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c10a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38502/0 (socket says 172.21.15.18:38502) 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.921+0000 7f3d923f2640 1 -- 172.21.15.18:0/767328828 learned_addr learned my addr 172.21.15.18:0/767328828 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.922+0000 7f3d923f2640 1 -- 172.21.15.18:0/767328828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c10aac0 con 0x7f3d8c108190 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.922+0000 7f3d923f2640 1 --2- 172.21.15.18:0/767328828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c10a580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009e80 tx=0x7f3d8802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5d101e122912b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.923+0000 7f3d913f0640 1 -- 172.21.15.18:0/767328828 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88036070 con 0x7f3d8c108190 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.923+0000 7f3d913f0640 1 -- 172.21.15.18:0/767328828 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d880318c0 con 0x7f3d8c108190 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.923+0000 7f3d913f0640 1 -- 172.21.15.18:0/767328828 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88007ab0 con 0x7f3d8c108190 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.923+0000 7f3d94656640 1 -- 172.21.15.18:0/767328828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 msgr2=0x7f3d8c10a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.923+0000 7f3d94656640 1 --2- 172.21.15.18:0/767328828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c10a580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009e80 tx=0x7f3d8802a7a0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.923+0000 7f3d94656640 1 -- 172.21.15.18:0/767328828 shutdown_connections 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.923+0000 7f3d94656640 1 --2- 172.21.15.18:0/767328828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c10a580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.923+0000 7f3d94656640 1 -- 172.21.15.18:0/767328828 >> 172.21.15.18:0/767328828 conn(0x7f3d8c101d70 msgr2=0x7f3d8c104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.923+0000 7f3d94656640 1 -- 172.21.15.18:0/767328828 shutdown_connections 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.923+0000 7f3d94656640 1 -- 172.21.15.18:0/767328828 wait complete. 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.924+0000 7f3d94656640 1 Processor -- start 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.924+0000 7f3d94656640 1 -- start start 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.924+0000 7f3d94656640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c107a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.924+0000 7f3d94656640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c10ba90 con 0x7f3d8c108190 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.924+0000 7f3d923f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c107a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.924+0000 7f3d923f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c107a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38504/0 (socket says 172.21.15.18:38504) 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.924+0000 7f3d923f2640 1 -- 172.21.15.18:0/2193096164 learned_addr learned my addr 172.21.15.18:0/2193096164 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:00.739 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.925+0000 7f3d923f2640 1 -- 172.21.15.18:0/2193096164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c107f50 con 0x7f3d8c108190 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.925+0000 7f3d923f2640 1 --2- 172.21.15.18:0/2193096164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c107a10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3d8802acc0 tx=0x7f3d88031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.925+0000 7f3d837fe640 1 -- 172.21.15.18:0/2193096164 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88036050 con 0x7f3d8c108190 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.925+0000 7f3d837fe640 1 -- 172.21.15.18:0/2193096164 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d88037040 con 0x7f3d8c108190 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.925+0000 7f3d94656640 1 -- 172.21.15.18:0/2193096164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c106140 con 0x7f3d8c108190 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.925+0000 7f3d837fe640 1 -- 172.21.15.18:0/2193096164 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8803d850 con 0x7f3d8c108190 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.925+0000 7f3d94656640 1 -- 172.21.15.18:0/2193096164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c106680 con 0x7f3d8c108190 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.926+0000 7f3d837fe640 1 -- 172.21.15.18:0/2193096164 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f3d88044020 con 0x7f3d8c108190 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.926+0000 7f3d837fe640 1 --2- 172.21.15.18:0/2193096164 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f3d780391b0 0x7f3d7803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.926+0000 7f3d94656640 1 -- 172.21.15.18:0/2193096164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8c1085f0 con 0x7f3d8c108190 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.927+0000 7f3d837fe640 1 -- 172.21.15.18:0/2193096164 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3d88042020 con 0x7f3d8c108190 2024-09-19T09:43:00.740 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.927+0000 7f3d91bf1640 1 --2- 172.21.15.18:0/2193096164 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f3d780391b0 0x7f3d7803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.927+0000 7f3d91bf1640 1 --2- 172.21.15.18:0/2193096164 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f3d780391b0 0x7f3d7803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0098c0 tx=0x7f3d7c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:42:59.931+0000 7f3d837fe640 1 -- 172.21.15.18:0/2193096164 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d8804b020 con 0x7f3d8c108190 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.110+0000 7f3d94656640 1 -- 172.21.15.18:0/2193096164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3d8c106e90 con 0x7f3d8c108190 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.111+0000 7f3d837fe640 1 -- 172.21.15.18:0/2193096164 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f3d8802e260 con 0x7f3d8c108190 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.113+0000 7f3d94656640 1 -- 172.21.15.18:0/2193096164 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f3d780391b0 msgr2=0x7f3d7803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.113+0000 7f3d94656640 1 --2- 172.21.15.18:0/2193096164 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f3d780391b0 0x7f3d7803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0098c0 tx=0x7f3d7c006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.113+0000 7f3d94656640 1 -- 172.21.15.18:0/2193096164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 msgr2=0x7f3d8c107a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.113+0000 7f3d94656640 1 --2- 172.21.15.18:0/2193096164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c107a10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3d8802acc0 tx=0x7f3d88031ca0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.113+0000 7f3d94656640 1 -- 172.21.15.18:0/2193096164 shutdown_connections 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.113+0000 7f3d94656640 1 --2- 172.21.15.18:0/2193096164 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f3d780391b0 0x7f3d7803b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.113+0000 7f3d94656640 1 --2- 172.21.15.18:0/2193096164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d8c108190 0x7f3d8c107a10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:00.741 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.113+0000 7f3d94656640 1 -- 172.21.15.18:0/2193096164 >> 172.21.15.18:0/2193096164 conn(0x7f3d8c101d70 msgr2=0x7f3d8c102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:00.742 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.114+0000 7f3d94656640 1 -- 172.21.15.18:0/2193096164 shutdown_connections 2024-09-19T09:43:00.742 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:00.114+0000 7f3d94656640 1 -- 172.21.15.18:0/2193096164 wait complete. 2024-09-19T09:43:00.742 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling cephadm module... 2024-09-19T09:43:01.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:01 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2760708129' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T09:43:01.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: ignoring --setuser ceph since I am not root 2024-09-19T09:43:01.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: ignoring --setgroup ceph since I am not root 2024-09-19T09:43:01.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:01.534+0000 7fc38be72040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:43:01.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:01.593+0000 7fc38be72040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:43:01.885 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:01.750+0000 7fc38be72040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:43:01.885 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:01.819+0000 7fc38be72040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:43:01.933 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.103+0000 7f0856175640 1 Processor -- start 2024-09-19T09:43:01.933 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.103+0000 7f0856175640 1 -- start start 2024-09-19T09:43:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.103+0000 7f0856175640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f08501069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.103+0000 7f0856175640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0850106f90 con 0x7f08501065c0 2024-09-19T09:43:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.103+0000 7f084f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f08501069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.103+0000 7f084f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f08501069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38520/0 (socket says 172.21.15.18:38520) 2024-09-19T09:43:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.103+0000 7f084f7fe640 1 -- 172.21.15.18:0/669200125 learned_addr learned my addr 172.21.15.18:0/669200125 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.103+0000 7f084f7fe640 1 -- 172.21.15.18:0/669200125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08501077c0 con 0x7f08501065c0 2024-09-19T09:43:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.104+0000 7f084f7fe640 1 --2- 172.21.15.18:0/669200125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f08501069c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0840009820 tx=0x7f084002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3903be506578f28d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.104+0000 7f084e7fc640 1 -- 172.21.15.18:0/669200125 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0840037070 con 0x7f08501065c0 2024-09-19T09:43:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.104+0000 7f084e7fc640 1 -- 172.21.15.18:0/669200125 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0840032900 con 0x7f08501065c0 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.104+0000 7f084e7fc640 1 -- 172.21.15.18:0/669200125 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0840030850 con 0x7f08501065c0 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.105+0000 7f0856175640 1 -- 172.21.15.18:0/669200125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 msgr2=0x7f08501069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.105+0000 7f0856175640 1 --2- 172.21.15.18:0/669200125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f08501069c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0840009820 tx=0x7f084002a270 comp rx=0 tx=0).stop 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.105+0000 7f0856175640 1 -- 172.21.15.18:0/669200125 shutdown_connections 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.105+0000 7f0856175640 1 --2- 172.21.15.18:0/669200125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f08501069c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.105+0000 7f0856175640 1 -- 172.21.15.18:0/669200125 >> 172.21.15.18:0/669200125 conn(0x7f0850101d70 msgr2=0x7f0850104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.105+0000 7f0856175640 1 -- 172.21.15.18:0/669200125 shutdown_connections 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.105+0000 7f0856175640 1 -- 172.21.15.18:0/669200125 wait complete. 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.106+0000 7f0856175640 1 Processor -- start 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.106+0000 7f0856175640 1 -- start start 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.106+0000 7f0856175640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f0850191780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.106+0000 7f0856175640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f085010ab70 con 0x7f08501065c0 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.106+0000 7f084f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f0850191780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.106+0000 7f084f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f0850191780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38522/0 (socket says 172.21.15.18:38522) 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.106+0000 7f084f7fe640 1 -- 172.21.15.18:0/2760708129 learned_addr learned my addr 172.21.15.18:0/2760708129 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.106+0000 7f084f7fe640 1 -- 172.21.15.18:0/2760708129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0850191cc0 con 0x7f08501065c0 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.107+0000 7f084f7fe640 1 --2- 172.21.15.18:0/2760708129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f0850191780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0840009940 tx=0x7f0840032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.107+0000 7f084cff9640 1 -- 172.21.15.18:0/2760708129 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0840042070 con 0x7f08501065c0 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.107+0000 7f084cff9640 1 -- 172.21.15.18:0/2760708129 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08400308c0 con 0x7f08501065c0 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.107+0000 7f0856175640 1 -- 172.21.15.18:0/2760708129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085018feb0 con 0x7f08501065c0 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.107+0000 7f084cff9640 1 -- 172.21.15.18:0/2760708129 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0840037040 con 0x7f08501065c0 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.107+0000 7f0856175640 1 -- 172.21.15.18:0/2760708129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08501903f0 con 0x7f08501065c0 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.108+0000 7f084cff9640 1 -- 172.21.15.18:0/2760708129 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f0840045070 con 0x7f08501065c0 2024-09-19T09:43:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.108+0000 7f084cff9640 1 --2- 172.21.15.18:0/2760708129 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f0838039160 0x7f083803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.108+0000 7f0856175640 1 -- 172.21.15.18:0/2760708129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0850106a40 con 0x7f08501065c0 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.108+0000 7f084cff9640 1 -- 172.21.15.18:0/2760708129 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f084006c210 con 0x7f08501065c0 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.108+0000 7f084effd640 1 --2- 172.21.15.18:0/2760708129 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f0838039160 0x7f083803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.109+0000 7f084effd640 1 --2- 172.21.15.18:0/2760708129 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f0838039160 0x7f083803b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f08440098c0 tx=0x7f0844006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.113+0000 7f084cff9640 1 -- 172.21.15.18:0/2760708129 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f084003cd90 con 0x7f08501065c0 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.339+0000 7f0856175640 1 -- 172.21.15.18:0/2760708129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f0850190c30 con 0x7f08501065c0 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.390+0000 7f084cff9640 1 -- 172.21.15.18:0/2760708129 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f0840048cf0 con 0x7f08501065c0 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.392+0000 7f084cff9640 1 -- 172.21.15.18:0/2760708129 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f084003c820 con 0x7f08501065c0 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.393+0000 7f0856175640 1 -- 172.21.15.18:0/2760708129 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f0838039160 msgr2=0x7f083803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.393+0000 7f0856175640 1 --2- 172.21.15.18:0/2760708129 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f0838039160 0x7f083803b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f08440098c0 tx=0x7f0844006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.393+0000 7f0856175640 1 -- 172.21.15.18:0/2760708129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 msgr2=0x7f0850191780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.393+0000 7f0856175640 1 --2- 172.21.15.18:0/2760708129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f0850191780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0840009940 tx=0x7f0840032ce0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.938 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.393+0000 7f0856175640 1 -- 172.21.15.18:0/2760708129 shutdown_connections 2024-09-19T09:43:01.938 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.393+0000 7f0856175640 1 --2- 172.21.15.18:0/2760708129 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7f0838039160 0x7f083803b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.938 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.393+0000 7f0856175640 1 --2- 172.21.15.18:0/2760708129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08501065c0 0x7f0850191780 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:01.938 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.393+0000 7f0856175640 1 -- 172.21.15.18:0/2760708129 >> 172.21.15.18:0/2760708129 conn(0x7f0850101d70 msgr2=0x7f08501028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:01.938 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.394+0000 7f0856175640 1 -- 172.21.15.18:0/2760708129 shutdown_connections 2024-09-19T09:43:01.938 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:01.394+0000 7f0856175640 1 -- 172.21.15.18:0/2760708129 wait complete. 2024-09-19T09:43:02.176 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:01.976+0000 7fc38be72040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:43:02.176 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:02 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:02.125+0000 7fc38be72040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:43:02.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:02 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2760708129' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T09:43:02.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:02 smithi018 ceph-mon[30956]: mgrmap e5: x(active, since 6s) 2024-09-19T09:43:02.538 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:02 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:02.473+0000 7fc38be72040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:43:02.538 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:02 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:02.536+0000 7fc38be72040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:43:02.885 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:02 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:02.732+0000 7fc38be72040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:43:03.224 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:43:03.224 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T09:43:03.224 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:43:03.224 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T09:43:03.224 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:43:03.224 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:43:03.224 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.347+0000 7fa578980640 1 Processor -- start 2024-09-19T09:43:03.224 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.347+0000 7fa578980640 1 -- start start 2024-09-19T09:43:03.224 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.347+0000 7fa578980640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa574106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.347+0000 7fa578980640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa5741074b0 con 0x7fa574106ae0 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.347+0000 7fa57259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa574106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.347+0000 7fa57259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa574106ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38534/0 (socket says 172.21.15.18:38534) 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.347+0000 7fa57259c640 1 -- 172.21.15.18:0/4065273329 learned_addr learned my addr 172.21.15.18:0/4065273329 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.348+0000 7fa57259c640 1 -- 172.21.15.18:0/4065273329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa574107800 con 0x7fa574106ae0 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.348+0000 7fa57259c640 1 --2- 172.21.15.18:0/4065273329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa574106ee0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa564009820 tx=0x7fa56402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691183bed57c4495 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.348+0000 7fa57159a640 1 -- 172.21.15.18:0/4065273329 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa564037070 con 0x7fa574106ae0 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.348+0000 7fa57159a640 1 -- 172.21.15.18:0/4065273329 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa564032900 con 0x7fa574106ae0 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.348+0000 7fa57159a640 1 -- 172.21.15.18:0/4065273329 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa564030850 con 0x7fa574106ae0 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.349+0000 7fa578980640 1 -- 172.21.15.18:0/4065273329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 msgr2=0x7fa574106ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.349+0000 7fa578980640 1 --2- 172.21.15.18:0/4065273329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa574106ee0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa564009820 tx=0x7fa56402a270 comp rx=0 tx=0).stop 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.349+0000 7fa578980640 1 -- 172.21.15.18:0/4065273329 shutdown_connections 2024-09-19T09:43:03.225 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.349+0000 7fa578980640 1 --2- 172.21.15.18:0/4065273329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa574106ee0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.349+0000 7fa578980640 1 -- 172.21.15.18:0/4065273329 >> 172.21.15.18:0/4065273329 conn(0x7fa574101510 msgr2=0x7fa574103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.350+0000 7fa578980640 1 -- 172.21.15.18:0/4065273329 shutdown_connections 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.350+0000 7fa578980640 1 -- 172.21.15.18:0/4065273329 wait complete. 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.350+0000 7fa578980640 1 Processor -- start 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.351+0000 7fa578980640 1 -- start start 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.351+0000 7fa578980640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa5741060c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.351+0000 7fa578980640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa57410abb0 con 0x7fa574106ae0 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.351+0000 7fa57259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa5741060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.351+0000 7fa57259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa5741060c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38544/0 (socket says 172.21.15.18:38544) 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.351+0000 7fa57259c640 1 -- 172.21.15.18:0/2616495797 learned_addr learned my addr 172.21.15.18:0/2616495797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.351+0000 7fa57259c640 1 -- 172.21.15.18:0/2616495797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57419e3b0 con 0x7fa574106ae0 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.351+0000 7fa57259c640 1 --2- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa5741060c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa564009940 tx=0x7fa564032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:03.226 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.352+0000 7fa5637fe640 1 -- 172.21.15.18:0/2616495797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa564042070 con 0x7fa574106ae0 2024-09-19T09:43:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.352+0000 7fa5637fe640 1 -- 172.21.15.18:0/2616495797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa5640308c0 con 0x7fa574106ae0 2024-09-19T09:43:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.352+0000 7fa578980640 1 -- 172.21.15.18:0/2616495797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa57419e580 con 0x7fa574106ae0 2024-09-19T09:43:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.352+0000 7fa5637fe640 1 -- 172.21.15.18:0/2616495797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa564037040 con 0x7fa574106ae0 2024-09-19T09:43:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.352+0000 7fa578980640 1 -- 172.21.15.18:0/2616495797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa57419e920 con 0x7fa574106ae0 2024-09-19T09:43:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.353+0000 7fa5637fe640 1 -- 172.21.15.18:0/2616495797 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fa564045070 con 0x7fa574106ae0 2024-09-19T09:43:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.353+0000 7fa5637fe640 1 --2- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fa55c039200 0x7fa55c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.353+0000 7fa5637fe640 1 -- 172.21.15.18:0/2616495797 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa56406c430 con 0x7fa574106ae0 2024-09-19T09:43:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.353+0000 7fa571d9b640 1 -- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fa55c039200 msgr2=0x7fa55c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/2865418420 2024-09-19T09:43:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.353+0000 7fa571d9b640 1 --2- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fa55c039200 0x7fa55c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:43:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.353+0000 7fa578980640 1 -- 172.21.15.18:0/2616495797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa574106f60 con 0x7fa574106ae0 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.358+0000 7fa5637fe640 1 -- 172.21.15.18:0/2616495797 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa56406beb0 con 0x7fa574106ae0 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.554+0000 7fa571d9b640 1 -- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fa55c039200 msgr2=0x7fa55c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/2865418420 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.554+0000 7fa571d9b640 1 --2- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fa55c039200 0x7fa55c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.597+0000 7fa578980640 1 -- 172.21.15.18:0/2616495797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fa57419f0d0 con 0x7fa574106ae0 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.598+0000 7fa5637fe640 1 -- 172.21.15.18:0/2616495797 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fa56403cd60 con 0x7fa574106ae0 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.600+0000 7fa578980640 1 -- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fa55c039200 msgr2=0x7fa55c03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.600+0000 7fa578980640 1 --2- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fa55c039200 0x7fa55c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.600+0000 7fa578980640 1 -- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 msgr2=0x7fa5741060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.600+0000 7fa578980640 1 --2- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa5741060c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa564009940 tx=0x7fa564032ce0 comp rx=0 tx=0).stop 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.600+0000 7fa578980640 1 -- 172.21.15.18:0/2616495797 shutdown_connections 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.600+0000 7fa578980640 1 --2- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fa55c039200 0x7fa55c03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.600+0000 7fa578980640 1 --2- 172.21.15.18:0/2616495797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa574106ae0 0x7fa5741060c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:03.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.600+0000 7fa578980640 1 -- 172.21.15.18:0/2616495797 >> 172.21.15.18:0/2616495797 conn(0x7fa574101510 msgr2=0x7fa574102020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:03.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.600+0000 7fa578980640 1 -- 172.21.15.18:0/2616495797 shutdown_connections 2024-09-19T09:43:03.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:02.600+0000 7fa578980640 1 -- 172.21.15.18:0/2616495797 wait complete. 2024-09-19T09:43:03.229 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for the mgr to restart... 2024-09-19T09:43:03.229 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr epoch 5... 2024-09-19T09:43:03.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:03 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2616495797' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:43:04.104 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:03 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:03.687+0000 7fc38be72040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:43:04.105 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:03 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:03.758+0000 7fc38be72040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:43:04.777 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:04 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:04.506+0000 7fc38be72040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:43:04.777 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:04 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:04.626+0000 7fc38be72040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:43:05.066 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:04 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:04.775+0000 7fc38be72040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:43:05.067 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:04 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:04.839+0000 7fc38be72040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:43:05.067 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:04 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:04.994+0000 7fc38be72040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:43:05.067 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:05 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:05.064+0000 7fc38be72040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:43:05.362 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:05 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:05.127+0000 7fc38be72040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:43:05.362 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:05 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:05.292+0000 7fc38be72040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:43:05.362 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:05 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:05.360+0000 7fc38be72040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:43:05.635 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:05 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:05.429+0000 7fc38be72040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:43:05.635 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:05 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:05.516+0000 7fc38be72040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:43:05.635 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:05 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:05.578+0000 7fc38be72040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:43:06.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:05 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:05.639+0000 7fc38be72040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:43:06.885 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:06.464+0000 7fc38be72040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:43:06.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: Active manager daemon x restarted 2024-09-19T09:43:06.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: Activating manager daemon x 2024-09-19T09:43:06.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T09:43:06.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: mgrmap e6: x(active, starting, since 0.003213s) 2024-09-19T09:43:06.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:43:06.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:43:06.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:43:06.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:43:06.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:43:06.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: Manager daemon x is now available 2024-09-19T09:43:06.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:06.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:06.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:06.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:06.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:43:06.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:06 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:43:07.754 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:07 smithi018 ceph-mon[30956]: Found migration_current of "None". Setting to last migration. 2024-09-19T09:43:07.754 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:07 smithi018 ceph-mon[30956]: mgrmap e7: x(active, since 1.00561s) 2024-09-19T09:43:08.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:43:08.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T09:43:08.038 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.896+0000 7fbcf9e75640 1 Processor -- start 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.896+0000 7fbcf9e75640 1 -- start start 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.897+0000 7fbcf9e75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf410a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.897+0000 7fbcf9e75640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf407be90 con 0x7fbcf41081a0 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.897+0000 7fbcf37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf410a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.897+0000 7fbcf37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf410a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38546/0 (socket says 172.21.15.18:38546) 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.897+0000 7fbcf37fe640 1 -- 172.21.15.18:0/4182820884 learned_addr learned my addr 172.21.15.18:0/4182820884 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.897+0000 7fbcf37fe640 1 -- 172.21.15.18:0/4182820884 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf410aad0 con 0x7fbcf41081a0 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.898+0000 7fbcf37fe640 1 --2- 172.21.15.18:0/4182820884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf410a590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009820 tx=0x7fbce402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1926eb3e3290b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.898+0000 7fbcf27fc640 1 -- 172.21.15.18:0/4182820884 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4037070 con 0x7fbcf41081a0 2024-09-19T09:43:08.039 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.898+0000 7fbcf27fc640 1 -- 172.21.15.18:0/4182820884 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbce4032900 con 0x7fbcf41081a0 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.898+0000 7fbcf27fc640 1 -- 172.21.15.18:0/4182820884 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4030850 con 0x7fbcf41081a0 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.899+0000 7fbcf9e75640 1 -- 172.21.15.18:0/4182820884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 msgr2=0x7fbcf410a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.899+0000 7fbcf9e75640 1 --2- 172.21.15.18:0/4182820884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf410a590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009820 tx=0x7fbce402a270 comp rx=0 tx=0).stop 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.899+0000 7fbcf9e75640 1 -- 172.21.15.18:0/4182820884 shutdown_connections 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.899+0000 7fbcf9e75640 1 --2- 172.21.15.18:0/4182820884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf410a590 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.899+0000 7fbcf9e75640 1 -- 172.21.15.18:0/4182820884 >> 172.21.15.18:0/4182820884 conn(0x7fbcf4101dc0 msgr2=0x7fbcf41041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.899+0000 7fbcf9e75640 1 -- 172.21.15.18:0/4182820884 shutdown_connections 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.899+0000 7fbcf9e75640 1 -- 172.21.15.18:0/4182820884 wait complete. 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.899+0000 7fbcf9e75640 1 Processor -- start 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.900+0000 7fbcf9e75640 1 -- start start 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.900+0000 7fbcf9e75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf4107a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:08.040 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.900+0000 7fbcf9e75640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf410baa0 con 0x7fbcf41081a0 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.900+0000 7fbcf37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf4107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.900+0000 7fbcf37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf4107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38550/0 (socket says 172.21.15.18:38550) 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.900+0000 7fbcf37fe640 1 -- 172.21.15.18:0/3643140804 learned_addr learned my addr 172.21.15.18:0/3643140804 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.900+0000 7fbcf37fe640 1 -- 172.21.15.18:0/3643140804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf4107f60 con 0x7fbcf41081a0 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.900+0000 7fbcf37fe640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf4107a20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbce40097f0 tx=0x7fbce4030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.900+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4042070 con 0x7fbcf41081a0 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.901+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbce4032ca0 con 0x7fbcf41081a0 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.901+0000 7fbcf9e75640 1 -- 172.21.15.18:0/3643140804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf4106150 con 0x7fbcf41081a0 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.901+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4037040 con 0x7fbcf41081a0 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.901+0000 7fbcf9e75640 1 -- 172.21.15.18:0/3643140804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf4106690 con 0x7fbcf41081a0 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.902+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fbce4045070 con 0x7fbcf41081a0 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.902+0000 7fbcf0ff9640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 0x7fbce003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.902+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 --> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbce003bdd0 con 0x7fbce0039200 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.902+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbce406c290 con 0x7fbcf41081a0 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.902+0000 7fbcf2ffd640 1 -- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 msgr2=0x7fbce003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/2865418420 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:03.902+0000 7fbcf2ffd640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 0x7fbce003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:04.103+0000 7fbcf2ffd640 1 -- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 msgr2=0x7fbce003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/2865418420 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:04.103+0000 7fbcf2ffd640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 0x7fbce003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:04.504+0000 7fbcf2ffd640 1 -- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 msgr2=0x7fbce003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/2865418420 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:04.504+0000 7fbcf2ffd640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 0x7fbce003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:05.305+0000 7fbcf2ffd640 1 -- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 msgr2=0x7fbce003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/2865418420 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:05.305+0000 7fbcf2ffd640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 0x7fbce003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:06.467+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fbce406ae10 con 0x7fbcf41081a0 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:06.467+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 msgr2=0x7fbce003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:43:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:06.467+0000 7fbcf0ff9640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 0x7fbce003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.469+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fbce403c720 con 0x7fbcf41081a0 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.469+0000 7fbcf0ff9640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fbce003cb30 0x7fbce003ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.469+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 --> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbce4039e50 con 0x7fbce003cb30 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.470+0000 7fbcf2ffd640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fbce003cb30 0x7fbce003ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.471+0000 7fbcf2ffd640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fbce003cb30 0x7fbce003ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc003980 tx=0x7fbcdc0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.471+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 <== mgr.14118 v2:172.21.15.18:6800/809218832 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fbce4039e50 con 0x7fbce003cb30 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.478+0000 7fbcf9e75640 1 -- 172.21.15.18:0/3643140804 --> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fbcf4108600 con 0x7fbce003cb30 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf0ff9640 1 -- 172.21.15.18:0/3643140804 <== mgr.14118 v2:172.21.15.18:6800/809218832 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fbcf4108600 con 0x7fbce003cb30 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 -- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fbce003cb30 msgr2=0x7fbce003ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fbce003cb30 0x7fbce003ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc003980 tx=0x7fbcdc0092b0 comp rx=0 tx=0).stop 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 -- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 msgr2=0x7fbcf4107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf4107a20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbce40097f0 tx=0x7fbce4030ec0 comp rx=0 tx=0).stop 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 -- 172.21.15.18:0/3643140804 shutdown_connections 2024-09-19T09:43:08.043 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/2865418420,v1:172.21.15.18:6801/2865418420] conn(0x7fbce0039200 0x7fbce003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:08.044 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fbce003cb30 0x7fbce003ef20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:08.044 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 --2- 172.21.15.18:0/3643140804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcf41081a0 0x7fbcf4107a20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:08.044 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 -- 172.21.15.18:0/3643140804 >> 172.21.15.18:0/3643140804 conn(0x7fbcf4101dc0 msgr2=0x7fbcf4102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:08.044 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 -- 172.21.15.18:0/3643140804 shutdown_connections 2024-09-19T09:43:08.044 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:07.479+0000 7fbcf9e75640 1 -- 172.21.15.18:0/3643140804 wait complete. 2024-09-19T09:43:08.044 INFO:teuthology.orchestra.run.smithi018.stdout:mgr epoch 5 is available 2024-09-19T09:43:08.044 INFO:teuthology.orchestra.run.smithi018.stdout:Setting orchestrator backend to cephadm... 2024-09-19T09:43:08.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:08 smithi018 ceph-mon[30956]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T09:43:08.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:08 smithi018 ceph-mon[30956]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T09:43:08.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:08 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:08.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:08 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:09.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.452+0000 7f1c2ed99640 1 Processor -- start 2024-09-19T09:43:09.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.452+0000 7f1c2ed99640 1 -- start start 2024-09-19T09:43:09.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.453+0000 7f1c2ed99640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c2810a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:09.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.453+0000 7f1c2ed99640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2807be50 con 0x7f1c281081b0 2024-09-19T09:43:09.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.453+0000 7f1c2cb35640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c2810a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:09.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.453+0000 7f1c2cb35640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c2810a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58834/0 (socket says 172.21.15.18:58834) 2024-09-19T09:43:09.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.453+0000 7f1c2cb35640 1 -- 172.21.15.18:0/806689736 learned_addr learned my addr 172.21.15.18:0/806689736 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:09.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.453+0000 7f1c2cb35640 1 -- 172.21.15.18:0/806689736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2810aae0 con 0x7f1c281081b0 2024-09-19T09:43:09.227 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.454+0000 7f1c2cb35640 1 --2- 172.21.15.18:0/806689736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c2810a5a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009820 tx=0x7f1c1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d89202ad519ff70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.454+0000 7f1c277fe640 1 -- 172.21.15.18:0/806689736 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1c037070 con 0x7f1c281081b0 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.454+0000 7f1c277fe640 1 -- 172.21.15.18:0/806689736 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c1c032900 con 0x7f1c281081b0 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.454+0000 7f1c277fe640 1 -- 172.21.15.18:0/806689736 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1c030850 con 0x7f1c281081b0 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.455+0000 7f1c2ed99640 1 -- 172.21.15.18:0/806689736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 msgr2=0x7f1c2810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.455+0000 7f1c2ed99640 1 --2- 172.21.15.18:0/806689736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c2810a5a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009820 tx=0x7f1c1c02a270 comp rx=0 tx=0).stop 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.455+0000 7f1c2ed99640 1 -- 172.21.15.18:0/806689736 shutdown_connections 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.455+0000 7f1c2ed99640 1 --2- 172.21.15.18:0/806689736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c2810a5a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.455+0000 7f1c2ed99640 1 -- 172.21.15.18:0/806689736 >> 172.21.15.18:0/806689736 conn(0x7f1c28101d70 msgr2=0x7f1c28104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.455+0000 7f1c2ed99640 1 -- 172.21.15.18:0/806689736 shutdown_connections 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.455+0000 7f1c2ed99640 1 -- 172.21.15.18:0/806689736 wait complete. 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.455+0000 7f1c2ed99640 1 Processor -- start 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.455+0000 7f1c2ed99640 1 -- start start 2024-09-19T09:43:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c2ed99640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c28107a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c2ed99640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2810ba50 con 0x7f1c281081b0 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c2cb35640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c28107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c2cb35640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c28107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58848/0 (socket says 172.21.15.18:58848) 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c2cb35640 1 -- 172.21.15.18:0/699334650 learned_addr learned my addr 172.21.15.18:0/699334650 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c2cb35640 1 -- 172.21.15.18:0/699334650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c28107f70 con 0x7f1c281081b0 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c2cb35640 1 --2- 172.21.15.18:0/699334650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c28107a30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0097f0 tx=0x7f1c1c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c25ffb640 1 -- 172.21.15.18:0/699334650 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1c037040 con 0x7f1c281081b0 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c25ffb640 1 -- 172.21.15.18:0/699334650 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c1c040070 con 0x7f1c281081b0 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c2ed99640 1 -- 172.21.15.18:0/699334650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c28106160 con 0x7f1c281081b0 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.456+0000 7f1c25ffb640 1 -- 172.21.15.18:0/699334650 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1c03a390 con 0x7f1c281081b0 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.457+0000 7f1c2ed99640 1 -- 172.21.15.18:0/699334650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c28106640 con 0x7f1c281081b0 2024-09-19T09:43:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.458+0000 7f1c25ffb640 1 -- 172.21.15.18:0/699334650 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f1c1c03a630 con 0x7f1c281081b0 2024-09-19T09:43:09.230 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.458+0000 7f1c2ed99640 1 -- 172.21.15.18:0/699334650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c28108610 con 0x7f1c281081b0 2024-09-19T09:43:09.230 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.458+0000 7f1c25ffb640 1 --2- 172.21.15.18:0/699334650 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f1c180390a0 0x7f1c1803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:09.230 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.458+0000 7f1c25ffb640 1 -- 172.21.15.18:0/699334650 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1c1c06c5c0 con 0x7f1c281081b0 2024-09-19T09:43:09.230 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.458+0000 7f1c27fff640 1 --2- 172.21.15.18:0/699334650 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f1c180390a0 0x7f1c1803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:09.230 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.459+0000 7f1c27fff640 1 --2- 172.21.15.18:0/699334650 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f1c180390a0 0x7f1c1803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1c140098c0 tx=0x7f1c14006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:09.230 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.463+0000 7f1c25ffb640 1 -- 172.21.15.18:0/699334650 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c1c04a200 con 0x7f1c281081b0 2024-09-19T09:43:09.230 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.538+0000 7f1c25ffb640 1 -- 172.21.15.18:0/699334650 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1c1c0457e0 con 0x7f1c281081b0 2024-09-19T09:43:09.230 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.657+0000 7f1c2ed99640 1 -- 172.21.15.18:0/699334650 --> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f1c28106f90 con 0x7f1c180390a0 2024-09-19T09:43:09.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.661+0000 7f1c25ffb640 1 -- 172.21.15.18:0/699334650 <== mgr.14118 v2:172.21.15.18:6800/809218832 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1c28106f90 con 0x7f1c180390a0 2024-09-19T09:43:09.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.664+0000 7f1c2ed99640 1 -- 172.21.15.18:0/699334650 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f1c180390a0 msgr2=0x7f1c1803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:09.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.664+0000 7f1c2ed99640 1 --2- 172.21.15.18:0/699334650 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f1c180390a0 0x7f1c1803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1c140098c0 tx=0x7f1c14006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.664+0000 7f1c2ed99640 1 -- 172.21.15.18:0/699334650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 msgr2=0x7f1c28107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:09.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.664+0000 7f1c2ed99640 1 --2- 172.21.15.18:0/699334650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c28107a30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0097f0 tx=0x7f1c1c030d80 comp rx=0 tx=0).stop 2024-09-19T09:43:09.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.664+0000 7f1c2ed99640 1 -- 172.21.15.18:0/699334650 shutdown_connections 2024-09-19T09:43:09.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.664+0000 7f1c2ed99640 1 --2- 172.21.15.18:0/699334650 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f1c180390a0 0x7f1c1803b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.664+0000 7f1c2ed99640 1 --2- 172.21.15.18:0/699334650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c281081b0 0x7f1c28107a30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.664+0000 7f1c2ed99640 1 -- 172.21.15.18:0/699334650 >> 172.21.15.18:0/699334650 conn(0x7f1c28101d70 msgr2=0x7f1c281028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:09.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.664+0000 7f1c2ed99640 1 -- 172.21.15.18:0/699334650 shutdown_connections 2024-09-19T09:43:09.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:08.664+0000 7f1c2ed99640 1 -- 172.21.15.18:0/699334650 wait complete. 2024-09-19T09:43:09.539 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:09.339+0000 7fc2f318c640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:43:09] ENGINE Error in HTTPServer.serve 2024-09-19T09:43:09.539 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: Traceback (most recent call last): 2024-09-19T09:43:09.539 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:43:09.539 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: self._connections.run(self.expiration_interval) 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: self._run(expiration_interval) 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: s = self.context.wrap_socket( 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: return self.sslsocket_class._create( 2024-09-19T09:43:09.540 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:43:09.541 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: self.do_handshake() 2024-09-19T09:43:09.541 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:43:09.541 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: self._sslobj.do_handshake() 2024-09-19T09:43:09.541 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:43:09.541 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:09.827 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-mon[30956]: mgrmap e8: x(active, since 2s) 2024-09-19T09:43:09.827 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-mon[30956]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:09.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:09.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:09.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-mon[30956]: [19/Sep/2024:09:43:09] ENGINE Bus STARTING 2024-09-19T09:43:09.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-mon[30956]: [19/Sep/2024:09:43:09] ENGINE Serving on http://172.21.15.18:8765 2024-09-19T09:43:09.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-mon[30956]: [19/Sep/2024:09:43:09] ENGINE Serving on https://172.21.15.18:7150 2024-09-19T09:43:09.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-mon[30956]: [19/Sep/2024:09:43:09] ENGINE Bus STARTED 2024-09-19T09:43:09.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:09.828 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:09 smithi018 ceph-mon[30956]: [19/Sep/2024:09:43:09] ENGINE Error in HTTPServer.serve 2024-09-19T09:43:09.828 INFO:journalctl@ceph.mon.a.smithi018.stdout: Traceback (most recent call last): 2024-09-19T09:43:09.828 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._run(expiration_interval) 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: s = self.context.wrap_socket( 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: return self.sslsocket_class._create( 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:43:09.829 INFO:journalctl@ceph.mon.a.smithi018.stdout: self.do_handshake() 2024-09-19T09:43:09.830 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:43:09.830 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._sslobj.do_handshake() 2024-09-19T09:43:09.830 INFO:journalctl@ceph.mon.a.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:43:10.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T09:43:10.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.638+0000 7f0ddb106640 1 Processor -- start 2024-09-19T09:43:10.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.638+0000 7f0ddb106640 1 -- start start 2024-09-19T09:43:10.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.638+0000 7f0ddb106640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd410a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.638+0000 7f0ddb106640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd407be70 con 0x7f0dd4108190 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.638+0000 7f0dd8ea2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd410a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.638+0000 7f0dd8ea2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd410a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58864/0 (socket says 172.21.15.18:58864) 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.638+0000 7f0dd8ea2640 1 -- 172.21.15.18:0/328667773 learned_addr learned my addr 172.21.15.18:0/328667773 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.638+0000 7f0dd8ea2640 1 -- 172.21.15.18:0/328667773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd410aac0 con 0x7f0dd4108190 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.639+0000 7f0dd8ea2640 1 --2- 172.21.15.18:0/328667773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd410a580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009820 tx=0x7f0dc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f453a0ed6bad3d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.639+0000 7f0dd37fe640 1 -- 172.21.15.18:0/328667773 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dc8037070 con 0x7f0dd4108190 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.639+0000 7f0dd37fe640 1 -- 172.21.15.18:0/328667773 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0dc8032900 con 0x7f0dd4108190 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.639+0000 7f0dd37fe640 1 -- 172.21.15.18:0/328667773 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dc8030850 con 0x7f0dd4108190 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.640+0000 7f0ddb106640 1 -- 172.21.15.18:0/328667773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 msgr2=0x7f0dd410a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.640+0000 7f0ddb106640 1 --2- 172.21.15.18:0/328667773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd410a580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009820 tx=0x7f0dc802a270 comp rx=0 tx=0).stop 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.640+0000 7f0ddb106640 1 -- 172.21.15.18:0/328667773 shutdown_connections 2024-09-19T09:43:10.351 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.640+0000 7f0ddb106640 1 --2- 172.21.15.18:0/328667773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd410a580 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.640+0000 7f0ddb106640 1 -- 172.21.15.18:0/328667773 >> 172.21.15.18:0/328667773 conn(0x7f0dd4101d90 msgr2=0x7f0dd41041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.640+0000 7f0ddb106640 1 -- 172.21.15.18:0/328667773 shutdown_connections 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.640+0000 7f0ddb106640 1 -- 172.21.15.18:0/328667773 wait complete. 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.640+0000 7f0ddb106640 1 Processor -- start 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.640+0000 7f0ddb106640 1 -- start start 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0ddb106640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0ddb106640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd410ba90 con 0x7f0dd4108190 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0dd8ea2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0dd8ea2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd419b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58874/0 (socket says 172.21.15.18:58874) 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0dd8ea2640 1 -- 172.21.15.18:0/2054574532 learned_addr learned my addr 172.21.15.18:0/2054574532 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0dd8ea2640 1 -- 172.21.15.18:0/2054574532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd419bbc0 con 0x7f0dd4108190 2024-09-19T09:43:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0dd8ea2640 1 --2- 172.21.15.18:0/2054574532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd419b680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80097f0 tx=0x7f0dc8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0dd1ffb640 1 -- 172.21.15.18:0/2054574532 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dc8042070 con 0x7f0dd4108190 2024-09-19T09:43:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0dd1ffb640 1 -- 172.21.15.18:0/2054574532 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0dc8032ca0 con 0x7f0dd4108190 2024-09-19T09:43:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0ddb106640 1 -- 172.21.15.18:0/2054574532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd419be50 con 0x7f0dd4108190 2024-09-19T09:43:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.641+0000 7f0dd1ffb640 1 -- 172.21.15.18:0/2054574532 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dc8037040 con 0x7f0dd4108190 2024-09-19T09:43:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.642+0000 7f0ddb106640 1 -- 172.21.15.18:0/2054574532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd419eb40 con 0x7f0dd4108190 2024-09-19T09:43:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.642+0000 7f0dd1ffb640 1 -- 172.21.15.18:0/2054574532 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0dc8045070 con 0x7f0dd4108190 2024-09-19T09:43:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.643+0000 7f0dd1ffb640 1 --2- 172.21.15.18:0/2054574532 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f0dc4039200 0x7f0dc403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.643+0000 7f0dd1ffb640 1 -- 172.21.15.18:0/2054574532 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0dc806c260 con 0x7f0dd4108190 2024-09-19T09:43:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.643+0000 7f0ddb106640 1 -- 172.21.15.18:0/2054574532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd41085f0 con 0x7f0dd4108190 2024-09-19T09:43:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.643+0000 7f0dd3fff640 1 --2- 172.21.15.18:0/2054574532 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f0dc4039200 0x7f0dc403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.643+0000 7f0dd3fff640 1 --2- 172.21.15.18:0/2054574532 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f0dc4039200 0x7f0dc403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00098c0 tx=0x7f0dc0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.648+0000 7f0dd1ffb640 1 -- 172.21.15.18:0/2054574532 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0dc8045520 con 0x7f0dd4108190 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.825+0000 7f0ddb106640 1 -- 172.21.15.18:0/2054574532 --> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f0dd4103080 con 0x7f0dc4039200 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.826+0000 7f0dd1ffb640 1 -- 172.21.15.18:0/2054574532 <== mgr.14118 v2:172.21.15.18:6800/809218832 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f0dd4103080 con 0x7f0dc4039200 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.828+0000 7f0ddb106640 1 -- 172.21.15.18:0/2054574532 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f0dc4039200 msgr2=0x7f0dc403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.828+0000 7f0ddb106640 1 --2- 172.21.15.18:0/2054574532 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f0dc4039200 0x7f0dc403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00098c0 tx=0x7f0dc0006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.828+0000 7f0ddb106640 1 -- 172.21.15.18:0/2054574532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 msgr2=0x7f0dd419b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.828+0000 7f0ddb106640 1 --2- 172.21.15.18:0/2054574532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd419b680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80097f0 tx=0x7f0dc8030ec0 comp rx=0 tx=0).stop 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.828+0000 7f0ddb106640 1 -- 172.21.15.18:0/2054574532 shutdown_connections 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.828+0000 7f0ddb106640 1 --2- 172.21.15.18:0/2054574532 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f0dc4039200 0x7f0dc403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.828+0000 7f0ddb106640 1 --2- 172.21.15.18:0/2054574532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dd4108190 0x7f0dd419b680 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.828+0000 7f0ddb106640 1 -- 172.21.15.18:0/2054574532 >> 172.21.15.18:0/2054574532 conn(0x7f0dd4101d90 msgr2=0x7f0dd4102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.828+0000 7f0ddb106640 1 -- 172.21.15.18:0/2054574532 shutdown_connections 2024-09-19T09:43:10.355 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:09.828+0000 7f0ddb106640 1 -- 172.21.15.18:0/2054574532 wait complete. 2024-09-19T09:43:10.355 INFO:teuthology.orchestra.run.smithi018.stdout:Generating ssh key... 2024-09-19T09:43:10.770 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:10 smithi018 ceph-mon[30956]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:11.385 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: Generating public/private rsa key pair. 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: Your identification has been saved in /tmp/tmpayn99sb0/key 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: Your public key has been saved in /tmp/tmpayn99sb0/key.pub 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: The key fingerprint is: 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: SHA256:fhDUbA9y+/b9OzZKboPLwltJtZlqjJUBGbinLBpUYvg ceph-5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: The key's randomart image is: 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: +---[RSA 3072]----+ 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: | . o=o | 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: | . o . o..B | 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: | o o o+ = . | 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: | E . o. = + | 2024-09-19T09:43:11.386 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: | . . S = + | 2024-09-19T09:43:11.387 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: | . . + .= = | 2024-09-19T09:43:11.387 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: | o . o..B.o . | 2024-09-19T09:43:11.387 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: | . ++.oo.+.| 2024-09-19T09:43:11.387 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: | .oooo+.*| 2024-09-19T09:43:11.387 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: +----[SHA256]-----+ 2024-09-19T09:43:11.742 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.775+0000 7f725a56e640 1 Processor -- start 2024-09-19T09:43:11.742 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.775+0000 7f725a56e640 1 -- start start 2024-09-19T09:43:11.743 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.775+0000 7f725a56e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f7254107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:11.743 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.775+0000 7f725a56e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7254108080 con 0x7f72541076b0 2024-09-19T09:43:11.743 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.775+0000 7f7253fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f7254107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:11.743 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.775+0000 7f7253fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f7254107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58878/0 (socket says 172.21.15.18:58878) 2024-09-19T09:43:11.743 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.775+0000 7f7253fff640 1 -- 172.21.15.18:0/2714087034 learned_addr learned my addr 172.21.15.18:0/2714087034 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:11.743 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.775+0000 7f7253fff640 1 -- 172.21.15.18:0/2714087034 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72541088b0 con 0x7f72541076b0 2024-09-19T09:43:11.743 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.776+0000 7f7253fff640 1 --2- 172.21.15.18:0/2714087034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f7254107ab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7244009820 tx=0x7f724402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec8edd137c85ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:11.743 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.776+0000 7f7252ffd640 1 -- 172.21.15.18:0/2714087034 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7244037070 con 0x7f72541076b0 2024-09-19T09:43:11.744 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.776+0000 7f7252ffd640 1 -- 172.21.15.18:0/2714087034 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7244032900 con 0x7f72541076b0 2024-09-19T09:43:11.744 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.776+0000 7f7252ffd640 1 -- 172.21.15.18:0/2714087034 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7244030850 con 0x7f72541076b0 2024-09-19T09:43:11.744 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.777+0000 7f725a56e640 1 -- 172.21.15.18:0/2714087034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 msgr2=0x7f7254107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:11.744 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.777+0000 7f725a56e640 1 --2- 172.21.15.18:0/2714087034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f7254107ab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7244009820 tx=0x7f724402a270 comp rx=0 tx=0).stop 2024-09-19T09:43:11.744 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.777+0000 7f725a56e640 1 -- 172.21.15.18:0/2714087034 shutdown_connections 2024-09-19T09:43:11.744 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.777+0000 7f725a56e640 1 --2- 172.21.15.18:0/2714087034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f7254107ab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:11.744 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.777+0000 7f725a56e640 1 -- 172.21.15.18:0/2714087034 >> 172.21.15.18:0/2714087034 conn(0x7f7254102e80 msgr2=0x7f72541052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:11.745 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.777+0000 7f725a56e640 1 -- 172.21.15.18:0/2714087034 shutdown_connections 2024-09-19T09:43:11.745 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.777+0000 7f725a56e640 1 -- 172.21.15.18:0/2714087034 wait complete. 2024-09-19T09:43:11.745 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.778+0000 7f725a56e640 1 Processor -- start 2024-09-19T09:43:11.745 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.778+0000 7f725a56e640 1 -- start start 2024-09-19T09:43:11.745 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.778+0000 7f725a56e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f725419d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:11.745 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.778+0000 7f725a56e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f725410bc60 con 0x7f72541076b0 2024-09-19T09:43:11.745 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.778+0000 7f7253fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f725419d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:11.745 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.778+0000 7f7253fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f725419d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58888/0 (socket says 172.21.15.18:58888) 2024-09-19T09:43:11.745 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.778+0000 7f7253fff640 1 -- 172.21.15.18:0/552547908 learned_addr learned my addr 172.21.15.18:0/552547908 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:11.745 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.778+0000 7f7253fff640 1 -- 172.21.15.18:0/552547908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725419ddb0 con 0x7f72541076b0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.779+0000 7f7253fff640 1 --2- 172.21.15.18:0/552547908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f725419d870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72440097f0 tx=0x7f7244030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.779+0000 7f72517fa640 1 -- 172.21.15.18:0/552547908 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7244037040 con 0x7f72541076b0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.779+0000 7f72517fa640 1 -- 172.21.15.18:0/552547908 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7244040070 con 0x7f72541076b0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.779+0000 7f725a56e640 1 -- 172.21.15.18:0/552547908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725419e040 con 0x7f72541076b0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.779+0000 7f72517fa640 1 -- 172.21.15.18:0/552547908 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724403a390 con 0x7f72541076b0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.779+0000 7f725a56e640 1 -- 172.21.15.18:0/552547908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72541a0d30 con 0x7f72541076b0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.780+0000 7f72517fa640 1 -- 172.21.15.18:0/552547908 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f724403a5e0 con 0x7f72541076b0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.780+0000 7f725a56e640 1 -- 172.21.15.18:0/552547908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7254107b30 con 0x7f72541076b0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.780+0000 7f72517fa640 1 --2- 172.21.15.18:0/552547908 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f723c039200 0x7f723c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.780+0000 7f72517fa640 1 -- 172.21.15.18:0/552547908 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f724406c980 con 0x7f72541076b0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.780+0000 7f72537fe640 1 --2- 172.21.15.18:0/552547908 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f723c039200 0x7f723c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:11.746 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.781+0000 7f72537fe640 1 --2- 172.21.15.18:0/552547908 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f723c039200 0x7f723c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f72480098c0 tx=0x7f7248006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.785+0000 7f72517fa640 1 -- 172.21.15.18:0/552547908 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7244043760 con 0x7f72541076b0 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:10.962+0000 7f725a56e640 1 -- 172.21.15.18:0/552547908 --> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f7254104080 con 0x7f723c039200 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.126+0000 7f72517fa640 1 -- 172.21.15.18:0/552547908 <== mgr.14118 v2:172.21.15.18:6800/809218832 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7254104080 con 0x7f723c039200 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.127+0000 7f725a56e640 1 -- 172.21.15.18:0/552547908 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f723c039200 msgr2=0x7f723c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.128+0000 7f725a56e640 1 --2- 172.21.15.18:0/552547908 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f723c039200 0x7f723c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f72480098c0 tx=0x7f7248006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.128+0000 7f725a56e640 1 -- 172.21.15.18:0/552547908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 msgr2=0x7f725419d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.128+0000 7f725a56e640 1 --2- 172.21.15.18:0/552547908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f725419d870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72440097f0 tx=0x7f7244030d80 comp rx=0 tx=0).stop 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.128+0000 7f725a56e640 1 -- 172.21.15.18:0/552547908 shutdown_connections 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.128+0000 7f725a56e640 1 --2- 172.21.15.18:0/552547908 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f723c039200 0x7f723c03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.128+0000 7f725a56e640 1 --2- 172.21.15.18:0/552547908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72541076b0 0x7f725419d870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.128+0000 7f725a56e640 1 -- 172.21.15.18:0/552547908 >> 172.21.15.18:0/552547908 conn(0x7f7254102e80 msgr2=0x7f7254103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.128+0000 7f725a56e640 1 -- 172.21.15.18:0/552547908 shutdown_connections 2024-09-19T09:43:11.747 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:11.128+0000 7f725a56e640 1 -- 172.21.15.18:0/552547908 wait complete. 2024-09-19T09:43:12.296 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:12 smithi018 ceph-mon[30956]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:12.296 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:12 smithi018 ceph-mon[30956]: Generating ssh key... 2024-09-19T09:43:12.296 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:12 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:12.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:12 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:12.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDf8FqoopOO1AGDkD/ms8JtlMRIbHGR4IEiYKBR98uVT6A6EY8IOEPLYba2Tzd6lWAWMjQkYYZr6UEt+4gV78NTdRCL6c3TJNy5owMt4zlsQlqmy7Zlmarc+U7kQhun6JTgyaxK6oNPEvtKoCPHHcKSbxHqXAQhlFKo6aEWwuKL1fcFs5ILL8OyZ3uNItYVCOD2O8WvJNKI5ZQjO/rMky3wtZlIV5ThqAhHGWOQOccS1IJQr3sCHgEFfrV9nky441FLCiiwpL6v94gW5x1SmrOUVLmucLpSrwrSWQxKeaFBdvifSfOD5G+0J1U5HQToQ4FkmKwxBghs/CVg9AIS10S9VMESPVbVYDy4EJM+thd2SOlTtZKdAwsI5ZjDU65xYyB7WLINJv0YNroJveQiL+2xVzXnbX3CPTf1zTguFKHYHSArfBO/Qjw2uP3brlQzu/ZAJvbeeK7ZlqaKRI5yOTFnfsQl6zcKWW55V3D4vc+hm4QXp12cl6GXtyTQoRPV5z0= ceph-5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:43:12.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.106+0000 7fe193b57640 1 Processor -- start 2024-09-19T09:43:12.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.106+0000 7fe193b57640 1 -- start start 2024-09-19T09:43:12.828 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.106+0000 7fe193b57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c10a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:12.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.106+0000 7fe193b57640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c07be50 con 0x7fe18c1081b0 2024-09-19T09:43:12.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.106+0000 7fe1918f3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c10a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:12.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.106+0000 7fe1918f3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c10a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58896/0 (socket says 172.21.15.18:58896) 2024-09-19T09:43:12.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.106+0000 7fe1918f3640 1 -- 172.21.15.18:0/4083800255 learned_addr learned my addr 172.21.15.18:0/4083800255 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:12.829 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.107+0000 7fe1918f3640 1 -- 172.21.15.18:0/4083800255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c10aae0 con 0x7fe18c1081b0 2024-09-19T09:43:12.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.107+0000 7fe1918f3640 1 --2- 172.21.15.18:0/4083800255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c10a5a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe188009820 tx=0x7fe18802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18de02094b37ce68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:12.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.108+0000 7fe1908f1640 1 -- 172.21.15.18:0/4083800255 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188037070 con 0x7fe18c1081b0 2024-09-19T09:43:12.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.108+0000 7fe1908f1640 1 -- 172.21.15.18:0/4083800255 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe188032900 con 0x7fe18c1081b0 2024-09-19T09:43:12.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.108+0000 7fe1908f1640 1 -- 172.21.15.18:0/4083800255 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188030850 con 0x7fe18c1081b0 2024-09-19T09:43:12.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.108+0000 7fe193b57640 1 -- 172.21.15.18:0/4083800255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 msgr2=0x7fe18c10a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:12.830 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.108+0000 7fe193b57640 1 --2- 172.21.15.18:0/4083800255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c10a5a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe188009820 tx=0x7fe18802a270 comp rx=0 tx=0).stop 2024-09-19T09:43:12.831 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.108+0000 7fe193b57640 1 -- 172.21.15.18:0/4083800255 shutdown_connections 2024-09-19T09:43:12.831 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.108+0000 7fe193b57640 1 --2- 172.21.15.18:0/4083800255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c10a5a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:12.831 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.108+0000 7fe193b57640 1 -- 172.21.15.18:0/4083800255 >> 172.21.15.18:0/4083800255 conn(0x7fe18c101d70 msgr2=0x7fe18c104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:12.831 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.108+0000 7fe193b57640 1 -- 172.21.15.18:0/4083800255 shutdown_connections 2024-09-19T09:43:12.831 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.109+0000 7fe193b57640 1 -- 172.21.15.18:0/4083800255 wait complete. 2024-09-19T09:43:12.831 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.109+0000 7fe193b57640 1 Processor -- start 2024-09-19T09:43:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.109+0000 7fe193b57640 1 -- start start 2024-09-19T09:43:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.109+0000 7fe193b57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.109+0000 7fe193b57640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c10ba50 con 0x7fe18c1081b0 2024-09-19T09:43:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.109+0000 7fe1918f3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.109+0000 7fe1918f3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58908/0 (socket says 172.21.15.18:58908) 2024-09-19T09:43:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.109+0000 7fe1918f3640 1 -- 172.21.15.18:0/3037811645 learned_addr learned my addr 172.21.15.18:0/3037811645 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.110+0000 7fe1918f3640 1 -- 172.21.15.18:0/3037811645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c19bba0 con 0x7fe18c1081b0 2024-09-19T09:43:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.110+0000 7fe1918f3640 1 --2- 172.21.15.18:0/3037811645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c19b660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe188032ce0 tx=0x7fe188032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.110+0000 7fe17effd640 1 -- 172.21.15.18:0/3037811645 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188042070 con 0x7fe18c1081b0 2024-09-19T09:43:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.110+0000 7fe17effd640 1 -- 172.21.15.18:0/3037811645 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1880308c0 con 0x7fe18c1081b0 2024-09-19T09:43:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.110+0000 7fe193b57640 1 -- 172.21.15.18:0/3037811645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18c19be30 con 0x7fe18c1081b0 2024-09-19T09:43:12.834 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.110+0000 7fe17effd640 1 -- 172.21.15.18:0/3037811645 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188037040 con 0x7fe18c1081b0 2024-09-19T09:43:12.834 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.110+0000 7fe193b57640 1 -- 172.21.15.18:0/3037811645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18c19eb20 con 0x7fe18c1081b0 2024-09-19T09:43:12.834 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.111+0000 7fe17effd640 1 -- 172.21.15.18:0/3037811645 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe188045070 con 0x7fe18c1081b0 2024-09-19T09:43:12.834 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.111+0000 7fe17effd640 1 --2- 172.21.15.18:0/3037811645 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fe1780391b0 0x7fe17803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:12.834 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.111+0000 7fe17effd640 1 -- 172.21.15.18:0/3037811645 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe18806c430 con 0x7fe18c1081b0 2024-09-19T09:43:12.834 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.111+0000 7fe1910f2640 1 --2- 172.21.15.18:0/3037811645 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fe1780391b0 0x7fe17803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:12.835 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.111+0000 7fe193b57640 1 -- 172.21.15.18:0/3037811645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18c108610 con 0x7fe18c1081b0 2024-09-19T09:43:12.835 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.112+0000 7fe1910f2640 1 --2- 172.21.15.18:0/3037811645 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fe1780391b0 0x7fe17803b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe1800098c0 tx=0x7fe180006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:12.835 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.116+0000 7fe17effd640 1 -- 172.21.15.18:0/3037811645 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe18806bd80 con 0x7fe18c1081b0 2024-09-19T09:43:12.835 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.294+0000 7fe193b57640 1 -- 172.21.15.18:0/3037811645 --> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fe18c103010 con 0x7fe1780391b0 2024-09-19T09:43:12.835 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.295+0000 7fe17effd640 1 -- 172.21.15.18:0/3037811645 <== mgr.14118 v2:172.21.15.18:6800/809218832 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fe18c103010 con 0x7fe1780391b0 2024-09-19T09:43:12.836 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.297+0000 7fe193b57640 1 -- 172.21.15.18:0/3037811645 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fe1780391b0 msgr2=0x7fe17803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:12.836 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.297+0000 7fe193b57640 1 --2- 172.21.15.18:0/3037811645 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fe1780391b0 0x7fe17803b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe1800098c0 tx=0x7fe180006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:12.836 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.297+0000 7fe193b57640 1 -- 172.21.15.18:0/3037811645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 msgr2=0x7fe18c19b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:12.836 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.297+0000 7fe193b57640 1 --2- 172.21.15.18:0/3037811645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c19b660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe188032ce0 tx=0x7fe188032d10 comp rx=0 tx=0).stop 2024-09-19T09:43:12.836 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.297+0000 7fe193b57640 1 -- 172.21.15.18:0/3037811645 shutdown_connections 2024-09-19T09:43:12.836 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.297+0000 7fe193b57640 1 --2- 172.21.15.18:0/3037811645 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fe1780391b0 0x7fe17803b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:12.837 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.297+0000 7fe193b57640 1 --2- 172.21.15.18:0/3037811645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c1081b0 0x7fe18c19b660 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:12.837 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.297+0000 7fe193b57640 1 -- 172.21.15.18:0/3037811645 >> 172.21.15.18:0/3037811645 conn(0x7fe18c101d70 msgr2=0x7fe18c102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:12.837 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.297+0000 7fe193b57640 1 -- 172.21.15.18:0/3037811645 shutdown_connections 2024-09-19T09:43:12.837 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:12.297+0000 7fe193b57640 1 -- 172.21.15.18:0/3037811645 wait complete. 2024-09-19T09:43:12.837 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:43:12.837 INFO:teuthology.orchestra.run.smithi018.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T09:43:12.838 INFO:teuthology.orchestra.run.smithi018.stdout:Adding host smithi018... 2024-09-19T09:43:13.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:13 smithi018 ceph-mon[30956]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:14.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:14 smithi018 ceph-mon[30956]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:15.728 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:15 smithi018 ceph-mon[30956]: Deploying cephadm binary to smithi018 2024-09-19T09:43:17.939 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Added host 'smithi018' with addr '172.21.15.18' 2024-09-19T09:43:17.939 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.249+0000 7fde01bb2640 1 Processor -- start 2024-09-19T09:43:17.939 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.250+0000 7fde01bb2640 1 -- start start 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.250+0000 7fde01bb2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc10a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.250+0000 7fde01bb2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc07bed0 con 0x7fddfc108130 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.250+0000 7fddfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc10a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.250+0000 7fddfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc10a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58916/0 (socket says 172.21.15.18:58916) 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.250+0000 7fddfb7fe640 1 -- 172.21.15.18:0/1588127798 learned_addr learned my addr 172.21.15.18:0/1588127798 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.250+0000 7fddfb7fe640 1 -- 172.21.15.18:0/1588127798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc10aa60 con 0x7fddfc108130 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.251+0000 7fddfb7fe640 1 --2- 172.21.15.18:0/1588127798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc10a520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fddec009820 tx=0x7fddec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3879fce6bfae0d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.251+0000 7fddfa7fc640 1 -- 172.21.15.18:0/1588127798 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec037070 con 0x7fddfc108130 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.251+0000 7fddfa7fc640 1 -- 172.21.15.18:0/1588127798 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fddec032900 con 0x7fddfc108130 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.251+0000 7fddfa7fc640 1 -- 172.21.15.18:0/1588127798 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec030850 con 0x7fddfc108130 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.252+0000 7fde01bb2640 1 -- 172.21.15.18:0/1588127798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 msgr2=0x7fddfc10a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:17.940 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.252+0000 7fde01bb2640 1 --2- 172.21.15.18:0/1588127798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc10a520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fddec009820 tx=0x7fddec02a270 comp rx=0 tx=0).stop 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.252+0000 7fde01bb2640 1 -- 172.21.15.18:0/1588127798 shutdown_connections 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.252+0000 7fde01bb2640 1 --2- 172.21.15.18:0/1588127798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc10a520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.252+0000 7fde01bb2640 1 -- 172.21.15.18:0/1588127798 >> 172.21.15.18:0/1588127798 conn(0x7fddfc101d70 msgr2=0x7fddfc104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.252+0000 7fde01bb2640 1 -- 172.21.15.18:0/1588127798 shutdown_connections 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.252+0000 7fde01bb2640 1 -- 172.21.15.18:0/1588127798 wait complete. 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.252+0000 7fde01bb2640 1 Processor -- start 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.253+0000 7fde01bb2640 1 -- start start 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.253+0000 7fde01bb2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc19b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.253+0000 7fde01bb2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc10ba90 con 0x7fddfc108130 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.253+0000 7fddfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc19b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:17.941 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.253+0000 7fddfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc19b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58922/0 (socket says 172.21.15.18:58922) 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.253+0000 7fddfb7fe640 1 -- 172.21.15.18:0/4163166399 learned_addr learned my addr 172.21.15.18:0/4163166399 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.253+0000 7fddfb7fe640 1 -- 172.21.15.18:0/4163166399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc19bb80 con 0x7fddfc108130 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.254+0000 7fddfb7fe640 1 --2- 172.21.15.18:0/4163166399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc19b640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fddec0097f0 tx=0x7fddec030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.254+0000 7fddf8ff9640 1 -- 172.21.15.18:0/4163166399 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec037040 con 0x7fddfc108130 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.254+0000 7fddf8ff9640 1 -- 172.21.15.18:0/4163166399 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fddec040070 con 0x7fddfc108130 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.254+0000 7fde01bb2640 1 -- 172.21.15.18:0/4163166399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddfc19be10 con 0x7fddfc108130 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.254+0000 7fddf8ff9640 1 -- 172.21.15.18:0/4163166399 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec03a390 con 0x7fddfc108130 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.254+0000 7fde01bb2640 1 -- 172.21.15.18:0/4163166399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddfc19eb00 con 0x7fddfc108130 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.255+0000 7fddf8ff9640 1 -- 172.21.15.18:0/4163166399 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fddec03a5e0 con 0x7fddfc108130 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.255+0000 7fde01bb2640 1 -- 172.21.15.18:0/4163166399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddfc108590 con 0x7fddfc108130 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.255+0000 7fddf8ff9640 1 --2- 172.21.15.18:0/4163166399 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdde4039200 0x7fdde403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.255+0000 7fddf8ff9640 1 -- 172.21.15.18:0/4163166399 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fddec06c750 con 0x7fddfc108130 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.255+0000 7fddfaffd640 1 --2- 172.21.15.18:0/4163166399 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdde4039200 0x7fdde403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.256+0000 7fddfaffd640 1 --2- 172.21.15.18:0/4163166399 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdde4039200 0x7fdde403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fddf00098c0 tx=0x7fddf0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.260+0000 7fddf8ff9640 1 -- 172.21.15.18:0/4163166399 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fddec042310 con 0x7fddfc108130 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:13.438+0000 7fde01bb2640 1 -- 172.21.15.18:0/4163166399 --> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}) -- 0x7fddfc103030 con 0x7fdde4039200 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.376+0000 7fddf8ff9640 1 -- 172.21.15.18:0/4163166399 <== mgr.14118 v2:172.21.15.18:6800/809218832 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fddfc103030 con 0x7fdde4039200 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.379+0000 7fde01bb2640 1 -- 172.21.15.18:0/4163166399 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdde4039200 msgr2=0x7fdde403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.379+0000 7fde01bb2640 1 --2- 172.21.15.18:0/4163166399 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdde4039200 0x7fdde403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fddf00098c0 tx=0x7fddf0006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.379+0000 7fde01bb2640 1 -- 172.21.15.18:0/4163166399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 msgr2=0x7fddfc19b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.379+0000 7fde01bb2640 1 --2- 172.21.15.18:0/4163166399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc19b640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fddec0097f0 tx=0x7fddec030d80 comp rx=0 tx=0).stop 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.379+0000 7fde01bb2640 1 -- 172.21.15.18:0/4163166399 shutdown_connections 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.379+0000 7fde01bb2640 1 --2- 172.21.15.18:0/4163166399 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdde4039200 0x7fdde403b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:17.943 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.379+0000 7fde01bb2640 1 --2- 172.21.15.18:0/4163166399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc108130 0x7fddfc19b640 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:17.944 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.379+0000 7fde01bb2640 1 -- 172.21.15.18:0/4163166399 >> 172.21.15.18:0/4163166399 conn(0x7fddfc101d70 msgr2=0x7fddfc102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:17.944 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.379+0000 7fde01bb2640 1 -- 172.21.15.18:0/4163166399 shutdown_connections 2024-09-19T09:43:17.944 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:17.379+0000 7fde01bb2640 1 -- 172.21.15.18:0/4163166399 wait complete. 2024-09-19T09:43:17.944 INFO:teuthology.orchestra.run.smithi018.stdout:Deploying unmanaged mon service... 2024-09-19T09:43:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:18 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:18 smithi018 ceph-mon[30956]: Added host smithi018 2024-09-19T09:43:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:18 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:19.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:19 smithi018 ceph-mon[30956]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:19.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:19 smithi018 ceph-mon[30956]: Saving service mon spec with placement count:5 2024-09-19T09:43:19.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:19 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:19.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:19 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:20.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T09:43:20.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.459+0000 7f405e871640 1 Processor -- start 2024-09-19T09:43:20.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.459+0000 7f405e871640 1 -- start start 2024-09-19T09:43:20.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.459+0000 7f405e871640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405810a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:20.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.460+0000 7f405e871640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f405807be90 con 0x7f4058108170 2024-09-19T09:43:20.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.460+0000 7f4057fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405810a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:20.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.460+0000 7f4057fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405810a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36974/0 (socket says 172.21.15.18:36974) 2024-09-19T09:43:20.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.460+0000 7f4057fff640 1 -- 172.21.15.18:0/3261178713 learned_addr learned my addr 172.21.15.18:0/3261178713 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:20.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.460+0000 7f4057fff640 1 -- 172.21.15.18:0/3261178713 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405810aaa0 con 0x7f4058108170 2024-09-19T09:43:20.263 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.461+0000 7f4057fff640 1 --2- 172.21.15.18:0/3261178713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405810a560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4048009820 tx=0x7f404802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8492bb656850ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.461+0000 7f4056ffd640 1 -- 172.21.15.18:0/3261178713 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4048037070 con 0x7f4058108170 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.461+0000 7f4056ffd640 1 -- 172.21.15.18:0/3261178713 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4048032900 con 0x7f4058108170 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.461+0000 7f4056ffd640 1 -- 172.21.15.18:0/3261178713 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4048030850 con 0x7f4058108170 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.461+0000 7f405e871640 1 -- 172.21.15.18:0/3261178713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 msgr2=0x7f405810a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.461+0000 7f405e871640 1 --2- 172.21.15.18:0/3261178713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405810a560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4048009820 tx=0x7f404802a270 comp rx=0 tx=0).stop 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.462+0000 7f405e871640 1 -- 172.21.15.18:0/3261178713 shutdown_connections 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.462+0000 7f405e871640 1 --2- 172.21.15.18:0/3261178713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405810a560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.462+0000 7f405e871640 1 -- 172.21.15.18:0/3261178713 >> 172.21.15.18:0/3261178713 conn(0x7f4058101d70 msgr2=0x7f4058104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.462+0000 7f405e871640 1 -- 172.21.15.18:0/3261178713 shutdown_connections 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.462+0000 7f405e871640 1 -- 172.21.15.18:0/3261178713 wait complete. 2024-09-19T09:43:20.264 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.462+0000 7f405e871640 1 Processor -- start 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.462+0000 7f405e871640 1 -- start start 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.462+0000 7f405e871640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.462+0000 7f405e871640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f405810ba70 con 0x7f4058108170 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.463+0000 7f4057fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.463+0000 7f4057fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36980/0 (socket says 172.21.15.18:36980) 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.463+0000 7f4057fff640 1 -- 172.21.15.18:0/3470109329 learned_addr learned my addr 172.21.15.18:0/3470109329 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.463+0000 7f4057fff640 1 -- 172.21.15.18:0/3470109329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405819bb90 con 0x7f4058108170 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.463+0000 7f4057fff640 1 --2- 172.21.15.18:0/3470109329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405819b650 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4048032ce0 tx=0x7f4048032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.463+0000 7f40557fa640 1 -- 172.21.15.18:0/3470109329 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4048042070 con 0x7f4058108170 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.463+0000 7f40557fa640 1 -- 172.21.15.18:0/3470109329 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40480308c0 con 0x7f4058108170 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.463+0000 7f405e871640 1 -- 172.21.15.18:0/3470109329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405819be20 con 0x7f4058108170 2024-09-19T09:43:20.265 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.463+0000 7f40557fa640 1 -- 172.21.15.18:0/3470109329 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4048037040 con 0x7f4058108170 2024-09-19T09:43:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.463+0000 7f405e871640 1 -- 172.21.15.18:0/3470109329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405819eb10 con 0x7f4058108170 2024-09-19T09:43:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.464+0000 7f40557fa640 1 -- 172.21.15.18:0/3470109329 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4048045070 con 0x7f4058108170 2024-09-19T09:43:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.464+0000 7f405e871640 1 -- 172.21.15.18:0/3470109329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40581085d0 con 0x7f4058108170 2024-09-19T09:43:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.464+0000 7f40557fa640 1 --2- 172.21.15.18:0/3470109329 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f40400391b0 0x7f404003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.464+0000 7f40557fa640 1 -- 172.21.15.18:0/3470109329 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f404806c330 con 0x7f4058108170 2024-09-19T09:43:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.464+0000 7f40577fe640 1 --2- 172.21.15.18:0/3470109329 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f40400391b0 0x7f404003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.465+0000 7f40577fe640 1 --2- 172.21.15.18:0/3470109329 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f40400391b0 0x7f404003b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f404c0098c0 tx=0x7f404c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.469+0000 7f40557fa640 1 -- 172.21.15.18:0/3470109329 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f404803cd00 con 0x7f4058108170 2024-09-19T09:43:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.662+0000 7f405e871640 1 -- 172.21.15.18:0/3470109329 --> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f4058103060 con 0x7f40400391b0 2024-09-19T09:43:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.667+0000 7f40557fa640 1 -- 172.21.15.18:0/3470109329 <== mgr.14118 v2:172.21.15.18:6800/809218832 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4058103060 con 0x7f40400391b0 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.669+0000 7f405e871640 1 -- 172.21.15.18:0/3470109329 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f40400391b0 msgr2=0x7f404003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.669+0000 7f405e871640 1 --2- 172.21.15.18:0/3470109329 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f40400391b0 0x7f404003b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f404c0098c0 tx=0x7f404c006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.669+0000 7f405e871640 1 -- 172.21.15.18:0/3470109329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 msgr2=0x7f405819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.669+0000 7f405e871640 1 --2- 172.21.15.18:0/3470109329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405819b650 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4048032ce0 tx=0x7f4048032d10 comp rx=0 tx=0).stop 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.669+0000 7f405e871640 1 -- 172.21.15.18:0/3470109329 shutdown_connections 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.669+0000 7f405e871640 1 --2- 172.21.15.18:0/3470109329 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f40400391b0 0x7f404003b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.669+0000 7f405e871640 1 --2- 172.21.15.18:0/3470109329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4058108170 0x7f405819b650 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.669+0000 7f405e871640 1 -- 172.21.15.18:0/3470109329 >> 172.21.15.18:0/3470109329 conn(0x7f4058101d70 msgr2=0x7f4058102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.669+0000 7f405e871640 1 -- 172.21.15.18:0/3470109329 shutdown_connections 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:18.669+0000 7f405e871640 1 -- 172.21.15.18:0/3470109329 wait complete. 2024-09-19T09:43:20.267 INFO:teuthology.orchestra.run.smithi018.stdout:Deploying unmanaged mgr service... 2024-09-19T09:43:21.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T09:43:21.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.672+0000 7f98a7694640 1 Processor -- start 2024-09-19T09:43:21.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.672+0000 7f98a7694640 1 -- start start 2024-09-19T09:43:21.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.673+0000 7f98a7694640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a010a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:21.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.673+0000 7f98a7694640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98a007be90 con 0x7f98a0108170 2024-09-19T09:43:21.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.673+0000 7f98a5430640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a010a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:21.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.673+0000 7f98a5430640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a010a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36982/0 (socket says 172.21.15.18:36982) 2024-09-19T09:43:21.480 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.673+0000 7f98a5430640 1 -- 172.21.15.18:0/975542878 learned_addr learned my addr 172.21.15.18:0/975542878 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.673+0000 7f98a5430640 1 -- 172.21.15.18:0/975542878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a010aaa0 con 0x7f98a0108170 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.674+0000 7f98a5430640 1 --2- 172.21.15.18:0/975542878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a010a560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9898009820 tx=0x7f989802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3201788cb51d74b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.674+0000 7f989ffff640 1 -- 172.21.15.18:0/975542878 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9898037070 con 0x7f98a0108170 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.674+0000 7f989ffff640 1 -- 172.21.15.18:0/975542878 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9898032920 con 0x7f98a0108170 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.674+0000 7f989ffff640 1 -- 172.21.15.18:0/975542878 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9898030810 con 0x7f98a0108170 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.675+0000 7f98a7694640 1 -- 172.21.15.18:0/975542878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 msgr2=0x7f98a010a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.675+0000 7f98a7694640 1 --2- 172.21.15.18:0/975542878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a010a560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9898009820 tx=0x7f989802a270 comp rx=0 tx=0).stop 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.675+0000 7f98a7694640 1 -- 172.21.15.18:0/975542878 shutdown_connections 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.675+0000 7f98a7694640 1 --2- 172.21.15.18:0/975542878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a010a560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.675+0000 7f98a7694640 1 -- 172.21.15.18:0/975542878 >> 172.21.15.18:0/975542878 conn(0x7f98a0101d70 msgr2=0x7f98a0104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.675+0000 7f98a7694640 1 -- 172.21.15.18:0/975542878 shutdown_connections 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.675+0000 7f98a7694640 1 -- 172.21.15.18:0/975542878 wait complete. 2024-09-19T09:43:21.481 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.675+0000 7f98a7694640 1 Processor -- start 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.675+0000 7f98a7694640 1 -- start start 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f98a7694640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a019d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f98a7694640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98a010bab0 con 0x7f98a0108170 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f98a5430640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a019d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f98a5430640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a019d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36988/0 (socket says 172.21.15.18:36988) 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f98a5430640 1 -- 172.21.15.18:0/2437499927 learned_addr learned my addr 172.21.15.18:0/2437499927 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f98a5430640 1 -- 172.21.15.18:0/2437499927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a019dde0 con 0x7f98a0108170 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f98a5430640 1 --2- 172.21.15.18:0/2437499927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a019d8a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98980097f0 tx=0x7f98980327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f989e7fc640 1 -- 172.21.15.18:0/2437499927 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9898037040 con 0x7f98a0108170 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f98a7694640 1 -- 172.21.15.18:0/2437499927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a019e070 con 0x7f98a0108170 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f989e7fc640 1 -- 172.21.15.18:0/2437499927 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9898030cc0 con 0x7f98a0108170 2024-09-19T09:43:21.482 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f989e7fc640 1 -- 172.21.15.18:0/2437499927 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f989803a6b0 con 0x7f98a0108170 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.676+0000 7f98a7694640 1 -- 172.21.15.18:0/2437499927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a01a0d60 con 0x7f98a0108170 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.677+0000 7f989e7fc640 1 -- 172.21.15.18:0/2437499927 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f989803baf0 con 0x7f98a0108170 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.677+0000 7f989e7fc640 1 --2- 172.21.15.18:0/2437499927 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f98880391b0 0x7f988803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.678+0000 7f989e7fc640 1 -- 172.21.15.18:0/2437499927 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f989806c7c0 con 0x7f98a0108170 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.678+0000 7f98a7694640 1 -- 172.21.15.18:0/2437499927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a01085d0 con 0x7f98a0108170 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.678+0000 7f98a4c2f640 1 --2- 172.21.15.18:0/2437499927 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f98880391b0 0x7f988803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.678+0000 7f98a4c2f640 1 --2- 172.21.15.18:0/2437499927 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f98880391b0 0x7f988803b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f98940098c0 tx=0x7f9894006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.683+0000 7f989e7fc640 1 -- 172.21.15.18:0/2437499927 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9898042dc0 con 0x7f98a0108170 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.883+0000 7f98a7694640 1 -- 172.21.15.18:0/2437499927 --> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f98a0102f80 con 0x7f98880391b0 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.888+0000 7f989e7fc640 1 -- 172.21.15.18:0/2437499927 <== mgr.14118 v2:172.21.15.18:6800/809218832 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f98a0102f80 con 0x7f98880391b0 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.890+0000 7f98a7694640 1 -- 172.21.15.18:0/2437499927 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f98880391b0 msgr2=0x7f988803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.890+0000 7f98a7694640 1 --2- 172.21.15.18:0/2437499927 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f98880391b0 0x7f988803b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f98940098c0 tx=0x7f9894006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.890+0000 7f98a7694640 1 -- 172.21.15.18:0/2437499927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 msgr2=0x7f98a019d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.890+0000 7f98a7694640 1 --2- 172.21.15.18:0/2437499927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a019d8a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98980097f0 tx=0x7f98980327b0 comp rx=0 tx=0).stop 2024-09-19T09:43:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.890+0000 7f98a7694640 1 -- 172.21.15.18:0/2437499927 shutdown_connections 2024-09-19T09:43:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.890+0000 7f98a7694640 1 --2- 172.21.15.18:0/2437499927 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f98880391b0 0x7f988803b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.890+0000 7f98a7694640 1 --2- 172.21.15.18:0/2437499927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98a0108170 0x7f98a019d8a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.890+0000 7f98a7694640 1 -- 172.21.15.18:0/2437499927 >> 172.21.15.18:0/2437499927 conn(0x7f98a0101d70 msgr2=0x7f98a0102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.890+0000 7f98a7694640 1 -- 172.21.15.18:0/2437499927 shutdown_connections 2024-09-19T09:43:21.484 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:20.890+0000 7f98a7694640 1 -- 172.21.15.18:0/2437499927 wait complete. 2024-09-19T09:43:22.106 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:21 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:22.106 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:21 smithi018 ceph-mon[30956]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:22.107 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:21 smithi018 ceph-mon[30956]: Saving service mgr spec with placement count:2 2024-09-19T09:43:22.107 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:21 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:22.845 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.907+0000 7fe003f8c640 1 Processor -- start 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.907+0000 7fe003f8c640 1 -- start start 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.907+0000 7fe003f8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.907+0000 7fe003f8c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc108080 con 0x7fdffc1076b0 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.908+0000 7fe001d28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.908+0000 7fe001d28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36990/0 (socket says 172.21.15.18:36990) 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.908+0000 7fe001d28640 1 -- 172.21.15.18:0/3065048373 learned_addr learned my addr 172.21.15.18:0/3065048373 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.908+0000 7fe001d28640 1 -- 172.21.15.18:0/3065048373 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc1088b0 con 0x7fdffc1076b0 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.909+0000 7fe001d28640 1 --2- 172.21.15.18:0/3065048373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc107ab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009820 tx=0x7fdff802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1115127c388d1f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.909+0000 7fe000d26640 1 -- 172.21.15.18:0/3065048373 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff8037070 con 0x7fdffc1076b0 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.909+0000 7fe000d26640 1 -- 172.21.15.18:0/3065048373 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdff8032920 con 0x7fdffc1076b0 2024-09-19T09:43:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.909+0000 7fe000d26640 1 -- 172.21.15.18:0/3065048373 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff8030810 con 0x7fdffc1076b0 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.909+0000 7fe003f8c640 1 -- 172.21.15.18:0/3065048373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 msgr2=0x7fdffc107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.909+0000 7fe003f8c640 1 --2- 172.21.15.18:0/3065048373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc107ab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009820 tx=0x7fdff802a270 comp rx=0 tx=0).stop 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.909+0000 7fe003f8c640 1 -- 172.21.15.18:0/3065048373 shutdown_connections 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.909+0000 7fe003f8c640 1 --2- 172.21.15.18:0/3065048373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc107ab0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.909+0000 7fe003f8c640 1 -- 172.21.15.18:0/3065048373 >> 172.21.15.18:0/3065048373 conn(0x7fdffc102e80 msgr2=0x7fdffc1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.910+0000 7fe003f8c640 1 -- 172.21.15.18:0/3065048373 shutdown_connections 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.910+0000 7fe003f8c640 1 -- 172.21.15.18:0/3065048373 wait complete. 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.910+0000 7fe003f8c640 1 Processor -- start 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.910+0000 7fe003f8c640 1 -- start start 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.910+0000 7fe003f8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc19d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.910+0000 7fe003f8c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc10bc60 con 0x7fdffc1076b0 2024-09-19T09:43:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.910+0000 7fe001d28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc19d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.910+0000 7fe001d28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc19d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37006/0 (socket says 172.21.15.18:37006) 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.910+0000 7fe001d28640 1 -- 172.21.15.18:0/486116091 learned_addr learned my addr 172.21.15.18:0/486116091 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.911+0000 7fe001d28640 1 -- 172.21.15.18:0/486116091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc19de00 con 0x7fdffc1076b0 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.911+0000 7fe001d28640 1 --2- 172.21.15.18:0/486116091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc19d8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdff8030560 tx=0x7fdff8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.911+0000 7fdff2ffd640 1 -- 172.21.15.18:0/486116091 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff8037040 con 0x7fdffc1076b0 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.911+0000 7fdff2ffd640 1 -- 172.21.15.18:0/486116091 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdff8040070 con 0x7fdffc1076b0 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.911+0000 7fe003f8c640 1 -- 172.21.15.18:0/486116091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdffc19e090 con 0x7fdffc1076b0 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.911+0000 7fdff2ffd640 1 -- 172.21.15.18:0/486116091 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff803a740 con 0x7fdffc1076b0 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.911+0000 7fe003f8c640 1 -- 172.21.15.18:0/486116091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdffc1a0d80 con 0x7fdffc1076b0 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.912+0000 7fdff2ffd640 1 -- 172.21.15.18:0/486116091 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fdff803a8e0 con 0x7fdffc1076b0 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.912+0000 7fdff2ffd640 1 --2- 172.21.15.18:0/486116091 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdfe8039200 0x7fdfe803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.848 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.912+0000 7fe003f8c640 1 -- 172.21.15.18:0/486116091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdffc107b30 con 0x7fdffc1076b0 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.912+0000 7fdff2ffd640 1 -- 172.21.15.18:0/486116091 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdff806c820 con 0x7fdffc1076b0 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.912+0000 7fe001527640 1 --2- 172.21.15.18:0/486116091 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdfe8039200 0x7fdfe803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.913+0000 7fe001527640 1 --2- 172.21.15.18:0/486116091 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdfe8039200 0x7fdfe803b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0098c0 tx=0x7fdfec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:21.917+0000 7fdff2ffd640 1 -- 172.21.15.18:0/486116091 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdff8043360 con 0x7fdffc1076b0 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.104+0000 7fe003f8c640 1 -- 172.21.15.18:0/486116091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fdffc1a1370 con 0x7fdffc1076b0 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.107+0000 7fdff2ffd640 1 -- 172.21.15.18:0/486116091 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fdff8040220 con 0x7fdffc1076b0 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.109+0000 7fe003f8c640 1 -- 172.21.15.18:0/486116091 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdfe8039200 msgr2=0x7fdfe803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.109+0000 7fe003f8c640 1 --2- 172.21.15.18:0/486116091 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdfe8039200 0x7fdfe803b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0098c0 tx=0x7fdfec006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.109+0000 7fe003f8c640 1 -- 172.21.15.18:0/486116091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 msgr2=0x7fdffc19d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.109+0000 7fe003f8c640 1 --2- 172.21.15.18:0/486116091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc19d8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdff8030560 tx=0x7fdff8032670 comp rx=0 tx=0).stop 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.109+0000 7fe003f8c640 1 -- 172.21.15.18:0/486116091 shutdown_connections 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.109+0000 7fe003f8c640 1 --2- 172.21.15.18:0/486116091 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fdfe8039200 0x7fdfe803b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.849 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.109+0000 7fe003f8c640 1 --2- 172.21.15.18:0/486116091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdffc1076b0 0x7fdffc19d8c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.850 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.109+0000 7fe003f8c640 1 -- 172.21.15.18:0/486116091 >> 172.21.15.18:0/486116091 conn(0x7fdffc102e80 msgr2=0x7fdffc1039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:22.850 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.109+0000 7fe003f8c640 1 -- 172.21.15.18:0/486116091 shutdown_connections 2024-09-19T09:43:22.850 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:22.109+0000 7fe003f8c640 1 -- 172.21.15.18:0/486116091 wait complete. 2024-09-19T09:43:23.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:23 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/486116091' entity='client.admin' 2024-09-19T09:43:24.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:24 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:24.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:24 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3126983631' entity='client.admin' 2024-09-19T09:43:24.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:24 smithi018 ceph-mon[30956]: from='mgr.14118 172.21.15.18:0/2873672003' entity='mgr.x' 2024-09-19T09:43:24.395 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.602+0000 7f916f3a6640 1 Processor -- start 2024-09-19T09:43:24.395 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.603+0000 7f916f3a6640 1 -- start start 2024-09-19T09:43:24.395 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.603+0000 7f916f3a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f916810a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:24.396 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.603+0000 7f916f3a6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f916807be50 con 0x7f91681081b0 2024-09-19T09:43:24.396 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.603+0000 7f916d142640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f916810a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:24.396 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.603+0000 7f916d142640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f916810a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37020/0 (socket says 172.21.15.18:37020) 2024-09-19T09:43:24.396 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.603+0000 7f916d142640 1 -- 172.21.15.18:0/2799192067 learned_addr learned my addr 172.21.15.18:0/2799192067 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:24.396 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.603+0000 7f916d142640 1 -- 172.21.15.18:0/2799192067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916810aae0 con 0x7f91681081b0 2024-09-19T09:43:24.396 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.604+0000 7f916d142640 1 --2- 172.21.15.18:0/2799192067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f916810a5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9164009820 tx=0x7f916402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6a70e0ac8a4384 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:24.396 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.604+0000 7f915bfff640 1 -- 172.21.15.18:0/2799192067 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9164037070 con 0x7f91681081b0 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.604+0000 7f915bfff640 1 -- 172.21.15.18:0/2799192067 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9164032920 con 0x7f91681081b0 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.604+0000 7f915bfff640 1 -- 172.21.15.18:0/2799192067 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9164030810 con 0x7f91681081b0 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.605+0000 7f916f3a6640 1 -- 172.21.15.18:0/2799192067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 msgr2=0x7f916810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.605+0000 7f916f3a6640 1 --2- 172.21.15.18:0/2799192067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f916810a5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9164009820 tx=0x7f916402a270 comp rx=0 tx=0).stop 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.605+0000 7f916f3a6640 1 -- 172.21.15.18:0/2799192067 shutdown_connections 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.605+0000 7f916f3a6640 1 --2- 172.21.15.18:0/2799192067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f916810a5a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.605+0000 7f916f3a6640 1 -- 172.21.15.18:0/2799192067 >> 172.21.15.18:0/2799192067 conn(0x7f9168101d70 msgr2=0x7f9168104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.605+0000 7f916f3a6640 1 -- 172.21.15.18:0/2799192067 shutdown_connections 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.605+0000 7f916f3a6640 1 -- 172.21.15.18:0/2799192067 wait complete. 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.606+0000 7f916f3a6640 1 Processor -- start 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.606+0000 7f916f3a6640 1 -- start start 2024-09-19T09:43:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.606+0000 7f916f3a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f9168107a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.606+0000 7f916f3a6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f916810ba90 con 0x7f91681081b0 2024-09-19T09:43:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.606+0000 7f916d142640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f9168107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.606+0000 7f916d142640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f9168107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37032/0 (socket says 172.21.15.18:37032) 2024-09-19T09:43:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.606+0000 7f916d142640 1 -- 172.21.15.18:0/3126983631 learned_addr learned my addr 172.21.15.18:0/3126983631 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.607+0000 7f916d142640 1 -- 172.21.15.18:0/3126983631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9168107f70 con 0x7f91681081b0 2024-09-19T09:43:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.607+0000 7f916d142640 1 --2- 172.21.15.18:0/3126983631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f9168107a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91640097f0 tx=0x7f91640327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.607+0000 7f915a7fc640 1 -- 172.21.15.18:0/3126983631 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9164037040 con 0x7f91681081b0 2024-09-19T09:43:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.607+0000 7f915a7fc640 1 -- 172.21.15.18:0/3126983631 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9164030cc0 con 0x7f91681081b0 2024-09-19T09:43:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.607+0000 7f915a7fc640 1 -- 172.21.15.18:0/3126983631 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f916403a6b0 con 0x7f91681081b0 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.607+0000 7f916f3a6640 1 -- 172.21.15.18:0/3126983631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9168106160 con 0x7f91681081b0 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.607+0000 7f916f3a6640 1 -- 172.21.15.18:0/3126983631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91681066a0 con 0x7f91681081b0 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.608+0000 7f915a7fc640 1 -- 172.21.15.18:0/3126983631 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f916403baf0 con 0x7f91681081b0 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.608+0000 7f916f3a6640 1 -- 172.21.15.18:0/3126983631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9168108610 con 0x7f91681081b0 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.608+0000 7f915a7fc640 1 --2- 172.21.15.18:0/3126983631 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f91540391b0 0x7f915403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.609+0000 7f915a7fc640 1 -- 172.21.15.18:0/3126983631 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f916406c8b0 con 0x7f91681081b0 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.609+0000 7f916c941640 1 --2- 172.21.15.18:0/3126983631 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f91540391b0 0x7f915403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.609+0000 7f916c941640 1 --2- 172.21.15.18:0/3126983631 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f91540391b0 0x7f915403b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f915c0098c0 tx=0x7f915c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.616+0000 7f915a7fc640 1 -- 172.21.15.18:0/3126983631 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91640371e0 con 0x7f91681081b0 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.794+0000 7f916f3a6640 1 -- 172.21.15.18:0/3126983631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f9168106eb0 con 0x7f91681081b0 2024-09-19T09:43:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.797+0000 7f915a7fc640 1 -- 172.21.15.18:0/3126983631 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f916406c200 con 0x7f91681081b0 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.800+0000 7f916f3a6640 1 -- 172.21.15.18:0/3126983631 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f91540391b0 msgr2=0x7f915403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.800+0000 7f916f3a6640 1 --2- 172.21.15.18:0/3126983631 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f91540391b0 0x7f915403b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f915c0098c0 tx=0x7f915c006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.800+0000 7f916f3a6640 1 -- 172.21.15.18:0/3126983631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 msgr2=0x7f9168107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.800+0000 7f916f3a6640 1 --2- 172.21.15.18:0/3126983631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f9168107a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91640097f0 tx=0x7f91640327b0 comp rx=0 tx=0).stop 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.800+0000 7f916f3a6640 1 -- 172.21.15.18:0/3126983631 shutdown_connections 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.800+0000 7f916f3a6640 1 --2- 172.21.15.18:0/3126983631 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f91540391b0 0x7f915403b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.800+0000 7f916f3a6640 1 --2- 172.21.15.18:0/3126983631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91681081b0 0x7f9168107a30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.800+0000 7f916f3a6640 1 -- 172.21.15.18:0/3126983631 >> 172.21.15.18:0/3126983631 conn(0x7f9168101d70 msgr2=0x7f9168102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.800+0000 7f916f3a6640 1 -- 172.21.15.18:0/3126983631 shutdown_connections 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:23.800+0000 7f916f3a6640 1 -- 172.21.15.18:0/3126983631 wait complete. 2024-09-19T09:43:24.400 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling the dashboard module... 2024-09-19T09:43:25.330 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:25 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3207973630' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T09:43:25.330 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: ignoring --setuser ceph since I am not root 2024-09-19T09:43:25.330 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: ignoring --setgroup ceph since I am not root 2024-09-19T09:43:25.628 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:25.334+0000 7f7f2a18d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:43:25.629 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:25.395+0000 7f7f2a18d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:43:25.629 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:25.554+0000 7f7f2a18d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:43:25.629 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:25.626+0000 7f7f2a18d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:43:25.880 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:25.782+0000 7f7f2a18d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:43:26.135 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:25.930+0000 7f7f2a18d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:43:26.517 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3207973630' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T09:43:26.517 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:26 smithi018 ceph-mon[30956]: mgrmap e9: x(active, since 18s) 2024-09-19T09:43:26.517 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:26 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:26.264+0000 7f7f2a18d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:43:26.517 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:26 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:26.328+0000 7f7f2a18d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:43:26.525 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.794+0000 7f2380eb4640 1 Processor -- start 2024-09-19T09:43:26.525 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.794+0000 7f2380eb4640 1 -- start start 2024-09-19T09:43:26.525 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.795+0000 7f2380eb4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c1069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:26.525 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.795+0000 7f2380eb4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f237c106fa0 con 0x7f237c1065d0 2024-09-19T09:43:26.525 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.795+0000 7f237a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c1069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:26.525 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.795+0000 7f237a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c1069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37044/0 (socket says 172.21.15.18:37044) 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.795+0000 7f237a59c640 1 -- 172.21.15.18:0/3504494099 learned_addr learned my addr 172.21.15.18:0/3504494099 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.795+0000 7f237a59c640 1 -- 172.21.15.18:0/3504494099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c1077d0 con 0x7f237c1065d0 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.796+0000 7f237a59c640 1 --2- 172.21.15.18:0/3504494099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c1069d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f236c009820 tx=0x7f236c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6ae4089597032d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.796+0000 7f237959a640 1 -- 172.21.15.18:0/3504494099 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f236c037070 con 0x7f237c1065d0 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.796+0000 7f237959a640 1 -- 172.21.15.18:0/3504494099 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f236c032920 con 0x7f237c1065d0 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.796+0000 7f237959a640 1 -- 172.21.15.18:0/3504494099 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f236c030810 con 0x7f237c1065d0 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.797+0000 7f2380eb4640 1 -- 172.21.15.18:0/3504494099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 msgr2=0x7f237c1069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.797+0000 7f2380eb4640 1 --2- 172.21.15.18:0/3504494099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c1069d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f236c009820 tx=0x7f236c02a270 comp rx=0 tx=0).stop 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.797+0000 7f2380eb4640 1 -- 172.21.15.18:0/3504494099 shutdown_connections 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.797+0000 7f2380eb4640 1 --2- 172.21.15.18:0/3504494099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c1069d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.797+0000 7f2380eb4640 1 -- 172.21.15.18:0/3504494099 >> 172.21.15.18:0/3504494099 conn(0x7f237c101d80 msgr2=0x7f237c1041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.797+0000 7f2380eb4640 1 -- 172.21.15.18:0/3504494099 shutdown_connections 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.797+0000 7f2380eb4640 1 -- 172.21.15.18:0/3504494099 wait complete. 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.798+0000 7f2380eb4640 1 Processor -- start 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.798+0000 7f2380eb4640 1 -- start start 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.798+0000 7f2380eb4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c191790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.798+0000 7f2380eb4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f237c10ab80 con 0x7f237c1065d0 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.799+0000 7f237a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c191790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.799+0000 7f237a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c191790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37050/0 (socket says 172.21.15.18:37050) 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.799+0000 7f237a59c640 1 -- 172.21.15.18:0/3207973630 learned_addr learned my addr 172.21.15.18:0/3207973630 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.799+0000 7f237a59c640 1 -- 172.21.15.18:0/3207973630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c191cd0 con 0x7f237c1065d0 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.799+0000 7f237a59c640 1 --2- 172.21.15.18:0/3207973630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c191790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f236c0097f0 tx=0x7f236c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.799+0000 7f236b7fe640 1 -- 172.21.15.18:0/3207973630 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f236c037040 con 0x7f237c1065d0 2024-09-19T09:43:26.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.799+0000 7f236b7fe640 1 -- 172.21.15.18:0/3207973630 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f236c030cc0 con 0x7f237c1065d0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.799+0000 7f2380eb4640 1 -- 172.21.15.18:0/3207973630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c18fec0 con 0x7f237c1065d0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.799+0000 7f236b7fe640 1 -- 172.21.15.18:0/3207973630 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f236c03a640 con 0x7f237c1065d0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.799+0000 7f2380eb4640 1 -- 172.21.15.18:0/3207973630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c190400 con 0x7f237c1065d0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.800+0000 7f236b7fe640 1 -- 172.21.15.18:0/3207973630 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f236c03a8f0 con 0x7f237c1065d0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.801+0000 7f236b7fe640 1 --2- 172.21.15.18:0/3207973630 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f2364039200 0x7f236403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.801+0000 7f2380eb4640 1 -- 172.21.15.18:0/3207973630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237c106a50 con 0x7f237c1065d0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.801+0000 7f236b7fe640 1 -- 172.21.15.18:0/3207973630 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f236c06c880 con 0x7f237c1065d0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.801+0000 7f2379d9b640 1 --2- 172.21.15.18:0/3207973630 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f2364039200 0x7f236403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.801+0000 7f2379d9b640 1 --2- 172.21.15.18:0/3207973630 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f2364039200 0x7f236403b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f23700098c0 tx=0x7f2370006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:24.805+0000 7f236b7fe640 1 -- 172.21.15.18:0/3207973630 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f236c0328c0 con 0x7f237c1065d0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.036+0000 7f2380eb4640 1 -- 172.21.15.18:0/3207973630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f237c1954b0 con 0x7f237c1065d0 2024-09-19T09:43:26.528 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.179+0000 7f236b7fe640 1 -- 172.21.15.18:0/3207973630 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f236c031c00 con 0x7f237c1065d0 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.181+0000 7f236b7fe640 1 -- 172.21.15.18:0/3207973630 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f236c02fd60 con 0x7f237c1065d0 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.182+0000 7f2380eb4640 1 -- 172.21.15.18:0/3207973630 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f2364039200 msgr2=0x7f236403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.182+0000 7f2380eb4640 1 --2- 172.21.15.18:0/3207973630 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f2364039200 0x7f236403b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f23700098c0 tx=0x7f2370006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.182+0000 7f2380eb4640 1 -- 172.21.15.18:0/3207973630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 msgr2=0x7f237c191790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.182+0000 7f2380eb4640 1 --2- 172.21.15.18:0/3207973630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c191790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f236c0097f0 tx=0x7f236c0327b0 comp rx=0 tx=0).stop 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.182+0000 7f2380eb4640 1 -- 172.21.15.18:0/3207973630 shutdown_connections 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.182+0000 7f2380eb4640 1 --2- 172.21.15.18:0/3207973630 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7f2364039200 0x7f236403b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.182+0000 7f2380eb4640 1 --2- 172.21.15.18:0/3207973630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f237c1065d0 0x7f237c191790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.182+0000 7f2380eb4640 1 -- 172.21.15.18:0/3207973630 >> 172.21.15.18:0/3207973630 conn(0x7f237c101d80 msgr2=0x7f237c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.182+0000 7f2380eb4640 1 -- 172.21.15.18:0/3207973630 shutdown_connections 2024-09-19T09:43:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:25.182+0000 7f2380eb4640 1 -- 172.21.15.18:0/3207973630 wait complete. 2024-09-19T09:43:26.775 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:26 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:26.523+0000 7f7f2a18d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:43:27.467 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:27 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/909959596' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:43:27.782 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:27 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:27.465+0000 7f7f2a18d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:43:27.782 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:27 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:27.537+0000 7f7f2a18d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:43:27.791 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:43:27.791 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T09:43:27.791 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:43:27.791 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T09:43:27.791 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:43:27.791 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:43:27.791 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.975+0000 7fa7ed62a640 1 Processor -- start 2024-09-19T09:43:27.791 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.975+0000 7fa7ed62a640 1 -- start start 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.975+0000 7fa7ed62a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e8107ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.975+0000 7fa7ed62a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e81080a0 con 0x7fa7e81076d0 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.976+0000 7fa7e6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e8107ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.976+0000 7fa7e6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e8107ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51574/0 (socket says 172.21.15.18:51574) 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.976+0000 7fa7e6ffd640 1 -- 172.21.15.18:0/2062316413 learned_addr learned my addr 172.21.15.18:0/2062316413 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.976+0000 7fa7e6ffd640 1 -- 172.21.15.18:0/2062316413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e81088d0 con 0x7fa7e81076d0 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.977+0000 7fa7e6ffd640 1 --2- 172.21.15.18:0/2062316413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e8107ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009820 tx=0x7fa7d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f58d84bc65f34d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.977+0000 7fa7e67fc640 1 -- 172.21.15.18:0/2062316413 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d8037070 con 0x7fa7e81076d0 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.977+0000 7fa7e67fc640 1 -- 172.21.15.18:0/2062316413 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7d8032920 con 0x7fa7e81076d0 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.977+0000 7fa7e67fc640 1 -- 172.21.15.18:0/2062316413 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d8030810 con 0x7fa7e81076d0 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.978+0000 7fa7ed62a640 1 -- 172.21.15.18:0/2062316413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 msgr2=0x7fa7e8107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.978+0000 7fa7ed62a640 1 --2- 172.21.15.18:0/2062316413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e8107ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009820 tx=0x7fa7d802a270 comp rx=0 tx=0).stop 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.978+0000 7fa7ed62a640 1 -- 172.21.15.18:0/2062316413 shutdown_connections 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.978+0000 7fa7ed62a640 1 --2- 172.21.15.18:0/2062316413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e8107ad0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.978+0000 7fa7ed62a640 1 -- 172.21.15.18:0/2062316413 >> 172.21.15.18:0/2062316413 conn(0x7fa7e8102e80 msgr2=0x7fa7e81052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.978+0000 7fa7ed62a640 1 -- 172.21.15.18:0/2062316413 shutdown_connections 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.978+0000 7fa7ed62a640 1 -- 172.21.15.18:0/2062316413 wait complete. 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.978+0000 7fa7ed62a640 1 Processor -- start 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.978+0000 7fa7ed62a640 1 -- start start 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7ed62a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7ed62a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e810bc80 con 0x7fa7e81076d0 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7e6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7e6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e819b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51576/0 (socket says 172.21.15.18:51576) 2024-09-19T09:43:27.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7e6ffd640 1 -- 172.21.15.18:0/909959596 learned_addr learned my addr 172.21.15.18:0/909959596 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7e6ffd640 1 -- 172.21.15.18:0/909959596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e819bc40 con 0x7fa7e81076d0 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7e6ffd640 1 --2- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e819b700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8030560 tx=0x7fa7d8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7e4ff9640 1 -- 172.21.15.18:0/909959596 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d8037040 con 0x7fa7e81076d0 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7e4ff9640 1 -- 172.21.15.18:0/909959596 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7d8040070 con 0x7fa7e81076d0 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7ed62a640 1 -- 172.21.15.18:0/909959596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e819bed0 con 0x7fa7e81076d0 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7e4ff9640 1 -- 172.21.15.18:0/909959596 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d803a740 con 0x7fa7e81076d0 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.979+0000 7fa7ed62a640 1 -- 172.21.15.18:0/909959596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e819ebc0 con 0x7fa7e81076d0 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.980+0000 7fa7e4ff9640 1 -- 172.21.15.18:0/909959596 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fa7d803a9b0 con 0x7fa7e81076d0 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.981+0000 7fa7ed62a640 1 -- 172.21.15.18:0/909959596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e8107b50 con 0x7fa7e81076d0 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.981+0000 7fa7e4ff9640 1 --2- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fa7d4039200 0x7fa7d403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.981+0000 7fa7e4ff9640 1 -- 172.21.15.18:0/909959596 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa7d806cb10 con 0x7fa7e81076d0 2024-09-19T09:43:27.794 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.981+0000 7fa7dffff640 1 -- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fa7d4039200 msgr2=0x7fa7d403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/809218832 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.981+0000 7fa7dffff640 1 --2- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fa7d4039200 0x7fa7d403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:26.986+0000 7fa7e4ff9640 1 -- 172.21.15.18:0/909959596 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7d803adf0 con 0x7fa7e81076d0 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.182+0000 7fa7dffff640 1 -- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fa7d4039200 msgr2=0x7fa7d403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/809218832 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.182+0000 7fa7dffff640 1 --2- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fa7d4039200 0x7fa7d403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.206+0000 7fa7ed62a640 1 -- 172.21.15.18:0/909959596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fa7e819f140 con 0x7fa7e81076d0 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.206+0000 7fa7e4ff9640 1 -- 172.21.15.18:0/909959596 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fa7d8041270 con 0x7fa7e81076d0 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.208+0000 7fa7ed62a640 1 -- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fa7d4039200 msgr2=0x7fa7d403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.208+0000 7fa7ed62a640 1 --2- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fa7d4039200 0x7fa7d403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.208+0000 7fa7ed62a640 1 -- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 msgr2=0x7fa7e819b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.208+0000 7fa7ed62a640 1 --2- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e819b700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8030560 tx=0x7fa7d8032670 comp rx=0 tx=0).stop 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.208+0000 7fa7ed62a640 1 -- 172.21.15.18:0/909959596 shutdown_connections 2024-09-19T09:43:27.795 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.208+0000 7fa7ed62a640 1 --2- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7fa7d4039200 0x7fa7d403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.208+0000 7fa7ed62a640 1 --2- 172.21.15.18:0/909959596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7e81076d0 0x7fa7e819b700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:27.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.208+0000 7fa7ed62a640 1 -- 172.21.15.18:0/909959596 >> 172.21.15.18:0/909959596 conn(0x7fa7e8102e80 msgr2=0x7fa7e8103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:27.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.209+0000 7fa7ed62a640 1 -- 172.21.15.18:0/909959596 shutdown_connections 2024-09-19T09:43:27.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:27.209+0000 7fa7ed62a640 1 -- 172.21.15.18:0/909959596 wait complete. 2024-09-19T09:43:27.796 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for the mgr to restart... 2024-09-19T09:43:27.796 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr epoch 9... 2024-09-19T09:43:28.385 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:28.294+0000 7f7f2a18d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:43:28.786 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:28.415+0000 7f7f2a18d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:43:28.786 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:28.564+0000 7f7f2a18d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:43:28.787 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:28.628+0000 7f7f2a18d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:43:28.787 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:28.784+0000 7f7f2a18d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:43:29.085 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:28.855+0000 7f7f2a18d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:43:29.085 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:28.918+0000 7f7f2a18d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:43:29.085 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:29.083+0000 7f7f2a18d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:43:29.370 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:29.151+0000 7f7f2a18d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:43:29.370 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:29.220+0000 7f7f2a18d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:43:29.370 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:29.306+0000 7f7f2a18d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:43:29.371 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:29.368+0000 7f7f2a18d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:43:29.635 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:29.430+0000 7f7f2a18d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:43:30.512 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:30.257+0000 7f7f2a18d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:43:30.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: Active manager daemon x restarted 2024-09-19T09:43:30.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: Activating manager daemon x 2024-09-19T09:43:30.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T09:43:30.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: mgrmap e10: x(active, starting, since 0.00342415s) 2024-09-19T09:43:30.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:43:30.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:43:30.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:43:30.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:43:30.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:43:30.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: Manager daemon x is now available 2024-09-19T09:43:30.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:30.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:43:30.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:43:31.993 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:43:31.993 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T09:43:31.993 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:43:31.993 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:43:31.993 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.198+0000 7ffb3c850640 1 Processor -- start 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.198+0000 7ffb3c850640 1 -- start start 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.198+0000 7ffb3c850640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb3810a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.198+0000 7ffb3c850640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3807be50 con 0x7ffb381081e0 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.198+0000 7ffb3659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb3810a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.198+0000 7ffb3659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb3810a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51580/0 (socket says 172.21.15.18:51580) 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.198+0000 7ffb3659c640 1 -- 172.21.15.18:0/2981996597 learned_addr learned my addr 172.21.15.18:0/2981996597 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.199+0000 7ffb3659c640 1 -- 172.21.15.18:0/2981996597 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3810ab10 con 0x7ffb381081e0 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.199+0000 7ffb3659c640 1 --2- 172.21.15.18:0/2981996597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb3810a5d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009820 tx=0x7ffb2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b10e56338838b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.199+0000 7ffb35d9b640 1 -- 172.21.15.18:0/2981996597 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb28037070 con 0x7ffb381081e0 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.199+0000 7ffb35d9b640 1 -- 172.21.15.18:0/2981996597 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb28032920 con 0x7ffb381081e0 2024-09-19T09:43:31.994 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.199+0000 7ffb35d9b640 1 -- 172.21.15.18:0/2981996597 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb28030810 con 0x7ffb381081e0 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.200+0000 7ffb3c850640 1 -- 172.21.15.18:0/2981996597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 msgr2=0x7ffb3810a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.200+0000 7ffb3c850640 1 --2- 172.21.15.18:0/2981996597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb3810a5d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009820 tx=0x7ffb2802a270 comp rx=0 tx=0).stop 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.200+0000 7ffb3c850640 1 -- 172.21.15.18:0/2981996597 shutdown_connections 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.200+0000 7ffb3c850640 1 --2- 172.21.15.18:0/2981996597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb3810a5d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.200+0000 7ffb3c850640 1 -- 172.21.15.18:0/2981996597 >> 172.21.15.18:0/2981996597 conn(0x7ffb38101dc0 msgr2=0x7ffb381041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.200+0000 7ffb3c850640 1 -- 172.21.15.18:0/2981996597 shutdown_connections 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.200+0000 7ffb3c850640 1 -- 172.21.15.18:0/2981996597 wait complete. 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.201+0000 7ffb3c850640 1 Processor -- start 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.201+0000 7ffb3c850640 1 -- start start 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.201+0000 7ffb3c850640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb38107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.201+0000 7ffb3c850640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3810bac0 con 0x7ffb381081e0 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.201+0000 7ffb3659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb38107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:31.995 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.201+0000 7ffb3659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb38107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51594/0 (socket says 172.21.15.18:51594) 2024-09-19T09:43:31.996 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.201+0000 7ffb3659c640 1 -- 172.21.15.18:0/2515649105 learned_addr learned my addr 172.21.15.18:0/2515649105 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:31.996 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.202+0000 7ffb3659c640 1 -- 172.21.15.18:0/2515649105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb38107fa0 con 0x7ffb381081e0 2024-09-19T09:43:31.996 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.202+0000 7ffb3659c640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb38107a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffb280097f0 tx=0x7ffb280327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:31.996 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.202+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb28037040 con 0x7ffb381081e0 2024-09-19T09:43:31.996 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.202+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb28030c40 con 0x7ffb381081e0 2024-09-19T09:43:31.996 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.202+0000 7ffb3c850640 1 -- 172.21.15.18:0/2515649105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb38106190 con 0x7ffb381081e0 2024-09-19T09:43:31.996 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.202+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2803a5d0 con 0x7ffb381081e0 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.202+0000 7ffb3c850640 1 -- 172.21.15.18:0/2515649105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb381066d0 con 0x7ffb381081e0 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.203+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7ffb2803a7c0 con 0x7ffb381081e0 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.203+0000 7ffb2f7fe640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 0x7ffb2403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.203+0000 7ffb3c850640 1 -- 172.21.15.18:0/2515649105 --> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffb38108640 con 0x7ffb24039260 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.203+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffb28030df0 con 0x7ffb381081e0 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.203+0000 7ffb2ffff640 1 -- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 msgr2=0x7ffb2403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/809218832 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.203+0000 7ffb2ffff640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 0x7ffb2403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.404+0000 7ffb2ffff640 1 -- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 msgr2=0x7ffb2403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/809218832 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.404+0000 7ffb2ffff640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 0x7ffb2403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.805+0000 7ffb2ffff640 1 -- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 msgr2=0x7ffb2403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/809218832 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:28.805+0000 7ffb2ffff640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 0x7ffb2403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:43:31.997 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:29.606+0000 7ffb2ffff640 1 -- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 msgr2=0x7ffb2403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/809218832 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:29.606+0000 7ffb2ffff640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 0x7ffb2403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:30.261+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7ffb2806c240 con 0x7ffb381081e0 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:30.261+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 msgr2=0x7ffb2403b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:30.261+0000 7ffb2f7fe640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 0x7ffb2403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.262+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7ffb2802ec40 con 0x7ffb381081e0 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.262+0000 7ffb2f7fe640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb2403cb30 0x7ffb2403ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.262+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffb28047e50 con 0x7ffb2403cb30 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.263+0000 7ffb2ffff640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb2403cb30 0x7ffb2403ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.264+0000 7ffb2ffff640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb2403cb30 0x7ffb2403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffb20003980 tx=0x7ffb200092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.264+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ffb28047e50 con 0x7ffb2403cb30 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.271+0000 7ffb3c850640 1 -- 172.21.15.18:0/2515649105 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ffb38103080 con 0x7ffb2403cb30 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb2f7fe640 1 -- 172.21.15.18:0/2515649105 <== mgr.14150 v2:172.21.15.18:6800/817115447 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ffb38103080 con 0x7ffb2403cb30 2024-09-19T09:43:31.998 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 -- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb2403cb30 msgr2=0x7ffb2403ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb2403cb30 0x7ffb2403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffb20003980 tx=0x7ffb200092b0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 -- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 msgr2=0x7ffb38107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb38107a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffb280097f0 tx=0x7ffb280327b0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 -- 172.21.15.18:0/2515649105 shutdown_connections 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb2403cb30 0x7ffb2403ef20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:6800/809218832,v1:172.21.15.18:6801/809218832] conn(0x7ffb24039260 0x7ffb2403b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 --2- 172.21.15.18:0/2515649105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb381081e0 0x7ffb38107a60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 -- 172.21.15.18:0/2515649105 >> 172.21.15.18:0/2515649105 conn(0x7ffb38101dc0 msgr2=0x7ffb38102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 -- 172.21.15.18:0/2515649105 shutdown_connections 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:31.272+0000 7ffb3c850640 1 -- 172.21.15.18:0/2515649105 wait complete. 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:mgr epoch 9 is available 2024-09-19T09:43:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:Generating a dashboard self-signed certificate... 2024-09-19T09:43:32.264 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:32.222+0000 7f7e8fc56640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:43:32] ENGINE Error in HTTPServer.serve 2024-09-19T09:43:32.264 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: Traceback (most recent call last): 2024-09-19T09:43:32.264 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: self._connections.run(self.expiration_interval) 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: self._run(expiration_interval) 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: s = self.context.wrap_socket( 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: return self.sslsocket_class._create( 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:43:32.265 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: self.do_handshake() 2024-09-19T09:43:32.266 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:43:32.266 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: self._sslobj.do_handshake() 2024-09-19T09:43:32.266 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:43:32.266 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:43:32.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-mon[30956]: mgrmap e11: x(active, since 1.00631s) 2024-09-19T09:43:32.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-mon[30956]: [19/Sep/2024:09:43:32] ENGINE Bus STARTING 2024-09-19T09:43:32.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-mon[30956]: [19/Sep/2024:09:43:32] ENGINE Serving on http://172.21.15.18:8765 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-mon[30956]: [19/Sep/2024:09:43:32] ENGINE Serving on https://172.21.15.18:7150 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-mon[30956]: [19/Sep/2024:09:43:32] ENGINE Bus STARTED 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:32 smithi018 ceph-mon[30956]: [19/Sep/2024:09:43:32] ENGINE Error in HTTPServer.serve 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout: Traceback (most recent call last): 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._run(expiration_interval) 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:43:32.538 INFO:journalctl@ceph.mon.a.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:43:32.539 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:43:32.539 INFO:journalctl@ceph.mon.a.smithi018.stdout: s = self.context.wrap_socket( 2024-09-19T09:43:32.539 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:43:32.539 INFO:journalctl@ceph.mon.a.smithi018.stdout: return self.sslsocket_class._create( 2024-09-19T09:43:32.539 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:43:32.539 INFO:journalctl@ceph.mon.a.smithi018.stdout: self.do_handshake() 2024-09-19T09:43:32.539 INFO:journalctl@ceph.mon.a.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:43:32.539 INFO:journalctl@ceph.mon.a.smithi018.stdout: self._sslobj.do_handshake() 2024-09-19T09:43:32.539 INFO:journalctl@ceph.mon.a.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:43:33.206 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.397+0000 7f87781cb640 1 Processor -- start 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.397+0000 7f87781cb640 1 -- start start 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.397+0000 7f87781cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f8770107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.397+0000 7f87781cb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8770108080 con 0x7f87701076b0 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.398+0000 7f8775f67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f8770107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.398+0000 7f8775f67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f8770107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51674/0 (socket says 172.21.15.18:51674) 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.398+0000 7f8775f67640 1 -- 172.21.15.18:0/2432785017 learned_addr learned my addr 172.21.15.18:0/2432785017 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.398+0000 7f8775f67640 1 -- 172.21.15.18:0/2432785017 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87701088b0 con 0x7f87701076b0 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.399+0000 7f8775f67640 1 --2- 172.21.15.18:0/2432785017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f8770107ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8760009820 tx=0x7f876002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc0b4fcea527c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.399+0000 7f8774f65640 1 -- 172.21.15.18:0/2432785017 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8760037070 con 0x7f87701076b0 2024-09-19T09:43:33.207 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.399+0000 7f8774f65640 1 -- 172.21.15.18:0/2432785017 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8760032920 con 0x7f87701076b0 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.399+0000 7f8774f65640 1 -- 172.21.15.18:0/2432785017 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8760030810 con 0x7f87701076b0 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.399+0000 7f87781cb640 1 -- 172.21.15.18:0/2432785017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 msgr2=0x7f8770107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.399+0000 7f87781cb640 1 --2- 172.21.15.18:0/2432785017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f8770107ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8760009820 tx=0x7f876002a270 comp rx=0 tx=0).stop 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.399+0000 7f87781cb640 1 -- 172.21.15.18:0/2432785017 shutdown_connections 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.399+0000 7f87781cb640 1 --2- 172.21.15.18:0/2432785017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f8770107ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.399+0000 7f87781cb640 1 -- 172.21.15.18:0/2432785017 >> 172.21.15.18:0/2432785017 conn(0x7f8770102e80 msgr2=0x7f87701052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.400+0000 7f87781cb640 1 -- 172.21.15.18:0/2432785017 shutdown_connections 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.400+0000 7f87781cb640 1 -- 172.21.15.18:0/2432785017 wait complete. 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.400+0000 7f87781cb640 1 Processor -- start 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.400+0000 7f87781cb640 1 -- start start 2024-09-19T09:43:33.208 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.400+0000 7f87781cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f877007db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.209 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.400+0000 7f87781cb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f877010bc60 con 0x7f87701076b0 2024-09-19T09:43:33.209 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.400+0000 7f8775f67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f877007db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.209 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.400+0000 7f8775f67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f877007db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51676/0 (socket says 172.21.15.18:51676) 2024-09-19T09:43:33.209 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.400+0000 7f8775f67640 1 -- 172.21.15.18:0/4285167206 learned_addr learned my addr 172.21.15.18:0/4285167206 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:33.209 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.401+0000 7f8775f67640 1 -- 172.21.15.18:0/4285167206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877007e0d0 con 0x7f87701076b0 2024-09-19T09:43:33.209 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.401+0000 7f8775f67640 1 --2- 172.21.15.18:0/4285167206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f877007db90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87600097f0 tx=0x7f87600327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.209 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.401+0000 7f876effd640 1 -- 172.21.15.18:0/4285167206 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8760037040 con 0x7f87701076b0 2024-09-19T09:43:33.209 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.401+0000 7f876effd640 1 -- 172.21.15.18:0/4285167206 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8760030cc0 con 0x7f87701076b0 2024-09-19T09:43:33.209 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.401+0000 7f876effd640 1 -- 172.21.15.18:0/4285167206 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876003a640 con 0x7f87701076b0 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.401+0000 7f87781cb640 1 -- 172.21.15.18:0/4285167206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877007c2c0 con 0x7f87701076b0 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.401+0000 7f87781cb640 1 -- 172.21.15.18:0/4285167206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877007c800 con 0x7f87701076b0 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.402+0000 7f876effd640 1 -- 172.21.15.18:0/4285167206 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f876003a8f0 con 0x7f87701076b0 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.402+0000 7f87781cb640 1 -- 172.21.15.18:0/4285167206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8770107b30 con 0x7f87701076b0 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.402+0000 7f876effd640 1 --2- 172.21.15.18:0/4285167206 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8758039260 0x7f875803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.402+0000 7f876effd640 1 -- 172.21.15.18:0/4285167206 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f876006ca50 con 0x7f87701076b0 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.402+0000 7f8775766640 1 --2- 172.21.15.18:0/4285167206 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8758039260 0x7f875803b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.403+0000 7f8775766640 1 --2- 172.21.15.18:0/4285167206 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8758039260 0x7f875803b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f876400ad30 tx=0x7f87640093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.407+0000 7f876effd640 1 -- 172.21.15.18:0/4285167206 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87600392f0 con 0x7f87701076b0 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.588+0000 7f87781cb640 1 -- 172.21.15.18:0/4285167206 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f877007d030 con 0x7f8758039260 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.649+0000 7f876effd640 1 -- 172.21.15.18:0/4285167206 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f877007d030 con 0x7f8758039260 2024-09-19T09:43:33.210 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.651+0000 7f87781cb640 1 -- 172.21.15.18:0/4285167206 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8758039260 msgr2=0x7f875803b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.211 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.651+0000 7f87781cb640 1 --2- 172.21.15.18:0/4285167206 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8758039260 0x7f875803b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f876400ad30 tx=0x7f87640093f0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.211 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.651+0000 7f87781cb640 1 -- 172.21.15.18:0/4285167206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 msgr2=0x7f877007db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:33.211 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.651+0000 7f87781cb640 1 --2- 172.21.15.18:0/4285167206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f877007db90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87600097f0 tx=0x7f87600327b0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.211 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.652+0000 7f87781cb640 1 -- 172.21.15.18:0/4285167206 shutdown_connections 2024-09-19T09:43:33.211 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.652+0000 7f87781cb640 1 --2- 172.21.15.18:0/4285167206 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8758039260 0x7f875803b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.211 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.652+0000 7f87781cb640 1 --2- 172.21.15.18:0/4285167206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87701076b0 0x7f877007db90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:33.211 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.652+0000 7f87781cb640 1 -- 172.21.15.18:0/4285167206 >> 172.21.15.18:0/4285167206 conn(0x7f8770102e80 msgr2=0x7f87701039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:33.211 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.652+0000 7f87781cb640 1 -- 172.21.15.18:0/4285167206 shutdown_connections 2024-09-19T09:43:33.211 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:32.652+0000 7f87781cb640 1 -- 172.21.15.18:0/4285167206 wait complete. 2024-09-19T09:43:33.212 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial admin user... 2024-09-19T09:43:33.544 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:33 smithi018 ceph-mon[30956]: mgrmap e12: x(active, since 2s) 2024-09-19T09:43:33.544 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:33 smithi018 ceph-mon[30956]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:33.544 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:33.544 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:34.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Cf9nxU.M34BKrRmK4tIMV..BHAiBWXvl80WXBOB5e4v/4hjVqqRw6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726739014, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T09:43:34.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.629+0000 7f3872ad4640 1 Processor -- start 2024-09-19T09:43:34.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.629+0000 7f3872ad4640 1 -- start start 2024-09-19T09:43:34.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.629+0000 7f3872ad4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:34.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.629+0000 7f3872ad4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f386c108080 con 0x7f386c1076b0 2024-09-19T09:43:34.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.629+0000 7f3870870640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:34.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.629+0000 7f3870870640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51682/0 (socket says 172.21.15.18:51682) 2024-09-19T09:43:34.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.629+0000 7f3870870640 1 -- 172.21.15.18:0/3097975847 learned_addr learned my addr 172.21.15.18:0/3097975847 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:34.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.630+0000 7f3870870640 1 -- 172.21.15.18:0/3097975847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c1088b0 con 0x7f386c1076b0 2024-09-19T09:43:34.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.630+0000 7f3870870640 1 --2- 172.21.15.18:0/3097975847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c107ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3868009820 tx=0x7f386802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773c1d05ba3c3849 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.630+0000 7f38637fe640 1 -- 172.21.15.18:0/3097975847 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868037070 con 0x7f386c1076b0 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.630+0000 7f38637fe640 1 -- 172.21.15.18:0/3097975847 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3868032920 con 0x7f386c1076b0 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.630+0000 7f38637fe640 1 -- 172.21.15.18:0/3097975847 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868030810 con 0x7f386c1076b0 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.631+0000 7f3872ad4640 1 -- 172.21.15.18:0/3097975847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 msgr2=0x7f386c107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.631+0000 7f3872ad4640 1 --2- 172.21.15.18:0/3097975847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c107ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3868009820 tx=0x7f386802a270 comp rx=0 tx=0).stop 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.631+0000 7f3872ad4640 1 -- 172.21.15.18:0/3097975847 shutdown_connections 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.631+0000 7f3872ad4640 1 --2- 172.21.15.18:0/3097975847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c107ab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.631+0000 7f3872ad4640 1 -- 172.21.15.18:0/3097975847 >> 172.21.15.18:0/3097975847 conn(0x7f386c102e80 msgr2=0x7f386c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.631+0000 7f3872ad4640 1 -- 172.21.15.18:0/3097975847 shutdown_connections 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.631+0000 7f3872ad4640 1 -- 172.21.15.18:0/3097975847 wait complete. 2024-09-19T09:43:34.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.632+0000 7f3872ad4640 1 Processor -- start 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.632+0000 7f3872ad4640 1 -- start start 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.632+0000 7f3872ad4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c19b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.632+0000 7f3872ad4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f386c10bc60 con 0x7f386c1076b0 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.632+0000 7f3870870640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c19b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.632+0000 7f3870870640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c19b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51690/0 (socket says 172.21.15.18:51690) 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.632+0000 7f3870870640 1 -- 172.21.15.18:0/3250550056 learned_addr learned my addr 172.21.15.18:0/3250550056 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.632+0000 7f3870870640 1 -- 172.21.15.18:0/3250550056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c19bbb0 con 0x7f386c1076b0 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.633+0000 7f3870870640 1 --2- 172.21.15.18:0/3250550056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c19b670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f38680097f0 tx=0x7f38680327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.633+0000 7f3861ffb640 1 -- 172.21.15.18:0/3250550056 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868037040 con 0x7f386c1076b0 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.633+0000 7f3861ffb640 1 -- 172.21.15.18:0/3250550056 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3868030cc0 con 0x7f386c1076b0 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.633+0000 7f3872ad4640 1 -- 172.21.15.18:0/3250550056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c19be40 con 0x7f386c1076b0 2024-09-19T09:43:34.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.633+0000 7f3861ffb640 1 -- 172.21.15.18:0/3250550056 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386803a640 con 0x7f386c1076b0 2024-09-19T09:43:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.633+0000 7f3872ad4640 1 -- 172.21.15.18:0/3250550056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c19eb30 con 0x7f386c1076b0 2024-09-19T09:43:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.634+0000 7f3861ffb640 1 -- 172.21.15.18:0/3250550056 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f386803b3f0 con 0x7f386c1076b0 2024-09-19T09:43:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.634+0000 7f3872ad4640 1 -- 172.21.15.18:0/3250550056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386c107b30 con 0x7f386c1076b0 2024-09-19T09:43:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.634+0000 7f3861ffb640 1 --2- 172.21.15.18:0/3250550056 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3854039260 0x7f385403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.634+0000 7f3861ffb640 1 -- 172.21.15.18:0/3250550056 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f386806c990 con 0x7f386c1076b0 2024-09-19T09:43:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.634+0000 7f3863fff640 1 --2- 172.21.15.18:0/3250550056 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3854039260 0x7f385403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.635+0000 7f3863fff640 1 --2- 172.21.15.18:0/3250550056 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3854039260 0x7f385403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f385c0098c0 tx=0x7f385c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.639+0000 7f3861ffb640 1 -- 172.21.15.18:0/3250550056 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f38680371e0 con 0x7f386c1076b0 2024-09-19T09:43:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:33.844+0000 7f3872ad4640 1 -- 172.21.15.18:0/3250550056 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f386c19c320 con 0x7f3854039260 2024-09-19T09:43:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.103+0000 7f3861ffb640 1 -- 172.21.15.18:0/3250550056 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f386c19c320 con 0x7f3854039260 2024-09-19T09:43:34.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.106+0000 7f3872ad4640 1 -- 172.21.15.18:0/3250550056 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3854039260 msgr2=0x7f385403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:34.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.106+0000 7f3872ad4640 1 --2- 172.21.15.18:0/3250550056 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3854039260 0x7f385403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f385c0098c0 tx=0x7f385c006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:34.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.106+0000 7f3872ad4640 1 -- 172.21.15.18:0/3250550056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 msgr2=0x7f386c19b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:34.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.106+0000 7f3872ad4640 1 --2- 172.21.15.18:0/3250550056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c19b670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f38680097f0 tx=0x7f38680327b0 comp rx=0 tx=0).stop 2024-09-19T09:43:34.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.106+0000 7f3872ad4640 1 -- 172.21.15.18:0/3250550056 shutdown_connections 2024-09-19T09:43:34.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.106+0000 7f3872ad4640 1 --2- 172.21.15.18:0/3250550056 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3854039260 0x7f385403b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:34.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.106+0000 7f3872ad4640 1 --2- 172.21.15.18:0/3250550056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f386c1076b0 0x7f386c19b670 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:34.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.106+0000 7f3872ad4640 1 -- 172.21.15.18:0/3250550056 >> 172.21.15.18:0/3250550056 conn(0x7f386c102e80 msgr2=0x7f386c1039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:34.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.106+0000 7f3872ad4640 1 -- 172.21.15.18:0/3250550056 shutdown_connections 2024-09-19T09:43:34.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:34.106+0000 7f3872ad4640 1 -- 172.21.15.18:0/3250550056 wait complete. 2024-09-19T09:43:34.711 INFO:teuthology.orchestra.run.smithi018.stdout:Fetching dashboard port number... 2024-09-19T09:43:35.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:35.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:34 smithi018 ceph-mon[30956]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:35.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:35.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:36.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:35 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/745899813' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T09:43:36.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T09:43:36.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.114+0000 7f8f11b71640 1 Processor -- start 2024-09-19T09:43:36.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.114+0000 7f8f11b71640 1 -- start start 2024-09-19T09:43:36.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.114+0000 7f8f11b71640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c105da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.114+0000 7f8f11b71640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c106370 con 0x7f8f0c1059a0 2024-09-19T09:43:36.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.114+0000 7f8f0b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c105da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.114+0000 7f8f0b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c105da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51692/0 (socket says 172.21.15.18:51692) 2024-09-19T09:43:36.376 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.114+0000 7f8f0b7fe640 1 -- 172.21.15.18:0/2049880032 learned_addr learned my addr 172.21.15.18:0/2049880032 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.114+0000 7f8f0b7fe640 1 -- 172.21.15.18:0/2049880032 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c1064f0 con 0x7f8f0c1059a0 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.115+0000 7f8f0b7fe640 1 --2- 172.21.15.18:0/2049880032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c105da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009820 tx=0x7f8efc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858b4fcfe41e9501 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.115+0000 7f8f0a7fc640 1 -- 172.21.15.18:0/2049880032 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8efc037070 con 0x7f8f0c1059a0 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.115+0000 7f8f0a7fc640 1 -- 172.21.15.18:0/2049880032 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8efc032920 con 0x7f8f0c1059a0 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.115+0000 7f8f0a7fc640 1 -- 172.21.15.18:0/2049880032 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8efc030810 con 0x7f8f0c1059a0 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.116+0000 7f8f11b71640 1 -- 172.21.15.18:0/2049880032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 msgr2=0x7f8f0c105da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.116+0000 7f8f11b71640 1 --2- 172.21.15.18:0/2049880032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c105da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009820 tx=0x7f8efc02a270 comp rx=0 tx=0).stop 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.116+0000 7f8f11b71640 1 -- 172.21.15.18:0/2049880032 shutdown_connections 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.116+0000 7f8f11b71640 1 --2- 172.21.15.18:0/2049880032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c105da0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.116+0000 7f8f11b71640 1 -- 172.21.15.18:0/2049880032 >> 172.21.15.18:0/2049880032 conn(0x7f8f0c101510 msgr2=0x7f8f0c103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.116+0000 7f8f11b71640 1 -- 172.21.15.18:0/2049880032 shutdown_connections 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.116+0000 7f8f11b71640 1 -- 172.21.15.18:0/2049880032 wait complete. 2024-09-19T09:43:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.117+0000 7f8f11b71640 1 Processor -- start 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.117+0000 7f8f11b71640 1 -- start start 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.117+0000 7f8f11b71640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.117+0000 7f8f11b71640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c10bc50 con 0x7f8f0c1059a0 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.117+0000 7f8f0b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.117+0000 7f8f0b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51696/0 (socket says 172.21.15.18:51696) 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.117+0000 7f8f0b7fe640 1 -- 172.21.15.18:0/745899813 learned_addr learned my addr 172.21.15.18:0/745899813 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.118+0000 7f8f0b7fe640 1 -- 172.21.15.18:0/745899813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c19bb90 con 0x7f8f0c1059a0 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.118+0000 7f8f0b7fe640 1 --2- 172.21.15.18:0/745899813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c19b650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8efc030560 tx=0x7f8efc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.118+0000 7f8f08ff9640 1 -- 172.21.15.18:0/745899813 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8efc037040 con 0x7f8f0c1059a0 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.118+0000 7f8f08ff9640 1 -- 172.21.15.18:0/745899813 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8efc040070 con 0x7f8f0c1059a0 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.119+0000 7f8f08ff9640 1 -- 172.21.15.18:0/745899813 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8efc03a740 con 0x7f8f0c1059a0 2024-09-19T09:43:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.119+0000 7f8f11b71640 1 -- 172.21.15.18:0/745899813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0c19be20 con 0x7f8f0c1059a0 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.119+0000 7f8f11b71640 1 -- 172.21.15.18:0/745899813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0c19eb10 con 0x7f8f0c1059a0 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.120+0000 7f8f08ff9640 1 -- 172.21.15.18:0/745899813 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f8efc03a8e0 con 0x7f8f0c1059a0 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.120+0000 7f8f11b71640 1 -- 172.21.15.18:0/745899813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0c105e20 con 0x7f8f0c1059a0 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.120+0000 7f8f08ff9640 1 --2- 172.21.15.18:0/745899813 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef4039260 0x7f8ef403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.120+0000 7f8f08ff9640 1 -- 172.21.15.18:0/745899813 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8efc06cbe0 con 0x7f8f0c1059a0 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.120+0000 7f8f0affd640 1 --2- 172.21.15.18:0/745899813 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef4039260 0x7f8ef403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.121+0000 7f8f0affd640 1 --2- 172.21.15.18:0/745899813 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef4039260 0x7f8ef403b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f000098c0 tx=0x7f8f00006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.127+0000 7f8f08ff9640 1 -- 172.21.15.18:0/745899813 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8efc043360 con 0x7f8f0c1059a0 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.308+0000 7f8f11b71640 1 -- 172.21.15.18:0/745899813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f8f0c19ece0 con 0x7f8f0c1059a0 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.309+0000 7f8f08ff9640 1 -- 172.21.15.18:0/745899813 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f8f0c19ece0 con 0x7f8f0c1059a0 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.311+0000 7f8f11b71640 1 -- 172.21.15.18:0/745899813 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef4039260 msgr2=0x7f8ef403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.311+0000 7f8f11b71640 1 --2- 172.21.15.18:0/745899813 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef4039260 0x7f8ef403b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f000098c0 tx=0x7f8f00006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.379 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.311+0000 7f8f11b71640 1 -- 172.21.15.18:0/745899813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 msgr2=0x7f8f0c19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.311+0000 7f8f11b71640 1 --2- 172.21.15.18:0/745899813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c19b650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8efc030560 tx=0x7f8efc032670 comp rx=0 tx=0).stop 2024-09-19T09:43:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.311+0000 7f8f11b71640 1 -- 172.21.15.18:0/745899813 shutdown_connections 2024-09-19T09:43:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.311+0000 7f8f11b71640 1 --2- 172.21.15.18:0/745899813 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef4039260 0x7f8ef403b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.311+0000 7f8f11b71640 1 --2- 172.21.15.18:0/745899813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c1059a0 0x7f8f0c19b650 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.311+0000 7f8f11b71640 1 -- 172.21.15.18:0/745899813 >> 172.21.15.18:0/745899813 conn(0x7f8f0c101510 msgr2=0x7f8f0c102060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.311+0000 7f8f11b71640 1 -- 172.21.15.18:0/745899813 shutdown_connections 2024-09-19T09:43:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:35.311+0000 7f8f11b71640 1 -- 172.21.15.18:0/745899813 wait complete. 2024-09-19T09:43:36.385 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:43:36.385 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-09-19T09:43:36.394 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:43:36.394 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-09-19T09:43:36.394 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-09-19T09:43:36.394 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T09:43:36.396 INFO:teuthology.orchestra.run.smithi018.stdout:Ceph Dashboard is now available at: 2024-09-19T09:43:36.396 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:36.396 INFO:teuthology.orchestra.run.smithi018.stdout: URL: https://smithi018.front.sepia.ceph.com:8443/ 2024-09-19T09:43:36.396 INFO:teuthology.orchestra.run.smithi018.stdout: User: admin 2024-09-19T09:43:36.396 INFO:teuthology.orchestra.run.smithi018.stdout: Password: uoa9v3tg2c 2024-09-19T09:43:36.396 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:36.396 INFO:teuthology.orchestra.run.smithi018.stdout:Saving cluster configuration to /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config directory 2024-09-19T09:43:38.002 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:37 smithi018 ceph-mon[30956]: mgrmap e13: x(active, since 6s) 2024-09-19T09:43:38.002 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:37 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2723865354' entity='client.admin' 2024-09-19T09:43:38.015 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.111+0000 7f072612a640 1 Processor -- start 2024-09-19T09:43:38.015 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.111+0000 7f072612a640 1 -- start start 2024-09-19T09:43:38.015 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.111+0000 7f072612a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f07201069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.015 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.111+0000 7f072612a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0720106f90 con 0x7f07201065c0 2024-09-19T09:43:38.015 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.112+0000 7f071f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f07201069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.015 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.112+0000 7f071f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f07201069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58400/0 (socket says 172.21.15.18:58400) 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.112+0000 7f071f7fe640 1 -- 172.21.15.18:0/3322202343 learned_addr learned my addr 172.21.15.18:0/3322202343 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.112+0000 7f071f7fe640 1 -- 172.21.15.18:0/3322202343 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07201077c0 con 0x7f07201065c0 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.113+0000 7f071f7fe640 1 --2- 172.21.15.18:0/3322202343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f07201069c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0710009820 tx=0x7f071002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f99c2f8d138290b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.113+0000 7f071e7fc640 1 -- 172.21.15.18:0/3322202343 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0710037070 con 0x7f07201065c0 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.113+0000 7f071e7fc640 1 -- 172.21.15.18:0/3322202343 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0710032920 con 0x7f07201065c0 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.113+0000 7f071e7fc640 1 -- 172.21.15.18:0/3322202343 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0710030810 con 0x7f07201065c0 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.113+0000 7f072612a640 1 -- 172.21.15.18:0/3322202343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 msgr2=0x7f07201069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.113+0000 7f072612a640 1 --2- 172.21.15.18:0/3322202343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f07201069c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0710009820 tx=0x7f071002a270 comp rx=0 tx=0).stop 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.113+0000 7f072612a640 1 -- 172.21.15.18:0/3322202343 shutdown_connections 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.113+0000 7f072612a640 1 --2- 172.21.15.18:0/3322202343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f07201069c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.113+0000 7f072612a640 1 -- 172.21.15.18:0/3322202343 >> 172.21.15.18:0/3322202343 conn(0x7f0720101d70 msgr2=0x7f0720104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:38.016 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.114+0000 7f072612a640 1 -- 172.21.15.18:0/3322202343 shutdown_connections 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.114+0000 7f072612a640 1 -- 172.21.15.18:0/3322202343 wait complete. 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.114+0000 7f072612a640 1 Processor -- start 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.114+0000 7f072612a640 1 -- start start 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f072612a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f072019d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f072612a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f072010ab70 con 0x7f07201065c0 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f071f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f072019d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f071f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f072019d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58408/0 (socket says 172.21.15.18:58408) 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f071f7fe640 1 -- 172.21.15.18:0/2723865354 learned_addr learned my addr 172.21.15.18:0/2723865354 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f071f7fe640 1 -- 172.21.15.18:0/2723865354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072019dde0 con 0x7f07201065c0 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f071f7fe640 1 --2- 172.21.15.18:0/2723865354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f072019d8a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0710030560 tx=0x7f0710032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f071cff9640 1 -- 172.21.15.18:0/2723865354 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0710037040 con 0x7f07201065c0 2024-09-19T09:43:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f071cff9640 1 -- 172.21.15.18:0/2723865354 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0710040070 con 0x7f07201065c0 2024-09-19T09:43:38.018 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f072612a640 1 -- 172.21.15.18:0/2723865354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072019e070 con 0x7f07201065c0 2024-09-19T09:43:38.018 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.115+0000 7f071cff9640 1 -- 172.21.15.18:0/2723865354 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f071003a740 con 0x7f07201065c0 2024-09-19T09:43:38.018 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.116+0000 7f072612a640 1 -- 172.21.15.18:0/2723865354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07201a0d60 con 0x7f07201065c0 2024-09-19T09:43:38.018 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.116+0000 7f071cff9640 1 -- 172.21.15.18:0/2723865354 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f071003a8e0 con 0x7f07201065c0 2024-09-19T09:43:38.018 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.117+0000 7f071cff9640 1 --2- 172.21.15.18:0/2723865354 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0708039300 0x7f070803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:38.018 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.117+0000 7f072612a640 1 -- 172.21.15.18:0/2723865354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0720106a40 con 0x7f07201065c0 2024-09-19T09:43:38.018 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.117+0000 7f071cff9640 1 -- 172.21.15.18:0/2723865354 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f071006ca70 con 0x7f07201065c0 2024-09-19T09:43:38.018 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.117+0000 7f071effd640 1 --2- 172.21.15.18:0/2723865354 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0708039300 0x7f070803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.117+0000 7f071effd640 1 --2- 172.21.15.18:0/2723865354 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0708039300 0x7f070803b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f07140098c0 tx=0x7f0714006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.122+0000 7f071cff9640 1 -- 172.21.15.18:0/2723865354 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0710039970 con 0x7f07201065c0 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.387+0000 7f072612a640 1 -- 172.21.15.18:0/2723865354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f0720197a20 con 0x7f07201065c0 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.389+0000 7f071cff9640 1 -- 172.21.15.18:0/2723865354 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f0720197a20 con 0x7f07201065c0 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.391+0000 7f072612a640 1 -- 172.21.15.18:0/2723865354 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0708039300 msgr2=0x7f070803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.391+0000 7f072612a640 1 --2- 172.21.15.18:0/2723865354 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0708039300 0x7f070803b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f07140098c0 tx=0x7f0714006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.391+0000 7f072612a640 1 -- 172.21.15.18:0/2723865354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 msgr2=0x7f072019d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.391+0000 7f072612a640 1 --2- 172.21.15.18:0/2723865354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f072019d8a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0710030560 tx=0x7f0710032670 comp rx=0 tx=0).stop 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.391+0000 7f072612a640 1 -- 172.21.15.18:0/2723865354 shutdown_connections 2024-09-19T09:43:38.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.391+0000 7f072612a640 1 --2- 172.21.15.18:0/2723865354 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0708039300 0x7f070803b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.391+0000 7f072612a640 1 --2- 172.21.15.18:0/2723865354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07201065c0 0x7f072019d8a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:38.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.391+0000 7f072612a640 1 -- 172.21.15.18:0/2723865354 >> 172.21.15.18:0/2723865354 conn(0x7f0720101d70 msgr2=0x7f0720102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:38.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.391+0000 7f072612a640 1 -- 172.21.15.18:0/2723865354 shutdown_connections 2024-09-19T09:43:38.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-09-19T09:43:37.391+0000 7f072612a640 1 -- 172.21.15.18:0/2723865354 wait complete. 2024-09-19T09:43:38.020 INFO:teuthology.orchestra.run.smithi018.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T09:43:38.020 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:38.020 INFO:teuthology.orchestra.run.smithi018.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:43:38.020 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:38.020 INFO:teuthology.orchestra.run.smithi018.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T09:43:38.020 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout: ceph telemetry on 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout:For more information see: 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:38.021 INFO:teuthology.orchestra.run.smithi018.stdout:Bootstrap complete. 2024-09-19T09:43:38.059 INFO:tasks.cephadm:Fetching config... 2024-09-19T09:43:38.059 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:43:38.059 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T09:43:38.078 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T09:43:38.078 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:43:38.078 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T09:43:38.134 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T09:43:38.135 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:43:38.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T09:43:38.201 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T09:43:38.201 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:43:38.201 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T09:43:38.257 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T09:43:38.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDf8FqoopOO1AGDkD/ms8JtlMRIbHGR4IEiYKBR98uVT6A6EY8IOEPLYba2Tzd6lWAWMjQkYYZr6UEt+4gV78NTdRCL6c3TJNy5owMt4zlsQlqmy7Zlmarc+U7kQhun6JTgyaxK6oNPEvtKoCPHHcKSbxHqXAQhlFKo6aEWwuKL1fcFs5ILL8OyZ3uNItYVCOD2O8WvJNKI5ZQjO/rMky3wtZlIV5ThqAhHGWOQOccS1IJQr3sCHgEFfrV9nky441FLCiiwpL6v94gW5x1SmrOUVLmucLpSrwrSWQxKeaFBdvifSfOD5G+0J1U5HQToQ4FkmKwxBghs/CVg9AIS10S9VMESPVbVYDy4EJM+thd2SOlTtZKdAwsI5ZjDU65xYyB7WLINJv0YNroJveQiL+2xVzXnbX3CPTf1zTguFKHYHSArfBO/Qjw2uP3brlQzu/ZAJvbeeK7ZlqaKRI5yOTFnfsQl6zcKWW55V3D4vc+hm4QXp12cl6GXtyTQoRPV5z0= ceph-5b174660-766b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:43:38.334 INFO:teuthology.orchestra.run.smithi018.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDf8FqoopOO1AGDkD/ms8JtlMRIbHGR4IEiYKBR98uVT6A6EY8IOEPLYba2Tzd6lWAWMjQkYYZr6UEt+4gV78NTdRCL6c3TJNy5owMt4zlsQlqmy7Zlmarc+U7kQhun6JTgyaxK6oNPEvtKoCPHHcKSbxHqXAQhlFKo6aEWwuKL1fcFs5ILL8OyZ3uNItYVCOD2O8WvJNKI5ZQjO/rMky3wtZlIV5ThqAhHGWOQOccS1IJQr3sCHgEFfrV9nky441FLCiiwpL6v94gW5x1SmrOUVLmucLpSrwrSWQxKeaFBdvifSfOD5G+0J1U5HQToQ4FkmKwxBghs/CVg9AIS10S9VMESPVbVYDy4EJM+thd2SOlTtZKdAwsI5ZjDU65xYyB7WLINJv0YNroJveQiL+2xVzXnbX3CPTf1zTguFKHYHSArfBO/Qjw2uP3brlQzu/ZAJvbeeK7ZlqaKRI5yOTFnfsQl6zcKWW55V3D4vc+hm4QXp12cl6GXtyTQoRPV5z0= ceph-5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:43:38.346 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDf8FqoopOO1AGDkD/ms8JtlMRIbHGR4IEiYKBR98uVT6A6EY8IOEPLYba2Tzd6lWAWMjQkYYZr6UEt+4gV78NTdRCL6c3TJNy5owMt4zlsQlqmy7Zlmarc+U7kQhun6JTgyaxK6oNPEvtKoCPHHcKSbxHqXAQhlFKo6aEWwuKL1fcFs5ILL8OyZ3uNItYVCOD2O8WvJNKI5ZQjO/rMky3wtZlIV5ThqAhHGWOQOccS1IJQr3sCHgEFfrV9nky441FLCiiwpL6v94gW5x1SmrOUVLmucLpSrwrSWQxKeaFBdvifSfOD5G+0J1U5HQToQ4FkmKwxBghs/CVg9AIS10S9VMESPVbVYDy4EJM+thd2SOlTtZKdAwsI5ZjDU65xYyB7WLINJv0YNroJveQiL+2xVzXnbX3CPTf1zTguFKHYHSArfBO/Qjw2uP3brlQzu/ZAJvbeeK7ZlqaKRI5yOTFnfsQl6zcKWW55V3D4vc+hm4QXp12cl6GXtyTQoRPV5z0= ceph-5b174660-766b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:43:38.389 INFO:teuthology.orchestra.run.smithi049.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDf8FqoopOO1AGDkD/ms8JtlMRIbHGR4IEiYKBR98uVT6A6EY8IOEPLYba2Tzd6lWAWMjQkYYZr6UEt+4gV78NTdRCL6c3TJNy5owMt4zlsQlqmy7Zlmarc+U7kQhun6JTgyaxK6oNPEvtKoCPHHcKSbxHqXAQhlFKo6aEWwuKL1fcFs5ILL8OyZ3uNItYVCOD2O8WvJNKI5ZQjO/rMky3wtZlIV5ThqAhHGWOQOccS1IJQr3sCHgEFfrV9nky441FLCiiwpL6v94gW5x1SmrOUVLmucLpSrwrSWQxKeaFBdvifSfOD5G+0J1U5HQToQ4FkmKwxBghs/CVg9AIS10S9VMESPVbVYDy4EJM+thd2SOlTtZKdAwsI5ZjDU65xYyB7WLINJv0YNroJveQiL+2xVzXnbX3CPTf1zTguFKHYHSArfBO/Qjw2uP3brlQzu/ZAJvbeeK7ZlqaKRI5yOTFnfsQl6zcKWW55V3D4vc+hm4QXp12cl6GXtyTQoRPV5z0= ceph-5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:43:38.403 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDf8FqoopOO1AGDkD/ms8JtlMRIbHGR4IEiYKBR98uVT6A6EY8IOEPLYba2Tzd6lWAWMjQkYYZr6UEt+4gV78NTdRCL6c3TJNy5owMt4zlsQlqmy7Zlmarc+U7kQhun6JTgyaxK6oNPEvtKoCPHHcKSbxHqXAQhlFKo6aEWwuKL1fcFs5ILL8OyZ3uNItYVCOD2O8WvJNKI5ZQjO/rMky3wtZlIV5ThqAhHGWOQOccS1IJQr3sCHgEFfrV9nky441FLCiiwpL6v94gW5x1SmrOUVLmucLpSrwrSWQxKeaFBdvifSfOD5G+0J1U5HQToQ4FkmKwxBghs/CVg9AIS10S9VMESPVbVYDy4EJM+thd2SOlTtZKdAwsI5ZjDU65xYyB7WLINJv0YNroJveQiL+2xVzXnbX3CPTf1zTguFKHYHSArfBO/Qjw2uP3brlQzu/ZAJvbeeK7ZlqaKRI5yOTFnfsQl6zcKWW55V3D4vc+hm4QXp12cl6GXtyTQoRPV5z0= ceph-5b174660-766b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:43:38.444 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDf8FqoopOO1AGDkD/ms8JtlMRIbHGR4IEiYKBR98uVT6A6EY8IOEPLYba2Tzd6lWAWMjQkYYZr6UEt+4gV78NTdRCL6c3TJNy5owMt4zlsQlqmy7Zlmarc+U7kQhun6JTgyaxK6oNPEvtKoCPHHcKSbxHqXAQhlFKo6aEWwuKL1fcFs5ILL8OyZ3uNItYVCOD2O8WvJNKI5ZQjO/rMky3wtZlIV5ThqAhHGWOQOccS1IJQr3sCHgEFfrV9nky441FLCiiwpL6v94gW5x1SmrOUVLmucLpSrwrSWQxKeaFBdvifSfOD5G+0J1U5HQToQ4FkmKwxBghs/CVg9AIS10S9VMESPVbVYDy4EJM+thd2SOlTtZKdAwsI5ZjDU65xYyB7WLINJv0YNroJveQiL+2xVzXnbX3CPTf1zTguFKHYHSArfBO/Qjw2uP3brlQzu/ZAJvbeeK7ZlqaKRI5yOTFnfsQl6zcKWW55V3D4vc+hm4QXp12cl6GXtyTQoRPV5z0= ceph-5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:43:38.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T09:43:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.212+0000 7fe3d4619640 1 -- 172.21.15.18:0/997837650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc100540 msgr2=0x7fe3cc100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.212+0000 7fe3d4619640 1 --2- 172.21.15.18:0/997837650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc100540 0x7fe3cc100940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009880 tx=0x7fe3c802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.212+0000 7fe3d4619640 1 -- 172.21.15.18:0/997837650 shutdown_connections 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.212+0000 7fe3d4619640 1 --2- 172.21.15.18:0/997837650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc100540 0x7fe3cc100940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.212+0000 7fe3d4619640 1 -- 172.21.15.18:0/997837650 >> 172.21.15.18:0/997837650 conn(0x7fe3cc0fbcd0 msgr2=0x7fe3cc0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.212+0000 7fe3d4619640 1 -- 172.21.15.18:0/997837650 shutdown_connections 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.212+0000 7fe3d4619640 1 -- 172.21.15.18:0/997837650 wait complete. 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.213+0000 7fe3d4619640 1 Processor -- start 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.213+0000 7fe3d4619640 1 -- start start 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.213+0000 7fe3d4619640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc100540 0x7fe3cc196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.213+0000 7fe3d4619640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc1065f0 con 0x7fe3cc100540 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.213+0000 7fe3d23b5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc100540 0x7fe3cc196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.213+0000 7fe3d23b5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc100540 0x7fe3cc196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58430/0 (socket says 172.21.15.18:58430) 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.213+0000 7fe3d23b5640 1 -- 172.21.15.18:0/2633108946 learned_addr learned my addr 172.21.15.18:0/2633108946 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.214+0000 7fe3d23b5640 1 -- 172.21.15.18:0/2633108946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3cc1972d0 con 0x7fe3cc100540 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.214+0000 7fe3d23b5640 1 --2- 172.21.15.18:0/2633108946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc100540 0x7fe3cc196d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8004f60 tx=0x7fe3c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.214+0000 7fe3c37fe640 1 -- 172.21.15.18:0/2633108946 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c803f070 con 0x7fe3cc100540 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.214+0000 7fe3c37fe640 1 -- 172.21.15.18:0/2633108946 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3c8004d40 con 0x7fe3cc100540 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.214+0000 7fe3d4619640 1 -- 172.21.15.18:0/2633108946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3cc197560 con 0x7fe3cc100540 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.214+0000 7fe3c37fe640 1 -- 172.21.15.18:0/2633108946 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c8035030 con 0x7fe3cc100540 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.214+0000 7fe3d4619640 1 -- 172.21.15.18:0/2633108946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3cc19a210 con 0x7fe3cc100540 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.215+0000 7fe3c37fe640 1 -- 172.21.15.18:0/2633108946 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe3c8042070 con 0x7fe3cc100540 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.215+0000 7fe3c37fe640 1 --2- 172.21.15.18:0/2633108946 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3b8039300 0x7fe3b803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.215+0000 7fe3d4619640 1 -- 172.21.15.18:0/2633108946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3cc106d70 con 0x7fe3cc100540 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.215+0000 7fe3c37fe640 1 -- 172.21.15.18:0/2633108946 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe3c806d1d0 con 0x7fe3cc100540 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.215+0000 7fe3d1bb4640 1 --2- 172.21.15.18:0/2633108946 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3b8039300 0x7fe3b803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:39.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.216+0000 7fe3d1bb4640 1 --2- 172.21.15.18:0/2633108946 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3b8039300 0x7fe3b803b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0098c0 tx=0x7fe3bc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.220+0000 7fe3c37fe640 1 -- 172.21.15.18:0/2633108946 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3c802f300 con 0x7fe3cc100540 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.404+0000 7fe3d4619640 1 -- 172.21.15.18:0/2633108946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fe3cc02d8a0 con 0x7fe3cc100540 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.407+0000 7fe3c37fe640 1 -- 172.21.15.18:0/2633108946 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fe3c8039350 con 0x7fe3cc100540 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.409+0000 7fe3d4619640 1 -- 172.21.15.18:0/2633108946 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3b8039300 msgr2=0x7fe3b803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.409+0000 7fe3d4619640 1 --2- 172.21.15.18:0/2633108946 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3b8039300 0x7fe3b803b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0098c0 tx=0x7fe3bc006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.409+0000 7fe3d4619640 1 -- 172.21.15.18:0/2633108946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc100540 msgr2=0x7fe3cc196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.409+0000 7fe3d4619640 1 --2- 172.21.15.18:0/2633108946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc100540 0x7fe3cc196d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8004f60 tx=0x7fe3c80048f0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.409+0000 7fe3d4619640 1 -- 172.21.15.18:0/2633108946 shutdown_connections 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.409+0000 7fe3d4619640 1 --2- 172.21.15.18:0/2633108946 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3b8039300 0x7fe3b803b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.409+0000 7fe3d4619640 1 --2- 172.21.15.18:0/2633108946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc100540 0x7fe3cc196d90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.409+0000 7fe3d4619640 1 -- 172.21.15.18:0/2633108946 >> 172.21.15.18:0/2633108946 conn(0x7fe3cc0fbcd0 msgr2=0x7fe3cc069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.410+0000 7fe3d4619640 1 -- 172.21.15.18:0/2633108946 shutdown_connections 2024-09-19T09:43:39.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:39.410+0000 7fe3d4619640 1 -- 172.21.15.18:0/2633108946 wait complete. 2024-09-19T09:43:40.011 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T09:43:40.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T09:43:40.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:40 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2633108946' entity='client.admin' 2024-09-19T09:43:40.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:40.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:40.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:43:40.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:40.900 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:41.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.402+0000 7fc725eab640 1 -- 172.21.15.18:0/1791739927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7201020d0 msgr2=0x7fc7201044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.402+0000 7fc725eab640 1 --2- 172.21.15.18:0/1791739927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7201020d0 0x7fc7201044c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc710009880 tx=0x7fc71002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.402+0000 7fc725eab640 1 -- 172.21.15.18:0/1791739927 shutdown_connections 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.402+0000 7fc725eab640 1 --2- 172.21.15.18:0/1791739927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7201020d0 0x7fc7201044c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.402+0000 7fc725eab640 1 -- 172.21.15.18:0/1791739927 >> 172.21.15.18:0/1791739927 conn(0x7fc7200fbcd0 msgr2=0x7fc7200fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.402+0000 7fc725eab640 1 -- 172.21.15.18:0/1791739927 shutdown_connections 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.402+0000 7fc725eab640 1 -- 172.21.15.18:0/1791739927 wait complete. 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.403+0000 7fc725eab640 1 Processor -- start 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.403+0000 7fc725eab640 1 -- start start 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.403+0000 7fc725eab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7201020d0 0x7fc720196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.403+0000 7fc725eab640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc720107670 con 0x7fc7201020d0 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.403+0000 7fc71f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7201020d0 0x7fc720196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:41.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.403+0000 7fc71f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7201020d0 0x7fc720196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58450/0 (socket says 172.21.15.18:58450) 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.403+0000 7fc71f7fe640 1 -- 172.21.15.18:0/166136180 learned_addr learned my addr 172.21.15.18:0/166136180 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.404+0000 7fc71f7fe640 1 -- 172.21.15.18:0/166136180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc720197280 con 0x7fc7201020d0 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.404+0000 7fc71f7fe640 1 --2- 172.21.15.18:0/166136180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7201020d0 0x7fc720196d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc710004f60 tx=0x7fc7100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.404+0000 7fc71cff9640 1 -- 172.21.15.18:0/166136180 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71003f070 con 0x7fc7201020d0 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.404+0000 7fc71cff9640 1 -- 172.21.15.18:0/166136180 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc710003ad0 con 0x7fc7201020d0 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.404+0000 7fc725eab640 1 -- 172.21.15.18:0/166136180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc720197570 con 0x7fc7201020d0 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.404+0000 7fc71cff9640 1 -- 172.21.15.18:0/166136180 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc710035030 con 0x7fc7201020d0 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.404+0000 7fc725eab640 1 -- 172.21.15.18:0/166136180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc72019a200 con 0x7fc7201020d0 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.405+0000 7fc71cff9640 1 -- 172.21.15.18:0/166136180 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc710042070 con 0x7fc7201020d0 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.405+0000 7fc71cff9640 1 --2- 172.21.15.18:0/166136180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc7080392a0 0x7fc70803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.405+0000 7fc71cff9640 1 -- 172.21.15.18:0/166136180 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc71006d130 con 0x7fc7201020d0 2024-09-19T09:43:41.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.406+0000 7fc71effd640 1 --2- 172.21.15.18:0/166136180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc7080392a0 0x7fc70803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:41.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.405+0000 7fc725eab640 1 -- 172.21.15.18:0/166136180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc720107df0 con 0x7fc7201020d0 2024-09-19T09:43:41.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.407+0000 7fc71effd640 1 --2- 172.21.15.18:0/166136180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc7080392a0 0x7fc70803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc7140098c0 tx=0x7fc714006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.411+0000 7fc71cff9640 1 -- 172.21.15.18:0/166136180 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc710039350 con 0x7fc7201020d0 2024-09-19T09:43:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.596+0000 7fc725eab640 1 -- 172.21.15.18:0/166136180 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fc72002d970 con 0x7fc7080392a0 2024-09-19T09:43:41.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:41.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:41.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.599+0000 7fc71cff9640 1 -- 172.21.15.18:0/166136180 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc72002d970 con 0x7fc7080392a0 2024-09-19T09:43:41.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.602+0000 7fc725eab640 1 -- 172.21.15.18:0/166136180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc7080392a0 msgr2=0x7fc70803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:41.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.602+0000 7fc725eab640 1 --2- 172.21.15.18:0/166136180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc7080392a0 0x7fc70803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc7140098c0 tx=0x7fc714006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:41.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.602+0000 7fc725eab640 1 -- 172.21.15.18:0/166136180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7201020d0 msgr2=0x7fc720196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:41.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.602+0000 7fc725eab640 1 --2- 172.21.15.18:0/166136180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7201020d0 0x7fc720196d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc710004f60 tx=0x7fc7100048f0 comp rx=0 tx=0).stop 2024-09-19T09:43:41.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.602+0000 7fc725eab640 1 -- 172.21.15.18:0/166136180 shutdown_connections 2024-09-19T09:43:41.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.602+0000 7fc725eab640 1 --2- 172.21.15.18:0/166136180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc7080392a0 0x7fc70803b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:41.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.602+0000 7fc725eab640 1 --2- 172.21.15.18:0/166136180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7201020d0 0x7fc720196d40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:41.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.602+0000 7fc725eab640 1 -- 172.21.15.18:0/166136180 >> 172.21.15.18:0/166136180 conn(0x7fc7200fbcd0 msgr2=0x7fc7200fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:41.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.602+0000 7fc725eab640 1 -- 172.21.15.18:0/166136180 shutdown_connections 2024-09-19T09:43:41.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:41.602+0000 7fc725eab640 1 -- 172.21.15.18:0/166136180 wait complete. 2024-09-19T09:43:42.373 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi049 2024-09-19T09:43:42.373 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:43:42.373 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:43:42.394 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:43:42.394 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:43:42.452 INFO:tasks.cephadm:Adding host smithi049 to orchestrator... 2024-09-19T09:43:42.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch host add smithi049 2024-09-19T09:43:42.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:42.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:42.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:42.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:42.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:42.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T09:43:42.861 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: Updating smithi018:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:43:42.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:43:42.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:42.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:42.862 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:42.892 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.313+0000 7fec01e5a640 1 -- 172.21.15.18:0/2530939295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febfc0ffe40 msgr2=0x7febfc100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.313+0000 7fec01e5a640 1 --2- 172.21.15.18:0/2530939295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febfc0ffe40 0x7febfc100220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7febec009c20 tx=0x7febec02aa90 comp rx=0 tx=0).stop 2024-09-19T09:43:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.313+0000 7fec01e5a640 1 -- 172.21.15.18:0/2530939295 shutdown_connections 2024-09-19T09:43:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.313+0000 7fec01e5a640 1 --2- 172.21.15.18:0/2530939295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febfc0ffe40 0x7febfc100220 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.313+0000 7fec01e5a640 1 -- 172.21.15.18:0/2530939295 >> 172.21.15.18:0/2530939295 conn(0x7febfc0fb8c0 msgr2=0x7febfc0fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.313+0000 7fec01e5a640 1 -- 172.21.15.18:0/2530939295 shutdown_connections 2024-09-19T09:43:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.313+0000 7fec01e5a640 1 -- 172.21.15.18:0/2530939295 wait complete. 2024-09-19T09:43:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.314+0000 7fec01e5a640 1 Processor -- start 2024-09-19T09:43:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.314+0000 7fec01e5a640 1 -- start start 2024-09-19T09:43:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.314+0000 7fec01e5a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febfc0ffe40 0x7febfc0fbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.314+0000 7fec01e5a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7febfc10a290 con 0x7febfc0ffe40 2024-09-19T09:43:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.314+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febfc0ffe40 0x7febfc0fbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.314+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febfc0ffe40 0x7febfc0fbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58476/0 (socket says 172.21.15.18:58476) 2024-09-19T09:43:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.314+0000 7febfb7fe640 1 -- 172.21.15.18:0/1977646299 learned_addr learned my addr 172.21.15.18:0/1977646299 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.314+0000 7febfb7fe640 1 -- 172.21.15.18:0/1977646299 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc0fdc60 con 0x7febfc0ffe40 2024-09-19T09:43:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.315+0000 7febfb7fe640 1 --2- 172.21.15.18:0/1977646299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febfc0ffe40 0x7febfc0fbd70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febec005e30 tx=0x7febec02fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.315+0000 7febf8ff9640 1 -- 172.21.15.18:0/1977646299 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febec047070 con 0x7febfc0ffe40 2024-09-19T09:43:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.315+0000 7febf8ff9640 1 -- 172.21.15.18:0/1977646299 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febec003df0 con 0x7febfc0ffe40 2024-09-19T09:43:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.315+0000 7fec01e5a640 1 -- 172.21.15.18:0/1977646299 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febfc0fc310 con 0x7febfc0ffe40 2024-09-19T09:43:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.315+0000 7febf8ff9640 1 -- 172.21.15.18:0/1977646299 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febec033050 con 0x7febfc0ffe40 2024-09-19T09:43:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.315+0000 7fec01e5a640 1 -- 172.21.15.18:0/1977646299 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febfc0fc7d0 con 0x7febfc0ffe40 2024-09-19T09:43:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.316+0000 7febf8ff9640 1 -- 172.21.15.18:0/1977646299 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7febec04a070 con 0x7febfc0ffe40 2024-09-19T09:43:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.316+0000 7febf8ff9640 1 --2- 172.21.15.18:0/1977646299 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febe40392a0 0x7febe403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.316+0000 7fec01e5a640 1 -- 172.21.15.18:0/1977646299 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febfc101320 con 0x7febfc0ffe40 2024-09-19T09:43:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.316+0000 7febf8ff9640 1 -- 172.21.15.18:0/1977646299 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7febec03e030 con 0x7febfc0ffe40 2024-09-19T09:43:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.316+0000 7febfaffd640 1 --2- 172.21.15.18:0/1977646299 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febe40392a0 0x7febe403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.316+0000 7febfaffd640 1 --2- 172.21.15.18:0/1977646299 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febe40392a0 0x7febe403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7febf00098c0 tx=0x7febf0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.321+0000 7febf8ff9640 1 -- 172.21.15.18:0/1977646299 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7febec04c440 con 0x7febfc0ffe40 2024-09-19T09:43:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:43.500+0000 7fec01e5a640 1 -- 172.21.15.18:0/1977646299 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi049", "target": ["mon-mgr", ""]}) -- 0x7febfc0fd2a0 con 0x7febe40392a0 2024-09-19T09:43:43.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:43 smithi018 ceph-mon[30956]: Updating smithi018:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:43:44.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:44 smithi018 ceph-mon[30956]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi049", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:45.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:45 smithi018 ceph-mon[30956]: Deploying cephadm binary to smithi049 2024-09-19T09:43:47.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.364+0000 7febf8ff9640 1 -- 172.21.15.18:0/1977646299 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7febfc0fd2a0 con 0x7febe40392a0 2024-09-19T09:43:47.366 INFO:teuthology.orchestra.run.smithi018.stdout:Added host 'smithi049' with addr '172.21.15.49' 2024-09-19T09:43:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.366+0000 7fec01e5a640 1 -- 172.21.15.18:0/1977646299 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febe40392a0 msgr2=0x7febe403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.366+0000 7fec01e5a640 1 --2- 172.21.15.18:0/1977646299 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febe40392a0 0x7febe403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7febf00098c0 tx=0x7febf0006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.366+0000 7fec01e5a640 1 -- 172.21.15.18:0/1977646299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febfc0ffe40 msgr2=0x7febfc0fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.366+0000 7fec01e5a640 1 --2- 172.21.15.18:0/1977646299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febfc0ffe40 0x7febfc0fbd70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febec005e30 tx=0x7febec02fc10 comp rx=0 tx=0).stop 2024-09-19T09:43:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.366+0000 7fec01e5a640 1 -- 172.21.15.18:0/1977646299 shutdown_connections 2024-09-19T09:43:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.366+0000 7fec01e5a640 1 --2- 172.21.15.18:0/1977646299 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febe40392a0 0x7febe403b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.366+0000 7fec01e5a640 1 --2- 172.21.15.18:0/1977646299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febfc0ffe40 0x7febfc0fbd70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.366+0000 7fec01e5a640 1 -- 172.21.15.18:0/1977646299 >> 172.21.15.18:0/1977646299 conn(0x7febfc0fb8c0 msgr2=0x7febfc107bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.366+0000 7fec01e5a640 1 -- 172.21.15.18:0/1977646299 shutdown_connections 2024-09-19T09:43:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:47.366+0000 7fec01e5a640 1 -- 172.21.15.18:0/1977646299 wait complete. 2024-09-19T09:43:47.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:43:48.241 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:48 smithi018 ceph-mon[30956]: Added host smithi049 2024-09-19T09:43:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:48.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.660+0000 7fc0b496d640 1 -- 172.21.15.18:0/547607477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0b0102750 msgr2=0x7fc0b0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:48.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.660+0000 7fc0b496d640 1 --2- 172.21.15.18:0/547607477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0b0102750 0x7fc0b0102b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009880 tx=0x7fc0a002a670 comp rx=0 tx=0).stop 2024-09-19T09:43:48.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.660+0000 7fc0b496d640 1 -- 172.21.15.18:0/547607477 shutdown_connections 2024-09-19T09:43:48.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.660+0000 7fc0b496d640 1 --2- 172.21.15.18:0/547607477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0b0102750 0x7fc0b0102b30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:48.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.660+0000 7fc0b496d640 1 -- 172.21.15.18:0/547607477 >> 172.21.15.18:0/547607477 conn(0x7fc0b00fc1b0 msgr2=0x7fc0b00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:48.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.660+0000 7fc0b496d640 1 -- 172.21.15.18:0/547607477 shutdown_connections 2024-09-19T09:43:48.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.660+0000 7fc0b496d640 1 -- 172.21.15.18:0/547607477 wait complete. 2024-09-19T09:43:48.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.661+0000 7fc0b496d640 1 Processor -- start 2024-09-19T09:43:48.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.661+0000 7fc0b496d640 1 -- start start 2024-09-19T09:43:48.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.662+0000 7fc0b496d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0b0102750 0x7fc0b01971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:48.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.662+0000 7fc0b496d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b010bcc0 con 0x7fc0b0102750 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.662+0000 7fc0ae59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0b0102750 0x7fc0b01971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.662+0000 7fc0ae59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0b0102750 0x7fc0b01971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54708/0 (socket says 172.21.15.18:54708) 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.662+0000 7fc0ae59c640 1 -- 172.21.15.18:0/3353000041 learned_addr learned my addr 172.21.15.18:0/3353000041 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.662+0000 7fc0ae59c640 1 -- 172.21.15.18:0/3353000041 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b0197710 con 0x7fc0b0102750 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.662+0000 7fc0ae59c640 1 --2- 172.21.15.18:0/3353000041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0b0102750 0x7fc0b01971d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009230 tx=0x7fc0a0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.662+0000 7fc09f7fe640 1 -- 172.21.15.18:0/3353000041 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a003f070 con 0x7fc0b0102750 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.663+0000 7fc09f7fe640 1 -- 172.21.15.18:0/3353000041 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0a003bc80 con 0x7fc0b0102750 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.663+0000 7fc0b496d640 1 -- 172.21.15.18:0/3353000041 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b01979a0 con 0x7fc0b0102750 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.663+0000 7fc09f7fe640 1 -- 172.21.15.18:0/3353000041 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a0035030 con 0x7fc0b0102750 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.663+0000 7fc0b496d640 1 -- 172.21.15.18:0/3353000041 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b0197e00 con 0x7fc0b0102750 2024-09-19T09:43:48.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.663+0000 7fc09f7fe640 1 -- 172.21.15.18:0/3353000041 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc0a0042070 con 0x7fc0b0102750 2024-09-19T09:43:48.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.664+0000 7fc0b496d640 1 -- 172.21.15.18:0/3353000041 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b006a7b0 con 0x7fc0b0102750 2024-09-19T09:43:48.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.664+0000 7fc09f7fe640 1 --2- 172.21.15.18:0/3353000041 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc098039300 0x7fc09803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:48.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.664+0000 7fc09f7fe640 1 -- 172.21.15.18:0/3353000041 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc0a006cfe0 con 0x7fc0b0102750 2024-09-19T09:43:48.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.664+0000 7fc0add9b640 1 --2- 172.21.15.18:0/3353000041 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc098039300 0x7fc09803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:48.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.664+0000 7fc0add9b640 1 --2- 172.21.15.18:0/3353000041 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc098039300 0x7fc09803b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40098c0 tx=0x7fc0a4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.669+0000 7fc09f7fe640 1 -- 172.21.15.18:0/3353000041 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc0a00314c0 con 0x7fc0b0102750 2024-09-19T09:43:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.848+0000 7fc0b496d640 1 -- 172.21.15.18:0/3353000041 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0b0198590 con 0x7fc098039300 2024-09-19T09:43:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.849+0000 7fc09f7fe640 1 -- 172.21.15.18:0/3353000041 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fc0b0198590 con 0x7fc098039300 2024-09-19T09:43:48.851 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:48.851 INFO:teuthology.orchestra.run.smithi018.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}] 2024-09-19T09:43:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.851+0000 7fc0b496d640 1 -- 172.21.15.18:0/3353000041 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc098039300 msgr2=0x7fc09803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.851+0000 7fc0b496d640 1 --2- 172.21.15.18:0/3353000041 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc098039300 0x7fc09803b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40098c0 tx=0x7fc0a4006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.851+0000 7fc0b496d640 1 -- 172.21.15.18:0/3353000041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0b0102750 msgr2=0x7fc0b01971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.851+0000 7fc0b496d640 1 --2- 172.21.15.18:0/3353000041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0b0102750 0x7fc0b01971d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009230 tx=0x7fc0a0003d40 comp rx=0 tx=0).stop 2024-09-19T09:43:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.851+0000 7fc0b496d640 1 -- 172.21.15.18:0/3353000041 shutdown_connections 2024-09-19T09:43:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.851+0000 7fc0b496d640 1 --2- 172.21.15.18:0/3353000041 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc098039300 0x7fc09803b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.851+0000 7fc0b496d640 1 --2- 172.21.15.18:0/3353000041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0b0102750 0x7fc0b01971d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.851+0000 7fc0b496d640 1 -- 172.21.15.18:0/3353000041 >> 172.21.15.18:0/3353000041 conn(0x7fc0b00fc1b0 msgr2=0x7fc0b0105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.851+0000 7fc0b496d640 1 -- 172.21.15.18:0/3353000041 shutdown_connections 2024-09-19T09:43:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:48.851+0000 7fc0b496d640 1 -- 172.21.15.18:0/3353000041 wait complete. 2024-09-19T09:43:49.453 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-09-19T09:43:49.453 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:43:49.453 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:43:49.474 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:43:49.474 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:43:49.531 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-09-19T09:43:49.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch host add smithi162 2024-09-19T09:43:49.782 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:50.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:50.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:49 smithi018 ceph-mon[30956]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:43:50.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.234+0000 7f42522a9640 1 -- 172.21.15.18:0/4222848393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f424c102790 msgr2=0x7f424c102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:50.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.234+0000 7f42522a9640 1 --2- 172.21.15.18:0/4222848393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f424c102790 0x7f424c102b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f423c009810 tx=0x7f423c02a540 comp rx=0 tx=0).stop 2024-09-19T09:43:50.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.234+0000 7f42522a9640 1 -- 172.21.15.18:0/4222848393 shutdown_connections 2024-09-19T09:43:50.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.234+0000 7f42522a9640 1 --2- 172.21.15.18:0/4222848393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f424c102790 0x7f424c102b70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:50.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.234+0000 7f42522a9640 1 -- 172.21.15.18:0/4222848393 >> 172.21.15.18:0/4222848393 conn(0x7f424c077310 msgr2=0x7f424c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:50.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.234+0000 7f42522a9640 1 -- 172.21.15.18:0/4222848393 shutdown_connections 2024-09-19T09:43:50.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.234+0000 7f42522a9640 1 -- 172.21.15.18:0/4222848393 wait complete. 2024-09-19T09:43:50.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.234+0000 7f42522a9640 1 Processor -- start 2024-09-19T09:43:50.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.235+0000 7f42522a9640 1 -- start start 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.235+0000 7f42522a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f424c102790 0x7f424c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.235+0000 7f42522a9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f424c10bc80 con 0x7f424c102790 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.235+0000 7f424bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f424c102790 0x7f424c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.235+0000 7f424bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f424c102790 0x7f424c1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54734/0 (socket says 172.21.15.18:54734) 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.235+0000 7f424bfff640 1 -- 172.21.15.18:0/2806175578 learned_addr learned my addr 172.21.15.18:0/2806175578 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.235+0000 7f424bfff640 1 -- 172.21.15.18:0/2806175578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424c197720 con 0x7f424c102790 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.235+0000 7f424bfff640 1 --2- 172.21.15.18:0/2806175578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f424c102790 0x7f424c1971e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f423c0045e0 tx=0x7f423c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.236+0000 7f42497fa640 1 -- 172.21.15.18:0/2806175578 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423c030e70 con 0x7f424c102790 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.236+0000 7f42497fa640 1 -- 172.21.15.18:0/2806175578 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f423c0318e0 con 0x7f424c102790 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.236+0000 7f42522a9640 1 -- 172.21.15.18:0/2806175578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424c1979b0 con 0x7f424c102790 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.236+0000 7f42497fa640 1 -- 172.21.15.18:0/2806175578 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423c0049c0 con 0x7f424c102790 2024-09-19T09:43:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.236+0000 7f42522a9640 1 -- 172.21.15.18:0/2806175578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f424c197e10 con 0x7f424c102790 2024-09-19T09:43:50.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.237+0000 7f42497fa640 1 -- 172.21.15.18:0/2806175578 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f423c039040 con 0x7f424c102790 2024-09-19T09:43:50.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.237+0000 7f42522a9640 1 -- 172.21.15.18:0/2806175578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f424c069f30 con 0x7f424c102790 2024-09-19T09:43:50.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.237+0000 7f42497fa640 1 --2- 172.21.15.18:0/2806175578 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4234039300 0x7f423403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:50.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.237+0000 7f42497fa640 1 -- 172.21.15.18:0/2806175578 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f423c06d600 con 0x7f424c102790 2024-09-19T09:43:50.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.237+0000 7f424b7fe640 1 --2- 172.21.15.18:0/2806175578 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4234039300 0x7f423403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:50.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.237+0000 7f424b7fe640 1 --2- 172.21.15.18:0/2806175578 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4234039300 0x7f423403b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f42400098c0 tx=0x7f4240006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.242+0000 7f42497fa640 1 -- 172.21.15.18:0/2806175578 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f423c040030 con 0x7f424c102790 2024-09-19T09:43:50.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:50.425+0000 7f42522a9640 1 -- 172.21.15.18:0/2806175578 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}) -- 0x7f424c198540 con 0x7f4234039300 2024-09-19T09:43:51.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:51 smithi018 ceph-mon[30956]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:43:51.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:51 smithi018 ceph-mon[30956]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:43:52.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:52.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:52.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:52.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: Deploying cephadm binary to smithi162 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: Updating smithi049:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: Updating smithi049:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:53.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:53 smithi018 ceph-mon[30956]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:43:54.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.233+0000 7f42497fa640 1 -- 172.21.15.18:0/2806175578 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f424c198540 con 0x7f4234039300 2024-09-19T09:43:54.235 INFO:teuthology.orchestra.run.smithi018.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-09-19T09:43:54.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.235+0000 7f42522a9640 1 -- 172.21.15.18:0/2806175578 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4234039300 msgr2=0x7f423403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:54.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.235+0000 7f42522a9640 1 --2- 172.21.15.18:0/2806175578 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4234039300 0x7f423403b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f42400098c0 tx=0x7f4240006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.235+0000 7f42522a9640 1 -- 172.21.15.18:0/2806175578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f424c102790 msgr2=0x7f424c1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:54.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.235+0000 7f42522a9640 1 --2- 172.21.15.18:0/2806175578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f424c102790 0x7f424c1971e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f423c0045e0 tx=0x7f423c004610 comp rx=0 tx=0).stop 2024-09-19T09:43:54.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.236+0000 7f42522a9640 1 -- 172.21.15.18:0/2806175578 shutdown_connections 2024-09-19T09:43:54.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.236+0000 7f42522a9640 1 --2- 172.21.15.18:0/2806175578 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4234039300 0x7f423403b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.236+0000 7f42522a9640 1 --2- 172.21.15.18:0/2806175578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f424c102790 0x7f424c1971e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.236+0000 7f42522a9640 1 -- 172.21.15.18:0/2806175578 >> 172.21.15.18:0/2806175578 conn(0x7f424c077310 msgr2=0x7f424c103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.236+0000 7f42522a9640 1 -- 172.21.15.18:0/2806175578 shutdown_connections 2024-09-19T09:43:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:54.236+0000 7f42522a9640 1 -- 172.21.15.18:0/2806175578 wait complete. 2024-09-19T09:43:54.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:43:55.092 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:55.476 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:55.476 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:55 smithi018 ceph-mon[30956]: Added host smithi162 2024-09-19T09:43:55.476 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:55.476 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:55.476 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:55.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/94435147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18102730 msgr2=0x7f7d18102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:55.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 --2- 172.21.15.18:0/94435147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18102730 0x7f7d18102b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009810 tx=0x7f7d0802a540 comp rx=0 tx=0).stop 2024-09-19T09:43:55.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/94435147 shutdown_connections 2024-09-19T09:43:55.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 --2- 172.21.15.18:0/94435147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18102730 0x7f7d18102b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/94435147 >> 172.21.15.18:0/94435147 conn(0x7f7d18077310 msgr2=0x7f7d180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/94435147 shutdown_connections 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/94435147 wait complete. 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 Processor -- start 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 -- start start 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18102730 0x7f7d181971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.556+0000 7f7d1f1ed640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1810bc80 con 0x7f7d18102730 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.557+0000 7f7d1cf89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18102730 0x7f7d181971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.557+0000 7f7d1cf89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18102730 0x7f7d181971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54740/0 (socket says 172.21.15.18:54740) 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.557+0000 7f7d1cf89640 1 -- 172.21.15.18:0/1975395067 learned_addr learned my addr 172.21.15.18:0/1975395067 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.557+0000 7f7d1cf89640 1 -- 172.21.15.18:0/1975395067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d181976f0 con 0x7f7d18102730 2024-09-19T09:43:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.557+0000 7f7d1cf89640 1 --2- 172.21.15.18:0/1975395067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18102730 0x7f7d181971b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d080045e0 tx=0x7f7d08004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.557+0000 7f7d15ffb640 1 -- 172.21.15.18:0/1975395067 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d08030e70 con 0x7f7d18102730 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.557+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/1975395067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d18197980 con 0x7f7d18102730 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.557+0000 7f7d15ffb640 1 -- 172.21.15.18:0/1975395067 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d080318e0 con 0x7f7d18102730 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.557+0000 7f7d15ffb640 1 -- 172.21.15.18:0/1975395067 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d080049c0 con 0x7f7d18102730 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.557+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/1975395067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d18197de0 con 0x7f7d18102730 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.558+0000 7f7d15ffb640 1 -- 172.21.15.18:0/1975395067 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7d08039040 con 0x7f7d18102730 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.558+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/1975395067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d18069f90 con 0x7f7d18102730 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.558+0000 7f7d15ffb640 1 --2- 172.21.15.18:0/1975395067 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d000392a0 0x7f7d0003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.559+0000 7f7d15ffb640 1 -- 172.21.15.18:0/1975395067 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7d0806d6e0 con 0x7f7d18102730 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.559+0000 7f7d17fff640 1 --2- 172.21.15.18:0/1975395067 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d000392a0 0x7f7d0003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.559+0000 7f7d17fff640 1 --2- 172.21.15.18:0/1975395067 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d000392a0 0x7f7d0003b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0098c0 tx=0x7f7d0c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.563+0000 7f7d15ffb640 1 -- 172.21.15.18:0/1975395067 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d08040030 con 0x7f7d18102730 2024-09-19T09:43:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.748+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/1975395067 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d18198570 con 0x7f7d000392a0 2024-09-19T09:43:55.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.750+0000 7f7d15ffb640 1 -- 172.21.15.18:0/1975395067 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f7d18198570 con 0x7f7d000392a0 2024-09-19T09:43:55.752 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:43:55.752 INFO:teuthology.orchestra.run.smithi018.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-09-19T09:43:55.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.752+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/1975395067 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d000392a0 msgr2=0x7f7d0003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:55.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.752+0000 7f7d1f1ed640 1 --2- 172.21.15.18:0/1975395067 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d000392a0 0x7f7d0003b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0098c0 tx=0x7f7d0c006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:55.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.752+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/1975395067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18102730 msgr2=0x7f7d181971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:55.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.752+0000 7f7d1f1ed640 1 --2- 172.21.15.18:0/1975395067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18102730 0x7f7d181971b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d080045e0 tx=0x7f7d08004610 comp rx=0 tx=0).stop 2024-09-19T09:43:55.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.752+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/1975395067 shutdown_connections 2024-09-19T09:43:55.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.752+0000 7f7d1f1ed640 1 --2- 172.21.15.18:0/1975395067 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d000392a0 0x7f7d0003b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:55.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.752+0000 7f7d1f1ed640 1 --2- 172.21.15.18:0/1975395067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18102730 0x7f7d181971b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:55.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.752+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/1975395067 >> 172.21.15.18:0/1975395067 conn(0x7f7d18077310 msgr2=0x7f7d181034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:55.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.752+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/1975395067 shutdown_connections 2024-09-19T09:43:55.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:55.752+0000 7f7d1f1ed640 1 -- 172.21.15.18:0/1975395067 wait complete. 2024-09-19T09:43:56.337 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:56 smithi018 ceph-mon[30956]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:43:56.338 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:56.368 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T09:43:56.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T09:43:56.628 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:57.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.099+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/2812845414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3ac106540 msgr2=0x7fb3ac106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:57.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.099+0000 7fb3b2c5a640 1 --2- 172.21.15.18:0/2812845414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3ac106540 0x7fb3ac106920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb394009810 tx=0x7fb39402a540 comp rx=0 tx=0).stop 2024-09-19T09:43:57.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.099+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/2812845414 shutdown_connections 2024-09-19T09:43:57.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.099+0000 7fb3b2c5a640 1 --2- 172.21.15.18:0/2812845414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3ac106540 0x7fb3ac106920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:57.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.099+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/2812845414 >> 172.21.15.18:0/2812845414 conn(0x7fb3ac077310 msgr2=0x7fb3ac0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:57.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.099+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/2812845414 shutdown_connections 2024-09-19T09:43:57.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.099+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/2812845414 wait complete. 2024-09-19T09:43:57.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.100+0000 7fb3b2c5a640 1 Processor -- start 2024-09-19T09:43:57.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.100+0000 7fb3b2c5a640 1 -- start start 2024-09-19T09:43:57.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.100+0000 7fb3b2c5a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3ac106540 0x7fb3ac0fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.100+0000 7fb3b2c5a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac10ab70 con 0x7fb3ac106540 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.100+0000 7fb3b09f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3ac106540 0x7fb3ac0fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.100+0000 7fb3b09f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3ac106540 0x7fb3ac0fd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52248/0 (socket says 172.21.15.18:52248) 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.100+0000 7fb3b09f6640 1 -- 172.21.15.18:0/88163593 learned_addr learned my addr 172.21.15.18:0/88163593 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.101+0000 7fb3b09f6640 1 -- 172.21.15.18:0/88163593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac0ff2d0 con 0x7fb3ac106540 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.101+0000 7fb3b09f6640 1 --2- 172.21.15.18:0/88163593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3ac106540 0x7fb3ac0fd3e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb3940045e0 tx=0x7fb394004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.101+0000 7fb3a9ffb640 1 -- 172.21.15.18:0/88163593 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb394030e70 con 0x7fb3ac106540 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.101+0000 7fb3a9ffb640 1 -- 172.21.15.18:0/88163593 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3940318e0 con 0x7fb3ac106540 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.101+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/88163593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ac0fd920 con 0x7fb3ac106540 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.101+0000 7fb3a9ffb640 1 -- 172.21.15.18:0/88163593 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3940049c0 con 0x7fb3ac106540 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.101+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/88163593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ac0fdde0 con 0x7fb3ac106540 2024-09-19T09:43:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.102+0000 7fb3a9ffb640 1 -- 172.21.15.18:0/88163593 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb394039040 con 0x7fb3ac106540 2024-09-19T09:43:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.102+0000 7fb3a9ffb640 1 --2- 172.21.15.18:0/88163593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb398039350 0x7fb39803b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.102+0000 7fb3a9ffb640 1 -- 172.21.15.18:0/88163593 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb39406dc60 con 0x7fb3ac106540 2024-09-19T09:43:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.102+0000 7fb3abfff640 1 --2- 172.21.15.18:0/88163593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb398039350 0x7fb39803b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.102+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/88163593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ac101bb0 con 0x7fb3ac106540 2024-09-19T09:43:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.103+0000 7fb3abfff640 1 --2- 172.21.15.18:0/88163593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb398039350 0x7fb39803b810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00ad30 tx=0x7fb39c0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.107+0000 7fb3a9ffb640 1 -- 172.21.15.18:0/88163593 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb394040030 con 0x7fb3ac106540 2024-09-19T09:43:57.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:57.289+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/88163593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fb3ac0fe910 con 0x7fb3ac106540 2024-09-19T09:43:57.291 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:57 smithi018 ceph-mon[30956]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:43:58.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.240+0000 7fb3a9ffb640 1 -- 172.21.15.18:0/88163593 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fb394037d70 con 0x7fb3ac106540 2024-09-19T09:43:58.242 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-09-19T09:43:58.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.243+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/88163593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb398039350 msgr2=0x7fb39803b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:58.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.243+0000 7fb3b2c5a640 1 --2- 172.21.15.18:0/88163593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb398039350 0x7fb39803b810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00ad30 tx=0x7fb39c0093f0 comp rx=0 tx=0).stop 2024-09-19T09:43:58.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.243+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/88163593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3ac106540 msgr2=0x7fb3ac0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:58.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.243+0000 7fb3b2c5a640 1 --2- 172.21.15.18:0/88163593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3ac106540 0x7fb3ac0fd3e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb3940045e0 tx=0x7fb394004610 comp rx=0 tx=0).stop 2024-09-19T09:43:58.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.243+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/88163593 shutdown_connections 2024-09-19T09:43:58.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.243+0000 7fb3b2c5a640 1 --2- 172.21.15.18:0/88163593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb398039350 0x7fb39803b810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:58.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.243+0000 7fb3b2c5a640 1 --2- 172.21.15.18:0/88163593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3ac106540 0x7fb3ac0fd3e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:58.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.243+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/88163593 >> 172.21.15.18:0/88163593 conn(0x7fb3ac077310 msgr2=0x7fb3ac0696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:58.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.243+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/88163593 shutdown_connections 2024-09-19T09:43:58.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:43:58.243+0000 7fb3b2c5a640 1 -- 172.21.15.18:0/88163593 wait complete. 2024-09-19T09:43:58.594 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:58 smithi018 ceph-mon[30956]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:43:58.594 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:58 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/88163593' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T09:43:58.933 INFO:tasks.cephadm:Adding mon.a on smithi018 2024-09-19T09:43:58.933 INFO:tasks.cephadm:Adding mon.b on smithi049 2024-09-19T09:43:58.934 INFO:tasks.cephadm:Adding mon.c on smithi162 2024-09-19T09:43:58.934 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi018:172.21.15.18=a;smithi049:172.21.15.49=b;smithi162:172.21.15.162=c' 2024-09-19T09:43:59.181 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:43:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:59 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/88163593' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T09:43:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:59 smithi018 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:43:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:43:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:43:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:43:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:59.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.638+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2756535548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5241076c0 msgr2=0x7fe524107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:59.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.638+0000 7fe52c4b0640 1 --2- 172.21.15.162:0/2756535548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5241076c0 0x7fe524107aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe520009880 tx=0x7fe52002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:43:59.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.638+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2756535548 shutdown_connections 2024-09-19T09:43:59.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.638+0000 7fe52c4b0640 1 --2- 172.21.15.162:0/2756535548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5241076c0 0x7fe524107aa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:59.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.638+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2756535548 >> 172.21.15.162:0/2756535548 conn(0x7fe5240fb8c0 msgr2=0x7fe5240fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:59.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.638+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2756535548 shutdown_connections 2024-09-19T09:43:59.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.638+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2756535548 wait complete. 2024-09-19T09:43:59.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.639+0000 7fe52c4b0640 1 Processor -- start 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.639+0000 7fe52c4b0640 1 -- start start 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.639+0000 7fe52c4b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5241076c0 0x7fe524197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe52c4b0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe52410bc50 con 0x7fe5241076c0 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe52a24c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5241076c0 0x7fe524197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe52a24c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5241076c0 0x7fe524197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.162:52982/0 (socket says 172.21.15.162:52982) 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe52a24c640 1 -- 172.21.15.162:0/2861627746 learned_addr learned my addr 172.21.15.162:0/2861627746 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe52a24c640 1 -- 172.21.15.162:0/2861627746 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe524197690 con 0x7fe5241076c0 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe52a24c640 1 --2- 172.21.15.162:0/2861627746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5241076c0 0x7fe524197150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe520009230 tx=0x7fe520003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe5177fe640 1 -- 172.21.15.162:0/2861627746 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52003f070 con 0x7fe5241076c0 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2861627746 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe524197920 con 0x7fe5241076c0 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe5177fe640 1 -- 172.21.15.162:0/2861627746 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe52003bc80 con 0x7fe5241076c0 2024-09-19T09:43:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe5177fe640 1 -- 172.21.15.162:0/2861627746 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe520035030 con 0x7fe5241076c0 2024-09-19T09:43:59.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.640+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2861627746 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe524197d80 con 0x7fe5241076c0 2024-09-19T09:43:59.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.641+0000 7fe5177fe640 1 -- 172.21.15.162:0/2861627746 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe520042070 con 0x7fe5241076c0 2024-09-19T09:43:59.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.641+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2861627746 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe524102cd0 con 0x7fe5241076c0 2024-09-19T09:43:59.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.642+0000 7fe5177fe640 1 --2- 172.21.15.162:0/2861627746 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5100392a0 0x7fe51003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:59.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.642+0000 7fe5177fe640 1 -- 172.21.15.162:0/2861627746 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe52006d270 con 0x7fe5241076c0 2024-09-19T09:43:59.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.642+0000 7fe529a4b640 1 --2- 172.21.15.162:0/2861627746 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5100392a0 0x7fe51003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:59.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.642+0000 7fe529a4b640 1 --2- 172.21.15.162:0/2861627746 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5100392a0 0x7fe51003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe5180098c0 tx=0x7fe518006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:59.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.646+0000 7fe5177fe640 1 -- 172.21.15.162:0/2861627746 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe52004c350 con 0x7fe5241076c0 2024-09-19T09:43:59.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.824+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2861627746 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi049:172.21.15.49=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}) -- 0x7fe524198570 con 0x7fe5100392a0 2024-09-19T09:43:59.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.830+0000 7fe5177fe640 1 -- 172.21.15.162:0/2861627746 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe524198570 con 0x7fe5100392a0 2024-09-19T09:43:59.832 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mon update... 2024-09-19T09:43:59.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.832+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2861627746 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5100392a0 msgr2=0x7fe51003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:59.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.832+0000 7fe52c4b0640 1 --2- 172.21.15.162:0/2861627746 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5100392a0 0x7fe51003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe5180098c0 tx=0x7fe518006db0 comp rx=0 tx=0).stop 2024-09-19T09:43:59.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.832+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2861627746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5241076c0 msgr2=0x7fe524197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:59.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.832+0000 7fe52c4b0640 1 --2- 172.21.15.162:0/2861627746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5241076c0 0x7fe524197150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe520009230 tx=0x7fe520003d40 comp rx=0 tx=0).stop 2024-09-19T09:43:59.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.832+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2861627746 shutdown_connections 2024-09-19T09:43:59.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.832+0000 7fe52c4b0640 1 --2- 172.21.15.162:0/2861627746 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5100392a0 0x7fe51003b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:59.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.832+0000 7fe52c4b0640 1 --2- 172.21.15.162:0/2861627746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5241076c0 0x7fe524197150 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:59.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.832+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2861627746 >> 172.21.15.162:0/2861627746 conn(0x7fe5240fb8c0 msgr2=0x7fe5240fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:59.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.832+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2861627746 shutdown_connections 2024-09-19T09:43:59.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:43:59.832+0000 7fe52c4b0640 1 -- 172.21.15.162:0/2861627746 wait complete. 2024-09-19T09:44:00.393 DEBUG:teuthology.orchestra.run.smithi049:mon.b> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T09:44:00.396 DEBUG:teuthology.orchestra.run.smithi162:mon.c> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T09:44:00.399 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:44:00.399 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:44:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T09:44:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: Updating smithi162:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: Updating smithi162:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi049:172.21.15.49=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: Saving service mon spec with placement smithi018:172.21.15.18=a;smithi049:172.21.15.49=b;smithi162:172.21.15.162=c;count:3 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:44:00.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:00.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:00 smithi018 ceph-mon[30956]: Deploying daemon mon.c on smithi162 2024-09-19T09:44:01.050 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:44:01.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.461+0000 7f6732910640 1 -- 172.21.15.162:0/691038695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f672c107660 msgr2=0x7f672c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:01.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.461+0000 7f6732910640 1 --2- 172.21.15.162:0/691038695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f672c107660 0x7f672c107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f671c009880 tx=0x7f671c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:44:01.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.461+0000 7f6732910640 1 -- 172.21.15.162:0/691038695 shutdown_connections 2024-09-19T09:44:01.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.461+0000 7f6732910640 1 --2- 172.21.15.162:0/691038695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f672c107660 0x7f672c107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:01.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.461+0000 7f6732910640 1 -- 172.21.15.162:0/691038695 >> 172.21.15.162:0/691038695 conn(0x7f672c0fd290 msgr2=0x7f672c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:01.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.461+0000 7f6732910640 1 -- 172.21.15.162:0/691038695 shutdown_connections 2024-09-19T09:44:01.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.461+0000 7f6732910640 1 -- 172.21.15.162:0/691038695 wait complete. 2024-09-19T09:44:01.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.462+0000 7f6732910640 1 Processor -- start 2024-09-19T09:44:01.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.462+0000 7f6732910640 1 -- start start 2024-09-19T09:44:01.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.462+0000 7f6732910640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f672c107660 0x7f672c197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:01.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.462+0000 7f6732910640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f672c10bc90 con 0x7f672c107660 2024-09-19T09:44:01.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.463+0000 7f672bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f672c107660 0x7f672c197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:01.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.463+0000 7f672bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f672c107660 0x7f672c197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.162:52998/0 (socket says 172.21.15.162:52998) 2024-09-19T09:44:01.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.463+0000 7f672bfff640 1 -- 172.21.15.162:0/2209986114 learned_addr learned my addr 172.21.15.162:0/2209986114 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:44:01.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.463+0000 7f672bfff640 1 -- 172.21.15.162:0/2209986114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c197660 con 0x7f672c107660 2024-09-19T09:44:01.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.463+0000 7f672bfff640 1 --2- 172.21.15.162:0/2209986114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f672c107660 0x7f672c197120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f671c009230 tx=0x7f671c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:01.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.463+0000 7f67297fa640 1 -- 172.21.15.162:0/2209986114 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f671c03f070 con 0x7f672c107660 2024-09-19T09:44:01.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.463+0000 7f6732910640 1 -- 172.21.15.162:0/2209986114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672c1978f0 con 0x7f672c107660 2024-09-19T09:44:01.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.463+0000 7f67297fa640 1 -- 172.21.15.162:0/2209986114 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f671c03bc80 con 0x7f672c107660 2024-09-19T09:44:01.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.463+0000 7f67297fa640 1 -- 172.21.15.162:0/2209986114 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f671c035030 con 0x7f672c107660 2024-09-19T09:44:01.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.463+0000 7f6732910640 1 -- 172.21.15.162:0/2209986114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672c19b9f0 con 0x7f672c107660 2024-09-19T09:44:01.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.464+0000 7f67297fa640 1 -- 172.21.15.162:0/2209986114 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f671c042070 con 0x7f672c107660 2024-09-19T09:44:01.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.464+0000 7f67297fa640 1 --2- 172.21.15.162:0/2209986114 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f67140392a0 0x7f671403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:01.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.464+0000 7f6732910640 1 -- 172.21.15.162:0/2209986114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672c102cd0 con 0x7f672c107660 2024-09-19T09:44:01.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.465+0000 7f67297fa640 1 -- 172.21.15.162:0/2209986114 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f671c06cfb0 con 0x7f672c107660 2024-09-19T09:44:01.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.465+0000 7f672b7fe640 1 --2- 172.21.15.162:0/2209986114 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f67140392a0 0x7f671403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:01.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.465+0000 7f672b7fe640 1 --2- 172.21.15.162:0/2209986114 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f67140392a0 0x7f671403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67200098c0 tx=0x7f6720006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:01.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.470+0000 7f67297fa640 1 -- 172.21.15.162:0/2209986114 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f671c04c350 con 0x7f672c107660 2024-09-19T09:44:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:01 smithi018 ceph-mon[30956]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:01.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.703+0000 7f6732910640 1 -- 172.21.15.162:0/2209986114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f672c198480 con 0x7f672c107660 2024-09-19T09:44:01.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.704+0000 7f67297fa640 1 -- 172.21.15.162:0/2209986114 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f671c031e20 con 0x7f672c107660 2024-09-19T09:44:01.707 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:44:01.707 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":1,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","modified":"2024-09-19T09:42:32.493034Z","created":"2024-09-19T09:42:32.493034Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:44:01.708 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 1 2024-09-19T09:44:01.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.706+0000 7f6732910640 1 -- 172.21.15.162:0/2209986114 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f67140392a0 msgr2=0x7f671403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:01.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.706+0000 7f6732910640 1 --2- 172.21.15.162:0/2209986114 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f67140392a0 0x7f671403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67200098c0 tx=0x7f6720006db0 comp rx=0 tx=0).stop 2024-09-19T09:44:01.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.706+0000 7f6732910640 1 -- 172.21.15.162:0/2209986114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f672c107660 msgr2=0x7f672c197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:01.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.706+0000 7f6732910640 1 --2- 172.21.15.162:0/2209986114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f672c107660 0x7f672c197120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f671c009230 tx=0x7f671c003d40 comp rx=0 tx=0).stop 2024-09-19T09:44:01.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.706+0000 7f6732910640 1 -- 172.21.15.162:0/2209986114 shutdown_connections 2024-09-19T09:44:01.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.706+0000 7f6732910640 1 --2- 172.21.15.162:0/2209986114 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f67140392a0 0x7f671403b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:01.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.706+0000 7f6732910640 1 --2- 172.21.15.162:0/2209986114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f672c107660 0x7f672c197120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:01.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.706+0000 7f6732910640 1 -- 172.21.15.162:0/2209986114 >> 172.21.15.162:0/2209986114 conn(0x7f672c0fd290 msgr2=0x7f672c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:01.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.706+0000 7f6732910640 1 -- 172.21.15.162:0/2209986114 shutdown_connections 2024-09-19T09:44:01.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:01.706+0000 7f6732910640 1 -- 172.21.15.162:0/2209986114 wait complete. 2024-09-19T09:44:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:02 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/2209986114' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:03.478 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:44:03.478 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:44:03.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:03 smithi018 ceph-mon[30956]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:03.885 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:44:04.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.515+0000 7fba4f7e4640 1 -- 172.21.15.162:0/3708328830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba48106650 msgr2=0x7fba48106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.515+0000 7fba4f7e4640 1 --2- 172.21.15.162:0/3708328830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba48106650 0x7fba48106a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba44009880 tx=0x7fba4402a5d0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.515+0000 7fba4f7e4640 1 -- 172.21.15.162:0/3708328830 shutdown_connections 2024-09-19T09:44:04.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.515+0000 7fba4f7e4640 1 --2- 172.21.15.162:0/3708328830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba48106650 0x7fba48106a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.515+0000 7fba4f7e4640 1 -- 172.21.15.162:0/3708328830 >> 172.21.15.162:0/3708328830 conn(0x7fba480fc280 msgr2=0x7fba480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.515+0000 7fba4f7e4640 1 -- 172.21.15.162:0/3708328830 shutdown_connections 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.515+0000 7fba4f7e4640 1 -- 172.21.15.162:0/3708328830 wait complete. 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.516+0000 7fba4f7e4640 1 Processor -- start 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.516+0000 7fba4f7e4640 1 -- start start 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.516+0000 7fba4f7e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba48106650 0x7fba48198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.516+0000 7fba4f7e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fba4810ac80 con 0x7fba48106650 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.516+0000 7fba4d580640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba48106650 0x7fba48198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.516+0000 7fba4d580640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba48106650 0x7fba48198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.162:53016/0 (socket says 172.21.15.162:53016) 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.516+0000 7fba4d580640 1 -- 172.21.15.162:0/1854671394 learned_addr learned my addr 172.21.15.162:0/1854671394 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.517+0000 7fba4d580640 1 -- 172.21.15.162:0/1854671394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba48198590 con 0x7fba48106650 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.517+0000 7fba4d580640 1 --2- 172.21.15.162:0/1854671394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba48106650 0x7fba48198050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba44009230 tx=0x7fba44003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.517+0000 7fba3e7fc640 1 -- 172.21.15.162:0/1854671394 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4403f070 con 0x7fba48106650 2024-09-19T09:44:04.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.517+0000 7fba4f7e4640 1 -- 172.21.15.162:0/1854671394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba48198820 con 0x7fba48106650 2024-09-19T09:44:04.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.517+0000 7fba3e7fc640 1 -- 172.21.15.162:0/1854671394 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba4403bd40 con 0x7fba48106650 2024-09-19T09:44:04.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.517+0000 7fba3e7fc640 1 -- 172.21.15.162:0/1854671394 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba44035030 con 0x7fba48106650 2024-09-19T09:44:04.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.517+0000 7fba4f7e4640 1 -- 172.21.15.162:0/1854671394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba48198c80 con 0x7fba48106650 2024-09-19T09:44:04.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.518+0000 7fba3e7fc640 1 -- 172.21.15.162:0/1854671394 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fba44042070 con 0x7fba48106650 2024-09-19T09:44:04.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.518+0000 7fba4f7e4640 1 -- 172.21.15.162:0/1854671394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba48101cc0 con 0x7fba48106650 2024-09-19T09:44:04.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.518+0000 7fba3e7fc640 1 --2- 172.21.15.162:0/1854671394 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fba340392a0 0x7fba3403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:04.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.518+0000 7fba3e7fc640 1 -- 172.21.15.162:0/1854671394 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fba4406cc00 con 0x7fba48106650 2024-09-19T09:44:04.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.519+0000 7fba4cd7f640 1 --2- 172.21.15.162:0/1854671394 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fba340392a0 0x7fba3403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:04.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.519+0000 7fba4cd7f640 1 --2- 172.21.15.162:0/1854671394 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fba340392a0 0x7fba3403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba380098c0 tx=0x7fba38006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:04.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.524+0000 7fba3e7fc640 1 -- 172.21.15.162:0/1854671394 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba44073080 con 0x7fba48106650 2024-09-19T09:44:04.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:04 smithi162 systemd[1]: Starting Ceph mon.c for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:44:04.780 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.777+0000 7fba4f7e4640 1 -- 172.21.15.162:0/1854671394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fba48106ab0 con 0x7fba48106650 2024-09-19T09:44:04.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.778+0000 7fba3e7fc640 1 -- 172.21.15.162:0/1854671394 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fba44036db0 con 0x7fba48106650 2024-09-19T09:44:04.781 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:44:04.781 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":1,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","modified":"2024-09-19T09:42:32.493034Z","created":"2024-09-19T09:42:32.493034Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:44:04.781 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 1 2024-09-19T09:44:04.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.780+0000 7fba4f7e4640 1 -- 172.21.15.162:0/1854671394 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fba340392a0 msgr2=0x7fba3403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.780+0000 7fba4f7e4640 1 --2- 172.21.15.162:0/1854671394 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fba340392a0 0x7fba3403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba380098c0 tx=0x7fba38006db0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.780+0000 7fba4f7e4640 1 -- 172.21.15.162:0/1854671394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba48106650 msgr2=0x7fba48198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:04.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.780+0000 7fba4f7e4640 1 --2- 172.21.15.162:0/1854671394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba48106650 0x7fba48198050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba44009230 tx=0x7fba44003d80 comp rx=0 tx=0).stop 2024-09-19T09:44:04.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.780+0000 7fba4f7e4640 1 -- 172.21.15.162:0/1854671394 shutdown_connections 2024-09-19T09:44:04.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.780+0000 7fba4f7e4640 1 --2- 172.21.15.162:0/1854671394 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fba340392a0 0x7fba3403b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.780+0000 7fba4f7e4640 1 --2- 172.21.15.162:0/1854671394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba48106650 0x7fba48198050 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:04.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.780+0000 7fba4f7e4640 1 -- 172.21.15.162:0/1854671394 >> 172.21.15.162:0/1854671394 conn(0x7fba480fc280 msgr2=0x7fba480fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:04.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.780+0000 7fba4f7e4640 1 -- 172.21.15.162:0/1854671394 shutdown_connections 2024-09-19T09:44:04.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:04.780+0000 7fba4f7e4640 1 -- 172.21.15.162:0/1854671394 wait complete. 2024-09-19T09:44:05.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:04 smithi162 podman[35139]: 2024-09-19 09:44:04.65437101 +0000 UTC m=+0.015919381 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:44:05.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:04 smithi162 podman[35139]: 2024-09-19 09:44:04.758117772 +0000 UTC m=+0.119666135 container create af4f767de581f4b3a5f07f4cf656bf1aee92b94058d58a8215d993a30580a553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:44:05.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:05 smithi018 ceph-mon[30956]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:05.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:05 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1854671394' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:05.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 podman[35139]: 2024-09-19 09:44:05.589140289 +0000 UTC m=+0.950688665 container init af4f767de581f4b3a5f07f4cf656bf1aee92b94058d58a8215d993a30580a553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:44:05.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 podman[35139]: 2024-09-19 09:44:05.593531761 +0000 UTC m=+0.955080125 container start af4f767de581f4b3a5f07f4cf656bf1aee92b94058d58a8215d993a30580a553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:44:05.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:44:05.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: pidfile_write: ignore empty --pid-file 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: load: jerasure load: lrc 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Git sha 0 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: DB SUMMARY 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: DB Session ID: 0LJ331ODMHKUYHB3T4VA 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T09:44:05.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.env: 0x55e4c9958940 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.info_log: 0x55e4cbebf6e0 2024-09-19T09:44:05.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:44:05.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.statistics: (nil) 2024-09-19T09:44:05.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.use_fsync: 0 2024-09-19T09:44:05.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:44:05.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:44:05.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:44:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:44:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:44:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:44:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:44:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:44:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:44:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:44:05.917 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:44:05.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.db_log_dir: 2024-09-19T09:44:05.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.wal_dir: 2024-09-19T09:44:05.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:44:05.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:44:05.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:44:05.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:44:05.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:44:05.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:44:05.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.write_buffer_manager: 0x55e4cbecedc0 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.unordered_write: 0 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:44:05.919 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.row_cache: None 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.wal_filter: None 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.wal_compression: 0 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:44:05.920 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:44:05.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:44:05.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:44:05.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:44:05.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:44:05.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:44:05.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:44:05.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:44:05.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:44:05.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:44:05.921 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_open_files: -1 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:44:05.922 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Compression algorithms supported: 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: kZSTD supported: 0 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:44:05.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.merge_operator: 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_filter: None 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e4cbebf320) 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:44:05.924 INFO:journalctl@ceph.mon.c.smithi162.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: index_type: 0 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: data_block_index_type: 0 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: index_shortening: 1 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: checksum: 4 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: no_block_cache: 0 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache: 0x55e4cbeb31f0 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache_options: 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: capacity : 536870912 2024-09-19T09:44:05.925 INFO:journalctl@ceph.mon.c.smithi162.stdout: num_shard_bits : 4 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: strict_capacity_limit : 0 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache_compressed: (nil) 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: persistent_cache: (nil) 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_size: 4096 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_size_deviation: 10 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_restart_interval: 16 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: index_block_restart_interval: 1 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: metadata_block_size: 4096 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: partition_filters: 0 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: use_delta_encoding: 1 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: filter_policy: bloomfilter 2024-09-19T09:44:05.926 INFO:journalctl@ceph.mon.c.smithi162.stdout: whole_key_filtering: 1 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout: verify_compression: 0 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout: format_version: 5 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout: enable_index_compression: 1 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_align: 0 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout: max_auto_readahead_size: 262144 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout: prepopulate_block_cache: 0 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:44:05.927 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compression: NoCompression 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.num_levels: 7 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:44:05.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:44:05.929 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:44:05.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:44:05.931 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:44:05.931 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:44:05.931 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:44:05.932 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:44:05.932 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:44:05.932 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:44:05.932 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:44:05.932 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:44:05.932 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:44:05.932 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:44:05.932 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:44:05.933 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:44:05.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:44:05.935 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:44:05.935 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:44:05.935 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:44:05.935 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.ttl: 2592000 2024-09-19T09:44:05.935 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:44:05.935 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:44:05.935 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:44:05.935 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:44:05.935 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:44:05.935 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:44:05.936 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:44:05.936 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:44:05.936 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:44:05.936 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:44:05.936 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:44:05.936 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:44:05.936 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:44:05.936 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T09:44:05.936 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T09:44:05.937 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ef477903-4ab6-4542-b0bc-33ede993c39d 2024-09-19T09:44:05.937 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726739045621071, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T09:44:05.937 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T09:44:05.937 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726739045621504, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726739045, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ef477903-4ab6-4542-b0bc-33ede993c39d", "db_session_id": "0LJ331ODMHKUYHB3T4VA", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:44:05.937 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726739045621605, "job": 1, "event": "recovery_finished"} 2024-09-19T09:44:05.937 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T09:44:05.937 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:44:05.937 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e4cbee0e00 2024-09-19T09:44:05.937 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: DB pointer 0x55e4cbfdc000 2024-09-19T09:44:05.937 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:44:05.938 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:44:05.938 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** DB Stats ** 2024-09-19T09:44:05.938 INFO:journalctl@ceph.mon.c.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:44:05.938 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:44:05.938 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:44:05.938 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:44:05.938 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:44:05.938 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:44:05.938 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:44:05.939 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T09:44:05.939 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-19T09:44:05.939 INFO:journalctl@ceph.mon.c.smithi162.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:44:05.939 INFO:journalctl@ceph.mon.c.smithi162.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:44:05.939 INFO:journalctl@ceph.mon.c.smithi162.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:44:05.939 INFO:journalctl@ceph.mon.c.smithi162.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:44:05.939 INFO:journalctl@ceph.mon.c.smithi162.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:44:05.939 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T09:44:05.939 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-19T09:44:05.939 INFO:journalctl@ceph.mon.c.smithi162.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:44:05.940 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout: Block cache BinnedLRUCache@0x55e4cbeb31f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: using public_addr v2:172.21.15.162:0/0 -> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: starting mon.c rank -1 at public addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] at bind addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(???) e0 preinit fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T09:44:05.941 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout: e1 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout: btime 2024-09-19T09:42:35:497798+0000 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout: legacy client fscid: -1 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout: No filesystems configured 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T09:44:05.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/88163593' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/88163593' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:44:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: Updating smithi162:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: Updating smithi162:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:44:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi049:172.21.15.49=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: Saving service mon spec with placement smithi018:172.21.15.18=a;smithi049:172.21.15.49=b;smithi162:172.21.15.162=c;count:3 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: Deploying daemon mon.c on smithi162 2024-09-19T09:44:05.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:05.946 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/2209986114' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:05.946 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:05.946 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:05.946 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/1854671394' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:05.946 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 ceph-mon[35174]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T09:44:05.946 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 bash[35139]: af4f767de581f4b3a5f07f4cf656bf1aee92b94058d58a8215d993a30580a553 2024-09-19T09:44:05.946 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:05 smithi162 systemd[1]: Started Ceph mon.c for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:44:06.508 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:44:06.509 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:44:06.760 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:44:10.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.783+0000 7f7387493640 1 -- 172.21.15.162:0/3839880534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c003530 msgr2=0x7f736c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:10.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.783+0000 7f7387493640 1 --2- 172.21.15.162:0/3839880534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c003530 0x7f736c0059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f738006a9e0 tx=0x7f737c02c3f0 comp rx=0 tx=0).stop 2024-09-19T09:44:10.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.784+0000 7f7387493640 1 -- 172.21.15.162:0/3839880534 shutdown_connections 2024-09-19T09:44:10.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.784+0000 7f7387493640 1 --2- 172.21.15.162:0/3839880534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c003530 0x7f736c0059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:10.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.784+0000 7f7387493640 1 -- 172.21.15.162:0/3839880534 >> 172.21.15.162:0/3839880534 conn(0x7f73800fc220 msgr2=0x7f73800fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:10.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.784+0000 7f7387493640 1 -- 172.21.15.162:0/3839880534 shutdown_connections 2024-09-19T09:44:10.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.784+0000 7f7387493640 1 -- 172.21.15.162:0/3839880534 wait complete. 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.784+0000 7f7387493640 1 Processor -- start 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.784+0000 7f7387493640 1 -- start start 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7387493640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c003530 0x7f73801972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7387493640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7380197810 0x7f738019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7387493640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73801097a0 con 0x7f736c003530 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7387493640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7380109620 con 0x7f7380197810 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7384a2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7380197810 0x7f738019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7384a2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7380197810 0x7f738019bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:50780/0 (socket says 172.21.15.162:50780) 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7384a2e640 1 -- 172.21.15.162:0/1657530316 learned_addr learned my addr 172.21.15.162:0/1657530316 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f738522f640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c003530 0x7f73801972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7384a2e640 1 -- 172.21.15.162:0/1657530316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7380197810 msgr2=0x7f738019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7384a2e640 1 -- 172.21.15.162:0/1657530316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7380197810 msgr2=0x7f738019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:44:10.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7384a2e640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7380197810 0x7f738019bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:44:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f7384a2e640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7380197810 0x7f738019bba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:44:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f738522f640 1 -- 172.21.15.162:0/1657530316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7380197810 msgr2=0x7f738019bba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:44:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f738522f640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7380197810 0x7f738019bba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f738522f640 1 -- 172.21.15.162:0/1657530316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7380197e30 con 0x7f736c003530 2024-09-19T09:44:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.785+0000 7f738522f640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c003530 0x7f73801972d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f737c005f10 tx=0x7f737c034bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.786+0000 7f73767fc640 1 -- 172.21.15.162:0/1657530316 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f737c0051f0 con 0x7f736c003530 2024-09-19T09:44:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.786+0000 7f7387493640 1 -- 172.21.15.162:0/1657530316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738019c0e0 con 0x7f736c003530 2024-09-19T09:44:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.786+0000 7f73767fc640 1 -- 172.21.15.162:0/1657530316 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f737c005390 con 0x7f736c003530 2024-09-19T09:44:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.786+0000 7f73767fc640 1 -- 172.21.15.162:0/1657530316 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f737c0128c0 con 0x7f736c003530 2024-09-19T09:44:10.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.786+0000 7f7387493640 1 -- 172.21.15.162:0/1657530316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738019c620 con 0x7f736c003530 2024-09-19T09:44:10.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.787+0000 7f73767fc640 1 -- 172.21.15.162:0/1657530316 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f737c044020 con 0x7f736c003530 2024-09-19T09:44:10.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.787+0000 7f7387493640 1 -- 172.21.15.162:0/1657530316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738006ac90 con 0x7f736c003530 2024-09-19T09:44:10.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.787+0000 7f73767fc640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7364039040 0x7f736403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:10.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.787+0000 7f73767fc640 1 -- 172.21.15.162:0/1657530316 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f737c042020 con 0x7f736c003530 2024-09-19T09:44:10.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.787+0000 7f7384a2e640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7364039040 0x7f736403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:10.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.788+0000 7f7384a2e640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7364039040 0x7f736403b500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7370009100 tx=0x7f7370008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:10.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:10.792+0000 7f73767fc640 1 -- 172.21.15.162:0/1657530316 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f737c04b020 con 0x7f736c003530 2024-09-19T09:44:11.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.029+0000 7f7387493640 1 -- 172.21.15.162:0/1657530316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f738010a8b0 con 0x7f736c003530 2024-09-19T09:44:11.031 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: mon.a calling monitor election 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: mon.c calling monitor election 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:44:11.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: monmap epoch 2 2024-09-19T09:44:11.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:11.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: last_changed 2024-09-19T09:44:05.647370+0000 2024-09-19T09:44:11.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: created 2024-09-19T09:42:32.493034+0000 2024-09-19T09:44:11.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: min_mon_release 19 (squid) 2024-09-19T09:44:11.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: election_strategy: 1 2024-09-19T09:44:11.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:44:11.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T09:44:11.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: fsmap 2024-09-19T09:44:11.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:44:11.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: mgrmap e13: x(active, since 40s) 2024-09-19T09:44:11.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: overall HEALTH_OK 2024-09-19T09:44:11.035 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:11.035 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:11.035 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:11.035 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:44:11.035 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:11.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.030+0000 7f73767fc640 1 -- 172.21.15.162:0/1657530316 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f737c044570 con 0x7f736c003530 2024-09-19T09:44:11.036 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:44:11.037 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","modified":"2024-09-19T09:44:05.647370Z","created":"2024-09-19T09:42:32.493034Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:44:11.038 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-19T09:44:11.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 -- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7364039040 msgr2=0x7f736403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:11.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7364039040 0x7f736403b500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7370009100 tx=0x7f7370008040 comp rx=0 tx=0).stop 2024-09-19T09:44:11.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 -- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c003530 msgr2=0x7f73801972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:11.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c003530 0x7f73801972d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f737c005f10 tx=0x7f737c034bb0 comp rx=0 tx=0).stop 2024-09-19T09:44:11.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 -- 172.21.15.162:0/1657530316 shutdown_connections 2024-09-19T09:44:11.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7364039040 0x7f736403b500 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:11.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7380197810 0x7f738019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:11.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 --2- 172.21.15.162:0/1657530316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c003530 0x7f73801972d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:11.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 -- 172.21.15.162:0/1657530316 >> 172.21.15.162:0/1657530316 conn(0x7f73800fc220 msgr2=0x7f73800fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:11.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 -- 172.21.15.162:0/1657530316 shutdown_connections 2024-09-19T09:44:11.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:11.033+0000 7f7387493640 1 -- 172.21.15.162:0/1657530316 wait complete. 2024-09-19T09:44:11.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:44:11.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: mon.a calling monitor election 2024-09-19T09:44:11.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: mon.c calling monitor election 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: monmap epoch 2 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: last_changed 2024-09-19T09:44:05.647370+0000 2024-09-19T09:44:11.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: created 2024-09-19T09:42:32.493034+0000 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: election_strategy: 1 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: fsmap 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: mgrmap e13: x(active, since 40s) 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:44:11.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:11.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:11 smithi162 ceph-mon[35174]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:11.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:11 smithi162 ceph-mon[35174]: Deploying daemon mon.b on smithi049 2024-09-19T09:44:11.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:11 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/1657530316' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:11.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:11 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:12.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:11 smithi018 ceph-mon[30956]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:12.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:11 smithi018 ceph-mon[30956]: Deploying daemon mon.b on smithi049 2024-09-19T09:44:12.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:11 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1657530316' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:12.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:12.631 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:44:12.632 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:44:12.890 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:44:13.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.321+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/1686370233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df80fff40 msgr2=0x7f5df8100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.321+0000 7f5dfdf0d640 1 --2- 172.21.15.162:0/1686370233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df80fff40 0x7f5df8100320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5de800a990 tx=0x7f5de802b910 comp rx=0 tx=0).stop 2024-09-19T09:44:13.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.321+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/1686370233 shutdown_connections 2024-09-19T09:44:13.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.321+0000 7f5dfdf0d640 1 --2- 172.21.15.162:0/1686370233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df80fff40 0x7f5df8100320 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.321+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/1686370233 >> 172.21.15.162:0/1686370233 conn(0x7f5df80fb9a0 msgr2=0x7f5df80fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:13.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.321+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/1686370233 shutdown_connections 2024-09-19T09:44:13.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.321+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/1686370233 wait complete. 2024-09-19T09:44:13.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.322+0000 7f5dfdf0d640 1 Processor -- start 2024-09-19T09:44:13.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.322+0000 7f5dfdf0d640 1 -- start start 2024-09-19T09:44:13.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.322+0000 7f5dfdf0d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df80fff40 0x7f5df81972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.322+0000 7f5dfdf0d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8197810 0x7f5df819bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.322+0000 7f5dfdf0d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5df8109b10 con 0x7f5df8197810 2024-09-19T09:44:13.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.322+0000 7f5dfdf0d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5df8109990 con 0x7f5df80fff40 2024-09-19T09:44:13.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.322+0000 7f5df77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df80fff40 0x7f5df81972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.322+0000 7f5df77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df80fff40 0x7f5df81972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:50784/0 (socket says 172.21.15.162:50784) 2024-09-19T09:44:13.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.322+0000 7f5df77fe640 1 -- 172.21.15.162:0/4250433408 learned_addr learned my addr 172.21.15.162:0/4250433408 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:44:13.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5df77fe640 1 -- 172.21.15.162:0/4250433408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df80fff40 msgr2=0x7f5df81972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T09:44:13.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5df77fe640 1 -- 172.21.15.162:0/4250433408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df80fff40 msgr2=0x7f5df81972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5df77fe640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df80fff40 0x7f5df81972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5deffff640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8197810 0x7f5df819bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5df77fe640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df80fff40 0x7f5df81972d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5deffff640 1 -- 172.21.15.162:0/4250433408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df80fff40 msgr2=0x7f5df81972d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5deffff640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df80fff40 0x7f5df81972d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5deffff640 1 -- 172.21.15.162:0/4250433408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df8197e30 con 0x7f5df8197810 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5deffff640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8197810 0x7f5df819bba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b3d0 tx=0x7f5de000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5df57fa640 1 -- 172.21.15.162:0/4250433408 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5de0011630 con 0x7f5df8197810 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.323+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/4250433408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df819c0e0 con 0x7f5df8197810 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.324+0000 7f5df57fa640 1 -- 172.21.15.162:0/4250433408 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5de0011cb0 con 0x7f5df8197810 2024-09-19T09:44:13.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.324+0000 7f5df57fa640 1 -- 172.21.15.162:0/4250433408 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5de0010df0 con 0x7f5df8197810 2024-09-19T09:44:13.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.324+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/4250433408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df819c620 con 0x7f5df8197810 2024-09-19T09:44:13.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.324+0000 7f5df57fa640 1 -- 172.21.15.162:0/4250433408 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5de0018020 con 0x7f5df8197810 2024-09-19T09:44:13.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.325+0000 7f5df57fa640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5de4039040 0x7f5de403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.325+0000 7f5df57fa640 1 -- 172.21.15.162:0/4250433408 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5de004bfb0 con 0x7f5df8197810 2024-09-19T09:44:13.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.325+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/4250433408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df8101420 con 0x7f5df8197810 2024-09-19T09:44:13.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.325+0000 7f5df77fe640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5de4039040 0x7f5de403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.326+0000 7f5df77fe640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5de4039040 0x7f5de403b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5de800a340 tx=0x7f5de800a670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:13.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.330+0000 7f5df57fa640 1 -- 172.21.15.162:0/4250433408 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5de001f020 con 0x7f5df8197810 2024-09-19T09:44:13.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.563+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/4250433408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5df819c930 con 0x7f5df8197810 2024-09-19T09:44:13.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.563+0000 7f5df57fa640 1 -- 172.21.15.162:0/4250433408 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f5de0017500 con 0x7f5df8197810 2024-09-19T09:44:13.566 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:44:13.566 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","modified":"2024-09-19T09:44:05.647370Z","created":"2024-09-19T09:42:32.493034Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:44:13.566 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-19T09:44:13.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.565+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5de4039040 msgr2=0x7f5de403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.565+0000 7f5dfdf0d640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5de4039040 0x7f5de403b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5de800a340 tx=0x7f5de800a670 comp rx=0 tx=0).stop 2024-09-19T09:44:13.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.565+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8197810 msgr2=0x7f5df819bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.565+0000 7f5dfdf0d640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8197810 0x7f5df819bba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b3d0 tx=0x7f5de000b890 comp rx=0 tx=0).stop 2024-09-19T09:44:13.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.565+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/4250433408 shutdown_connections 2024-09-19T09:44:13.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.565+0000 7f5dfdf0d640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5de4039040 0x7f5de403b500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.565+0000 7f5dfdf0d640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8197810 0x7f5df819bba0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.565+0000 7f5dfdf0d640 1 --2- 172.21.15.162:0/4250433408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df80fff40 0x7f5df81972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.565+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/4250433408 >> 172.21.15.162:0/4250433408 conn(0x7f5df80fb9a0 msgr2=0x7f5df8101910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:13.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.566+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/4250433408 shutdown_connections 2024-09-19T09:44:13.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:13.566+0000 7f5dfdf0d640 1 -- 172.21.15.162:0/4250433408 wait complete. 2024-09-19T09:44:13.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:13 smithi162 ceph-mon[35174]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:13.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:13 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/4250433408' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:14.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:13 smithi018 ceph-mon[30956]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:14.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:13 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/4250433408' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:14.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:14 smithi049 systemd[1]: Started Ceph mon.b for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:44:15.138 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:44:15.139 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:44:15.391 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:44:19.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:19.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: mon.a calling monitor election 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: mon.c calling monitor election 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:19.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:19.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:44:19.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: monmap epoch 3 2024-09-19T09:44:19.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:19.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: last_changed 2024-09-19T09:44:14.582844+0000 2024-09-19T09:44:19.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: created 2024-09-19T09:42:32.493034+0000 2024-09-19T09:44:19.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: min_mon_release 19 (squid) 2024-09-19T09:44:19.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: election_strategy: 1 2024-09-19T09:44:19.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:44:19.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T09:44:19.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-19T09:44:19.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: fsmap 2024-09-19T09:44:19.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:44:19.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: mgrmap e13: x(active, since 49s) 2024-09-19T09:44:19.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: overall HEALTH_OK 2024-09-19T09:44:19.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:19.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:19.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:19.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: mon.a calling monitor election 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: mon.c calling monitor election 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:20.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:44:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: monmap epoch 3 2024-09-19T09:44:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: last_changed 2024-09-19T09:44:14.582844+0000 2024-09-19T09:44:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: created 2024-09-19T09:42:32.493034+0000 2024-09-19T09:44:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T09:44:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: election_strategy: 1 2024-09-19T09:44:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:44:20.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T09:44:20.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-19T09:44:20.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: fsmap 2024-09-19T09:44:20.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:44:20.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: mgrmap e13: x(active, since 49s) 2024-09-19T09:44:20.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T09:44:20.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:20.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:20.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:20.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:20.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.247+0000 7f4f52a3f640 1 -- 172.21.15.162:0/295046880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f34003530 msgr2=0x7f4f340059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:20.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.247+0000 7f4f52a3f640 1 --2- 172.21.15.162:0/295046880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f34003530 0x7f4f340059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c06aa60 tx=0x7f4f3c02c490 comp rx=0 tx=0).stop 2024-09-19T09:44:20.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.247+0000 7f4f52a3f640 1 -- 172.21.15.162:0/295046880 shutdown_connections 2024-09-19T09:44:20.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.247+0000 7f4f52a3f640 1 --2- 172.21.15.162:0/295046880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f34003530 0x7f4f340059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:20.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.247+0000 7f4f52a3f640 1 -- 172.21.15.162:0/295046880 >> 172.21.15.162:0/295046880 conn(0x7f4f4c0fc220 msgr2=0x7f4f4c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:20.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.247+0000 7f4f52a3f640 1 -- 172.21.15.162:0/295046880 shutdown_connections 2024-09-19T09:44:20.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.247+0000 7f4f52a3f640 1 -- 172.21.15.162:0/295046880 wait complete. 2024-09-19T09:44:20.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.247+0000 7f4f52a3f640 1 Processor -- start 2024-09-19T09:44:20.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.247+0000 7f4f52a3f640 1 -- start start 2024-09-19T09:44:20.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f52a3f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f34003530 0x7f4f4c1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:20.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f52a3f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f4c199af0 0x7f4f4c19de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:20.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f52a3f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4c19e3c0 0x7f4f4c19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:20.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f52a3f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c101f50 con 0x7f4f4c199af0 2024-09-19T09:44:20.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f52a3f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c101dd0 con 0x7f4f4c19e3c0 2024-09-19T09:44:20.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f52a3f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c1020d0 con 0x7f4f34003530 2024-09-19T09:44:20.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f4bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f34003530 0x7f4f4c1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:20.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f4bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f34003530 0x7f4f4c1995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:48314/0 (socket says 172.21.15.162:48314) 2024-09-19T09:44:20.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f4bfff640 1 -- 172.21.15.162:0/1198775496 learned_addr learned my addr 172.21.15.162:0/1198775496 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:44:20.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f4b7fe640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f4c199af0 0x7f4f4c19de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:20.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f4bfff640 1 -- 172.21.15.162:0/1198775496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f34003530 msgr2=0x7f4f4c1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T09:44:20.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f4bfff640 1 -- 172.21.15.162:0/1198775496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f34003530 msgr2=0x7f4f4c1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:44:20.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f4bfff640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f34003530 0x7f4f4c1995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f50fdc640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4c19e3c0 0x7f4f4c19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f4bfff640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f34003530 0x7f4f4c1995b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f50fdc640 1 -- 172.21.15.162:0/1198775496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4c19e3c0 msgr2=0x7f4f4c19e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f50fdc640 1 -- 172.21.15.162:0/1198775496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4c19e3c0 msgr2=0x7f4f4c19e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f50fdc640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4c19e3c0 0x7f4f4c19e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.248+0000 7f4f50fdc640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4c19e3c0 0x7f4f4c19e870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.249+0000 7f4f4b7fe640 1 -- 172.21.15.162:0/1198775496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f34003530 msgr2=0x7f4f4c1995b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.249+0000 7f4f4b7fe640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f34003530 0x7f4f4c1995b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.249+0000 7f4f4b7fe640 1 -- 172.21.15.162:0/1198775496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4c19e3c0 msgr2=0x7f4f4c19e870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.249+0000 7f4f4b7fe640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4c19e3c0 0x7f4f4c19e870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.249+0000 7f4f4b7fe640 1 -- 172.21.15.162:0/1198775496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c1a6130 con 0x7f4f4c199af0 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.249+0000 7f4f4b7fe640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f4c199af0 0x7f4f4c19de80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000b450 tx=0x7f4f4000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:20.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.249+0000 7f4f497fa640 1 -- 172.21.15.162:0/1198775496 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40004230 con 0x7f4f4c199af0 2024-09-19T09:44:20.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.249+0000 7f4f52a3f640 1 -- 172.21.15.162:0/1198775496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4c1a6360 con 0x7f4f4c199af0 2024-09-19T09:44:20.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.250+0000 7f4f497fa640 1 -- 172.21.15.162:0/1198775496 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f400043d0 con 0x7f4f4c199af0 2024-09-19T09:44:20.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.250+0000 7f4f497fa640 1 -- 172.21.15.162:0/1198775496 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40003cb0 con 0x7f4f4c199af0 2024-09-19T09:44:20.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.250+0000 7f4f52a3f640 1 -- 172.21.15.162:0/1198775496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4c1a68c0 con 0x7f4f4c199af0 2024-09-19T09:44:20.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.250+0000 7f4f497fa640 1 -- 172.21.15.162:0/1198775496 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4f4000f050 con 0x7f4f4c199af0 2024-09-19T09:44:20.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.250+0000 7f4f52a3f640 1 -- 172.21.15.162:0/1198775496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4c10cac0 con 0x7f4f4c199af0 2024-09-19T09:44:20.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.251+0000 7f4f497fa640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f38039730 0x7f4f3803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:20.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.251+0000 7f4f497fa640 1 -- 172.21.15.162:0/1198775496 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4f4004c210 con 0x7f4f4c199af0 2024-09-19T09:44:20.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.251+0000 7f4f4bfff640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f38039730 0x7f4f3803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:20.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.252+0000 7f4f4bfff640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f38039730 0x7f4f3803bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c02ca00 tx=0x7f4f3c02c990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:20.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.256+0000 7f4f497fa640 1 -- 172.21.15.162:0/1198775496 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f4000d040 con 0x7f4f4c199af0 2024-09-19T09:44:20.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.497+0000 7f4f52a3f640 1 -- 172.21.15.162:0/1198775496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4f4c1a6c60 con 0x7f4f4c199af0 2024-09-19T09:44:20.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.498+0000 7f4f497fa640 1 -- 172.21.15.162:0/1198775496 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f4f40018e00 con 0x7f4f4c199af0 2024-09-19T09:44:20.500 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:44:20.500 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","modified":"2024-09-19T09:44:14.582844Z","created":"2024-09-19T09:42:32.493034Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:44:20.500 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 3 2024-09-19T09:44:20.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 -- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f38039730 msgr2=0x7f4f3803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:20.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f38039730 0x7f4f3803bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c02ca00 tx=0x7f4f3c02c990 comp rx=0 tx=0).stop 2024-09-19T09:44:20.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 -- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f4c199af0 msgr2=0x7f4f4c19de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:20.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f4c199af0 0x7f4f4c19de80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000b450 tx=0x7f4f4000b910 comp rx=0 tx=0).stop 2024-09-19T09:44:20.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 -- 172.21.15.162:0/1198775496 shutdown_connections 2024-09-19T09:44:20.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f38039730 0x7f4f3803bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:20.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4c19e3c0 0x7f4f4c19e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:20.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f4c199af0 0x7f4f4c19de80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:20.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 --2- 172.21.15.162:0/1198775496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f34003530 0x7f4f4c1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:20.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 -- 172.21.15.162:0/1198775496 >> 172.21.15.162:0/1198775496 conn(0x7f4f4c0fc220 msgr2=0x7f4f4c0fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:20.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 -- 172.21.15.162:0/1198775496 shutdown_connections 2024-09-19T09:44:20.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:20.500+0000 7f4f52a3f640 1 -- 172.21.15.162:0/1198775496 wait complete. 2024-09-19T09:44:20.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:20.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:20.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:20 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/1198775496' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:20.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:21.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:21.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:21.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:20 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1198775496' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:21.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:21.475 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T09:44:21.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T09:44:21.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:44:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: mon.a calling monitor election 2024-09-19T09:44:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: mon.c calling monitor election 2024-09-19T09:44:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:44:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: monmap epoch 3 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: last_changed 2024-09-19T09:44:14.582844+0000 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: created 2024-09-19T09:42:32.493034+0000 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: min_mon_release 19 (squid) 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: election_strategy: 1 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-19T09:44:22.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: fsmap 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: mgrmap e13: x(active, since 49s) 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: overall HEALTH_OK 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='client.? 172.21.15.162:0/1198775496' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:44:22.524 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:22.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: mon.b calling monitor election 2024-09-19T09:44:22.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: Reconfiguring daemon mon.a on smithi018 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: mon.b calling monitor election 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: mon.c calling monitor election 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: mon.a calling monitor election 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: monmap epoch 3 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: last_changed 2024-09-19T09:44:14.582844+0000 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: created 2024-09-19T09:42:32.493034+0000 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: election_strategy: 1 2024-09-19T09:44:22.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:44:22.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T09:44:22.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-19T09:44:22.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: fsmap 2024-09-19T09:44:22.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:44:22.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: mgrmap e13: x(active, since 51s) 2024-09-19T09:44:22.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:22 smithi018 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T09:44:22.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: mon.b calling monitor election 2024-09-19T09:44:22.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:44:22.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: Reconfiguring daemon mon.a on smithi018 2024-09-19T09:44:22.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: mon.b calling monitor election 2024-09-19T09:44:22.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: mon.c calling monitor election 2024-09-19T09:44:22.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: mon.a calling monitor election 2024-09-19T09:44:22.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: monmap epoch 3 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: last_changed 2024-09-19T09:44:14.582844+0000 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: created 2024-09-19T09:42:32.493034+0000 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: min_mon_release 19 (squid) 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: election_strategy: 1 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: fsmap 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: mgrmap e13: x(active, since 51s) 2024-09-19T09:44:22.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:22 smithi049 ceph-mon[34858]: overall HEALTH_OK 2024-09-19T09:44:22.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: mon.b calling monitor election 2024-09-19T09:44:22.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:44:22.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: Reconfiguring daemon mon.a on smithi018 2024-09-19T09:44:22.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: mon.b calling monitor election 2024-09-19T09:44:22.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: mon.c calling monitor election 2024-09-19T09:44:22.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: mon.a calling monitor election 2024-09-19T09:44:22.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: monmap epoch 3 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: last_changed 2024-09-19T09:44:14.582844+0000 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: created 2024-09-19T09:42:32.493034+0000 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: min_mon_release 19 (squid) 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: election_strategy: 1 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: fsmap 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: mgrmap e13: x(active, since 51s) 2024-09-19T09:44:22.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:22 smithi162 ceph-mon[35174]: overall HEALTH_OK 2024-09-19T09:44:22.814 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 -- 172.21.15.18:0/772693580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb60c101430 msgr2=0x7fb60c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 --2- 172.21.15.18:0/772693580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb60c101430 0x7fb60c10d960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009930 tx=0x7fb5f402a420 comp rx=0 tx=0).stop 2024-09-19T09:44:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 -- 172.21.15.18:0/772693580 shutdown_connections 2024-09-19T09:44:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 --2- 172.21.15.18:0/772693580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb60c101430 0x7fb60c10d960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 --2- 172.21.15.18:0/772693580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c100a90 0x7fb60c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 --2- 172.21.15.18:0/772693580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60c106a90 0x7fb60c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 -- 172.21.15.18:0/772693580 >> 172.21.15.18:0/772693580 conn(0x7fb60c0fc7d0 msgr2=0x7fb60c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 -- 172.21.15.18:0/772693580 shutdown_connections 2024-09-19T09:44:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 -- 172.21.15.18:0/772693580 wait complete. 2024-09-19T09:44:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 Processor -- start 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.242+0000 7fb612f02640 1 -- start start 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb612f02640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb60c100a90 0x7fb60c10e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb612f02640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60c101430 0x7fb60c10e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb612f02640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c106a90 0x7fb60c10ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb612f02640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c112030 con 0x7fb60c100a90 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb612f02640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c111eb0 con 0x7fb60c106a90 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb612f02640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c1121b0 con 0x7fb60c101430 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb610c9e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb60c100a90 0x7fb60c10e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb610c9e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb60c100a90 0x7fb60c10e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49670/0 (socket says 172.21.15.18:49670) 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb610c9e640 1 -- 172.21.15.18:0/1922983943 learned_addr learned my addr 172.21.15.18:0/1922983943 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:44:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb60bfff640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60c101430 0x7fb60c10e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb61149f640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c106a90 0x7fb60c10ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb610c9e640 1 -- 172.21.15.18:0/1922983943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60c101430 msgr2=0x7fb60c10e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb610c9e640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60c101430 0x7fb60c10e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb610c9e640 1 -- 172.21.15.18:0/1922983943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c106a90 msgr2=0x7fb60c10ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb610c9e640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c106a90 0x7fb60c10ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb610c9e640 1 -- 172.21.15.18:0/1922983943 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60c1a6a50 con 0x7fb60c100a90 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb61149f640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c106a90 0x7fb60c10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb610c9e640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb60c100a90 0x7fb60c10e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb60400b4a0 tx=0x7fb60400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.243+0000 7fb609ffb640 1 -- 172.21.15.18:0/1922983943 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604014070 con 0x7fb60c100a90 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.244+0000 7fb612f02640 1 -- 172.21.15.18:0/1922983943 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60c1a6d40 con 0x7fb60c100a90 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.244+0000 7fb609ffb640 1 -- 172.21.15.18:0/1922983943 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb604010af0 con 0x7fb60c100a90 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.244+0000 7fb609ffb640 1 -- 172.21.15.18:0/1922983943 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604017d10 con 0x7fb60c100a90 2024-09-19T09:44:23.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.244+0000 7fb612f02640 1 -- 172.21.15.18:0/1922983943 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60c1a7220 con 0x7fb60c100a90 2024-09-19T09:44:23.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.244+0000 7fb609ffb640 1 -- 172.21.15.18:0/1922983943 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb604017070 con 0x7fb60c100a90 2024-09-19T09:44:23.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.245+0000 7fb609ffb640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5f80394d0 0x7fb5f803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:23.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.245+0000 7fb609ffb640 1 -- 172.21.15.18:0/1922983943 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb60404bb50 con 0x7fb60c100a90 2024-09-19T09:44:23.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.245+0000 7fb612f02640 1 -- 172.21.15.18:0/1922983943 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60c100f70 con 0x7fb60c100a90 2024-09-19T09:44:23.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.245+0000 7fb60bfff640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5f80394d0 0x7fb5f803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:23.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.245+0000 7fb60bfff640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5f80394d0 0x7fb5f803b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb60c10fe80 tx=0x7fb5fc0094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:23.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.250+0000 7fb609ffb640 1 -- 172.21.15.18:0/1922983943 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb604020300 con 0x7fb60c100a90 2024-09-19T09:44:23.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.426+0000 7fb612f02640 1 -- 172.21.15.18:0/1922983943 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fb60c109020 con 0x7fb60c100a90 2024-09-19T09:44:23.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.426+0000 7fb609ffb640 1 -- 172.21.15.18:0/1922983943 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7fb604018e00 con 0x7fb60c100a90 2024-09-19T09:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout:# minimal ceph.conf for 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-09-19T09:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: mon_host = [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-19T09:44:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 -- 172.21.15.18:0/1922983943 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5f80394d0 msgr2=0x7fb5f803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5f80394d0 0x7fb5f803b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb60c10fe80 tx=0x7fb5fc0094f0 comp rx=0 tx=0).stop 2024-09-19T09:44:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 -- 172.21.15.18:0/1922983943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb60c100a90 msgr2=0x7fb60c10e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb60c100a90 0x7fb60c10e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb60400b4a0 tx=0x7fb60400b960 comp rx=0 tx=0).stop 2024-09-19T09:44:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 -- 172.21.15.18:0/1922983943 shutdown_connections 2024-09-19T09:44:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5f80394d0 0x7fb5f803b990 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:23.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb60c106a90 0x7fb60c10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:23.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb60c101430 0x7fb60c10e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:23.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 --2- 172.21.15.18:0/1922983943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb60c100a90 0x7fb60c10e3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:23.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 -- 172.21.15.18:0/1922983943 >> 172.21.15.18:0/1922983943 conn(0x7fb60c0fc7d0 msgr2=0x7fb60c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:23.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 -- 172.21.15.18:0/1922983943 shutdown_connections 2024-09-19T09:44:23.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:23.428+0000 7fb612f02640 1 -- 172.21.15.18:0/1922983943 wait complete. 2024-09-19T09:44:23.468 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:23 smithi049 ceph-mon[34858]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:23.468 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:23.468 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:23.468 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:23.468 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:23 smithi049 ceph-mon[34858]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:44:23.468 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:44:23.468 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:44:23.468 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:23.468 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:23 smithi049 ceph-mon[34858]: Reconfiguring daemon mon.b on smithi049 2024-09-19T09:44:23.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:23 smithi018 ceph-mon[30956]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:23.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:23.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:23.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:23.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:23 smithi018 ceph-mon[30956]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:44:23.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:44:23.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:44:23.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:23.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:23 smithi018 ceph-mon[30956]: Reconfiguring daemon mon.b on smithi049 2024-09-19T09:44:23.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:23 smithi162 ceph-mon[35174]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:23.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:44:23.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:23.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:23.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:23 smithi162 ceph-mon[35174]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:44:23.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:44:23.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:44:23.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:23.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:23 smithi162 ceph-mon[35174]: Reconfiguring daemon mon.b on smithi049 2024-09-19T09:44:24.083 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T09:44:24.083 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:44:24.083 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:44:24.115 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:44:24.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:44:24.182 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:44:24.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:44:24.216 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:44:24.216 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:44:24.284 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:44:24.284 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:44:24.315 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:44:24.315 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:44:24.381 INFO:tasks.cephadm:Adding mgr.x on smithi018 2024-09-19T09:44:24.382 INFO:tasks.cephadm:Adding mgr.y on smithi049 2024-09-19T09:44:24.382 INFO:tasks.cephadm:Adding mgr.z on smithi162 2024-09-19T09:44:24.382 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi018=x;smithi049=y;smithi162=z' 2024-09-19T09:44:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:24 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1922983943' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:24 smithi018 ceph-mon[30956]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:44:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:44:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:44:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:24 smithi018 ceph-mon[30956]: Reconfiguring daemon mon.c on smithi162 2024-09-19T09:44:24.637 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:24 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1922983943' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:24.637 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:24 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:24.637 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:24 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:24.637 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:24 smithi162 ceph-mon[35174]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:44:24.638 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:24 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:44:24.638 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:24 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:44:24.638 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:24 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:24.638 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:24 smithi162 ceph-mon[35174]: Reconfiguring daemon mon.c on smithi162 2024-09-19T09:44:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:24 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1922983943' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:24 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:24 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:24 smithi049 ceph-mon[34858]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:44:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:24 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:44:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:24 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:44:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:24 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:24 smithi049 ceph-mon[34858]: Reconfiguring daemon mon.c on smithi162 2024-09-19T09:44:25.644 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:44:26.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.092+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/1557496406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b48101cd0 msgr2=0x7f2b48102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:26.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.092+0000 7f2b4e9c3640 1 --2- 172.21.15.162:0/1557496406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b48101cd0 0x7f2b48102150 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009900 tx=0x7f2b3002a410 comp rx=0 tx=0).stop 2024-09-19T09:44:26.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.092+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/1557496406 shutdown_connections 2024-09-19T09:44:26.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.092+0000 7f2b4e9c3640 1 --2- 172.21.15.162:0/1557496406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b48102690 0x7f2b48108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.092+0000 7f2b4e9c3640 1 --2- 172.21.15.162:0/1557496406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b48101cd0 0x7f2b48102150 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.092+0000 7f2b4e9c3640 1 --2- 172.21.15.162:0/1557496406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b48100ad0 0x7f2b48100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.092+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/1557496406 >> 172.21.15.162:0/1557496406 conn(0x7f2b480fc280 msgr2=0x7f2b480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.092+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/1557496406 shutdown_connections 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.092+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/1557496406 wait complete. 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.092+0000 7f2b4e9c3640 1 Processor -- start 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b4e9c3640 1 -- start start 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b4e9c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b48100ad0 0x7f2b48104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b4e9c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b48101cd0 0x7f2b481030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b4e9c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b48102690 0x7f2b481035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b4e9c3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4810c800 con 0x7f2b48102690 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b4e9c3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4810c680 con 0x7f2b48100ad0 2024-09-19T09:44:26.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b4e9c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4810c980 con 0x7f2b48101cd0 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b477fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b48101cd0 0x7f2b481030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b477fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b48101cd0 0x7f2b481030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:48332/0 (socket says 172.21.15.162:48332) 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b477fe640 1 -- 172.21.15.162:0/2399132367 learned_addr learned my addr 172.21.15.162:0/2399132367 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b47fff640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b48100ad0 0x7f2b48104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b477fe640 1 -- 172.21.15.162:0/2399132367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b48100ad0 msgr2=0x7f2b48104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b477fe640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b48100ad0 0x7f2b48104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b4cf60640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b48102690 0x7f2b481035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b477fe640 1 -- 172.21.15.162:0/2399132367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b48102690 msgr2=0x7f2b481035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b477fe640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b48102690 0x7f2b481035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b477fe640 1 -- 172.21.15.162:0/2399132367 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b48103eb0 con 0x7f2b48101cd0 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.093+0000 7f2b477fe640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b48101cd0 0x7f2b481030b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009230 tx=0x7f2b30004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.094+0000 7f2b457fa640 1 -- 172.21.15.162:0/2399132367 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3003f030 con 0x7f2b48101cd0 2024-09-19T09:44:26.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.094+0000 7f2b457fa640 1 -- 172.21.15.162:0/2399132367 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b30003ce0 con 0x7f2b48101cd0 2024-09-19T09:44:26.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.094+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/2399132367 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b481a20c0 con 0x7f2b48101cd0 2024-09-19T09:44:26.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.094+0000 7f2b457fa640 1 -- 172.21.15.162:0/2399132367 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b30035070 con 0x7f2b48101cd0 2024-09-19T09:44:26.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.094+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/2399132367 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b481a2640 con 0x7f2b48101cd0 2024-09-19T09:44:26.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.094+0000 7f2b457fa640 1 -- 172.21.15.162:0/2399132367 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2b30042030 con 0x7f2b48101cd0 2024-09-19T09:44:26.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.095+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/2399132367 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b481a2870 con 0x7f2b48101cd0 2024-09-19T09:44:26.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.095+0000 7f2b457fa640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b340394d0 0x7f2b3403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:26.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.095+0000 7f2b457fa640 1 -- 172.21.15.162:0/2399132367 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2b3006d260 con 0x7f2b48101cd0 2024-09-19T09:44:26.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.095+0000 7f2b47fff640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b340394d0 0x7f2b3403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:26.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.096+0000 7f2b47fff640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b340394d0 0x7f2b3403b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b48101b30 tx=0x7f2b38008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:26.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.100+0000 7f2b457fa640 1 -- 172.21.15.162:0/2399132367 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b3004dbf0 con 0x7f2b48101cd0 2024-09-19T09:44:26.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.281+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/2399132367 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi049=y;smithi162=z", "target": ["mon-mgr", ""]}) -- 0x7f2b4806a6f0 con 0x7f2b340394d0 2024-09-19T09:44:26.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.286+0000 7f2b457fa640 1 -- 172.21.15.162:0/2399132367 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2b4806a6f0 con 0x7f2b340394d0 2024-09-19T09:44:26.288 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mgr update... 2024-09-19T09:44:26.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/2399132367 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b340394d0 msgr2=0x7f2b3403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:26.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b340394d0 0x7f2b3403b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b48101b30 tx=0x7f2b38008040 comp rx=0 tx=0).stop 2024-09-19T09:44:26.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/2399132367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b48101cd0 msgr2=0x7f2b481030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:26.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b48101cd0 0x7f2b481030b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009230 tx=0x7f2b30004360 comp rx=0 tx=0).stop 2024-09-19T09:44:26.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/2399132367 shutdown_connections 2024-09-19T09:44:26.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b340394d0 0x7f2b3403b990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:26.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b48102690 0x7f2b481035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:26.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b48101cd0 0x7f2b481030b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:26.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 --2- 172.21.15.162:0/2399132367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b48100ad0 0x7f2b48104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:26.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/2399132367 >> 172.21.15.162:0/2399132367 conn(0x7f2b480fc280 msgr2=0x7f2b48069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:26.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/2399132367 shutdown_connections 2024-09-19T09:44:26.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:44:26.288+0000 7f2b4e9c3640 1 -- 172.21.15.162:0/2399132367 wait complete. 2024-09-19T09:44:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:26 smithi018 ceph-mon[30956]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:26.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:26 smithi049 ceph-mon[34858]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:26.665 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:26 smithi162 ceph-mon[35174]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:26.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:26.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:26.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:26.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:26.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:26.666 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:26.894 DEBUG:teuthology.orchestra.run.smithi049:mgr.y> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T09:44:26.897 DEBUG:teuthology.orchestra.run.smithi162:mgr.z> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T09:44:26.899 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T09:44:26.899 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:44:26.899 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:44:26.919 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:44:26.919 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-19T09:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T09:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 09:43:41.209267968 +0000 2024-09-19T09:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 09:39:04.556181297 +0000 2024-09-19T09:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 09:39:04.556181297 +0000 2024-09-19T09:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 09:39:04.556181297 +0000 2024-09-19T09:44:26.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:44:27.050 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T09:44:27.050 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T09:44:27.050 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000134935 s, 3.8 MB/s 2024-09-19T09:44:27.051 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:44:27.111 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-19T09:44:27.170 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:44:27.170 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:27.170 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T09:44:27.170 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:27.170 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:27.170 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 09:43:41.244267528 +0000 2024-09-19T09:44:27.170 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 09:39:04.868177350 +0000 2024-09-19T09:44:27.170 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 09:39:04.868177350 +0000 2024-09-19T09:44:27.170 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 09:39:04.868177350 +0000 2024-09-19T09:44:27.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:44:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T09:44:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T09:44:27.237 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000121165 s, 4.2 MB/s 2024-09-19T09:44:27.238 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:44:27.299 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-19T09:44:27.357 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:44:27.357 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:27.357 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T09:44:27.357 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:27.358 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:27.358 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 09:43:41.278267101 +0000 2024-09-19T09:44:27.358 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 09:39:05.201173137 +0000 2024-09-19T09:44:27.358 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 09:39:05.201173137 +0000 2024-09-19T09:44:27.358 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 09:39:05.201173137 +0000 2024-09-19T09:44:27.358 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:44:27.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:27.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi049=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:27.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: Saving service mgr spec with placement smithi018=x;smithi049=y;smithi162=z;count:3 2024-09-19T09:44:27.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:27.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:27.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:27.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:27.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:27.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:44:27.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:44:27.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:44:27.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:27.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:27 smithi018 ceph-mon[30956]: Deploying daemon mgr.z on smithi162 2024-09-19T09:44:27.412 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T09:44:27.412 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T09:44:27.412 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000117298 s, 4.4 MB/s 2024-09-19T09:44:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi049=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: Saving service mgr spec with placement smithi018=x;smithi049=y;smithi162=z;count:3 2024-09-19T09:44:27.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:27.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:27.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:27.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:27.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:27.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:44:27.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:44:27.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:44:27.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:27.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:27 smithi162 ceph-mon[35174]: Deploying daemon mgr.z on smithi162 2024-09-19T09:44:27.415 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:44:27.474 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-19T09:44:27.530 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:44:27.530 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:27.530 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T09:44:27.530 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:27.530 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:27.530 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 09:43:41.313266660 +0000 2024-09-19T09:44:27.530 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 09:39:05.536168898 +0000 2024-09-19T09:44:27.531 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 09:39:05.536168898 +0000 2024-09-19T09:44:27.531 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 09:39:05.536168898 +0000 2024-09-19T09:44:27.531 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:44:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T09:44:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T09:44:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000112411 s, 4.6 MB/s 2024-09-19T09:44:27.597 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:44:27.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:27.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi049=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:27.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: Saving service mgr spec with placement smithi018=x;smithi049=y;smithi162=z;count:3 2024-09-19T09:44:27.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:27.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:27.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:27.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:27.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:27.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:44:27.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:44:27.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:44:27.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:27.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:27 smithi049 ceph-mon[34858]: Deploying daemon mgr.z on smithi162 2024-09-19T09:44:27.655 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:44:27.655 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:44:27.675 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:44:27.675 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-09-19T09:44:27.734 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:44:27.735 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:27.735 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T09:44:27.735 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:27.735 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:27.735 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-19 09:44:14.049347265 +0000 2024-09-19T09:44:27.735 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-19 09:39:24.706721350 +0000 2024-09-19T09:44:27.735 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-19 09:39:24.706721350 +0000 2024-09-19T09:44:27.735 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-19 09:39:24.706721350 +0000 2024-09-19T09:44:27.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:44:27.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-19T09:44:27.804 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-19T09:44:27.804 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000117981 s, 4.3 MB/s 2024-09-19T09:44:27.805 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:44:27.866 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-09-19T09:44:27.924 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:44:27.924 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:27.924 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T09:44:27.925 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:27.925 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:27.925 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-19 09:44:14.050347238 +0000 2024-09-19T09:44:27.925 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-19 09:39:25.043712182 +0000 2024-09-19T09:44:27.925 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-19 09:39:25.043712182 +0000 2024-09-19T09:44:27.925 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-19 09:39:25.043712182 +0000 2024-09-19T09:44:27.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:44:27.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-19T09:44:27.991 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-19T09:44:27.991 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000119836 s, 4.3 MB/s 2024-09-19T09:44:27.993 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:44:28.052 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-09-19T09:44:28.109 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:44:28.109 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:28.109 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T09:44:28.110 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:28.110 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:28.110 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-19 09:44:14.050347238 +0000 2024-09-19T09:44:28.110 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-19 09:39:25.366703394 +0000 2024-09-19T09:44:28.110 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-19 09:39:25.366703394 +0000 2024-09-19T09:44:28.110 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-19 09:39:25.366703394 +0000 2024-09-19T09:44:28.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:44:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-19T09:44:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-19T09:44:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000143253 s, 3.6 MB/s 2024-09-19T09:44:28.176 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:44:28.234 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-09-19T09:44:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:44:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:28.291 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T09:44:28.291 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:28.291 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:28.291 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-19 09:44:14.051347211 +0000 2024-09-19T09:44:28.292 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-19 09:39:25.698694362 +0000 2024-09-19T09:44:28.292 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-19 09:39:25.698694362 +0000 2024-09-19T09:44:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-19 09:39:25.698694362 +0000 2024-09-19T09:44:28.292 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:44:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-19T09:44:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-19T09:44:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000111137 s, 4.6 MB/s 2024-09-19T09:44:28.357 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:44:28.415 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:44:28.415 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:44:28.432 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:44:28.432 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-19T09:44:28.488 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:44:28.488 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:28.488 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T09:44:28.489 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:28.489 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:28.489 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 09:44:28.426423448 +0000 2024-09-19T09:44:28.489 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 09:39:16.509719806 +0000 2024-09-19T09:44:28.489 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 09:39:16.509719806 +0000 2024-09-19T09:44:28.489 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 09:39:16.509719806 +0000 2024-09-19T09:44:28.489 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:44:28.556 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T09:44:28.556 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T09:44:28.556 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000256142 s, 2.0 MB/s 2024-09-19T09:44:28.557 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:44:28.616 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-19T09:44:28.671 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:44:28.671 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:28.671 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T09:44:28.671 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:28.671 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:28.671 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 09:44:28.426423448 +0000 2024-09-19T09:44:28.671 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 09:39:16.825713253 +0000 2024-09-19T09:44:28.671 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 09:39:16.825713253 +0000 2024-09-19T09:44:28.671 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 09:39:16.825713253 +0000 2024-09-19T09:44:28.672 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:44:28.736 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T09:44:28.736 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T09:44:28.736 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000249004 s, 2.1 MB/s 2024-09-19T09:44:28.737 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:44:28.793 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-19T09:44:28.850 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:44:28.851 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:28.851 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T09:44:28.851 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:28.851 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:28.851 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 09:44:28.427423427 +0000 2024-09-19T09:44:28.851 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 09:39:17.154706430 +0000 2024-09-19T09:44:28.851 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 09:39:17.154706430 +0000 2024-09-19T09:44:28.851 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 09:39:17.154706430 +0000 2024-09-19T09:44:28.852 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:44:28.916 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T09:44:28.917 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T09:44:28.917 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000223601 s, 2.3 MB/s 2024-09-19T09:44:28.917 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:44:28.972 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-19T09:44:29.028 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:44:29.028 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:44:29.028 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T09:44:29.028 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:44:29.028 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:44:29.029 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 09:44:28.427423427 +0000 2024-09-19T09:44:29.029 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 09:39:17.497699317 +0000 2024-09-19T09:44:29.029 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 09:39:17.497699317 +0000 2024-09-19T09:44:29.029 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 09:39:17.497699317 +0000 2024-09-19T09:44:29.029 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:44:29.093 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T09:44:29.093 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T09:44:29.093 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.00024411 s, 2.1 MB/s 2024-09-19T09:44:29.094 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:44:29.153 INFO:tasks.cephadm:Deploying osd.0 on smithi018 with /dev/vg_nvme/lv_4... 2024-09-19T09:44:29.154 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:44:29.352 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:29.202+0000 7ff53a902040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:44:29.352 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:29.350+0000 7ff53a902040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:44:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:29.662 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:29.416+0000 7ff53a902040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:44:29.663 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:29.563+0000 7ff53a902040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:44:30.020 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:29.704+0000 7ff53a902040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:44:30.021 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:30.018+0000 7ff53a902040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:44:30.413 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:30.079+0000 7ff53a902040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:44:30.413 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:30.268+0000 7ff53a902040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:44:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-mon[35174]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:44:30.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:44:30.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:44:30.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:30.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:30 smithi162 ceph-mon[35174]: Deploying daemon mgr.y on smithi049 2024-09-19T09:44:30.476 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:30 smithi049 ceph-mon[34858]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:30.476 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:30.476 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:30.476 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:30.476 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:44:30.476 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:44:30.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:44:30.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:30.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:30 smithi049 ceph-mon[34858]: Deploying daemon mgr.y on smithi049 2024-09-19T09:44:30.494 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:30 smithi018 ceph-mon[30956]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:30.495 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:30.495 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:30.495 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:30.495 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:44:30.495 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:44:30.495 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:44:30.495 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:30.495 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:30 smithi018 ceph-mon[30956]: Deploying daemon mgr.y on smithi049 2024-09-19T09:44:31.145 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:30 smithi049 systemd[1]: Starting Ceph mgr.y for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:44:31.400 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 podman[36239]: 2024-09-19 09:44:31.143657314 +0000 UTC m=+0.106117525 container create 9075f74b746c6ba8668bf7d00b0b8c45a372d4fd8d0a934a56eaa9d513a9196b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T09:44:31.400 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 podman[36239]: 2024-09-19 09:44:31.053219733 +0000 UTC m=+0.015679911 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:44:31.400 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 podman[36239]: 2024-09-19 09:44:31.337698609 +0000 UTC m=+0.300158781 container init 9075f74b746c6ba8668bf7d00b0b8c45a372d4fd8d0a934a56eaa9d513a9196b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:44:31.400 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 podman[36239]: 2024-09-19 09:44:31.34059027 +0000 UTC m=+0.303050440 container start 9075f74b746c6ba8668bf7d00b0b8c45a372d4fd8d0a934a56eaa9d513a9196b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:44:31.401 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 ceph-mgr[36258]: -- 172.21.15.49:0/4171458501 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563a6bcdb0e0 con 0x563a6bcb8800 2024-09-19T09:44:31.662 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:31 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:31.194+0000 7ff53a902040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:44:31.663 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:31 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:31.264+0000 7ff53a902040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:44:31.689 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 bash[36239]: 9075f74b746c6ba8668bf7d00b0b8c45a372d4fd8d0a934a56eaa9d513a9196b 2024-09-19T09:44:31.689 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 systemd[1]: Started Ceph mgr.y for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:44:31.689 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:31.465+0000 7fd18ac6d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:44:31.689 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:31.526+0000 7fd18ac6d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:44:31.689 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:31.686+0000 7fd18ac6d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:44:31.865 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:44:31.891 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_4 2024-09-19T09:44:32.075 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:31.757+0000 7fd18ac6d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:44:32.075 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:31 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:31.918+0000 7fd18ac6d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:44:32.075 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:32 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:32.073+0000 7fd18ac6d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:44:32.141 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:32.316 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-mon[35174]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:32.316 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.316 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.316 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.316 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.316 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:32.316 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:32.041+0000 7ff53a902040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:44:32.317 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:32.157+0000 7ff53a902040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:44:32.317 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:32.313+0000 7ff53a902040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:44:32.328 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:32 smithi049 ceph-mon[34858]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:32.328 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:32 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.328 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:32 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.328 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:32 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.328 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:32 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.328 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:32 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:32.458 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:32 smithi018 ceph-mon[30956]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:32.458 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:32.459 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:32.600 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:32.377+0000 7ff53a902040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:44:32.600 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:32.530+0000 7ff53a902040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:44:32.601 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:32.598+0000 7ff53a902040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:44:32.650 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:32 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:32.408+0000 7fd18ac6d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:44:32.650 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:32 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:32.471+0000 7fd18ac6d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.667+0000 7fc3d1e59640 1 -- 172.21.15.18:0/4179402297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc107920 msgr2=0x7fc3cc109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.667+0000 7fc3d1e59640 1 --2- 172.21.15.18:0/4179402297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc107920 0x7fc3cc109d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009ca0 tx=0x7fc3c402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.667+0000 7fc3d1e59640 1 -- 172.21.15.18:0/4179402297 shutdown_connections 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.667+0000 7fc3d1e59640 1 --2- 172.21.15.18:0/4179402297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc107920 0x7fc3cc109d10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.667+0000 7fc3d1e59640 1 --2- 172.21.15.18:0/4179402297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc104ff0 0x7fc3cc1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.667+0000 7fc3d1e59640 1 --2- 172.21.15.18:0/4179402297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc1026c0 0x7fc3cc104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.667+0000 7fc3d1e59640 1 -- 172.21.15.18:0/4179402297 >> 172.21.15.18:0/4179402297 conn(0x7fc3cc0fc280 msgr2=0x7fc3cc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.667+0000 7fc3d1e59640 1 -- 172.21.15.18:0/4179402297 shutdown_connections 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.667+0000 7fc3d1e59640 1 -- 172.21.15.18:0/4179402297 wait complete. 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3d1e59640 1 Processor -- start 2024-09-19T09:44:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3d1e59640 1 -- start start 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3d1e59640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc1026c0 0x7fc3cc197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3d1e59640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc104ff0 0x7fc3cc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3d1e59640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc107920 0x7fc3cc19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3d1e59640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc10d880 con 0x7fc3cc104ff0 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3d1e59640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc10d700 con 0x7fc3cc1026c0 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3d1e59640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc10da00 con 0x7fc3cc107920 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3c2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc104ff0 0x7fc3cc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3cb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc1026c0 0x7fc3cc197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3c2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc104ff0 0x7fc3cc198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57294/0 (socket says 172.21.15.18:57294) 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3c2ffd640 1 -- 172.21.15.18:0/397124839 learned_addr learned my addr 172.21.15.18:0/397124839 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3cb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc1026c0 0x7fc3cc197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:56320/0 (socket says 172.21.15.18:56320) 2024-09-19T09:44:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.668+0000 7fc3cbfff640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc107920 0x7fc3cc19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3c2ffd640 1 -- 172.21.15.18:0/397124839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc107920 msgr2=0x7fc3cc19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3c2ffd640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc107920 0x7fc3cc19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3c2ffd640 1 -- 172.21.15.18:0/397124839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc1026c0 msgr2=0x7fc3cc197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3c2ffd640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc1026c0 0x7fc3cc197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3c2ffd640 1 -- 172.21.15.18:0/397124839 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc19faf0 con 0x7fc3cc104ff0 2024-09-19T09:44:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3cb7fe640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc1026c0 0x7fc3cc197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3c2ffd640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc104ff0 0x7fc3cc198400 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400d740 tx=0x7fc3b400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3c97fa640 1 -- 172.21.15.18:0/397124839 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4017070 con 0x7fc3cc104ff0 2024-09-19T09:44:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3c97fa640 1 -- 172.21.15.18:0/397124839 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b400de50 con 0x7fc3cc104ff0 2024-09-19T09:44:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3d1e59640 1 -- 172.21.15.18:0/397124839 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc19fde0 con 0x7fc3cc104ff0 2024-09-19T09:44:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3c97fa640 1 -- 172.21.15.18:0/397124839 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4004e00 con 0x7fc3cc104ff0 2024-09-19T09:44:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.669+0000 7fc3d1e59640 1 -- 172.21.15.18:0/397124839 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc1a0240 con 0x7fc3cc104ff0 2024-09-19T09:44:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.670+0000 7fc3c97fa640 1 -- 172.21.15.18:0/397124839 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc3b4010460 con 0x7fc3cc104ff0 2024-09-19T09:44:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.670+0000 7fc3d1e59640 1 -- 172.21.15.18:0/397124839 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3cc0fdd70 con 0x7fc3cc104ff0 2024-09-19T09:44:32.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.671+0000 7fc3c97fa640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3b8039500 0x7fc3b803b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:32.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.671+0000 7fc3c97fa640 1 -- 172.21.15.18:0/397124839 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc3b404c1a0 con 0x7fc3cc104ff0 2024-09-19T09:44:32.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.671+0000 7fc3cb7fe640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3b8039500 0x7fc3b803b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:32.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.671+0000 7fc3cb7fe640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3b8039500 0x7fc3b803b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009fc0 tx=0x7fc3bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:32.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.675+0000 7fc3c97fa640 1 -- 172.21.15.18:0/397124839 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3b4009cc0 con 0x7fc3cc104ff0 2024-09-19T09:44:32.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:32.872+0000 7fc3d1e59640 1 -- 172.21.15.18:0/397124839 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc3cc062630 con 0x7fc3b8039500 2024-09-19T09:44:32.899 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:32.662+0000 7ff53a902040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:44:32.899 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:32.831+0000 7ff53a902040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:44:32.900 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:32.897+0000 7ff53a902040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:44:33.150 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:32 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:32.670+0000 7fd18ac6d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:44:33.162 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:32.963+0000 7ff53a902040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:44:33.163 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:33.045+0000 7ff53a902040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:44:33.163 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:33.105+0000 7ff53a902040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:44:33.637 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:33.165+0000 7ff53a902040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:44:33.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:33.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: Reconfiguring daemon mgr.x on smithi018 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:33.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:44:33.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:44:33.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:33.900 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:33.594+0000 7fd18ac6d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:44:33.900 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:33.665+0000 7fd18ac6d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:44:33.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:33.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: Reconfiguring daemon mgr.x on smithi018 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:44:33.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:44:33.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:44:33.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:44:33.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:33.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: Reconfiguring daemon mgr.x on smithi018 2024-09-19T09:44:33.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:44:33.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:44:33.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:44:33.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:34.413 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 09:44:33 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z[36911]: 2024-09-19T09:44:33.961+0000 7ff53a902040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:44:34.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:34.644+0000 7fc3c97fa640 1 -- 172.21.15.18:0/397124839 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7fc3b400f3c0 con 0x7fc3cc104ff0 2024-09-19T09:44:34.692 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:34.421+0000 7fd18ac6d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:44:34.693 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:34.541+0000 7fd18ac6d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:44:34.693 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: Standby manager daemon z started 2024-09-19T09:44:34.693 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:44:34.693 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:44:34.693 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:44:34.693 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:44:34.693 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:34.693 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:34.693 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:34.694 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:34.694 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:34.694 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:34.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: Standby manager daemon z started 2024-09-19T09:44:34.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:44:34.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:44:34.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:44:34.859 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:44:34.860 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:34.860 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:34.860 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:34.860 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:34.860 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:34.860 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:34.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: Standby manager daemon z started 2024-09-19T09:44:34.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:44:34.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:44:34.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:44:34.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: from='mgr.? 172.21.15.162:0/2747322005' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:44:34.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:34.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:34.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:34.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:34.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:34.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:34.983 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:34.690+0000 7fd18ac6d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:44:34.984 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:34.754+0000 7fd18ac6d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:44:34.984 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:34.910+0000 7fd18ac6d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:44:34.984 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:34.981+0000 7fd18ac6d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:44:35.279 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:35.043+0000 7fd18ac6d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:44:35.279 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:35.209+0000 7fd18ac6d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:44:35.280 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:35.277+0000 7fd18ac6d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:44:35.558 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:35.346+0000 7fd18ac6d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:44:35.558 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:35.432+0000 7fd18ac6d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:44:35.558 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:35.494+0000 7fd18ac6d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:44:35.558 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:35.555+0000 7fd18ac6d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:44:35.716 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:35 smithi018 ceph-mon[30956]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:35.716 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:35 smithi018 ceph-mon[30956]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-19T09:44:35.717 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:44:35.717 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:35.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-mon[34858]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:35.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-mon[34858]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-19T09:44:35.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:44:35.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:35 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:35.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:35 smithi162 ceph-mon[35174]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:35.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:35 smithi162 ceph-mon[35174]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-19T09:44:35.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:35 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:44:35.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:35 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:36.646 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 09:44:36 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y[36254]: 2024-09-19T09:44:36.383+0000 7fd18ac6d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:44:36.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:36 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2546503833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "703e518f-f9d8-41f1-84cb-2d8dfe53c98c"}]: dispatch 2024-09-19T09:44:36.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:36 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2546503833' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "703e518f-f9d8-41f1-84cb-2d8dfe53c98c"}]': finished 2024-09-19T09:44:36.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:36 smithi049 ceph-mon[34858]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:44:36.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:36 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:44:36.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:36 smithi049 ceph-mon[34858]: Standby manager daemon y started 2024-09-19T09:44:36.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:36 smithi049 ceph-mon[34858]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:44:36.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:36 smithi049 ceph-mon[34858]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:44:36.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:36 smithi049 ceph-mon[34858]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:44:36.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:36 smithi049 ceph-mon[34858]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:44:36.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:36 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2546503833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "703e518f-f9d8-41f1-84cb-2d8dfe53c98c"}]: dispatch 2024-09-19T09:44:36.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:36 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2546503833' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "703e518f-f9d8-41f1-84cb-2d8dfe53c98c"}]': finished 2024-09-19T09:44:36.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:36 smithi162 ceph-mon[35174]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:44:36.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:36 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:44:36.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:36 smithi162 ceph-mon[35174]: Standby manager daemon y started 2024-09-19T09:44:36.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:36 smithi162 ceph-mon[35174]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:44:36.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:36 smithi162 ceph-mon[35174]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:44:36.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:36 smithi162 ceph-mon[35174]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:44:36.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:36 smithi162 ceph-mon[35174]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:44:37.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:36 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2546503833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "703e518f-f9d8-41f1-84cb-2d8dfe53c98c"}]: dispatch 2024-09-19T09:44:37.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:36 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2546503833' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "703e518f-f9d8-41f1-84cb-2d8dfe53c98c"}]': finished 2024-09-19T09:44:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:36 smithi018 ceph-mon[30956]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:44:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:36 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:44:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:36 smithi018 ceph-mon[30956]: Standby manager daemon y started 2024-09-19T09:44:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:36 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:44:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:36 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:44:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:36 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:44:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:36 smithi018 ceph-mon[30956]: from='mgr.? 172.21.15.49:0/3396524964' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:44:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:37.167+0000 7fc3c97fa640 1 -- 172.21.15.18:0/397124839 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fc3b4010b70 con 0x7fc3cc104ff0 2024-09-19T09:44:37.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:37 smithi049 ceph-mon[34858]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:37.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:37 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/533645979' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:44:37.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:37 smithi049 ceph-mon[34858]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T09:44:37.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:37 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:44:37.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:37 smithi162 ceph-mon[35174]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:37.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:37 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/533645979' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:44:37.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:37 smithi162 ceph-mon[35174]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T09:44:37.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:37 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:44:38.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:37 smithi018 ceph-mon[30956]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:38.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:37 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/533645979' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:44:38.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:37 smithi018 ceph-mon[30956]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T09:44:38.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:44:39.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:39 smithi049 ceph-mon[34858]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:39.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:39 smithi162 ceph-mon[35174]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:40.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:39 smithi018 ceph-mon[30956]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:41.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:41 smithi018 ceph-mon[30956]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:41.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:41 smithi162 ceph-mon[35174]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:41.987 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:41 smithi049 ceph-mon[34858]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:43.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:43 smithi018 ceph-mon[30956]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:43.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:43 smithi162 ceph-mon[35174]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:44.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:43 smithi049 ceph-mon[34858]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:44.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:44:44.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:44.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:44 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:44:44.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:44 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:45.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:44 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:44:45.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:44 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:45.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:45 smithi162 ceph-mon[35174]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:45.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:45 smithi162 ceph-mon[35174]: Deploying daemon osd.0 on smithi018 2024-09-19T09:44:45.939 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:45 smithi018 ceph-mon[30956]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:45.939 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:45 smithi018 ceph-mon[30956]: Deploying daemon osd.0 on smithi018 2024-09-19T09:44:46.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:45 smithi049 ceph-mon[34858]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:46.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:45 smithi049 ceph-mon[34858]: Deploying daemon osd.0 on smithi018 2024-09-19T09:44:47.988 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:47 smithi018 ceph-mon[30956]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:48.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:47 smithi049 ceph-mon[34858]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:48.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:47 smithi162 ceph-mon[35174]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:50.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:49 smithi018 ceph-mon[30956]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:50.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:49 smithi049 ceph-mon[34858]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:50.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:49 smithi162 ceph-mon[35174]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:52.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:51 smithi018 ceph-mon[30956]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:52.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:52.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:52.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:52.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:51 smithi049 ceph-mon[34858]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:52.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:52.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:52.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:52.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:51 smithi162 ceph-mon[35174]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:54.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:54 smithi018 ceph-mon[30956]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:54.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:54.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:54.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:54.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:54.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:54 smithi049 ceph-mon[34858]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:54 smithi162 ceph-mon[35174]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:55.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.248+0000 7fc3c97fa640 1 -- 172.21.15.18:0/397124839 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc3cc062630 con 0x7fc3b8039500 2024-09-19T09:44:55.250 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 0 on host 'smithi018' 2024-09-19T09:44:55.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 -- 172.21.15.18:0/397124839 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3b8039500 msgr2=0x7fc3b803b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3b8039500 0x7fc3b803b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009fc0 tx=0x7fc3bc005f90 comp rx=0 tx=0).stop 2024-09-19T09:44:55.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 -- 172.21.15.18:0/397124839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc104ff0 msgr2=0x7fc3cc198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:55.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc104ff0 0x7fc3cc198400 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400d740 tx=0x7fc3b400dc00 comp rx=0 tx=0).stop 2024-09-19T09:44:55.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 -- 172.21.15.18:0/397124839 shutdown_connections 2024-09-19T09:44:55.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3b8039500 0x7fc3b803b9c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc107920 0x7fc3cc19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc104ff0 0x7fc3cc198400 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 --2- 172.21.15.18:0/397124839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc1026c0 0x7fc3cc197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:55.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 -- 172.21.15.18:0/397124839 >> 172.21.15.18:0/397124839 conn(0x7fc3cc0fc280 msgr2=0x7fc3cc102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:55.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 -- 172.21.15.18:0/397124839 shutdown_connections 2024-09-19T09:44:55.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:44:55.250+0000 7fc3d1e59640 1 -- 172.21.15.18:0/397124839 wait complete. 2024-09-19T09:44:55.877 DEBUG:teuthology.orchestra.run.smithi018:osd.0> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T09:44:55.880 INFO:tasks.cephadm:Deploying osd.1 on smithi049 with /dev/vg_nvme/lv_4... 2024-09-19T09:44:55.880 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:44:56.143 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:44:56.258 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:56 smithi049 ceph-mon[34858]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:56.258 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:56 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:56.258 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:56 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:56.258 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:56 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:56.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:56 smithi018 ceph-mon[30956]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:56.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:56.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:56.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:56.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:56 smithi162 ceph-mon[35174]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:56.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:56 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:56.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:56 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:56.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:56 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:57.385 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:44:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0[44812]: 2024-09-19T09:44:57.265+0000 7f7e523c8640 -1 osd.0 0 log_to_monitors true 2024-09-19T09:44:58.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:58 smithi018 ceph-mon[30956]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:58.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:58 smithi018 ceph-mon[30956]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:44:58.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:58 smithi049 ceph-mon[34858]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:58.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:58 smithi049 ceph-mon[34858]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:44:58.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:58 smithi162 ceph-mon[35174]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:44:58.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:58 smithi162 ceph-mon[35174]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:44:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:44:58.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_4 2024-09-19T09:44:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:44:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.233+0000 7f8e76a99640 1 -- 172.21.15.49:0/841571119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70101c00 msgr2=0x7f8e70102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.233+0000 7f8e76a99640 1 --2- 172.21.15.49:0/841571119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70101c00 0x7f8e70102000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009900 tx=0x7f8e6402a410 comp rx=0 tx=0).stop 2024-09-19T09:44:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.233+0000 7f8e76a99640 1 -- 172.21.15.49:0/841571119 shutdown_connections 2024-09-19T09:44:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.233+0000 7f8e76a99640 1 --2- 172.21.15.49:0/841571119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e701037c0 0x7f8e7010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.233+0000 7f8e76a99640 1 --2- 172.21.15.49:0/841571119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e70102e00 0x7f8e70103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.233+0000 7f8e76a99640 1 --2- 172.21.15.49:0/841571119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70101c00 0x7f8e70102000 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.233+0000 7f8e76a99640 1 -- 172.21.15.49:0/841571119 >> 172.21.15.49:0/841571119 conn(0x7f8e700fd390 msgr2=0x7f8e700ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.233+0000 7f8e76a99640 1 -- 172.21.15.49:0/841571119 shutdown_connections 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.233+0000 7f8e76a99640 1 -- 172.21.15.49:0/841571119 wait complete. 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e76a99640 1 Processor -- start 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e76a99640 1 -- start start 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e76a99640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70101c00 0x7f8e70197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e76a99640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e70102e00 0x7f8e701983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e76a99640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e701037c0 0x7f8e7019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e74835640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70101c00 0x7f8e70197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e74835640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70101c00 0x7f8e70197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55810/0 (socket says 172.21.15.49:55810) 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e74835640 1 -- 172.21.15.49:0/2074418591 learned_addr learned my addr 172.21.15.49:0/2074418591 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:44:59.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7010d890 con 0x7f8e701037c0 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7010d710 con 0x7f8e70101c00 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e6ffff640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e70102e00 0x7f8e701983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.234+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7010da10 con 0x7f8e70102e00 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e75036640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e701037c0 0x7f8e7019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e6ffff640 1 -- 172.21.15.49:0/2074418591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70101c00 msgr2=0x7f8e70197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e6ffff640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70101c00 0x7f8e70197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e6ffff640 1 -- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e701037c0 msgr2=0x7f8e7019f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e6ffff640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e701037c0 0x7f8e7019f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e6ffff640 1 -- 172.21.15.49:0/2074418591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7019fac0 con 0x7f8e70102e00 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e75036640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e701037c0 0x7f8e7019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e74835640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70101c00 0x7f8e70197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e6ffff640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e70102e00 0x7f8e701983d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00c970 tx=0x7f8e5c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e6dffb640 1 -- 172.21.15.49:0/2074418591 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c007bb0 con 0x7f8e70102e00 2024-09-19T09:44:59.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e6dffb640 1 -- 172.21.15.49:0/2074418591 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e5c007d50 con 0x7f8e70102e00 2024-09-19T09:44:59.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7019fdb0 con 0x7f8e70102e00 2024-09-19T09:44:59.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.235+0000 7f8e6dffb640 1 -- 172.21.15.49:0/2074418591 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c018820 con 0x7f8e70102e00 2024-09-19T09:44:59.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.236+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e701a0260 con 0x7f8e70102e00 2024-09-19T09:44:59.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.237+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e70108fb0 con 0x7f8e70102e00 2024-09-19T09:44:59.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.238+0000 7f8e6dffb640 1 -- 172.21.15.49:0/2074418591 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f8e5c018a40 con 0x7f8e70102e00 2024-09-19T09:44:59.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.239+0000 7f8e6dffb640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8e600a31e0 0x7f8e600a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:59.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.239+0000 7f8e6dffb640 1 -- 172.21.15.49:0/2074418591 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f8e5c0ce310 con 0x7f8e70102e00 2024-09-19T09:44:59.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.239+0000 7f8e74835640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8e600a31e0 0x7f8e600a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:59.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.240+0000 7f8e74835640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8e600a31e0 0x7f8e600a56a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8e64000c00 tx=0x7f8e640046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:59.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.242+0000 7f8e6dffb640 1 -- 172.21.15.49:0/2074418591 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e5c014030 con 0x7f8e70102e00 2024-09-19T09:44:59.385 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0[44812]: 2024-09-19T09:44:59.129+0000 7f7e4db28640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T09:44:59.385 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0[44812]: 2024-09-19T09:44:59.133+0000 7f7e4a162640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:44:59.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:44:59.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:44:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:44:59.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:44:59.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:44:59.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:44:59.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:44:59.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:59.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:44:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:44:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:44:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:44:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:44:59.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:44:59.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:44:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:44:59.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:44:59.445+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8e70062630 con 0x7f8e600a31e0 2024-09-19T09:45:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:00 smithi049 ceph-mon[34858]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:45:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:00 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi018 2024-09-19T09:45:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:00 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-19T09:45:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:45:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:45:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:45:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:45:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:00 smithi162 ceph-mon[35174]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:45:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:00 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi018 2024-09-19T09:45:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:00 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-19T09:45:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:45:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:45:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:45:00.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:00.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:45:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:00 smithi018 ceph-mon[30956]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:45:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:00 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi018 2024-09-19T09:45:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:00 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-19T09:45:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:45:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:45:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:45:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:45:01.384 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:01 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:45:01.385 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:01 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:45:01.385 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:01 smithi049 ceph-mon[34858]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:01.385 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:01 smithi049 ceph-mon[34858]: osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] boot 2024-09-19T09:45:01.385 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:01 smithi049 ceph-mon[34858]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:45:01.385 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:01 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:45:01.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:01 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:45:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:01 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:45:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:01 smithi162 ceph-mon[35174]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:01 smithi162 ceph-mon[35174]: osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] boot 2024-09-19T09:45:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:01 smithi162 ceph-mon[35174]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:45:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:01 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:45:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:01 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:45:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:01 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:45:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:01 smithi018 ceph-mon[30956]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:01 smithi018 ceph-mon[30956]: osd.0 [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] boot 2024-09-19T09:45:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:01 smithi018 ceph-mon[30956]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:45:01.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:01 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:45:02.253 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:02 smithi049 ceph-mon[34858]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:45:02.254 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:02 smithi049 ceph-mon[34858]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:45:02.254 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:02 smithi049 ceph-mon[34858]: from='client.? 172.21.15.49:0/1050339086' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5783af38-5921-4147-964c-d4a3f4f81ff6"}]: dispatch 2024-09-19T09:45:02.254 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:02 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5783af38-5921-4147-964c-d4a3f4f81ff6"}]: dispatch 2024-09-19T09:45:02.254 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:02 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5783af38-5921-4147-964c-d4a3f4f81ff6"}]': finished 2024-09-19T09:45:02.254 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:02 smithi049 ceph-mon[34858]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:45:02.254 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:02 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:02 smithi162 ceph-mon[35174]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:45:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:02 smithi162 ceph-mon[35174]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:45:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:02 smithi162 ceph-mon[35174]: from='client.? 172.21.15.49:0/1050339086' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5783af38-5921-4147-964c-d4a3f4f81ff6"}]: dispatch 2024-09-19T09:45:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:02 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5783af38-5921-4147-964c-d4a3f4f81ff6"}]: dispatch 2024-09-19T09:45:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:02 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5783af38-5921-4147-964c-d4a3f4f81ff6"}]': finished 2024-09-19T09:45:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:02 smithi162 ceph-mon[35174]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:45:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:02 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:02 smithi018 ceph-mon[30956]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:45:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:02 smithi018 ceph-mon[30956]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:45:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:02 smithi018 ceph-mon[30956]: from='client.? 172.21.15.49:0/1050339086' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5783af38-5921-4147-964c-d4a3f4f81ff6"}]: dispatch 2024-09-19T09:45:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:02 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5783af38-5921-4147-964c-d4a3f4f81ff6"}]: dispatch 2024-09-19T09:45:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:02 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5783af38-5921-4147-964c-d4a3f4f81ff6"}]': finished 2024-09-19T09:45:02.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:02 smithi018 ceph-mon[30956]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:45:02.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:02 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:03.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:03 smithi162 ceph-mon[35174]: from='client.? 172.21.15.49:0/482196916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:45:03.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:03 smithi018 ceph-mon[30956]: from='client.? 172.21.15.49:0/482196916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:45:03.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:03 smithi049 ceph-mon[34858]: from='client.? 172.21.15.49:0/482196916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:45:04.408 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:04 smithi018 ceph-mon[30956]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:04.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:04 smithi162 ceph-mon[35174]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:04.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:04 smithi049 ceph-mon[34858]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:06.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:06 smithi162 ceph-mon[35174]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:06.479 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:06 smithi049 ceph-mon[34858]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:06.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:06 smithi018 ceph-mon[30956]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:08.314 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:08 smithi049 ceph-mon[34858]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:08.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:08 smithi162 ceph-mon[35174]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:08.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:08 smithi018 ceph-mon[30956]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:10 smithi049 ceph-mon[34858]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:10 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:45:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:10 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:10 smithi162 ceph-mon[35174]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:45:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:10.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:10 smithi018 ceph-mon[30956]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:10.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:45:10.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:11.529 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:11 smithi049 ceph-mon[34858]: Deploying daemon osd.1 on smithi049 2024-09-19T09:45:11.585 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:11 smithi162 ceph-mon[35174]: Deploying daemon osd.1 on smithi049 2024-09-19T09:45:11.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:11 smithi018 ceph-mon[30956]: Deploying daemon osd.1 on smithi049 2024-09-19T09:45:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:12 smithi049 ceph-mon[34858]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:12.537 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:12 smithi162 ceph-mon[35174]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:12.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:12 smithi018 ceph-mon[30956]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:14.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:14 smithi018 ceph-mon[30956]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:14.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:14 smithi049 ceph-mon[34858]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:14.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:14 smithi162 ceph-mon[35174]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:16.356 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:16 smithi049 ceph-mon[34858]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:16.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:16 smithi018 ceph-mon[30956]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:16.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:16 smithi162 ceph-mon[35174]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:17.366 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:17.366 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:17.366 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:17.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:18.513 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:18 smithi049 ceph-mon[34858]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:18 smithi018 ceph-mon[30956]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:18.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:18 smithi162 ceph-mon[35174]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:20 smithi049 ceph-mon[34858]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:20 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:20 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:20 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:20 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:20 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:20.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:20 smithi018 ceph-mon[30956]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:20.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:20.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:20.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:20.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:20.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:20.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:20 smithi162 ceph-mon[35174]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:20.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:20.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:20.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:20.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:20.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:20.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.886+0000 7f8e6dffb640 1 -- 172.21.15.49:0/2074418591 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8e70062630 con 0x7f8e600a31e0 2024-09-19T09:45:20.889 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 1 on host 'smithi049' 2024-09-19T09:45:20.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8e600a31e0 msgr2=0x7f8e600a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:20.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8e600a31e0 0x7f8e600a56a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8e64000c00 tx=0x7f8e640046c0 comp rx=0 tx=0).stop 2024-09-19T09:45:20.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e70102e00 msgr2=0x7f8e701983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:20.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e70102e00 0x7f8e701983d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00c970 tx=0x7f8e5c00ce30 comp rx=0 tx=0).stop 2024-09-19T09:45:20.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 shutdown_connections 2024-09-19T09:45:20.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8e600a31e0 0x7f8e600a56a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:20.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e701037c0 0x7f8e7019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:20.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e70102e00 0x7f8e701983d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:20.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 --2- 172.21.15.49:0/2074418591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e70101c00 0x7f8e70197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:20.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 >> 172.21.15.49:0/2074418591 conn(0x7f8e700fd390 msgr2=0x7f8e70106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:20.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 shutdown_connections 2024-09-19T09:45:20.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:45:20.889+0000 7f8e76a99640 1 -- 172.21.15.49:0/2074418591 wait complete. 2024-09-19T09:45:21.465 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:21.466 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:21.466 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:21.494 DEBUG:teuthology.orchestra.run.smithi049:osd.1> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T09:45:21.496 INFO:tasks.cephadm:Deploying osd.2 on smithi162 with /dev/vg_nvme/lv_4... 2024-09-19T09:45:21.497 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:45:21.525 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:21.525 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:21.525 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:21.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:21.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:21.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:21.751 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:45:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:22 smithi049 ceph-mon[34858]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:22.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:22 smithi162 ceph-mon[35174]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:22.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:22 smithi018 ceph-mon[30956]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:22.987 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:22 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1[39373]: 2024-09-19T09:45:22.863+0000 7f12c1507640 -1 osd.1 0 log_to_monitors true 2024-09-19T09:45:23.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:23 smithi049 ceph-mon[34858]: from='osd.1 [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:45:23.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:23 smithi049 ceph-mon[34858]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:45:23.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:23 smithi162 ceph-mon[35174]: from='osd.1 [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:45:23.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:23 smithi162 ceph-mon[35174]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:45:23.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:23 smithi018 ceph-mon[30956]: from='osd.1 [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:45:23.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:23 smithi018 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:45:24.330 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:24 smithi162 ceph-mon[35174]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:24.330 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:24 smithi162 ceph-mon[35174]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:45:24.330 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:24 smithi162 ceph-mon[35174]: from='osd.1 [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:45:24.330 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:24 smithi162 ceph-mon[35174]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:45:24.330 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:24 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:24.330 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:24 smithi162 ceph-mon[35174]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:45:24.333 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:45:24.359 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-09-19T09:45:24.362 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:24 smithi049 ceph-mon[34858]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:24.362 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:24 smithi049 ceph-mon[34858]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:45:24.362 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:24 smithi049 ceph-mon[34858]: from='osd.1 [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:45:24.362 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:24 smithi049 ceph-mon[34858]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:45:24.362 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:24 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:24.362 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:24 smithi049 ceph-mon[34858]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:45:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:24 smithi018 ceph-mon[30956]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:24 smithi018 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:45:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:24 smithi018 ceph-mon[30956]: from='osd.1 [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:45:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:24 smithi018 ceph-mon[30956]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:45:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:24 smithi018 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:45:24.651 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:45:25.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.151+0000 7f5eb21b6640 1 -- 172.21.15.162:0/3805173583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eac101cd0 msgr2=0x7f5eac102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:25.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.151+0000 7f5eb21b6640 1 --2- 172.21.15.162:0/3805173583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eac101cd0 0x7f5eac102150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009900 tx=0x7f5e9402a410 comp rx=0 tx=0).stop 2024-09-19T09:45:25.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.151+0000 7f5eb21b6640 1 -- 172.21.15.162:0/3805173583 shutdown_connections 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.151+0000 7f5eb21b6640 1 --2- 172.21.15.162:0/3805173583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eac102690 0x7f5eac108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.151+0000 7f5eb21b6640 1 --2- 172.21.15.162:0/3805173583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eac101cd0 0x7f5eac102150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.151+0000 7f5eb21b6640 1 --2- 172.21.15.162:0/3805173583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac100ad0 0x7f5eac100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.151+0000 7f5eb21b6640 1 -- 172.21.15.162:0/3805173583 >> 172.21.15.162:0/3805173583 conn(0x7f5eac0fc280 msgr2=0x7f5eac0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.151+0000 7f5eb21b6640 1 -- 172.21.15.162:0/3805173583 shutdown_connections 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.151+0000 7f5eb21b6640 1 -- 172.21.15.162:0/3805173583 wait complete. 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eb21b6640 1 Processor -- start 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eb21b6640 1 -- start start 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eb21b6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac100ad0 0x7f5eac197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eb21b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eac101cd0 0x7f5eac1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eb21b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eac102690 0x7f5eac19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eb21b6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac10c800 con 0x7f5eac100ad0 2024-09-19T09:45:25.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eb21b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac10c680 con 0x7f5eac101cd0 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eb21b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac10c980 con 0x7f5eac102690 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eabfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eac102690 0x7f5eac19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eabfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eac102690 0x7f5eac19f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:38018/0 (socket says 172.21.15.162:38018) 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eabfff640 1 -- 172.21.15.162:0/4131604026 learned_addr learned my addr 172.21.15.162:0/4131604026 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5ea3fff640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eac101cd0 0x7f5eac1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eab7fe640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac100ad0 0x7f5eac197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eabfff640 1 -- 172.21.15.162:0/4131604026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eac101cd0 msgr2=0x7f5eac1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eabfff640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eac101cd0 0x7f5eac1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eabfff640 1 -- 172.21.15.162:0/4131604026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac100ad0 msgr2=0x7f5eac197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eabfff640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac100ad0 0x7f5eac197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:25.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eabfff640 1 -- 172.21.15.162:0/4131604026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eac19fbb0 con 0x7f5eac102690 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5eabfff640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eac102690 0x7f5eac19f540 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400eaa0 tx=0x7f5ea400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5ea97fa640 1 -- 172.21.15.162:0/4131604026 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400cdb0 con 0x7f5eac102690 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.152+0000 7f5ea97fa640 1 -- 172.21.15.162:0/4131604026 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea4005020 con 0x7f5eac102690 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.153+0000 7f5eb21b6640 1 -- 172.21.15.162:0/4131604026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eac19fea0 con 0x7f5eac102690 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.153+0000 7f5ea97fa640 1 -- 172.21.15.162:0/4131604026 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40116b0 con 0x7f5eac102690 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.153+0000 7f5eb21b6640 1 -- 172.21.15.162:0/4131604026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eac1a03d0 con 0x7f5eac102690 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.154+0000 7f5eb21b6640 1 -- 172.21.15.162:0/4131604026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eac1a0660 con 0x7f5eac102690 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.155+0000 7f5ea97fa640 1 -- 172.21.15.162:0/4131604026 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f5ea4005560 con 0x7f5eac102690 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.155+0000 7f5ea97fa640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5e980a31e0 0x7f5e980a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.155+0000 7f5ea97fa640 1 -- 172.21.15.162:0/4131604026 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f5ea40ce190 con 0x7f5eac102690 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.155+0000 7f5eab7fe640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5e980a31e0 0x7f5e980a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:25.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.156+0000 7f5eab7fe640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5e980a31e0 0x7f5e980a56a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5eac101b30 tx=0x7f5e9c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:25.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.160+0000 7f5ea97fa640 1 -- 172.21.15.162:0/4131604026 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ea4016030 con 0x7f5eac102690 2024-09-19T09:45:25.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:25.345+0000 7f5eb21b6640 1 -- 172.21.15.162:0/4131604026 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5eac1a0830 con 0x7f5e980a31e0 2024-09-19T09:45:25.400 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:24 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1[39373]: 2024-09-19T09:45:24.975+0000 7f12bcc67640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T09:45:25.400 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:24 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1[39373]: 2024-09-19T09:45:24.978+0000 7f12b5299640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:45:25.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:45:25.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:45:25.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:25.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:25.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:25.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:25.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:25.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:25 smithi049 ceph-mon[34858]: from='osd.1 ' entity='osd.1' 2024-09-19T09:45:25.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:45:25.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:45:25.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:25.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:25.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:25.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:25.537 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:25.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.538 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:25 smithi018 ceph-mon[30956]: from='osd.1 ' entity='osd.1' 2024-09-19T09:45:25.629 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:45:25.630 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:45:25.630 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:25.630 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:25.630 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.630 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.630 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:25.630 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.630 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:25.630 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:25.630 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:25.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:25 smithi162 ceph-mon[35174]: from='osd.1 ' entity='osd.1' 2024-09-19T09:45:26.581 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:45:26.581 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:45:26.581 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:26.581 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi049 2024-09-19T09:45:26.581 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi049 to 17088M 2024-09-19T09:45:26.581 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:26.582 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:45:26.582 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:45:26.582 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:26.582 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: osd.1 [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] boot 2024-09-19T09:45:26.582 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T09:45:26.582 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:45:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:45:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi049 2024-09-19T09:45:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi049 to 17088M 2024-09-19T09:45:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:26.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:45:26.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:45:26.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:26.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: osd.1 [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] boot 2024-09-19T09:45:26.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T09:45:26.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:45:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:45:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:45:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi049 2024-09-19T09:45:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi049 to 17088M 2024-09-19T09:45:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:26.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:45:26.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:45:26.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:26.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: osd.1 [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] boot 2024-09-19T09:45:26.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T09:45:26.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:45:27.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:27 smithi018 ceph-mon[30956]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:27.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:27 smithi049 ceph-mon[34858]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:27.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:27 smithi162 ceph-mon[35174]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:28 smithi162 ceph-mon[35174]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:28 smithi162 ceph-mon[35174]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T09:45:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:28 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/695650600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8"}]: dispatch 2024-09-19T09:45:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:28 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8"}]: dispatch 2024-09-19T09:45:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:28 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8"}]': finished 2024-09-19T09:45:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:28 smithi162 ceph-mon[35174]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:45:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:28 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:28 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/1110463978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:45:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:28 smithi018 ceph-mon[30956]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:28 smithi018 ceph-mon[30956]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T09:45:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:28 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/695650600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8"}]: dispatch 2024-09-19T09:45:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:28 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8"}]: dispatch 2024-09-19T09:45:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:28 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8"}]': finished 2024-09-19T09:45:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:28 smithi018 ceph-mon[30956]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:45:28.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:28.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:28 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1110463978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:45:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:28 smithi049 ceph-mon[34858]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:28 smithi049 ceph-mon[34858]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T09:45:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:28 smithi049 ceph-mon[34858]: from='client.? 172.21.15.162:0/695650600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8"}]: dispatch 2024-09-19T09:45:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:28 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8"}]: dispatch 2024-09-19T09:45:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:28 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8"}]': finished 2024-09-19T09:45:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:28 smithi049 ceph-mon[34858]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:45:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:28 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:28 smithi049 ceph-mon[34858]: from='client.? 172.21.15.162:0/1110463978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:45:30.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:30 smithi018 ceph-mon[30956]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:30.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:30 smithi049 ceph-mon[34858]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:30.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:30 smithi162 ceph-mon[35174]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:32.600 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:32 smithi162 ceph-mon[35174]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:32.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:32 smithi018 ceph-mon[30956]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:32.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:32 smithi049 ceph-mon[34858]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:34.309 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:34 smithi162 ceph-mon[35174]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:34.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:34 smithi018 ceph-mon[30956]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:34.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:34 smithi049 ceph-mon[34858]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:36 smithi162 ceph-mon[35174]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:36 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:45:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:36 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:36.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:36 smithi018 ceph-mon[30956]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:36.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:36 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:45:36.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:36 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:36 smithi049 ceph-mon[34858]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:36 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:45:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:36 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:37.441 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:37 smithi162 ceph-mon[35174]: Deploying daemon osd.2 on smithi162 2024-09-19T09:45:37.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:37 smithi018 ceph-mon[30956]: Deploying daemon osd.2 on smithi162 2024-09-19T09:45:37.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:37 smithi049 ceph-mon[34858]: Deploying daemon osd.2 on smithi162 2024-09-19T09:45:38.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:38 smithi162 ceph-mon[35174]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:38.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:38 smithi018 ceph-mon[30956]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:38.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:38 smithi049 ceph-mon[34858]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:40.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:40 smithi018 ceph-mon[30956]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:40 smithi049 ceph-mon[34858]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:40 smithi162 ceph-mon[35174]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:42.323 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:42 smithi162 ceph-mon[35174]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:42.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:42 smithi018 ceph-mon[30956]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:42.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:42 smithi049 ceph-mon[34858]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:43.380 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:43 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:43.380 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:43 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:43.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:43 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:43.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:43.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:43.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:43.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:43 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:43.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:43 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:43.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:43 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:44.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:44 smithi162 ceph-mon[35174]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:44.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:44 smithi018 ceph-mon[30956]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:44.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:44 smithi049 ceph-mon[34858]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:45 smithi018 ceph-mon[30956]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:46.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:45 smithi049 ceph-mon[34858]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:46.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:46.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:45 smithi162 ceph-mon[35174]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:46.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.814+0000 7f5ea97fa640 1 -- 172.21.15.162:0/4131604026 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5eac1a0830 con 0x7f5e980a31e0 2024-09-19T09:45:46.818 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 2 on host 'smithi162' 2024-09-19T09:45:46.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 -- 172.21.15.162:0/4131604026 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5e980a31e0 msgr2=0x7f5e980a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:46.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5e980a31e0 0x7f5e980a56a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5eac101b30 tx=0x7f5e9c008040 comp rx=0 tx=0).stop 2024-09-19T09:45:46.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 -- 172.21.15.162:0/4131604026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eac102690 msgr2=0x7f5eac19f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:46.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eac102690 0x7f5eac19f540 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400eaa0 tx=0x7f5ea400ef60 comp rx=0 tx=0).stop 2024-09-19T09:45:46.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 -- 172.21.15.162:0/4131604026 shutdown_connections 2024-09-19T09:45:46.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5e980a31e0 0x7f5e980a56a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:46.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eac102690 0x7f5eac19f540 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:46.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5eac101cd0 0x7f5eac1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:46.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 --2- 172.21.15.162:0/4131604026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac100ad0 0x7f5eac197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:46.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 -- 172.21.15.162:0/4131604026 >> 172.21.15.162:0/4131604026 conn(0x7f5eac0fc280 msgr2=0x7f5eac06a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:46.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 -- 172.21.15.162:0/4131604026 shutdown_connections 2024-09-19T09:45:46.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:45:46.818+0000 7f5eb21b6640 1 -- 172.21.15.162:0/4131604026 wait complete. 2024-09-19T09:45:47.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:47.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:47.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:47.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:47.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:47.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:47.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:47.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:47.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:47.481 DEBUG:teuthology.orchestra.run.smithi162:osd.2> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T09:45:47.483 INFO:tasks.cephadm:Deploying osd.3 on smithi018 with /dev/vg_nvme/lv_3... 2024-09-19T09:45:47.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:45:47.751 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:45:48.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:47 smithi018 ceph-mon[30956]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:48.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:47 smithi162 ceph-mon[35174]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:47 smithi049 ceph-mon[34858]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:49.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:48 smithi162 ceph-mon[35174]: from='osd.2 [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:45:49.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:48 smithi162 ceph-mon[35174]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:45:49.163 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2[40216]: 2024-09-19T09:45:48.869+0000 7f2deb2f8640 -1 osd.2 0 log_to_monitors true 2024-09-19T09:45:49.372 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:48 smithi018 ceph-mon[30956]: from='osd.2 [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:45:49.372 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:48 smithi018 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:45:49.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:48 smithi049 ceph-mon[34858]: from='osd.2 [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:45:49.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:48 smithi049 ceph-mon[34858]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:45:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:45:50.105 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_3 2024-09-19T09:45:50.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:49 smithi018 ceph-mon[30956]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:50.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:49 smithi018 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:45:50.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:49 smithi018 ceph-mon[30956]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:45:50.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:50.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:49 smithi018 ceph-mon[30956]: from='osd.2 [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:45:50.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:49 smithi018 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:45:50.163 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2[40216]: 2024-09-19T09:45:49.972+0000 7f2de6a58640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T09:45:50.163 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2[40216]: 2024-09-19T09:45:49.975+0000 7f2de3092640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:45:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:49 smithi162 ceph-mon[35174]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:49 smithi162 ceph-mon[35174]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:45:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:49 smithi162 ceph-mon[35174]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:45:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:49 smithi162 ceph-mon[35174]: from='osd.2 [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:45:50.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:49 smithi162 ceph-mon[35174]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:45:50.390 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:45:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:49 smithi049 ceph-mon[34858]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:49 smithi049 ceph-mon[34858]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:45:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:49 smithi049 ceph-mon[34858]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:45:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:49 smithi049 ceph-mon[34858]: from='osd.2 [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:45:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:49 smithi049 ceph-mon[34858]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:45:50.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.855+0000 7f9946511640 1 -- 172.21.15.18:0/2640929868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9940100ad0 msgr2=0x7f9940100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:50.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.855+0000 7f9946511640 1 --2- 172.21.15.18:0/2640929868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9940100ad0 0x7f9940100ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9930009900 tx=0x7f993002a410 comp rx=0 tx=0).stop 2024-09-19T09:45:50.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.855+0000 7f9946511640 1 -- 172.21.15.18:0/2640929868 shutdown_connections 2024-09-19T09:45:50.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.855+0000 7f9946511640 1 --2- 172.21.15.18:0/2640929868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940102690 0x7f9940108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:50.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.855+0000 7f9946511640 1 --2- 172.21.15.18:0/2640929868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9940101cd0 0x7f9940102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.855+0000 7f9946511640 1 --2- 172.21.15.18:0/2640929868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9940100ad0 0x7f9940100ed0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.855+0000 7f9946511640 1 -- 172.21.15.18:0/2640929868 >> 172.21.15.18:0/2640929868 conn(0x7f99400fc280 msgr2=0x7f99400fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.855+0000 7f9946511640 1 -- 172.21.15.18:0/2640929868 shutdown_connections 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.855+0000 7f9946511640 1 -- 172.21.15.18:0/2640929868 wait complete. 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f9946511640 1 Processor -- start 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f9946511640 1 -- start start 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f9946511640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9940100ad0 0x7f994006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f9946511640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9940101cd0 0x7f994019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f9946511640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940102690 0x7f994019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f9946511640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f994010c830 con 0x7f9940100ad0 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f9946511640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f994010c6b0 con 0x7f9940102690 2024-09-19T09:45:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f9946511640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f994010c9b0 con 0x7f9940101cd0 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f993ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9940100ad0 0x7f994006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f993ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9940100ad0 0x7f994006aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42114/0 (socket says 172.21.15.18:42114) 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f993ffff640 1 -- 172.21.15.18:0/2672058205 learned_addr learned my addr 172.21.15.18:0/2672058205 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f9937fff640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9940101cd0 0x7f994019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.856+0000 7f9944aae640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940102690 0x7f994019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f993ffff640 1 -- 172.21.15.18:0/2672058205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9940101cd0 msgr2=0x7f994019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f993ffff640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9940101cd0 0x7f994019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f993ffff640 1 -- 172.21.15.18:0/2672058205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940102690 msgr2=0x7f994019f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f993ffff640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940102690 0x7f994019f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f993ffff640 1 -- 172.21.15.18:0/2672058205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9940196bd0 con 0x7f9940100ad0 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f993ffff640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9940100ad0 0x7f994006aad0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9930031610 tx=0x7f993003ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f993dffb640 1 -- 172.21.15.18:0/2672058205 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993004c070 con 0x7f9940100ad0 2024-09-19T09:45:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f9946511640 1 -- 172.21.15.18:0/2672058205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9940196e00 con 0x7f9940100ad0 2024-09-19T09:45:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f993dffb640 1 -- 172.21.15.18:0/2672058205 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9930004250 con 0x7f9940100ad0 2024-09-19T09:45:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f993dffb640 1 -- 172.21.15.18:0/2672058205 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930035050 con 0x7f9940100ad0 2024-09-19T09:45:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.857+0000 7f9946511640 1 -- 172.21.15.18:0/2672058205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99401973b0 con 0x7f9940100ad0 2024-09-19T09:45:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.858+0000 7f9946511640 1 -- 172.21.15.18:0/2672058205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994002d7c0 con 0x7f9940100ad0 2024-09-19T09:45:50.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.860+0000 7f993dffb640 1 -- 172.21.15.18:0/2672058205 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f993004f070 con 0x7f9940100ad0 2024-09-19T09:45:50.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.861+0000 7f993dffb640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f992c0a31b0 0x7f992c0a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:50.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.861+0000 7f9937fff640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f992c0a31b0 0x7f992c0a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:50.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.861+0000 7f993dffb640 1 -- 172.21.15.18:0/2672058205 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f99300f65c0 con 0x7f9940100ad0 2024-09-19T09:45:50.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.861+0000 7f9937fff640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f992c0a31b0 0x7f992c0a5670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f994006b050 tx=0x7f9928009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:50.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:50.863+0000 7f993dffb640 1 -- 172.21.15.18:0/2672058205 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9930084210 con 0x7f9940100ad0 2024-09-19T09:45:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:51.051+0000 7f9946511640 1 -- 172.21.15.18:0/2672058205 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9940107b50 con 0x7f992c0a31b0 2024-09-19T09:45:51.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:45:51.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T09:45:51.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:51.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:51.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi162 2024-09-19T09:45:51.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:51.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-19T09:45:51.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:51.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:51.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:45:51.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T09:45:51.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:51.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi162 2024-09-19T09:45:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-19T09:45:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi162 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:51.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:51.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:52.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:51 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:45:52.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:51 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:45:52.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:51 smithi018 ceph-mon[30956]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:52.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:51 smithi018 ceph-mon[30956]: osd.2 [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] boot 2024-09-19T09:45:52.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:51 smithi018 ceph-mon[30956]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T09:45:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:51 smithi018 ceph-mon[30956]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:45:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:45:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:51 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:45:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:51 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:45:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:51 smithi049 ceph-mon[34858]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:51 smithi049 ceph-mon[34858]: osd.2 [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] boot 2024-09-19T09:45:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:51 smithi049 ceph-mon[34858]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T09:45:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:51 smithi049 ceph-mon[34858]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:45:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:45:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:51 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:45:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:51 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:45:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:51 smithi162 ceph-mon[35174]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:45:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:51 smithi162 ceph-mon[35174]: osd.2 [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] boot 2024-09-19T09:45:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:51 smithi162 ceph-mon[35174]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T09:45:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:45:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:51 smithi162 ceph-mon[35174]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:45:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:45:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:45:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:53.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:53 smithi018 ceph-mon[30956]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T09:45:53.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:45:53.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:53 smithi049 ceph-mon[34858]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T09:45:53.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:53 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:45:53.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:53 smithi162 ceph-mon[35174]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T09:45:53.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:53 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:45:54.247 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:45:54 smithi018 sudo[49432]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:45:54.247 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:45:54 smithi018 sudo[49432]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:54.248 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:45:54 smithi018 sudo[49432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:54.248 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:45:54 smithi018 sudo[49432]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:54.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:54 smithi018 ceph-mon[30956]: pgmap v80: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:54.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:45:54.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:54 smithi018 ceph-mon[30956]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T09:45:54.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:45:54.512 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:54 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1415685512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa"}]: dispatch 2024-09-19T09:45:54.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:45:54.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:54 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1415685512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa"}]': finished 2024-09-19T09:45:54.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:54 smithi018 ceph-mon[30956]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:45:54.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:45:54.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:54 smithi049 ceph-mon[34858]: pgmap v80: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:54.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:45:54.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:54 smithi049 ceph-mon[34858]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T09:45:54.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:45:54.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:54 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1415685512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa"}]: dispatch 2024-09-19T09:45:54.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:45:54.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:54 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1415685512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa"}]': finished 2024-09-19T09:45:54.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:54 smithi049 ceph-mon[34858]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:45:54.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:45:54.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:54 smithi162 ceph-mon[35174]: pgmap v80: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:45:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:54 smithi162 ceph-mon[35174]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T09:45:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:45:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:54 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1415685512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa"}]: dispatch 2024-09-19T09:45:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:45:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:54 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1415685512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa"}]': finished 2024-09-19T09:45:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:54 smithi162 ceph-mon[35174]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:45:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:45:54.885 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:45:54 smithi018 sudo[49458]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:45:54.885 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:45:54 smithi018 sudo[49458]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:54.885 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:45:54 smithi018 sudo[49458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:54.885 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 09:45:54 smithi018 sudo[49458]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:55.150 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:54 smithi049 sudo[43547]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:45:55.150 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:54 smithi049 sudo[43547]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:55.150 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:54 smithi049 sudo[43547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:55.150 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:55 smithi049 sudo[43547]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:55.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:45:55.263+0000 7f993dffb640 1 -- 172.21.15.18:0/2672058205 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f99300c0a50 con 0x7f9940100ad0 2024-09-19T09:45:55.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:55 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1564251435' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:45:55.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:55 smithi018 ceph-mon[30956]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T09:45:55.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:45:55.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:55.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:55 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1564251435' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:45:55.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:55 smithi049 ceph-mon[34858]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T09:45:55.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:55 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:45:55.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:55 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:55.651 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:55 smithi049 sudo[43550]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:45:55.651 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:55 smithi049 sudo[43550]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:55.651 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:55 smithi049 sudo[43550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:55.651 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:45:55 smithi049 sudo[43550]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:55.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:55 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1564251435' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:45:55.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:55 smithi162 ceph-mon[35174]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T09:45:55.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:55 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:45:55.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:55 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:55.979 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:55 smithi162 sudo[43880]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:45:55.980 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:55 smithi162 sudo[43880]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:55.980 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:55 smithi162 sudo[43880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:55.980 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:55 smithi162 sudo[43880]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:56.412 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:55 smithi162 sudo[43883]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:45:56.413 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:55 smithi162 sudo[43883]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:56.413 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:55 smithi162 sudo[43883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:56.413 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 09:45:55 smithi162 sudo[43883]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:56.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 sudo[49869]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:45:56.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 sudo[49869]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:56.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 sudo[49869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:56.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 sudo[49869]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:57.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:56 smithi162 ceph-mon[35174]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:57.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:56 smithi162 ceph-mon[35174]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:45:57.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:56 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:57.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:56 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:57.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:56 smithi162 ceph-mon[35174]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:45:57.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:57 smithi162 sudo[43886]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:45:57.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:57 smithi162 sudo[43886]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:57.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:57 smithi162 sudo[43886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:57.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 sudo[50057]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:45:57.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 sudo[50057]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:57.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 sudo[50057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:57.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 sudo[50057]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:57.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 ceph-mon[30956]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:57.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 ceph-mon[30956]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:45:57.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:57.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:57.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:56 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:45:57.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:56 smithi049 ceph-mon[34858]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:57.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:56 smithi049 ceph-mon[34858]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:45:57.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:56 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:57.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:56 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:45:57.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:56 smithi049 ceph-mon[34858]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:45:57.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:57 smithi162 sudo[43886]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:57.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:57 smithi162 sudo[43889]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:45:57.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:57 smithi162 sudo[43889]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:57.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:57 smithi162 sudo[43889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:57.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:57 smithi162 sudo[43889]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:58.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:57 smithi049 sudo[43553]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:45:58.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:57 smithi049 sudo[43553]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:58.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:57 smithi049 sudo[43553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:58.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:57 smithi049 sudo[43553]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:58.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:58.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:45:58.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:45:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:45:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:45:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:45:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:45:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:45:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:45:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:45:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:45:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:45:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:45:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 sudo[43556]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:45:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 sudo[43556]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:45:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 sudo[43556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:45:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 sudo[43556]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:45:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:45:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:45:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:45:58.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:45:58.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:45:59.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:59 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:45:59.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:59 smithi018 ceph-mon[30956]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:59.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:45:59 smithi018 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:45:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:59 smithi049 ceph-mon[34858]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:45:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:59 smithi049 ceph-mon[34858]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:45:59 smithi049 ceph-mon[34858]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:45:59.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:59 smithi162 ceph-mon[35174]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:45:59.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:59 smithi162 ceph-mon[35174]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:45:59.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:45:59 smithi162 ceph-mon[35174]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:46:01.377 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:01 smithi018 ceph-mon[30956]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:46:01.653 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:01 smithi049 ceph-mon[34858]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:46:01.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:01 smithi162 ceph-mon[35174]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:46:03.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:03 smithi018 ceph-mon[30956]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T09:46:03.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:46:03.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:03.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:03 smithi018 ceph-mon[30956]: Deploying daemon osd.3 on smithi018 2024-09-19T09:46:03.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:03 smithi049 ceph-mon[34858]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T09:46:03.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:46:03.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:03.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:03 smithi049 ceph-mon[34858]: Deploying daemon osd.3 on smithi018 2024-09-19T09:46:03.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:03 smithi162 ceph-mon[35174]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T09:46:03.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:46:03.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:03.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:03 smithi162 ceph-mon[35174]: Deploying daemon osd.3 on smithi018 2024-09-19T09:46:05.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:05 smithi018 ceph-mon[30956]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T09:46:05.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:05 smithi049 ceph-mon[34858]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T09:46:05.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:05 smithi162 ceph-mon[35174]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T09:46:07.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:07 smithi018 ceph-mon[30956]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T09:46:07.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:07 smithi049 ceph-mon[34858]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T09:46:07.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:07 smithi162 ceph-mon[35174]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T09:46:09.554 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:09 smithi018 ceph-mon[30956]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:46:09.554 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:09.554 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:09.554 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:09.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:09 smithi049 ceph-mon[34858]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:46:09.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:09.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:09.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:09.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:09 smithi162 ceph-mon[35174]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:46:09.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:09.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:09.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:11.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:11 smithi018 ceph-mon[30956]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:46:11.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:11.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:11.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:11 smithi049 ceph-mon[34858]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:46:11.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:11 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:11.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:11 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:11.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:11 smithi162 ceph-mon[35174]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:46:11.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:11 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:11.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:11 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:12.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:12.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:12.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:12.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.559+0000 7f993dffb640 1 -- 172.21.15.18:0/2672058205 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9940107b50 con 0x7f992c0a31b0 2024-09-19T09:46:12.561 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 3 on host 'smithi018' 2024-09-19T09:46:12.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 -- 172.21.15.18:0/2672058205 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f992c0a31b0 msgr2=0x7f992c0a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f992c0a31b0 0x7f992c0a5670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f994006b050 tx=0x7f9928009110 comp rx=0 tx=0).stop 2024-09-19T09:46:12.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 -- 172.21.15.18:0/2672058205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9940100ad0 msgr2=0x7f994006aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9940100ad0 0x7f994006aad0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9930031610 tx=0x7f993003ede0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 -- 172.21.15.18:0/2672058205 shutdown_connections 2024-09-19T09:46:12.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f992c0a31b0 0x7f992c0a5670 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9940102690 0x7f994019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9940101cd0 0x7f994019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 --2- 172.21.15.18:0/2672058205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9940100ad0 0x7f994006aad0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 -- 172.21.15.18:0/2672058205 >> 172.21.15.18:0/2672058205 conn(0x7f99400fc280 msgr2=0x7f9940105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:12.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 -- 172.21.15.18:0/2672058205 shutdown_connections 2024-09-19T09:46:12.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:46:12.561+0000 7f9946511640 1 -- 172.21.15.18:0/2672058205 wait complete. 2024-09-19T09:46:12.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:12.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:12.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:12.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:12.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:12.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:13.191 DEBUG:teuthology.orchestra.run.smithi018:osd.3> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T09:46:13.234 INFO:tasks.cephadm:Deploying osd.4 on smithi049 with /dev/vg_nvme/lv_3... 2024-09-19T09:46:13.234 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:46:13.450 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:13 smithi018 ceph-mon[30956]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:46:13.450 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:13.450 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:13.450 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:13.499 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:46:13.620 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:13 smithi049 ceph-mon[34858]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:46:13.620 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:13.620 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:13.621 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:13.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:13 smithi162 ceph-mon[35174]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:46:13.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:13.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:13.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:14.885 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 09:46:14 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T09:46:14.547+0000 7f02dba8c640 -1 osd.3 0 log_to_monitors true 2024-09-19T09:46:15.437 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:15 smithi049 ceph-mon[34858]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:46:15.438 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:15 smithi049 ceph-mon[34858]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:46:15.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:15 smithi018 ceph-mon[30956]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:46:15.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:15 smithi018 ceph-mon[30956]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:46:15.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:15 smithi162 ceph-mon[35174]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:46:15.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:15 smithi162 ceph-mon[35174]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:46:15.936 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:46:15.972 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_3 2024-09-19T09:46:16.224 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:46:16.635 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T09:46:16.353+0000 7f02d71ec640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T09:46:16.635 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T09:46:16.360+0000 7f02d3826640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:46:16.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:46:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T09:46:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:46:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi018 2024-09-19T09:46:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-19T09:46:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:16.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:16.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:46:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T09:46:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:46:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi018 2024-09-19T09:46:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:16.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:16.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-19T09:46:16.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:16.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:16.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:16 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:46:16.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T09:46:16.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:46:16.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:16.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi018 2024-09-19T09:46:16.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:16.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:16.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-19T09:46:16.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:16.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:16.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:16 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:16.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.668+0000 7fd37ef1d640 1 -- 172.21.15.49:0/3135441600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd378101d10 msgr2=0x7fd378102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:16.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.668+0000 7fd37ef1d640 1 --2- 172.21.15.49:0/3135441600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd378101d10 0x7fd378102190 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd364009900 tx=0x7fd36402a410 comp rx=0 tx=0).stop 2024-09-19T09:46:16.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.668+0000 7fd37ef1d640 1 -- 172.21.15.49:0/3135441600 shutdown_connections 2024-09-19T09:46:16.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.668+0000 7fd37ef1d640 1 --2- 172.21.15.49:0/3135441600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3781026d0 0x7fd378108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:16.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.668+0000 7fd37ef1d640 1 --2- 172.21.15.49:0/3135441600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd378101d10 0x7fd378102190 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:16.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.668+0000 7fd37ef1d640 1 --2- 172.21.15.49:0/3135441600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd378100b10 0x7fd378100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:16.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.668+0000 7fd37ef1d640 1 -- 172.21.15.49:0/3135441600 >> 172.21.15.49:0/3135441600 conn(0x7fd3780fc2a0 msgr2=0x7fd3780fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:16.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.668+0000 7fd37ef1d640 1 -- 172.21.15.49:0/3135441600 shutdown_connections 2024-09-19T09:46:16.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.668+0000 7fd37ef1d640 1 -- 172.21.15.49:0/3135441600 wait complete. 2024-09-19T09:46:16.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ef1d640 1 Processor -- start 2024-09-19T09:46:16.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ef1d640 1 -- start start 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ef1d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd378100b10 0x7fd378196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ef1d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd378101d10 0x7fd378197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ef1d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3781026d0 0x7fd37819e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ef1d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd37810c770 con 0x7fd3781026d0 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ef1d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd37810c5f0 con 0x7fd378100b10 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ef1d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd37810c8f0 con 0x7fd378101d10 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ccb9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd378100b10 0x7fd378196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ccb9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd378100b10 0x7fd378196e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47172/0 (socket says 172.21.15.49:47172) 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ccb9640 1 -- 172.21.15.49:0/2796078127 learned_addr learned my addr 172.21.15.49:0/2796078127 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd377fff640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd378101d10 0x7fd378197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37d4ba640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3781026d0 0x7fd37819e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:16.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ccb9640 1 -- 172.21.15.49:0/2796078127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd378101d10 msgr2=0x7fd378197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ccb9640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd378101d10 0x7fd378197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ccb9640 1 -- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3781026d0 msgr2=0x7fd37819e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ccb9640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3781026d0 0x7fd37819e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37ccb9640 1 -- 172.21.15.49:0/2796078127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37819ea50 con 0x7fd378100b10 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.669+0000 7fd37d4ba640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3781026d0 0x7fd37819e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.670+0000 7fd37ccb9640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd378100b10 0x7fd378196e20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c970 tx=0x7fd36c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.670+0000 7fd375ffb640 1 -- 172.21.15.49:0/2796078127 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c004220 con 0x7fd378100b10 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.670+0000 7fd37ef1d640 1 -- 172.21.15.49:0/2796078127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37819ed40 con 0x7fd378100b10 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.670+0000 7fd375ffb640 1 -- 172.21.15.49:0/2796078127 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd36c0043c0 con 0x7fd378100b10 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.670+0000 7fd375ffb640 1 -- 172.21.15.49:0/2796078127 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00f450 con 0x7fd378100b10 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.670+0000 7fd37ef1d640 1 -- 172.21.15.49:0/2796078127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37819f1a0 con 0x7fd378100b10 2024-09-19T09:46:16.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.671+0000 7fd37ef1d640 1 -- 172.21.15.49:0/2796078127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd378107f60 con 0x7fd378100b10 2024-09-19T09:46:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.672+0000 7fd375ffb640 1 -- 172.21.15.49:0/2796078127 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd36c0079b0 con 0x7fd378100b10 2024-09-19T09:46:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.673+0000 7fd375ffb640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3680a3270 0x7fd3680a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.673+0000 7fd375ffb640 1 -- 172.21.15.49:0/2796078127 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3389+0+0 (secure 0 0 0) 0x7fd36c0ce310 con 0x7fd378100b10 2024-09-19T09:46:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.673+0000 7fd377fff640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3680a3270 0x7fd3680a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.674+0000 7fd377fff640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3680a3270 0x7fd3680a5730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3640314e0 tx=0x7fd364000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.677+0000 7fd375ffb640 1 -- 172.21.15.49:0/2796078127 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd36c014030 con 0x7fd378100b10 2024-09-19T09:46:16.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:16.862+0000 7fd37ef1d640 1 -- 172.21.15.49:0/2796078127 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd378062630 con 0x7fd3680a3270 2024-09-19T09:46:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:17 smithi049 ceph-mon[34858]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:46:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:17 smithi049 ceph-mon[34858]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:46:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:17 smithi049 ceph-mon[34858]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T09:46:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:17 smithi049 ceph-mon[34858]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:46:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:46:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:46:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:17 smithi018 ceph-mon[30956]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:46:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:17 smithi018 ceph-mon[30956]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:46:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:17 smithi018 ceph-mon[30956]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T09:46:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:17 smithi018 ceph-mon[30956]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:46:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:46:17.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:46:17.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:17 smithi162 ceph-mon[35174]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:46:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:17 smithi162 ceph-mon[35174]: from='osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:46:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:17 smithi162 ceph-mon[35174]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T09:46:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:17 smithi162 ceph-mon[35174]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:46:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:46:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:46:17.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:18.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:18 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:46:18.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:18 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:46:18.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:18 smithi049 ceph-mon[34858]: osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] boot 2024-09-19T09:46:18.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:18 smithi049 ceph-mon[34858]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T09:46:18.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:18 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:18 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:46:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:18 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:46:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:18 smithi018 ceph-mon[30956]: osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] boot 2024-09-19T09:46:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:18 smithi018 ceph-mon[30956]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T09:46:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:18.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:18 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:46:18.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:18 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:46:18.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:18 smithi162 ceph-mon[35174]: osd.3 [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] boot 2024-09-19T09:46:18.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:18 smithi162 ceph-mon[35174]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T09:46:18.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:18 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:46:19.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:19 smithi018 ceph-mon[30956]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:19.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:19 smithi018 ceph-mon[30956]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T09:46:19.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:19 smithi018 ceph-mon[30956]: from='client.? 172.21.15.49:0/1971157853' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb894107-ee7c-4c7c-8d84-173445174dcf"}]: dispatch 2024-09-19T09:46:19.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:19 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb894107-ee7c-4c7c-8d84-173445174dcf"}]: dispatch 2024-09-19T09:46:19.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:19 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb894107-ee7c-4c7c-8d84-173445174dcf"}]': finished 2024-09-19T09:46:19.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:19 smithi018 ceph-mon[30956]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:46:19.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:19.636 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:19 smithi049 ceph-mon[34858]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:19.636 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:19 smithi049 ceph-mon[34858]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T09:46:19.636 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:19 smithi049 ceph-mon[34858]: from='client.? 172.21.15.49:0/1971157853' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb894107-ee7c-4c7c-8d84-173445174dcf"}]: dispatch 2024-09-19T09:46:19.636 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:19 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb894107-ee7c-4c7c-8d84-173445174dcf"}]: dispatch 2024-09-19T09:46:19.636 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:19 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb894107-ee7c-4c7c-8d84-173445174dcf"}]': finished 2024-09-19T09:46:19.636 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:19 smithi049 ceph-mon[34858]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:46:19.636 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:19.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:19 smithi162 ceph-mon[35174]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:19.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:19 smithi162 ceph-mon[35174]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T09:46:19.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:19 smithi162 ceph-mon[35174]: from='client.? 172.21.15.49:0/1971157853' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb894107-ee7c-4c7c-8d84-173445174dcf"}]: dispatch 2024-09-19T09:46:19.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:19 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb894107-ee7c-4c7c-8d84-173445174dcf"}]: dispatch 2024-09-19T09:46:19.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:19 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb894107-ee7c-4c7c-8d84-173445174dcf"}]': finished 2024-09-19T09:46:19.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:19 smithi162 ceph-mon[35174]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:46:19.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:20.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:20 smithi018 ceph-mon[30956]: from='client.? 172.21.15.49:0/372647400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:46:20.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:20 smithi018 ceph-mon[30956]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:46:20.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:20.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:20 smithi049 ceph-mon[34858]: from='client.? 172.21.15.49:0/372647400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:46:20.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:20 smithi049 ceph-mon[34858]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:46:20.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:20 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:20.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:20 smithi162 ceph-mon[35174]: from='client.? 172.21.15.49:0/372647400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:46:20.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:20 smithi162 ceph-mon[35174]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:46:20.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:21.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:21 smithi018 ceph-mon[30956]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:21.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:21 smithi018 ceph-mon[30956]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T09:46:21.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:21.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:21 smithi049 ceph-mon[34858]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:21.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:21 smithi049 ceph-mon[34858]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T09:46:21.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:21.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:21 smithi162 ceph-mon[35174]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:21.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:21 smithi162 ceph-mon[35174]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T09:46:21.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:23.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:23 smithi018 ceph-mon[30956]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:46:23.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:23 smithi049 ceph-mon[34858]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:46:23.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:23 smithi162 ceph-mon[35174]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:46:25.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:25 smithi018 ceph-mon[30956]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T09:46:25.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:25 smithi049 ceph-mon[34858]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T09:46:25.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:25 smithi162 ceph-mon[35174]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T09:46:27.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:27 smithi018 ceph-mon[30956]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T09:46:27.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:27 smithi049 ceph-mon[34858]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T09:46:27.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:27 smithi162 ceph-mon[35174]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T09:46:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:46:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:28 smithi018 ceph-mon[30956]: Deploying daemon osd.4 on smithi049 2024-09-19T09:46:28.641 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:28 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:46:28.641 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:28 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:28.641 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:28 smithi049 ceph-mon[34858]: Deploying daemon osd.4 on smithi049 2024-09-19T09:46:28.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:28 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:46:28.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:28 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:28.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:28 smithi162 ceph-mon[35174]: Deploying daemon osd.4 on smithi049 2024-09-19T09:46:29.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:29 smithi018 ceph-mon[30956]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:46:29.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:29 smithi049 ceph-mon[34858]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:46:29.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:29 smithi162 ceph-mon[35174]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:46:31.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:31 smithi018 ceph-mon[30956]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:46:31.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:31 smithi049 ceph-mon[34858]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:46:31.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:31 smithi162 ceph-mon[35174]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:46:33.476 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:33 smithi049 ceph-mon[34858]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:33.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:33 smithi018 ceph-mon[30956]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:33.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:33 smithi162 ceph-mon[35174]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:34.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:34.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:34.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:34.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:34.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:34.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:34.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:34.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:34.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:35.511 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:35 smithi049 ceph-mon[34858]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:35.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:35 smithi162 ceph-mon[35174]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:35.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:35 smithi018 ceph-mon[30956]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:38.380 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:38 smithi049 ceph-mon[34858]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:38.380 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:38 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:38.380 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:38 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:38.380 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:38 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:38.380 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:38 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:38.380 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:38 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:38.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:38 smithi018 ceph-mon[30956]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:38.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:38.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:38.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:38.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:38.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:38.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:38 smithi162 ceph-mon[35174]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:38.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:38 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:38.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:38 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:38.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:38 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:38.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:38 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:38.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:38 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.422+0000 7fd375ffb640 1 -- 172.21.15.49:0/2796078127 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd378062630 con 0x7fd3680a3270 2024-09-19T09:46:38.424 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 4 on host 'smithi049' 2024-09-19T09:46:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 -- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3680a3270 msgr2=0x7fd3680a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3680a3270 0x7fd3680a5730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3640314e0 tx=0x7fd364000bc0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 -- 172.21.15.49:0/2796078127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd378100b10 msgr2=0x7fd378196e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd378100b10 0x7fd378196e20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c970 tx=0x7fd36c00ce30 comp rx=0 tx=0).stop 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 -- 172.21.15.49:0/2796078127 shutdown_connections 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3680a3270 0x7fd3680a5730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3781026d0 0x7fd37819e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd378101d10 0x7fd378197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 --2- 172.21.15.49:0/2796078127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd378100b10 0x7fd378196e20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 -- 172.21.15.49:0/2796078127 >> 172.21.15.49:0/2796078127 conn(0x7fd3780fc2a0 msgr2=0x7fd378105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 -- 172.21.15.49:0/2796078127 shutdown_connections 2024-09-19T09:46:38.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:46:38.424+0000 7fd37ef1d640 1 -- 172.21.15.49:0/2796078127 wait complete. 2024-09-19T09:46:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:39.076 DEBUG:teuthology.orchestra.run.smithi049:osd.4> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T09:46:39.079 INFO:tasks.cephadm:Deploying osd.5 on smithi162 with /dev/vg_nvme/lv_3... 2024-09-19T09:46:39.079 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:46:39.334 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:46:39.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:39.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:39.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:39.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:39.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:39.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:40.073 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:40 smithi049 ceph-mon[34858]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:40.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:40 smithi162 ceph-mon[35174]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:40.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:40 smithi018 ceph-mon[30956]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:41.030 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 09:46:40 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4[46340]: 2024-09-19T09:46:40.720+0000 7f4ffa6e4640 -1 osd.4 0 log_to_monitors true 2024-09-19T09:46:41.304 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:41 smithi162 ceph-mon[35174]: from='osd.4 [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:46:41.304 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:41 smithi162 ceph-mon[35174]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:46:41.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:41 smithi018 ceph-mon[30956]: from='osd.4 [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:46:41.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:41 smithi018 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:46:41.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:41 smithi049 ceph-mon[34858]: from='osd.4 [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:46:41.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:41 smithi049 ceph-mon[34858]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:46:41.818 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:46:41.843 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-09-19T09:46:42.100 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:46:42.150 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4[46340]: 2024-09-19T09:46:42.038+0000 7f4ff5e44640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T09:46:42.150 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4[46340]: 2024-09-19T09:46:42.044+0000 7f4ff247e640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:46:42.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:42.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:46:42.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:46:42.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:42.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='osd.4 [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:46:42.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:46:42.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:42.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:42.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:42.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:42.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:46:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:46:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='osd.4 [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:46:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:46:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:42.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:42.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:42.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:42.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:46:42.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='osd.4 [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:46:42.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.583+0000 7f2dbd326640 1 -- 172.21.15.162:0/4005072151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db8101c00 msgr2=0x7f2db8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:42.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.583+0000 7f2dbd326640 1 --2- 172.21.15.162:0/4005072151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db8101c00 0x7f2db8102000 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009900 tx=0x7f2da802a410 comp rx=0 tx=0).stop 2024-09-19T09:46:42.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.583+0000 7f2dbd326640 1 -- 172.21.15.162:0/4005072151 shutdown_connections 2024-09-19T09:46:42.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.583+0000 7f2dbd326640 1 --2- 172.21.15.162:0/4005072151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db81037c0 0x7f2db810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:42.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.583+0000 7f2dbd326640 1 --2- 172.21.15.162:0/4005072151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db8102e00 0x7f2db8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:42.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.583+0000 7f2dbd326640 1 --2- 172.21.15.162:0/4005072151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db8101c00 0x7f2db8102000 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.583+0000 7f2dbd326640 1 -- 172.21.15.162:0/4005072151 >> 172.21.15.162:0/4005072151 conn(0x7f2db80fd390 msgr2=0x7f2db80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.583+0000 7f2dbd326640 1 -- 172.21.15.162:0/4005072151 shutdown_connections 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.583+0000 7f2dbd326640 1 -- 172.21.15.162:0/4005072151 wait complete. 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2dbd326640 1 Processor -- start 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2dbd326640 1 -- start start 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2dbd326640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db8101c00 0x7f2db8197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2dbd326640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db8102e00 0x7f2db8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2dbd326640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db81037c0 0x7f2db819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2dbd326640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2db810d890 con 0x7f2db8102e00 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2dbd326640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2db810d710 con 0x7f2db8101c00 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2dbd326640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2db810da10 con 0x7f2db81037c0 2024-09-19T09:46:42.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2db77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db81037c0 0x7f2db819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2db77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db81037c0 0x7f2db819f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:33384/0 (socket says 172.21.15.162:33384) 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.584+0000 7f2db77fe640 1 -- 172.21.15.162:0/2154883672 learned_addr learned my addr 172.21.15.162:0/2154883672 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2db6ffd640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db8101c00 0x7f2db8197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2db67fc640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db8102e00 0x7f2db8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2db77fe640 1 -- 172.21.15.162:0/2154883672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db8101c00 msgr2=0x7f2db8197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2db77fe640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db8101c00 0x7f2db8197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2db77fe640 1 -- 172.21.15.162:0/2154883672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db8102e00 msgr2=0x7f2db8198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2db77fe640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db8102e00 0x7f2db8198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2db77fe640 1 -- 172.21.15.162:0/2154883672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db819fb10 con 0x7f2db81037c0 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2db77fe640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db81037c0 0x7f2db819f4a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2db000eb10 tx=0x7f2db000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2d9ffff640 1 -- 172.21.15.162:0/2154883672 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0004b20 con 0x7f2db81037c0 2024-09-19T09:46:42.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2dbd326640 1 -- 172.21.15.162:0/2154883672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db819fe00 con 0x7f2db81037c0 2024-09-19T09:46:42.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2d9ffff640 1 -- 172.21.15.162:0/2154883672 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2db0004cc0 con 0x7f2db81037c0 2024-09-19T09:46:42.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2d9ffff640 1 -- 172.21.15.162:0/2154883672 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0010760 con 0x7f2db81037c0 2024-09-19T09:46:42.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.585+0000 7f2dbd326640 1 -- 172.21.15.162:0/2154883672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db81a02b0 con 0x7f2db81037c0 2024-09-19T09:46:42.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.586+0000 7f2dbd326640 1 -- 172.21.15.162:0/2154883672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db8108ff0 con 0x7f2db81037c0 2024-09-19T09:46:42.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.587+0000 7f2d9ffff640 1 -- 172.21.15.162:0/2154883672 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2db0005020 con 0x7f2db81037c0 2024-09-19T09:46:42.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.588+0000 7f2d9ffff640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a3270 0x7f2da00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:42.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.588+0000 7f2d9ffff640 1 -- 172.21.15.162:0/2154883672 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7f2db00cee00 con 0x7f2db81037c0 2024-09-19T09:46:42.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.588+0000 7f2db6ffd640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a3270 0x7f2da00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:42.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.589+0000 7f2db6ffd640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a3270 0x7f2da00a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2da8006010 tx=0x7f2da8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:42.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.592+0000 7f2d9ffff640 1 -- 172.21.15.162:0/2154883672 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2db009ccb0 con 0x7f2db81037c0 2024-09-19T09:46:42.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:46:42.766+0000 7f2dbd326640 1 -- 172.21.15.162:0/2154883672 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2db8062630 con 0x7f2da00a3270 2024-09-19T09:46:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:43 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi049 2024-09-19T09:46:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:43 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi049 to 8544M 2024-09-19T09:46:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:43 smithi162 ceph-mon[35174]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:46:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:43 smithi162 ceph-mon[35174]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T09:46:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:43 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:43 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:43 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:46:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:43 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:46:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:43 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:43.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:43 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi049 2024-09-19T09:46:43.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:43 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi049 to 8544M 2024-09-19T09:46:43.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:43 smithi018 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:46:43.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:43 smithi018 ceph-mon[30956]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T09:46:43.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:43.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:43.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:46:43.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:46:43.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:43.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:43 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi049 2024-09-19T09:46:43.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:43 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi049 to 8544M 2024-09-19T09:46:43.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:43 smithi049 ceph-mon[34858]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:46:43.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:43 smithi049 ceph-mon[34858]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T09:46:43.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:43 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:43.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:43 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:43.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:43 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:46:43.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:43 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:46:43.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:43 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:44.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:44 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:46:44.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:44 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:46:44.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:44 smithi162 ceph-mon[35174]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:44.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:44 smithi162 ceph-mon[35174]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:46:44.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:44 smithi162 ceph-mon[35174]: osd.4 [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] boot 2024-09-19T09:46:44.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:44 smithi162 ceph-mon[35174]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T09:46:44.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:44 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:44.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:44 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:46:44.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:44 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:46:44.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:44 smithi018 ceph-mon[30956]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:44.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:44 smithi018 ceph-mon[30956]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:46:44.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:44 smithi018 ceph-mon[30956]: osd.4 [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] boot 2024-09-19T09:46:44.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:44 smithi018 ceph-mon[30956]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T09:46:44.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:44 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:44.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:44 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:46:44.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:44 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:46:44.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:44 smithi049 ceph-mon[34858]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:46:44.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:44 smithi049 ceph-mon[34858]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:46:44.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:44 smithi049 ceph-mon[34858]: osd.4 [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] boot 2024-09-19T09:46:44.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:44 smithi049 ceph-mon[34858]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T09:46:44.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:44 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:46:45.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:45 smithi018 ceph-mon[30956]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T09:46:45.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:45 smithi049 ceph-mon[34858]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T09:46:45.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:45 smithi162 ceph-mon[35174]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T09:46:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:46 smithi018 ceph-mon[30956]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:46 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1442661704' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2654f083-56fe-4de5-bc96-e47e8ef9dca1"}]: dispatch 2024-09-19T09:46:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:46 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2654f083-56fe-4de5-bc96-e47e8ef9dca1"}]: dispatch 2024-09-19T09:46:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:46 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2654f083-56fe-4de5-bc96-e47e8ef9dca1"}]': finished 2024-09-19T09:46:46.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:46 smithi018 ceph-mon[30956]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T09:46:46.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:46:46.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:46 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1604705065' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:46:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:46 smithi049 ceph-mon[34858]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:46 smithi049 ceph-mon[34858]: from='client.? 172.21.15.162:0/1442661704' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2654f083-56fe-4de5-bc96-e47e8ef9dca1"}]: dispatch 2024-09-19T09:46:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:46 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2654f083-56fe-4de5-bc96-e47e8ef9dca1"}]: dispatch 2024-09-19T09:46:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:46 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2654f083-56fe-4de5-bc96-e47e8ef9dca1"}]': finished 2024-09-19T09:46:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:46 smithi049 ceph-mon[34858]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T09:46:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:46:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:46 smithi049 ceph-mon[34858]: from='client.? 172.21.15.162:0/1604705065' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:46:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:46 smithi162 ceph-mon[35174]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:46 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/1442661704' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2654f083-56fe-4de5-bc96-e47e8ef9dca1"}]: dispatch 2024-09-19T09:46:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:46 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2654f083-56fe-4de5-bc96-e47e8ef9dca1"}]: dispatch 2024-09-19T09:46:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:46 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2654f083-56fe-4de5-bc96-e47e8ef9dca1"}]': finished 2024-09-19T09:46:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:46 smithi162 ceph-mon[35174]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T09:46:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:46:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:46 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/1604705065' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:46:48.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:48 smithi018 ceph-mon[30956]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:48 smithi049 ceph-mon[34858]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:48.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:48 smithi162 ceph-mon[35174]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:50.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:50 smithi018 ceph-mon[30956]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:50 smithi049 ceph-mon[34858]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:50.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:50 smithi162 ceph-mon[35174]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:52.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:52 smithi162 ceph-mon[35174]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:52.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:52 smithi018 ceph-mon[30956]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:52 smithi049 ceph-mon[34858]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:54.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:54 smithi162 ceph-mon[35174]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:54.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:46:54.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:54.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:54 smithi018 ceph-mon[30956]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:54.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:46:54.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:54 smithi049 ceph-mon[34858]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:46:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:55.361 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:55 smithi162 ceph-mon[35174]: Deploying daemon osd.5 on smithi162 2024-09-19T09:46:55.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:55 smithi018 ceph-mon[30956]: Deploying daemon osd.5 on smithi162 2024-09-19T09:46:55.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:55 smithi049 ceph-mon[34858]: Deploying daemon osd.5 on smithi162 2024-09-19T09:46:56.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:56 smithi162 ceph-mon[35174]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:56.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:56 smithi018 ceph-mon[30956]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:56.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:56 smithi049 ceph-mon[34858]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:58.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:46:58 smithi018 ceph-mon[30956]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:58.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:46:58 smithi049 ceph-mon[34858]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:46:58.404 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:46:58 smithi162 ceph-mon[35174]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:00.302 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:00 smithi162 ceph-mon[35174]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:00.303 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:00.303 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:00.303 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:00.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:00 smithi018 ceph-mon[30956]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:00.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:00.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:00.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:00 smithi049 ceph-mon[34858]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:02 smithi162 ceph-mon[35174]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:02.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:02 smithi018 ceph-mon[30956]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:02.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:02 smithi049 ceph-mon[34858]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:02.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.909+0000 7f2d9ffff640 1 -- 172.21.15.162:0/2154883672 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2db8062630 con 0x7f2da00a3270 2024-09-19T09:47:02.912 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 5 on host 'smithi162' 2024-09-19T09:47:02.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 -- 172.21.15.162:0/2154883672 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a3270 msgr2=0x7f2da00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a3270 0x7f2da00a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2da8006010 tx=0x7f2da8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 -- 172.21.15.162:0/2154883672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db81037c0 msgr2=0x7f2db819f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db81037c0 0x7f2db819f4a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2db000eb10 tx=0x7f2db000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 -- 172.21.15.162:0/2154883672 shutdown_connections 2024-09-19T09:47:02.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a3270 0x7f2da00a5730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db81037c0 0x7f2db819f4a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db8102e00 0x7f2db8198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 --2- 172.21.15.162:0/2154883672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db8101c00 0x7f2db8197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 -- 172.21.15.162:0/2154883672 >> 172.21.15.162:0/2154883672 conn(0x7f2db80fd390 msgr2=0x7f2db81061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:02.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 -- 172.21.15.162:0/2154883672 shutdown_connections 2024-09-19T09:47:02.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:02.913+0000 7f2dbd326640 1 -- 172.21.15.162:0/2154883672 wait complete. 2024-09-19T09:47:03.546 DEBUG:teuthology.orchestra.run.smithi162:osd.5> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T09:47:03.549 INFO:tasks.cephadm:Deploying osd.6 on smithi018 with /dev/vg_nvme/lv_2... 2024-09-19T09:47:03.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:04.130 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:03 smithi162 ceph-mon[35174]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:04.130 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.130 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.130 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.130 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.231 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:03 smithi018 ceph-mon[30956]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:04.231 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.231 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.231 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.231 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:03 smithi049 ceph-mon[34858]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:04.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:04.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:05.909 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 09:47:05 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T09:47:05.648+0000 7f60fe31e640 -1 osd.5 0 log_to_monitors true 2024-09-19T09:47:06.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:05 smithi162 ceph-mon[35174]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:06.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:05 smithi162 ceph-mon[35174]: from='osd.5 [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:47:06.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:05 smithi162 ceph-mon[35174]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:47:06.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:05 smithi018 ceph-mon[30956]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:06.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:05 smithi018 ceph-mon[30956]: from='osd.5 [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:47:06.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:05 smithi018 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:47:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:05 smithi049 ceph-mon[34858]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:05 smithi049 ceph-mon[34858]: from='osd.5 [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:47:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:05 smithi049 ceph-mon[34858]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:47:06.553 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:47:06.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_2 2024-09-19T09:47:06.843 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:07.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:47:07.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:47:07.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:07.104 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='osd.5 [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:07.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.389+0000 7f258351d640 1 -- 172.21.15.18:0/3846133004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257c101cd0 msgr2=0x7f257c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.389+0000 7f258351d640 1 --2- 172.21.15.18:0/3846133004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257c101cd0 0x7f257c102150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f256c009900 tx=0x7f256c02a410 comp rx=0 tx=0).stop 2024-09-19T09:47:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.389+0000 7f258351d640 1 -- 172.21.15.18:0/3846133004 shutdown_connections 2024-09-19T09:47:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.389+0000 7f258351d640 1 --2- 172.21.15.18:0/3846133004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257c102690 0x7f257c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.389+0000 7f258351d640 1 --2- 172.21.15.18:0/3846133004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257c101cd0 0x7f257c102150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.389+0000 7f258351d640 1 --2- 172.21.15.18:0/3846133004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c100ad0 0x7f257c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.389+0000 7f258351d640 1 -- 172.21.15.18:0/3846133004 >> 172.21.15.18:0/3846133004 conn(0x7f257c0fc280 msgr2=0x7f257c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.389+0000 7f258351d640 1 -- 172.21.15.18:0/3846133004 shutdown_connections 2024-09-19T09:47:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.389+0000 7f258351d640 1 -- 172.21.15.18:0/3846133004 wait complete. 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f258351d640 1 Processor -- start 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f258351d640 1 -- start start 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f258351d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c100ad0 0x7f257c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f258351d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257c101cd0 0x7f257c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f258351d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257c102690 0x7f257c19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f258351d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f257c10c780 con 0x7f257c101cd0 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f258351d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f257c10c600 con 0x7f257c100ad0 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f258351d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f257c10c900 con 0x7f257c102690 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f2580ab8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257c101cd0 0x7f257c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f2580ab8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257c101cd0 0x7f257c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53384/0 (socket says 172.21.15.18:53384) 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f2580ab8640 1 -- 172.21.15.18:0/1294258048 learned_addr learned my addr 172.21.15.18:0/1294258048 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:47:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f2581aba640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257c102690 0x7f257c19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.390+0000 7f25812b9640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c100ad0 0x7f257c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f2580ab8640 1 -- 172.21.15.18:0/1294258048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257c102690 msgr2=0x7f257c19f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f2580ab8640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257c102690 0x7f257c19f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f2580ab8640 1 -- 172.21.15.18:0/1294258048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c100ad0 msgr2=0x7f257c197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f2580ab8640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c100ad0 0x7f257c197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f2580ab8640 1 -- 172.21.15.18:0/1294258048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257c19fb50 con 0x7f257c101cd0 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f2580ab8640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257c101cd0 0x7f257c198460 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f256c031440 tx=0x7f256c032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f25727fc640 1 -- 172.21.15.18:0/1294258048 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c03f030 con 0x7f257c101cd0 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f25727fc640 1 -- 172.21.15.18:0/1294258048 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f256c003ce0 con 0x7f257c101cd0 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f258351d640 1 -- 172.21.15.18:0/1294258048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257c102ef0 con 0x7f257c101cd0 2024-09-19T09:47:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f258351d640 1 -- 172.21.15.18:0/1294258048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f257c1033d0 con 0x7f257c101cd0 2024-09-19T09:47:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.391+0000 7f25727fc640 1 -- 172.21.15.18:0/1294258048 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c035070 con 0x7f257c101cd0 2024-09-19T09:47:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.392+0000 7f258351d640 1 -- 172.21.15.18:0/1294258048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2560005290 con 0x7f257c101cd0 2024-09-19T09:47:07.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.394+0000 7f25727fc640 1 -- 172.21.15.18:0/1294258048 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f256c042030 con 0x7f257c101cd0 2024-09-19T09:47:07.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.395+0000 7f25727fc640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25680a3270 0x7f25680a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:07.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.395+0000 7f25812b9640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25680a3270 0x7f25680a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:07.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.396+0000 7f25727fc640 1 -- 172.21.15.18:0/1294258048 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7f256c0ef210 con 0x7f257c101cd0 2024-09-19T09:47:07.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.396+0000 7f25812b9640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25680a3270 0x7f25680a5730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f257c101b30 tx=0x7f257800f7a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.398+0000 7f25727fc640 1 -- 172.21.15.18:0/1294258048 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f256c0bc820 con 0x7f257c101cd0 2024-09-19T09:47:07.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:47:07.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:47:07.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='osd.5 [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:07.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:07.402 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='osd.5 [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:07.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:07.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:07.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:07.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:07.584+0000 7f258351d640 1 -- 172.21.15.18:0/1294258048 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2560000bc0 con 0x7f25680a3270 2024-09-19T09:47:08.131 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:08.131 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi162 2024-09-19T09:47:08.131 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-19T09:47:08.131 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:47:08.131 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T09:47:08.131 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:08.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:08.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:47:08.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:47:08.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:08.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: from='osd.5 ' entity='osd.5' 2024-09-19T09:47:08.132 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:07 smithi018 ceph-mon[30956]: osd.5 [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] boot 2024-09-19T09:47:08.163 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T09:47:07.735+0000 7f60f9a7e640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T09:47:08.163 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T09:47:07.745+0000 7f60f20b0640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:47:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi162 2024-09-19T09:47:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-19T09:47:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:47:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T09:47:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:08.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:47:08.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:47:08.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:08.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: from='osd.5 ' entity='osd.5' 2024-09-19T09:47:08.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:07 smithi162 ceph-mon[35174]: osd.5 [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] boot 2024-09-19T09:47:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:47:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi162 2024-09-19T09:47:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-19T09:47:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:47:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T09:47:08.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:08.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:08.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:47:08.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:47:08.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:08.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: from='osd.5 ' entity='osd.5' 2024-09-19T09:47:08.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:07 smithi049 ceph-mon[34858]: osd.5 [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] boot 2024-09-19T09:47:08.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:08 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:47:08.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:08 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:47:08.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:08 smithi018 ceph-mon[30956]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:47:08.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:08 smithi018 ceph-mon[30956]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T09:47:08.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:08 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:09.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:08 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:47:09.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:08 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:47:09.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:08 smithi049 ceph-mon[34858]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:47:09.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:08 smithi049 ceph-mon[34858]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T09:47:09.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:08 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:09.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:08 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:47:09.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:08 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:47:09.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:08 smithi162 ceph-mon[35174]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:47:09.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:08 smithi162 ceph-mon[35174]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T09:47:09.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:08 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:47:10.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:09 smithi018 ceph-mon[30956]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 576 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:10.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:09 smithi018 ceph-mon[30956]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T09:47:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:09 smithi049 ceph-mon[34858]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 576 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:09 smithi049 ceph-mon[34858]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T09:47:10.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:09 smithi162 ceph-mon[35174]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 576 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:10.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:09 smithi162 ceph-mon[35174]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T09:47:11.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:10 smithi162 ceph-mon[35174]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T09:47:11.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:10 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2290118900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d62113a-1d28-4c49-a893-1ade15236dc7"}]: dispatch 2024-09-19T09:47:11.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:10 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2290118900' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d62113a-1d28-4c49-a893-1ade15236dc7"}]': finished 2024-09-19T09:47:11.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:10 smithi162 ceph-mon[35174]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:47:11.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:10 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:11.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:10 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/266738861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:47:11.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:10 smithi018 ceph-mon[30956]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T09:47:11.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:10 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2290118900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d62113a-1d28-4c49-a893-1ade15236dc7"}]: dispatch 2024-09-19T09:47:11.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:10 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2290118900' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d62113a-1d28-4c49-a893-1ade15236dc7"}]': finished 2024-09-19T09:47:11.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:10 smithi018 ceph-mon[30956]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:47:11.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:10 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:11.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:10 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/266738861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:47:11.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:10 smithi049 ceph-mon[34858]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T09:47:11.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:10 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2290118900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d62113a-1d28-4c49-a893-1ade15236dc7"}]: dispatch 2024-09-19T09:47:11.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:10 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2290118900' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d62113a-1d28-4c49-a893-1ade15236dc7"}]': finished 2024-09-19T09:47:11.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:10 smithi049 ceph-mon[34858]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:47:11.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:10 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:11.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:10 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/266738861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:47:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:12 smithi049 ceph-mon[34858]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 576 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:12 smithi049 ceph-mon[34858]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T09:47:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:12.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:12 smithi018 ceph-mon[30956]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 576 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:12.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:12 smithi018 ceph-mon[30956]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T09:47:12.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:12 smithi162 ceph-mon[35174]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 576 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:12 smithi162 ceph-mon[35174]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T09:47:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:13.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:13 smithi018 ceph-mon[30956]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T09:47:13.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:13.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:13 smithi049 ceph-mon[34858]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T09:47:13.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:13 smithi162 ceph-mon[35174]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T09:47:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:14.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:14 smithi018 ceph-mon[30956]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 576 MiB used, 536 GiB / 536 GiB avail; 171 KiB/s, 0 objects/s recovering 2024-09-19T09:47:14.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:14 smithi049 ceph-mon[34858]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 576 MiB used, 536 GiB / 536 GiB avail; 171 KiB/s, 0 objects/s recovering 2024-09-19T09:47:14.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:14 smithi162 ceph-mon[35174]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 576 MiB used, 536 GiB / 536 GiB avail; 171 KiB/s, 0 objects/s recovering 2024-09-19T09:47:16.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:16 smithi018 ceph-mon[30956]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-19T09:47:16.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:16 smithi049 ceph-mon[34858]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-19T09:47:16.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:16 smithi162 ceph-mon[35174]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-19T09:47:18.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:18 smithi018 ceph-mon[30956]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T09:47:18.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:18 smithi049 ceph-mon[34858]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T09:47:18.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:18 smithi162 ceph-mon[35174]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T09:47:19.361 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:47:19.361 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:19.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:47:19.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:19.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:47:19.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:20.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:20 smithi018 ceph-mon[30956]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:47:20.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:20 smithi018 ceph-mon[30956]: Deploying daemon osd.6 on smithi018 2024-09-19T09:47:20.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:20 smithi049 ceph-mon[34858]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:47:20.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:20 smithi049 ceph-mon[34858]: Deploying daemon osd.6 on smithi018 2024-09-19T09:47:20.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:20 smithi162 ceph-mon[35174]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:47:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:20 smithi162 ceph-mon[35174]: Deploying daemon osd.6 on smithi018 2024-09-19T09:47:22.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:22 smithi018 ceph-mon[30956]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T09:47:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:22 smithi049 ceph-mon[34858]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T09:47:22.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:22 smithi162 ceph-mon[35174]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T09:47:24.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:24 smithi018 ceph-mon[30956]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:24.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:24 smithi049 ceph-mon[34858]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:24.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:24 smithi162 ceph-mon[35174]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:25.329 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:25.329 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:25.330 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:25.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:25.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:25.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:25.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:25.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:25.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:26.340 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:26 smithi018 ceph-mon[30956]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:26.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:26 smithi049 ceph-mon[34858]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:26.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:26 smithi162 ceph-mon[35174]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:28.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:28 smithi018 ceph-mon[30956]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:28.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:28.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:28.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:28.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:28.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:28 smithi049 ceph-mon[34858]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:28 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:28 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:28 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:28 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:28 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:28.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:28 smithi162 ceph-mon[35174]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:28.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:28 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:28.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:28 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:28 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:28 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:28 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.518+0000 7f25727fc640 1 -- 172.21.15.18:0/1294258048 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2560000bc0 con 0x7f25680a3270 2024-09-19T09:47:28.520 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 6 on host 'smithi018' 2024-09-19T09:47:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 -- 172.21.15.18:0/1294258048 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25680a3270 msgr2=0x7f25680a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25680a3270 0x7f25680a5730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f257c101b30 tx=0x7f257800f7a0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 -- 172.21.15.18:0/1294258048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257c101cd0 msgr2=0x7f257c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257c101cd0 0x7f257c198460 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f256c031440 tx=0x7f256c032e20 comp rx=0 tx=0).stop 2024-09-19T09:47:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 -- 172.21.15.18:0/1294258048 shutdown_connections 2024-09-19T09:47:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25680a3270 0x7f25680a5730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257c102690 0x7f257c19f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257c101cd0 0x7f257c198460 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 --2- 172.21.15.18:0/1294258048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f257c100ad0 0x7f257c197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 -- 172.21.15.18:0/1294258048 >> 172.21.15.18:0/1294258048 conn(0x7f257c0fc280 msgr2=0x7f257c06a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 -- 172.21.15.18:0/1294258048 shutdown_connections 2024-09-19T09:47:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:47:28.520+0000 7f258351d640 1 -- 172.21.15.18:0/1294258048 wait complete. 2024-09-19T09:47:29.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:29.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:29.306 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:29 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:29.335 DEBUG:teuthology.orchestra.run.smithi018:osd.6> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T09:47:29.337 INFO:tasks.cephadm:Deploying osd.7 on smithi049 with /dev/vg_nvme/lv_2... 2024-09-19T09:47:29.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:47:29.367 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:29 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:29.367 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:29 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:29.367 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:29 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:29.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:29 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:29.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:29 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:29.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:29 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:29.602 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:47:30.376 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:30 smithi049 ceph-mon[34858]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:30.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:30 smithi018 ceph-mon[30956]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:30 smithi162 ceph-mon[35174]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:31.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:31 smithi018 ceph-mon[30956]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:47:31.135 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 09:47:30 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T09:47:30.936+0000 7f6215f5f640 -1 osd.6 0 log_to_monitors true 2024-09-19T09:47:31.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:31 smithi049 ceph-mon[34858]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:47:31.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:31 smithi162 ceph-mon[35174]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:47:32.317 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:32 smithi049 ceph-mon[34858]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:32.317 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:32 smithi049 ceph-mon[34858]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:47:32.317 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:32 smithi049 ceph-mon[34858]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T09:47:32.317 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:32 smithi049 ceph-mon[34858]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:47:32.317 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:32 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:32.319 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:47:32.345 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_2 2024-09-19T09:47:32.370 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:32 smithi018 ceph-mon[30956]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:32.370 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:32 smithi018 ceph-mon[30956]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:47:32.370 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:32 smithi018 ceph-mon[30956]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T09:47:32.370 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:32 smithi018 ceph-mon[30956]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:47:32.370 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:32 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:32.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:32 smithi162 ceph-mon[35174]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:32.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:32 smithi162 ceph-mon[35174]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:47:32.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:32 smithi162 ceph-mon[35174]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T09:47:32.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:32 smithi162 ceph-mon[35174]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:47:32.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:32 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:32.653 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:47:33.135 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 09:47:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T09:47:32.841+0000 7f62116bf640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T09:47:33.135 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 09:47:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T09:47:32.852+0000 7f6209cf1640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:47:33.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:47:33.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:33 smithi018 ceph-mon[30956]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' 2024-09-19T09:47:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.104+0000 7fc227bc6640 1 -- 172.21.15.49:0/1168283269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2201026d0 msgr2=0x7fc220108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.104+0000 7fc227bc6640 1 --2- 172.21.15.49:0/1168283269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2201026d0 0x7fc220108f60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc218009ca0 tx=0x7fc21802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.104+0000 7fc227bc6640 1 -- 172.21.15.49:0/1168283269 shutdown_connections 2024-09-19T09:47:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.104+0000 7fc227bc6640 1 --2- 172.21.15.49:0/1168283269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2201026d0 0x7fc220108f60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.104+0000 7fc227bc6640 1 --2- 172.21.15.49:0/1168283269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc220101d10 0x7fc220102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.104+0000 7fc227bc6640 1 --2- 172.21.15.49:0/1168283269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc220100b10 0x7fc220100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.104+0000 7fc227bc6640 1 -- 172.21.15.49:0/1168283269 >> 172.21.15.49:0/1168283269 conn(0x7fc2200fc2a0 msgr2=0x7fc2200fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.104+0000 7fc227bc6640 1 -- 172.21.15.49:0/1168283269 shutdown_connections 2024-09-19T09:47:33.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.104+0000 7fc227bc6640 1 -- 172.21.15.49:0/1168283269 wait complete. 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc227bc6640 1 Processor -- start 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc227bc6640 1 -- start start 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc227bc6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc220100b10 0x7fc22010b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc227bc6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc220101d10 0x7fc220109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc227bc6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2201026d0 0x7fc22010a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc227bc6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc22010d920 con 0x7fc220101d10 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc227bc6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc22010d7a0 con 0x7fc220100b10 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc227bc6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc22010daa0 con 0x7fc2201026d0 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc225962640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc220100b10 0x7fc22010b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc225962640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc220100b10 0x7fc22010b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49912/0 (socket says 172.21.15.49:49912) 2024-09-19T09:47:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc225962640 1 -- 172.21.15.49:0/2859929505 learned_addr learned my addr 172.21.15.49:0/2859929505 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc226163640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2201026d0 0x7fc22010a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc225161640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc220101d10 0x7fc220109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc225962640 1 -- 172.21.15.49:0/2859929505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2201026d0 msgr2=0x7fc22010a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc225962640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2201026d0 0x7fc22010a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc225962640 1 -- 172.21.15.49:0/2859929505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc220101d10 msgr2=0x7fc220109ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc225962640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc220101d10 0x7fc220109ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc225962640 1 -- 172.21.15.49:0/2859929505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22010a8e0 con 0x7fc220100b10 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.105+0000 7fc226163640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2201026d0 0x7fc22010a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.106+0000 7fc225962640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc220100b10 0x7fc22010b490 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00d770 tx=0x7fc21c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.106+0000 7fc212ffd640 1 -- 172.21.15.49:0/2859929505 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c017070 con 0x7fc220100b10 2024-09-19T09:47:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.106+0000 7fc212ffd640 1 -- 172.21.15.49:0/2859929505 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc21c009c30 con 0x7fc220100b10 2024-09-19T09:47:33.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.106+0000 7fc227bc6640 1 -- 172.21.15.49:0/2859929505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2201a1fe0 con 0x7fc220100b10 2024-09-19T09:47:33.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.106+0000 7fc212ffd640 1 -- 172.21.15.49:0/2859929505 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c003dd0 con 0x7fc220100b10 2024-09-19T09:47:33.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.106+0000 7fc227bc6640 1 -- 172.21.15.49:0/2859929505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2201a23d0 con 0x7fc220100b10 2024-09-19T09:47:33.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.107+0000 7fc227bc6640 1 -- 172.21.15.49:0/2859929505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc220107ec0 con 0x7fc220100b10 2024-09-19T09:47:33.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.108+0000 7fc212ffd640 1 -- 172.21.15.49:0/2859929505 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc21c003fb0 con 0x7fc220100b10 2024-09-19T09:47:33.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.109+0000 7fc212ffd640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc20c0a3240 0x7fc20c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:33.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.109+0000 7fc212ffd640 1 -- 172.21.15.49:0/2859929505 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4685+0+0 (secure 0 0 0) 0x7fc21c0ce8f0 con 0x7fc220100b10 2024-09-19T09:47:33.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.109+0000 7fc225161640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc20c0a3240 0x7fc20c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:33.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.110+0000 7fc225161640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc20c0a3240 0x7fc20c0a5700 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc214005fd0 tx=0x7fc214005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:33.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.112+0000 7fc212ffd640 1 -- 172.21.15.49:0/2859929505 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc21c009de0 con 0x7fc220100b10 2024-09-19T09:47:33.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:33.296+0000 7fc227bc6640 1 -- 172.21.15.49:0/2859929505 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc220062630 con 0x7fc20c0a3240 2024-09-19T09:47:33.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:47:33.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:33 smithi049 ceph-mon[34858]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' 2024-09-19T09:47:33.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:47:33.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T09:47:33.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:33.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:33.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:33.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:33.415 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:33.415 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.415 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:33.415 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:33.415 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:33.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:33 smithi162 ceph-mon[35174]: from='osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681]' entity='osd.6' 2024-09-19T09:47:34.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:47:34.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:47:34.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:34.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi018 2024-09-19T09:47:34.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-19T09:47:34.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:34.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:47:34.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:47:34.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:34.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] boot 2024-09-19T09:47:34.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T09:47:34.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:34 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:34.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:47:34.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:47:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi018 2024-09-19T09:47:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-19T09:47:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:47:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:47:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] boot 2024-09-19T09:47:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T09:47:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:34 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:47:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:47:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:47:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi018 2024-09-19T09:47:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-19T09:47:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:34.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:47:34.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:47:34.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:34.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: osd.6 [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] boot 2024-09-19T09:47:34.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T09:47:34.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:34 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:47:35.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:35 smithi018 ceph-mon[30956]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:47:35.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:35 smithi018 ceph-mon[30956]: osdmap e46: 7 total, 7 up, 7 in 2024-09-19T09:47:35.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:35 smithi049 ceph-mon[34858]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:47:35.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:35 smithi049 ceph-mon[34858]: osdmap e46: 7 total, 7 up, 7 in 2024-09-19T09:47:35.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:35 smithi162 ceph-mon[35174]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:47:35.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:35 smithi162 ceph-mon[35174]: osdmap e46: 7 total, 7 up, 7 in 2024-09-19T09:47:36.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:36 smithi018 ceph-mon[30956]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:36.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:36 smithi018 ceph-mon[30956]: from='client.? 172.21.15.49:0/1116796188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ec6cadf-ad0b-4ae7-bafc-40c901da2173"}]: dispatch 2024-09-19T09:47:36.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:36 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ec6cadf-ad0b-4ae7-bafc-40c901da2173"}]: dispatch 2024-09-19T09:47:36.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:36 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ec6cadf-ad0b-4ae7-bafc-40c901da2173"}]': finished 2024-09-19T09:47:36.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:36 smithi018 ceph-mon[30956]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T09:47:36.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:36 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:36.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:36 smithi049 ceph-mon[34858]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:36.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:36 smithi049 ceph-mon[34858]: from='client.? 172.21.15.49:0/1116796188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ec6cadf-ad0b-4ae7-bafc-40c901da2173"}]: dispatch 2024-09-19T09:47:36.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:36 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ec6cadf-ad0b-4ae7-bafc-40c901da2173"}]: dispatch 2024-09-19T09:47:36.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:36 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ec6cadf-ad0b-4ae7-bafc-40c901da2173"}]': finished 2024-09-19T09:47:36.397 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:36 smithi049 ceph-mon[34858]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T09:47:36.397 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:36 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:36 smithi162 ceph-mon[35174]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:36 smithi162 ceph-mon[35174]: from='client.? 172.21.15.49:0/1116796188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ec6cadf-ad0b-4ae7-bafc-40c901da2173"}]: dispatch 2024-09-19T09:47:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:36 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ec6cadf-ad0b-4ae7-bafc-40c901da2173"}]: dispatch 2024-09-19T09:47:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:36 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ec6cadf-ad0b-4ae7-bafc-40c901da2173"}]': finished 2024-09-19T09:47:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:36 smithi162 ceph-mon[35174]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T09:47:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:36 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:37.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:37 smithi018 ceph-mon[30956]: from='client.? 172.21.15.49:0/3271142169' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:47:37.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:37 smithi049 ceph-mon[34858]: from='client.? 172.21.15.49:0/3271142169' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:47:37.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:37 smithi162 ceph-mon[35174]: from='client.? 172.21.15.49:0/3271142169' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:47:38.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:38 smithi018 ceph-mon[30956]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:38.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:38 smithi049 ceph-mon[34858]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:38.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:38 smithi162 ceph-mon[35174]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:40.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:40 smithi018 ceph-mon[30956]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:40.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:40 smithi049 ceph-mon[34858]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:40.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:40 smithi162 ceph-mon[35174]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:42.322 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:42 smithi049 ceph-mon[34858]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:42.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:42 smithi018 ceph-mon[30956]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:42.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:42 smithi162 ceph-mon[35174]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:44.325 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:44 smithi049 ceph-mon[34858]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:44.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:44 smithi018 ceph-mon[30956]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:44.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:44 smithi162 ceph-mon[35174]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:45.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:47:45.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:45.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:47:45.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:45.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:47:45.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:46.323 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:46 smithi049 ceph-mon[34858]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:46.323 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:46 smithi049 ceph-mon[34858]: Deploying daemon osd.7 on smithi049 2024-09-19T09:47:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:46 smithi018 ceph-mon[30956]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:46 smithi018 ceph-mon[30956]: Deploying daemon osd.7 on smithi049 2024-09-19T09:47:46.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:46 smithi162 ceph-mon[35174]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:46 smithi162 ceph-mon[35174]: Deploying daemon osd.7 on smithi049 2024-09-19T09:47:48.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:48 smithi018 ceph-mon[30956]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:48 smithi049 ceph-mon[34858]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:48.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:48 smithi162 ceph-mon[35174]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:50.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:50 smithi018 ceph-mon[30956]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:50 smithi049 ceph-mon[34858]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:50.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:50 smithi162 ceph-mon[35174]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:51.169 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:51.169 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:51.170 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:51.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:51.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:51.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:51.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:52.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:52 smithi049 ceph-mon[34858]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:52.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:52 smithi018 ceph-mon[30956]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:52 smithi162 ceph-mon[35174]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.868+0000 7fc212ffd640 1 -- 172.21.15.49:0/2859929505 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc220062630 con 0x7fc20c0a3240 2024-09-19T09:47:53.870 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 7 on host 'smithi049' 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 -- 172.21.15.49:0/2859929505 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc20c0a3240 msgr2=0x7fc20c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc20c0a3240 0x7fc20c0a5700 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc214005fd0 tx=0x7fc214005850 comp rx=0 tx=0).stop 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 -- 172.21.15.49:0/2859929505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc220100b10 msgr2=0x7fc22010b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc220100b10 0x7fc22010b490 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00d770 tx=0x7fc21c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 -- 172.21.15.49:0/2859929505 shutdown_connections 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc20c0a3240 0x7fc20c0a5700 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2201026d0 0x7fc22010a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc220101d10 0x7fc220109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 --2- 172.21.15.49:0/2859929505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc220100b10 0x7fc22010b490 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 -- 172.21.15.49:0/2859929505 >> 172.21.15.49:0/2859929505 conn(0x7fc2200fc2a0 msgr2=0x7fc220105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 -- 172.21.15.49:0/2859929505 shutdown_connections 2024-09-19T09:47:53.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:47:53.871+0000 7fc227bc6640 1 -- 172.21.15.49:0/2859929505 wait complete. 2024-09-19T09:47:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:54 smithi049 ceph-mon[34858]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:54.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:54.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:54.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:54 smithi018 ceph-mon[30956]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:54.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:54.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:54.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:54.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:54 smithi162 ceph-mon[35174]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:47:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:54.678 DEBUG:teuthology.orchestra.run.smithi049:osd.7> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T09:47:54.680 INFO:tasks.cephadm:Deploying osd.8 on smithi162 with /dev/vg_nvme/lv_2... 2024-09-19T09:47:54.680 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:47:54.935 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:47:56.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:56 smithi049 ceph-mon[34858]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:56.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:56 smithi162 ceph-mon[35174]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:56.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:56 smithi018 ceph-mon[30956]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:57.150 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 09:47:56 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T09:47:56.765+0000 7fe78478f640 -1 osd.7 0 log_to_monitors true 2024-09-19T09:47:57.452 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:57 smithi049 ceph-mon[34858]: from='osd.7 [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:47:57.453 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:57 smithi049 ceph-mon[34858]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:47:57.538 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:57 smithi162 ceph-mon[35174]: from='osd.7 [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:47:57.538 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:57 smithi162 ceph-mon[35174]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:47:57.541 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:47:57.567 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-09-19T09:47:57.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:57 smithi018 ceph-mon[30956]: from='osd.7 [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:47:57.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:57 smithi018 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:47:57.821 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:47:58.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 -- 172.21.15.162:0/2175919083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458107960 msgr2=0x7f3458109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:58.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 --2- 172.21.15.162:0/2175919083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458107960 0x7f3458109d50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3450009ca0 tx=0x7f345002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:47:58.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 -- 172.21.15.162:0/2175919083 shutdown_connections 2024-09-19T09:47:58.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 --2- 172.21.15.162:0/2175919083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458107960 0x7f3458109d50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:58.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 --2- 172.21.15.162:0/2175919083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105030 0x7f3458107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:58.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 --2- 172.21.15.162:0/2175919083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3458102700 0x7f3458104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 -- 172.21.15.162:0/2175919083 >> 172.21.15.162:0/2175919083 conn(0x7f34580fc280 msgr2=0x7f34580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 -- 172.21.15.162:0/2175919083 shutdown_connections 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 -- 172.21.15.162:0/2175919083 wait complete. 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 Processor -- start 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.270+0000 7f346063f640 1 -- start start 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f346063f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102700 0x7f3458197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f346063f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105030 0x7f3458198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f346063f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3458107960 0x7f345819f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f346063f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f345810d8d0 con 0x7f3458105030 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f346063f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f345810d750 con 0x7f3458107960 2024-09-19T09:47:58.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f346063f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f345810da50 con 0x7f3458102700 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345e3db640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102700 0x7f3458197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345e3db640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102700 0x7f3458197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:48916/0 (socket says 172.21.15.162:48916) 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345e3db640 1 -- 172.21.15.162:0/433924289 learned_addr learned my addr 172.21.15.162:0/433924289 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345dbda640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105030 0x7f3458198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345ebdc640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3458107960 0x7f345819f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345dbda640 1 -- 172.21.15.162:0/433924289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102700 msgr2=0x7f3458197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345dbda640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102700 0x7f3458197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345dbda640 1 -- 172.21.15.162:0/433924289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3458107960 msgr2=0x7f345819f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345dbda640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3458107960 0x7f345819f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345dbda640 1 -- 172.21.15.162:0/433924289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345819fb20 con 0x7f3458105030 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345e3db640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102700 0x7f3458197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:47:58.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f345dbda640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105030 0x7f3458198430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f344800e9c0 tx=0x7f344800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f344f7fe640 1 -- 172.21.15.162:0/433924289 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344800ccc0 con 0x7f3458105030 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f346063f640 1 -- 172.21.15.162:0/433924289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345819fe10 con 0x7f3458105030 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f344f7fe640 1 -- 172.21.15.162:0/433924289 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3448010910 con 0x7f3458105030 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.271+0000 7f344f7fe640 1 -- 172.21.15.162:0/433924289 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448018880 con 0x7f3458105030 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.272+0000 7f346063f640 1 -- 172.21.15.162:0/433924289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34581a02c0 con 0x7f3458105030 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.272+0000 7f346063f640 1 -- 172.21.15.162:0/433924289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34580fdd70 con 0x7f3458105030 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.274+0000 7f344f7fe640 1 -- 172.21.15.162:0/433924289 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3448010ac0 con 0x7f3458105030 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.275+0000 7f344f7fe640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34440a3270 0x7f34440a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.275+0000 7f344f7fe640 1 -- 172.21.15.162:0/433924289 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5117+0+0 (secure 0 0 0) 0x7f34480cf0b0 con 0x7f3458105030 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.275+0000 7f345e3db640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34440a3270 0x7f34440a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.276+0000 7f345e3db640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34440a3270 0x7f34440a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3454011500 tx=0x7f3454005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:58.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.278+0000 7f344f7fe640 1 -- 172.21.15.162:0/433924289 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f344809c400 con 0x7f3458105030 2024-09-19T09:47:58.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:47:58.459+0000 7f346063f640 1 -- 172.21.15.162:0/433924289 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3458062630 con 0x7f34440a3270 2024-09-19T09:47:58.461 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='osd.7 [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.462 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:58.463 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:58.463 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:58 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:58.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:47:58.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T09:47:58.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='osd.7 [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:47:58.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:47:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:58.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:58 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:47:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:47:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T09:47:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='osd.7 [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:47:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:47:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:47:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:47:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:47:59.222 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T09:47:58.931+0000 7fe77feef640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T09:47:59.223 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 09:47:58 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T09:47:58.940+0000 7fe778521640 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:47:59.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi049 2024-09-19T09:47:59.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi049 to 5696M 2024-09-19T09:47:59.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:47:59.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: osdmap e49: 8 total, 7 up, 8 in 2024-09-19T09:47:59.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:59.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:59.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:47:59.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:47:59.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:59.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: from='osd.7 ' entity='osd.7' 2024-09-19T09:47:59.531 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: osd.7 [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] boot 2024-09-19T09:47:59.531 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:47:59 smithi162 ceph-mon[35174]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T09:47:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi049 2024-09-19T09:47:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi049 to 5696M 2024-09-19T09:47:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:47:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: osdmap e49: 8 total, 7 up, 8 in 2024-09-19T09:47:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:47:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:47:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: from='osd.7 ' entity='osd.7' 2024-09-19T09:47:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: osd.7 [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] boot 2024-09-19T09:47:59.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:47:59 smithi018 ceph-mon[30956]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T09:47:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi049 2024-09-19T09:47:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi049 to 5696M 2024-09-19T09:47:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:47:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: osdmap e49: 8 total, 7 up, 8 in 2024-09-19T09:47:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:47:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:47:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:47:59.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:47:59.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: from='osd.7 ' entity='osd.7' 2024-09-19T09:47:59.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: osd.7 [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] boot 2024-09-19T09:47:59.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:47:59 smithi049 ceph-mon[34858]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T09:48:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:00 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:48:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:00 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:48:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:00 smithi162 ceph-mon[35174]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:48:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:00 smithi162 ceph-mon[35174]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:48:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:48:00.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:00 smithi162 ceph-mon[35174]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T09:48:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:00 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:48:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:00 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:48:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:00 smithi018 ceph-mon[30956]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:48:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:00 smithi018 ceph-mon[30956]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:48:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:48:00.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:00 smithi018 ceph-mon[30956]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T09:48:00.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:00 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:48:00.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:00 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:48:00.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:00 smithi049 ceph-mon[34858]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:48:00.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:00 smithi049 ceph-mon[34858]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:48:00.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:48:00.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:00 smithi049 ceph-mon[34858]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T09:48:01.406 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:01 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/1373758383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9eed0ed-9719-4772-be83-f6849ab08bf3"}]: dispatch 2024-09-19T09:48:01.406 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:01 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9eed0ed-9719-4772-be83-f6849ab08bf3"}]: dispatch 2024-09-19T09:48:01.406 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:01 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9eed0ed-9719-4772-be83-f6849ab08bf3"}]': finished 2024-09-19T09:48:01.406 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:01 smithi162 ceph-mon[35174]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:48:01.406 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:01 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:01 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/1373758383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9eed0ed-9719-4772-be83-f6849ab08bf3"}]: dispatch 2024-09-19T09:48:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:01 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9eed0ed-9719-4772-be83-f6849ab08bf3"}]: dispatch 2024-09-19T09:48:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:01 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9eed0ed-9719-4772-be83-f6849ab08bf3"}]': finished 2024-09-19T09:48:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:01 smithi018 ceph-mon[30956]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:48:01.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:01 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:01.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:01 smithi049 ceph-mon[34858]: from='client.? 172.21.15.162:0/1373758383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9eed0ed-9719-4772-be83-f6849ab08bf3"}]: dispatch 2024-09-19T09:48:01.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:01 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9eed0ed-9719-4772-be83-f6849ab08bf3"}]: dispatch 2024-09-19T09:48:01.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:01 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9eed0ed-9719-4772-be83-f6849ab08bf3"}]': finished 2024-09-19T09:48:01.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:01 smithi049 ceph-mon[34858]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:48:01.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:01 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:02 smithi018 ceph-mon[30956]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:02 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/301946233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:48:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:02 smithi018 ceph-mon[30956]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T09:48:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:02 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:02.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:02 smithi049 ceph-mon[34858]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:02.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:02 smithi049 ceph-mon[34858]: from='client.? 172.21.15.162:0/301946233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:48:02.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:02 smithi049 ceph-mon[34858]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T09:48:02.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:02 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:02.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:02 smithi162 ceph-mon[35174]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:02.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:02 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/301946233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:48:02.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:02 smithi162 ceph-mon[35174]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T09:48:02.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:02 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:04.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:03 smithi018 ceph-mon[30956]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:04.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:03 smithi018 ceph-mon[30956]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T09:48:04.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:04.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:03 smithi049 ceph-mon[34858]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:04.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:03 smithi049 ceph-mon[34858]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T09:48:04.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:04.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:03 smithi162 ceph-mon[35174]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:04.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:03 smithi162 ceph-mon[35174]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T09:48:04.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:06.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:05 smithi018 ceph-mon[30956]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:06.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:05 smithi049 ceph-mon[34858]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:06.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:05 smithi162 ceph-mon[35174]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:07.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:07 smithi162 ceph-mon[35174]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:08.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:07 smithi018 ceph-mon[30956]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:08.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:07 smithi049 ceph-mon[34858]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:10.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:09 smithi162 ceph-mon[35174]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:10.129 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:48:10.129 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:10.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:09 smithi018 ceph-mon[30956]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:10.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:48:10.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:10.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:09 smithi049 ceph-mon[34858]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:10.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:48:10.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:11.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:10 smithi018 ceph-mon[30956]: Deploying daemon osd.8 on smithi162 2024-09-19T09:48:11.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:10 smithi049 ceph-mon[34858]: Deploying daemon osd.8 on smithi162 2024-09-19T09:48:11.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:10 smithi162 ceph-mon[35174]: Deploying daemon osd.8 on smithi162 2024-09-19T09:48:12.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:11 smithi018 ceph-mon[30956]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:12.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:11 smithi049 ceph-mon[34858]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:12.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:11 smithi162 ceph-mon[35174]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:14.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:13 smithi018 ceph-mon[30956]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:14.289 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:13 smithi162 ceph-mon[35174]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:14.290 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:13 smithi049 ceph-mon[34858]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:16.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:15 smithi018 ceph-mon[30956]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:16.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:16.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:16.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:16.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:15 smithi162 ceph-mon[35174]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:16.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:15 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:16.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:15 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:16.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:15 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:16.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:15 smithi049 ceph-mon[34858]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:16.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:15 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:16.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:15 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:16.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:15 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:18.041 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:17 smithi162 ceph-mon[35174]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:18.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:17 smithi018 ceph-mon[30956]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:18.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:17 smithi049 ceph-mon[34858]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:18.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.677+0000 7f344f7fe640 1 -- 172.21.15.162:0/433924289 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3458062630 con 0x7f34440a3270 2024-09-19T09:48:18.679 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 8 on host 'smithi162' 2024-09-19T09:48:18.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 -- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34440a3270 msgr2=0x7f34440a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:18.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34440a3270 0x7f34440a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3454011500 tx=0x7f3454005f90 comp rx=0 tx=0).stop 2024-09-19T09:48:18.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 -- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105030 msgr2=0x7f3458198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:18.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105030 0x7f3458198430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f344800e9c0 tx=0x7f344800ee80 comp rx=0 tx=0).stop 2024-09-19T09:48:18.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 -- 172.21.15.162:0/433924289 shutdown_connections 2024-09-19T09:48:18.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34440a3270 0x7f34440a5730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:18.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3458107960 0x7f345819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:18.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3458105030 0x7f3458198430 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:18.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 --2- 172.21.15.162:0/433924289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3458102700 0x7f3458197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:18.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 -- 172.21.15.162:0/433924289 >> 172.21.15.162:0/433924289 conn(0x7f34580fc280 msgr2=0x7f3458102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:18.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 -- 172.21.15.162:0/433924289 shutdown_connections 2024-09-19T09:48:18.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:48:18.679+0000 7f346063f640 1 -- 172.21.15.162:0/433924289 wait complete. 2024-09-19T09:48:19.315 DEBUG:teuthology.orchestra.run.smithi162:osd.8> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T09:48:19.317 INFO:tasks.cephadm:Deploying osd.9 on smithi018 with /dev/vg_nvme/lv_1... 2024-09-19T09:48:19.318 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:48:19.592 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:48:19.923 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:19 smithi162 ceph-mon[35174]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:19.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:19.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:19.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:19.924 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:19.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:19 smithi018 ceph-mon[30956]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:19.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:19.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:19.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:19.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:20.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:19 smithi049 ceph-mon[34858]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:20.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:20.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:20.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:20.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:21.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:21 smithi018 ceph-mon[30956]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:22.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:21 smithi049 ceph-mon[34858]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:22.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:21 smithi162 ceph-mon[35174]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:22.163 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 09:48:21 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T09:48:21.794+0000 7f9254fed640 -1 osd.8 0 log_to_monitors true 2024-09-19T09:48:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:48:22.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_1 2024-09-19T09:48:22.619 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:48:22.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='osd.8 [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:48:22.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:48:22.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:22.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:22.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:22.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:22.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:22.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:22.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:22.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:22.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:22 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:23.016 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='osd.8 [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:48:23.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:48:23.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:23.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:23.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:23.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:23.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:23.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:23.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:23.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:23.017 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:23.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 -- 172.21.15.18:0/3184553200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db01037c0 msgr2=0x7f9db010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:23.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 --2- 172.21.15.18:0/3184553200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db01037c0 0x7f9db010a050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009ca0 tx=0x7f9da802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:48:23.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 -- 172.21.15.18:0/3184553200 shutdown_connections 2024-09-19T09:48:23.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 --2- 172.21.15.18:0/3184553200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db01037c0 0x7f9db010a050 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:23.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 --2- 172.21.15.18:0/3184553200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102e00 0x7f9db0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:23.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 --2- 172.21.15.18:0/3184553200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9db0101c00 0x7f9db0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:23.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 -- 172.21.15.18:0/3184553200 >> 172.21.15.18:0/3184553200 conn(0x7f9db00fd390 msgr2=0x7f9db00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:23.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 -- 172.21.15.18:0/3184553200 shutdown_connections 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 -- 172.21.15.18:0/3184553200 wait complete. 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 Processor -- start 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.101+0000 7f9db649e640 1 -- start start 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db649e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0101c00 0x7f9db0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db649e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9db0102e00 0x7f9db00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db649e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db01037c0 0x7f9db0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db649e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9db010d860 con 0x7f9db01037c0 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db649e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9db010d6e0 con 0x7f9db0101c00 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db649e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9db010d9e0 con 0x7f9db0102e00 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db4a3b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db01037c0 0x7f9db0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9daf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9db0102e00 0x7f9db00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db4a3b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db01037c0 0x7f9db0074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53304/0 (socket says 172.21.15.18:53304) 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9daf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9db0102e00 0x7f9db00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:60798/0 (socket says 172.21.15.18:60798) 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db4a3b640 1 -- 172.21.15.18:0/3577622343 learned_addr learned my addr 172.21.15.18:0/3577622343 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9daffff640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0101c00 0x7f9db0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db4a3b640 1 -- 172.21.15.18:0/3577622343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9db0102e00 msgr2=0x7f9db00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db4a3b640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9db0102e00 0x7f9db00745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db4a3b640 1 -- 172.21.15.18:0/3577622343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0101c00 msgr2=0x7f9db0075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db4a3b640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0101c00 0x7f9db0075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db4a3b640 1 -- 172.21.15.18:0/3577622343 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db00753e0 con 0x7f9db01037c0 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9daf7fe640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9db0102e00 0x7f9db00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:48:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9daffff640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0101c00 0x7f9db0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.102+0000 7f9db4a3b640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db01037c0 0x7f9db0074b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9da8005e30 tx=0x7f9da8031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.103+0000 7f9dad7fa640 1 -- 172.21.15.18:0/3577622343 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8003c30 con 0x7f9db01037c0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.103+0000 7f9dad7fa640 1 -- 172.21.15.18:0/3577622343 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9da8003dd0 con 0x7f9db01037c0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.103+0000 7f9db649e640 1 -- 172.21.15.18:0/3577622343 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db01a1fb0 con 0x7f9db01037c0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.103+0000 7f9dad7fa640 1 -- 172.21.15.18:0/3577622343 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da802fde0 con 0x7f9db01037c0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.103+0000 7f9db649e640 1 -- 172.21.15.18:0/3577622343 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db01a24b0 con 0x7f9db01037c0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.104+0000 7f9db649e640 1 -- 172.21.15.18:0/3577622343 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db0109000 con 0x7f9db01037c0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.105+0000 7f9dad7fa640 1 -- 172.21.15.18:0/3577622343 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9da8004050 con 0x7f9db01037c0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.105+0000 7f9dad7fa640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d980a32c0 0x7f9d980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.106+0000 7f9daffff640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d980a32c0 0x7f9d980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.106+0000 7f9dad7fa640 1 -- 172.21.15.18:0/3577622343 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5533+0+0 (secure 0 0 0) 0x7f9da80f0220 con 0x7f9db01037c0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.106+0000 7f9daffff640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d980a32c0 0x7f9d980a5780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9da0005d00 tx=0x7f9da0005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.110+0000 7f9dad7fa640 1 -- 172.21.15.18:0/3577622343 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9da80bd980 con 0x7f9db01037c0 2024-09-19T09:48:23.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='osd.8 [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:48:23.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:48:23.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:23.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:23.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:23.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:23.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:23.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:23.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:23.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:23.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:22 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:23.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:23.294+0000 7f9db649e640 1 -- 172.21.15.18:0/3577622343 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9db0062630 con 0x7f9d980a32c0 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi162 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='osd.8 [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:24.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:24.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:24.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:48:24.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:48:24.012 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:24.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:24.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi162 2024-09-19T09:48:24.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-19T09:48:24.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:24.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:48:24.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T09:48:24.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='osd.8 [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:48:24.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:24.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:48:24.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:24.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:24.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:24.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:48:24.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:48:24.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:24.163 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T09:48:23.688+0000 7f925074d640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T09:48:24.163 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T09:48:23.698+0000 7f924cd87640 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:48:24.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:24.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi162 2024-09-19T09:48:24.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-19T09:48:24.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:24.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:48:24.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T09:48:24.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='osd.8 [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:48:24.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:24.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:48:24.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:24.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:24.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:24.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:48:24.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:48:24.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:25.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:24 smithi018 ceph-mon[30956]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:48:25.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:24 smithi018 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:48:25.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:24 smithi018 ceph-mon[30956]: osdmap e56: 9 total, 8 up, 9 in 2024-09-19T09:48:25.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:25.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:25.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:24 smithi049 ceph-mon[34858]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:48:25.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:24 smithi049 ceph-mon[34858]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:48:25.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:24 smithi049 ceph-mon[34858]: osdmap e56: 9 total, 8 up, 9 in 2024-09-19T09:48:25.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:24 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:25.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:24 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:25.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:24 smithi162 ceph-mon[35174]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:48:25.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:24 smithi162 ceph-mon[35174]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:48:25.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:24 smithi162 ceph-mon[35174]: osdmap e56: 9 total, 8 up, 9 in 2024-09-19T09:48:25.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:24 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:25.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:24 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:26.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:25 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:48:26.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:25 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:48:26.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:25 smithi018 ceph-mon[30956]: pgmap v193: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:26.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:26.111 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:25 smithi018 ceph-mon[30956]: osd.8 [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] boot 2024-09-19T09:48:26.112 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:25 smithi018 ceph-mon[30956]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T09:48:26.112 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:26.112 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:25 smithi018 ceph-mon[30956]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T09:48:26.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:25 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:48:26.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:25 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:48:26.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:25 smithi049 ceph-mon[34858]: pgmap v193: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:26.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:26.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:25 smithi049 ceph-mon[34858]: osd.8 [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] boot 2024-09-19T09:48:26.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:25 smithi049 ceph-mon[34858]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T09:48:26.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:26.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:25 smithi049 ceph-mon[34858]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T09:48:26.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:25 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:48:26.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:25 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:48:26.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:25 smithi162 ceph-mon[35174]: pgmap v193: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:48:26.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:26.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:25 smithi162 ceph-mon[35174]: osd.8 [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] boot 2024-09-19T09:48:26.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:25 smithi162 ceph-mon[35174]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T09:48:26.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:48:26.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:25 smithi162 ceph-mon[35174]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T09:48:26.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2681179365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ba61d77-2981-4ff0-8253-e8a4aacf19b6"}]: dispatch 2024-09-19T09:48:26.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2681179365' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ba61d77-2981-4ff0-8253-e8a4aacf19b6"}]': finished 2024-09-19T09:48:26.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:26 smithi018 ceph-mon[30956]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:48:26.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:26.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/34111983' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:48:27.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:26 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2681179365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ba61d77-2981-4ff0-8253-e8a4aacf19b6"}]: dispatch 2024-09-19T09:48:27.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:26 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2681179365' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ba61d77-2981-4ff0-8253-e8a4aacf19b6"}]': finished 2024-09-19T09:48:27.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:26 smithi049 ceph-mon[34858]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:48:27.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:27.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:26 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/34111983' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:48:27.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:26 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2681179365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ba61d77-2981-4ff0-8253-e8a4aacf19b6"}]: dispatch 2024-09-19T09:48:27.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:26 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2681179365' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ba61d77-2981-4ff0-8253-e8a4aacf19b6"}]': finished 2024-09-19T09:48:27.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:26 smithi162 ceph-mon[35174]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:48:27.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:27.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:26 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/34111983' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:48:28.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:27 smithi018 ceph-mon[30956]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:28.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:27 smithi018 ceph-mon[30956]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:48:28.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:27 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:28.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:27 smithi049 ceph-mon[34858]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:28.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:27 smithi049 ceph-mon[34858]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:48:28.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:27 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:28.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:27 smithi162 ceph-mon[35174]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:28.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:27 smithi162 ceph-mon[35174]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:48:28.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:27 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:29.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:28 smithi018 ceph-mon[30956]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T09:48:29.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:28 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:29.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:28 smithi049 ceph-mon[34858]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T09:48:29.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:28 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:29.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:28 smithi162 ceph-mon[35174]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T09:48:29.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:28 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:30.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:29 smithi018 ceph-mon[30956]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:30.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:29 smithi049 ceph-mon[34858]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:30.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:29 smithi162 ceph-mon[35174]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:32.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:31 smithi018 ceph-mon[30956]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-19T09:48:32.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:31 smithi049 ceph-mon[34858]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-19T09:48:32.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:31 smithi162 ceph-mon[35174]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-19T09:48:34.025 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:33 smithi018 ceph-mon[30956]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T09:48:34.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:33 smithi049 ceph-mon[34858]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T09:48:34.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:33 smithi162 ceph-mon[35174]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T09:48:35.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:35 smithi018 ceph-mon[30956]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:48:35.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:48:35.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:35.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:35 smithi018 ceph-mon[30956]: Deploying daemon osd.9 on smithi018 2024-09-19T09:48:36.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:35 smithi049 ceph-mon[34858]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:48:36.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:35 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:48:36.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:35 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:36.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:35 smithi049 ceph-mon[34858]: Deploying daemon osd.9 on smithi018 2024-09-19T09:48:36.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:35 smithi162 ceph-mon[35174]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:48:36.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:35 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:48:36.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:35 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:36.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:35 smithi162 ceph-mon[35174]: Deploying daemon osd.9 on smithi018 2024-09-19T09:48:38.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:37 smithi018 ceph-mon[30956]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T09:48:38.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:37 smithi049 ceph-mon[34858]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T09:48:38.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:37 smithi162 ceph-mon[35174]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T09:48:40.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:39 smithi018 ceph-mon[30956]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T09:48:40.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:39 smithi049 ceph-mon[34858]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T09:48:40.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:39 smithi162 ceph-mon[35174]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T09:48:41.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:40 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:41.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:40 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:41.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:40 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:41.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:40 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:41.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:40 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:41.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:40 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:41.225 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:41.225 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:41.225 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:42.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:41 smithi018 ceph-mon[30956]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:48:42.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:41 smithi049 ceph-mon[34858]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:48:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:41 smithi162 ceph-mon[35174]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:48:44.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:43 smithi049 ceph-mon[34858]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:44.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:43 smithi162 ceph-mon[35174]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:44.229 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:43 smithi018 ceph-mon[30956]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:44.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.268+0000 7f9dad7fa640 1 -- 172.21.15.18:0/3577622343 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9db0062630 con 0x7f9d980a32c0 2024-09-19T09:48:44.271 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 9 on host 'smithi018' 2024-09-19T09:48:44.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 -- 172.21.15.18:0/3577622343 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d980a32c0 msgr2=0x7f9d980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:44.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d980a32c0 0x7f9d980a5780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9da0005d00 tx=0x7f9da0005c90 comp rx=0 tx=0).stop 2024-09-19T09:48:44.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 -- 172.21.15.18:0/3577622343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db01037c0 msgr2=0x7f9db0074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:44.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db01037c0 0x7f9db0074b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9da8005e30 tx=0x7f9da8031ee0 comp rx=0 tx=0).stop 2024-09-19T09:48:44.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 -- 172.21.15.18:0/3577622343 shutdown_connections 2024-09-19T09:48:44.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d980a32c0 0x7f9d980a5780 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:44.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9db01037c0 0x7f9db0074b20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:44.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9db0102e00 0x7f9db00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:44.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 --2- 172.21.15.18:0/3577622343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0101c00 0x7f9db0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:44.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 -- 172.21.15.18:0/3577622343 >> 172.21.15.18:0/3577622343 conn(0x7f9db00fd390 msgr2=0x7f9db01061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:44.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 -- 172.21.15.18:0/3577622343 shutdown_connections 2024-09-19T09:48:44.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:48:44.271+0000 7f9db649e640 1 -- 172.21.15.18:0/3577622343 wait complete. 2024-09-19T09:48:44.834 DEBUG:teuthology.orchestra.run.smithi018:osd.9> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T09:48:44.837 INFO:tasks.cephadm:Deploying osd.10 on smithi049 with /dev/vg_nvme/lv_1... 2024-09-19T09:48:44.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:48:45.105 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:48:45.489 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.489 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.489 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.489 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:45.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:46 smithi018 ceph-mon[30956]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:46.581 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:46 smithi049 ceph-mon[34858]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:46.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:46 smithi162 ceph-mon[35174]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:47.301 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:47 smithi018 ceph-mon[30956]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:48:47.301 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 09:48:47 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T09:48:47.028+0000 7fe073f50640 -1 osd.9 0 log_to_monitors true 2024-09-19T09:48:47.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:47 smithi049 ceph-mon[34858]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:48:47.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:47 smithi162 ceph-mon[35174]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:48:47.767 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:48:47.793 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_1 2024-09-19T09:48:48.059 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:48:48.433 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:48 smithi049 ceph-mon[34858]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:48.433 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:48 smithi049 ceph-mon[34858]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:48:48.433 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:48 smithi049 ceph-mon[34858]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T09:48:48.433 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:48 smithi049 ceph-mon[34858]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:48:48.433 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:48 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:48.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.517+0000 7f28b5009640 1 -- 172.21.15.49:0/2947496507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b01026d0 msgr2=0x7f28b0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:48.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.517+0000 7f28b5009640 1 --2- 172.21.15.49:0/2947496507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b01026d0 0x7f28b0108f60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009ca0 tx=0x7f28a802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:48:48.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.517+0000 7f28b5009640 1 -- 172.21.15.49:0/2947496507 shutdown_connections 2024-09-19T09:48:48.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.517+0000 7f28b5009640 1 --2- 172.21.15.49:0/2947496507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b01026d0 0x7f28b0108f60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:48.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.517+0000 7f28b5009640 1 --2- 172.21.15.49:0/2947496507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28b0101d10 0x7f28b0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:48.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.517+0000 7f28b5009640 1 --2- 172.21.15.49:0/2947496507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b0100b10 0x7f28b0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:48.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.517+0000 7f28b5009640 1 -- 172.21.15.49:0/2947496507 >> 172.21.15.49:0/2947496507 conn(0x7f28b00fc2a0 msgr2=0x7f28b00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:48:48.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.517+0000 7f28b5009640 1 -- 172.21.15.49:0/2947496507 shutdown_connections 2024-09-19T09:48:48.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.517+0000 7f28b5009640 1 -- 172.21.15.49:0/2947496507 wait complete. 2024-09-19T09:48:48.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.518+0000 7f28b5009640 1 Processor -- start 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.518+0000 7f28b5009640 1 -- start start 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.518+0000 7f28b5009640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b0100b10 0x7f28b0197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.518+0000 7f28b5009640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28b0101d10 0x7f28b0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.518+0000 7f28b5009640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b01026d0 0x7f28b019f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28b5009640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28b010c7e0 con 0x7f28b0101d10 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28b5009640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f28b010c660 con 0x7f28b0100b10 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28b5009640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28b010c960 con 0x7f28b01026d0 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28aed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b0100b10 0x7f28b0197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28aed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b0100b10 0x7f28b0197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47936/0 (socket says 172.21.15.49:47936) 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28aed9d640 1 -- 172.21.15.49:0/3379396331 learned_addr learned my addr 172.21.15.49:0/3379396331 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:48:48.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28ae59c640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28b0101d10 0x7f28b0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28af59e640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b01026d0 0x7f28b019f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28aed9d640 1 -- 172.21.15.49:0/3379396331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b01026d0 msgr2=0x7f28b019f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28aed9d640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b01026d0 0x7f28b019f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28aed9d640 1 -- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28b0101d10 msgr2=0x7f28b0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28aed9d640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28b0101d10 0x7f28b0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28aed9d640 1 -- 172.21.15.49:0/3379396331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b019fb20 con 0x7f28b0100b10 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28ae59c640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28b0101d10 0x7f28b0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28af59e640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b01026d0 0x7f28b019f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28aed9d640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b0100b10 0x7f28b0197ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f28a000e9c0 tx=0x7f28a000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28a7fff640 1 -- 172.21.15.49:0/3379396331 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a000cd80 con 0x7f28b0100b10 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28a7fff640 1 -- 172.21.15.49:0/3379396331 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28a00035f0 con 0x7f28b0100b10 2024-09-19T09:48:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28b5009640 1 -- 172.21.15.49:0/3379396331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b019fe10 con 0x7f28b0100b10 2024-09-19T09:48:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28a7fff640 1 -- 172.21.15.49:0/3379396331 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a0010690 con 0x7f28b0100b10 2024-09-19T09:48:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.519+0000 7f28b5009640 1 -- 172.21.15.49:0/3379396331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b01a0260 con 0x7f28b0100b10 2024-09-19T09:48:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.521+0000 7f28b5009640 1 -- 172.21.15.49:0/3379396331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b01a0520 con 0x7f28b0100b10 2024-09-19T09:48:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.522+0000 7f28a7fff640 1 -- 172.21.15.49:0/3379396331 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f28a00037a0 con 0x7f28b0100b10 2024-09-19T09:48:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.523+0000 7f28a7fff640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f289c0a32f0 0x7f289c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:48:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.523+0000 7f28a7fff640 1 -- 172.21.15.49:0/3379396331 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5981+0+0 (secure 0 0 0) 0x7f28a00cf400 con 0x7f28b0100b10 2024-09-19T09:48:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.523+0000 7f28ae59c640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f289c0a32f0 0x7f289c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:48:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.523+0000 7f28ae59c640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f289c0a32f0 0x7f289c0a57b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f28b0199410 tx=0x7f2898005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:48:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.527+0000 7f28a7fff640 1 -- 172.21.15.49:0/3379396331 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f28a009ca40 con 0x7f28b0100b10 2024-09-19T09:48:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:48 smithi018 ceph-mon[30956]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:48.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:48 smithi018 ceph-mon[30956]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:48:48.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:48 smithi018 ceph-mon[30956]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T09:48:48.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:48 smithi018 ceph-mon[30956]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:48:48.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:48 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:48.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 09:48:48 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T09:48:48.284+0000 7fe06f6b0640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T09:48:48.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 09:48:48 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T09:48:48.296+0000 7fe06bcea640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:48:48.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:48 smithi162 ceph-mon[35174]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:48.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:48 smithi162 ceph-mon[35174]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:48:48.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:48 smithi162 ceph-mon[35174]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T09:48:48.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:48 smithi162 ceph-mon[35174]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T09:48:48.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:48 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:48.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:48:48.710+0000 7f28b5009640 1 -- 172.21.15.49:0/3379396331 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f28b00fe4b0 con 0x7f289c0a32f0 2024-09-19T09:48:49.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:48:49.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:49.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:49.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:48:49.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:48:49.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:49.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:49.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:49.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:49.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:48:49.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T09:48:49.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:48:49.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:48:49.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:49.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:49.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:49.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:49.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T09:48:49.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T09:48:49.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:49.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:49.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:48:49.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:48:49.665 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:48:50.463 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:50 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:48:50.463 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:50 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:48:50.463 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:50 smithi049 ceph-mon[34858]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:50.463 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:50 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi018 2024-09-19T09:48:50.463 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:50 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-19T09:48:50.463 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:50 smithi049 ceph-mon[34858]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:48:50.463 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:50 smithi049 ceph-mon[34858]: osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] boot 2024-09-19T09:48:50.463 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:50 smithi049 ceph-mon[34858]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T09:48:50.463 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:50.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:50 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:48:50.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:50 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:48:50.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:50 smithi018 ceph-mon[30956]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:50.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:50 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi018 2024-09-19T09:48:50.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:50 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-19T09:48:50.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:50 smithi018 ceph-mon[30956]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:48:50.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:50 smithi018 ceph-mon[30956]: osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] boot 2024-09-19T09:48:50.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:50 smithi018 ceph-mon[30956]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T09:48:50.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:50 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:48:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:50 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:48:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:50 smithi162 ceph-mon[35174]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:48:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:50 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi018 2024-09-19T09:48:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:50 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-19T09:48:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:50 smithi162 ceph-mon[35174]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:48:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:50 smithi162 ceph-mon[35174]: osd.9 [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] boot 2024-09-19T09:48:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:50 smithi162 ceph-mon[35174]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T09:48:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:48:51.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:51 smithi018 ceph-mon[30956]: osdmap e65: 10 total, 10 up, 10 in 2024-09-19T09:48:51.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:51 smithi018 ceph-mon[30956]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:51.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:51 smithi018 ceph-mon[30956]: from='client.? 172.21.15.49:0/3039321053' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1f71af-43ea-4fa2-b5bb-f502936f4e6b"}]: dispatch 2024-09-19T09:48:51.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:51 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1f71af-43ea-4fa2-b5bb-f502936f4e6b"}]: dispatch 2024-09-19T09:48:51.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:51 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da1f71af-43ea-4fa2-b5bb-f502936f4e6b"}]': finished 2024-09-19T09:48:51.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:51 smithi018 ceph-mon[30956]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T09:48:51.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:48:51.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:51 smithi049 ceph-mon[34858]: osdmap e65: 10 total, 10 up, 10 in 2024-09-19T09:48:51.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:51 smithi049 ceph-mon[34858]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:51.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:51 smithi049 ceph-mon[34858]: from='client.? 172.21.15.49:0/3039321053' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1f71af-43ea-4fa2-b5bb-f502936f4e6b"}]: dispatch 2024-09-19T09:48:51.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:51 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1f71af-43ea-4fa2-b5bb-f502936f4e6b"}]: dispatch 2024-09-19T09:48:51.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:51 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da1f71af-43ea-4fa2-b5bb-f502936f4e6b"}]': finished 2024-09-19T09:48:51.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:51 smithi049 ceph-mon[34858]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T09:48:51.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:48:51.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:51 smithi162 ceph-mon[35174]: osdmap e65: 10 total, 10 up, 10 in 2024-09-19T09:48:51.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:51 smithi162 ceph-mon[35174]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:51.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:51 smithi162 ceph-mon[35174]: from='client.? 172.21.15.49:0/3039321053' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1f71af-43ea-4fa2-b5bb-f502936f4e6b"}]: dispatch 2024-09-19T09:48:51.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:51 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1f71af-43ea-4fa2-b5bb-f502936f4e6b"}]: dispatch 2024-09-19T09:48:51.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:51 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da1f71af-43ea-4fa2-b5bb-f502936f4e6b"}]': finished 2024-09-19T09:48:51.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:51 smithi162 ceph-mon[35174]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T09:48:51.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:48:52.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:52 smithi018 ceph-mon[30956]: from='client.? 172.21.15.49:0/4187424959' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:48:52.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:52 smithi049 ceph-mon[34858]: from='client.? 172.21.15.49:0/4187424959' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:48:52.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:52 smithi162 ceph-mon[35174]: from='client.? 172.21.15.49:0/4187424959' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:48:53.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:53 smithi018 ceph-mon[30956]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:53.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:53 smithi049 ceph-mon[34858]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:53.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:53 smithi162 ceph-mon[35174]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:55.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:55 smithi018 ceph-mon[30956]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:55.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:55 smithi049 ceph-mon[34858]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:55.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:55 smithi162 ceph-mon[35174]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:57.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:57 smithi018 ceph-mon[30956]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:57.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:57 smithi049 ceph-mon[34858]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:57.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:57 smithi162 ceph-mon[35174]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:59.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:48:59 smithi018 ceph-mon[30956]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:59.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:48:59 smithi049 ceph-mon[34858]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:48:59.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:48:59 smithi162 ceph-mon[35174]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:00.527 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:49:00.527 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:00 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:00.527 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:00 smithi049 ceph-mon[34858]: Deploying daemon osd.10 on smithi049 2024-09-19T09:49:00.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:49:00.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:00 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:00.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:00 smithi162 ceph-mon[35174]: Deploying daemon osd.10 on smithi049 2024-09-19T09:49:00.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:49:00.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:00 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:00.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:00 smithi018 ceph-mon[30956]: Deploying daemon osd.10 on smithi049 2024-09-19T09:49:01.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:01 smithi049 ceph-mon[34858]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:01.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:01 smithi162 ceph-mon[35174]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:01.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:01 smithi018 ceph-mon[30956]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:03.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:03 smithi049 ceph-mon[34858]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:03.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:03 smithi162 ceph-mon[35174]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:03.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:03 smithi018 ceph-mon[30956]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:05.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:05 smithi049 ceph-mon[34858]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:05.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:05 smithi162 ceph-mon[35174]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:05.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:05 smithi018 ceph-mon[30956]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:06.616 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:06.616 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:06.617 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:06.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:06.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:06.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:06.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:06.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:06.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:07.743 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:07 smithi049 ceph-mon[34858]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:07.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:07 smithi018 ceph-mon[30956]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:07.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:07 smithi162 ceph-mon[35174]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:08.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.854+0000 7f28a7fff640 1 -- 172.21.15.49:0/3379396331 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f28b00fe4b0 con 0x7f289c0a32f0 2024-09-19T09:49:08.856 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 10 on host 'smithi049' 2024-09-19T09:49:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.856+0000 7f28b5009640 1 -- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f289c0a32f0 msgr2=0x7f289c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.856+0000 7f28b5009640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f289c0a32f0 0x7f289c0a57b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f28b0199410 tx=0x7f2898005f90 comp rx=0 tx=0).stop 2024-09-19T09:49:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.856+0000 7f28b5009640 1 -- 172.21.15.49:0/3379396331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b0100b10 msgr2=0x7f28b0197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.856+0000 7f28b5009640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b0100b10 0x7f28b0197ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f28a000e9c0 tx=0x7f28a000ee80 comp rx=0 tx=0).stop 2024-09-19T09:49:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.856+0000 7f28b5009640 1 -- 172.21.15.49:0/3379396331 shutdown_connections 2024-09-19T09:49:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.856+0000 7f28b5009640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f289c0a32f0 0x7f289c0a57b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.856+0000 7f28b5009640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b01026d0 0x7f28b019f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.856+0000 7f28b5009640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28b0101d10 0x7f28b0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.856+0000 7f28b5009640 1 --2- 172.21.15.49:0/3379396331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b0100b10 0x7f28b0197ef0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:08.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.856+0000 7f28b5009640 1 -- 172.21.15.49:0/3379396331 >> 172.21.15.49:0/3379396331 conn(0x7f28b00fc2a0 msgr2=0x7f28b00fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:08.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.857+0000 7f28b5009640 1 -- 172.21.15.49:0/3379396331 shutdown_connections 2024-09-19T09:49:08.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:49:08.857+0000 7f28b5009640 1 -- 172.21.15.49:0/3379396331 wait complete. 2024-09-19T09:49:09.471 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.471 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.471 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:09.471 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:09.471 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.471 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:09.471 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.471 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.499 DEBUG:teuthology.orchestra.run.smithi049:osd.10> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T09:49:09.501 INFO:tasks.cephadm:Deploying osd.11 on smithi162 with /dev/vg_nvme/lv_1... 2024-09-19T09:49:09.502 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:49:09.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:09.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:09.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:09.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.530 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:09.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:09.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:09.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:09.759 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:49:10.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:10 smithi162 ceph-mon[35174]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:10.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:10 smithi018 ceph-mon[30956]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:10.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:10 smithi049 ceph-mon[34858]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:12.085 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 09:49:11 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T09:49:11.742+0000 7fe19b7e2640 -1 osd.10 0 log_to_monitors true 2024-09-19T09:49:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:12 smithi049 ceph-mon[34858]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:12 smithi049 ceph-mon[34858]: from='osd.10 [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:49:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:12 smithi049 ceph-mon[34858]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:49:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:12 smithi162 ceph-mon[35174]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:12 smithi162 ceph-mon[35174]: from='osd.10 [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:49:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:12 smithi162 ceph-mon[35174]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:49:12.537 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:49:12.564 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-09-19T09:49:12.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:12 smithi018 ceph-mon[30956]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:12.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:12 smithi018 ceph-mon[30956]: from='osd.10 [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:49:12.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:12 smithi018 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:49:12.857 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:49:13.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.303+0000 7f3fc113d640 1 -- 172.21.15.162:0/262181691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc102690 msgr2=0x7f3fbc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:13.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.303+0000 7f3fc113d640 1 --2- 172.21.15.162:0/262181691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc102690 0x7f3fbc108f20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009ca0 tx=0x7f3fb402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:49:13.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.303+0000 7f3fc113d640 1 -- 172.21.15.162:0/262181691 shutdown_connections 2024-09-19T09:49:13.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.303+0000 7f3fc113d640 1 --2- 172.21.15.162:0/262181691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc102690 0x7f3fbc108f20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:13.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.303+0000 7f3fc113d640 1 --2- 172.21.15.162:0/262181691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fbc101cd0 0x7f3fbc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:13.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.303+0000 7f3fc113d640 1 --2- 172.21.15.162:0/262181691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fbc100ad0 0x7f3fbc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.303+0000 7f3fc113d640 1 -- 172.21.15.162:0/262181691 >> 172.21.15.162:0/262181691 conn(0x7f3fbc0fc280 msgr2=0x7f3fbc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.303+0000 7f3fc113d640 1 -- 172.21.15.162:0/262181691 shutdown_connections 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.303+0000 7f3fc113d640 1 -- 172.21.15.162:0/262181691 wait complete. 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.304+0000 7f3fc113d640 1 Processor -- start 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.304+0000 7f3fc113d640 1 -- start start 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.304+0000 7f3fc113d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc100ad0 0x7f3fbc196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.304+0000 7f3fc113d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fbc101cd0 0x7f3fbc197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.304+0000 7f3fc113d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fbc102690 0x7f3fbc19e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fc113d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc10c7b0 con 0x7f3fbc101cd0 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fc113d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc10c630 con 0x7f3fbc102690 2024-09-19T09:49:13.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fc113d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc10c930 con 0x7f3fbc100ad0 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc100ad0 0x7f3fbc196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc100ad0 0x7f3fbc196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55780/0 (socket says 172.21.15.162:55780) 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbad9d640 1 -- 172.21.15.162:0/2466570761 learned_addr learned my addr 172.21.15.162:0/2466570761 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fba59c640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fbc101cd0 0x7f3fbc197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbb59e640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fbc102690 0x7f3fbc19e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbad9d640 1 -- 172.21.15.162:0/2466570761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fbc102690 msgr2=0x7f3fbc19e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbad9d640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fbc102690 0x7f3fbc19e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbad9d640 1 -- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fbc101cd0 msgr2=0x7f3fbc197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbad9d640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fbc101cd0 0x7f3fbc197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbad9d640 1 -- 172.21.15.162:0/2466570761 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc19ea30 con 0x7f3fbc100ad0 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbb59e640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fbc102690 0x7f3fbc19e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:49:13.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fba59c640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fbc101cd0 0x7f3fbc197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:49:13.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fbad9d640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc100ad0 0x7f3fbc196e00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009860 tx=0x7f3fac009d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:13.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fa3fff640 1 -- 172.21.15.162:0/2466570761 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac004020 con 0x7f3fbc100ad0 2024-09-19T09:49:13.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fc113d640 1 -- 172.21.15.162:0/2466570761 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fbc069fd0 con 0x7f3fbc100ad0 2024-09-19T09:49:13.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fa3fff640 1 -- 172.21.15.162:0/2466570761 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fac007c80 con 0x7f3fbc100ad0 2024-09-19T09:49:13.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fa3fff640 1 -- 172.21.15.162:0/2466570761 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac003b90 con 0x7f3fbc100ad0 2024-09-19T09:49:13.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.305+0000 7f3fc113d640 1 -- 172.21.15.162:0/2466570761 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fbc06a5e0 con 0x7f3fbc100ad0 2024-09-19T09:49:13.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.307+0000 7f3fc113d640 1 -- 172.21.15.162:0/2466570761 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fbc107e70 con 0x7f3fbc100ad0 2024-09-19T09:49:13.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.308+0000 7f3fa3fff640 1 -- 172.21.15.162:0/2466570761 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3fac003d30 con 0x7f3fbc100ad0 2024-09-19T09:49:13.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.309+0000 7f3fa3fff640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3fa40a3270 0x7f3fa40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:13.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.309+0000 7f3fa3fff640 1 -- 172.21.15.162:0/2466570761 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6414+0+0 (secure 0 0 0) 0x7f3fac0d0f60 con 0x7f3fbc100ad0 2024-09-19T09:49:13.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.309+0000 7f3fba59c640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3fa40a3270 0x7f3fa40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:13.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.309+0000 7f3fba59c640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3fa40a3270 0x7f3fa40a5730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc198320 tx=0x7f3fb0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:13.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.312+0000 7f3fa3fff640 1 -- 172.21.15.162:0/2466570761 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3fac09e350 con 0x7f3fbc100ad0 2024-09-19T09:49:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:49:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='osd.10 [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:49:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T09:49:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:49:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:13.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:13.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:13.493+0000 7f3fc113d640 1 -- 172.21.15.162:0/2466570761 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3fbc06a970 con 0x7f3fa40a3270 2024-09-19T09:49:13.632 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T09:49:13.208+0000 7fe196f42640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T09:49:13.633 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T09:49:13.223+0000 7fe19357c640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:49:13.633 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:49:13.633 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='osd.10 [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:49:13.633 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T09:49:13.633 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:13.633 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:49:13.633 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.633 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:13.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:13.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:49:13.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='osd.10 [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:49:13.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T09:49:13.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:13.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:49:13.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:13.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:13.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:13.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:13.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:14 smithi162 ceph-mon[35174]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:14 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi049 2024-09-19T09:49:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:14 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi049 to 4272M 2024-09-19T09:49:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:14 smithi162 ceph-mon[35174]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:49:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:14 smithi162 ceph-mon[35174]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T09:49:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:49:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:49:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:14.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:14 smithi018 ceph-mon[30956]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:14.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:14 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi049 2024-09-19T09:49:14.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:14 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi049 to 4272M 2024-09-19T09:49:14.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:14 smithi018 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:49:14.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:14 smithi018 ceph-mon[30956]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T09:49:14.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:14.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:14.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:49:14.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:49:14.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:14.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:14 smithi049 ceph-mon[34858]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:49:14.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:14 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi049 2024-09-19T09:49:14.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:14 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi049 to 4272M 2024-09-19T09:49:14.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:14 smithi049 ceph-mon[34858]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T09:49:14.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:14 smithi049 ceph-mon[34858]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T09:49:14.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:14.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:14.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:49:14.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:49:14.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:15 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:49:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:15 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:49:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:15 smithi162 ceph-mon[35174]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:49:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:15 smithi162 ceph-mon[35174]: osd.10 [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] boot 2024-09-19T09:49:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:15 smithi162 ceph-mon[35174]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T09:49:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:15 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:15.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:15 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:49:15.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:15 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:49:15.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:15 smithi018 ceph-mon[30956]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:49:15.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:15 smithi018 ceph-mon[30956]: osd.10 [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] boot 2024-09-19T09:49:15.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:15 smithi018 ceph-mon[30956]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T09:49:15.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:15.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:15 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:49:15.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:15 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:49:15.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:15 smithi049 ceph-mon[34858]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:49:15.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:15 smithi049 ceph-mon[34858]: osd.10 [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] boot 2024-09-19T09:49:15.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:15 smithi049 ceph-mon[34858]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T09:49:15.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:15 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:49:16.533 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:16 smithi162 ceph-mon[35174]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:16.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:16 smithi162 ceph-mon[35174]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T09:49:16.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:16 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/3040648450' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1202ee7d-aee9-4ee8-97cc-5ca3eaa99367"}]: dispatch 2024-09-19T09:49:16.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:16 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1202ee7d-aee9-4ee8-97cc-5ca3eaa99367"}]: dispatch 2024-09-19T09:49:16.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:16 smithi162 ceph-mon[35174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1202ee7d-aee9-4ee8-97cc-5ca3eaa99367"}]': finished 2024-09-19T09:49:16.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:16 smithi162 ceph-mon[35174]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:49:16.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:16 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:16.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:16 smithi018 ceph-mon[30956]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:16.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:16 smithi018 ceph-mon[30956]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T09:49:16.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:16 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/3040648450' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1202ee7d-aee9-4ee8-97cc-5ca3eaa99367"}]: dispatch 2024-09-19T09:49:16.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:16 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1202ee7d-aee9-4ee8-97cc-5ca3eaa99367"}]: dispatch 2024-09-19T09:49:16.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:16 smithi018 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1202ee7d-aee9-4ee8-97cc-5ca3eaa99367"}]': finished 2024-09-19T09:49:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:16 smithi018 ceph-mon[30956]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:49:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:16 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:16 smithi049 ceph-mon[34858]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:16 smithi049 ceph-mon[34858]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T09:49:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:16 smithi049 ceph-mon[34858]: from='client.? 172.21.15.162:0/3040648450' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1202ee7d-aee9-4ee8-97cc-5ca3eaa99367"}]: dispatch 2024-09-19T09:49:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:16 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1202ee7d-aee9-4ee8-97cc-5ca3eaa99367"}]: dispatch 2024-09-19T09:49:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:16 smithi049 ceph-mon[34858]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1202ee7d-aee9-4ee8-97cc-5ca3eaa99367"}]': finished 2024-09-19T09:49:16.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:16 smithi049 ceph-mon[34858]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:49:16.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:16 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:17 smithi018 ceph-mon[30956]: from='client.? 172.21.15.162:0/4258311475' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:49:17.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:17 smithi049 ceph-mon[34858]: from='client.? 172.21.15.162:0/4258311475' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:49:17.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:17 smithi162 ceph-mon[35174]: from='client.? 172.21.15.162:0/4258311475' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:49:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:18 smithi018 ceph-mon[30956]: pgmap v234: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:18 smithi018 ceph-mon[30956]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:49:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:18 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:18.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:18 smithi049 ceph-mon[34858]: pgmap v234: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:18.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:18 smithi049 ceph-mon[34858]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:49:18.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:18 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:18.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:18 smithi162 ceph-mon[35174]: pgmap v234: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:18.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:18 smithi162 ceph-mon[35174]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:49:18.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:18 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:19.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:19 smithi018 ceph-mon[30956]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T09:49:19.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:19.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:19 smithi018 ceph-mon[30956]: pgmap v237: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:19.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:19 smithi049 ceph-mon[34858]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T09:49:19.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:19.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:19 smithi049 ceph-mon[34858]: pgmap v237: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:19.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:19 smithi162 ceph-mon[35174]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T09:49:19.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:19.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:19 smithi162 ceph-mon[35174]: pgmap v237: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:21.608 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:21 smithi162 ceph-mon[35174]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T09:49:21.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:21 smithi018 ceph-mon[30956]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T09:49:21.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:21 smithi049 ceph-mon[34858]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T09:49:23.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:23 smithi018 ceph-mon[30956]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T09:49:23.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:23 smithi049 ceph-mon[34858]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T09:49:23.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:23 smithi162 ceph-mon[35174]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T09:49:25.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:25 smithi049 ceph-mon[34858]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:49:25.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:49:25.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:25.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:25 smithi049 ceph-mon[34858]: Deploying daemon osd.11 on smithi162 2024-09-19T09:49:25.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:25 smithi162 ceph-mon[35174]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:49:25.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:49:25.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:25.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:25 smithi162 ceph-mon[35174]: Deploying daemon osd.11 on smithi162 2024-09-19T09:49:25.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:25 smithi018 ceph-mon[30956]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:49:25.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:49:25.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:25.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:25 smithi018 ceph-mon[30956]: Deploying daemon osd.11 on smithi162 2024-09-19T09:49:27.594 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:27 smithi162 ceph-mon[35174]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T09:49:27.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:27 smithi049 ceph-mon[34858]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T09:49:27.687 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:27 smithi018 ceph-mon[30956]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T09:49:29.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:29 smithi049 ceph-mon[34858]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T09:49:29.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:29 smithi162 ceph-mon[35174]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T09:49:29.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:29 smithi018 ceph-mon[30956]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T09:49:31.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:31 smithi049 ceph-mon[34858]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:49:31.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:31.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:31.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:31.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:31 smithi162 ceph-mon[35174]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:49:31.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:31.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:31.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:31.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:31 smithi018 ceph-mon[30956]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:49:31.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:31.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:31.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:33.477 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:33 smithi162 ceph-mon[35174]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:33.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:33 smithi049 ceph-mon[34858]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:33.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:33 smithi018 ceph-mon[30956]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:34.288 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 11 on host 'smithi162' 2024-09-19T09:49:34.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.286+0000 7f3fa3fff640 1 -- 172.21.15.162:0/2466570761 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3fbc06a970 con 0x7f3fa40a3270 2024-09-19T09:49:34.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 -- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3fa40a3270 msgr2=0x7f3fa40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:34.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3fa40a3270 0x7f3fa40a5730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc198320 tx=0x7f3fb0008040 comp rx=0 tx=0).stop 2024-09-19T09:49:34.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 -- 172.21.15.162:0/2466570761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc100ad0 msgr2=0x7f3fbc196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:34.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc100ad0 0x7f3fbc196e00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009860 tx=0x7f3fac009d20 comp rx=0 tx=0).stop 2024-09-19T09:49:34.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 -- 172.21.15.162:0/2466570761 shutdown_connections 2024-09-19T09:49:34.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3fa40a3270 0x7f3fa40a5730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:34.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fbc102690 0x7f3fbc19e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:34.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fbc101cd0 0x7f3fbc197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:34.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 --2- 172.21.15.162:0/2466570761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fbc100ad0 0x7f3fbc196e00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:34.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 -- 172.21.15.162:0/2466570761 >> 172.21.15.162:0/2466570761 conn(0x7f3fbc0fc280 msgr2=0x7f3fbc105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:34.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.289+0000 7f3fc113d640 1 -- 172.21.15.162:0/2466570761 shutdown_connections 2024-09-19T09:49:34.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:34.290+0000 7f3fc113d640 1 -- 172.21.15.162:0/2466570761 wait complete. 2024-09-19T09:49:34.949 DEBUG:teuthology.orchestra.run.smithi162:osd.11> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T09:49:34.951 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T09:49:34.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:49:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:49:35.535 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:35 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.535 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:35 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.535 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:35 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.535 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:35 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:35 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:35 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:35 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:35 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:35 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:35.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.670+0000 7f19f5c2e640 1 -- 172.21.15.18:0/2101522422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19f0102660 msgr2=0x7f19f0104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.670+0000 7f19f5c2e640 1 --2- 172.21.15.18:0/2101522422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19f0102660 0x7f19f0104a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009900 tx=0x7f19e002a410 comp rx=0 tx=0).stop 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.670+0000 7f19f5c2e640 1 -- 172.21.15.18:0/2101522422 shutdown_connections 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.670+0000 7f19f5c2e640 1 --2- 172.21.15.18:0/2101522422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f01078c0 0x7f19f0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.670+0000 7f19f5c2e640 1 --2- 172.21.15.18:0/2101522422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f0104f90 0x7f19f0107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.670+0000 7f19f5c2e640 1 --2- 172.21.15.18:0/2101522422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19f0102660 0x7f19f0104a50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.670+0000 7f19f5c2e640 1 -- 172.21.15.18:0/2101522422 >> 172.21.15.18:0/2101522422 conn(0x7f19f00fc280 msgr2=0x7f19f00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.670+0000 7f19f5c2e640 1 -- 172.21.15.18:0/2101522422 shutdown_connections 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.670+0000 7f19f5c2e640 1 -- 172.21.15.18:0/2101522422 wait complete. 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19f5c2e640 1 Processor -- start 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19f5c2e640 1 -- start start 2024-09-19T09:49:35.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19f5c2e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f0102660 0x7f19f0197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19f5c2e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f0104f90 0x7f19f0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19f5c2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19f01078c0 0x7f19f019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19f5c2e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f19f010d890 con 0x7f19f0104f90 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19f5c2e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f19f010d710 con 0x7f19f0102660 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19f5c2e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19f010da10 con 0x7f19f01078c0 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19eeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f0104f90 0x7f19f0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19eeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f0104f90 0x7f19f0198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59944/0 (socket says 172.21.15.18:59944) 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19eeffd640 1 -- 172.21.15.18:0/3239652212 learned_addr learned my addr 172.21.15.18:0/3239652212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19ef7fe640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f0102660 0x7f19f0197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19effff640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19f01078c0 0x7f19f019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19eeffd640 1 -- 172.21.15.18:0/3239652212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19f01078c0 msgr2=0x7f19f019f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19eeffd640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19f01078c0 0x7f19f019f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19eeffd640 1 -- 172.21.15.18:0/3239652212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f0102660 msgr2=0x7f19f0197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19eeffd640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f0102660 0x7f19f0197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.671+0000 7f19eeffd640 1 -- 172.21.15.18:0/3239652212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f019fb80 con 0x7f19f0104f90 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.672+0000 7f19eeffd640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f0104f90 0x7f19f0198490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f19e400e9f0 tx=0x7f19e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.672+0000 7f19ecff9640 1 -- 172.21.15.18:0/3239652212 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e400ccc0 con 0x7f19f0104f90 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.672+0000 7f19f5c2e640 1 -- 172.21.15.18:0/3239652212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f019fe70 con 0x7f19f0104f90 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.672+0000 7f19ecff9640 1 -- 172.21.15.18:0/3239652212 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e4005500 con 0x7f19f0104f90 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.672+0000 7f19ecff9640 1 -- 172.21.15.18:0/3239652212 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4010690 con 0x7f19f0104f90 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.672+0000 7f19f5c2e640 1 -- 172.21.15.18:0/3239652212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f01a0320 con 0x7f19f0104f90 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.673+0000 7f19f5c2e640 1 -- 172.21.15.18:0/3239652212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f00fdd70 con 0x7f19f0104f90 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.675+0000 7f19ecff9640 1 -- 172.21.15.18:0/3239652212 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f19e40046c0 con 0x7f19f0104f90 2024-09-19T09:49:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.675+0000 7f19ecff9640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19d80a3270 0x7f19d80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:35.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.676+0000 7f19ecff9640 1 -- 172.21.15.18:0/3239652212 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7f19e40cf7b0 con 0x7f19f0104f90 2024-09-19T09:49:35.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.675+0000 7f19ef7fe640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19d80a3270 0x7f19d80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:35.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.676+0000 7f19ef7fe640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19d80a3270 0x7f19d80a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f19e00314e0 tx=0x7f19e0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:35.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.680+0000 7f19ecff9640 1 -- 172.21.15.18:0/3239652212 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f19e4054210 con 0x7f19f0104f90 2024-09-19T09:49:35.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.856+0000 7f19f5c2e640 1 -- 172.21.15.18:0/3239652212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f19f002d9c0 con 0x7f19f0104f90 2024-09-19T09:49:35.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.857+0000 7f19ecff9640 1 -- 172.21.15.18:0/3239652212 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f19e409cab0 con 0x7f19f0104f90 2024-09-19T09:49:35.860 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:49:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 -- 172.21.15.18:0/3239652212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19d80a3270 msgr2=0x7f19d80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19d80a3270 0x7f19d80a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f19e00314e0 tx=0x7f19e0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 -- 172.21.15.18:0/3239652212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f0104f90 msgr2=0x7f19f0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f0104f90 0x7f19f0198490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f19e400e9f0 tx=0x7f19e400edf0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 -- 172.21.15.18:0/3239652212 shutdown_connections 2024-09-19T09:49:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19d80a3270 0x7f19d80a5730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19f01078c0 0x7f19f019f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f0104f90 0x7f19f0198490 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 --2- 172.21.15.18:0/3239652212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19f0102660 0x7f19f0197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 -- 172.21.15.18:0/3239652212 >> 172.21.15.18:0/3239652212 conn(0x7f19f00fc280 msgr2=0x7f19f0102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 -- 172.21.15.18:0/3239652212 shutdown_connections 2024-09-19T09:49:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:35.859+0000 7f19f5c2e640 1 -- 172.21.15.18:0/3239652212 wait complete. 2024-09-19T09:49:36.539 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:36 smithi162 ceph-mon[35174]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:36.539 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:36 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3239652212' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:49:36.592 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:36 smithi018 ceph-mon[30956]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:36.592 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:36 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3239652212' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:49:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726739354,"num_in_osds":12,"osd_in_since":1726739356,"num_remapped_pgs":0} 2024-09-19T09:49:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:36 smithi049 ceph-mon[34858]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:36 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3239652212' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:49:37.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:49:37.894 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:49:37.913 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 09:49:37 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T09:49:37.436+0000 7fd70096b640 -1 osd.11 0 log_to_monitors true 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.365+0000 7f13db2b0640 1 -- 172.21.15.18:0/3666994908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4109a80 msgr2=0x7f13d410bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.365+0000 7f13db2b0640 1 --2- 172.21.15.18:0/3666994908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4109a80 0x7f13d410bf40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009ca0 tx=0x7f13cc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.365+0000 7f13db2b0640 1 -- 172.21.15.18:0/3666994908 shutdown_connections 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.365+0000 7f13db2b0640 1 --2- 172.21.15.18:0/3666994908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4109a80 0x7f13d410bf40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.365+0000 7f13db2b0640 1 --2- 172.21.15.18:0/3666994908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4074c50 0x7f13d40750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.365+0000 7f13db2b0640 1 --2- 172.21.15.18:0/3666994908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4076220 0x7f13d4074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.365+0000 7f13db2b0640 1 -- 172.21.15.18:0/3666994908 >> 172.21.15.18:0/3666994908 conn(0x7f13d40fd390 msgr2=0x7f13d40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13db2b0640 1 -- 172.21.15.18:0/3666994908 shutdown_connections 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13db2b0640 1 -- 172.21.15.18:0/3666994908 wait complete. 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13db2b0640 1 Processor -- start 2024-09-19T09:49:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13db2b0640 1 -- start start 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13db2b0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4074c50 0x7f13d419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13db2b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4076220 0x7f13d419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13db2b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4109a80 0x7f13d41a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13db2b0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f13d410fb00 con 0x7f13d4076220 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13db2b0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f13d410f980 con 0x7f13d4074c50 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13db2b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13d410fc80 con 0x7f13d4109a80 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.366+0000 7f13d884b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4076220 0x7f13d419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13d884b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4076220 0x7f13d419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37576/0 (socket says 172.21.15.18:37576) 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13d884b640 1 -- 172.21.15.18:0/3607923425 learned_addr learned my addr 172.21.15.18:0/3607923425 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13d904c640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4074c50 0x7f13d419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13d984d640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4109a80 0x7f13d41a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13d884b640 1 -- 172.21.15.18:0/3607923425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4109a80 msgr2=0x7f13d41a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13d884b640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4109a80 0x7f13d41a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13d884b640 1 -- 172.21.15.18:0/3607923425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4074c50 msgr2=0x7f13d419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13d884b640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4074c50 0x7f13d419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13d884b640 1 -- 172.21.15.18:0/3607923425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d41a1d30 con 0x7f13d4076220 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13d884b640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4076220 0x7f13d419a640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13c400b4a0 tx=0x7f13c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13ca7fc640 1 -- 172.21.15.18:0/3607923425 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4014070 con 0x7f13d4076220 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13ca7fc640 1 -- 172.21.15.18:0/3607923425 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13c4010af0 con 0x7f13d4076220 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13db2b0640 1 -- 172.21.15.18:0/3607923425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d41a1fc0 con 0x7f13d4076220 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13ca7fc640 1 -- 172.21.15.18:0/3607923425 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4017d10 con 0x7f13d4076220 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.367+0000 7f13db2b0640 1 -- 172.21.15.18:0/3607923425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d41a2520 con 0x7f13d4076220 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.368+0000 7f13db2b0640 1 -- 172.21.15.18:0/3607923425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d4108800 con 0x7f13d4076220 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.370+0000 7f13ca7fc640 1 -- 172.21.15.18:0/3607923425 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f13c4017070 con 0x7f13d4076220 2024-09-19T09:49:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.371+0000 7f13ca7fc640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13c00a32f0 0x7f13c00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.371+0000 7f13d904c640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13c00a32f0 0x7f13c00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.371+0000 7f13ca7fc640 1 -- 172.21.15.18:0/3607923425 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6831+0+0 (secure 0 0 0) 0x7f13c40ce9e0 con 0x7f13d4076220 2024-09-19T09:49:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.371+0000 7f13d904c640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13c00a32f0 0x7f13c00a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f13d0005d00 tx=0x7f13d000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.374+0000 7f13ca7fc640 1 -- 172.21.15.18:0/3607923425 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13c409bc30 con 0x7f13d4076220 2024-09-19T09:49:38.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.553+0000 7f13db2b0640 1 -- 172.21.15.18:0/3607923425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f13d402da10 con 0x7f13d4076220 2024-09-19T09:49:38.556 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:38 smithi018 ceph-mon[30956]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:38.556 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:38 smithi018 ceph-mon[30956]: from='osd.11 [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:49:38.556 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:38 smithi018 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:49:38.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.554+0000 7f13ca7fc640 1 -- 172.21.15.18:0/3607923425 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f13c409b530 con 0x7f13d4076220 2024-09-19T09:49:38.557 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:49:38.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 -- 172.21.15.18:0/3607923425 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13c00a32f0 msgr2=0x7f13c00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:38.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13c00a32f0 0x7f13c00a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f13d0005d00 tx=0x7f13d000b410 comp rx=0 tx=0).stop 2024-09-19T09:49:38.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 -- 172.21.15.18:0/3607923425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4076220 msgr2=0x7f13d419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:38.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4076220 0x7f13d419a640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13c400b4a0 tx=0x7f13c400b960 comp rx=0 tx=0).stop 2024-09-19T09:49:38.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 -- 172.21.15.18:0/3607923425 shutdown_connections 2024-09-19T09:49:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13c00a32f0 0x7f13c00a57b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4109a80 0x7f13d41a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4076220 0x7f13d419a640 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 --2- 172.21.15.18:0/3607923425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4074c50 0x7f13d419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 -- 172.21.15.18:0/3607923425 >> 172.21.15.18:0/3607923425 conn(0x7f13d40fd390 msgr2=0x7f13d41059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 -- 172.21.15.18:0/3607923425 shutdown_connections 2024-09-19T09:49:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:38.556+0000 7f13db2b0640 1 -- 172.21.15.18:0/3607923425 wait complete. 2024-09-19T09:49:38.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:38 smithi049 ceph-mon[34858]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:38.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:38 smithi049 ceph-mon[34858]: from='osd.11 [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:49:38.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:38 smithi049 ceph-mon[34858]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:49:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:38 smithi162 ceph-mon[35174]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:38 smithi162 ceph-mon[35174]: from='osd.11 [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:49:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:38 smithi162 ceph-mon[35174]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:49:39.226 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726739354,"num_in_osds":12,"osd_in_since":1726739356,"num_remapped_pgs":0} 2024-09-19T09:49:39.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:49:39.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='osd.11 [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: Detected new or changed devices on smithi162 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:39.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:39.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:39.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:39.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:39.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:39 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3607923425' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:49:39.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:49:39.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='osd.11 [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: Detected new or changed devices on smithi162 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:39.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:39.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:39.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:39.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:39.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:39 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3607923425' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:49:39.662 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T09:49:39.306+0000 7fd6fc0cb640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T09:49:39.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T09:49:39.322+0000 7fd6f8705640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:49:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:49:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T09:49:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='osd.11 [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:49:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: Detected new or changed devices on smithi162 2024-09-19T09:49:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T09:49:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:49:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:39.665 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:39.665 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:39 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3607923425' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:49:40.227 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:49:40.504 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:49:40.625 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:40 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-19T09:49:40.626 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:40 smithi018 ceph-mon[30956]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:40.626 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:40 smithi018 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:49:40.626 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:40 smithi018 ceph-mon[30956]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T09:49:40.626 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:40.626 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:40 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-19T09:49:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:40 smithi049 ceph-mon[34858]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:40 smithi049 ceph-mon[34858]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:49:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:40 smithi049 ceph-mon[34858]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T09:49:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:40 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:40.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:40 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:40.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:40 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-19T09:49:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:40 smithi162 ceph-mon[35174]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:40 smithi162 ceph-mon[35174]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T09:49:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:40 smithi162 ceph-mon[35174]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T09:49:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:40 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:40 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 -- 172.21.15.18:0/1576196194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4250101770 msgr2=0x7f4250101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 --2- 172.21.15.18:0/1576196194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4250101770 0x7f4250101c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4248009ca0 tx=0x7f424802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:49:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 -- 172.21.15.18:0/1576196194 shutdown_connections 2024-09-19T09:49:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 --2- 172.21.15.18:0/1576196194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4250101770 0x7f4250101c20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 --2- 172.21.15.18:0/1576196194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4250100dd0 0x7f4250101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 --2- 172.21.15.18:0/1576196194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4250100490 0x7f4250100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 -- 172.21.15.18:0/1576196194 >> 172.21.15.18:0/1576196194 conn(0x7f42500fc2a0 msgr2=0x7f42500fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 -- 172.21.15.18:0/1576196194 shutdown_connections 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 -- 172.21.15.18:0/1576196194 wait complete. 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 Processor -- start 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.949+0000 7f4257526640 1 -- start start 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4257526640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4250100490 0x7f425019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4257526640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4250100dd0 0x7f425019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4257526640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4250101770 0x7f42501a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4257526640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f425010fa60 con 0x7f4250101770 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4257526640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f425010f8e0 con 0x7f4250100490 2024-09-19T09:49:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4257526640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f425010fbe0 con 0x7f4250100dd0 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4255ac3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4250101770 0x7f42501a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f42552c2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4250100490 0x7f425019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f42552c2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4250100490 0x7f425019a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60158/0 (socket says 172.21.15.18:60158) 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f42552c2640 1 -- 172.21.15.18:0/498062648 learned_addr learned my addr 172.21.15.18:0/498062648 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4254ac1640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4250100dd0 0x7f425019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4255ac3640 1 -- 172.21.15.18:0/498062648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4250100dd0 msgr2=0x7f425019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4255ac3640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4250100dd0 0x7f425019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4255ac3640 1 -- 172.21.15.18:0/498062648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4250100490 msgr2=0x7f425019a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4255ac3640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4250100490 0x7f425019a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4255ac3640 1 -- 172.21.15.18:0/498062648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42501a1cb0 con 0x7f4250101770 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f4255ac3640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4250101770 0x7f42501a1640 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4248031ae0 tx=0x7f4248031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f42467fc640 1 -- 172.21.15.18:0/498062648 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4248003c30 con 0x7f4250101770 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.950+0000 7f42467fc640 1 -- 172.21.15.18:0/498062648 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4248003dd0 con 0x7f4250101770 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.951+0000 7f4257526640 1 -- 172.21.15.18:0/498062648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42501a1f40 con 0x7f4250101770 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.951+0000 7f42467fc640 1 -- 172.21.15.18:0/498062648 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424802fd40 con 0x7f4250101770 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.951+0000 7f4257526640 1 -- 172.21.15.18:0/498062648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42501a23f0 con 0x7f4250101770 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.951+0000 7f4257526640 1 -- 172.21.15.18:0/498062648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f425010b1e0 con 0x7f4250101770 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.953+0000 7f42467fc640 1 -- 172.21.15.18:0/498062648 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4248004050 con 0x7f4250101770 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.954+0000 7f42467fc640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f423c0a3270 0x7f423c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.954+0000 7f42552c2640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f423c0a3270 0x7f423c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.954+0000 7f42467fc640 1 -- 172.21.15.18:0/498062648 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f42480f0560 con 0x7f4250101770 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.954+0000 7f42552c2640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f423c0a3270 0x7f423c0a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f424c005fd0 tx=0x7f424c00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:40.958+0000 7f42467fc640 1 -- 172.21.15.18:0/498062648 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f42480bd720 con 0x7f4250101770 2024-09-19T09:49:41.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.132+0000 7f4257526640 1 -- 172.21.15.18:0/498062648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4250062e90 con 0x7f4250101770 2024-09-19T09:49:41.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.133+0000 7f42467fc640 1 -- 172.21.15.18:0/498062648 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f42480dd0e0 con 0x7f4250101770 2024-09-19T09:49:41.135 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:49:41.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.134+0000 7f4257526640 1 -- 172.21.15.18:0/498062648 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f423c0a3270 msgr2=0x7f423c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.134+0000 7f4257526640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f423c0a3270 0x7f423c0a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f424c005fd0 tx=0x7f424c00b480 comp rx=0 tx=0).stop 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.134+0000 7f4257526640 1 -- 172.21.15.18:0/498062648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4250101770 msgr2=0x7f42501a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.134+0000 7f4257526640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4250101770 0x7f42501a1640 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4248031ae0 tx=0x7f4248031ee0 comp rx=0 tx=0).stop 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.135+0000 7f4257526640 1 -- 172.21.15.18:0/498062648 shutdown_connections 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.135+0000 7f4257526640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f423c0a3270 0x7f423c0a5730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.135+0000 7f4257526640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4250101770 0x7f42501a1640 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.135+0000 7f4257526640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4250100dd0 0x7f425019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.135+0000 7f4257526640 1 --2- 172.21.15.18:0/498062648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4250100490 0x7f425019a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.135+0000 7f4257526640 1 -- 172.21.15.18:0/498062648 >> 172.21.15.18:0/498062648 conn(0x7f42500fc2a0 msgr2=0x7f42500fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.135+0000 7f4257526640 1 -- 172.21.15.18:0/498062648 shutdown_connections 2024-09-19T09:49:41.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:41.135+0000 7f4257526640 1 -- 172.21.15.18:0/498062648 wait complete. 2024-09-19T09:49:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:41 smithi018 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T09:49:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:41 smithi018 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T09:49:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:41 smithi018 ceph-mon[30956]: osd.11 [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] boot 2024-09-19T09:49:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:41 smithi018 ceph-mon[30956]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:49:41.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:41 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:41.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:41 smithi018 ceph-mon[30956]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:41.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:41 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/498062648' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:49:41.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:41 smithi049 ceph-mon[34858]: purged_snaps scrub starts 2024-09-19T09:49:41.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:41 smithi049 ceph-mon[34858]: purged_snaps scrub ok 2024-09-19T09:49:41.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:41 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:41.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:41 smithi049 ceph-mon[34858]: osd.11 [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] boot 2024-09-19T09:49:41.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:41 smithi049 ceph-mon[34858]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:49:41.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:41 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:41.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:41 smithi049 ceph-mon[34858]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:41.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:41 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/498062648' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:49:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:41 smithi162 ceph-mon[35174]: purged_snaps scrub starts 2024-09-19T09:49:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:41 smithi162 ceph-mon[35174]: purged_snaps scrub ok 2024-09-19T09:49:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:41 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:41 smithi162 ceph-mon[35174]: osd.11 [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] boot 2024-09-19T09:49:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:41 smithi162 ceph-mon[35174]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:49:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:41 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:49:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:41 smithi162 ceph-mon[35174]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:49:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:41 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/498062648' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:49:41.751 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726739380,"num_in_osds":12,"osd_in_since":1726739356,"num_remapped_pgs":0} 2024-09-19T09:49:41.752 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:49:42.006 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:49:42.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:42 smithi018 ceph-mon[30956]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:49:42.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.489+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2333962283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a4100a80 msgr2=0x7fc3a4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.489+0000 7fc3a8dbe640 1 --2- 172.21.15.18:0/2333962283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a4100a80 0x7fc3a4100ee0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009930 tx=0x7fc38c02a420 comp rx=0 tx=0).stop 2024-09-19T09:49:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.489+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2333962283 shutdown_connections 2024-09-19T09:49:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.489+0000 7fc3a8dbe640 1 --2- 172.21.15.18:0/2333962283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a4101420 0x7fc3a410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.489+0000 7fc3a8dbe640 1 --2- 172.21.15.18:0/2333962283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a4100a80 0x7fc3a4100ee0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.489+0000 7fc3a8dbe640 1 --2- 172.21.15.18:0/2333962283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a4106a80 0x7fc3a4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.489+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2333962283 >> 172.21.15.18:0/2333962283 conn(0x7fc3a40fc7a0 msgr2=0x7fc3a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.489+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2333962283 shutdown_connections 2024-09-19T09:49:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.489+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2333962283 wait complete. 2024-09-19T09:49:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.490+0000 7fc3a8dbe640 1 Processor -- start 2024-09-19T09:49:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.490+0000 7fc3a8dbe640 1 -- start start 2024-09-19T09:49:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a8dbe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a4100a80 0x7fc3a419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a8dbe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a4101420 0x7fc3a419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a8dbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a4106a80 0x7fc3a419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a8dbe640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a4110e80 con 0x7fc3a4106a80 2024-09-19T09:49:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a8dbe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a4110d00 con 0x7fc3a4101420 2024-09-19T09:49:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a8dbe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a4111000 con 0x7fc3a4100a80 2024-09-19T09:49:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a4106a80 0x7fc3a419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a4106a80 0x7fc3a419eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37616/0 (socket says 172.21.15.18:37616) 2024-09-19T09:49:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a2d9d640 1 -- 172.21.15.18:0/2847691483 learned_addr learned my addr 172.21.15.18:0/2847691483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:49:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a259c640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a4100a80 0x7fc3a419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc39bfff640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a4101420 0x7fc3a419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a2d9d640 1 -- 172.21.15.18:0/2847691483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a4100a80 msgr2=0x7fc3a419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a2d9d640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a4100a80 0x7fc3a419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a2d9d640 1 -- 172.21.15.18:0/2847691483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a4101420 msgr2=0x7fc3a419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a2d9d640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a4101420 0x7fc3a419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a2d9d640 1 -- 172.21.15.18:0/2847691483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a419f5c0 con 0x7fc3a4106a80 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc39bfff640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a4101420 0x7fc3a419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a2d9d640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a4106a80 0x7fc3a419eee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00eaa0 tx=0x7fc39c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc39b7fe640 1 -- 172.21.15.18:0/2847691483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00cdb0 con 0x7fc3a4106a80 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc39b7fe640 1 -- 172.21.15.18:0/2847691483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39c005020 con 0x7fc3a4106a80 2024-09-19T09:49:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc39b7fe640 1 -- 172.21.15.18:0/2847691483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0116b0 con 0x7fc3a4106a80 2024-09-19T09:49:42.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.491+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2847691483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a419f8b0 con 0x7fc3a4106a80 2024-09-19T09:49:42.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.492+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2847691483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a41a7190 con 0x7fc3a4106a80 2024-09-19T09:49:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.493+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2847691483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a4100ee0 con 0x7fc3a4106a80 2024-09-19T09:49:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.494+0000 7fc39b7fe640 1 -- 172.21.15.18:0/2847691483 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc39c005560 con 0x7fc3a4106a80 2024-09-19T09:49:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.495+0000 7fc39b7fe640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3900a3240 0x7fc3900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.495+0000 7fc3a259c640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3900a3240 0x7fc3900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.495+0000 7fc39b7fe640 1 -- 172.21.15.18:0/2847691483 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fc39c0cf6a0 con 0x7fc3a4106a80 2024-09-19T09:49:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.495+0000 7fc3a259c640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3900a3240 0x7fc3900a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc394009b50 tx=0x7fc394005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:42.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.499+0000 7fc39b7fe640 1 -- 172.21.15.18:0/2847691483 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc39c016030 con 0x7fc3a4106a80 2024-09-19T09:49:42.578 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:42 smithi162 ceph-mon[35174]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:49:42.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:42 smithi049 ceph-mon[34858]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:49:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.677+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2847691483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3a41a7430 con 0x7fc3a4106a80 2024-09-19T09:49:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.678+0000 7fc39b7fe640 1 -- 172.21.15.18:0/2847691483 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18429 (secure 0 0 0) 0x7fc39c09c860 con 0x7fc3a4106a80 2024-09-19T09:49:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:49:42.680 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":77,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:49:41.317737+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:49:42.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2847691483 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3900a3240 msgr2=0x7fc3900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:42.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3900a3240 0x7fc3900a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc394009b50 tx=0x7fc394005f90 comp rx=0 tx=0).stop 2024-09-19T09:49:42.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2847691483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a4106a80 msgr2=0x7fc3a419eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:42.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a4106a80 0x7fc3a419eee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00eaa0 tx=0x7fc39c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:49:42.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2847691483 shutdown_connections 2024-09-19T09:49:42.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3900a3240 0x7fc3900a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:42.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a4106a80 0x7fc3a419eee0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:42.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3a4101420 0x7fc3a419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:42.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 --2- 172.21.15.18:0/2847691483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a4100a80 0x7fc3a419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:42.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2847691483 >> 172.21.15.18:0/2847691483 conn(0x7fc3a40fc7a0 msgr2=0x7fc3a406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:42.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2847691483 shutdown_connections 2024-09-19T09:49:42.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:42.680+0000 7fc3a8dbe640 1 -- 172.21.15.18:0/2847691483 wait complete. 2024-09-19T09:49:43.504 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:45:52.767383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:49:43.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T09:49:43.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:43 smithi018 ceph-mon[30956]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:43.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:43 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2847691483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:49:43.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:43 smithi049 ceph-mon[34858]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:43.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:43 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2847691483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:49:43.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:43 smithi162 ceph-mon[35174]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:43.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:43 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2847691483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:49:43.763 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:49:44.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.240+0000 7fec08dbf640 1 -- 172.21.15.18:0/509347199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec04102790 msgr2=0x7fec041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.240+0000 7fec08dbf640 1 --2- 172.21.15.18:0/509347199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec04102790 0x7fec041067e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febf8009900 tx=0x7febf802a410 comp rx=0 tx=0).stop 2024-09-19T09:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.240+0000 7fec08dbf640 1 -- 172.21.15.18:0/509347199 shutdown_connections 2024-09-19T09:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.240+0000 7fec08dbf640 1 --2- 172.21.15.18:0/509347199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec04106f10 0x7fec0410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.240+0000 7fec08dbf640 1 --2- 172.21.15.18:0/509347199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec04102790 0x7fec041067e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.240+0000 7fec08dbf640 1 --2- 172.21.15.18:0/509347199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec04101de0 0x7fec041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.240+0000 7fec08dbf640 1 -- 172.21.15.18:0/509347199 >> 172.21.15.18:0/509347199 conn(0x7fec040fd8c0 msgr2=0x7fec040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.240+0000 7fec08dbf640 1 -- 172.21.15.18:0/509347199 shutdown_connections 2024-09-19T09:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.240+0000 7fec08dbf640 1 -- 172.21.15.18:0/509347199 wait complete. 2024-09-19T09:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec08dbf640 1 Processor -- start 2024-09-19T09:49:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec08dbf640 1 -- start start 2024-09-19T09:49:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec08dbf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec04101de0 0x7fec041983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec08dbf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec04102790 0x7fec041988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec08dbf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec04106f10 0x7fec0419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec08dbf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec04111f70 con 0x7fec04101de0 2024-09-19T09:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec08dbf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fec04111df0 con 0x7fec04106f10 2024-09-19T09:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec08dbf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec041120f0 con 0x7fec04102790 2024-09-19T09:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec0259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec04101de0 0x7fec041983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec0259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec04101de0 0x7fec041983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37644/0 (socket says 172.21.15.18:37644) 2024-09-19T09:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec0259c640 1 -- 172.21.15.18:0/1929131948 learned_addr learned my addr 172.21.15.18:0/1929131948 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec02d9d640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec04106f10 0x7fec0419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.241+0000 7fec01d9b640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec04102790 0x7fec041988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7fec0259c640 1 -- 172.21.15.18:0/1929131948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec04102790 msgr2=0x7fec041988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7fec0259c640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec04102790 0x7fec041988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7fec0259c640 1 -- 172.21.15.18:0/1929131948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec04106f10 msgr2=0x7fec0419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7fec0259c640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec04106f10 0x7fec0419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7fec0259c640 1 -- 172.21.15.18:0/1929131948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0419d360 con 0x7fec04101de0 2024-09-19T09:49:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7fec01d9b640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec04102790 0x7fec041988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:49:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7fec0259c640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec04101de0 0x7fec041983b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7febf400d950 tx=0x7febf400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7febf37fe640 1 -- 172.21.15.18:0/1929131948 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4017070 con 0x7fec04101de0 2024-09-19T09:49:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7fec08dbf640 1 -- 172.21.15.18:0/1929131948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0419d650 con 0x7fec04101de0 2024-09-19T09:49:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7febf37fe640 1 -- 172.21.15.18:0/1929131948 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf4009c30 con 0x7fec04101de0 2024-09-19T09:49:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7febf37fe640 1 -- 172.21.15.18:0/1929131948 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf400f6b0 con 0x7fec04101de0 2024-09-19T09:49:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.242+0000 7fec08dbf640 1 -- 172.21.15.18:0/1929131948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec041a4f30 con 0x7fec04101de0 2024-09-19T09:49:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.243+0000 7fec08dbf640 1 -- 172.21.15.18:0/1929131948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec041021c0 con 0x7fec04101de0 2024-09-19T09:49:44.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.244+0000 7febf37fe640 1 -- 172.21.15.18:0/1929131948 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7febf40109d0 con 0x7fec04101de0 2024-09-19T09:49:44.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.245+0000 7febf37fe640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febec0a3240 0x7febec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:44.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.245+0000 7fec01d9b640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febec0a3240 0x7febec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:44.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.245+0000 7febf37fe640 1 -- 172.21.15.18:0/1929131948 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7febf40cf100 con 0x7fec04101de0 2024-09-19T09:49:44.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.245+0000 7fec01d9b640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febec0a3240 0x7febec0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fec041088e0 tx=0x7febf8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.249+0000 7febf37fe640 1 -- 172.21.15.18:0/1929131948 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7febf4009de0 con 0x7fec04101de0 2024-09-19T09:49:44.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.424+0000 7fec08dbf640 1 -- 172.21.15.18:0/1929131948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec04199710 con 0x7fec04101de0 2024-09-19T09:49:44.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.424+0000 7febf37fe640 1 -- 172.21.15.18:0/1929131948 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7febf409c2c0 con 0x7fec04101de0 2024-09-19T09:49:44.426 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:49:44.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.426+0000 7fec08dbf640 1 -- 172.21.15.18:0/1929131948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febec0a3240 msgr2=0x7febec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.426+0000 7fec08dbf640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febec0a3240 0x7febec0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fec041088e0 tx=0x7febf8005a20 comp rx=0 tx=0).stop 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.426+0000 7fec08dbf640 1 -- 172.21.15.18:0/1929131948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec04101de0 msgr2=0x7fec041983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.426+0000 7fec08dbf640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec04101de0 0x7fec041983b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7febf400d950 tx=0x7febf400de10 comp rx=0 tx=0).stop 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.427+0000 7fec08dbf640 1 -- 172.21.15.18:0/1929131948 shutdown_connections 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.427+0000 7fec08dbf640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7febec0a3240 0x7febec0a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.427+0000 7fec08dbf640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec04106f10 0x7fec0419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.427+0000 7fec08dbf640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec04102790 0x7fec041988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.427+0000 7fec08dbf640 1 --2- 172.21.15.18:0/1929131948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec04101de0 0x7fec041983b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.427+0000 7fec08dbf640 1 -- 172.21.15.18:0/1929131948 >> 172.21.15.18:0/1929131948 conn(0x7fec040fd8c0 msgr2=0x7fec040fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.427+0000 7fec08dbf640 1 -- 172.21.15.18:0/1929131948 shutdown_connections 2024-09-19T09:49:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:44.427+0000 7fec08dbf640 1 -- 172.21.15.18:0/1929131948 wait complete. 2024-09-19T09:49:45.018 INFO:tasks.cephadm:Adding mds.a on smithi018 2024-09-19T09:49:45.018 INFO:tasks.cephadm:Adding mds.d on smithi018 2024-09-19T09:49:45.018 INFO:tasks.cephadm:Adding mds.g on smithi018 2024-09-19T09:49:45.018 INFO:tasks.cephadm:Adding mds.j on smithi018 2024-09-19T09:49:45.018 INFO:tasks.cephadm:Adding mds.b on smithi049 2024-09-19T09:49:45.018 INFO:tasks.cephadm:Adding mds.e on smithi049 2024-09-19T09:49:45.019 INFO:tasks.cephadm:Adding mds.h on smithi049 2024-09-19T09:49:45.019 INFO:tasks.cephadm:Adding mds.k on smithi049 2024-09-19T09:49:45.019 INFO:tasks.cephadm:Adding mds.c on smithi162 2024-09-19T09:49:45.019 INFO:tasks.cephadm:Adding mds.f on smithi162 2024-09-19T09:49:45.019 INFO:tasks.cephadm:Adding mds.i on smithi162 2024-09-19T09:49:45.019 INFO:tasks.cephadm:Adding mds.l on smithi162 2024-09-19T09:49:45.019 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi049=b;smithi049=e;smithi049=h;smithi049=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l' 2024-09-19T09:49:45.284 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:49:45.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:45 smithi049 ceph-mon[34858]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:45.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:45 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1929131948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:49:45.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:45 smithi162 ceph-mon[35174]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:45.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:45 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1929131948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.765+0000 7f6848b5c640 1 -- 172.21.15.162:0/6418205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6844101c00 msgr2=0x7f6844102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.765+0000 7f6848b5c640 1 --2- 172.21.15.162:0/6418205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6844101c00 0x7f6844102000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6834009900 tx=0x7f683402a410 comp rx=0 tx=0).stop 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.765+0000 7f6848b5c640 1 -- 172.21.15.162:0/6418205 shutdown_connections 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.765+0000 7f6848b5c640 1 --2- 172.21.15.162:0/6418205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68441037c0 0x7f684410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.765+0000 7f6848b5c640 1 --2- 172.21.15.162:0/6418205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844102e00 0x7f6844103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.765+0000 7f6848b5c640 1 --2- 172.21.15.162:0/6418205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6844101c00 0x7f6844102000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.765+0000 7f6848b5c640 1 -- 172.21.15.162:0/6418205 >> 172.21.15.162:0/6418205 conn(0x7f68440fd390 msgr2=0x7f68440ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.765+0000 7f6848b5c640 1 -- 172.21.15.162:0/6418205 shutdown_connections 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.765+0000 7f6848b5c640 1 -- 172.21.15.162:0/6418205 wait complete. 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f6848b5c640 1 Processor -- start 2024-09-19T09:49:45.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f6848b5c640 1 -- start start 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f6848b5c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6844101c00 0x7f6844197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f6848b5c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844102e00 0x7f6844198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f6848b5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68441037c0 0x7f684419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f6848b5c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f684410d880 con 0x7f68441037c0 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f6848b5c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f684410d700 con 0x7f6844102e00 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f6848b5c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f684410da00 con 0x7f6844101c00 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f684259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6844101c00 0x7f6844197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f684259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6844101c00 0x7f6844197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35420/0 (socket says 172.21.15.162:35420) 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.766+0000 7f684259c640 1 -- 172.21.15.162:0/2365095591 learned_addr learned my addr 172.21.15.162:0/2365095591 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f6842d9d640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68441037c0 0x7f684419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:45.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f6841d9b640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844102e00 0x7f6844198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f684259c640 1 -- 172.21.15.162:0/2365095591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844102e00 msgr2=0x7f6844198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f684259c640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844102e00 0x7f6844198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f684259c640 1 -- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68441037c0 msgr2=0x7f684419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f684259c640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68441037c0 0x7f684419f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f684259c640 1 -- 172.21.15.162:0/2365095591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684419fb30 con 0x7f6844101c00 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f6842d9d640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68441037c0 0x7f684419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f6841d9b640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844102e00 0x7f6844198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f684259c640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6844101c00 0x7f6844197f00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6834031610 tx=0x7f68340043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f683b7fe640 1 -- 172.21.15.162:0/2365095591 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683403f030 con 0x7f6844101c00 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f683b7fe640 1 -- 172.21.15.162:0/2365095591 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6834003ce0 con 0x7f6844101c00 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f6848b5c640 1 -- 172.21.15.162:0/2365095591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684419fdc0 con 0x7f6844101c00 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f683b7fe640 1 -- 172.21.15.162:0/2365095591 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834035070 con 0x7f6844101c00 2024-09-19T09:49:45.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.767+0000 7f6848b5c640 1 -- 172.21.15.162:0/2365095591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68441a01e0 con 0x7f6844101c00 2024-09-19T09:49:45.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.768+0000 7f6848b5c640 1 -- 172.21.15.162:0/2365095591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6844109000 con 0x7f6844101c00 2024-09-19T09:49:45.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.770+0000 7f683b7fe640 1 -- 172.21.15.162:0/2365095591 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6834042030 con 0x7f6844101c00 2024-09-19T09:49:45.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.771+0000 7f683b7fe640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f68300a3270 0x7f68300a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:45.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.771+0000 7f683b7fe640 1 -- 172.21.15.162:0/2365095591 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f68340efcb0 con 0x7f6844101c00 2024-09-19T09:49:45.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.771+0000 7f6841d9b640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f68300a3270 0x7f68300a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:45.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.772+0000 7f6841d9b640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f68300a3270 0x7f68300a5730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f682c0058c0 tx=0x7f682c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:45.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.774+0000 7f683b7fe640 1 -- 172.21.15.162:0/2365095591 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68340bce70 con 0x7f6844101c00 2024-09-19T09:49:45.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:45 smithi018 ceph-mon[30956]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:45.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:45 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1929131948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:49:45.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.949+0000 7f6848b5c640 1 -- 172.21.15.162:0/2365095591 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi049=b;smithi049=e;smithi049=h;smithi049=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}) -- 0x7f68440627f0 con 0x7f68300a3270 2024-09-19T09:49:45.960 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mds.all update... 2024-09-19T09:49:45.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.957+0000 7f683b7fe640 1 -- 172.21.15.162:0/2365095591 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f68440627f0 con 0x7f68300a3270 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 -- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f68300a3270 msgr2=0x7f68300a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f68300a3270 0x7f68300a5730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f682c0058c0 tx=0x7f682c005850 comp rx=0 tx=0).stop 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 -- 172.21.15.162:0/2365095591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6844101c00 msgr2=0x7f6844197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6844101c00 0x7f6844197f00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6834031610 tx=0x7f68340043b0 comp rx=0 tx=0).stop 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 -- 172.21.15.162:0/2365095591 shutdown_connections 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f68300a3270 0x7f68300a5730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68441037c0 0x7f684419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844102e00 0x7f6844198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 --2- 172.21.15.162:0/2365095591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6844101c00 0x7f6844197f00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 -- 172.21.15.162:0/2365095591 >> 172.21.15.162:0/2365095591 conn(0x7f68440fd390 msgr2=0x7f68441061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:45.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 -- 172.21.15.162:0/2365095591 shutdown_connections 2024-09-19T09:49:45.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:49:45.960+0000 7f6848b5c640 1 -- 172.21.15.162:0/2365095591 wait complete. 2024-09-19T09:49:46.591 DEBUG:teuthology.orchestra.run.smithi018:mds.a> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T09:49:46.595 DEBUG:teuthology.orchestra.run.smithi018:mds.d> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T09:49:46.642 DEBUG:teuthology.orchestra.run.smithi018:mds.g> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T09:49:46.689 DEBUG:teuthology.orchestra.run.smithi018:mds.j> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T09:49:46.736 DEBUG:teuthology.orchestra.run.smithi049:mds.b> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T09:49:46.740 DEBUG:teuthology.orchestra.run.smithi049:mds.e> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T09:49:46.784 DEBUG:teuthology.orchestra.run.smithi049:mds.h> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T09:49:46.833 DEBUG:teuthology.orchestra.run.smithi049:mds.k> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T09:49:46.882 DEBUG:teuthology.orchestra.run.smithi162:mds.c> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T09:49:46.885 DEBUG:teuthology.orchestra.run.smithi162:mds.f> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T09:49:46.929 DEBUG:teuthology.orchestra.run.smithi162:mds.i> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T09:49:46.972 DEBUG:teuthology.orchestra.run.smithi162:mds.l> sudo journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T09:49:47.016 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T09:49:47.016 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:49:47.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:46 smithi049 ceph-mon[34858]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi049=b;smithi049=e;smithi049=h;smithi049=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:49:47.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:46 smithi049 ceph-mon[34858]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi049=b;smithi049=e;smithi049=h;smithi049=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T09:49:47.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:47.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:47.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:47.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:47.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:47.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:47.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:47.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:47.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:46 smithi162 ceph-mon[35174]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi049=b;smithi049=e;smithi049=h;smithi049=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:49:47.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:46 smithi162 ceph-mon[35174]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi049=b;smithi049=e;smithi049=h;smithi049=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T09:49:47.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:47.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:47.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:47.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:47.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:47.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:47.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:47.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:47.268 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:49:47.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:46 smithi018 ceph-mon[30956]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi049=b;smithi049=e;smithi049=h;smithi049=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:49:47.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:46 smithi018 ceph-mon[30956]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi049=b;smithi049=e;smithi049=h;smithi049=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T09:49:47.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:47.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:49:47.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:47.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:49:47.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:47.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:47.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:47.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:47.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.694+0000 7f0e15763640 1 -- 172.21.15.18:0/2331430523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e10101de0 msgr2=0x7f0e101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:47.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.694+0000 7f0e15763640 1 --2- 172.21.15.18:0/2331430523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e10101de0 0x7f0e101021c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0e00009900 tx=0x7f0e0002a410 comp rx=0 tx=0).stop 2024-09-19T09:49:47.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.694+0000 7f0e15763640 1 -- 172.21.15.18:0/2331430523 shutdown_connections 2024-09-19T09:49:47.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.694+0000 7f0e15763640 1 --2- 172.21.15.18:0/2331430523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e10106f10 0x7f0e1010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:47.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.694+0000 7f0e15763640 1 --2- 172.21.15.18:0/2331430523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e10102790 0x7f0e101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:47.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.694+0000 7f0e15763640 1 --2- 172.21.15.18:0/2331430523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e10101de0 0x7f0e101021c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:47.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.694+0000 7f0e15763640 1 -- 172.21.15.18:0/2331430523 >> 172.21.15.18:0/2331430523 conn(0x7f0e100fd8c0 msgr2=0x7f0e100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:47.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.694+0000 7f0e15763640 1 -- 172.21.15.18:0/2331430523 shutdown_connections 2024-09-19T09:49:47.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.694+0000 7f0e15763640 1 -- 172.21.15.18:0/2331430523 wait complete. 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.695+0000 7f0e15763640 1 Processor -- start 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.695+0000 7f0e15763640 1 -- start start 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.695+0000 7f0e15763640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e10101de0 0x7f0e10198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e15763640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e10102790 0x7f0e10198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e15763640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e10106f10 0x7f0e1019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e15763640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e10111f70 con 0x7f0e10101de0 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e15763640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0e10111df0 con 0x7f0e10106f10 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e15763640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e101120f0 con 0x7f0e10102790 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e10101de0 0x7f0e10198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e10101de0 0x7f0e10198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48294/0 (socket says 172.21.15.18:48294) 2024-09-19T09:49:47.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0effd640 1 -- 172.21.15.18:0/1914662877 learned_addr learned my addr 172.21.15.18:0/1914662877 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0e7fc640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e10102790 0x7f0e10198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0f7fe640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e10106f10 0x7f0e1019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0effd640 1 -- 172.21.15.18:0/1914662877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e10102790 msgr2=0x7f0e10198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0effd640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e10102790 0x7f0e10198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0effd640 1 -- 172.21.15.18:0/1914662877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e10106f10 msgr2=0x7f0e1019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0effd640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e10106f10 0x7f0e1019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0effd640 1 -- 172.21.15.18:0/1914662877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1019d400 con 0x7f0e10101de0 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e0effd640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e10101de0 0x7f0e10198450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e00006010 tx=0x7f0e000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0df7fff640 1 -- 172.21.15.18:0/1914662877 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0003f030 con 0x7f0e10101de0 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0e15763640 1 -- 172.21.15.18:0/1914662877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1019d690 con 0x7f0e10101de0 2024-09-19T09:49:47.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0df7fff640 1 -- 172.21.15.18:0/1914662877 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e00003ce0 con 0x7f0e10101de0 2024-09-19T09:49:47.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.696+0000 7f0df7fff640 1 -- 172.21.15.18:0/1914662877 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e00035070 con 0x7f0e10101de0 2024-09-19T09:49:47.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.697+0000 7f0e15763640 1 -- 172.21.15.18:0/1914662877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e101a4fd0 con 0x7f0e10101de0 2024-09-19T09:49:47.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.697+0000 7f0e15763640 1 -- 172.21.15.18:0/1914662877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e101032c0 con 0x7f0e10101de0 2024-09-19T09:49:47.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.699+0000 7f0df7fff640 1 -- 172.21.15.18:0/1914662877 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0e00042030 con 0x7f0e10101de0 2024-09-19T09:49:47.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.699+0000 7f0df7fff640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0df80a3240 0x7f0df80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:47.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.699+0000 7f0e0e7fc640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0df80a3240 0x7f0df80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:47.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.699+0000 7f0df7fff640 1 -- 172.21.15.18:0/1914662877 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f0e000ef9a0 con 0x7f0e10101de0 2024-09-19T09:49:47.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.700+0000 7f0e0e7fc640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0df80a3240 0x7f0df80a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e100fdce0 tx=0x7f0e0400a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:47.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.704+0000 7f0df7fff640 1 -- 172.21.15.18:0/1914662877 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0e000bc5d0 con 0x7f0e10101de0 2024-09-19T09:49:47.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.917+0000 7f0e15763640 1 -- 172.21.15.18:0/1914662877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e1010a0f0 con 0x7f0e10101de0 2024-09-19T09:49:47.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.917+0000 7f0df7fff640 1 -- 172.21.15.18:0/1914662877 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f0e000c08d0 con 0x7f0e10101de0 2024-09-19T09:49:47.920 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:49:47.920 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":1,"btime":"2024-09-19T09:42:35:497798+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T09:49:47.920 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 1 2024-09-19T09:49:47.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 -- 172.21.15.18:0/1914662877 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0df80a3240 msgr2=0x7f0df80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:47.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0df80a3240 0x7f0df80a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e100fdce0 tx=0x7f0e0400a590 comp rx=0 tx=0).stop 2024-09-19T09:49:47.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 -- 172.21.15.18:0/1914662877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e10101de0 msgr2=0x7f0e10198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:47.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e10101de0 0x7f0e10198450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e00006010 tx=0x7f0e000042f0 comp rx=0 tx=0).stop 2024-09-19T09:49:47.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 -- 172.21.15.18:0/1914662877 shutdown_connections 2024-09-19T09:49:47.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0df80a3240 0x7f0df80a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:47.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e10106f10 0x7f0e1019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:47.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e10102790 0x7f0e10198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:47.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 --2- 172.21.15.18:0/1914662877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e10101de0 0x7f0e10198450 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:47.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 -- 172.21.15.18:0/1914662877 >> 172.21.15.18:0/1914662877 conn(0x7f0e100fd8c0 msgr2=0x7f0e100fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:47.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 -- 172.21.15.18:0/1914662877 shutdown_connections 2024-09-19T09:49:47.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:47.920+0000 7f0e15763640 1 -- 172.21.15.18:0/1914662877 wait complete. 2024-09-19T09:49:48.070 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:47 smithi162 ceph-mon[35174]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:48.070 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:47 smithi162 ceph-mon[35174]: Deploying daemon mds.l on smithi162 2024-09-19T09:49:48.070 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:47 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1914662877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:49:48.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:47 smithi018 ceph-mon[30956]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:48.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:47 smithi018 ceph-mon[30956]: Deploying daemon mds.l on smithi162 2024-09-19T09:49:48.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:47 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1914662877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:49:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:47 smithi049 ceph-mon[34858]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:47 smithi049 ceph-mon[34858]: Deploying daemon mds.l on smithi162 2024-09-19T09:49:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:47 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1914662877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:49:48.413 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 09:49:48 smithi162 systemd[1]: Starting Ceph mds.l for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:49:48.740 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 09:49:48 smithi162 podman[64584]: 2024-09-19 09:49:48.371243569 +0000 UTC m=+0.016065234 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:49:48.740 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 09:49:48 smithi162 podman[64584]: 2024-09-19 09:49:48.499789844 +0000 UTC m=+0.144611549 container create f09fc438a8109d09d8d8bbc9c5c45d0186e937599f2428e10cdbadc388628e35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:49:48.741 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 09:49:48 smithi162 podman[64584]: 2024-09-19 09:49:48.739074973 +0000 UTC m=+0.383896642 container init f09fc438a8109d09d8d8bbc9c5c45d0186e937599f2428e10cdbadc388628e35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:49:49.163 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 09:49:48 smithi162 podman[64584]: 2024-09-19 09:49:48.742033271 +0000 UTC m=+0.386854930 container start f09fc438a8109d09d8d8bbc9c5c45d0186e937599f2428e10cdbadc388628e35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:49:49.163 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 09:49:48 smithi162 ceph-mds[64603]: -- 172.21.15.162:0/269234188 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e9108c3860 con 0x55e9108a0800 2024-09-19T09:49:49.163 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 09:49:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l[64599]: starting mds.l at 2024-09-19T09:49:49.163 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 09:49:48 smithi162 bash[64584]: f09fc438a8109d09d8d8bbc9c5c45d0186e937599f2428e10cdbadc388628e35 2024-09-19T09:49:49.163 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 09:49:48 smithi162 systemd[1]: Started Ceph mds.l for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:49:50.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:50.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6832/212444721,v1:172.21.15.162:6833/212444721] up:boot 2024-09-19T09:49:50.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: fsmap 1 up:standby 2024-09-19T09:49:50.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:49:50.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:50.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:50.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:50.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:50.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:50.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:50.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:49 smithi018 ceph-mon[30956]: Deploying daemon mds.k on smithi049 2024-09-19T09:49:50.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:50.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.162:6832/212444721,v1:172.21.15.162:6833/212444721] up:boot 2024-09-19T09:49:50.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: fsmap 1 up:standby 2024-09-19T09:49:50.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:49:50.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:50.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:50.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:50.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:50.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:50.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:50.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:49 smithi049 ceph-mon[34858]: Deploying daemon mds.k on smithi049 2024-09-19T09:49:50.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.162:6832/212444721,v1:172.21.15.162:6833/212444721] up:boot 2024-09-19T09:49:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: fsmap 1 up:standby 2024-09-19T09:49:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:49:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:49 smithi162 ceph-mon[35174]: Deploying daemon mds.k on smithi049 2024-09-19T09:49:50.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:49:50.936 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:49:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.343+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/4142240340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a58103640 msgr2=0x7f6a5810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.343+0000 7f6a5dbd4640 1 --2- 172.21.15.18:0/4142240340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a58103640 0x7f6a5810bb30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009900 tx=0x7f6a4c02a480 comp rx=0 tx=0).stop 2024-09-19T09:49:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.343+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/4142240340 shutdown_connections 2024-09-19T09:49:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.343+0000 7f6a5dbd4640 1 --2- 172.21.15.18:0/4142240340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5810c150 0x7f6a5810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.343+0000 7f6a5dbd4640 1 --2- 172.21.15.18:0/4142240340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a58103640 0x7f6a5810bb30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.343+0000 7f6a5dbd4640 1 --2- 172.21.15.18:0/4142240340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a58102d20 0x7f6a58103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.343+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/4142240340 >> 172.21.15.18:0/4142240340 conn(0x7f6a580fc780 msgr2=0x7f6a580feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.343+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/4142240340 shutdown_connections 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.343+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/4142240340 wait complete. 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.343+0000 7f6a5dbd4640 1 Processor -- start 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a5dbd4640 1 -- start start 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a5dbd4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a58102d20 0x7f6a581984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a5dbd4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a58103640 0x7f6a581989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a5dbd4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5810c150 0x7f6a5819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a5dbd4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a58111f50 con 0x7f6a58102d20 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a5dbd4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6a58111dd0 con 0x7f6a58103640 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a5dbd4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a581120d0 con 0x7f6a5810c150 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a58102d20 0x7f6a581984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:51.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a56ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a58103640 0x7f6a581989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a56ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a58103640 0x7f6a581989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59246/0 (socket says 172.21.15.18:59246) 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a58102d20 0x7f6a581984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48314/0 (socket says 172.21.15.18:48314) 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a56ffd640 1 -- 172.21.15.18:0/3061724840 learned_addr learned my addr 172.21.15.18:0/3061724840 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a57fff640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5810c150 0x7f6a5819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a56ffd640 1 -- 172.21.15.18:0/3061724840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5810c150 msgr2=0x7f6a5819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a56ffd640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5810c150 0x7f6a5819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a56ffd640 1 -- 172.21.15.18:0/3061724840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a58102d20 msgr2=0x7f6a581984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a56ffd640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a58102d20 0x7f6a581984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a56ffd640 1 -- 172.21.15.18:0/3061724840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5819d460 con 0x7f6a58103640 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a57fff640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5810c150 0x7f6a5819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.344+0000 7f6a577fe640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a58102d20 0x7f6a581984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:49:51.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.345+0000 7f6a56ffd640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a58103640 0x7f6a581989f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c006010 tx=0x7f6a4c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:51.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.345+0000 7f6a54ff9640 1 -- 172.21.15.18:0/3061724840 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c03f030 con 0x7f6a58103640 2024-09-19T09:49:51.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.345+0000 7f6a54ff9640 1 -- 172.21.15.18:0/3061724840 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a4c004440 con 0x7f6a58103640 2024-09-19T09:49:51.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.345+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/3061724840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5819d6f0 con 0x7f6a58103640 2024-09-19T09:49:51.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.345+0000 7f6a54ff9640 1 -- 172.21.15.18:0/3061724840 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c035070 con 0x7f6a58103640 2024-09-19T09:49:51.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.345+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/3061724840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a581a5030 con 0x7f6a58103640 2024-09-19T09:49:51.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.346+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/3061724840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a58103100 con 0x7f6a58103640 2024-09-19T09:49:51.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.347+0000 7f6a54ff9640 1 -- 172.21.15.18:0/3061724840 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6a4c042030 con 0x7f6a58103640 2024-09-19T09:49:51.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.348+0000 7f6a54ff9640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a400a32c0 0x7f6a400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:51.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.348+0000 7f6a577fe640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a400a32c0 0x7f6a400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:51.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.348+0000 7f6a54ff9640 1 -- 172.21.15.18:0/3061724840 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f6a4c0ef6e0 con 0x7f6a58103640 2024-09-19T09:49:51.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.348+0000 7f6a577fe640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a400a32c0 0x7f6a400a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009fc0 tx=0x7f6a48005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:51.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.352+0000 7f6a54ff9640 1 -- 172.21.15.18:0/3061724840 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a4c0bc880 con 0x7f6a58103640 2024-09-19T09:49:51.400 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 09:49:51 smithi049 podman[64523]: 2024-09-19 09:49:51.258934233 +0000 UTC m=+0.121024988 container create 5017f0fbc729cf898dfb7fcb2a663f4412d5035d42c7f3f213b35fbc744e1fbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:49:51.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.562+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/3061724840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a58199810 con 0x7f6a58103640 2024-09-19T09:49:51.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.563+0000 7f6a54ff9640 1 -- 172.21.15.18:0/3061724840 <== mon.2 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f6a58199810 con 0x7f6a58103640 2024-09-19T09:49:51.565 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:49:51.565 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":2,"btime":"2024-09-19T09:49:48:770741+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:49:51.565 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 2 2024-09-19T09:49:51.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/3061724840 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a400a32c0 msgr2=0x7f6a400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:51.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a400a32c0 0x7f6a400a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009fc0 tx=0x7f6a48005f90 comp rx=0 tx=0).stop 2024-09-19T09:49:51.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/3061724840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a58103640 msgr2=0x7f6a581989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:51.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a58103640 0x7f6a581989f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c006010 tx=0x7f6a4c004040 comp rx=0 tx=0).stop 2024-09-19T09:49:51.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/3061724840 shutdown_connections 2024-09-19T09:49:51.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a400a32c0 0x7f6a400a5780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:51.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a5810c150 0x7f6a5819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:51.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a58103640 0x7f6a581989f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:51.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 --2- 172.21.15.18:0/3061724840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a58102d20 0x7f6a581984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:51.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/3061724840 >> 172.21.15.18:0/3061724840 conn(0x7f6a580fc780 msgr2=0x7f6a580fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:51.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/3061724840 shutdown_connections 2024-09-19T09:49:51.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:51.565+0000 7f6a5dbd4640 1 -- 172.21.15.18:0/3061724840 wait complete. 2024-09-19T09:49:51.777 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 09:49:51 smithi049 podman[64523]: 2024-09-19 09:49:51.603460262 +0000 UTC m=+0.465551023 container init 5017f0fbc729cf898dfb7fcb2a663f4412d5035d42c7f3f213b35fbc744e1fbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T09:49:51.778 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 09:49:51 smithi049 podman[64523]: 2024-09-19 09:49:51.60637218 +0000 UTC m=+0.468462936 container start 5017f0fbc729cf898dfb7fcb2a663f4412d5035d42c7f3f213b35fbc744e1fbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T09:49:51.778 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 09:49:51 smithi049 ceph-mds[64542]: -- 172.21.15.49:0/2645805414 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562aac1bb860 con 0x562aac199400 2024-09-19T09:49:51.778 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 09:49:51 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k[64538]: starting mds.k at 2024-09-19T09:49:51.778 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 09:49:51 smithi049 bash[64523]: 5017f0fbc729cf898dfb7fcb2a663f4412d5035d42c7f3f213b35fbc744e1fbd 2024-09-19T09:49:51.778 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 09:49:51 smithi049 systemd[1]: Started Ceph mds.k for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:49:52.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:51 smithi018 ceph-mon[30956]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:52.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:51 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3061724840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:49:52.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:52.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:52.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:52.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:52.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:52.057 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:51 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:52.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:51 smithi049 ceph-mon[34858]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:52.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:51 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3061724840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:49:52.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:52.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:52.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:52.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:52.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:52.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:51 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:52.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:51 smithi162 ceph-mon[35174]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:51 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3061724840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:49:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:51 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:53.090 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:52 smithi018 ceph-mon[30956]: Deploying daemon mds.j on smithi018 2024-09-19T09:49:53.090 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:52 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6832/94526458,v1:172.21.15.49:6833/94526458] up:boot 2024-09-19T09:49:53.090 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:52 smithi018 ceph-mon[30956]: fsmap 2 up:standby 2024-09-19T09:49:53.090 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:49:53.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:52 smithi049 ceph-mon[34858]: Deploying daemon mds.j on smithi018 2024-09-19T09:49:53.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:52 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6832/94526458,v1:172.21.15.49:6833/94526458] up:boot 2024-09-19T09:49:53.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:52 smithi049 ceph-mon[34858]: fsmap 2 up:standby 2024-09-19T09:49:53.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:52 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:49:53.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:52 smithi162 ceph-mon[35174]: Deploying daemon mds.j on smithi018 2024-09-19T09:49:53.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:52 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6832/94526458,v1:172.21.15.49:6833/94526458] up:boot 2024-09-19T09:49:53.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:52 smithi162 ceph-mon[35174]: fsmap 2 up:standby 2024-09-19T09:49:53.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:52 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:49:54.066 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:53 smithi049 ceph-mon[34858]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:54.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:53 smithi018 ceph-mon[30956]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:54.076 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 09:49:53 smithi018 systemd[1]: Starting Ceph mds.j for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:49:54.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:53 smithi162 ceph-mon[35174]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:54.278 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:49:54.385 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 09:49:54 smithi018 podman[70200]: 2024-09-19 09:49:54.074064277 +0000 UTC m=+0.097902140 container create 80f52a23bad7fbdcd1245b74b4031b08f2ff713b69fcc580effb87cd1df135eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T09:49:54.385 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 09:49:54 smithi018 podman[70200]: 2024-09-19 09:49:53.992588908 +0000 UTC m=+0.016426782 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:49:54.386 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 09:49:54 smithi018 podman[70200]: 2024-09-19 09:49:54.29330751 +0000 UTC m=+0.317145375 container init 80f52a23bad7fbdcd1245b74b4031b08f2ff713b69fcc580effb87cd1df135eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:49:54.386 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 09:49:54 smithi018 podman[70200]: 2024-09-19 09:49:54.29635872 +0000 UTC m=+0.320196582 container start 80f52a23bad7fbdcd1245b74b4031b08f2ff713b69fcc580effb87cd1df135eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T09:49:54.386 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 09:49:54 smithi018 ceph-mds[70235]: -- 172.21.15.18:0/2587973957 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55de2d4f7860 con 0x55de2d4d5000 2024-09-19T09:49:54.386 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 09:49:54 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-j[70215]: starting mds.j at 2024-09-19T09:49:54.547 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:49:54.669 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 09:49:54 smithi018 bash[70200]: 80f52a23bad7fbdcd1245b74b4031b08f2ff713b69fcc580effb87cd1df135eb 2024-09-19T09:49:54.670 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 09:49:54 smithi018 systemd[1]: Started Ceph mds.j for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:49:54.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.963+0000 7f7e99b82640 1 -- 172.21.15.18:0/1636536580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e94102d40 msgr2=0x7f7e94103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.963+0000 7f7e99b82640 1 --2- 172.21.15.18:0/1636536580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e94102d40 0x7f7e94103120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009900 tx=0x7f7e8402a480 comp rx=0 tx=0).stop 2024-09-19T09:49:54.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.963+0000 7f7e99b82640 1 -- 172.21.15.18:0/1636536580 shutdown_connections 2024-09-19T09:49:54.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.963+0000 7f7e99b82640 1 --2- 172.21.15.18:0/1636536580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e9410c170 0x7f7e9410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.963+0000 7f7e99b82640 1 --2- 172.21.15.18:0/1636536580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e94103660 0x7f7e9410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.963+0000 7f7e99b82640 1 --2- 172.21.15.18:0/1636536580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e94102d40 0x7f7e94103120 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.963+0000 7f7e99b82640 1 -- 172.21.15.18:0/1636536580 >> 172.21.15.18:0/1636536580 conn(0x7f7e940fc7a0 msgr2=0x7f7e940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:54.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.963+0000 7f7e99b82640 1 -- 172.21.15.18:0/1636536580 shutdown_connections 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.963+0000 7f7e99b82640 1 -- 172.21.15.18:0/1636536580 wait complete. 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.963+0000 7f7e99b82640 1 Processor -- start 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e99b82640 1 -- start start 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e99b82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e94102d40 0x7f7e94198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e99b82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e94103660 0x7f7e94198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e99b82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e9410c170 0x7f7e9419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e99b82640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e94111f70 con 0x7f7e9410c170 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e99b82640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7e94111df0 con 0x7f7e94103660 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e99b82640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e941120f0 con 0x7f7e94102d40 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e93fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e9410c170 0x7f7e9419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e93fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e9410c170 0x7f7e9419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48358/0 (socket says 172.21.15.18:48358) 2024-09-19T09:49:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e93fff640 1 -- 172.21.15.18:0/1032462770 learned_addr learned my addr 172.21.15.18:0/1032462770 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e92ffd640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e94103660 0x7f7e94198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e937fe640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e94102d40 0x7f7e94198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e92ffd640 1 -- 172.21.15.18:0/1032462770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e94102d40 msgr2=0x7f7e94198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e92ffd640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e94102d40 0x7f7e94198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e92ffd640 1 -- 172.21.15.18:0/1032462770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e9410c170 msgr2=0x7f7e9419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e92ffd640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e9410c170 0x7f7e9419ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e92ffd640 1 -- 172.21.15.18:0/1032462770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9419d3b0 con 0x7f7e94103660 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.964+0000 7f7e93fff640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e9410c170 0x7f7e9419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.965+0000 7f7e92ffd640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e94103660 0x7f7e94198940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800d680 tx=0x7f7e8800db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.965+0000 7f7e90ff9640 1 -- 172.21.15.18:0/1032462770 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88017070 con 0x7f7e94103660 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.965+0000 7f7e99b82640 1 -- 172.21.15.18:0/1032462770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9419d6a0 con 0x7f7e94103660 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.965+0000 7f7e90ff9640 1 -- 172.21.15.18:0/1032462770 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e880097c0 con 0x7f7e94103660 2024-09-19T09:49:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.965+0000 7f7e90ff9640 1 -- 172.21.15.18:0/1032462770 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88004c60 con 0x7f7e94103660 2024-09-19T09:49:54.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.965+0000 7f7e99b82640 1 -- 172.21.15.18:0/1032462770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e941a4f80 con 0x7f7e94103660 2024-09-19T09:49:54.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.966+0000 7f7e99b82640 1 -- 172.21.15.18:0/1032462770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e94103120 con 0x7f7e94103660 2024-09-19T09:49:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.967+0000 7f7e90ff9640 1 -- 172.21.15.18:0/1032462770 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7e88009ce0 con 0x7f7e94103660 2024-09-19T09:49:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.968+0000 7f7e90ff9640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e7c0a3240 0x7f7e7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.968+0000 7f7e937fe640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e7c0a3240 0x7f7e7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.968+0000 7f7e90ff9640 1 -- 172.21.15.18:0/1032462770 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f7e880cedc0 con 0x7f7e94103660 2024-09-19T09:49:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.968+0000 7f7e937fe640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e7c0a3240 0x7f7e7c0a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009230 tx=0x7f7e840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:54.971+0000 7f7e90ff9640 1 -- 172.21.15.18:0/1032462770 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7e8809b890 con 0x7f7e94103660 2024-09-19T09:49:55.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.192+0000 7f7e99b82640 1 -- 172.21.15.18:0/1032462770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e94107210 con 0x7f7e94103660 2024-09-19T09:49:55.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.193+0000 7f7e90ff9640 1 -- 172.21.15.18:0/1032462770 <== mon.2 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3076 (secure 0 0 0) 0x7f7e8809fb90 con 0x7f7e94103660 2024-09-19T09:49:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:49:55.195 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":4,"btime":"2024-09-19T09:49:54:787034+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T09:49:55.195 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 4 2024-09-19T09:49:55.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 -- 172.21.15.18:0/1032462770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e7c0a3240 msgr2=0x7f7e7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:55.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e7c0a3240 0x7f7e7c0a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009230 tx=0x7f7e840058d0 comp rx=0 tx=0).stop 2024-09-19T09:49:55.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 -- 172.21.15.18:0/1032462770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e94103660 msgr2=0x7f7e94198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:55.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e94103660 0x7f7e94198940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800d680 tx=0x7f7e8800db40 comp rx=0 tx=0).stop 2024-09-19T09:49:55.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 -- 172.21.15.18:0/1032462770 shutdown_connections 2024-09-19T09:49:55.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e7c0a3240 0x7f7e7c0a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:55.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e9410c170 0x7f7e9419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:55.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e94103660 0x7f7e94198940 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:55.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 --2- 172.21.15.18:0/1032462770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e94102d40 0x7f7e94198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:55.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 -- 172.21.15.18:0/1032462770 >> 172.21.15.18:0/1032462770 conn(0x7f7e940fc7a0 msgr2=0x7f7e940fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:55.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 -- 172.21.15.18:0/1032462770 shutdown_connections 2024-09-19T09:49:55.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:55.195+0000 7f7e99b82640 1 -- 172.21.15.18:0/1032462770 wait complete. 2024-09-19T09:49:55.586 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:55.586 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:55.586 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:55.586 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:55.586 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:55.586 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:55.586 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:55.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: Deploying daemon mds.d on smithi018 2024-09-19T09:49:55.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6834/643561171,v1:172.21.15.18:6835/643561171] up:boot 2024-09-19T09:49:55.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: fsmap 3 up:standby 2024-09-19T09:49:55.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:49:55.587 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:55 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1032462770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:49:55.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:55.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:55.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:55.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:55.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:55.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:55.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:55.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: Deploying daemon mds.d on smithi018 2024-09-19T09:49:55.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.18:6834/643561171,v1:172.21.15.18:6835/643561171] up:boot 2024-09-19T09:49:55.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: fsmap 3 up:standby 2024-09-19T09:49:55.902 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:49:55.902 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:55 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1032462770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:49:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: Deploying daemon mds.d on smithi018 2024-09-19T09:49:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.18:6834/643561171,v1:172.21.15.18:6835/643561171] up:boot 2024-09-19T09:49:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: fsmap 3 up:standby 2024-09-19T09:49:55.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:49:55.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:55 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1032462770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:49:57.634 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:57 smithi018 ceph-mon[30956]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:57.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:57 smithi049 ceph-mon[34858]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:57.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:57 smithi162 ceph-mon[35174]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:49:58.137 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:49:58.162 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 09:49:57 smithi018 systemd[1]: Started Ceph mds.d for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:49:58.397 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:49:58.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.832+0000 7f7f033f4640 1 -- 172.21.15.18:0/3548504735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7efc074f40 msgr2=0x7f7efc10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:58.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.832+0000 7f7f033f4640 1 --2- 172.21.15.18:0/3548504735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7efc074f40 0x7f7efc10de80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009900 tx=0x7f7eec02a480 comp rx=0 tx=0).stop 2024-09-19T09:49:58.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.832+0000 7f7f033f4640 1 -- 172.21.15.18:0/3548504735 shutdown_connections 2024-09-19T09:49:58.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.832+0000 7f7f033f4640 1 --2- 172.21.15.18:0/3548504735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc10e3c0 0x7f7efc110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:58.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.832+0000 7f7f033f4640 1 --2- 172.21.15.18:0/3548504735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7efc074f40 0x7f7efc10de80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:58.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.832+0000 7f7f033f4640 1 --2- 172.21.15.18:0/3548504735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7efc074620 0x7f7efc074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:58.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.832+0000 7f7f033f4640 1 -- 172.21.15.18:0/3548504735 >> 172.21.15.18:0/3548504735 conn(0x7f7efc0fd8c0 msgr2=0x7f7efc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:58.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.832+0000 7f7f033f4640 1 -- 172.21.15.18:0/3548504735 shutdown_connections 2024-09-19T09:49:58.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.832+0000 7f7f033f4640 1 -- 172.21.15.18:0/3548504735 wait complete. 2024-09-19T09:49:58.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.832+0000 7f7f033f4640 1 Processor -- start 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f033f4640 1 -- start start 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f033f4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7efc074620 0x7f7efc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f033f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc074f40 0x7f7efc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f033f4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7efc10e3c0 0x7f7efc19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f033f4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc114140 con 0x7f7efc10e3c0 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f033f4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc113fc0 con 0x7f7efc074620 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f033f4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1142c0 con 0x7f7efc074f40 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f01991640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7efc10e3c0 0x7f7efc19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f01991640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7efc10e3c0 0x7f7efc19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34084/0 (socket says 172.21.15.18:34084) 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f01991640 1 -- 172.21.15.18:0/571651922 learned_addr learned my addr 172.21.15.18:0/571651922 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f01190640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7efc074620 0x7f7efc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:58.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f0098f640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc074f40 0x7f7efc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f01991640 1 -- 172.21.15.18:0/571651922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc074f40 msgr2=0x7f7efc19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f01991640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc074f40 0x7f7efc19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f01991640 1 -- 172.21.15.18:0/571651922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7efc074620 msgr2=0x7f7efc19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f01991640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7efc074620 0x7f7efc19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f01991640 1 -- 172.21.15.18:0/571651922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc19f5f0 con 0x7f7efc10e3c0 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.833+0000 7f7f01190640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7efc074620 0x7f7efc19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.834+0000 7f7f01991640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7efc10e3c0 0x7f7efc19ef10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400eaa0 tx=0x7f7ef400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.834+0000 7f7ef27fc640 1 -- 172.21.15.18:0/571651922 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400cdb0 con 0x7f7efc10e3c0 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.834+0000 7f7f033f4640 1 -- 172.21.15.18:0/571651922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc19f8e0 con 0x7f7efc10e3c0 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.834+0000 7f7ef27fc640 1 -- 172.21.15.18:0/571651922 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ef4005020 con 0x7f7efc10e3c0 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.834+0000 7f7ef27fc640 1 -- 172.21.15.18:0/571651922 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40116b0 con 0x7f7efc10e3c0 2024-09-19T09:49:58.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.834+0000 7f7f033f4640 1 -- 172.21.15.18:0/571651922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc1a71c0 con 0x7f7efc10e3c0 2024-09-19T09:49:58.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.835+0000 7f7f033f4640 1 -- 172.21.15.18:0/571651922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc074a00 con 0x7f7efc10e3c0 2024-09-19T09:49:58.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.836+0000 7f7ef27fc640 1 -- 172.21.15.18:0/571651922 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7ef4005560 con 0x7f7efc10e3c0 2024-09-19T09:49:58.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.837+0000 7f7ef27fc640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7ee80a3240 0x7f7ee80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:49:58.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.837+0000 7f7f01190640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7ee80a3240 0x7f7ee80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:49:58.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.837+0000 7f7ef27fc640 1 -- 172.21.15.18:0/571651922 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f7ef40cf660 con 0x7f7efc10e3c0 2024-09-19T09:49:58.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.837+0000 7f7f01190640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7ee80a3240 0x7f7ee80a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800bfd0 tx=0x7f7ef800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:49:58.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:58.841+0000 7f7ef27fc640 1 -- 172.21.15.18:0/571651922 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ef4016030 con 0x7f7efc10e3c0 2024-09-19T09:49:59.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.055+0000 7f7f033f4640 1 -- 172.21.15.18:0/571651922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7efc02d7c0 con 0x7f7efc10e3c0 2024-09-19T09:49:59.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.055+0000 7f7ef27fc640 1 -- 172.21.15.18:0/571651922 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3895 (secure 0 0 0) 0x7f7ef409c820 con 0x7f7efc10e3c0 2024-09-19T09:49:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:49:59.057 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"btime":"2024-09-19T09:49:58:447605+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T09:49:59.058 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 5 2024-09-19T09:49:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 -- 172.21.15.18:0/571651922 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7ee80a3240 msgr2=0x7f7ee80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7ee80a3240 0x7f7ee80a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800bfd0 tx=0x7f7ef800b390 comp rx=0 tx=0).stop 2024-09-19T09:49:59.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 -- 172.21.15.18:0/571651922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7efc10e3c0 msgr2=0x7f7efc19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:49:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7efc10e3c0 0x7f7efc19ef10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400eaa0 tx=0x7f7ef400ef60 comp rx=0 tx=0).stop 2024-09-19T09:49:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 -- 172.21.15.18:0/571651922 shutdown_connections 2024-09-19T09:49:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7ee80a3240 0x7f7ee80a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7efc10e3c0 0x7f7efc19ef10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc074f40 0x7f7efc19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 --2- 172.21.15.18:0/571651922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7efc074620 0x7f7efc19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:49:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 -- 172.21.15.18:0/571651922 >> 172.21.15.18:0/571651922 conn(0x7f7efc0fd8c0 msgr2=0x7f7efc0fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:49:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 -- 172.21.15.18:0/571651922 shutdown_connections 2024-09-19T09:49:59.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:49:59.057+0000 7f7f033f4640 1 -- 172.21.15.18:0/571651922 wait complete. 2024-09-19T09:49:59.093 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:59.093 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:59.093 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:59.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:59.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:59.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:59.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:59 smithi018 ceph-mon[30956]: Deploying daemon mds.e on smithi049 2024-09-19T09:49:59.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:59 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6836/70672754,v1:172.21.15.18:6837/70672754] up:boot 2024-09-19T09:49:59.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:59 smithi018 ceph-mon[30956]: fsmap 4 up:standby 2024-09-19T09:49:59.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:49:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:49:59.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:59 smithi049 ceph-mon[34858]: Deploying daemon mds.e on smithi049 2024-09-19T09:49:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:59 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.18:6836/70672754,v1:172.21.15.18:6837/70672754] up:boot 2024-09-19T09:49:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:59 smithi049 ceph-mon[34858]: fsmap 4 up:standby 2024-09-19T09:49:59.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:49:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:49:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:49:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:49:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:49:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:49:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:59 smithi162 ceph-mon[35174]: Deploying daemon mds.e on smithi049 2024-09-19T09:49:59.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:59 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.18:6836/70672754,v1:172.21.15.18:6837/70672754] up:boot 2024-09-19T09:49:59.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:59 smithi162 ceph-mon[35174]: fsmap 4 up:standby 2024-09-19T09:49:59.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:49:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:50:00.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:00 smithi018 ceph-mon[30956]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:00.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:00 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/571651922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:00.368 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:00 smithi018 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T09:50:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:00 smithi049 ceph-mon[34858]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:00 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/571651922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:00 smithi049 ceph-mon[34858]: overall HEALTH_OK 2024-09-19T09:50:00.401 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 09:50:00 smithi049 systemd[1]: Starting Ceph mds.e for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:50:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:00 smithi162 ceph-mon[35174]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:00 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/571651922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:00 smithi162 ceph-mon[35174]: overall HEALTH_OK 2024-09-19T09:50:00.728 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 09:50:00 smithi049 podman[64834]: 2024-09-19 09:50:00.36502965 +0000 UTC m=+0.016395463 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:50:00.729 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 09:50:00 smithi049 podman[64834]: 2024-09-19 09:50:00.463579955 +0000 UTC m=+0.114945755 container create 47c0c5eac077a1ec90f44a131207ea74bd083d65e03287a1d42bc699e298b54f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T09:50:00.729 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 09:50:00 smithi049 podman[64834]: 2024-09-19 09:50:00.699608829 +0000 UTC m=+0.350974626 container init 47c0c5eac077a1ec90f44a131207ea74bd083d65e03287a1d42bc699e298b54f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:50:00.729 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 09:50:00 smithi049 podman[64834]: 2024-09-19 09:50:00.702669833 +0000 UTC m=+0.354035641 container start 47c0c5eac077a1ec90f44a131207ea74bd083d65e03287a1d42bc699e298b54f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:50:01.150 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 09:50:00 smithi049 ceph-mds[64853]: -- 172.21.15.49:0/3166992526 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cd6daa7860 con 0x55cd6da84800 2024-09-19T09:50:01.150 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 09:50:00 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e[64849]: starting mds.e at 2024-09-19T09:50:01.151 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 09:50:00 smithi049 bash[64834]: 47c0c5eac077a1ec90f44a131207ea74bd083d65e03287a1d42bc699e298b54f 2024-09-19T09:50:01.151 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 09:50:00 smithi049 systemd[1]: Started Ceph mds.e for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:50:01.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:50:02.084 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:02.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: Deploying daemon mds.f on smithi162 2024-09-19T09:50:02.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] up:boot 2024-09-19T09:50:02.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: fsmap 5 up:standby 2024-09-19T09:50:02.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:01 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:50:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:02.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:02.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:02.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:02.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: Deploying daemon mds.f on smithi162 2024-09-19T09:50:02.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] up:boot 2024-09-19T09:50:02.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: fsmap 5 up:standby 2024-09-19T09:50:02.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:01 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:50:02.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: Deploying daemon mds.f on smithi162 2024-09-19T09:50:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] up:boot 2024-09-19T09:50:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: fsmap 5 up:standby 2024-09-19T09:50:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:01 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:50:02.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.565+0000 7f43c7729640 1 -- 172.21.15.18:0/2419130066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c01082a0 msgr2=0x7f43c010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:02.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.565+0000 7f43c7729640 1 --2- 172.21.15.18:0/2419130066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c01082a0 0x7f43c010ec40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009cd0 tx=0x7f43b802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:50:02.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.565+0000 7f43c7729640 1 -- 172.21.15.18:0/2419130066 shutdown_connections 2024-09-19T09:50:02.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.565+0000 7f43c7729640 1 --2- 172.21.15.18:0/2419130066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c01082a0 0x7f43c010ec40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:02.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.565+0000 7f43c7729640 1 --2- 172.21.15.18:0/2419130066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c01036e0 0x7f43c0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:02.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.565+0000 7f43c7729640 1 --2- 172.21.15.18:0/2419130066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c0102d30 0x7f43c0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:02.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.565+0000 7f43c7729640 1 -- 172.21.15.18:0/2419130066 >> 172.21.15.18:0/2419130066 conn(0x7f43c00fc7d0 msgr2=0x7f43c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:02.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.565+0000 7f43c7729640 1 -- 172.21.15.18:0/2419130066 shutdown_connections 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.565+0000 7f43c7729640 1 -- 172.21.15.18:0/2419130066 wait complete. 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c7729640 1 Processor -- start 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c7729640 1 -- start start 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c7729640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c0102d30 0x7f43c0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c7729640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c01036e0 0x7f43c0198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c7729640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c01082a0 0x7f43c019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c7729640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43c01120a0 con 0x7f43c01036e0 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c7729640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f43c0111f20 con 0x7f43c0102d30 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c7729640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43c0112220 con 0x7f43c01082a0 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c4cc4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c01036e0 0x7f43c0198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c4cc4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c01036e0 0x7f43c0198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34108/0 (socket says 172.21.15.18:34108) 2024-09-19T09:50:02.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c4cc4640 1 -- 172.21.15.18:0/945776188 learned_addr learned my addr 172.21.15.18:0/945776188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c54c5640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c0102d30 0x7f43c0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.566+0000 7f43c5cc6640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c01082a0 0x7f43c019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43c4cc4640 1 -- 172.21.15.18:0/945776188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c01082a0 msgr2=0x7f43c019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43c4cc4640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c01082a0 0x7f43c019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43c4cc4640 1 -- 172.21.15.18:0/945776188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c0102d30 msgr2=0x7f43c0198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43c4cc4640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c0102d30 0x7f43c0198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43c4cc4640 1 -- 172.21.15.18:0/945776188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c019d4e0 con 0x7f43c01036e0 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43c4cc4640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c01036e0 0x7f43c0198a70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43b400d740 tx=0x7f43b400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43b27fc640 1 -- 172.21.15.18:0/945776188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4017070 con 0x7f43c01036e0 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43b27fc640 1 -- 172.21.15.18:0/945776188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43b400de50 con 0x7f43c01036e0 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43c7729640 1 -- 172.21.15.18:0/945776188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c019d7d0 con 0x7f43c01036e0 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43b27fc640 1 -- 172.21.15.18:0/945776188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b400f6b0 con 0x7f43c01036e0 2024-09-19T09:50:02.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.567+0000 7f43c7729640 1 -- 172.21.15.18:0/945776188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c01a50b0 con 0x7f43c01036e0 2024-09-19T09:50:02.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.568+0000 7f43c7729640 1 -- 172.21.15.18:0/945776188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c0103110 con 0x7f43c01036e0 2024-09-19T09:50:02.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.569+0000 7f43b27fc640 1 -- 172.21.15.18:0/945776188 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f43b401a070 con 0x7f43c01036e0 2024-09-19T09:50:02.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.570+0000 7f43b27fc640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43ac0a3240 0x7f43ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:02.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.570+0000 7f43c54c5640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43ac0a3240 0x7f43ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:02.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.570+0000 7f43b27fc640 1 -- 172.21.15.18:0/945776188 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f43b40cedb0 con 0x7f43c01036e0 2024-09-19T09:50:02.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.571+0000 7f43c54c5640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43ac0a3240 0x7f43ac0a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009bd0 tx=0x7f43bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:02.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.574+0000 7f43b27fc640 1 -- 172.21.15.18:0/945776188 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43b409b880 con 0x7f43c01036e0 2024-09-19T09:50:02.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.786+0000 7f43c7729640 1 -- 172.21.15.18:0/945776188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43c010a2e0 con 0x7f43c01036e0 2024-09-19T09:50:02.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.786+0000 7f43b27fc640 1 -- 172.21.15.18:0/945776188 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4720 (secure 0 0 0) 0x7f43b409fb80 con 0x7f43c01036e0 2024-09-19T09:50:02.789 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:02.789 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-19T09:50:01:037898+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T09:50:02.789 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-19T09:50:02.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 -- 172.21.15.18:0/945776188 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43ac0a3240 msgr2=0x7f43ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:02.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43ac0a3240 0x7f43ac0a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009bd0 tx=0x7f43bc005f90 comp rx=0 tx=0).stop 2024-09-19T09:50:02.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 -- 172.21.15.18:0/945776188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c01036e0 msgr2=0x7f43c0198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:02.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c01036e0 0x7f43c0198a70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43b400d740 tx=0x7f43b400dc00 comp rx=0 tx=0).stop 2024-09-19T09:50:02.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 -- 172.21.15.18:0/945776188 shutdown_connections 2024-09-19T09:50:02.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43ac0a3240 0x7f43ac0a5700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:02.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c01082a0 0x7f43c019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:02.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c01036e0 0x7f43c0198a70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:02.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 --2- 172.21.15.18:0/945776188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43c0102d30 0x7f43c0198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:02.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 -- 172.21.15.18:0/945776188 >> 172.21.15.18:0/945776188 conn(0x7f43c00fc7d0 msgr2=0x7f43c0105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:02.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 -- 172.21.15.18:0/945776188 shutdown_connections 2024-09-19T09:50:02.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:02.790+0000 7f43c7729640 1 -- 172.21.15.18:0/945776188 wait complete. 2024-09-19T09:50:02.841 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 09:50:02 smithi162 systemd[1]: Starting Ceph mds.f for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:50:03.114 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:02 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/945776188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:03.114 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 09:50:02 smithi162 podman[64883]: 2024-09-19 09:50:02.884068237 +0000 UTC m=+0.016088512 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:50:03.114 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 09:50:02 smithi162 podman[64883]: 2024-09-19 09:50:02.987228209 +0000 UTC m=+0.119248476 container create 121aadc42177c510d232acd6a72ca6a28fbda297bc34205e4d3d427508106ffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:50:03.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:02 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/945776188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:03.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:02 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/945776188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:03.663 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 09:50:03 smithi162 podman[64883]: 2024-09-19 09:50:03.214618565 +0000 UTC m=+0.346638833 container init 121aadc42177c510d232acd6a72ca6a28fbda297bc34205e4d3d427508106ffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T09:50:03.663 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 09:50:03 smithi162 podman[64883]: 2024-09-19 09:50:03.217392256 +0000 UTC m=+0.349412533 container start 121aadc42177c510d232acd6a72ca6a28fbda297bc34205e4d3d427508106ffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:50:03.663 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 09:50:03 smithi162 ceph-mds[64902]: -- 172.21.15.162:0/4033199645 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a172663860 con 0x55a172641000 2024-09-19T09:50:03.663 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 09:50:03 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f[64898]: starting mds.f at 2024-09-19T09:50:03.663 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 09:50:03 smithi162 bash[64883]: 121aadc42177c510d232acd6a72ca6a28fbda297bc34205e4d3d427508106ffd 2024-09-19T09:50:03.663 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 09:50:03 smithi162 systemd[1]: Started Ceph mds.f for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:50:04.052 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:03 smithi162 ceph-mon[35174]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:04.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:04.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:04.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:04.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:04.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:04.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:03 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:04.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:03 smithi018 ceph-mon[30956]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:04.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:04.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:04.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:04.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:04.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:04.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:03 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:04.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:03 smithi049 ceph-mon[34858]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:04.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:04.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:04.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:04.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:04.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:04.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:03 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:05.069 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:04 smithi162 ceph-mon[35174]: Deploying daemon mds.c on smithi162 2024-09-19T09:50:05.070 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:04 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.162:6834/2083709123,v1:172.21.15.162:6835/2083709123] up:boot 2024-09-19T09:50:05.070 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:04 smithi162 ceph-mon[35174]: fsmap 6 up:standby 2024-09-19T09:50:05.070 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:04 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:50:05.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:04 smithi018 ceph-mon[30956]: Deploying daemon mds.c on smithi162 2024-09-19T09:50:05.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:04 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6834/2083709123,v1:172.21.15.162:6835/2083709123] up:boot 2024-09-19T09:50:05.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:04 smithi018 ceph-mon[30956]: fsmap 6 up:standby 2024-09-19T09:50:05.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:04 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:50:05.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:04 smithi049 ceph-mon[34858]: Deploying daemon mds.c on smithi162 2024-09-19T09:50:05.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:04 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.162:6834/2083709123,v1:172.21.15.162:6835/2083709123] up:boot 2024-09-19T09:50:05.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:04 smithi049 ceph-mon[34858]: fsmap 6 up:standby 2024-09-19T09:50:05.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:04 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:50:05.413 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 09:50:05 smithi162 systemd[1]: Starting Ceph mds.c for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:50:05.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:50:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:05.742 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 09:50:05 smithi162 podman[65183]: 2024-09-19 09:50:05.371961179 +0000 UTC m=+0.016402584 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:50:05.742 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 09:50:05 smithi162 podman[65183]: 2024-09-19 09:50:05.488530314 +0000 UTC m=+0.132971703 container create 63e882ce8d8fcc4fb15f9d80cb59ed94cb214f7d5aabe60074ca9a257448b606 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T09:50:05.742 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 09:50:05 smithi162 podman[65183]: 2024-09-19 09:50:05.740855274 +0000 UTC m=+0.385296676 container init 63e882ce8d8fcc4fb15f9d80cb59ed94cb214f7d5aabe60074ca9a257448b606 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:50:06.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:05 smithi018 ceph-mon[30956]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:06.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:05 smithi049 ceph-mon[34858]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:06.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:05 smithi162 ceph-mon[35174]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:06.163 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 09:50:05 smithi162 podman[65183]: 2024-09-19 09:50:05.743706153 +0000 UTC m=+0.388147553 container start 63e882ce8d8fcc4fb15f9d80cb59ed94cb214f7d5aabe60074ca9a257448b606 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:50:06.163 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 09:50:05 smithi162 ceph-mds[65202]: -- 172.21.15.162:0/724737635 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cd71135860 con 0x55cd71112800 2024-09-19T09:50:06.163 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 09:50:05 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c[65198]: starting mds.c at 2024-09-19T09:50:06.163 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 09:50:05 smithi162 bash[65183]: 63e882ce8d8fcc4fb15f9d80cb59ed94cb214f7d5aabe60074ca9a257448b606 2024-09-19T09:50:06.163 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 09:50:05 smithi162 systemd[1]: Started Ceph mds.c for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:50:06.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.157+0000 7f0507383640 1 -- 172.21.15.18:0/3198396692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f050010c170 msgr2=0x7f050010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.157+0000 7f0507383640 1 --2- 172.21.15.18:0/3198396692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f050010c170 0x7f050010e610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009ca0 tx=0x7f04f802a950 comp rx=0 tx=0).stop 2024-09-19T09:50:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.157+0000 7f0507383640 1 -- 172.21.15.18:0/3198396692 shutdown_connections 2024-09-19T09:50:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.157+0000 7f0507383640 1 --2- 172.21.15.18:0/3198396692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f050010c170 0x7f050010e610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.157+0000 7f0507383640 1 --2- 172.21.15.18:0/3198396692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0500103660 0x7f050010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.157+0000 7f0507383640 1 --2- 172.21.15.18:0/3198396692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0500102d40 0x7f0500103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.157+0000 7f0507383640 1 -- 172.21.15.18:0/3198396692 >> 172.21.15.18:0/3198396692 conn(0x7f05000fc7a0 msgr2=0x7f05000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.157+0000 7f0507383640 1 -- 172.21.15.18:0/3198396692 shutdown_connections 2024-09-19T09:50:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.157+0000 7f0507383640 1 -- 172.21.15.18:0/3198396692 wait complete. 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f0507383640 1 Processor -- start 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f0507383640 1 -- start start 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f0507383640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0500102d40 0x7f0500198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f0507383640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0500103660 0x7f05001988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f0507383640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050010c170 0x7f050019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f0507383640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0500111f70 con 0x7f0500103660 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f0507383640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0500111df0 con 0x7f050010c170 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f0507383640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05001120f0 con 0x7f0500102d40 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f050491e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0500103660 0x7f05001988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f050491e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0500103660 0x7f05001988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34132/0 (socket says 172.21.15.18:34132) 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.158+0000 7f050491e640 1 -- 172.21.15.18:0/3504926587 learned_addr learned my addr 172.21.15.18:0/3504926587 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f0505920640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050010c170 0x7f050019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f050511f640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0500102d40 0x7f0500198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f050491e640 1 -- 172.21.15.18:0/3504926587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0500102d40 msgr2=0x7f0500198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f050491e640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0500102d40 0x7f0500198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f050491e640 1 -- 172.21.15.18:0/3504926587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050010c170 msgr2=0x7f050019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f050491e640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050010c170 0x7f050019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f050491e640 1 -- 172.21.15.18:0/3504926587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050019d340 con 0x7f0500103660 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f050491e640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0500103660 0x7f05001988d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f04f000c970 tx=0x7f04f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f04f67fc640 1 -- 172.21.15.18:0/3504926587 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0007bb0 con 0x7f0500103660 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f04f67fc640 1 -- 172.21.15.18:0/3504926587 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04f0007d50 con 0x7f0500103660 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f04f67fc640 1 -- 172.21.15.18:0/3504926587 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0018820 con 0x7f0500103660 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f0507383640 1 -- 172.21.15.18:0/3504926587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050019d630 con 0x7f0500103660 2024-09-19T09:50:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.159+0000 7f0507383640 1 -- 172.21.15.18:0/3504926587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05001a4f10 con 0x7f0500103660 2024-09-19T09:50:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.160+0000 7f0507383640 1 -- 172.21.15.18:0/3504926587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0500103120 con 0x7f0500103660 2024-09-19T09:50:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.161+0000 7f04f67fc640 1 -- 172.21.15.18:0/3504926587 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f04f00189c0 con 0x7f0500103660 2024-09-19T09:50:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.162+0000 7f04f67fc640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04ec0a32c0 0x7f04ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.162+0000 7f050511f640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04ec0a32c0 0x7f04ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.162+0000 7f04f67fc640 1 -- 172.21.15.18:0/3504926587 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f04f00cf780 con 0x7f0500103660 2024-09-19T09:50:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.163+0000 7f050511f640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04ec0a32c0 0x7f04ec0a5780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f04fc005fd0 tx=0x7f04fc005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.166+0000 7f04f67fc640 1 -- 172.21.15.18:0/3504926587 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04f0014030 con 0x7f0500103660 2024-09-19T09:50:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.376+0000 7f0507383640 1 -- 172.21.15.18:0/3504926587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05001996f0 con 0x7f0500103660 2024-09-19T09:50:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.377+0000 7f04f67fc640 1 -- 172.21.15.18:0/3504926587 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6376 (secure 0 0 0) 0x7f05001996f0 con 0x7f0500103660 2024-09-19T09:50:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:06.379 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"btime":"2024-09-19T09:50:05:849174+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T09:50:06.379 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-19T09:50:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 -- 172.21.15.18:0/3504926587 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04ec0a32c0 msgr2=0x7f04ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04ec0a32c0 0x7f04ec0a5780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f04fc005fd0 tx=0x7f04fc005e20 comp rx=0 tx=0).stop 2024-09-19T09:50:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 -- 172.21.15.18:0/3504926587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0500103660 msgr2=0x7f05001988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0500103660 0x7f05001988d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f04f000c970 tx=0x7f04f000ce30 comp rx=0 tx=0).stop 2024-09-19T09:50:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 -- 172.21.15.18:0/3504926587 shutdown_connections 2024-09-19T09:50:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04ec0a32c0 0x7f04ec0a5780 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050010c170 0x7f050019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0500103660 0x7f05001988d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 --2- 172.21.15.18:0/3504926587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0500102d40 0x7f0500198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 -- 172.21.15.18:0/3504926587 >> 172.21.15.18:0/3504926587 conn(0x7f05000fc7a0 msgr2=0x7f05000fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 -- 172.21.15.18:0/3504926587 shutdown_connections 2024-09-19T09:50:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:06.379+0000 7f0507383640 1 -- 172.21.15.18:0/3504926587 wait complete. 2024-09-19T09:50:07.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6836/3104050334,v1:172.21.15.162:6837/3104050334] up:boot 2024-09-19T09:50:07.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: fsmap 7 up:standby 2024-09-19T09:50:07.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:50:07.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:07.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:07.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:07.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:07.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:07.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:07.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: Deploying daemon mds.h on smithi049 2024-09-19T09:50:07.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:06 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3504926587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:07.124 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.162:6836/3104050334,v1:172.21.15.162:6837/3104050334] up:boot 2024-09-19T09:50:07.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: fsmap 7 up:standby 2024-09-19T09:50:07.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:50:07.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:07.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:07.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:07.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:07.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:07.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:07.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: Deploying daemon mds.h on smithi049 2024-09-19T09:50:07.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:06 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3504926587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:07.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.162:6836/3104050334,v1:172.21.15.162:6837/3104050334] up:boot 2024-09-19T09:50:07.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: fsmap 7 up:standby 2024-09-19T09:50:07.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:50:07.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:07.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:07.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:07.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:07.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:07.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:07.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: Deploying daemon mds.h on smithi049 2024-09-19T09:50:07.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:06 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3504926587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:08.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:07 smithi049 ceph-mon[34858]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:08.150 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 09:50:08 smithi049 systemd[1]: Starting Ceph mds.h for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:50:08.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:07 smithi162 ceph-mon[35174]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:08.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:07 smithi018 ceph-mon[30956]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:08.522 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 09:50:08 smithi049 podman[65136]: 2024-09-19 09:50:08.169150259 +0000 UTC m=+0.016494997 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:50:08.522 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 09:50:08 smithi049 podman[65136]: 2024-09-19 09:50:08.275869473 +0000 UTC m=+0.123214243 container create 9c2cae7447ec885437250e2abf0d9bd28e1908d5b927fafdfd6bb078bc18195c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T09:50:08.522 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 09:50:08 smithi049 podman[65136]: 2024-09-19 09:50:08.520418069 +0000 UTC m=+0.367762800 container init 9c2cae7447ec885437250e2abf0d9bd28e1908d5b927fafdfd6bb078bc18195c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T09:50:08.900 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 09:50:08 smithi049 podman[65136]: 2024-09-19 09:50:08.523710987 +0000 UTC m=+0.371055725 container start 9c2cae7447ec885437250e2abf0d9bd28e1908d5b927fafdfd6bb078bc18195c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T09:50:08.900 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 09:50:08 smithi049 ceph-mds[65155]: -- 172.21.15.49:0/2130363371 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559c12939860 con 0x559c12917400 2024-09-19T09:50:08.900 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 09:50:08 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h[65151]: starting mds.h at 2024-09-19T09:50:08.900 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 09:50:08 smithi049 bash[65136]: 9c2cae7447ec885437250e2abf0d9bd28e1908d5b927fafdfd6bb078bc18195c 2024-09-19T09:50:08.900 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 09:50:08 smithi049 systemd[1]: Started Ceph mds.h for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:50:09.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:50:09.350 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:09.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:09.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:09.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:09.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:09.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:09.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:09.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:09.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: Deploying daemon mds.i on smithi162 2024-09-19T09:50:09.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] up:boot 2024-09-19T09:50:09.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: fsmap 8 up:standby 2024-09-19T09:50:09.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:50:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.970+0000 7fd6301f3640 1 -- 172.21.15.18:0/2778194421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628103660 msgr2=0x7fd62810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.970+0000 7fd6301f3640 1 --2- 172.21.15.18:0/2778194421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628103660 0x7fd62810bb50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd618009900 tx=0x7fd61802a480 comp rx=0 tx=0).stop 2024-09-19T09:50:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.970+0000 7fd6301f3640 1 -- 172.21.15.18:0/2778194421 shutdown_connections 2024-09-19T09:50:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.970+0000 7fd6301f3640 1 --2- 172.21.15.18:0/2778194421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62810c170 0x7fd62810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.970+0000 7fd6301f3640 1 --2- 172.21.15.18:0/2778194421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628103660 0x7fd62810bb50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.970+0000 7fd6301f3640 1 --2- 172.21.15.18:0/2778194421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd628102d40 0x7fd628103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.970+0000 7fd6301f3640 1 -- 172.21.15.18:0/2778194421 >> 172.21.15.18:0/2778194421 conn(0x7fd6280fc7a0 msgr2=0x7fd6280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.970+0000 7fd6301f3640 1 -- 172.21.15.18:0/2778194421 shutdown_connections 2024-09-19T09:50:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.970+0000 7fd6301f3640 1 -- 172.21.15.18:0/2778194421 wait complete. 2024-09-19T09:50:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.971+0000 7fd6301f3640 1 Processor -- start 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.971+0000 7fd6301f3640 1 -- start start 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.971+0000 7fd6301f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd628102d40 0x7fd628198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.971+0000 7fd6301f3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628103660 0x7fd6281989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.971+0000 7fd6301f3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62810c170 0x7fd62819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.971+0000 7fd6301f3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd628111fc0 con 0x7fd628103660 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.971+0000 7fd6301f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd628111e40 con 0x7fd628102d40 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.971+0000 7fd6301f3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd628112140 con 0x7fd62810c170 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.971+0000 7fd62d78e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628103660 0x7fd6281989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd62d78e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628103660 0x7fd6281989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37168/0 (socket says 172.21.15.18:37168) 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd62d78e640 1 -- 172.21.15.18:0/3243695954 learned_addr learned my addr 172.21.15.18:0/3243695954 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd62df8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd628102d40 0x7fd628198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd62e790640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62810c170 0x7fd62819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd62d78e640 1 -- 172.21.15.18:0/3243695954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62810c170 msgr2=0x7fd62819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd62d78e640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62810c170 0x7fd62819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd62d78e640 1 -- 172.21.15.18:0/3243695954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd628102d40 msgr2=0x7fd628198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd62d78e640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd628102d40 0x7fd628198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd62d78e640 1 -- 172.21.15.18:0/3243695954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62819d410 con 0x7fd628103660 2024-09-19T09:50:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd62d78e640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628103660 0x7fd6281989a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd618004770 tx=0x7fd618003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd61effd640 1 -- 172.21.15.18:0/3243695954 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61803f070 con 0x7fd628103660 2024-09-19T09:50:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd61effd640 1 -- 172.21.15.18:0/3243695954 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd618031ca0 con 0x7fd628103660 2024-09-19T09:50:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd6301f3640 1 -- 172.21.15.18:0/3243695954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62819d6a0 con 0x7fd628103660 2024-09-19T09:50:09.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd61effd640 1 -- 172.21.15.18:0/3243695954 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618035030 con 0x7fd628103660 2024-09-19T09:50:09.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.972+0000 7fd6301f3640 1 -- 172.21.15.18:0/3243695954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6281a4fe0 con 0x7fd628103660 2024-09-19T09:50:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.973+0000 7fd6301f3640 1 -- 172.21.15.18:0/3243695954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd628103120 con 0x7fd628103660 2024-09-19T09:50:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.974+0000 7fd61effd640 1 -- 172.21.15.18:0/3243695954 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd618042070 con 0x7fd628103660 2024-09-19T09:50:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.975+0000 7fd61effd640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6140a3240 0x7fd6140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.975+0000 7fd62df8f640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6140a3240 0x7fd6140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.975+0000 7fd61effd640 1 -- 172.21.15.18:0/3243695954 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fd6180f00d0 con 0x7fd628103660 2024-09-19T09:50:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.976+0000 7fd62df8f640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6140a3240 0x7fd6140a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd62400bbe0 tx=0x7fd62400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:09.978+0000 7fd61effd640 1 -- 172.21.15.18:0/3243695954 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6180bcc40 con 0x7fd628103660 2024-09-19T09:50:10.014 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:10.014 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:10.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:10.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:10.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:10.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:10.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:10.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: Deploying daemon mds.i on smithi162 2024-09-19T09:50:10.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] up:boot 2024-09-19T09:50:10.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: fsmap 8 up:standby 2024-09-19T09:50:10.015 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:50:10.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:10.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:10.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:10.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:10.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:10.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:10.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:10.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: Deploying daemon mds.i on smithi162 2024-09-19T09:50:10.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] up:boot 2024-09-19T09:50:10.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: fsmap 8 up:standby 2024-09-19T09:50:10.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:50:10.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.188+0000 7fd6301f3640 1 -- 172.21.15.18:0/3243695954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6281997c0 con 0x7fd628103660 2024-09-19T09:50:10.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.189+0000 7fd61effd640 1 -- 172.21.15.18:0/3243695954 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7201 (secure 0 0 0) 0x7fd6281997c0 con 0x7fd628103660 2024-09-19T09:50:10.191 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:10.191 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"btime":"2024-09-19T09:50:08:897577+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T09:50:10.191 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-09-19T09:50:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 -- 172.21.15.18:0/3243695954 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6140a3240 msgr2=0x7fd6140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6140a3240 0x7fd6140a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd62400bbe0 tx=0x7fd62400b390 comp rx=0 tx=0).stop 2024-09-19T09:50:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 -- 172.21.15.18:0/3243695954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628103660 msgr2=0x7fd6281989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628103660 0x7fd6281989a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd618004770 tx=0x7fd618003c10 comp rx=0 tx=0).stop 2024-09-19T09:50:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 -- 172.21.15.18:0/3243695954 shutdown_connections 2024-09-19T09:50:10.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6140a3240 0x7fd6140a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:10.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62810c170 0x7fd62819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:10.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628103660 0x7fd6281989a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:10.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 --2- 172.21.15.18:0/3243695954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd628102d40 0x7fd628198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:10.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 -- 172.21.15.18:0/3243695954 >> 172.21.15.18:0/3243695954 conn(0x7fd6280fc7a0 msgr2=0x7fd6280fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:10.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.192+0000 7fd6301f3640 1 -- 172.21.15.18:0/3243695954 shutdown_connections 2024-09-19T09:50:10.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:10.193+0000 7fd6301f3640 1 -- 172.21.15.18:0/3243695954 wait complete. 2024-09-19T09:50:10.663 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 09:50:10 smithi162 systemd[1]: Starting Ceph mds.i for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:50:10.819 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:10 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3243695954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:10.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:10 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3243695954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:10.944 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 09:50:10 smithi162 podman[65486]: 2024-09-19 09:50:10.609360164 +0000 UTC m=+0.015927142 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:50:10.945 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 09:50:10 smithi162 podman[65486]: 2024-09-19 09:50:10.724027438 +0000 UTC m=+0.130594413 container create bb436781b811fdffee53a617f9d77fdc558b46a68d0c3e1c3ad56f31b862ed40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T09:50:11.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:10 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3243695954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:11.413 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 09:50:10 smithi162 podman[65486]: 2024-09-19 09:50:10.942993784 +0000 UTC m=+0.349560757 container init bb436781b811fdffee53a617f9d77fdc558b46a68d0c3e1c3ad56f31b862ed40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-19T09:50:11.413 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 09:50:10 smithi162 podman[65486]: 2024-09-19 09:50:10.945995765 +0000 UTC m=+0.352562734 container start bb436781b811fdffee53a617f9d77fdc558b46a68d0c3e1c3ad56f31b862ed40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:50:11.413 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 09:50:10 smithi162 ceph-mds[65505]: -- 172.21.15.162:0/2500885206 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f0f70f860 con 0x563f0f6ed400 2024-09-19T09:50:11.413 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 09:50:10 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i[65501]: starting mds.i at 2024-09-19T09:50:11.413 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 09:50:11 smithi162 bash[65486]: bb436781b811fdffee53a617f9d77fdc558b46a68d0c3e1c3ad56f31b862ed40 2024-09-19T09:50:11.413 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 09:50:11 smithi162 systemd[1]: Started Ceph mds.i for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:50:12.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:12.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:12.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:12.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:12.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:12.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:12.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:12.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: Deploying daemon mds.g on smithi018 2024-09-19T09:50:12.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] up:boot 2024-09-19T09:50:12.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: fsmap 9 up:standby 2024-09-19T09:50:12.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:50:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:12.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:12.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:12.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:12.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:12.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: Deploying daemon mds.g on smithi018 2024-09-19T09:50:12.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] up:boot 2024-09-19T09:50:12.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: fsmap 9 up:standby 2024-09-19T09:50:12.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: Deploying daemon mds.g on smithi018 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] up:boot 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: fsmap 9 up:standby 2024-09-19T09:50:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:50:12.851 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:50:13.135 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 09:50:13 smithi018 systemd[1]: Starting Ceph mds.g for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:50:13.533 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 09:50:13 smithi018 podman[71401]: 2024-09-19 09:50:13.177087987 +0000 UTC m=+0.017088655 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:50:13.533 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 09:50:13 smithi018 podman[71401]: 2024-09-19 09:50:13.285444769 +0000 UTC m=+0.125445462 container create cb39f182c715c1c22e3b34ee06a06cb934b2dd53a0ae16bfd52ef50736a803d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:50:13.534 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 09:50:13 smithi018 podman[71401]: 2024-09-19 09:50:13.504621691 +0000 UTC m=+0.344622345 container init cb39f182c715c1c22e3b34ee06a06cb934b2dd53a0ae16bfd52ef50736a803d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:50:13.534 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 09:50:13 smithi018 podman[71401]: 2024-09-19 09:50:13.507613102 +0000 UTC m=+0.347613765 container start cb39f182c715c1c22e3b34ee06a06cb934b2dd53a0ae16bfd52ef50736a803d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:50:13.534 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 09:50:13 smithi018 ceph-mds[71442]: -- 172.21.15.18:0/472971500 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55df94611860 con 0x55df945ef400 2024-09-19T09:50:13.662 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:13.784 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 09:50:13 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g[71433]: starting mds.g at 2024-09-19T09:50:13.784 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 09:50:13 smithi018 bash[71401]: cb39f182c715c1c22e3b34ee06a06cb934b2dd53a0ae16bfd52ef50736a803d0 2024-09-19T09:50:13.785 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 09:50:13 smithi018 systemd[1]: Started Ceph mds.g for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:50:14.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.151+0000 7f3729b67640 1 -- 172.21.15.18:0/3002672463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37241037a0 msgr2=0x7f372410bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:14.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.151+0000 7f3729b67640 1 --2- 172.21.15.18:0/3002672463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37241037a0 0x7f372410bc00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3718009900 tx=0x7f371802a410 comp rx=0 tx=0).stop 2024-09-19T09:50:14.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.151+0000 7f3729b67640 1 -- 172.21.15.18:0/3002672463 shutdown_connections 2024-09-19T09:50:14.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.151+0000 7f3729b67640 1 --2- 172.21.15.18:0/3002672463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f372410c2f0 0x7f372410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:14.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.151+0000 7f3729b67640 1 --2- 172.21.15.18:0/3002672463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37241037a0 0x7f372410bc00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:14.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.151+0000 7f3729b67640 1 --2- 172.21.15.18:0/3002672463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3724102df0 0x7f37241031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:14.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.151+0000 7f3729b67640 1 -- 172.21.15.18:0/3002672463 >> 172.21.15.18:0/3002672463 conn(0x7f37240fc7d0 msgr2=0x7f37240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:14.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.151+0000 7f3729b67640 1 -- 172.21.15.18:0/3002672463 shutdown_connections 2024-09-19T09:50:14.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.151+0000 7f3729b67640 1 -- 172.21.15.18:0/3002672463 wait complete. 2024-09-19T09:50:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.151+0000 7f3729b67640 1 Processor -- start 2024-09-19T09:50:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3729b67640 1 -- start start 2024-09-19T09:50:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3729b67640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3724102df0 0x7f3724100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3729b67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37241037a0 0x7f3724100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3729b67640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f372410c2f0 0x7f37241014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3729b67640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37241120b0 con 0x7f37241037a0 2024-09-19T09:50:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3729b67640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3724111f30 con 0x7f3724102df0 2024-09-19T09:50:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3729b67640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3724112230 con 0x7f372410c2f0 2024-09-19T09:50:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3722ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37241037a0 0x7f3724100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:14.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3722ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37241037a0 0x7f3724100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37196/0 (socket says 172.21.15.18:37196) 2024-09-19T09:50:14.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3722ffd640 1 -- 172.21.15.18:0/585821683 learned_addr learned my addr 172.21.15.18:0/585821683 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:14.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f37237fe640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3724102df0 0x7f3724100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:14.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3723fff640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f372410c2f0 0x7f37241014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:14.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3722ffd640 1 -- 172.21.15.18:0/585821683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f372410c2f0 msgr2=0x7f37241014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:14.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3722ffd640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f372410c2f0 0x7f37241014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:14.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3722ffd640 1 -- 172.21.15.18:0/585821683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3724102df0 msgr2=0x7f3724100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:14.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3722ffd640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3724102df0 0x7f3724100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:14.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3722ffd640 1 -- 172.21.15.18:0/585821683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37241a6af0 con 0x7f37241037a0 2024-09-19T09:50:14.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.152+0000 7f3722ffd640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37241037a0 0x7f3724100f90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3718005940 tx=0x7f37180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:14.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.153+0000 7f3720ff9640 1 -- 172.21.15.18:0/585821683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371803f030 con 0x7f37241037a0 2024-09-19T09:50:14.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.153+0000 7f3729b67640 1 -- 172.21.15.18:0/585821683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37241a6d80 con 0x7f37241037a0 2024-09-19T09:50:14.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.153+0000 7f3720ff9640 1 -- 172.21.15.18:0/585821683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3718003ce0 con 0x7f37241037a0 2024-09-19T09:50:14.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.153+0000 7f3720ff9640 1 -- 172.21.15.18:0/585821683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718035070 con 0x7f37241037a0 2024-09-19T09:50:14.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.153+0000 7f3729b67640 1 -- 172.21.15.18:0/585821683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37241a7200 con 0x7f37241037a0 2024-09-19T09:50:14.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.154+0000 7f3729b67640 1 -- 172.21.15.18:0/585821683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37241031d0 con 0x7f37241037a0 2024-09-19T09:50:14.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.155+0000 7f3720ff9640 1 -- 172.21.15.18:0/585821683 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3718042030 con 0x7f37241037a0 2024-09-19T09:50:14.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.156+0000 7f3720ff9640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f370c0a3240 0x7f370c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:14.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.156+0000 7f37237fe640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f370c0a3240 0x7f370c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:14.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.156+0000 7f3720ff9640 1 -- 172.21.15.18:0/585821683 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f37180ef8f0 con 0x7f37241037a0 2024-09-19T09:50:14.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.156+0000 7f37237fe640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f370c0a3240 0x7f370c0a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3714005fd0 tx=0x7f3714009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:14.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.160+0000 7f3720ff9640 1 -- 172.21.15.18:0/585821683 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37180bc460 con 0x7f37241037a0 2024-09-19T09:50:14.335 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:14 smithi018 ceph-mon[30956]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:14.335 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:14.335 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:14.335 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:14.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:14.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:14.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:14 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.379+0000 7f3729b67640 1 -- 172.21.15.18:0/585821683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37241072c0 con 0x7f37241037a0 2024-09-19T09:50:14.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.380+0000 7f3720ff9640 1 -- 172.21.15.18:0/585821683 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8857 (secure 0 0 0) 0x7f37180c0760 con 0x7f37241037a0 2024-09-19T09:50:14.382 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:14.382 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":11,"btime":"2024-09-19T09:50:14:110080+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T09:50:14.383 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 11 2024-09-19T09:50:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 -- 172.21.15.18:0/585821683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f370c0a3240 msgr2=0x7f370c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f370c0a3240 0x7f370c0a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3714005fd0 tx=0x7f3714009760 comp rx=0 tx=0).stop 2024-09-19T09:50:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 -- 172.21.15.18:0/585821683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37241037a0 msgr2=0x7f3724100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37241037a0 0x7f3724100f90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3718005940 tx=0x7f37180042f0 comp rx=0 tx=0).stop 2024-09-19T09:50:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 -- 172.21.15.18:0/585821683 shutdown_connections 2024-09-19T09:50:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f370c0a3240 0x7f370c0a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f372410c2f0 0x7f37241014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37241037a0 0x7f3724100f90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 --2- 172.21.15.18:0/585821683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3724102df0 0x7f3724100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 -- 172.21.15.18:0/585821683 >> 172.21.15.18:0/585821683 conn(0x7f37240fc7d0 msgr2=0x7f37240fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 -- 172.21.15.18:0/585821683 shutdown_connections 2024-09-19T09:50:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:14.382+0000 7f3729b67640 1 -- 172.21.15.18:0/585821683 wait complete. 2024-09-19T09:50:14.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:14 smithi049 ceph-mon[34858]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:14.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:14.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:14.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:14.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:14.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:14.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:14 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:14 smithi162 ceph-mon[35174]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:14 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:15.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:15 smithi018 ceph-mon[30956]: Deploying daemon mds.a on smithi018 2024-09-19T09:50:15.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:15 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6838/2438161705,v1:172.21.15.18:6839/2438161705] up:boot 2024-09-19T09:50:15.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:15 smithi018 ceph-mon[30956]: fsmap 10 up:standby 2024-09-19T09:50:15.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:15 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:50:15.289 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:15 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/585821683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:15.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:15 smithi049 ceph-mon[34858]: Deploying daemon mds.a on smithi018 2024-09-19T09:50:15.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:15 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.18:6838/2438161705,v1:172.21.15.18:6839/2438161705] up:boot 2024-09-19T09:50:15.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:15 smithi049 ceph-mon[34858]: fsmap 10 up:standby 2024-09-19T09:50:15.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:15 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:50:15.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:15 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/585821683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:15 smithi162 ceph-mon[35174]: Deploying daemon mds.a on smithi018 2024-09-19T09:50:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:15 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.18:6838/2438161705,v1:172.21.15.18:6839/2438161705] up:boot 2024-09-19T09:50:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:15 smithi162 ceph-mon[35174]: fsmap 10 up:standby 2024-09-19T09:50:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:15 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:50:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:15 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/585821683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:16.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:16 smithi018 ceph-mon[30956]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:16.385 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 09:50:16 smithi018 systemd[1]: Starting Ceph mds.a for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:50:16.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:16 smithi049 ceph-mon[34858]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:16.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:16 smithi162 ceph-mon[35174]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:16.866 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 09:50:16 smithi018 podman[71800]: 2024-09-19 09:50:16.455872976 +0000 UTC m=+0.016447164 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:50:16.866 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 09:50:16 smithi018 podman[71800]: 2024-09-19 09:50:16.554333233 +0000 UTC m=+0.114907454 container create 6ba4d341ef5b535c75834e058b896f9b744536a3bd0bfc79014cc7abe093c2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T09:50:16.866 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 09:50:16 smithi018 podman[71800]: 2024-09-19 09:50:16.773285773 +0000 UTC m=+0.333859955 container init 6ba4d341ef5b535c75834e058b896f9b744536a3bd0bfc79014cc7abe093c2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T09:50:16.867 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 09:50:16 smithi018 podman[71800]: 2024-09-19 09:50:16.776261577 +0000 UTC m=+0.336835749 container start 6ba4d341ef5b535c75834e058b896f9b744536a3bd0bfc79014cc7abe093c2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:50:16.867 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 09:50:16 smithi018 ceph-mds[71819]: -- 172.21.15.18:0/2998387143 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559ae60dd860 con 0x559ae60bb400 2024-09-19T09:50:16.867 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 09:50:16 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a[71815]: starting mds.a at 2024-09-19T09:50:16.867 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 09:50:16 smithi018 bash[71800]: 6ba4d341ef5b535c75834e058b896f9b744536a3bd0bfc79014cc7abe093c2ed 2024-09-19T09:50:17.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:50:17.135 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 09:50:16 smithi018 systemd[1]: Started Ceph mds.a for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:50:17.275 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.726+0000 7fecf9ffe640 1 -- 172.21.15.18:0/1099705277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecf4100ca0 msgr2=0x7fecf4106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.726+0000 7fecf9ffe640 1 --2- 172.21.15.18:0/1099705277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecf4100ca0 0x7fecf4106840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fece8009930 tx=0x7fece802a420 comp rx=0 tx=0).stop 2024-09-19T09:50:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.726+0000 7fecf9ffe640 1 -- 172.21.15.18:0/1099705277 shutdown_connections 2024-09-19T09:50:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.726+0000 7fecf9ffe640 1 --2- 172.21.15.18:0/1099705277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4106f50 0x7fecf410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.726+0000 7fecf9ffe640 1 --2- 172.21.15.18:0/1099705277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecf4100ca0 0x7fecf4106840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.726+0000 7fecf9ffe640 1 --2- 172.21.15.18:0/1099705277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf41002f0 0x7fecf41006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.726+0000 7fecf9ffe640 1 -- 172.21.15.18:0/1099705277 >> 172.21.15.18:0/1099705277 conn(0x7fecf4077210 msgr2=0x7fecf40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.726+0000 7fecf9ffe640 1 -- 172.21.15.18:0/1099705277 shutdown_connections 2024-09-19T09:50:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.726+0000 7fecf9ffe640 1 -- 172.21.15.18:0/1099705277 wait complete. 2024-09-19T09:50:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.727+0000 7fecf9ffe640 1 Processor -- start 2024-09-19T09:50:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.727+0000 7fecf9ffe640 1 -- start start 2024-09-19T09:50:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.727+0000 7fecf9ffe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf41002f0 0x7fecf41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.727+0000 7fecf9ffe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4100ca0 0x7fecf4198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.727+0000 7fecf9ffe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecf4106f50 0x7fecf419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf9ffe640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4111fa0 con 0x7fecf4106f50 2024-09-19T09:50:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf9ffe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4111e20 con 0x7fecf4100ca0 2024-09-19T09:50:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf9ffe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4112120 con 0x7fecf41002f0 2024-09-19T09:50:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecf4106f50 0x7fecf419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecf4106f50 0x7fecf419cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60812/0 (socket says 172.21.15.18:60812) 2024-09-19T09:50:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf3fff640 1 -- 172.21.15.18:0/3465032147 learned_addr learned my addr 172.21.15.18:0/3465032147 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf2ffd640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4100ca0 0x7fecf4198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf37fe640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf41002f0 0x7fecf41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf3fff640 1 -- 172.21.15.18:0/3465032147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf41002f0 msgr2=0x7fecf41984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf3fff640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf41002f0 0x7fecf41984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf3fff640 1 -- 172.21.15.18:0/3465032147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4100ca0 msgr2=0x7fecf4198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf3fff640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4100ca0 0x7fecf4198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf3fff640 1 -- 172.21.15.18:0/3465032147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf419d490 con 0x7fecf4106f50 2024-09-19T09:50:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf3fff640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecf4106f50 0x7fecf419cdb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fecec00eaa0 tx=0x7fecec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf0ff9640 1 -- 172.21.15.18:0/3465032147 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec00cdb0 con 0x7fecf4106f50 2024-09-19T09:50:17.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf0ff9640 1 -- 172.21.15.18:0/3465032147 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecec005020 con 0x7fecf4106f50 2024-09-19T09:50:17.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf9ffe640 1 -- 172.21.15.18:0/3465032147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf419d780 con 0x7fecf4106f50 2024-09-19T09:50:17.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.728+0000 7fecf0ff9640 1 -- 172.21.15.18:0/3465032147 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec0116b0 con 0x7fecf4106f50 2024-09-19T09:50:17.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.729+0000 7fecf9ffe640 1 -- 172.21.15.18:0/3465032147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf41a5060 con 0x7fecf4106f50 2024-09-19T09:50:17.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.730+0000 7fecf9ffe640 1 -- 172.21.15.18:0/3465032147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf41006d0 con 0x7fecf4106f50 2024-09-19T09:50:17.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.731+0000 7fecf0ff9640 1 -- 172.21.15.18:0/3465032147 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fecec005560 con 0x7fecf4106f50 2024-09-19T09:50:17.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.732+0000 7fecf0ff9640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fecdc0a32c0 0x7fecdc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.732+0000 7fecf37fe640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fecdc0a32c0 0x7fecdc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.732+0000 7fecf0ff9640 1 -- 172.21.15.18:0/3465032147 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fecec0cf880 con 0x7fecf4106f50 2024-09-19T09:50:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.732+0000 7fecf37fe640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fecdc0a32c0 0x7fecdc0a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fece400bbe0 tx=0x7fece400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.735+0000 7fecf0ff9640 1 -- 172.21.15.18:0/3465032147 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fecec016030 con 0x7fecf4106f50 2024-09-19T09:50:17.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.947+0000 7fecf9ffe640 1 -- 172.21.15.18:0/3465032147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecf402d7c0 con 0x7fecf4106f50 2024-09-19T09:50:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.947+0000 7fecf0ff9640 1 -- 172.21.15.18:0/3465032147 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9683 (secure 0 0 0) 0x7fecec09c470 con 0x7fecf4106f50 2024-09-19T09:50:17.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:17.950 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":12,"btime":"2024-09-19T09:50:17:121514+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T09:50:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 12 2024-09-19T09:50:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.949+0000 7fecf9ffe640 1 -- 172.21.15.18:0/3465032147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fecdc0a32c0 msgr2=0x7fecdc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.949+0000 7fecf9ffe640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fecdc0a32c0 0x7fecdc0a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fece400bbe0 tx=0x7fece400b390 comp rx=0 tx=0).stop 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.949+0000 7fecf9ffe640 1 -- 172.21.15.18:0/3465032147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecf4106f50 msgr2=0x7fecf419cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.949+0000 7fecf9ffe640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecf4106f50 0x7fecf419cdb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fecec00eaa0 tx=0x7fecec00ef60 comp rx=0 tx=0).stop 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.949+0000 7fecf9ffe640 1 -- 172.21.15.18:0/3465032147 shutdown_connections 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.949+0000 7fecf9ffe640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fecdc0a32c0 0x7fecdc0a5780 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.949+0000 7fecf9ffe640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecf4106f50 0x7fecf419cdb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.949+0000 7fecf9ffe640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecf4100ca0 0x7fecf4198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.949+0000 7fecf9ffe640 1 --2- 172.21.15.18:0/3465032147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf41002f0 0x7fecf41984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.949+0000 7fecf9ffe640 1 -- 172.21.15.18:0/3465032147 >> 172.21.15.18:0/3465032147 conn(0x7fecf4077210 msgr2=0x7fecf40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.950+0000 7fecf9ffe640 1 -- 172.21.15.18:0/3465032147 shutdown_connections 2024-09-19T09:50:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:17.950+0000 7fecf9ffe640 1 -- 172.21.15.18:0/3465032147 wait complete. 2024-09-19T09:50:18.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:18.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:18.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:18.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:18.249 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:18.250 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:18.250 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:18.250 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: Deploying daemon mds.b on smithi049 2024-09-19T09:50:18.250 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] up:boot 2024-09-19T09:50:18.250 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: fsmap 11 up:standby 2024-09-19T09:50:18.251 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:17 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:50:18.359 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:18.360 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:18.360 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:18.360 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:18.360 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:18.361 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:18.361 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:18.361 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: Deploying daemon mds.b on smithi049 2024-09-19T09:50:18.361 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] up:boot 2024-09-19T09:50:18.361 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: fsmap 11 up:standby 2024-09-19T09:50:18.362 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:17 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:50:18.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:18.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:18.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:18.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:18.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:50:18.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:50:18.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:18.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: Deploying daemon mds.b on smithi049 2024-09-19T09:50:18.415 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] up:boot 2024-09-19T09:50:18.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: fsmap 11 up:standby 2024-09-19T09:50:18.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:17 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:50:18.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:18 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3465032147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:19.288 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:19 smithi049 systemd[1]: Starting Ceph mds.b for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T09:50:19.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:18 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3465032147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:19.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:18 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3465032147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:19.561 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:19 smithi049 podman[65449]: 2024-09-19 09:50:19.18931889 +0000 UTC m=+0.016378752 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:50:19.561 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:19 smithi049 podman[65449]: 2024-09-19 09:50:19.446923188 +0000 UTC m=+0.273983037 container create 1b78794f50922d915961d30abe46648db776bc28e7aee4cd58ef2741ef2fff9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T09:50:19.900 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:19 smithi049 podman[65449]: 2024-09-19 09:50:19.691057894 +0000 UTC m=+0.518117750 container init 1b78794f50922d915961d30abe46648db776bc28e7aee4cd58ef2741ef2fff9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T09:50:19.900 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:19 smithi049 podman[65449]: 2024-09-19 09:50:19.693995424 +0000 UTC m=+0.521055274 container start 1b78794f50922d915961d30abe46648db776bc28e7aee4cd58ef2741ef2fff9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:50:19.900 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:19 smithi049 ceph-mds[65468]: -- 172.21.15.49:0/3793829269 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635ba4c3860 con 0x5635ba4a1400 2024-09-19T09:50:19.901 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:19 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b[65464]: starting mds.b at 2024-09-19T09:50:19.901 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:19 smithi049 bash[65449]: 1b78794f50922d915961d30abe46648db776bc28e7aee4cd58ef2741ef2fff9a 2024-09-19T09:50:19.901 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:19 smithi049 systemd[1]: Started Ceph mds.b for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T09:50:20.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:19 smithi018 ceph-mon[30956]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:20.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:19 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:19 smithi049 ceph-mon[34858]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:20.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:19 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:19 smithi162 ceph-mon[35174]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:19 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:20.538 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:50:21.133 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:21.255 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:20 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] up:boot 2024-09-19T09:50:21.255 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:20 smithi018 ceph-mon[30956]: fsmap 12 up:standby 2024-09-19T09:50:21.255 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:50:21.256 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:50:21.256 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:20 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:21.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:20 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] up:boot 2024-09-19T09:50:21.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:20 smithi049 ceph-mon[34858]: fsmap 12 up:standby 2024-09-19T09:50:21.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:20 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:50:21.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:20 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:50:21.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:20 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:21.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:20 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] up:boot 2024-09-19T09:50:21.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:20 smithi162 ceph-mon[35174]: fsmap 12 up:standby 2024-09-19T09:50:21.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:50:21.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:50:21.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:20 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:21.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.611+0000 7f4578676640 1 -- 172.21.15.18:0/597681268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f457010c170 msgr2=0x7f457010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.611+0000 7f4578676640 1 --2- 172.21.15.18:0/597681268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f457010c170 0x7f457010e610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4568009ca0 tx=0x7f456802a950 comp rx=0 tx=0).stop 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.611+0000 7f4578676640 1 -- 172.21.15.18:0/597681268 shutdown_connections 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.611+0000 7f4578676640 1 --2- 172.21.15.18:0/597681268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f457010c170 0x7f457010e610 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.611+0000 7f4578676640 1 --2- 172.21.15.18:0/597681268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4570103660 0x7f457010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.611+0000 7f4578676640 1 --2- 172.21.15.18:0/597681268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4570102d40 0x7f4570103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.611+0000 7f4578676640 1 -- 172.21.15.18:0/597681268 >> 172.21.15.18:0/597681268 conn(0x7f45700fc7a0 msgr2=0x7f45700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.611+0000 7f4578676640 1 -- 172.21.15.18:0/597681268 shutdown_connections 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.611+0000 7f4578676640 1 -- 172.21.15.18:0/597681268 wait complete. 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4578676640 1 Processor -- start 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4578676640 1 -- start start 2024-09-19T09:50:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4578676640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4570102d40 0x7f45701983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4578676640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4570103660 0x7f4570198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4578676640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f457010c170 0x7f457019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4578676640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4570111fc0 con 0x7f4570103660 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4578676640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4570111e40 con 0x7f4570102d40 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4578676640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4570112140 con 0x7f457010c170 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4575c11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4570103660 0x7f4570198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4575c11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4570103660 0x7f4570198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60828/0 (socket says 172.21.15.18:60828) 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4575c11640 1 -- 172.21.15.18:0/1118887906 learned_addr learned my addr 172.21.15.18:0/1118887906 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4576412640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4570102d40 0x7f45701983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4576c13640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f457010c170 0x7f457019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4575c11640 1 -- 172.21.15.18:0/1118887906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f457010c170 msgr2=0x7f457019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4575c11640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f457010c170 0x7f457019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4575c11640 1 -- 172.21.15.18:0/1118887906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4570102d40 msgr2=0x7f45701983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4575c11640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4570102d40 0x7f45701983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4575c11640 1 -- 172.21.15.18:0/1118887906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457019d370 con 0x7f4570103660 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4576c13640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f457010c170 0x7f457019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.612+0000 7f4576412640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4570102d40 0x7f45701983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.613+0000 7f4575c11640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4570103660 0x7f4570198900 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f456000d950 tx=0x7f456000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.613+0000 7f45677fe640 1 -- 172.21.15.18:0/1118887906 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560017030 con 0x7f4570103660 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.613+0000 7f45677fe640 1 -- 172.21.15.18:0/1118887906 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4560004020 con 0x7f4570103660 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.613+0000 7f4578676640 1 -- 172.21.15.18:0/1118887906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f457019d660 con 0x7f4570103660 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.613+0000 7f45677fe640 1 -- 172.21.15.18:0/1118887906 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45600047a0 con 0x7f4570103660 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.613+0000 7f4578676640 1 -- 172.21.15.18:0/1118887906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45701a4f40 con 0x7f4570103660 2024-09-19T09:50:21.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.614+0000 7f4578676640 1 -- 172.21.15.18:0/1118887906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4570103120 con 0x7f4570103660 2024-09-19T09:50:21.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.615+0000 7f45677fe640 1 -- 172.21.15.18:0/1118887906 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f45600041d0 con 0x7f4570103660 2024-09-19T09:50:21.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.616+0000 7f45677fe640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f455c0a32c0 0x7f455c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:21.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.616+0000 7f4576412640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f455c0a32c0 0x7f455c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:21.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.616+0000 7f45677fe640 1 -- 172.21.15.18:0/1118887906 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f45600ced00 con 0x7f4570103660 2024-09-19T09:50:21.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.616+0000 7f4576412640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f455c0a32c0 0x7f455c0a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f456c009fc0 tx=0x7f456c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:21.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.620+0000 7f45677fe640 1 -- 172.21.15.18:0/1118887906 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f456009bec0 con 0x7f4570103660 2024-09-19T09:50:21.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.846+0000 7f4578676640 1 -- 172.21.15.18:0/1118887906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f457002d7c0 con 0x7f4570103660 2024-09-19T09:50:21.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.847+0000 7f45677fe640 1 -- 172.21.15.18:0/1118887906 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10506 (secure 0 0 0) 0x7f456009b7c0 con 0x7f4570103660 2024-09-19T09:50:21.850 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:21.850 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-19T09:50:19:921015+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14580,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T09:50:21.850 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-19T09:50:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.850+0000 7f4578676640 1 -- 172.21.15.18:0/1118887906 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f455c0a32c0 msgr2=0x7f455c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.850+0000 7f4578676640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f455c0a32c0 0x7f455c0a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f456c009fc0 tx=0x7f456c005f90 comp rx=0 tx=0).stop 2024-09-19T09:50:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.850+0000 7f4578676640 1 -- 172.21.15.18:0/1118887906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4570103660 msgr2=0x7f4570198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.851+0000 7f4578676640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4570103660 0x7f4570198900 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f456000d950 tx=0x7f456000de10 comp rx=0 tx=0).stop 2024-09-19T09:50:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.851+0000 7f4578676640 1 -- 172.21.15.18:0/1118887906 shutdown_connections 2024-09-19T09:50:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.851+0000 7f4578676640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f455c0a32c0 0x7f455c0a5780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.851+0000 7f4578676640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f457010c170 0x7f457019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.851+0000 7f4578676640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4570103660 0x7f4570198900 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:21.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.851+0000 7f4578676640 1 --2- 172.21.15.18:0/1118887906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4570102d40 0x7f45701983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:21.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.851+0000 7f4578676640 1 -- 172.21.15.18:0/1118887906 >> 172.21.15.18:0/1118887906 conn(0x7f45700fc7a0 msgr2=0x7f45700fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:21.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.851+0000 7f4578676640 1 -- 172.21.15.18:0/1118887906 shutdown_connections 2024-09-19T09:50:21.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:21.851+0000 7f4578676640 1 -- 172.21.15.18:0/1118887906 wait complete. 2024-09-19T09:50:22.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:22.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1118887906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:22.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:22.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:50:22.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:21 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1118887906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:22.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:22.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:50:22.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:21 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1118887906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:22.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:50:22.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:21 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:22.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T09:50:23.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:22 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:50:23.187 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:22 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:50:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:23.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:22 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:50:23.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.705+0000 7f466906b640 1 -- 172.21.15.18:0/2838698678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4664102df0 msgr2=0x7f46641031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.705+0000 7f466906b640 1 --2- 172.21.15.18:0/2838698678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4664102df0 0x7f46641031d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4654009900 tx=0x7f465402a410 comp rx=0 tx=0).stop 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.706+0000 7f466906b640 1 -- 172.21.15.18:0/2838698678 shutdown_connections 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.706+0000 7f466906b640 1 --2- 172.21.15.18:0/2838698678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f466410c2f0 0x7f466410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.706+0000 7f466906b640 1 --2- 172.21.15.18:0/2838698678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46641037a0 0x7f466410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.706+0000 7f466906b640 1 --2- 172.21.15.18:0/2838698678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4664102df0 0x7f46641031d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.706+0000 7f466906b640 1 -- 172.21.15.18:0/2838698678 >> 172.21.15.18:0/2838698678 conn(0x7f46640fc7d0 msgr2=0x7f46640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.706+0000 7f466906b640 1 -- 172.21.15.18:0/2838698678 shutdown_connections 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.706+0000 7f466906b640 1 -- 172.21.15.18:0/2838698678 wait complete. 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.706+0000 7f466906b640 1 Processor -- start 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466906b640 1 -- start start 2024-09-19T09:50:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466906b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4664102df0 0x7f4664198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466906b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46641037a0 0x7f4664198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466906b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f466410c2f0 0x7f466419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466906b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4664112110 con 0x7f466410c2f0 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466906b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4664111f90 con 0x7f4664102df0 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466906b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4664112290 con 0x7f46641037a0 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f466410c2f0 0x7f466419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f466410c2f0 0x7f466419cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60842/0 (socket says 172.21.15.18:60842) 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466359e640 1 -- 172.21.15.18:0/247217741 learned_addr learned my addr 172.21.15.18:0/247217741 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f4662d9d640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4664102df0 0x7f4664198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466259c640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46641037a0 0x7f4664198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466359e640 1 -- 172.21.15.18:0/247217741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46641037a0 msgr2=0x7f4664198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466359e640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46641037a0 0x7f4664198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466359e640 1 -- 172.21.15.18:0/247217741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4664102df0 msgr2=0x7f4664198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466359e640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4664102df0 0x7f4664198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466359e640 1 -- 172.21.15.18:0/247217741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466419d5c0 con 0x7f466410c2f0 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f4662d9d640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4664102df0 0x7f4664198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.707+0000 7f466359e640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f466410c2f0 0x7f466419cee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f465c00eb10 tx=0x7f465c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.708+0000 7f464bfff640 1 -- 172.21.15.18:0/247217741 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c004b20 con 0x7f466410c2f0 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.708+0000 7f466906b640 1 -- 172.21.15.18:0/247217741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466419d8b0 con 0x7f466410c2f0 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.708+0000 7f464bfff640 1 -- 172.21.15.18:0/247217741 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f465c004cc0 con 0x7f466410c2f0 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.708+0000 7f464bfff640 1 -- 172.21.15.18:0/247217741 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c010760 con 0x7f466410c2f0 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.708+0000 7f466906b640 1 -- 172.21.15.18:0/247217741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46641a5190 con 0x7f466410c2f0 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.709+0000 7f466906b640 1 -- 172.21.15.18:0/247217741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466406a790 con 0x7f466410c2f0 2024-09-19T09:50:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.710+0000 7f464bfff640 1 -- 172.21.15.18:0/247217741 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f465c005020 con 0x7f466410c2f0 2024-09-19T09:50:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.710+0000 7f464bfff640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f464c0a3240 0x7f464c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.711+0000 7f4662d9d640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f464c0a3240 0x7f464c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.711+0000 7f464bfff640 1 -- 172.21.15.18:0/247217741 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f465c0cfcb0 con 0x7f466410c2f0 2024-09-19T09:50:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.711+0000 7f4662d9d640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f464c0a3240 0x7f464c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4654005ab0 tx=0x7f4654005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.715+0000 7f464bfff640 1 -- 172.21.15.18:0/247217741 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f465c09cdd0 con 0x7f466410c2f0 2024-09-19T09:50:23.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.908+0000 7f466906b640 1 -- 172.21.15.18:0/247217741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f46641072c0 con 0x7f466410c2f0 2024-09-19T09:50:23.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.908+0000 7f464bfff640 1 -- 172.21.15.18:0/247217741 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7f465c09c6d0 con 0x7f466410c2f0 2024-09-19T09:50:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:23.911 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:50:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:50:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:50:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:50:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:50:23.912 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:50:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 -- 172.21.15.18:0/247217741 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f464c0a3240 msgr2=0x7f464c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f464c0a3240 0x7f464c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4654005ab0 tx=0x7f4654005a20 comp rx=0 tx=0).stop 2024-09-19T09:50:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 -- 172.21.15.18:0/247217741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f466410c2f0 msgr2=0x7f466419cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f466410c2f0 0x7f466419cee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f465c00eb10 tx=0x7f465c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:50:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 -- 172.21.15.18:0/247217741 shutdown_connections 2024-09-19T09:50:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f464c0a3240 0x7f464c0a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f466410c2f0 0x7f466419cee0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:23.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46641037a0 0x7f4664198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:23.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 --2- 172.21.15.18:0/247217741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4664102df0 0x7f4664198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:23.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 -- 172.21.15.18:0/247217741 >> 172.21.15.18:0/247217741 conn(0x7f46640fc7d0 msgr2=0x7f46640fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:23.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 -- 172.21.15.18:0/247217741 shutdown_connections 2024-09-19T09:50:23.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:23.911+0000 7f466906b640 1 -- 172.21.15.18:0/247217741 wait complete. 2024-09-19T09:50:24.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:23 smithi018 ceph-mon[30956]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:24.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:23 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:23 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/247217741' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:50:24.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:23 smithi049 ceph-mon[34858]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:24.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:23 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:23 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/247217741' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:50:24.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:23 smithi162 ceph-mon[35174]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:24.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:23 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:24.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:23 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/247217741' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:50:24.581 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:50:24.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:50:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:25.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.275+0000 7f10532d5640 1 -- 172.21.15.18:0/4240319262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f104c106a60 msgr2=0x7f104c106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:25.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.275+0000 7f10532d5640 1 --2- 172.21.15.18:0/4240319262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f104c106a60 0x7f104c106e40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f103c009cd0 tx=0x7f103c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:50:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.275+0000 7f10532d5640 1 -- 172.21.15.18:0/4240319262 shutdown_connections 2024-09-19T09:50:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.275+0000 7f10532d5640 1 --2- 172.21.15.18:0/4240319262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c101400 0x7f104c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.275+0000 7f10532d5640 1 --2- 172.21.15.18:0/4240319262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f104c100a60 0x7f104c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.275+0000 7f10532d5640 1 --2- 172.21.15.18:0/4240319262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f104c106a60 0x7f104c106e40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.275+0000 7f10532d5640 1 -- 172.21.15.18:0/4240319262 >> 172.21.15.18:0/4240319262 conn(0x7f104c0fc780 msgr2=0x7f104c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.275+0000 7f10532d5640 1 -- 172.21.15.18:0/4240319262 shutdown_connections 2024-09-19T09:50:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.275+0000 7f10532d5640 1 -- 172.21.15.18:0/4240319262 wait complete. 2024-09-19T09:50:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f10532d5640 1 Processor -- start 2024-09-19T09:50:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f10532d5640 1 -- start start 2024-09-19T09:50:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f10532d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c100a60 0x7f104c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f10532d5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f104c101400 0x7f104c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f10532d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f104c106a60 0x7f104c1a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f10532d5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f104c110e60 con 0x7f104c101400 2024-09-19T09:50:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f10532d5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f104c110ce0 con 0x7f104c100a60 2024-09-19T09:50:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f10532d5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f104c110fe0 con 0x7f104c106a60 2024-09-19T09:50:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f1050870640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f104c101400 0x7f104c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f1050870640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f104c101400 0x7f104c199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60866/0 (socket says 172.21.15.18:60866) 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.276+0000 7f1050870640 1 -- 172.21.15.18:0/3997877907 learned_addr learned my addr 172.21.15.18:0/3997877907 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f1051872640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f104c106a60 0x7f104c1a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f1051071640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c100a60 0x7f104c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f1050870640 1 -- 172.21.15.18:0/3997877907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f104c106a60 msgr2=0x7f104c1a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f1050870640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f104c106a60 0x7f104c1a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f1050870640 1 -- 172.21.15.18:0/3997877907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c100a60 msgr2=0x7f104c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f1050870640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c100a60 0x7f104c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f1050870640 1 -- 172.21.15.18:0/3997877907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c1a48f0 con 0x7f104c101400 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f1051872640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f104c106a60 0x7f104c1a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f1050870640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f104c101400 0x7f104c199870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f104000d950 tx=0x7f104000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f104a7fc640 1 -- 172.21.15.18:0/3997877907 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040017070 con 0x7f104c101400 2024-09-19T09:50:25.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f104a7fc640 1 -- 172.21.15.18:0/3997877907 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1040009c30 con 0x7f104c101400 2024-09-19T09:50:25.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f104a7fc640 1 -- 172.21.15.18:0/3997877907 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104000f6b0 con 0x7f104c101400 2024-09-19T09:50:25.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f10532d5640 1 -- 172.21.15.18:0/3997877907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c1a4ac0 con 0x7f104c101400 2024-09-19T09:50:25.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.277+0000 7f10532d5640 1 -- 172.21.15.18:0/3997877907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c1a5000 con 0x7f104c101400 2024-09-19T09:50:25.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.278+0000 7f10532d5640 1 -- 172.21.15.18:0/3997877907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f104c100ec0 con 0x7f104c101400 2024-09-19T09:50:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.279+0000 7f104a7fc640 1 -- 172.21.15.18:0/3997877907 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f10400109d0 con 0x7f104c101400 2024-09-19T09:50:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.280+0000 7f104a7fc640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f10340a32c0 0x7f10340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.280+0000 7f1051071640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f10340a32c0 0x7f10340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.280+0000 7f104a7fc640 1 -- 172.21.15.18:0/3997877907 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f10400cf150 con 0x7f104c101400 2024-09-19T09:50:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.281+0000 7f1051071640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f10340a32c0 0x7f10340a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f103c006010 tx=0x7f103c0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:25.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.284+0000 7f104a7fc640 1 -- 172.21.15.18:0/3997877907 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1040009de0 con 0x7f104c101400 2024-09-19T09:50:25.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:25.463+0000 7f10532d5640 1 -- 172.21.15.18:0/3997877907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f104c108a40 con 0x7f104c101400 2024-09-19T09:50:25.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:25.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:25.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:25.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:50:25.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:25 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:25.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:25.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:25.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:25.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:50:25.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:25 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:25.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:25.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:25.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:50:25.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:50:25.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:25 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:50:26.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.323+0000 7f104a7fc640 1 -- 172.21.15.18:0/3997877907 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f104009c270 con 0x7f104c101400 2024-09-19T09:50:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:50:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 -- 172.21.15.18:0/3997877907 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f10340a32c0 msgr2=0x7f10340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f10340a32c0 0x7f10340a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f103c006010 tx=0x7f103c0093f0 comp rx=0 tx=0).stop 2024-09-19T09:50:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 -- 172.21.15.18:0/3997877907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f104c101400 msgr2=0x7f104c199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f104c101400 0x7f104c199870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f104000d950 tx=0x7f104000de10 comp rx=0 tx=0).stop 2024-09-19T09:50:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 -- 172.21.15.18:0/3997877907 shutdown_connections 2024-09-19T09:50:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f10340a32c0 0x7f10340a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:26.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f104c106a60 0x7f104c1a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:26.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f104c101400 0x7f104c199870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:26.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 --2- 172.21.15.18:0/3997877907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c100a60 0x7f104c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:26.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 -- 172.21.15.18:0/3997877907 >> 172.21.15.18:0/3997877907 conn(0x7f104c0fc780 msgr2=0x7f104c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:26.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 -- 172.21.15.18:0/3997877907 shutdown_connections 2024-09-19T09:50:26.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:26.326+0000 7f10532d5640 1 -- 172.21.15.18:0/3997877907 wait complete. 2024-09-19T09:50:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:26 smithi018 ceph-mon[30956]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3997877907' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:50:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:26 smithi049 ceph-mon[34858]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:26 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3997877907' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:50:26.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:26 smithi162 ceph-mon[35174]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:26.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:26 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3997877907' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:50:26.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:50:27.244 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:27.590 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:27 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3997877907' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:50:27.590 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:27 smithi018 ceph-mon[30956]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:50:27.590 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:27 smithi018 ceph-mon[30956]: pgmap v276: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:27.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:27 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3997877907' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:50:27.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:27 smithi049 ceph-mon[34858]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:50:27.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:27 smithi049 ceph-mon[34858]: pgmap v276: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:27.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:27 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3997877907' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:50:27.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:27 smithi162 ceph-mon[35174]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:50:27.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:27 smithi162 ceph-mon[35174]: pgmap v276: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:27.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.676+0000 7f8241139640 1 -- 172.21.15.18:0/4009298448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f823c106f10 msgr2=0x7f823c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:27.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.676+0000 7f8241139640 1 --2- 172.21.15.18:0/4009298448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f823c106f10 0x7f823c10ea90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f822c009ca0 tx=0x7f822c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:50:27.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.676+0000 7f8241139640 1 -- 172.21.15.18:0/4009298448 shutdown_connections 2024-09-19T09:50:27.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.676+0000 7f8241139640 1 --2- 172.21.15.18:0/4009298448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f823c106f10 0x7f823c10ea90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:27.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.676+0000 7f8241139640 1 --2- 172.21.15.18:0/4009298448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f823c102790 0x7f823c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:27.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.676+0000 7f8241139640 1 --2- 172.21.15.18:0/4009298448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f823c101de0 0x7f823c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:27.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.676+0000 7f8241139640 1 -- 172.21.15.18:0/4009298448 >> 172.21.15.18:0/4009298448 conn(0x7f823c0fd8c0 msgr2=0x7f823c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:27.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.677+0000 7f8241139640 1 -- 172.21.15.18:0/4009298448 shutdown_connections 2024-09-19T09:50:27.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.677+0000 7f8241139640 1 -- 172.21.15.18:0/4009298448 wait complete. 2024-09-19T09:50:27.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.677+0000 7f8241139640 1 Processor -- start 2024-09-19T09:50:27.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.677+0000 7f8241139640 1 -- start start 2024-09-19T09:50:27.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f8241139640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f823c101de0 0x7f823c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:27.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f8241139640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f823c102790 0x7f823c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:27.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f8241139640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f823c106f10 0x7f823c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:27.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f8241139640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f823c111f70 con 0x7f823c101de0 2024-09-19T09:50:27.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f8241139640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f823c111df0 con 0x7f823c106f10 2024-09-19T09:50:27.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f8241139640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f823c1120f0 con 0x7f823c102790 2024-09-19T09:50:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f823c101de0 0x7f823c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f823c101de0 0x7f823c1983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43480/0 (socket says 172.21.15.18:43480) 2024-09-19T09:50:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823ad9d640 1 -- 172.21.15.18:0/2669336868 learned_addr learned my addr 172.21.15.18:0/2669336868 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823a59c640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f823c102790 0x7f823c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823b59e640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f823c106f10 0x7f823c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823ad9d640 1 -- 172.21.15.18:0/2669336868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f823c102790 msgr2=0x7f823c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823ad9d640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f823c102790 0x7f823c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823ad9d640 1 -- 172.21.15.18:0/2669336868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f823c106f10 msgr2=0x7f823c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:27.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823ad9d640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f823c106f10 0x7f823c19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:27.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823ad9d640 1 -- 172.21.15.18:0/2669336868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c19d350 con 0x7f823c101de0 2024-09-19T09:50:27.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.678+0000 7f823ad9d640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f823c101de0 0x7f823c1983a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f823400d950 tx=0x7f823400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:27.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.679+0000 7f8233fff640 1 -- 172.21.15.18:0/2669336868 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234017070 con 0x7f823c101de0 2024-09-19T09:50:27.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.679+0000 7f8241139640 1 -- 172.21.15.18:0/2669336868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823c19d640 con 0x7f823c101de0 2024-09-19T09:50:27.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.679+0000 7f8233fff640 1 -- 172.21.15.18:0/2669336868 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f823400de80 con 0x7f823c101de0 2024-09-19T09:50:27.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.679+0000 7f8233fff640 1 -- 172.21.15.18:0/2669336868 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823400f620 con 0x7f823c101de0 2024-09-19T09:50:27.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.679+0000 7f8241139640 1 -- 172.21.15.18:0/2669336868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823c1a4f20 con 0x7f823c101de0 2024-09-19T09:50:27.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.680+0000 7f8241139640 1 -- 172.21.15.18:0/2669336868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823c1021c0 con 0x7f823c101de0 2024-09-19T09:50:27.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.681+0000 7f8233fff640 1 -- 172.21.15.18:0/2669336868 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8234009c30 con 0x7f823c101de0 2024-09-19T09:50:27.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.682+0000 7f8233fff640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f82280a3240 0x7f82280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:27.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.682+0000 7f823a59c640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f82280a3240 0x7f82280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:27.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.682+0000 7f8233fff640 1 -- 172.21.15.18:0/2669336868 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7f82340cf240 con 0x7f823c101de0 2024-09-19T09:50:27.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.682+0000 7f823a59c640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f82280a3240 0x7f82280a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f823c108800 tx=0x7f822400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:27.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.686+0000 7f8233fff640 1 -- 172.21.15.18:0/2669336868 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f823409c1f0 con 0x7f823c101de0 2024-09-19T09:50:27.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:27.865+0000 7f8241139640 1 -- 172.21.15.18:0/2669336868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f823c1a5150 con 0x7f823c101de0 2024-09-19T09:50:28.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.336+0000 7f8233fff640 1 -- 172.21.15.18:0/2669336868 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) ==== 170+0+0 (secure 0 0 0) 0x7f823409baf0 con 0x7f823c101de0 2024-09-19T09:50:28.339 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:50:28.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.339+0000 7f8241139640 1 -- 172.21.15.18:0/2669336868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f82280a3240 msgr2=0x7f82280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:28.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.339+0000 7f8241139640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f82280a3240 0x7f82280a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f823c108800 tx=0x7f822400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:50:28.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.339+0000 7f8241139640 1 -- 172.21.15.18:0/2669336868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f823c101de0 msgr2=0x7f823c1983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:28.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.339+0000 7f8241139640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f823c101de0 0x7f823c1983a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f823400d950 tx=0x7f823400dd50 comp rx=0 tx=0).stop 2024-09-19T09:50:28.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.339+0000 7f8241139640 1 -- 172.21.15.18:0/2669336868 shutdown_connections 2024-09-19T09:50:28.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.339+0000 7f8241139640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f82280a3240 0x7f82280a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:28.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.339+0000 7f8241139640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f823c106f10 0x7f823c19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:28.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.339+0000 7f8241139640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f823c102790 0x7f823c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:28.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.339+0000 7f8241139640 1 --2- 172.21.15.18:0/2669336868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f823c101de0 0x7f823c1983a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:28.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.339+0000 7f8241139640 1 -- 172.21.15.18:0/2669336868 >> 172.21.15.18:0/2669336868 conn(0x7f823c0fd8c0 msgr2=0x7f823c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:28.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.340+0000 7f8241139640 1 -- 172.21.15.18:0/2669336868 shutdown_connections 2024-09-19T09:50:28.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:28.340+0000 7f8241139640 1 -- 172.21.15.18:0/2669336868 wait complete. 2024-09-19T09:50:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:28 smithi018 ceph-mon[30956]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:50:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:28 smithi018 ceph-mon[30956]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:50:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:28 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2669336868' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:50:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:28 smithi049 ceph-mon[34858]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:50:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:28 smithi049 ceph-mon[34858]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:50:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:28 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2669336868' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:50:28.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:28 smithi162 ceph-mon[35174]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:50:28.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:28 smithi162 ceph-mon[35174]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:50:28.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:28 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2669336868' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:50:28.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:50:29.234 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:29.630 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:29 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2669336868' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:50:29.630 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:29 smithi018 ceph-mon[30956]: pgmap v279: 97 pgs: 1 creating+activating, 3 creating+peering, 86 unknown, 7 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:29.630 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:29 smithi018 ceph-mon[30956]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:50:29.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:29 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2669336868' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:50:29.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:29 smithi049 ceph-mon[34858]: pgmap v279: 97 pgs: 1 creating+activating, 3 creating+peering, 86 unknown, 7 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:29.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:29 smithi049 ceph-mon[34858]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:50:29.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:29 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2669336868' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:50:29.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:29 smithi162 ceph-mon[35174]: pgmap v279: 97 pgs: 1 creating+activating, 3 creating+peering, 86 unknown, 7 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:29.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:29 smithi162 ceph-mon[35174]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:50:29.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 -- 172.21.15.18:0/764894683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefe010e480 msgr2=0x7fefe0110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:29.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 --2- 172.21.15.18:0/764894683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefe010e480 0x7fefe0110870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009ca0 tx=0x7fefd802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:50:29.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 -- 172.21.15.18:0/764894683 shutdown_connections 2024-09-19T09:50:29.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 --2- 172.21.15.18:0/764894683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefe010e480 0x7fefe0110870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:29.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 --2- 172.21.15.18:0/764894683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefe0101280 0x7fefe010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:29.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 --2- 172.21.15.18:0/764894683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe01008d0 0x7fefe0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:29.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 -- 172.21.15.18:0/764894683 >> 172.21.15.18:0/764894683 conn(0x7fefe00fc7a0 msgr2=0x7fefe00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:29.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 -- 172.21.15.18:0/764894683 shutdown_connections 2024-09-19T09:50:29.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 -- 172.21.15.18:0/764894683 wait complete. 2024-09-19T09:50:29.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 Processor -- start 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.716+0000 7fefe7f47640 1 -- start start 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe7f47640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefe01008d0 0x7fefe019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe7f47640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefe0101280 0x7fefe019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe7f47640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe010e480 0x7fefe019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe7f47640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0114160 con 0x7fefe0101280 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe7f47640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0113fe0 con 0x7fefe01008d0 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe7f47640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01142e0 con 0x7fefe010e480 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe54e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefe0101280 0x7fefe019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe54e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefe0101280 0x7fefe019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43496/0 (socket says 172.21.15.18:43496) 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe54e2640 1 -- 172.21.15.18:0/2323199918 learned_addr learned my addr 172.21.15.18:0/2323199918 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe5ce3640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefe01008d0 0x7fefe019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe64e4640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe010e480 0x7fefe019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe54e2640 1 -- 172.21.15.18:0/2323199918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe010e480 msgr2=0x7fefe019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe54e2640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe010e480 0x7fefe019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe54e2640 1 -- 172.21.15.18:0/2323199918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefe01008d0 msgr2=0x7fefe019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe54e2640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefe01008d0 0x7fefe019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe54e2640 1 -- 172.21.15.18:0/2323199918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe019f5f0 con 0x7fefe0101280 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefe54e2640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefe0101280 0x7fefe019ab80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fefd000d950 tx=0x7fefd000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.717+0000 7fefd6ffd640 1 -- 172.21.15.18:0/2323199918 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0017070 con 0x7fefe0101280 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.718+0000 7fefe7f47640 1 -- 172.21.15.18:0/2323199918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe019f8e0 con 0x7fefe0101280 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.718+0000 7fefd6ffd640 1 -- 172.21.15.18:0/2323199918 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd0009c30 con 0x7fefe0101280 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.718+0000 7fefd6ffd640 1 -- 172.21.15.18:0/2323199918 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd000f6b0 con 0x7fefe0101280 2024-09-19T09:50:29.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.718+0000 7fefe7f47640 1 -- 172.21.15.18:0/2323199918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe01a71c0 con 0x7fefe0101280 2024-09-19T09:50:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.719+0000 7fefe7f47640 1 -- 172.21.15.18:0/2323199918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe0100cb0 con 0x7fefe0101280 2024-09-19T09:50:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.720+0000 7fefd6ffd640 1 -- 172.21.15.18:0/2323199918 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fefd00109d0 con 0x7fefe0101280 2024-09-19T09:50:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.721+0000 7fefd6ffd640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fefcc0a3240 0x7fefcc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.721+0000 7fefe5ce3640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fefcc0a3240 0x7fefcc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:29.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.721+0000 7fefd6ffd640 1 -- 172.21.15.18:0/2323199918 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7fefd00cf270 con 0x7fefe0101280 2024-09-19T09:50:29.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.721+0000 7fefe5ce3640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fefcc0a3240 0x7fefcc0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00bbe0 tx=0x7fefdc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:29.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.725+0000 7fefd6ffd640 1 -- 172.21.15.18:0/2323199918 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fefd0009de0 con 0x7fefe0101280 2024-09-19T09:50:29.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:29.936+0000 7fefe7f47640 1 -- 172.21.15.18:0/2323199918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fefe002d7c0 con 0x7fefe0101280 2024-09-19T09:50:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.352+0000 7fefd6ffd640 1 -- 172.21.15.18:0/2323199918 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fefd009baf0 con 0x7fefe0101280 2024-09-19T09:50:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 -- 172.21.15.18:0/2323199918 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fefcc0a3240 msgr2=0x7fefcc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fefcc0a3240 0x7fefcc0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00bbe0 tx=0x7fefdc00b390 comp rx=0 tx=0).stop 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 -- 172.21.15.18:0/2323199918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefe0101280 msgr2=0x7fefe019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefe0101280 0x7fefe019ab80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fefd000d950 tx=0x7fefd000de10 comp rx=0 tx=0).stop 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 -- 172.21.15.18:0/2323199918 shutdown_connections 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fefcc0a3240 0x7fefcc0a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe010e480 0x7fefe019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefe0101280 0x7fefe019ab80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 --2- 172.21.15.18:0/2323199918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefe01008d0 0x7fefe019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 -- 172.21.15.18:0/2323199918 >> 172.21.15.18:0/2323199918 conn(0x7fefe00fc7a0 msgr2=0x7fefe00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 -- 172.21.15.18:0/2323199918 shutdown_connections 2024-09-19T09:50:30.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:30.355+0000 7fefe7f47640 1 -- 172.21.15.18:0/2323199918 wait complete. 2024-09-19T09:50:30.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:30 smithi018 ceph-mon[30956]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:50:30.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:30 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2323199918' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:50:30.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:30 smithi018 ceph-mon[30956]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:50:30.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:30 smithi049 ceph-mon[34858]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:50:30.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:30 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2323199918' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:50:30.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:30 smithi049 ceph-mon[34858]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:50:30.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:30 smithi162 ceph-mon[35174]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:50:30.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:30 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2323199918' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:50:30.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:30 smithi162 ceph-mon[35174]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:50:31.010 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:50:31.274 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:31.629 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:31 smithi018 ceph-mon[30956]: pgmap v281: 97 pgs: 1 creating+activating, 23 creating+peering, 49 unknown, 24 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:31.630 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:31 smithi018 ceph-mon[30956]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:50:31.630 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:31 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2323199918' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:50:31.630 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:31 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:50:31.630 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:31 smithi018 ceph-mon[30956]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:50:31.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:31 smithi049 ceph-mon[34858]: pgmap v281: 97 pgs: 1 creating+activating, 23 creating+peering, 49 unknown, 24 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:31.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:31 smithi049 ceph-mon[34858]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:50:31.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:31 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2323199918' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:50:31.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:31 smithi049 ceph-mon[34858]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:50:31.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:31 smithi049 ceph-mon[34858]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:50:31.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:31 smithi162 ceph-mon[35174]: pgmap v281: 97 pgs: 1 creating+activating, 23 creating+peering, 49 unknown, 24 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:50:31.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:31 smithi162 ceph-mon[35174]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:50:31.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:31 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2323199918' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:50:31.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:31 smithi162 ceph-mon[35174]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:50:31.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:31 smithi162 ceph-mon[35174]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:50:31.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.712+0000 7f55a25b1640 1 -- 172.21.15.18:0/3709231021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f559c103740 msgr2=0x7f559c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:31.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.712+0000 7f55a25b1640 1 --2- 172.21.15.18:0/3709231021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f559c103740 0x7f559c107b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5584009930 tx=0x7f558402a420 comp rx=0 tx=0).stop 2024-09-19T09:50:31.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.712+0000 7f55a25b1640 1 -- 172.21.15.18:0/3709231021 shutdown_connections 2024-09-19T09:50:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.712+0000 7f55a25b1640 1 --2- 172.21.15.18:0/3709231021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f559c108290 0x7f559c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.712+0000 7f55a25b1640 1 --2- 172.21.15.18:0/3709231021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f559c103740 0x7f559c107b80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.712+0000 7f55a25b1640 1 --2- 172.21.15.18:0/3709231021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c102d90 0x7f559c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.712+0000 7f55a25b1640 1 -- 172.21.15.18:0/3709231021 >> 172.21.15.18:0/3709231021 conn(0x7f559c0fc7d0 msgr2=0x7f559c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.712+0000 7f55a25b1640 1 -- 172.21.15.18:0/3709231021 shutdown_connections 2024-09-19T09:50:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.712+0000 7f55a25b1640 1 -- 172.21.15.18:0/3709231021 wait complete. 2024-09-19T09:50:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f55a25b1640 1 Processor -- start 2024-09-19T09:50:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f55a25b1640 1 -- start start 2024-09-19T09:50:31.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f55a25b1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c102d90 0x7f559c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:31.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f55a25b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f559c103740 0x7f559c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:31.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f55a25b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f559c108290 0x7f559c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f55a25b1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f559c112090 con 0x7f559c103740 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f55a25b1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f559c111f10 con 0x7f559c108290 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f55a25b1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f559c112210 con 0x7f559c102d90 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f5593fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f559c103740 0x7f559c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f5593fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f559c103740 0x7f559c198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43518/0 (socket says 172.21.15.18:43518) 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f5593fff640 1 -- 172.21.15.18:0/2126398097 learned_addr learned my addr 172.21.15.18:0/2126398097 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f55a0b4e640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f559c108290 0x7f559c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.713+0000 7f559bfff640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c102d90 0x7f559c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f5593fff640 1 -- 172.21.15.18:0/2126398097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c102d90 msgr2=0x7f559c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f5593fff640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c102d90 0x7f559c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f5593fff640 1 -- 172.21.15.18:0/2126398097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f559c108290 msgr2=0x7f559c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f5593fff640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f559c108290 0x7f559c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:31.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f5593fff640 1 -- 172.21.15.18:0/2126398097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c19d570 con 0x7f559c103740 2024-09-19T09:50:31.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f5593fff640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f559c103740 0x7f559c198b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5584005940 tx=0x7f55840040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:31.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f5599ffb640 1 -- 172.21.15.18:0/2126398097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558403f030 con 0x7f559c103740 2024-09-19T09:50:31.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f5599ffb640 1 -- 172.21.15.18:0/2126398097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55840044c0 con 0x7f559c103740 2024-09-19T09:50:31.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f55a25b1640 1 -- 172.21.15.18:0/2126398097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c19d800 con 0x7f559c103740 2024-09-19T09:50:31.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f5599ffb640 1 -- 172.21.15.18:0/2126398097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584035070 con 0x7f559c103740 2024-09-19T09:50:31.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.714+0000 7f55a25b1640 1 -- 172.21.15.18:0/2126398097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c1a5140 con 0x7f559c103740 2024-09-19T09:50:31.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.715+0000 7f55a25b1640 1 -- 172.21.15.18:0/2126398097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f559c06a7f0 con 0x7f559c103740 2024-09-19T09:50:31.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.716+0000 7f5599ffb640 1 -- 172.21.15.18:0/2126398097 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5584042030 con 0x7f559c103740 2024-09-19T09:50:31.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.717+0000 7f5599ffb640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f55880a3240 0x7f55880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:31.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.717+0000 7f559bfff640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f55880a3240 0x7f55880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:31.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.717+0000 7f5599ffb640 1 -- 172.21.15.18:0/2126398097 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f55840efc50 con 0x7f559c103740 2024-09-19T09:50:31.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.718+0000 7f559bfff640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f55880a3240 0x7f55880a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f558c009b60 tx=0x7f558c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:31.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.722+0000 7f5599ffb640 1 -- 172.21.15.18:0/2126398097 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55840bca20 con 0x7f559c103740 2024-09-19T09:50:31.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.900+0000 7f55a25b1640 1 -- 172.21.15.18:0/2126398097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f559c10a2a0 con 0x7f559c103740 2024-09-19T09:50:31.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.901+0000 7f5599ffb640 1 -- 172.21.15.18:0/2126398097 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22240 (secure 0 0 0) 0x7f55840bc320 con 0x7f559c103740 2024-09-19T09:50:31.903 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:31.904 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:50:29.937394+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:50:31.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.903+0000 7f55a25b1640 1 -- 172.21.15.18:0/2126398097 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f55880a3240 msgr2=0x7f55880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.903+0000 7f55a25b1640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f55880a3240 0x7f55880a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f558c009b60 tx=0x7f558c005f90 comp rx=0 tx=0).stop 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.903+0000 7f55a25b1640 1 -- 172.21.15.18:0/2126398097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f559c103740 msgr2=0x7f559c198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.903+0000 7f55a25b1640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f559c103740 0x7f559c198b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5584005940 tx=0x7f55840040c0 comp rx=0 tx=0).stop 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.904+0000 7f55a25b1640 1 -- 172.21.15.18:0/2126398097 shutdown_connections 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.904+0000 7f55a25b1640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f55880a3240 0x7f55880a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.904+0000 7f55a25b1640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f559c108290 0x7f559c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.904+0000 7f55a25b1640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f559c103740 0x7f559c198b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.904+0000 7f55a25b1640 1 --2- 172.21.15.18:0/2126398097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c102d90 0x7f559c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.904+0000 7f55a25b1640 1 -- 172.21.15.18:0/2126398097 >> 172.21.15.18:0/2126398097 conn(0x7f559c0fc7d0 msgr2=0x7f559c105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.904+0000 7f55a25b1640 1 -- 172.21.15.18:0/2126398097 shutdown_connections 2024-09-19T09:50:31.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:31.904+0000 7f55a25b1640 1 -- 172.21.15.18:0/2126398097 wait complete. 2024-09-19T09:50:32.566 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:32 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] up:active 2024-09-19T09:50:32.567 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:32 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:32.567 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:32 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:32.567 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:32 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2126398097' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:50:32.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:50:32.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:32 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] up:active 2024-09-19T09:50:32.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:32 smithi049 ceph-mon[34858]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:32.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:32 smithi049 ceph-mon[34858]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:32.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:32 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2126398097' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:50:32.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:32 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] up:active 2024-09-19T09:50:32.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:32 smithi162 ceph-mon[35174]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:32.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:32 smithi162 ceph-mon[35174]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:32.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:32 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2126398097' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:50:32.860 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.224+0000 7fe1792ff640 1 -- 172.21.15.18:0/1286979965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe174101450 msgr2=0x7fe174105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.225+0000 7fe1792ff640 1 --2- 172.21.15.18:0/1286979965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe174101450 0x7fe174105920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe168009900 tx=0x7fe16802a470 comp rx=0 tx=0).stop 2024-09-19T09:50:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.225+0000 7fe1792ff640 1 -- 172.21.15.18:0/1286979965 shutdown_connections 2024-09-19T09:50:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.225+0000 7fe1792ff640 1 --2- 172.21.15.18:0/1286979965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe174105f40 0x7fe1741063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.225+0000 7fe1792ff640 1 --2- 172.21.15.18:0/1286979965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe174101450 0x7fe174105920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.225+0000 7fe1792ff640 1 --2- 172.21.15.18:0/1286979965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe174100b30 0x7fe174100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.225+0000 7fe1792ff640 1 -- 172.21.15.18:0/1286979965 >> 172.21.15.18:0/1286979965 conn(0x7fe1740fc7a0 msgr2=0x7fe1740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.225+0000 7fe1792ff640 1 -- 172.21.15.18:0/1286979965 shutdown_connections 2024-09-19T09:50:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.225+0000 7fe1792ff640 1 -- 172.21.15.18:0/1286979965 wait complete. 2024-09-19T09:50:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.225+0000 7fe1792ff640 1 Processor -- start 2024-09-19T09:50:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe1792ff640 1 -- start start 2024-09-19T09:50:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe1792ff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe174100b30 0x7fe1741a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe1792ff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe174101450 0x7fe1741a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe1792ff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe174105f40 0x7fe17419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe1792ff640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1741185c0 con 0x7fe174105f40 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe1792ff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe174118440 con 0x7fe174100b30 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe1792ff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe174118740 con 0x7fe174101450 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe1737fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe174105f40 0x7fe17419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe1737fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe174105f40 0x7fe17419e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43540/0 (socket says 172.21.15.18:43540) 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe1737fe640 1 -- 172.21.15.18:0/3438479830 learned_addr learned my addr 172.21.15.18:0/3438479830 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.226+0000 7fe172ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe174100b30 0x7fe1741a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe1727fc640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe174101450 0x7fe1741a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe1737fe640 1 -- 172.21.15.18:0/3438479830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe174101450 msgr2=0x7fe1741a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe1737fe640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe174101450 0x7fe1741a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe1737fe640 1 -- 172.21.15.18:0/3438479830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe174100b30 msgr2=0x7fe1741a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe1737fe640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe174100b30 0x7fe1741a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe1737fe640 1 -- 172.21.15.18:0/3438479830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17419f000 con 0x7fe174105f40 2024-09-19T09:50:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe1737fe640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe174105f40 0x7fe17419e8d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00b970 tx=0x7fe16c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe15bfff640 1 -- 172.21.15.18:0/3438479830 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c019070 con 0x7fe174105f40 2024-09-19T09:50:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe1792ff640 1 -- 172.21.15.18:0/3438479830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17419f2f0 con 0x7fe174105f40 2024-09-19T09:50:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe15bfff640 1 -- 172.21.15.18:0/3438479830 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe16c014440 con 0x7fe174105f40 2024-09-19T09:50:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe15bfff640 1 -- 172.21.15.18:0/3438479830 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0075d0 con 0x7fe174105f40 2024-09-19T09:50:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.227+0000 7fe1792ff640 1 -- 172.21.15.18:0/3438479830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1741ab5e0 con 0x7fe174105f40 2024-09-19T09:50:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.228+0000 7fe1792ff640 1 -- 172.21.15.18:0/3438479830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe174105920 con 0x7fe174105f40 2024-09-19T09:50:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.229+0000 7fe15bfff640 1 -- 172.21.15.18:0/3438479830 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe16c01c070 con 0x7fe174105f40 2024-09-19T09:50:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.230+0000 7fe15bfff640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe15c0a3240 0x7fe15c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.230+0000 7fe172ffd640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe15c0a3240 0x7fe15c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.230+0000 7fe15bfff640 1 -- 172.21.15.18:0/3438479830 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fe16c0cee10 con 0x7fe174105f40 2024-09-19T09:50:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.231+0000 7fe172ffd640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe15c0a3240 0x7fe15c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe17419fa10 tx=0x7fe16400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:33.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.234+0000 7fe15bfff640 1 -- 172.21.15.18:0/3438479830 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe16c09bc80 con 0x7fe174105f40 2024-09-19T09:50:33.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.413+0000 7fe1792ff640 1 -- 172.21.15.18:0/3438479830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1741ab810 con 0x7fe174105f40 2024-09-19T09:50:33.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.414+0000 7fe15bfff640 1 -- 172.21.15.18:0/3438479830 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22240 (secure 0 0 0) 0x7fe16c0806f0 con 0x7fe174105f40 2024-09-19T09:50:33.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:33.417 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:50:29.937394+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:50:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.416+0000 7fe1792ff640 1 -- 172.21.15.18:0/3438479830 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe15c0a3240 msgr2=0x7fe15c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.416+0000 7fe1792ff640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe15c0a3240 0x7fe15c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe17419fa10 tx=0x7fe16400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.416+0000 7fe1792ff640 1 -- 172.21.15.18:0/3438479830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe174105f40 msgr2=0x7fe17419e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.416+0000 7fe1792ff640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe174105f40 0x7fe17419e8d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00b970 tx=0x7fe16c00bd70 comp rx=0 tx=0).stop 2024-09-19T09:50:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.417+0000 7fe1792ff640 1 -- 172.21.15.18:0/3438479830 shutdown_connections 2024-09-19T09:50:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.417+0000 7fe1792ff640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe15c0a3240 0x7fe15c0a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.417+0000 7fe1792ff640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe174105f40 0x7fe17419e8d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.417+0000 7fe1792ff640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe174101450 0x7fe1741a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.417+0000 7fe1792ff640 1 --2- 172.21.15.18:0/3438479830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe174100b30 0x7fe1741a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.417+0000 7fe1792ff640 1 -- 172.21.15.18:0/3438479830 >> 172.21.15.18:0/3438479830 conn(0x7fe1740fc7a0 msgr2=0x7fe1741038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.417+0000 7fe1792ff640 1 -- 172.21.15.18:0/3438479830 shutdown_connections 2024-09-19T09:50:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:33.417+0000 7fe1792ff640 1 -- 172.21.15.18:0/3438479830 wait complete. 2024-09-19T09:50:33.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:33 smithi018 ceph-mon[30956]: pgmap v283: 97 pgs: 1 creating+activating, 20 creating+peering, 13 unknown, 63 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 4 op/s 2024-09-19T09:50:33.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:33 smithi018 ceph-mon[30956]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:50:33.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:33 smithi018 ceph-mon[30956]: Cluster is now healthy 2024-09-19T09:50:33.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:33 smithi049 ceph-mon[34858]: pgmap v283: 97 pgs: 1 creating+activating, 20 creating+peering, 13 unknown, 63 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 4 op/s 2024-09-19T09:50:33.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:33 smithi049 ceph-mon[34858]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:50:33.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:33 smithi049 ceph-mon[34858]: Cluster is now healthy 2024-09-19T09:50:33.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:33 smithi162 ceph-mon[35174]: pgmap v283: 97 pgs: 1 creating+activating, 20 creating+peering, 13 unknown, 63 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 4 op/s 2024-09-19T09:50:33.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:33 smithi162 ceph-mon[35174]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:50:33.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:33 smithi162 ceph-mon[35174]: Cluster is now healthy 2024-09-19T09:50:34.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:50:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:34.631 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:34 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3438479830' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:50:34.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:34 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3438479830' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:50:34.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:34 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3438479830' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:50:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.801+0000 7f758bf4e640 1 -- 172.21.15.18:0/1888744112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7584101450 msgr2=0x7f7584105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.801+0000 7f758bf4e640 1 --2- 172.21.15.18:0/1888744112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7584101450 0x7f7584105920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7574009900 tx=0x7f757402a470 comp rx=0 tx=0).stop 2024-09-19T09:50:34.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.801+0000 7f758bf4e640 1 -- 172.21.15.18:0/1888744112 shutdown_connections 2024-09-19T09:50:34.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.801+0000 7f758bf4e640 1 --2- 172.21.15.18:0/1888744112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7584105f40 0x7f75841063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.801+0000 7f758bf4e640 1 --2- 172.21.15.18:0/1888744112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7584101450 0x7f7584105920 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.801+0000 7f758bf4e640 1 --2- 172.21.15.18:0/1888744112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584100b30 0x7f7584100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.801+0000 7f758bf4e640 1 -- 172.21.15.18:0/1888744112 >> 172.21.15.18:0/1888744112 conn(0x7f75840fc7a0 msgr2=0x7f75840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:34.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.801+0000 7f758bf4e640 1 -- 172.21.15.18:0/1888744112 shutdown_connections 2024-09-19T09:50:34.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.801+0000 7f758bf4e640 1 -- 172.21.15.18:0/1888744112 wait complete. 2024-09-19T09:50:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758bf4e640 1 Processor -- start 2024-09-19T09:50:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758bf4e640 1 -- start start 2024-09-19T09:50:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758bf4e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7584100b30 0x7f75841a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758bf4e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584101450 0x7f75841a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758bf4e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7584105f40 0x7f758419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758bf4e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7584118560 con 0x7f7584105f40 2024-09-19T09:50:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758bf4e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75841183e0 con 0x7f7584100b30 2024-09-19T09:50:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758bf4e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75841186e0 con 0x7f7584101450 2024-09-19T09:50:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758a4eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7584105f40 0x7f758419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758a4eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7584105f40 0x7f758419e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43556/0 (socket says 172.21.15.18:43556) 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f758a4eb640 1 -- 172.21.15.18:0/5357264 learned_addr learned my addr 172.21.15.18:0/5357264 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.802+0000 7f7589cea640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7584100b30 0x7f75841a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f75894e9640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584101450 0x7f75841a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f758a4eb640 1 -- 172.21.15.18:0/5357264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584101450 msgr2=0x7f75841a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f758a4eb640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584101450 0x7f75841a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f758a4eb640 1 -- 172.21.15.18:0/5357264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7584100b30 msgr2=0x7f75841a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f758a4eb640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7584100b30 0x7f75841a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f758a4eb640 1 -- 172.21.15.18:0/5357264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758419f040 con 0x7f7584105f40 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f7589cea640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7584100b30 0x7f75841a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f758a4eb640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7584105f40 0x7f758419e910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f757c00eaa0 tx=0x7f757c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f757affd640 1 -- 172.21.15.18:0/5357264 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c00cdb0 con 0x7f7584105f40 2024-09-19T09:50:34.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f757affd640 1 -- 172.21.15.18:0/5357264 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f757c005020 con 0x7f7584105f40 2024-09-19T09:50:34.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f757affd640 1 -- 172.21.15.18:0/5357264 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c0116b0 con 0x7f7584105f40 2024-09-19T09:50:34.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f758bf4e640 1 -- 172.21.15.18:0/5357264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758419f330 con 0x7f7584105f40 2024-09-19T09:50:34.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.803+0000 7f758bf4e640 1 -- 172.21.15.18:0/5357264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75841ab620 con 0x7f7584105f40 2024-09-19T09:50:34.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.804+0000 7f758bf4e640 1 -- 172.21.15.18:0/5357264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7584105920 con 0x7f7584105f40 2024-09-19T09:50:34.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.806+0000 7f757affd640 1 -- 172.21.15.18:0/5357264 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f757c005560 con 0x7f7584105f40 2024-09-19T09:50:34.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.806+0000 7f757affd640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32c0 0x7f75700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:34.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.806+0000 7f7589cea640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32c0 0x7f75700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:34.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.806+0000 7f757affd640 1 -- 172.21.15.18:0/5357264 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f757c0cfd30 con 0x7f7584105f40 2024-09-19T09:50:34.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.807+0000 7f7589cea640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32c0 0x7f75700a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f75800058c0 tx=0x7f758000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:34.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:34.809+0000 7f757affd640 1 -- 172.21.15.18:0/5357264 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f757c016030 con 0x7f7584105f40 2024-09-19T09:50:35.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.023+0000 7f758bf4e640 1 -- 172.21.15.18:0/5357264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f75841ab850 con 0x7f7584105f40 2024-09-19T09:50:35.369 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b[65464]: 2024-09-19T09:50:34.928+0000 7fac373c7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:50:35.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.371+0000 7f757affd640 1 -- 172.21.15.18:0/5357264 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f757c09cc20 con 0x7f7584105f40 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.373+0000 7f758bf4e640 1 -- 172.21.15.18:0/5357264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32c0 msgr2=0x7f75700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.373+0000 7f758bf4e640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32c0 0x7f75700a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f75800058c0 tx=0x7f758000a250 comp rx=0 tx=0).stop 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.373+0000 7f758bf4e640 1 -- 172.21.15.18:0/5357264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7584105f40 msgr2=0x7f758419e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.373+0000 7f758bf4e640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7584105f40 0x7f758419e910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f757c00eaa0 tx=0x7f757c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.374+0000 7f758bf4e640 1 -- 172.21.15.18:0/5357264 shutdown_connections 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.374+0000 7f758bf4e640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32c0 0x7f75700a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.374+0000 7f758bf4e640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7584105f40 0x7f758419e910 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.374+0000 7f758bf4e640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7584101450 0x7f75841a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.374+0000 7f758bf4e640 1 --2- 172.21.15.18:0/5357264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7584100b30 0x7f75841a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.374+0000 7f758bf4e640 1 -- 172.21.15.18:0/5357264 >> 172.21.15.18:0/5357264 conn(0x7f75840fc7a0 msgr2=0x7f758410f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.374+0000 7f758bf4e640 1 -- 172.21.15.18:0/5357264 shutdown_connections 2024-09-19T09:50:35.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:35.374+0000 7f758bf4e640 1 -- 172.21.15.18:0/5357264 wait complete. 2024-09-19T09:50:35.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:35 smithi018 ceph-mon[30956]: pgmap v284: 97 pgs: 97 active+clean; 578 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T09:50:35.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:35 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/5357264' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:50:35.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:35 smithi049 ceph-mon[34858]: pgmap v284: 97 pgs: 97 active+clean; 578 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T09:50:35.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:35 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/5357264' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:50:35.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:35 smithi162 ceph-mon[35174]: pgmap v284: 97 pgs: 97 active+clean; 578 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T09:50:35.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:35 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/5357264' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:50:35.982 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-19T09:50:35.982 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-19T09:50:36.245 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:36.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:36 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/5357264' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:50:36.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:36 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:36 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/5357264' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:50:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:36 smithi049 ceph-mon[34858]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:36.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:36 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/5357264' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:50:36.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:36 smithi162 ceph-mon[35174]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.727+0000 7f4190a72640 1 -- 172.21.15.18:0/2703769452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f418c102d40 msgr2=0x7f418c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.727+0000 7f4190a72640 1 --2- 172.21.15.18:0/2703769452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f418c102d40 0x7f418c103120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f417c009900 tx=0x7f417c02a480 comp rx=0 tx=0).stop 2024-09-19T09:50:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.727+0000 7f4190a72640 1 -- 172.21.15.18:0/2703769452 shutdown_connections 2024-09-19T09:50:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.727+0000 7f4190a72640 1 --2- 172.21.15.18:0/2703769452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418c10c170 0x7f418c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.727+0000 7f4190a72640 1 --2- 172.21.15.18:0/2703769452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418c103660 0x7f418c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.727+0000 7f4190a72640 1 --2- 172.21.15.18:0/2703769452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f418c102d40 0x7f418c103120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.727+0000 7f4190a72640 1 -- 172.21.15.18:0/2703769452 >> 172.21.15.18:0/2703769452 conn(0x7f418c0fc7a0 msgr2=0x7f418c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.727+0000 7f4190a72640 1 -- 172.21.15.18:0/2703769452 shutdown_connections 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.727+0000 7f4190a72640 1 -- 172.21.15.18:0/2703769452 wait complete. 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.728+0000 7f4190a72640 1 Processor -- start 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.728+0000 7f4190a72640 1 -- start start 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.728+0000 7f4190a72640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418c102d40 0x7f418c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.728+0000 7f4190a72640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418c103660 0x7f418c198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.728+0000 7f4190a72640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f418c10c170 0x7f418c19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.728+0000 7f4190a72640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f418c112030 con 0x7f418c10c170 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.728+0000 7f4190a72640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f418c111eb0 con 0x7f418c103660 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.728+0000 7f4190a72640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1121b0 con 0x7f418c102d40 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f418ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f418c10c170 0x7f418c19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f4189d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418c103660 0x7f418c198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f4189d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418c103660 0x7f418c198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37138/0 (socket says 172.21.15.18:37138) 2024-09-19T09:50:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f4189d9b640 1 -- 172.21.15.18:0/1353582934 learned_addr learned my addr 172.21.15.18:0/1353582934 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f418a59c640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418c102d40 0x7f418c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f418ad9d640 1 -- 172.21.15.18:0/1353582934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418c102d40 msgr2=0x7f418c198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f418ad9d640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418c102d40 0x7f418c198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f418ad9d640 1 -- 172.21.15.18:0/1353582934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418c103660 msgr2=0x7f418c198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f418ad9d640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418c103660 0x7f418c198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f418ad9d640 1 -- 172.21.15.18:0/1353582934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c19d5c0 con 0x7f418c10c170 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f4189d9b640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418c103660 0x7f418c198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f418a59c640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418c102d40 0x7f418c198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f418ad9d640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f418c10c170 0x7f418c19cee0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f418400be20 tx=0x7f418400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f417b7fe640 1 -- 172.21.15.18:0/1353582934 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184019070 con 0x7f418c10c170 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f4190a72640 1 -- 172.21.15.18:0/1353582934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418c19d8b0 con 0x7f418c10c170 2024-09-19T09:50:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f417b7fe640 1 -- 172.21.15.18:0/1353582934 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4184014920 con 0x7f418c10c170 2024-09-19T09:50:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f417b7fe640 1 -- 172.21.15.18:0/1353582934 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184012920 con 0x7f418c10c170 2024-09-19T09:50:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.729+0000 7f4190a72640 1 -- 172.21.15.18:0/1353582934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f418c1a5190 con 0x7f418c10c170 2024-09-19T09:50:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.730+0000 7f4190a72640 1 -- 172.21.15.18:0/1353582934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418c1031a0 con 0x7f418c10c170 2024-09-19T09:50:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.732+0000 7f417b7fe640 1 -- 172.21.15.18:0/1353582934 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f418401c070 con 0x7f418c10c170 2024-09-19T09:50:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.732+0000 7f417b7fe640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41740a3240 0x7f41740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.732+0000 7f418a59c640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41740a3240 0x7f41740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.733+0000 7f417b7fe640 1 -- 172.21.15.18:0/1353582934 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f41840cf3d0 con 0x7f418c10c170 2024-09-19T09:50:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.733+0000 7f418a59c640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41740a3240 0x7f41740a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f417c005ab0 tx=0x7f417c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.736+0000 7f417b7fe640 1 -- 172.21.15.18:0/1353582934 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f418409bbf0 con 0x7f418c10c170 2024-09-19T09:50:36.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:36.948+0000 7f4190a72640 1 -- 172.21.15.18:0/1353582934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f418c106c80 con 0x7f418c10c170 2024-09-19T09:50:37.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.381+0000 7f417b7fe640 1 -- 172.21.15.18:0/1353582934 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f418409fef0 con 0x7f418c10c170 2024-09-19T09:50:37.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 -- 172.21.15.18:0/1353582934 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41740a3240 msgr2=0x7f41740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:37.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41740a3240 0x7f41740a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f417c005ab0 tx=0x7f417c005a20 comp rx=0 tx=0).stop 2024-09-19T09:50:37.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 -- 172.21.15.18:0/1353582934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f418c10c170 msgr2=0x7f418c19cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:37.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f418c10c170 0x7f418c19cee0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f418400be20 tx=0x7f418400bf10 comp rx=0 tx=0).stop 2024-09-19T09:50:37.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 -- 172.21.15.18:0/1353582934 shutdown_connections 2024-09-19T09:50:37.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41740a3240 0x7f41740a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:37.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f418c10c170 0x7f418c19cee0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:37.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f418c103660 0x7f418c198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:37.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 --2- 172.21.15.18:0/1353582934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418c102d40 0x7f418c198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:37.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 -- 172.21.15.18:0/1353582934 >> 172.21.15.18:0/1353582934 conn(0x7f418c0fc7a0 msgr2=0x7f418c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:37.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 -- 172.21.15.18:0/1353582934 shutdown_connections 2024-09-19T09:50:37.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:37.383+0000 7f4190a72640 1 -- 172.21.15.18:0/1353582934 wait complete. 2024-09-19T09:50:37.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:37 smithi018 ceph-mon[30956]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:50:37.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:37 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1353582934' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:50:37.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:37 smithi049 ceph-mon[34858]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:50:37.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:37 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1353582934' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:50:37.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:37 smithi162 ceph-mon[35174]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:50:37.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:37 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1353582934' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:50:37.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T09:50:38.180 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:38.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:38 smithi018 ceph-mon[30956]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:50:38.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:38 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1353582934' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:50:38.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:38 smithi018 ceph-mon[30956]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:50:38.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:38 smithi018 ceph-mon[30956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:38.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:38 smithi018 ceph-mon[30956]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T09:50:38.559 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:38 smithi018 ceph-mon[30956]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.642+0000 7f8a864aa640 1 -- 172.21.15.18:0/2068875582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a80102790 msgr2=0x7f8a801067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.642+0000 7f8a864aa640 1 --2- 172.21.15.18:0/2068875582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a80102790 0x7f8a801067e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009900 tx=0x7f8a7402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.642+0000 7f8a864aa640 1 -- 172.21.15.18:0/2068875582 shutdown_connections 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.642+0000 7f8a864aa640 1 --2- 172.21.15.18:0/2068875582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a80106f10 0x7f8a8010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.642+0000 7f8a864aa640 1 --2- 172.21.15.18:0/2068875582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a80102790 0x7f8a801067e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.642+0000 7f8a864aa640 1 --2- 172.21.15.18:0/2068875582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a80101de0 0x7f8a801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.642+0000 7f8a864aa640 1 -- 172.21.15.18:0/2068875582 >> 172.21.15.18:0/2068875582 conn(0x7f8a800fd8c0 msgr2=0x7f8a800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.642+0000 7f8a864aa640 1 -- 172.21.15.18:0/2068875582 shutdown_connections 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.642+0000 7f8a864aa640 1 -- 172.21.15.18:0/2068875582 wait complete. 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.643+0000 7f8a864aa640 1 Processor -- start 2024-09-19T09:50:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.643+0000 7f8a864aa640 1 -- start start 2024-09-19T09:50:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.643+0000 7f8a864aa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a80101de0 0x7f8a80198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.643+0000 7f8a864aa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a80102790 0x7f8a801988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.643+0000 7f8a864aa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a80106f10 0x7f8a8019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.643+0000 7f8a864aa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80111f80 con 0x7f8a80101de0 2024-09-19T09:50:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.643+0000 7f8a864aa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80111e00 con 0x7f8a80106f10 2024-09-19T09:50:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.643+0000 7f8a864aa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80112100 con 0x7f8a80102790 2024-09-19T09:50:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.643+0000 7f8a7ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a80101de0 0x7f8a80198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a80101de0 0x7f8a80198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39022/0 (socket says 172.21.15.18:39022) 2024-09-19T09:50:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7ffff640 1 -- 172.21.15.18:0/970084763 learned_addr learned my addr 172.21.15.18:0/970084763 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7f7fe640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a80102790 0x7f8a801988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a84a47640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a80106f10 0x7f8a8019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7ffff640 1 -- 172.21.15.18:0/970084763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a80102790 msgr2=0x7f8a801988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7ffff640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a80102790 0x7f8a801988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7ffff640 1 -- 172.21.15.18:0/970084763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a80106f10 msgr2=0x7f8a8019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7ffff640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a80106f10 0x7f8a8019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7ffff640 1 -- 172.21.15.18:0/970084763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8019d320 con 0x7f8a80101de0 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a84a47640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a80106f10 0x7f8a8019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7ffff640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a80101de0 0x7f8a80198370 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c920 tx=0x7f8a7000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7d7fa640 1 -- 172.21.15.18:0/970084763 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70007c70 con 0x7f8a80101de0 2024-09-19T09:50:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7d7fa640 1 -- 172.21.15.18:0/970084763 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a70007e10 con 0x7f8a80101de0 2024-09-19T09:50:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a864aa640 1 -- 172.21.15.18:0/970084763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8019d610 con 0x7f8a80101de0 2024-09-19T09:50:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a7d7fa640 1 -- 172.21.15.18:0/970084763 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70018890 con 0x7f8a80101de0 2024-09-19T09:50:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.644+0000 7f8a864aa640 1 -- 172.21.15.18:0/970084763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a801a4ef0 con 0x7f8a80101de0 2024-09-19T09:50:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.646+0000 7f8a864aa640 1 -- 172.21.15.18:0/970084763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a801021c0 con 0x7f8a80101de0 2024-09-19T09:50:38.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:38 smithi049 ceph-mon[34858]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:50:38.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:38 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1353582934' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:50:38.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:38 smithi049 ceph-mon[34858]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:50:38.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:38 smithi049 ceph-mon[34858]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:38.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:38 smithi049 ceph-mon[34858]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T09:50:38.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:38 smithi049 ceph-mon[34858]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T09:50:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.647+0000 7f8a7d7fa640 1 -- 172.21.15.18:0/970084763 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8a70018a70 con 0x7f8a80101de0 2024-09-19T09:50:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.647+0000 7f8a7d7fa640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a680a3240 0x7f8a680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.647+0000 7f8a7f7fe640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a680a3240 0x7f8a680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.648+0000 7f8a7d7fa640 1 -- 172.21.15.18:0/970084763 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f8a700cf910 con 0x7f8a80101de0 2024-09-19T09:50:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.648+0000 7f8a7f7fe640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a680a3240 0x7f8a680a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a74000c00 tx=0x7f8a74005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.652+0000 7f8a7d7fa640 1 -- 172.21.15.18:0/970084763 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a70014030 con 0x7f8a80101de0 2024-09-19T09:50:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:38 smithi162 ceph-mon[35174]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:50:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:38 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1353582934' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:50:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:38 smithi162 ceph-mon[35174]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:50:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:38 smithi162 ceph-mon[35174]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:50:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:38 smithi162 ceph-mon[35174]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T09:50:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:38 smithi162 ceph-mon[35174]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T09:50:38.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:38.865+0000 7f8a864aa640 1 -- 172.21.15.18:0/970084763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f8a8002d7c0 con 0x7f8a80101de0 2024-09-19T09:50:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.398+0000 7f8a7d7fa640 1 -- 172.21.15.18:0/970084763 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f8a7009c780 con 0x7f8a80101de0 2024-09-19T09:50:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.400+0000 7f8a864aa640 1 -- 172.21.15.18:0/970084763 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a680a3240 msgr2=0x7f8a680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.400+0000 7f8a864aa640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a680a3240 0x7f8a680a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a74000c00 tx=0x7f8a74005df0 comp rx=0 tx=0).stop 2024-09-19T09:50:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.400+0000 7f8a864aa640 1 -- 172.21.15.18:0/970084763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a80101de0 msgr2=0x7f8a80198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.400+0000 7f8a864aa640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a80101de0 0x7f8a80198370 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c920 tx=0x7f8a7000cde0 comp rx=0 tx=0).stop 2024-09-19T09:50:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.401+0000 7f8a864aa640 1 -- 172.21.15.18:0/970084763 shutdown_connections 2024-09-19T09:50:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.401+0000 7f8a864aa640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a680a3240 0x7f8a680a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.401+0000 7f8a864aa640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a80106f10 0x7f8a8019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.401+0000 7f8a864aa640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a80102790 0x7f8a801988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.401+0000 7f8a864aa640 1 --2- 172.21.15.18:0/970084763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a80101de0 0x7f8a80198370 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.401+0000 7f8a864aa640 1 -- 172.21.15.18:0/970084763 >> 172.21.15.18:0/970084763 conn(0x7f8a800fd8c0 msgr2=0x7f8a800fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:39.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.401+0000 7f8a864aa640 1 -- 172.21.15.18:0/970084763 shutdown_connections 2024-09-19T09:50:39.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:39.401+0000 7f8a864aa640 1 -- 172.21.15.18:0/970084763 wait complete. 2024-09-19T09:50:39.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:39 smithi049 ceph-mon[34858]: pgmap v286: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-09-19T09:50:39.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:39 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] up:active 2024-09-19T09:50:39.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:39 smithi049 ceph-mon[34858]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:50:39.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:39 smithi049 ceph-mon[34858]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T09:50:39.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:39 smithi049 ceph-mon[34858]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T09:50:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:39 smithi049 ceph-mon[34858]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T09:50:39.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:39 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/970084763' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:50:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:39 smithi162 ceph-mon[35174]: pgmap v286: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-09-19T09:50:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:39 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] up:active 2024-09-19T09:50:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:39 smithi162 ceph-mon[35174]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:50:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:39 smithi162 ceph-mon[35174]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T09:50:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:39 smithi162 ceph-mon[35174]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T09:50:39.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:39 smithi162 ceph-mon[35174]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T09:50:39.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:39 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/970084763' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:50:39.736 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:39 smithi018 ceph-mon[30956]: pgmap v286: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-09-19T09:50:39.737 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:39 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] up:active 2024-09-19T09:50:39.737 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:39 smithi018 ceph-mon[30956]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:50:39.737 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:39 smithi018 ceph-mon[30956]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T09:50:39.737 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:39 smithi018 ceph-mon[30956]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T09:50:39.737 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:39 smithi018 ceph-mon[30956]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T09:50:39.737 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:39 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/970084763' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:50:40.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T09:50:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:40.400 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b[65464]: 2024-09-19T09:50:39.928+0000 7fac373c7640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T09:50:40.400 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 09:50:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b[65464]: 2024-09-19T09:50:39.928+0000 7fac373c7640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T09:50:40.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/970084763' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:50:40.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] up:active 2024-09-19T09:50:40.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:50:40.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-19T09:50:40.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-19T09:50:40.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-19T09:50:40.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] up:active 2024-09-19T09:50:40.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:50:40.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:50:40.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: Cluster is now healthy 2024-09-19T09:50:40.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-09-19T09:50:40.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-19T09:50:40.658 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:40 smithi018 ceph-mon[30956]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-19T09:50:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/970084763' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:50:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] up:active 2024-09-19T09:50:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:50:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-19T09:50:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-19T09:50:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-19T09:50:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] up:active 2024-09-19T09:50:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:50:40.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:50:40.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: Cluster is now healthy 2024-09-19T09:50:40.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-09-19T09:50:40.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-19T09:50:40.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:40 smithi162 ceph-mon[35174]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-19T09:50:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.739+0000 7f32d29a2640 1 -- 172.21.15.18:0/1345883785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32cc106f10 msgr2=0x7f32cc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.739+0000 7f32d29a2640 1 --2- 172.21.15.18:0/1345883785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32cc106f10 0x7f32cc10ea90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009ca0 tx=0x7f32c402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:50:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.739+0000 7f32d29a2640 1 -- 172.21.15.18:0/1345883785 shutdown_connections 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.739+0000 7f32d29a2640 1 --2- 172.21.15.18:0/1345883785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32cc106f10 0x7f32cc10ea90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.739+0000 7f32d29a2640 1 --2- 172.21.15.18:0/1345883785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32cc102790 0x7f32cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.739+0000 7f32d29a2640 1 --2- 172.21.15.18:0/1345883785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32cc101de0 0x7f32cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.739+0000 7f32d29a2640 1 -- 172.21.15.18:0/1345883785 >> 172.21.15.18:0/1345883785 conn(0x7f32cc0fd8c0 msgr2=0x7f32cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.739+0000 7f32d29a2640 1 -- 172.21.15.18:0/1345883785 shutdown_connections 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.739+0000 7f32d29a2640 1 -- 172.21.15.18:0/1345883785 wait complete. 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32d29a2640 1 Processor -- start 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32d29a2640 1 -- start start 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32d29a2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32cc101de0 0x7f32cc1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32d29a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32cc102790 0x7f32cc1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32d29a2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32cc106f10 0x7f32cc19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32d29a2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc111fc0 con 0x7f32cc101de0 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32d29a2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc111e40 con 0x7f32cc106f10 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32d29a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc112140 con 0x7f32cc102790 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32cbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32cc101de0 0x7f32cc1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32cbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32cc101de0 0x7f32cc1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39046/0 (socket says 172.21.15.18:39046) 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32cbfff640 1 -- 172.21.15.18:0/957654457 learned_addr learned my addr 172.21.15.18:0/957654457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.740+0000 7f32d0f3f640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32cc106f10 0x7f32cc19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32cb7fe640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32cc102790 0x7f32cc1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32cbfff640 1 -- 172.21.15.18:0/957654457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32cc102790 msgr2=0x7f32cc1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32cbfff640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32cc102790 0x7f32cc1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32cbfff640 1 -- 172.21.15.18:0/957654457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32cc106f10 msgr2=0x7f32cc19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32cbfff640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32cc106f10 0x7f32cc19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32cbfff640 1 -- 172.21.15.18:0/957654457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc19d360 con 0x7f32cc101de0 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32cbfff640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32cc101de0 0x7f32cc1983b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00c970 tx=0x7f32bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32c97fa640 1 -- 172.21.15.18:0/957654457 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc007bb0 con 0x7f32cc101de0 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32c97fa640 1 -- 172.21.15.18:0/957654457 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32bc007d50 con 0x7f32cc101de0 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32d29a2640 1 -- 172.21.15.18:0/957654457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32cc19d650 con 0x7f32cc101de0 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32c97fa640 1 -- 172.21.15.18:0/957654457 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc00f450 con 0x7f32cc101de0 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.741+0000 7f32d29a2640 1 -- 172.21.15.18:0/957654457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32cc1a4f30 con 0x7f32cc101de0 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.742+0000 7f32d29a2640 1 -- 172.21.15.18:0/957654457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32cc1021c0 con 0x7f32cc101de0 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.743+0000 7f32c97fa640 1 -- 172.21.15.18:0/957654457 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f32bc005020 con 0x7f32cc101de0 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.744+0000 7f32c97fa640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32b40a3240 0x7f32b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.744+0000 7f32cb7fe640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32b40a3240 0x7f32b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.744+0000 7f32c97fa640 1 -- 172.21.15.18:0/957654457 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f32bc0cf650 con 0x7f32cc101de0 2024-09-19T09:50:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.744+0000 7f32cb7fe640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32b40a3240 0x7f32b40a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32cc0fe130 tx=0x7f32c000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.749+0000 7f32c97fa640 1 -- 172.21.15.18:0/957654457 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f32bc014030 con 0x7f32cc101de0 2024-09-19T09:50:40.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/970084763' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:50:40.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] up:active 2024-09-19T09:50:40.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:50:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-19T09:50:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-19T09:50:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-19T09:50:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] up:active 2024-09-19T09:50:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:50:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:50:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: Cluster is now healthy 2024-09-19T09:50:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-09-19T09:50:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-19T09:50:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:40 smithi049 ceph-mon[34858]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-19T09:50:40.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:40.961+0000 7f32d29a2640 1 -- 172.21.15.18:0/957654457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f32cc1a5130 con 0x7f32cc101de0 2024-09-19T09:50:41.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.334+0000 7f32c97fa640 1 -- 172.21.15.18:0/957654457 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f32bc09c420 con 0x7f32cc101de0 2024-09-19T09:50:41.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.337+0000 7f32d29a2640 1 -- 172.21.15.18:0/957654457 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32b40a3240 msgr2=0x7f32b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:41.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.337+0000 7f32d29a2640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32b40a3240 0x7f32b40a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32cc0fe130 tx=0x7f32c000c4a0 comp rx=0 tx=0).stop 2024-09-19T09:50:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.337+0000 7f32d29a2640 1 -- 172.21.15.18:0/957654457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32cc101de0 msgr2=0x7f32cc1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.337+0000 7f32d29a2640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32cc101de0 0x7f32cc1983b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00c970 tx=0x7f32bc00ce30 comp rx=0 tx=0).stop 2024-09-19T09:50:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.337+0000 7f32d29a2640 1 -- 172.21.15.18:0/957654457 shutdown_connections 2024-09-19T09:50:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.337+0000 7f32d29a2640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32b40a3240 0x7f32b40a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.337+0000 7f32d29a2640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32cc106f10 0x7f32cc19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.337+0000 7f32d29a2640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32cc102790 0x7f32cc1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.337+0000 7f32d29a2640 1 --2- 172.21.15.18:0/957654457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32cc101de0 0x7f32cc1983b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.337+0000 7f32d29a2640 1 -- 172.21.15.18:0/957654457 >> 172.21.15.18:0/957654457 conn(0x7f32cc0fd8c0 msgr2=0x7f32cc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.338+0000 7f32d29a2640 1 -- 172.21.15.18:0/957654457 shutdown_connections 2024-09-19T09:50:41.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:41.338+0000 7f32d29a2640 1 -- 172.21.15.18:0/957654457 wait complete. 2024-09-19T09:50:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:41 smithi018 ceph-mon[30956]: pgmap v287: 97 pgs: 97 active+clean; 581 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 10 op/s 2024-09-19T09:50:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:41 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/957654457' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:50:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:41 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/957654457' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:50:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:41 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] up:active 2024-09-19T09:50:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:41 smithi018 ceph-mon[30956]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:50:41.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:41 smithi018 ceph-mon[30956]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:50:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:41 smithi162 ceph-mon[35174]: pgmap v287: 97 pgs: 97 active+clean; 581 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 10 op/s 2024-09-19T09:50:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:41 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/957654457' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:50:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:41 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/957654457' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:50:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:41 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] up:active 2024-09-19T09:50:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:41 smithi162 ceph-mon[35174]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:50:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:41 smithi162 ceph-mon[35174]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:50:41.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:41 smithi049 ceph-mon[34858]: pgmap v287: 97 pgs: 97 active+clean; 581 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 10 op/s 2024-09-19T09:50:41.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:41 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/957654457' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:50:41.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:41 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/957654457' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:50:41.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:41 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] up:active 2024-09-19T09:50:41.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:41 smithi049 ceph-mon[34858]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:50:41.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:41 smithi049 ceph-mon[34858]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:50:41.938 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-19T09:50:41.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T09:50:42.204 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.697+0000 7f66c1931640 1 -- 172.21.15.18:0/3047646157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66bc101de0 msgr2=0x7f66bc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.697+0000 7f66c1931640 1 --2- 172.21.15.18:0/3047646157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66bc101de0 0x7f66bc1021c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009900 tx=0x7f66ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:50:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.697+0000 7f66c1931640 1 -- 172.21.15.18:0/3047646157 shutdown_connections 2024-09-19T09:50:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.697+0000 7f66c1931640 1 --2- 172.21.15.18:0/3047646157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66bc106f10 0x7f66bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.697+0000 7f66c1931640 1 --2- 172.21.15.18:0/3047646157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc102790 0x7f66bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.697+0000 7f66c1931640 1 --2- 172.21.15.18:0/3047646157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66bc101de0 0x7f66bc1021c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.697+0000 7f66c1931640 1 -- 172.21.15.18:0/3047646157 >> 172.21.15.18:0/3047646157 conn(0x7f66bc0fd8c0 msgr2=0x7f66bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.697+0000 7f66c1931640 1 -- 172.21.15.18:0/3047646157 shutdown_connections 2024-09-19T09:50:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.697+0000 7f66c1931640 1 -- 172.21.15.18:0/3047646157 wait complete. 2024-09-19T09:50:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.698+0000 7f66c1931640 1 Processor -- start 2024-09-19T09:50:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.698+0000 7f66c1931640 1 -- start start 2024-09-19T09:50:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.698+0000 7f66c1931640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66bc101de0 0x7f66bc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.698+0000 7f66c1931640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc102790 0x7f66bc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66c1931640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66bc106f10 0x7f66bc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66c1931640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc111f70 con 0x7f66bc106f10 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66c1931640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc111df0 con 0x7f66bc101de0 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66c1931640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc1120f0 con 0x7f66bc102790 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66bb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66bc106f10 0x7f66bc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66bb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66bc106f10 0x7f66bc19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39066/0 (socket says 172.21.15.18:39066) 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66bb7fe640 1 -- 172.21.15.18:0/2950682339 learned_addr learned my addr 172.21.15.18:0/2950682339 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66baffd640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66bc101de0 0x7f66bc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66b3fff640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc102790 0x7f66bc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66bb7fe640 1 -- 172.21.15.18:0/2950682339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc102790 msgr2=0x7f66bc198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66bb7fe640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc102790 0x7f66bc198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66bb7fe640 1 -- 172.21.15.18:0/2950682339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66bc101de0 msgr2=0x7f66bc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66bb7fe640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66bc101de0 0x7f66bc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66bb7fe640 1 -- 172.21.15.18:0/2950682339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66bc19d400 con 0x7f66bc106f10 2024-09-19T09:50:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66bb7fe640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66bc106f10 0x7f66bc19cd20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66b400eb10 tx=0x7f66b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66c092f640 1 -- 172.21.15.18:0/2950682339 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4004b20 con 0x7f66bc106f10 2024-09-19T09:50:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66c1931640 1 -- 172.21.15.18:0/2950682339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66bc19d6f0 con 0x7f66bc106f10 2024-09-19T09:50:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66c092f640 1 -- 172.21.15.18:0/2950682339 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66b4004cc0 con 0x7f66bc106f10 2024-09-19T09:50:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.699+0000 7f66c092f640 1 -- 172.21.15.18:0/2950682339 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4010760 con 0x7f66bc106f10 2024-09-19T09:50:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.700+0000 7f66c1931640 1 -- 172.21.15.18:0/2950682339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66bc1a4fd0 con 0x7f66bc106f10 2024-09-19T09:50:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.701+0000 7f66c1931640 1 -- 172.21.15.18:0/2950682339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66bc1021c0 con 0x7f66bc106f10 2024-09-19T09:50:42.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.702+0000 7f66c092f640 1 -- 172.21.15.18:0/2950682339 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f66b4005020 con 0x7f66bc106f10 2024-09-19T09:50:42.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.703+0000 7f66c092f640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66a80a3240 0x7f66a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:42.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.703+0000 7f66baffd640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66a80a3240 0x7f66a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:42.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.703+0000 7f66c092f640 1 -- 172.21.15.18:0/2950682339 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f66b40cfd60 con 0x7f66bc106f10 2024-09-19T09:50:42.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.703+0000 7f66baffd640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66a80a3240 0x7f66a80a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009230 tx=0x7f66ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:42.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.707+0000 7f66c092f640 1 -- 172.21.15.18:0/2950682339 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66b409cbd0 con 0x7f66bc106f10 2024-09-19T09:50:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.907+0000 7f66c1931640 1 -- 172.21.15.18:0/2950682339 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f66bc062630 con 0x7f66a80a3240 2024-09-19T09:50:42.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.935+0000 7f66c092f640 1 -- 172.21.15.18:0/2950682339 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f66bc062630 con 0x7f66a80a3240 2024-09-19T09:50:42.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 -- 172.21.15.18:0/2950682339 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66a80a3240 msgr2=0x7f66a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:42.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66a80a3240 0x7f66a80a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009230 tx=0x7f66ac0058d0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 -- 172.21.15.18:0/2950682339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66bc106f10 msgr2=0x7f66bc19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:42.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66bc106f10 0x7f66bc19cd20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66b400eb10 tx=0x7f66b400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 -- 172.21.15.18:0/2950682339 shutdown_connections 2024-09-19T09:50:42.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66a80a3240 0x7f66a80a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66bc106f10 0x7f66bc19cd20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66bc102790 0x7f66bc198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 --2- 172.21.15.18:0/2950682339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66bc101de0 0x7f66bc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:42.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 -- 172.21.15.18:0/2950682339 >> 172.21.15.18:0/2950682339 conn(0x7f66bc0fd8c0 msgr2=0x7f66bc0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:42.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 -- 172.21.15.18:0/2950682339 shutdown_connections 2024-09-19T09:50:42.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:42.937+0000 7f66c1931640 1 -- 172.21.15.18:0/2950682339 wait complete. 2024-09-19T09:50:43.332 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:50:42 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:50:42.912+0000 7f7e95d22640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:50:43.332 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:50:42 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:50:42.912+0000 7f7e95d22640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:50:43.332 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:50:42 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:50:42.912+0000 7f7e95d22640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:50:43.332 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:50:42 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:50:42.912+0000 7f7e95d22640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:50:43.332 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 09:50:42 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T09:50:42.912+0000 7f7e95d22640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:50:43.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T09:50:43.606 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:43 smithi018 ceph-mon[30956]: pgmap v288: 97 pgs: 97 active+clean; 583 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 939 B/s rd, 3.4 KiB/s wr, 13 op/s 2024-09-19T09:50:43.606 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:43 smithi018 ceph-mon[30956]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:43.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:43 smithi162 ceph-mon[35174]: pgmap v288: 97 pgs: 97 active+clean; 583 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 939 B/s rd, 3.4 KiB/s wr, 13 op/s 2024-09-19T09:50:43.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:43 smithi162 ceph-mon[35174]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:43.703 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:43 smithi049 ceph-mon[34858]: pgmap v288: 97 pgs: 97 active+clean; 583 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 939 B/s rd, 3.4 KiB/s wr, 13 op/s 2024-09-19T09:50:43.703 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:43 smithi049 ceph-mon[34858]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:43.840 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:44.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.239+0000 7fb0f3e18640 1 -- 172.21.15.18:0/2596062925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec10e500 msgr2=0x7fb0ec110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:44.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.239+0000 7fb0f3e18640 1 --2- 172.21.15.18:0/2596062925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec10e500 0x7fb0ec110910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009900 tx=0x7fb0e402a410 comp rx=0 tx=0).stop 2024-09-19T09:50:44.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.239+0000 7fb0f3e18640 1 -- 172.21.15.18:0/2596062925 shutdown_connections 2024-09-19T09:50:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.239+0000 7fb0f3e18640 1 --2- 172.21.15.18:0/2596062925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec10e500 0x7fb0ec110910 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.239+0000 7fb0f3e18640 1 --2- 172.21.15.18:0/2596062925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec101440 0x7fb0ec10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.239+0000 7fb0f3e18640 1 --2- 172.21.15.18:0/2596062925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0ec100b20 0x7fb0ec100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.239+0000 7fb0f3e18640 1 -- 172.21.15.18:0/2596062925 >> 172.21.15.18:0/2596062925 conn(0x7fb0ec0fc7d0 msgr2=0x7fb0ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.239+0000 7fb0f3e18640 1 -- 172.21.15.18:0/2596062925 shutdown_connections 2024-09-19T09:50:44.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.239+0000 7fb0f3e18640 1 -- 172.21.15.18:0/2596062925 wait complete. 2024-09-19T09:50:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f3e18640 1 Processor -- start 2024-09-19T09:50:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f3e18640 1 -- start start 2024-09-19T09:50:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f3e18640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec100b20 0x7fb0ec19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f3e18640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0ec101440 0x7fb0ec19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f3e18640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec10e500 0x7fb0ec19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f3e18640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec114230 con 0x7fb0ec100b20 2024-09-19T09:50:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f3e18640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec1140b0 con 0x7fb0ec10e500 2024-09-19T09:50:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f3e18640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec1143b0 con 0x7fb0ec101440 2024-09-19T09:50:44.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f1bb4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec100b20 0x7fb0ec19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f1bb4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec100b20 0x7fb0ec19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39110/0 (socket says 172.21.15.18:39110) 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f1bb4640 1 -- 172.21.15.18:0/3471169847 learned_addr learned my addr 172.21.15.18:0/3471169847 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f13b3640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0ec101440 0x7fb0ec19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.240+0000 7fb0f23b5640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec10e500 0x7fb0ec19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0f1bb4640 1 -- 172.21.15.18:0/3471169847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0ec101440 msgr2=0x7fb0ec19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0f1bb4640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0ec101440 0x7fb0ec19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0f1bb4640 1 -- 172.21.15.18:0/3471169847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec10e500 msgr2=0x7fb0ec19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0f1bb4640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec10e500 0x7fb0ec19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0f1bb4640 1 -- 172.21.15.18:0/3471169847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ec19f6a0 con 0x7fb0ec100b20 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0f13b3640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0ec101440 0x7fb0ec19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0f23b5640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec10e500 0x7fb0ec19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0f1bb4640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec100b20 0x7fb0ec19a6f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00eab0 tx=0x7fb0dc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0eaffd640 1 -- 172.21.15.18:0/3471169847 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc00ce40 con 0x7fb0ec100b20 2024-09-19T09:50:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0eaffd640 1 -- 172.21.15.18:0/3471169847 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0dc011950 con 0x7fb0ec100b20 2024-09-19T09:50:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0f3e18640 1 -- 172.21.15.18:0/3471169847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ec19f990 con 0x7fb0ec100b20 2024-09-19T09:50:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0eaffd640 1 -- 172.21.15.18:0/3471169847 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc010ae0 con 0x7fb0ec100b20 2024-09-19T09:50:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.241+0000 7fb0f3e18640 1 -- 172.21.15.18:0/3471169847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ec1a7270 con 0x7fb0ec100b20 2024-09-19T09:50:44.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.242+0000 7fb0f3e18640 1 -- 172.21.15.18:0/3471169847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0ec100f00 con 0x7fb0ec100b20 2024-09-19T09:50:44.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.243+0000 7fb0eaffd640 1 -- 172.21.15.18:0/3471169847 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb0dc011b00 con 0x7fb0ec100b20 2024-09-19T09:50:44.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.244+0000 7fb0eaffd640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0d40a3240 0x7fb0d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:44.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.244+0000 7fb0f13b3640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0d40a3240 0x7fb0d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:44.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.244+0000 7fb0eaffd640 1 -- 172.21.15.18:0/3471169847 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fb0dc0cfe70 con 0x7fb0ec100b20 2024-09-19T09:50:44.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.245+0000 7fb0f13b3640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0d40a3240 0x7fb0d40a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec102810 tx=0x7fb0e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:44.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.247+0000 7fb0eaffd640 1 -- 172.21.15.18:0/3471169847 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0dc016030 con 0x7fb0ec100b20 2024-09-19T09:50:44.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.418+0000 7fb0eaffd640 1 -- 172.21.15.18:0/3471169847 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb0dc098bb0 con 0x7fb0ec100b20 2024-09-19T09:50:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.454+0000 7fb0f3e18640 1 -- 172.21.15.18:0/3471169847 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb0ec109670 con 0x7fb0d40a3240 2024-09-19T09:50:44.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.476+0000 7fb0eaffd640 1 -- 172.21.15.18:0/3471169847 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb0e0004030 con 0x7fb0d40a3240 2024-09-19T09:50:44.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.478+0000 7fb0f3e18640 1 -- 172.21.15.18:0/3471169847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0d40a3240 msgr2=0x7fb0d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:44.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.478+0000 7fb0f3e18640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0d40a3240 0x7fb0d40a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec102810 tx=0x7fb0e0005f90 comp rx=0 tx=0).stop 2024-09-19T09:50:44.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.478+0000 7fb0f3e18640 1 -- 172.21.15.18:0/3471169847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec100b20 msgr2=0x7fb0ec19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.478+0000 7fb0f3e18640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec100b20 0x7fb0ec19a6f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00eab0 tx=0x7fb0dc00ef70 comp rx=0 tx=0).stop 2024-09-19T09:50:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.478+0000 7fb0f3e18640 1 -- 172.21.15.18:0/3471169847 shutdown_connections 2024-09-19T09:50:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.478+0000 7fb0f3e18640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0d40a3240 0x7fb0d40a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.478+0000 7fb0f3e18640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec10e500 0x7fb0ec19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.478+0000 7fb0f3e18640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0ec101440 0x7fb0ec19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.478+0000 7fb0f3e18640 1 --2- 172.21.15.18:0/3471169847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec100b20 0x7fb0ec19a6f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.478+0000 7fb0f3e18640 1 -- 172.21.15.18:0/3471169847 >> 172.21.15.18:0/3471169847 conn(0x7fb0ec0fc7d0 msgr2=0x7fb0ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.479+0000 7fb0f3e18640 1 -- 172.21.15.18:0/3471169847 shutdown_connections 2024-09-19T09:50:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:44.479+0000 7fb0f3e18640 1 -- 172.21.15.18:0/3471169847 wait complete. 2024-09-19T09:50:45.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T09:50:45.393 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:45.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:45 smithi018 ceph-mon[30956]: pgmap v289: 97 pgs: 97 active+clean; 592 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.2 KiB/s wr, 20 op/s 2024-09-19T09:50:45.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:45 smithi018 ceph-mon[30956]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:50:45.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:45 smithi018 ceph-mon[30956]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.778+0000 7f5b0e617640 1 -- 172.21.15.18:0/3197315545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b081082a0 msgr2=0x7f5b0810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.778+0000 7f5b0e617640 1 --2- 172.21.15.18:0/3197315545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b081082a0 0x7f5b0810ec40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009cd0 tx=0x7f5b0002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:50:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.778+0000 7f5b0e617640 1 -- 172.21.15.18:0/3197315545 shutdown_connections 2024-09-19T09:50:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.778+0000 7f5b0e617640 1 --2- 172.21.15.18:0/3197315545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b081082a0 0x7f5b0810ec40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.778+0000 7f5b0e617640 1 --2- 172.21.15.18:0/3197315545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b081036e0 0x7f5b08107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.778+0000 7f5b0e617640 1 --2- 172.21.15.18:0/3197315545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b08102d30 0x7f5b08103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.779+0000 7f5b0e617640 1 -- 172.21.15.18:0/3197315545 >> 172.21.15.18:0/3197315545 conn(0x7f5b080fc7d0 msgr2=0x7f5b080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:45.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.779+0000 7f5b0e617640 1 -- 172.21.15.18:0/3197315545 shutdown_connections 2024-09-19T09:50:45.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.779+0000 7f5b0e617640 1 -- 172.21.15.18:0/3197315545 wait complete. 2024-09-19T09:50:45.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.779+0000 7f5b0e617640 1 Processor -- start 2024-09-19T09:50:45.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.779+0000 7f5b0e617640 1 -- start start 2024-09-19T09:50:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.779+0000 7f5b0e617640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b08102d30 0x7f5b08100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.779+0000 7f5b0e617640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b081036e0 0x7f5b08100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b0e617640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b081082a0 0x7f5b08101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b0e617640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08112100 con 0x7f5b08102d30 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b0e617640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08111f80 con 0x7f5b081036e0 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b0e617640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08112280 con 0x7f5b081082a0 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b07fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b08102d30 0x7f5b08100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b07fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b08102d30 0x7f5b08100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39128/0 (socket says 172.21.15.18:39128) 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b07fff640 1 -- 172.21.15.18:0/862908823 learned_addr learned my addr 172.21.15.18:0/862908823 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b077fe640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b081036e0 0x7f5b08100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b0cbb4640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b081082a0 0x7f5b08101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b07fff640 1 -- 172.21.15.18:0/862908823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b081082a0 msgr2=0x7f5b08101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b07fff640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b081082a0 0x7f5b08101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b07fff640 1 -- 172.21.15.18:0/862908823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b081036e0 msgr2=0x7f5b08100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b07fff640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b081036e0 0x7f5b08100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b07fff640 1 -- 172.21.15.18:0/862908823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b081a6a90 con 0x7f5b08102d30 2024-09-19T09:50:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b07fff640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b08102d30 0x7f5b08100990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5af800b4a0 tx=0x7f5af800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b057fa640 1 -- 172.21.15.18:0/862908823 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8014070 con 0x7f5b08102d30 2024-09-19T09:50:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b057fa640 1 -- 172.21.15.18:0/862908823 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5af8010af0 con 0x7f5b08102d30 2024-09-19T09:50:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b0e617640 1 -- 172.21.15.18:0/862908823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b081a6d80 con 0x7f5b08102d30 2024-09-19T09:50:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.780+0000 7f5b057fa640 1 -- 172.21.15.18:0/862908823 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8017d10 con 0x7f5b08102d30 2024-09-19T09:50:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.781+0000 7f5b0e617640 1 -- 172.21.15.18:0/862908823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b081a7240 con 0x7f5b08102d30 2024-09-19T09:50:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.782+0000 7f5b0e617640 1 -- 172.21.15.18:0/862908823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0806a850 con 0x7f5b08102d30 2024-09-19T09:50:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.783+0000 7f5b057fa640 1 -- 172.21.15.18:0/862908823 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5af8017070 con 0x7f5b08102d30 2024-09-19T09:50:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.783+0000 7f5b057fa640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5af00a3350 0x7f5af00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.784+0000 7f5b077fe640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5af00a3350 0x7f5af00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.784+0000 7f5b057fa640 1 -- 172.21.15.18:0/862908823 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f5af80cead0 con 0x7f5b08102d30 2024-09-19T09:50:45.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.784+0000 7f5b077fe640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5af00a3350 0x7f5af00a5810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5b08102420 tx=0x7f5afc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:45.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.788+0000 7f5b057fa640 1 -- 172.21.15.18:0/862908823 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5af809b950 con 0x7f5b08102d30 2024-09-19T09:50:45.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:45 smithi049 ceph-mon[34858]: pgmap v289: 97 pgs: 97 active+clean; 592 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.2 KiB/s wr, 20 op/s 2024-09-19T09:50:45.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:45 smithi049 ceph-mon[34858]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:50:45.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:45 smithi049 ceph-mon[34858]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:45.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:45 smithi162 ceph-mon[35174]: pgmap v289: 97 pgs: 97 active+clean; 592 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.2 KiB/s wr, 20 op/s 2024-09-19T09:50:45.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:45 smithi162 ceph-mon[35174]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:50:45.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:45 smithi162 ceph-mon[35174]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:45.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.994+0000 7f5b0e617640 1 -- 172.21.15.18:0/862908823 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f5b08062630 con 0x7f5af00a3350 2024-09-19T09:50:46.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:45.999+0000 7f5b057fa640 1 -- 172.21.15.18:0/862908823 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5b08062630 con 0x7f5af00a3350 2024-09-19T09:50:46.002 INFO:teuthology.orchestra.run.smithi018.stdout:/volumes/qa/sv_0/bf2ab9b6-6acf-48ff-80fb-7f69a71df16f 2024-09-19T09:50:46.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 -- 172.21.15.18:0/862908823 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5af00a3350 msgr2=0x7f5af00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:46.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5af00a3350 0x7f5af00a5810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5b08102420 tx=0x7f5afc00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:50:46.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 -- 172.21.15.18:0/862908823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b08102d30 msgr2=0x7f5b08100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:46.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b08102d30 0x7f5b08100990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5af800b4a0 tx=0x7f5af800b960 comp rx=0 tx=0).stop 2024-09-19T09:50:46.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 -- 172.21.15.18:0/862908823 shutdown_connections 2024-09-19T09:50:46.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5af00a3350 0x7f5af00a5810 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:46.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b081082a0 0x7f5b08101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:46.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b081036e0 0x7f5b08100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:46.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 --2- 172.21.15.18:0/862908823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b08102d30 0x7f5b08100990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:46.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 -- 172.21.15.18:0/862908823 >> 172.21.15.18:0/862908823 conn(0x7f5b080fc7d0 msgr2=0x7f5b08105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:46.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 -- 172.21.15.18:0/862908823 shutdown_connections 2024-09-19T09:50:46.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:46.001+0000 7f5b0e617640 1 -- 172.21.15.18:0/862908823 wait complete. 2024-09-19T09:50:46.624 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:46 smithi018 ceph-mon[30956]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:46.653 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T09:50:46.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:46 smithi049 ceph-mon[34858]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:46.910 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:46.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:46 smithi162 ceph-mon[35174]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:47.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.312+0000 7f7dda9a0640 1 -- 172.21.15.18:0/2753241525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd4100980 msgr2=0x7f7dd4100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:47.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.312+0000 7f7dda9a0640 1 --2- 172.21.15.18:0/2753241525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd4100980 0x7f7dd4100d60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009900 tx=0x7f7dd002a470 comp rx=0 tx=0).stop 2024-09-19T09:50:47.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.312+0000 7f7dda9a0640 1 -- 172.21.15.18:0/2753241525 shutdown_connections 2024-09-19T09:50:47.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.312+0000 7f7dda9a0640 1 --2- 172.21.15.18:0/2753241525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd4105d90 0x7f7dd4106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.312+0000 7f7dda9a0640 1 --2- 172.21.15.18:0/2753241525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dd41012a0 0x7f7dd4105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.312+0000 7f7dda9a0640 1 --2- 172.21.15.18:0/2753241525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd4100980 0x7f7dd4100d60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.312+0000 7f7dda9a0640 1 -- 172.21.15.18:0/2753241525 >> 172.21.15.18:0/2753241525 conn(0x7f7dd40fc610 msgr2=0x7f7dd40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.312+0000 7f7dda9a0640 1 -- 172.21.15.18:0/2753241525 shutdown_connections 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.312+0000 7f7dda9a0640 1 -- 172.21.15.18:0/2753241525 wait complete. 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dda9a0640 1 Processor -- start 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dda9a0640 1 -- start start 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dda9a0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd4100980 0x7f7dd419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dda9a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd41012a0 0x7f7dd419f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dda9a0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dd4105d90 0x7f7dd41a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dda9a0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4118490 con 0x7f7dd4100980 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dda9a0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4118310 con 0x7f7dd41012a0 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dda9a0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4118610 con 0x7f7dd4105d90 2024-09-19T09:50:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dd999e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd4100980 0x7f7dd419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:47.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dd999e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd4100980 0x7f7dd419eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60840/0 (socket says 172.21.15.18:60840) 2024-09-19T09:50:47.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dd999e640 1 -- 172.21.15.18:0/3163988971 learned_addr learned my addr 172.21.15.18:0/3163988971 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:47.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.313+0000 7f7dd919d640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd41012a0 0x7f7dd419f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:47.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dda19f640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dd4105d90 0x7f7dd41a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:47.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dd999e640 1 -- 172.21.15.18:0/3163988971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dd4105d90 msgr2=0x7f7dd41a3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:47.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dd999e640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dd4105d90 0x7f7dd41a3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dd999e640 1 -- 172.21.15.18:0/3163988971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd41012a0 msgr2=0x7f7dd419f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dd999e640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd41012a0 0x7f7dd419f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dd999e640 1 -- 172.21.15.18:0/3163988971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd41a3b30 con 0x7f7dd4100980 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dd999e640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd4100980 0x7f7dd419eb00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0005ab0 tx=0x7f7dd00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dcaffd640 1 -- 172.21.15.18:0/3163988971 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd003f030 con 0x7f7dd4100980 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dda9a0640 1 -- 172.21.15.18:0/3163988971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd41a3dc0 con 0x7f7dd4100980 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dcaffd640 1 -- 172.21.15.18:0/3163988971 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dd0003ce0 con 0x7f7dd4100980 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dcaffd640 1 -- 172.21.15.18:0/3163988971 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0035070 con 0x7f7dd4100980 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.314+0000 7f7dda9a0640 1 -- 172.21.15.18:0/3163988971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd41ab6b0 con 0x7f7dd4100980 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.315+0000 7f7dda9a0640 1 -- 172.21.15.18:0/3163988971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd41057f0 con 0x7f7dd4100980 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.317+0000 7f7dcaffd640 1 -- 172.21.15.18:0/3163988971 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7dd0042030 con 0x7f7dd4100980 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.317+0000 7f7dcaffd640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7dc00a32d0 0x7f7dc00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:47.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.317+0000 7f7dd919d640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7dc00a32d0 0x7f7dc00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:47.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.317+0000 7f7dcaffd640 1 -- 172.21.15.18:0/3163988971 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f7dd00f01e0 con 0x7f7dd4100980 2024-09-19T09:50:47.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.318+0000 7f7dd919d640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7dc00a32d0 0x7f7dc00a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ffc00 tx=0x7f7dc4009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:47.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.321+0000 7f7dcaffd640 1 -- 172.21.15.18:0/3163988971 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7dd00bcf50 con 0x7f7dd4100980 2024-09-19T09:50:47.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.526+0000 7f7dda9a0640 1 -- 172.21.15.18:0/3163988971 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7dd410fc60 con 0x7f7dc00a32d0 2024-09-19T09:50:47.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.553+0000 7f7dcaffd640 1 -- 172.21.15.18:0/3163988971 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7dd410fc60 con 0x7f7dc00a32d0 2024-09-19T09:50:47.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.555+0000 7f7dda9a0640 1 -- 172.21.15.18:0/3163988971 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7dc00a32d0 msgr2=0x7f7dc00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:47.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.555+0000 7f7dda9a0640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7dc00a32d0 0x7f7dc00a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ffc00 tx=0x7f7dc4009060 comp rx=0 tx=0).stop 2024-09-19T09:50:47.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.555+0000 7f7dda9a0640 1 -- 172.21.15.18:0/3163988971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd4100980 msgr2=0x7f7dd419eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:47.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.555+0000 7f7dda9a0640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd4100980 0x7f7dd419eb00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0005ab0 tx=0x7f7dd00042f0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.555+0000 7f7dda9a0640 1 -- 172.21.15.18:0/3163988971 shutdown_connections 2024-09-19T09:50:47.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.555+0000 7f7dda9a0640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7dc00a32d0 0x7f7dc00a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.555+0000 7f7dda9a0640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dd4105d90 0x7f7dd41a3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.555+0000 7f7dda9a0640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7dd41012a0 0x7f7dd419f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.555+0000 7f7dda9a0640 1 --2- 172.21.15.18:0/3163988971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd4100980 0x7f7dd419eb00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:47.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.555+0000 7f7dda9a0640 1 -- 172.21.15.18:0/3163988971 >> 172.21.15.18:0/3163988971 conn(0x7f7dd40fc610 msgr2=0x7f7dd410f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:47.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.556+0000 7f7dda9a0640 1 -- 172.21.15.18:0/3163988971 shutdown_connections 2024-09-19T09:50:47.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:47.556+0000 7f7dda9a0640 1 -- 172.21.15.18:0/3163988971 wait complete. 2024-09-19T09:50:47.568 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:47 smithi018 ceph-mon[30956]: pgmap v290: 97 pgs: 97 active+clean; 592 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.0 KiB/s wr, 20 op/s 2024-09-19T09:50:47.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:47 smithi049 ceph-mon[34858]: pgmap v290: 97 pgs: 97 active+clean; 592 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.0 KiB/s wr, 20 op/s 2024-09-19T09:50:47.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:47 smithi162 ceph-mon[35174]: pgmap v290: 97 pgs: 97 active+clean; 592 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.0 KiB/s wr, 20 op/s 2024-09-19T09:50:48.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T09:50:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:48.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:48 smithi018 ceph-mon[30956]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:48.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:48 smithi049 ceph-mon[34858]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:48.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:48 smithi162 ceph-mon[35174]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:48.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.979+0000 7f813c198640 1 -- 172.21.15.18:0/895602543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8134100e20 msgr2=0x7f8134101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.979+0000 7f813c198640 1 --2- 172.21.15.18:0/895602543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8134100e20 0x7f8134101200 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8130009900 tx=0x7f813002a480 comp rx=0 tx=0).stop 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.979+0000 7f813c198640 1 -- 172.21.15.18:0/895602543 shutdown_connections 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.979+0000 7f813c198640 1 --2- 172.21.15.18:0/895602543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8134102ef0 0x7f813410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.979+0000 7f813c198640 1 --2- 172.21.15.18:0/895602543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8134102570 0x7f81341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.979+0000 7f813c198640 1 --2- 172.21.15.18:0/895602543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8134100e20 0x7f8134101200 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.979+0000 7f813c198640 1 -- 172.21.15.18:0/895602543 >> 172.21.15.18:0/895602543 conn(0x7f81340fc7d0 msgr2=0x7f81340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.979+0000 7f813c198640 1 -- 172.21.15.18:0/895602543 shutdown_connections 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.979+0000 7f813c198640 1 -- 172.21.15.18:0/895602543 wait complete. 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.979+0000 7f813c198640 1 Processor -- start 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f813c198640 1 -- start start 2024-09-19T09:50:48.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f813c198640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8134100e20 0x7f81341994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f813c198640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8134102570 0x7f81341999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f813c198640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8134102ef0 0x7f81341a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f813c198640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8134111070 con 0x7f8134102570 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f813c198640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8134110ef0 con 0x7f8134102ef0 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f813c198640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f81341111f0 con 0x7f8134100e20 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f8139733640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8134102570 0x7f81341999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f8139733640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8134102570 0x7f81341999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60856/0 (socket says 172.21.15.18:60856) 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f8139733640 1 -- 172.21.15.18:0/4131872007 learned_addr learned my addr 172.21.15.18:0/4131872007 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f813a735640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8134102ef0 0x7f81341a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f8139f34640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8134100e20 0x7f81341994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f8139733640 1 -- 172.21.15.18:0/4131872007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8134100e20 msgr2=0x7f81341994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f8139733640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8134100e20 0x7f81341994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f8139733640 1 -- 172.21.15.18:0/4131872007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8134102ef0 msgr2=0x7f81341a4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f8139733640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8134102ef0 0x7f81341a4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f8139733640 1 -- 172.21.15.18:0/4131872007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81341a4a60 con 0x7f8134102570 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f813a735640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8134102ef0 0x7f81341a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.980+0000 7f8139733640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8134102570 0x7f81341999e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f812400b4a0 tx=0x7f812400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.981+0000 7f812affd640 1 -- 172.21.15.18:0/4131872007 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124014070 con 0x7f8134102570 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.981+0000 7f812affd640 1 -- 172.21.15.18:0/4131872007 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8124010af0 con 0x7f8134102570 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.981+0000 7f813c198640 1 -- 172.21.15.18:0/4131872007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81341a4c30 con 0x7f8134102570 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.981+0000 7f812affd640 1 -- 172.21.15.18:0/4131872007 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124017d10 con 0x7f8134102570 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.981+0000 7f813c198640 1 -- 172.21.15.18:0/4131872007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81341a50f0 con 0x7f8134102570 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.982+0000 7f813c198640 1 -- 172.21.15.18:0/4131872007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8134101280 con 0x7f8134102570 2024-09-19T09:50:48.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.983+0000 7f812affd640 1 -- 172.21.15.18:0/4131872007 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8124017070 con 0x7f8134102570 2024-09-19T09:50:48.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.983+0000 7f812affd640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f81200a32d0 0x7f81200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:48.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.984+0000 7f8139f34640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f81200a32d0 0x7f81200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:48.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.984+0000 7f812affd640 1 -- 172.21.15.18:0/4131872007 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f81240ced60 con 0x7f8134102570 2024-09-19T09:50:48.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.984+0000 7f8139f34640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f81200a32d0 0x7f81200a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8130000c00 tx=0x7f8130005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:48.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:48.988+0000 7f812affd640 1 -- 172.21.15.18:0/4131872007 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f812409bae0 con 0x7f8134102570 2024-09-19T09:50:49.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.192+0000 7f813c198640 1 -- 172.21.15.18:0/4131872007 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f8134109100 con 0x7f81200a32d0 2024-09-19T09:50:49.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.198+0000 7f812affd640 1 -- 172.21.15.18:0/4131872007 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8130004330 con 0x7f81200a32d0 2024-09-19T09:50:49.201 INFO:teuthology.orchestra.run.smithi018.stdout:/volumes/qa/sv_1/f6f4fc47-84bb-421e-b05b-f5ce55d47ab2 2024-09-19T09:50:49.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 -- 172.21.15.18:0/4131872007 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f81200a32d0 msgr2=0x7f81200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:49.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f81200a32d0 0x7f81200a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8130000c00 tx=0x7f8130005a20 comp rx=0 tx=0).stop 2024-09-19T09:50:49.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 -- 172.21.15.18:0/4131872007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8134102570 msgr2=0x7f81341999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:49.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8134102570 0x7f81341999e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f812400b4a0 tx=0x7f812400b960 comp rx=0 tx=0).stop 2024-09-19T09:50:49.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 -- 172.21.15.18:0/4131872007 shutdown_connections 2024-09-19T09:50:49.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f81200a32d0 0x7f81200a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8134102ef0 0x7f81341a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8134102570 0x7f81341999e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 --2- 172.21.15.18:0/4131872007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8134100e20 0x7f81341994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:49.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 -- 172.21.15.18:0/4131872007 >> 172.21.15.18:0/4131872007 conn(0x7f81340fc7d0 msgr2=0x7f81340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:49.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 -- 172.21.15.18:0/4131872007 shutdown_connections 2024-09-19T09:50:49.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:49.200+0000 7f813c198640 1 -- 172.21.15.18:0/4131872007 wait complete. 2024-09-19T09:50:49.603 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:49 smithi018 ceph-mon[30956]: pgmap v291: 97 pgs: 97 active+clean; 592 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-19T09:50:49.603 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:49 smithi018 ceph-mon[30956]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:49.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:49 smithi049 ceph-mon[34858]: pgmap v291: 97 pgs: 97 active+clean; 592 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-19T09:50:49.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:49 smithi049 ceph-mon[34858]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:49.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:49 smithi162 ceph-mon[35174]: pgmap v291: 97 pgs: 97 active+clean; 592 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.9 KiB/s wr, 20 op/s 2024-09-19T09:50:49.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:49 smithi162 ceph-mon[35174]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:50:49.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:50:50.208 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.648+0000 7fd86a432640 1 -- 172.21.15.18:0/1553139645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd864100480 msgr2=0x7fd864100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:50.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.648+0000 7fd86a432640 1 --2- 172.21.15.18:0/1553139645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd864100480 0x7fd864100860 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd854009900 tx=0x7fd85402a410 comp rx=0 tx=0).stop 2024-09-19T09:50:50.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.648+0000 7fd86a432640 1 -- 172.21.15.18:0/1553139645 shutdown_connections 2024-09-19T09:50:50.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.648+0000 7fd86a432640 1 --2- 172.21.15.18:0/1553139645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8641055b0 0x7fd86410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:50.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.648+0000 7fd86a432640 1 --2- 172.21.15.18:0/1553139645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd864100e30 0x7fd864104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:50.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.648+0000 7fd86a432640 1 --2- 172.21.15.18:0/1553139645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd864100480 0x7fd864100860 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:50.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.648+0000 7fd86a432640 1 -- 172.21.15.18:0/1553139645 >> 172.21.15.18:0/1553139645 conn(0x7fd864077210 msgr2=0x7fd8640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:50.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.648+0000 7fd86a432640 1 -- 172.21.15.18:0/1553139645 shutdown_connections 2024-09-19T09:50:50.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.648+0000 7fd86a432640 1 -- 172.21.15.18:0/1553139645 wait complete. 2024-09-19T09:50:50.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd86a432640 1 Processor -- start 2024-09-19T09:50:50.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd86a432640 1 -- start start 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd86a432640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd864100480 0x7fd864198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd86a432640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864100e30 0x7fd8641989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd86a432640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8641055b0 0x7fd86419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd86a432640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd86410fd90 con 0x7fd864100480 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd86a432640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd86410fc10 con 0x7fd864100e30 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd86a432640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd86410ff10 con 0x7fd8641055b0 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd863fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd864100480 0x7fd864198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd863fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd864100480 0x7fd864198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60872/0 (socket says 172.21.15.18:60872) 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.649+0000 7fd863fff640 1 -- 172.21.15.18:0/683009984 learned_addr learned my addr 172.21.15.18:0/683009984 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd8637fe640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864100e30 0x7fd8641989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd8689cf640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8641055b0 0x7fd86419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd863fff640 1 -- 172.21.15.18:0/683009984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8641055b0 msgr2=0x7fd86419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd863fff640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8641055b0 0x7fd86419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd863fff640 1 -- 172.21.15.18:0/683009984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864100e30 msgr2=0x7fd8641989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd863fff640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864100e30 0x7fd8641989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd863fff640 1 -- 172.21.15.18:0/683009984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86419d420 con 0x7fd864100480 2024-09-19T09:50:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd863fff640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd864100480 0x7fd864198470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd854006010 tx=0x7fd8540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd8617fa640 1 -- 172.21.15.18:0/683009984 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85403f030 con 0x7fd864100480 2024-09-19T09:50:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd86a432640 1 -- 172.21.15.18:0/683009984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86419d6b0 con 0x7fd864100480 2024-09-19T09:50:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd8617fa640 1 -- 172.21.15.18:0/683009984 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd854003ce0 con 0x7fd864100480 2024-09-19T09:50:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd8617fa640 1 -- 172.21.15.18:0/683009984 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854035070 con 0x7fd864100480 2024-09-19T09:50:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.650+0000 7fd86a432640 1 -- 172.21.15.18:0/683009984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8641a4ff0 con 0x7fd864100480 2024-09-19T09:50:50.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.652+0000 7fd86a432640 1 -- 172.21.15.18:0/683009984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd864101960 con 0x7fd864100480 2024-09-19T09:50:50.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.652+0000 7fd8617fa640 1 -- 172.21.15.18:0/683009984 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd854042030 con 0x7fd864100480 2024-09-19T09:50:50.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.653+0000 7fd8617fa640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd84c0a32d0 0x7fd84c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:50.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.654+0000 7fd8637fe640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd84c0a32d0 0x7fd84c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:50.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.654+0000 7fd8617fa640 1 -- 172.21.15.18:0/683009984 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fd8540efb20 con 0x7fd864100480 2024-09-19T09:50:50.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.654+0000 7fd8637fe640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd84c0a32d0 0x7fd84c0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd8640ff990 tx=0x7fd85800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:50.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.658+0000 7fd8617fa640 1 -- 172.21.15.18:0/683009984 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd8540bc850 con 0x7fd864100480 2024-09-19T09:50:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.868+0000 7fd86a432640 1 -- 172.21.15.18:0/683009984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd86410a7a0 con 0x7fd864100480 2024-09-19T09:50:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.869+0000 7fd8617fa640 1 -- 172.21.15.18:0/683009984 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11954 (secure 0 0 0) 0x7fd8540bc150 con 0x7fd864100480 2024-09-19T09:50:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:50.872 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"btime":"2024-09-19T09:50:41:339962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:50:41.339939+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[24488,24484,24470,24524,14592]},"id":1}]} 2024-09-19T09:50:50.872 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-09-19T09:50:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 -- 172.21.15.18:0/683009984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd84c0a32d0 msgr2=0x7fd84c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd84c0a32d0 0x7fd84c0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd8640ff990 tx=0x7fd85800b390 comp rx=0 tx=0).stop 2024-09-19T09:50:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 -- 172.21.15.18:0/683009984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd864100480 msgr2=0x7fd864198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd864100480 0x7fd864198470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd854006010 tx=0x7fd8540042f0 comp rx=0 tx=0).stop 2024-09-19T09:50:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 -- 172.21.15.18:0/683009984 shutdown_connections 2024-09-19T09:50:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd84c0a32d0 0x7fd84c0a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8641055b0 0x7fd86419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd864100e30 0x7fd8641989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 --2- 172.21.15.18:0/683009984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd864100480 0x7fd864198470 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 -- 172.21.15.18:0/683009984 >> 172.21.15.18:0/683009984 conn(0x7fd864077210 msgr2=0x7fd864103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 -- 172.21.15.18:0/683009984 shutdown_connections 2024-09-19T09:50:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:50.871+0000 7fd86a432640 1 -- 172.21.15.18:0/683009984 wait complete. 2024-09-19T09:50:51.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:50:51.681 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:51 smithi018 ceph-mon[30956]: pgmap v292: 97 pgs: 97 active+clean; 624 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.8 KiB/s wr, 24 op/s 2024-09-19T09:50:51.681 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:51 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/683009984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:51.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:51 smithi049 ceph-mon[34858]: pgmap v292: 97 pgs: 97 active+clean; 624 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.8 KiB/s wr, 24 op/s 2024-09-19T09:50:51.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:51 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/683009984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:51.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:51 smithi162 ceph-mon[35174]: pgmap v292: 97 pgs: 97 active+clean; 624 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.8 KiB/s wr, 24 op/s 2024-09-19T09:50:51.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:51 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/683009984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:50:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:52.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.341+0000 7f24c1847640 1 -- 172.21.15.18:0/1551940427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24bc100a80 msgr2=0x7f24bc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.341+0000 7f24c1847640 1 --2- 172.21.15.18:0/1551940427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24bc100a80 0x7f24bc100ee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009930 tx=0x7f24a402a420 comp rx=0 tx=0).stop 2024-09-19T09:50:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.341+0000 7f24c1847640 1 -- 172.21.15.18:0/1551940427 shutdown_connections 2024-09-19T09:50:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.341+0000 7f24c1847640 1 --2- 172.21.15.18:0/1551940427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24bc101420 0x7f24bc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.341+0000 7f24c1847640 1 --2- 172.21.15.18:0/1551940427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24bc100a80 0x7f24bc100ee0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.341+0000 7f24c1847640 1 --2- 172.21.15.18:0/1551940427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24bc106a80 0x7f24bc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.341+0000 7f24c1847640 1 -- 172.21.15.18:0/1551940427 >> 172.21.15.18:0/1551940427 conn(0x7f24bc0fc7a0 msgr2=0x7f24bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.341+0000 7f24c1847640 1 -- 172.21.15.18:0/1551940427 shutdown_connections 2024-09-19T09:50:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.341+0000 7f24c1847640 1 -- 172.21.15.18:0/1551940427 wait complete. 2024-09-19T09:50:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.341+0000 7f24c1847640 1 Processor -- start 2024-09-19T09:50:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24c1847640 1 -- start start 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24c1847640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24bc100a80 0x7f24bc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24c1847640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24bc101420 0x7f24bc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24c1847640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24bc106a80 0x7f24bc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24c1847640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc111f40 con 0x7f24bc101420 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24c1847640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc111dc0 con 0x7f24bc106a80 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24c1847640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1120c0 con 0x7f24bc100a80 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24ba7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24bc101420 0x7f24bc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24ba7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24bc101420 0x7f24bc198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60894/0 (socket says 172.21.15.18:60894) 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24ba7fc640 1 -- 172.21.15.18:0/1273040847 learned_addr learned my addr 172.21.15.18:0/1273040847 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24baffd640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24bc100a80 0x7f24bc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24bb7fe640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24bc106a80 0x7f24bc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24ba7fc640 1 -- 172.21.15.18:0/1273040847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24bc100a80 msgr2=0x7f24bc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24ba7fc640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24bc100a80 0x7f24bc198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24ba7fc640 1 -- 172.21.15.18:0/1273040847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24bc106a80 msgr2=0x7f24bc19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24ba7fc640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24bc106a80 0x7f24bc19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24ba7fc640 1 -- 172.21.15.18:0/1273040847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc19d3d0 con 0x7f24bc101420 2024-09-19T09:50:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.342+0000 7f24baffd640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24bc100a80 0x7f24bc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:50:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.343+0000 7f24ba7fc640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24bc101420 0x7f24bc198960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009230 tx=0x7f24a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.343+0000 7f24c0845640 1 -- 172.21.15.18:0/1273040847 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a403f030 con 0x7f24bc101420 2024-09-19T09:50:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.343+0000 7f24c0845640 1 -- 172.21.15.18:0/1273040847 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24a4003ad0 con 0x7f24bc101420 2024-09-19T09:50:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.343+0000 7f24c1847640 1 -- 172.21.15.18:0/1273040847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc19d660 con 0x7f24bc101420 2024-09-19T09:50:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.343+0000 7f24c0845640 1 -- 172.21.15.18:0/1273040847 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4035070 con 0x7f24bc101420 2024-09-19T09:50:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.343+0000 7f24c1847640 1 -- 172.21.15.18:0/1273040847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc1a4fa0 con 0x7f24bc101420 2024-09-19T09:50:52.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.344+0000 7f24c1847640 1 -- 172.21.15.18:0/1273040847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24bc1021c0 con 0x7f24bc101420 2024-09-19T09:50:52.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.345+0000 7f24c0845640 1 -- 172.21.15.18:0/1273040847 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f24a4042030 con 0x7f24bc101420 2024-09-19T09:50:52.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.346+0000 7f24c0845640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f24a80a3350 0x7f24a80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:52.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.346+0000 7f24baffd640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f24a80a3350 0x7f24a80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:52.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.346+0000 7f24c0845640 1 -- 172.21.15.18:0/1273040847 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f24a40eff30 con 0x7f24bc101420 2024-09-19T09:50:52.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.346+0000 7f24baffd640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f24a80a3350 0x7f24a80a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f24ac005e10 tx=0x7f24ac005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:52.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.350+0000 7f24c0845640 1 -- 172.21.15.18:0/1273040847 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f24a40bcba0 con 0x7f24bc101420 2024-09-19T09:50:52.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.532+0000 7f24c1847640 1 -- 172.21.15.18:0/1273040847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24bc1a5200 con 0x7f24bc101420 2024-09-19T09:50:52.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.533+0000 7f24c0845640 1 -- 172.21.15.18:0/1273040847 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22240 (secure 0 0 0) 0x7f24a40bc4a0 con 0x7f24bc101420 2024-09-19T09:50:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:52.537 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:50:29.937394+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.535+0000 7f24c1847640 1 -- 172.21.15.18:0/1273040847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f24a80a3350 msgr2=0x7f24a80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.535+0000 7f24c1847640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f24a80a3350 0x7f24a80a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f24ac005e10 tx=0x7f24ac005da0 comp rx=0 tx=0).stop 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.535+0000 7f24c1847640 1 -- 172.21.15.18:0/1273040847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24bc101420 msgr2=0x7f24bc198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.535+0000 7f24c1847640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24bc101420 0x7f24bc198960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009230 tx=0x7f24a4004270 comp rx=0 tx=0).stop 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.536+0000 7f24c1847640 1 -- 172.21.15.18:0/1273040847 shutdown_connections 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.536+0000 7f24c1847640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f24a80a3350 0x7f24a80a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.536+0000 7f24c1847640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24bc106a80 0x7f24bc19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.536+0000 7f24c1847640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24bc101420 0x7f24bc198960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.536+0000 7f24c1847640 1 --2- 172.21.15.18:0/1273040847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24bc100a80 0x7f24bc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.536+0000 7f24c1847640 1 -- 172.21.15.18:0/1273040847 >> 172.21.15.18:0/1273040847 conn(0x7f24bc0fc7a0 msgr2=0x7f24bc0fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.536+0000 7f24c1847640 1 -- 172.21.15.18:0/1273040847 shutdown_connections 2024-09-19T09:50:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:52.536+0000 7f24c1847640 1 -- 172.21.15.18:0/1273040847 wait complete. 2024-09-19T09:50:53.130 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:50:53.130 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:50:53.432 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:53.689 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:53 smithi018 ceph-mon[30956]: pgmap v293: 97 pgs: 97 active+clean; 624 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-09-19T09:50:53.689 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:53 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1273040847' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:50:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.855+0000 7f61cb827640 1 -- 172.21.15.18:0/2394014462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4102d40 msgr2=0x7f61c4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.855+0000 7f61cb827640 1 --2- 172.21.15.18:0/2394014462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4102d40 0x7f61c4103120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009900 tx=0x7f61c002a480 comp rx=0 tx=0).stop 2024-09-19T09:50:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.855+0000 7f61cb827640 1 -- 172.21.15.18:0/2394014462 shutdown_connections 2024-09-19T09:50:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.855+0000 7f61cb827640 1 --2- 172.21.15.18:0/2394014462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c410c170 0x7f61c410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.855+0000 7f61cb827640 1 --2- 172.21.15.18:0/2394014462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c4103660 0x7f61c410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.855+0000 7f61cb827640 1 --2- 172.21.15.18:0/2394014462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4102d40 0x7f61c4103120 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.855+0000 7f61cb827640 1 -- 172.21.15.18:0/2394014462 >> 172.21.15.18:0/2394014462 conn(0x7f61c40fc7a0 msgr2=0x7f61c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.855+0000 7f61cb827640 1 -- 172.21.15.18:0/2394014462 shutdown_connections 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.855+0000 7f61cb827640 1 -- 172.21.15.18:0/2394014462 wait complete. 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61cb827640 1 Processor -- start 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61cb827640 1 -- start start 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61cb827640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4102d40 0x7f61c41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61cb827640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4103660 0x7f61c4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61cb827640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410c170 0x7f61c419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61cb827640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61c4111fb0 con 0x7f61c4102d40 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61cb827640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61c4111e30 con 0x7f61c410c170 2024-09-19T09:50:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61cb827640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61c4112130 con 0x7f61c4103660 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61c95c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4102d40 0x7f61c41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61c95c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4102d40 0x7f61c41984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60916/0 (socket says 172.21.15.18:60916) 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61c95c3640 1 -- 172.21.15.18:0/1261476108 learned_addr learned my addr 172.21.15.18:0/1261476108 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.856+0000 7f61c9dc4640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410c170 0x7f61c419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61c95c3640 1 -- 172.21.15.18:0/1261476108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4103660 msgr2=0x7f61c4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61c8dc2640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4103660 0x7f61c4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61c95c3640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4103660 0x7f61c4198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61c95c3640 1 -- 172.21.15.18:0/1261476108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410c170 msgr2=0x7f61c419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61c95c3640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410c170 0x7f61c419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61c95c3640 1 -- 172.21.15.18:0/1261476108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c419d470 con 0x7f61c4102d40 2024-09-19T09:50:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61c9dc4640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410c170 0x7f61c419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61c95c3640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4102d40 0x7f61c41984c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61c0005ab0 tx=0x7f61c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61ba7fc640 1 -- 172.21.15.18:0/1261476108 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c003f030 con 0x7f61c4102d40 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61cb827640 1 -- 172.21.15.18:0/1261476108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c419d700 con 0x7f61c4102d40 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61ba7fc640 1 -- 172.21.15.18:0/1261476108 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c0003ce0 con 0x7f61c4102d40 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61ba7fc640 1 -- 172.21.15.18:0/1261476108 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0035070 con 0x7f61c4102d40 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.857+0000 7f61cb827640 1 -- 172.21.15.18:0/1261476108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c41a5040 con 0x7f61c4102d40 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.858+0000 7f61cb827640 1 -- 172.21.15.18:0/1261476108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c406b070 con 0x7f61c4102d40 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.859+0000 7f61ba7fc640 1 -- 172.21.15.18:0/1261476108 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f61c0042030 con 0x7f61c4102d40 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.860+0000 7f61ba7fc640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a32d0 0x7f61b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.860+0000 7f61c8dc2640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a32d0 0x7f61b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.860+0000 7f61ba7fc640 1 -- 172.21.15.18:0/1261476108 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f61c00f0560 con 0x7f61c4102d40 2024-09-19T09:50:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.860+0000 7f61c8dc2640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a32d0 0x7f61b00a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61c40feda0 tx=0x7f61b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:53.863+0000 7f61ba7fc640 1 -- 172.21.15.18:0/1261476108 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f61c00bd250 con 0x7f61c4102d40 2024-09-19T09:50:53.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:53 smithi049 ceph-mon[34858]: pgmap v293: 97 pgs: 97 active+clean; 624 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-09-19T09:50:53.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:53 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1273040847' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:50:53.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:53 smithi162 ceph-mon[35174]: pgmap v293: 97 pgs: 97 active+clean; 624 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2024-09-19T09:50:53.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:53 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1273040847' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:50:54.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.040+0000 7f61cb827640 1 -- 172.21.15.18:0/1261476108 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61c4107280 con 0x7f61b00a32d0 2024-09-19T09:50:54.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.048+0000 7f61ba7fc640 1 -- 172.21.15.18:0/1261476108 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258744 (secure 0 0 0) 0x7f61b400a4a0 con 0x7f61b00a32d0 2024-09-19T09:50:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:54.055 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:50:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 -- 172.21.15.18:0/1261476108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a32d0 msgr2=0x7f61b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a32d0 0x7f61b00a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61c40feda0 tx=0x7f61b4008040 comp rx=0 tx=0).stop 2024-09-19T09:50:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 -- 172.21.15.18:0/1261476108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4102d40 msgr2=0x7f61c41984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4102d40 0x7f61c41984c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61c0005ab0 tx=0x7f61c00042f0 comp rx=0 tx=0).stop 2024-09-19T09:50:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 -- 172.21.15.18:0/1261476108 shutdown_connections 2024-09-19T09:50:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a32d0 0x7f61b00a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410c170 0x7f61c419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4103660 0x7f61c4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 --2- 172.21.15.18:0/1261476108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4102d40 0x7f61c41984c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 -- 172.21.15.18:0/1261476108 >> 172.21.15.18:0/1261476108 conn(0x7f61c40fc7a0 msgr2=0x7f61c40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 -- 172.21.15.18:0/1261476108 shutdown_connections 2024-09-19T09:50:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:54.051+0000 7f61cb827640 1 -- 172.21.15.18:0/1261476108 wait complete. 2024-09-19T09:50:54.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:54 smithi018 ceph-mon[30956]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:50:54.658 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-19T09:50:52.346242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638875,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":254,"num_read_kb":228,"num_write":409,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336,"ondisk_log_size":336,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374324,"kb_used_data":12596,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567500,"statfs":{"total":1151940427776,"available":1151557120000,"internally_reserved":0,"allocated":12898304,"data_stored":7029680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44091,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":127,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002983"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350952+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:50:30.350952+0000","last_peered":"2024-09-19T09:50:30.350952+0000","last_clean":"2024-09-19T09:50:30.350952+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:50:30.350952+0000","last_undegraded":"2024-09-19T09:50:30.350952+0000","last_fullsized":"2024-09-19T09:50:30.350952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365706+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:50:30.365706+0000","last_peered":"2024-09-19T09:50:30.365706+0000","last_clean":"2024-09-19T09:50:30.365706+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:50:30.365706+0000","last_undegraded":"2024-09-19T09:50:30.365706+0000","last_fullsized":"2024-09-19T09:50:30.365706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365686+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:50:30.365686+0000","last_peered":"2024-09-19T09:50:30.365686+0000","last_clean":"2024-09-19T09:50:30.365686+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:50:30.365686+0000","last_undegraded":"2024-09-19T09:50:30.365686+0000","last_fullsized":"2024-09-19T09:50:30.365686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350884+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:50:30.350884+0000","last_peered":"2024-09-19T09:50:30.350884+0000","last_clean":"2024-09-19T09:50:30.350884+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:50:30.350884+0000","last_undegraded":"2024-09-19T09:50:30.350884+0000","last_fullsized":"2024-09-19T09:50:30.350884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363363+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:50:30.363363+0000","last_peered":"2024-09-19T09:50:30.363363+0000","last_clean":"2024-09-19T09:50:30.363363+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:50:30.363363+0000","last_undegraded":"2024-09-19T09:50:30.363363+0000","last_fullsized":"2024-09-19T09:50:30.363363+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361812+0000","last_change":"2024-09-19T09:50:29.355326+0000","last_active":"2024-09-19T09:50:30.361812+0000","last_peered":"2024-09-19T09:50:30.361812+0000","last_clean":"2024-09-19T09:50:30.361812+0000","last_became_active":"2024-09-19T09:50:29.353527+0000","last_became_peered":"2024-09-19T09:50:29.353527+0000","last_unstale":"2024-09-19T09:50:30.361812+0000","last_undegraded":"2024-09-19T09:50:30.361812+0000","last_fullsized":"2024-09-19T09:50:30.361812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:24.250263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364898+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:50:30.364898+0000","last_peered":"2024-09-19T09:50:30.364898+0000","last_clean":"2024-09-19T09:50:30.364898+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:50:30.364898+0000","last_undegraded":"2024-09-19T09:50:30.364898+0000","last_fullsized":"2024-09-19T09:50:30.364898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362061+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:50:30.362061+0000","last_peered":"2024-09-19T09:50:30.362061+0000","last_clean":"2024-09-19T09:50:30.362061+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:50:30.362061+0000","last_undegraded":"2024-09-19T09:50:30.362061+0000","last_fullsized":"2024-09-19T09:50:30.362061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365738+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:50:30.365738+0000","last_peered":"2024-09-19T09:50:30.365738+0000","last_clean":"2024-09-19T09:50:30.365738+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:50:30.365738+0000","last_undegraded":"2024-09-19T09:50:30.365738+0000","last_fullsized":"2024-09-19T09:50:30.365738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362476+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:50:30.362476+0000","last_peered":"2024-09-19T09:50:30.362476+0000","last_clean":"2024-09-19T09:50:30.362476+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:50:30.362476+0000","last_undegraded":"2024-09-19T09:50:30.362476+0000","last_fullsized":"2024-09-19T09:50:30.362476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367368+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:50:30.367368+0000","last_peered":"2024-09-19T09:50:30.367368+0000","last_clean":"2024-09-19T09:50:30.367368+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:50:30.367368+0000","last_undegraded":"2024-09-19T09:50:30.367368+0000","last_fullsized":"2024-09-19T09:50:30.367368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350960+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:50:30.350960+0000","last_peered":"2024-09-19T09:50:30.350960+0000","last_clean":"2024-09-19T09:50:30.350960+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:50:30.350960+0000","last_undegraded":"2024-09-19T09:50:30.350960+0000","last_fullsized":"2024-09-19T09:50:30.350960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350141+0000","last_change":"2024-09-19T09:50:29.353493+0000","last_active":"2024-09-19T09:50:30.350141+0000","last_peered":"2024-09-19T09:50:30.350141+0000","last_clean":"2024-09-19T09:50:30.350141+0000","last_became_active":"2024-09-19T09:50:29.353040+0000","last_became_peered":"2024-09-19T09:50:29.353040+0000","last_unstale":"2024-09-19T09:50:30.350141+0000","last_undegraded":"2024-09-19T09:50:30.350141+0000","last_fullsized":"2024-09-19T09:50:30.350141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:07.751702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365257+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:50:30.365257+0000","last_peered":"2024-09-19T09:50:30.365257+0000","last_clean":"2024-09-19T09:50:30.365257+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:50:30.365257+0000","last_undegraded":"2024-09-19T09:50:30.365257+0000","last_fullsized":"2024-09-19T09:50:30.365257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365019+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:50:30.365019+0000","last_peered":"2024-09-19T09:50:30.365019+0000","last_clean":"2024-09-19T09:50:30.365019+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:50:30.365019+0000","last_undegraded":"2024-09-19T09:50:30.365019+0000","last_fullsized":"2024-09-19T09:50:30.365019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364552+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:50:30.364552+0000","last_peered":"2024-09-19T09:50:30.364552+0000","last_clean":"2024-09-19T09:50:30.364552+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:50:30.364552+0000","last_undegraded":"2024-09-19T09:50:30.364552+0000","last_fullsized":"2024-09-19T09:50:30.364552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350989+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:50:30.350989+0000","last_peered":"2024-09-19T09:50:30.350989+0000","last_clean":"2024-09-19T09:50:30.350989+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:50:30.350989+0000","last_undegraded":"2024-09-19T09:50:30.350989+0000","last_fullsized":"2024-09-19T09:50:30.350989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361305+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:50:30.361305+0000","last_peered":"2024-09-19T09:50:30.361305+0000","last_clean":"2024-09-19T09:50:30.361305+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:50:30.361305+0000","last_undegraded":"2024-09-19T09:50:30.361305+0000","last_fullsized":"2024-09-19T09:50:30.361305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363634+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:50:30.363634+0000","last_peered":"2024-09-19T09:50:30.363634+0000","last_clean":"2024-09-19T09:50:30.363634+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:50:30.363634+0000","last_undegraded":"2024-09-19T09:50:30.363634+0000","last_fullsized":"2024-09-19T09:50:30.363634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350740+0000","last_change":"2024-09-19T09:50:29.352834+0000","last_active":"2024-09-19T09:50:30.350740+0000","last_peered":"2024-09-19T09:50:30.350740+0000","last_clean":"2024-09-19T09:50:30.350740+0000","last_became_active":"2024-09-19T09:50:29.352483+0000","last_became_peered":"2024-09-19T09:50:29.352483+0000","last_unstale":"2024-09-19T09:50:30.350740+0000","last_undegraded":"2024-09-19T09:50:30.350740+0000","last_fullsized":"2024-09-19T09:50:30.350740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:43.916024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350217+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:50:30.350217+0000","last_peered":"2024-09-19T09:50:30.350217+0000","last_clean":"2024-09-19T09:50:30.350217+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:50:30.350217+0000","last_undegraded":"2024-09-19T09:50:30.350217+0000","last_fullsized":"2024-09-19T09:50:30.350217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364926+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:50:30.364926+0000","last_peered":"2024-09-19T09:50:30.364926+0000","last_clean":"2024-09-19T09:50:30.364926+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:50:30.364926+0000","last_undegraded":"2024-09-19T09:50:30.364926+0000","last_fullsized":"2024-09-19T09:50:30.364926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361960+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:50:30.361960+0000","last_peered":"2024-09-19T09:50:30.361960+0000","last_clean":"2024-09-19T09:50:30.361960+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:50:30.361960+0000","last_undegraded":"2024-09-19T09:50:30.361960+0000","last_fullsized":"2024-09-19T09:50:30.361960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366668+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:50:30.366668+0000","last_peered":"2024-09-19T09:50:30.366668+0000","last_clean":"2024-09-19T09:50:30.366668+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:50:30.366668+0000","last_undegraded":"2024-09-19T09:50:30.366668+0000","last_fullsized":"2024-09-19T09:50:30.366668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361980+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:50:30.361980+0000","last_peered":"2024-09-19T09:50:30.361980+0000","last_clean":"2024-09-19T09:50:30.361980+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:50:30.361980+0000","last_undegraded":"2024-09-19T09:50:30.361980+0000","last_fullsized":"2024-09-19T09:50:30.361980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363189+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:50:30.363189+0000","last_peered":"2024-09-19T09:50:30.363189+0000","last_clean":"2024-09-19T09:50:30.363189+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:50:30.363189+0000","last_undegraded":"2024-09-19T09:50:30.363189+0000","last_fullsized":"2024-09-19T09:50:30.363189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350918+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:50:30.350918+0000","last_peered":"2024-09-19T09:50:30.350918+0000","last_clean":"2024-09-19T09:50:30.350918+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:50:30.350918+0000","last_undegraded":"2024-09-19T09:50:30.350918+0000","last_fullsized":"2024-09-19T09:50:30.350918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350297+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:50:30.350297+0000","last_peered":"2024-09-19T09:50:30.350297+0000","last_clean":"2024-09-19T09:50:30.350297+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:50:30.350297+0000","last_undegraded":"2024-09-19T09:50:30.350297+0000","last_fullsized":"2024-09-19T09:50:30.350297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365151+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:50:30.365151+0000","last_peered":"2024-09-19T09:50:30.365151+0000","last_clean":"2024-09-19T09:50:30.365151+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:50:30.365151+0000","last_undegraded":"2024-09-19T09:50:30.365151+0000","last_fullsized":"2024-09-19T09:50:30.365151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365091+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:50:30.365091+0000","last_peered":"2024-09-19T09:50:30.365091+0000","last_clean":"2024-09-19T09:50:30.365091+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:50:30.365091+0000","last_undegraded":"2024-09-19T09:50:30.365091+0000","last_fullsized":"2024-09-19T09:50:30.365091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362893+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:50:30.362893+0000","last_peered":"2024-09-19T09:50:30.362893+0000","last_clean":"2024-09-19T09:50:30.362893+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:50:30.362893+0000","last_undegraded":"2024-09-19T09:50:30.362893+0000","last_fullsized":"2024-09-19T09:50:30.362893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350596+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:50:30.350596+0000","last_peered":"2024-09-19T09:50:30.350596+0000","last_clean":"2024-09-19T09:50:30.350596+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:50:30.350596+0000","last_undegraded":"2024-09-19T09:50:30.350596+0000","last_fullsized":"2024-09-19T09:50:30.350596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363157+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:50:30.363157+0000","last_peered":"2024-09-19T09:50:30.363157+0000","last_clean":"2024-09-19T09:50:30.363157+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:50:30.363157+0000","last_undegraded":"2024-09-19T09:50:30.363157+0000","last_fullsized":"2024-09-19T09:50:30.363157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:46.348836+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:50:46.348836+0000","last_peered":"2024-09-19T09:50:46.348836+0000","last_clean":"2024-09-19T09:50:46.348836+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:50:46.348836+0000","last_undegraded":"2024-09-19T09:50:46.348836+0000","last_fullsized":"2024-09-19T09:50:46.348836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361870+0000","last_change":"2024-09-19T09:50:29.368212+0000","last_active":"2024-09-19T09:50:30.361870+0000","last_peered":"2024-09-19T09:50:30.361870+0000","last_clean":"2024-09-19T09:50:30.361870+0000","last_became_active":"2024-09-19T09:50:29.367866+0000","last_became_peered":"2024-09-19T09:50:29.367866+0000","last_unstale":"2024-09-19T09:50:30.361870+0000","last_undegraded":"2024-09-19T09:50:30.361870+0000","last_fullsized":"2024-09-19T09:50:30.361870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:57.270280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.415673+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:50:39.415673+0000","last_peered":"2024-09-19T09:50:39.415673+0000","last_clean":"2024-09-19T09:50:39.415673+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:50:39.415673+0000","last_undegraded":"2024-09-19T09:50:39.415673+0000","last_fullsized":"2024-09-19T09:50:39.415673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:38.410952+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:50:38.410952+0000","last_peered":"2024-09-19T09:50:38.410952+0000","last_clean":"2024-09-19T09:50:38.410952+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:50:38.410952+0000","last_undegraded":"2024-09-19T09:50:38.410952+0000","last_fullsized":"2024-09-19T09:50:38.410952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362772+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:50:30.362772+0000","last_peered":"2024-09-19T09:50:30.362772+0000","last_clean":"2024-09-19T09:50:30.362772+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:50:30.362772+0000","last_undegraded":"2024-09-19T09:50:30.362772+0000","last_fullsized":"2024-09-19T09:50:30.362772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340115+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:50:40.340115+0000","last_peered":"2024-09-19T09:50:40.340115+0000","last_clean":"2024-09-19T09:50:40.340115+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:50:40.340115+0000","last_undegraded":"2024-09-19T09:50:40.340115+0000","last_fullsized":"2024-09-19T09:50:40.340115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361653+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:50:30.361653+0000","last_peered":"2024-09-19T09:50:30.361653+0000","last_clean":"2024-09-19T09:50:30.361653+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:50:30.361653+0000","last_undegraded":"2024-09-19T09:50:30.361653+0000","last_fullsized":"2024-09-19T09:50:30.361653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:48.351428+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:50:48.351428+0000","last_peered":"2024-09-19T09:50:48.351428+0000","last_clean":"2024-09-19T09:50:48.351428+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:50:48.351428+0000","last_undegraded":"2024-09-19T09:50:48.351428+0000","last_fullsized":"2024-09-19T09:50:48.351428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365496+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:50:30.365496+0000","last_peered":"2024-09-19T09:50:30.365496+0000","last_clean":"2024-09-19T09:50:30.365496+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:50:30.365496+0000","last_undegraded":"2024-09-19T09:50:30.365496+0000","last_fullsized":"2024-09-19T09:50:30.365496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.338958+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:50:40.338958+0000","last_peered":"2024-09-19T09:50:40.338958+0000","last_clean":"2024-09-19T09:50:40.338958+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:50:40.338958+0000","last_undegraded":"2024-09-19T09:50:40.338958+0000","last_fullsized":"2024-09-19T09:50:40.338958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365928+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:50:30.365928+0000","last_peered":"2024-09-19T09:50:30.365928+0000","last_clean":"2024-09-19T09:50:30.365928+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:50:30.365928+0000","last_undegraded":"2024-09-19T09:50:30.365928+0000","last_fullsized":"2024-09-19T09:50:30.365928+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.415364+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:50:39.415364+0000","last_peered":"2024-09-19T09:50:39.415364+0000","last_clean":"2024-09-19T09:50:39.415364+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:50:39.415364+0000","last_undegraded":"2024-09-19T09:50:39.415364+0000","last_fullsized":"2024-09-19T09:50:39.415364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365535+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:50:30.365535+0000","last_peered":"2024-09-19T09:50:30.365535+0000","last_clean":"2024-09-19T09:50:30.365535+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:50:30.365535+0000","last_undegraded":"2024-09-19T09:50:30.365535+0000","last_fullsized":"2024-09-19T09:50:30.365535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'23","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:48.354784+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:50:48.354784+0000","last_peered":"2024-09-19T09:50:48.354784+0000","last_clean":"2024-09-19T09:50:48.354784+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:50:48.354784+0000","last_undegraded":"2024-09-19T09:50:48.354784+0000","last_fullsized":"2024-09-19T09:50:48.354784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41065,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":51,"num_write":25,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364413+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:50:30.364413+0000","last_peered":"2024-09-19T09:50:30.364413+0000","last_clean":"2024-09-19T09:50:30.364413+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:50:30.364413+0000","last_undegraded":"2024-09-19T09:50:30.364413+0000","last_fullsized":"2024-09-19T09:50:30.364413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340658+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:50:40.340658+0000","last_peered":"2024-09-19T09:50:40.340658+0000","last_clean":"2024-09-19T09:50:40.340658+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:50:40.340658+0000","last_undegraded":"2024-09-19T09:50:40.340658+0000","last_fullsized":"2024-09-19T09:50:40.340658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.349959+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:50:30.349959+0000","last_peered":"2024-09-19T09:50:30.349959+0000","last_clean":"2024-09-19T09:50:30.349959+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:50:30.349959+0000","last_undegraded":"2024-09-19T09:50:30.349959+0000","last_fullsized":"2024-09-19T09:50:30.349959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.341939+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:50:40.341939+0000","last_peered":"2024-09-19T09:50:40.341939+0000","last_clean":"2024-09-19T09:50:40.341939+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:50:40.341939+0000","last_undegraded":"2024-09-19T09:50:40.341939+0000","last_fullsized":"2024-09-19T09:50:40.341939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366752+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:50:30.366752+0000","last_peered":"2024-09-19T09:50:30.366752+0000","last_clean":"2024-09-19T09:50:30.366752+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:50:30.366752+0000","last_undegraded":"2024-09-19T09:50:30.366752+0000","last_fullsized":"2024-09-19T09:50:30.366752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:47.353427+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:50:47.353427+0000","last_peered":"2024-09-19T09:50:47.353427+0000","last_clean":"2024-09-19T09:50:47.353427+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:50:47.353427+0000","last_undegraded":"2024-09-19T09:50:47.353427+0000","last_fullsized":"2024-09-19T09:50:47.353427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365819+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:50:30.365819+0000","last_peered":"2024-09-19T09:50:30.365819+0000","last_clean":"2024-09-19T09:50:30.365819+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:50:30.365819+0000","last_undegraded":"2024-09-19T09:50:30.365819+0000","last_fullsized":"2024-09-19T09:50:30.365819+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.333564+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:50:40.333564+0000","last_peered":"2024-09-19T09:50:40.333564+0000","last_clean":"2024-09-19T09:50:40.333564+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:50:40.333564+0000","last_undegraded":"2024-09-19T09:50:40.333564+0000","last_fullsized":"2024-09-19T09:50:40.333564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361933+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:50:30.361933+0000","last_peered":"2024-09-19T09:50:30.361933+0000","last_clean":"2024-09-19T09:50:30.361933+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:50:30.361933+0000","last_undegraded":"2024-09-19T09:50:30.361933+0000","last_fullsized":"2024-09-19T09:50:30.361933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.407032+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:50:39.407032+0000","last_peered":"2024-09-19T09:50:39.407032+0000","last_clean":"2024-09-19T09:50:39.407032+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:50:39.407032+0000","last_undegraded":"2024-09-19T09:50:39.407032+0000","last_fullsized":"2024-09-19T09:50:39.407032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350865+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:50:30.350865+0000","last_peered":"2024-09-19T09:50:30.350865+0000","last_clean":"2024-09-19T09:50:30.350865+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:50:30.350865+0000","last_undegraded":"2024-09-19T09:50:30.350865+0000","last_fullsized":"2024-09-19T09:50:30.350865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.337189+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:50:40.337189+0000","last_peered":"2024-09-19T09:50:40.337189+0000","last_clean":"2024-09-19T09:50:40.337189+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:50:40.337189+0000","last_undegraded":"2024-09-19T09:50:40.337189+0000","last_fullsized":"2024-09-19T09:50:40.337189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367067+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:50:30.367067+0000","last_peered":"2024-09-19T09:50:30.367067+0000","last_clean":"2024-09-19T09:50:30.367067+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:50:30.367067+0000","last_undegraded":"2024-09-19T09:50:30.367067+0000","last_fullsized":"2024-09-19T09:50:30.367067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.332929+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:50:40.332929+0000","last_peered":"2024-09-19T09:50:40.332929+0000","last_clean":"2024-09-19T09:50:40.332929+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:50:40.332929+0000","last_undegraded":"2024-09-19T09:50:40.332929+0000","last_fullsized":"2024-09-19T09:50:40.332929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365560+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:50:30.365560+0000","last_peered":"2024-09-19T09:50:30.365560+0000","last_clean":"2024-09-19T09:50:30.365560+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:50:30.365560+0000","last_undegraded":"2024-09-19T09:50:30.365560+0000","last_fullsized":"2024-09-19T09:50:30.365560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:50.355585+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:50:50.355585+0000","last_peered":"2024-09-19T09:50:50.355585+0000","last_clean":"2024-09-19T09:50:50.355585+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:50:50.355585+0000","last_undegraded":"2024-09-19T09:50:50.355585+0000","last_fullsized":"2024-09-19T09:50:50.355585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367413+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:50:30.367413+0000","last_peered":"2024-09-19T09:50:30.367413+0000","last_clean":"2024-09-19T09:50:30.367413+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:50:30.367413+0000","last_undegraded":"2024-09-19T09:50:30.367413+0000","last_fullsized":"2024-09-19T09:50:30.367413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366182+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:50:30.366182+0000","last_peered":"2024-09-19T09:50:30.366182+0000","last_clean":"2024-09-19T09:50:30.366182+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:50:30.366182+0000","last_undegraded":"2024-09-19T09:50:30.366182+0000","last_fullsized":"2024-09-19T09:50:30.366182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.342531+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:50:40.342531+0000","last_peered":"2024-09-19T09:50:40.342531+0000","last_clean":"2024-09-19T09:50:40.342531+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:50:40.342531+0000","last_undegraded":"2024-09-19T09:50:40.342531+0000","last_fullsized":"2024-09-19T09:50:40.342531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362554+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:50:30.362554+0000","last_peered":"2024-09-19T09:50:30.362554+0000","last_clean":"2024-09-19T09:50:30.362554+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:50:30.362554+0000","last_undegraded":"2024-09-19T09:50:30.362554+0000","last_fullsized":"2024-09-19T09:50:30.362554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:38.412358+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:50:38.412358+0000","last_peered":"2024-09-19T09:50:38.412358+0000","last_clean":"2024-09-19T09:50:38.412358+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:50:38.412358+0000","last_undegraded":"2024-09-19T09:50:38.412358+0000","last_fullsized":"2024-09-19T09:50:38.412358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.349830+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:50:30.349830+0000","last_peered":"2024-09-19T09:50:30.349830+0000","last_clean":"2024-09-19T09:50:30.349830+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:50:30.349830+0000","last_undegraded":"2024-09-19T09:50:30.349830+0000","last_fullsized":"2024-09-19T09:50:30.349830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:47.352925+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:50:47.352925+0000","last_peered":"2024-09-19T09:50:47.352925+0000","last_clean":"2024-09-19T09:50:47.352925+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:50:47.352925+0000","last_undegraded":"2024-09-19T09:50:47.352925+0000","last_fullsized":"2024-09-19T09:50:47.352925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366839+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:50:30.366839+0000","last_peered":"2024-09-19T09:50:30.366839+0000","last_clean":"2024-09-19T09:50:30.366839+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:50:30.366839+0000","last_undegraded":"2024-09-19T09:50:30.366839+0000","last_fullsized":"2024-09-19T09:50:30.366839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:47.358469+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:50:47.358469+0000","last_peered":"2024-09-19T09:50:47.358469+0000","last_clean":"2024-09-19T09:50:47.358469+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:50:47.358469+0000","last_undegraded":"2024-09-19T09:50:47.358469+0000","last_fullsized":"2024-09-19T09:50:47.358469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362118+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:50:30.362118+0000","last_peered":"2024-09-19T09:50:30.362118+0000","last_clean":"2024-09-19T09:50:30.362118+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:50:30.362118+0000","last_undegraded":"2024-09-19T09:50:30.362118+0000","last_fullsized":"2024-09-19T09:50:30.362118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361503+0000","last_change":"2024-09-19T09:50:27.784718+0000","last_active":"2024-09-19T09:50:30.361503+0000","last_peered":"2024-09-19T09:50:30.361503+0000","last_clean":"2024-09-19T09:50:30.361503+0000","last_became_active":"2024-09-19T09:50:27.784381+0000","last_became_peered":"2024-09-19T09:50:27.784381+0000","last_unstale":"2024-09-19T09:50:30.361503+0000","last_undegraded":"2024-09-19T09:50:30.361503+0000","last_fullsized":"2024-09-19T09:50:30.361503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:14.507786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362021+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:50:30.362021+0000","last_peered":"2024-09-19T09:50:30.362021+0000","last_clean":"2024-09-19T09:50:30.362021+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:50:30.362021+0000","last_undegraded":"2024-09-19T09:50:30.362021+0000","last_fullsized":"2024-09-19T09:50:30.362021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.333703+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:50:40.333703+0000","last_peered":"2024-09-19T09:50:40.333703+0000","last_clean":"2024-09-19T09:50:40.333703+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:50:40.333703+0000","last_undegraded":"2024-09-19T09:50:40.333703+0000","last_fullsized":"2024-09-19T09:50:40.333703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350173+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:50:30.350173+0000","last_peered":"2024-09-19T09:50:30.350173+0000","last_clean":"2024-09-19T09:50:30.350173+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:50:30.350173+0000","last_undegraded":"2024-09-19T09:50:30.350173+0000","last_fullsized":"2024-09-19T09:50:30.350173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'10","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:45.360402+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:50:45.360402+0000","last_peered":"2024-09-19T09:50:45.360402+0000","last_clean":"2024-09-19T09:50:45.360402+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:50:45.360402+0000","last_undegraded":"2024-09-19T09:50:45.360402+0000","last_fullsized":"2024-09-19T09:50:45.360402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362298+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:50:30.362298+0000","last_peered":"2024-09-19T09:50:30.362298+0000","last_clean":"2024-09-19T09:50:30.362298+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:50:30.362298+0000","last_undegraded":"2024-09-19T09:50:30.362298+0000","last_fullsized":"2024-09-19T09:50:30.362298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340977+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:50:40.340977+0000","last_peered":"2024-09-19T09:50:40.340977+0000","last_clean":"2024-09-19T09:50:40.340977+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:50:40.340977+0000","last_undegraded":"2024-09-19T09:50:40.340977+0000","last_fullsized":"2024-09-19T09:50:40.340977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365749+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:50:30.365749+0000","last_peered":"2024-09-19T09:50:30.365749+0000","last_clean":"2024-09-19T09:50:30.365749+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:50:30.365749+0000","last_undegraded":"2024-09-19T09:50:30.365749+0000","last_fullsized":"2024-09-19T09:50:30.365749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.396716+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:50:37.396716+0000","last_peered":"2024-09-19T09:50:37.396716+0000","last_clean":"2024-09-19T09:50:37.396716+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:50:37.396716+0000","last_undegraded":"2024-09-19T09:50:37.396716+0000","last_fullsized":"2024-09-19T09:50:37.396716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361625+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:50:30.361625+0000","last_peered":"2024-09-19T09:50:30.361625+0000","last_clean":"2024-09-19T09:50:30.361625+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:50:30.361625+0000","last_undegraded":"2024-09-19T09:50:30.361625+0000","last_fullsized":"2024-09-19T09:50:30.361625+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340021+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:50:40.340021+0000","last_peered":"2024-09-19T09:50:40.340021+0000","last_clean":"2024-09-19T09:50:40.340021+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:50:40.340021+0000","last_undegraded":"2024-09-19T09:50:40.340021+0000","last_fullsized":"2024-09-19T09:50:40.340021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350782+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:50:30.350782+0000","last_peered":"2024-09-19T09:50:30.350782+0000","last_clean":"2024-09-19T09:50:30.350782+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:50:30.350782+0000","last_undegraded":"2024-09-19T09:50:30.350782+0000","last_fullsized":"2024-09-19T09:50:30.350782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.414486+0000","last_change":"2024-09-19T09:50:27.344357+0000","last_active":"2024-09-19T09:50:39.414486+0000","last_peered":"2024-09-19T09:50:39.414486+0000","last_clean":"2024-09-19T09:50:39.414486+0000","last_became_active":"2024-09-19T09:50:27.343727+0000","last_became_peered":"2024-09-19T09:50:27.343727+0000","last_unstale":"2024-09-19T09:50:39.414486+0000","last_undegraded":"2024-09-19T09:50:39.414486+0000","last_fullsized":"2024-09-19T09:50:39.414486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:58.824686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362989+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:50:30.362989+0000","last_peered":"2024-09-19T09:50:30.362989+0000","last_clean":"2024-09-19T09:50:30.362989+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:50:30.362989+0000","last_undegraded":"2024-09-19T09:50:30.362989+0000","last_fullsized":"2024-09-19T09:50:30.362989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.398274+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:50:37.398274+0000","last_peered":"2024-09-19T09:50:37.398274+0000","last_clean":"2024-09-19T09:50:37.398274+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:50:37.398274+0000","last_undegraded":"2024-09-19T09:50:37.398274+0000","last_fullsized":"2024-09-19T09:50:37.398274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366534+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:50:30.366534+0000","last_peered":"2024-09-19T09:50:30.366534+0000","last_clean":"2024-09-19T09:50:30.366534+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:50:30.366534+0000","last_undegraded":"2024-09-19T09:50:30.366534+0000","last_fullsized":"2024-09-19T09:50:30.366534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364268+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:50:30.364268+0000","last_peered":"2024-09-19T09:50:30.364268+0000","last_clean":"2024-09-19T09:50:30.364268+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:50:30.364268+0000","last_undegraded":"2024-09-19T09:50:30.364268+0000","last_fullsized":"2024-09-19T09:50:30.364268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.344467+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:50:40.344467+0000","last_peered":"2024-09-19T09:50:40.344467+0000","last_clean":"2024-09-19T09:50:40.344467+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:50:40.344467+0000","last_undegraded":"2024-09-19T09:50:40.344467+0000","last_fullsized":"2024-09-19T09:50:40.344467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365134+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:50:30.365134+0000","last_peered":"2024-09-19T09:50:30.365134+0000","last_clean":"2024-09-19T09:50:30.365134+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:50:30.365134+0000","last_undegraded":"2024-09-19T09:50:30.365134+0000","last_fullsized":"2024-09-19T09:50:30.365134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.344696+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:50:40.344696+0000","last_peered":"2024-09-19T09:50:40.344696+0000","last_clean":"2024-09-19T09:50:40.344696+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:50:40.344696+0000","last_undegraded":"2024-09-19T09:50:40.344696+0000","last_fullsized":"2024-09-19T09:50:40.344696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365889+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:50:30.365889+0000","last_peered":"2024-09-19T09:50:30.365889+0000","last_clean":"2024-09-19T09:50:30.365889+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:50:30.365889+0000","last_undegraded":"2024-09-19T09:50:30.365889+0000","last_fullsized":"2024-09-19T09:50:30.365889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.370521+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:50:30.370521+0000","last_peered":"2024-09-19T09:50:30.370521+0000","last_clean":"2024-09-19T09:50:30.370521+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:50:30.370521+0000","last_undegraded":"2024-09-19T09:50:30.370521+0000","last_fullsized":"2024-09-19T09:50:30.370521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362615+0000","last_change":"2024-09-19T09:50:29.365288+0000","last_active":"2024-09-19T09:50:30.362615+0000","last_peered":"2024-09-19T09:50:30.362615+0000","last_clean":"2024-09-19T09:50:30.362615+0000","last_became_active":"2024-09-19T09:50:29.364977+0000","last_became_peered":"2024-09-19T09:50:29.364977+0000","last_unstale":"2024-09-19T09:50:30.362615+0000","last_undegraded":"2024-09-19T09:50:30.362615+0000","last_fullsized":"2024-09-19T09:50:30.362615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:45.978204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:48.359039+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:50:48.359039+0000","last_peered":"2024-09-19T09:50:48.359039+0000","last_clean":"2024-09-19T09:50:48.359039+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:50:48.359039+0000","last_undegraded":"2024-09-19T09:50:48.359039+0000","last_fullsized":"2024-09-19T09:50:48.359039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":48273,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":226,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":162923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":425781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1572864,"data_stored":1058268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906971,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":425711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":426089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364836,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1511424,"data_stored":1019002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528362,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":901120,"data_stored":425821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712480,"statfs":{"total":95995035648,"available":95961579520,"internally_reserved":0,"allocated":1523712,"data_stored":1017894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":425682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":425136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":476678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":954368,"data_stored":476851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":426767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":52262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":52089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":43194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:50:54.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:50:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:54 smithi162 ceph-mon[35174]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:50:54.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:54 smithi049 ceph-mon[34858]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:50:54.919 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.346+0000 7f32703e0640 1 -- 172.21.15.18:0/3720152007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3268100a80 msgr2=0x7f3268100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.346+0000 7f32703e0640 1 --2- 172.21.15.18:0/3720152007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3268100a80 0x7f3268100ee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3258009930 tx=0x7f325802a420 comp rx=0 tx=0).stop 2024-09-19T09:50:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.346+0000 7f32703e0640 1 -- 172.21.15.18:0/3720152007 shutdown_connections 2024-09-19T09:50:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.346+0000 7f32703e0640 1 --2- 172.21.15.18:0/3720152007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3268101420 0x7f326810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.346+0000 7f32703e0640 1 --2- 172.21.15.18:0/3720152007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3268100a80 0x7f3268100ee0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.346+0000 7f32703e0640 1 --2- 172.21.15.18:0/3720152007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3268106a80 0x7f3268106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.346+0000 7f32703e0640 1 -- 172.21.15.18:0/3720152007 >> 172.21.15.18:0/3720152007 conn(0x7f32680fc7a0 msgr2=0x7f32680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.346+0000 7f32703e0640 1 -- 172.21.15.18:0/3720152007 shutdown_connections 2024-09-19T09:50:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.346+0000 7f32703e0640 1 -- 172.21.15.18:0/3720152007 wait complete. 2024-09-19T09:50:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f32703e0640 1 Processor -- start 2024-09-19T09:50:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f32703e0640 1 -- start start 2024-09-19T09:50:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f32703e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3268100a80 0x7f32681984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f32703e0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3268101420 0x7f32681989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f32703e0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3268106a80 0x7f326819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f32703e0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3268110ef0 con 0x7f3268106a80 2024-09-19T09:50:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f32703e0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3268110d70 con 0x7f3268101420 2024-09-19T09:50:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f32703e0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3268111070 con 0x7f3268100a80 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f326e97d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3268106a80 0x7f326819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f326e97d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3268106a80 0x7f326819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60942/0 (socket says 172.21.15.18:60942) 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f326e97d640 1 -- 172.21.15.18:0/3284908399 learned_addr learned my addr 172.21.15.18:0/3284908399 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f326d97b640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3268101420 0x7f32681989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.347+0000 7f326e17c640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3268100a80 0x7f32681984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f326e97d640 1 -- 172.21.15.18:0/3284908399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3268100a80 msgr2=0x7f32681984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f326e97d640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3268100a80 0x7f32681984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f326e97d640 1 -- 172.21.15.18:0/3284908399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3268101420 msgr2=0x7f32681989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f326e97d640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3268101420 0x7f32681989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f326e97d640 1 -- 172.21.15.18:0/3284908399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326819d450 con 0x7f3268106a80 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f326e97d640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3268106a80 0x7f326819cd70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f326000b970 tx=0x7f326000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f325f7fe640 1 -- 172.21.15.18:0/3284908399 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3260019070 con 0x7f3268106a80 2024-09-19T09:50:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f325f7fe640 1 -- 172.21.15.18:0/3284908399 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f326000cb40 con 0x7f3268106a80 2024-09-19T09:50:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f32703e0640 1 -- 172.21.15.18:0/3284908399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f326819d740 con 0x7f3268106a80 2024-09-19T09:50:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f325f7fe640 1 -- 172.21.15.18:0/3284908399 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3260007650 con 0x7f3268106a80 2024-09-19T09:50:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.348+0000 7f32703e0640 1 -- 172.21.15.18:0/3284908399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32681a5020 con 0x7f3268106a80 2024-09-19T09:50:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.349+0000 7f32703e0640 1 -- 172.21.15.18:0/3284908399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3268100ee0 con 0x7f3268106a80 2024-09-19T09:50:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.350+0000 7f325f7fe640 1 -- 172.21.15.18:0/3284908399 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f326001c070 con 0x7f3268106a80 2024-09-19T09:50:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.351+0000 7f325f7fe640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32540a3350 0x7f32540a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.351+0000 7f326e17c640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32540a3350 0x7f32540a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.351+0000 7f325f7fe640 1 -- 172.21.15.18:0/3284908399 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f32600ceca0 con 0x7f3268106a80 2024-09-19T09:50:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.351+0000 7f326e17c640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32540a3350 0x7f32540a5810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32640058c0 tx=0x7f326400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:55.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.355+0000 7f325f7fe640 1 -- 172.21.15.18:0/3284908399 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f32600d3070 con 0x7f3268106a80 2024-09-19T09:50:55.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.527+0000 7f32703e0640 1 -- 172.21.15.18:0/3284908399 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32680fcd00 con 0x7f32540a3350 2024-09-19T09:50:55.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.534+0000 7f325f7fe640 1 -- 172.21.15.18:0/3284908399 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258743 (secure 0 0 0) 0x7f32680fcd00 con 0x7f32540a3350 2024-09-19T09:50:55.537 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:55.538 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:50:55.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.536+0000 7f32703e0640 1 -- 172.21.15.18:0/3284908399 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32540a3350 msgr2=0x7f32540a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:55.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.536+0000 7f32703e0640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32540a3350 0x7f32540a5810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32640058c0 tx=0x7f326400a4c0 comp rx=0 tx=0).stop 2024-09-19T09:50:55.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.536+0000 7f32703e0640 1 -- 172.21.15.18:0/3284908399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3268106a80 msgr2=0x7f326819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:55.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.536+0000 7f32703e0640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3268106a80 0x7f326819cd70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f326000b970 tx=0x7f326000be30 comp rx=0 tx=0).stop 2024-09-19T09:50:55.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.536+0000 7f32703e0640 1 -- 172.21.15.18:0/3284908399 shutdown_connections 2024-09-19T09:50:55.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.536+0000 7f32703e0640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32540a3350 0x7f32540a5810 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:55.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.536+0000 7f32703e0640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3268106a80 0x7f326819cd70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:55.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.536+0000 7f32703e0640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3268101420 0x7f32681989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.536+0000 7f32703e0640 1 --2- 172.21.15.18:0/3284908399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3268100a80 0x7f32681984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.536+0000 7f32703e0640 1 -- 172.21.15.18:0/3284908399 >> 172.21.15.18:0/3284908399 conn(0x7f32680fc7a0 msgr2=0x7f3268104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.537+0000 7f32703e0640 1 -- 172.21.15.18:0/3284908399 shutdown_connections 2024-09-19T09:50:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:55.537+0000 7f32703e0640 1 -- 172.21.15.18:0/3284908399 wait complete. 2024-09-19T09:50:55.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:55 smithi018 ceph-mon[30956]: pgmap v294: 97 pgs: 97 active+clean; 633 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 19 op/s 2024-09-19T09:50:55.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:55 smithi049 ceph-mon[34858]: pgmap v294: 97 pgs: 97 active+clean; 633 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 19 op/s 2024-09-19T09:50:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:55 smithi162 ceph-mon[35174]: pgmap v294: 97 pgs: 97 active+clean; 633 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 19 op/s 2024-09-19T09:50:56.180 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-19T09:50:54.346754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647927,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":295,"num_read_kb":257,"num_write":413,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374340,"kb_used_data":12612,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567484,"statfs":{"total":1151940427776,"available":1151557103616,"internally_reserved":0,"allocated":12914688,"data_stored":7038849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51133,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":156,"num_read_kb":137,"num_write":78,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003084"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350952+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:50:30.350952+0000","last_peered":"2024-09-19T09:50:30.350952+0000","last_clean":"2024-09-19T09:50:30.350952+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:50:30.350952+0000","last_undegraded":"2024-09-19T09:50:30.350952+0000","last_fullsized":"2024-09-19T09:50:30.350952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365706+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:50:30.365706+0000","last_peered":"2024-09-19T09:50:30.365706+0000","last_clean":"2024-09-19T09:50:30.365706+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:50:30.365706+0000","last_undegraded":"2024-09-19T09:50:30.365706+0000","last_fullsized":"2024-09-19T09:50:30.365706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365686+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:50:30.365686+0000","last_peered":"2024-09-19T09:50:30.365686+0000","last_clean":"2024-09-19T09:50:30.365686+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:50:30.365686+0000","last_undegraded":"2024-09-19T09:50:30.365686+0000","last_fullsized":"2024-09-19T09:50:30.365686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350884+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:50:30.350884+0000","last_peered":"2024-09-19T09:50:30.350884+0000","last_clean":"2024-09-19T09:50:30.350884+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:50:30.350884+0000","last_undegraded":"2024-09-19T09:50:30.350884+0000","last_fullsized":"2024-09-19T09:50:30.350884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363363+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:50:30.363363+0000","last_peered":"2024-09-19T09:50:30.363363+0000","last_clean":"2024-09-19T09:50:30.363363+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:50:30.363363+0000","last_undegraded":"2024-09-19T09:50:30.363363+0000","last_fullsized":"2024-09-19T09:50:30.363363+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361812+0000","last_change":"2024-09-19T09:50:29.355326+0000","last_active":"2024-09-19T09:50:30.361812+0000","last_peered":"2024-09-19T09:50:30.361812+0000","last_clean":"2024-09-19T09:50:30.361812+0000","last_became_active":"2024-09-19T09:50:29.353527+0000","last_became_peered":"2024-09-19T09:50:29.353527+0000","last_unstale":"2024-09-19T09:50:30.361812+0000","last_undegraded":"2024-09-19T09:50:30.361812+0000","last_fullsized":"2024-09-19T09:50:30.361812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:24.250263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364898+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:50:30.364898+0000","last_peered":"2024-09-19T09:50:30.364898+0000","last_clean":"2024-09-19T09:50:30.364898+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:50:30.364898+0000","last_undegraded":"2024-09-19T09:50:30.364898+0000","last_fullsized":"2024-09-19T09:50:30.364898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362061+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:50:30.362061+0000","last_peered":"2024-09-19T09:50:30.362061+0000","last_clean":"2024-09-19T09:50:30.362061+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:50:30.362061+0000","last_undegraded":"2024-09-19T09:50:30.362061+0000","last_fullsized":"2024-09-19T09:50:30.362061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365738+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:50:30.365738+0000","last_peered":"2024-09-19T09:50:30.365738+0000","last_clean":"2024-09-19T09:50:30.365738+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:50:30.365738+0000","last_undegraded":"2024-09-19T09:50:30.365738+0000","last_fullsized":"2024-09-19T09:50:30.365738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362476+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:50:30.362476+0000","last_peered":"2024-09-19T09:50:30.362476+0000","last_clean":"2024-09-19T09:50:30.362476+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:50:30.362476+0000","last_undegraded":"2024-09-19T09:50:30.362476+0000","last_fullsized":"2024-09-19T09:50:30.362476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367368+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:50:30.367368+0000","last_peered":"2024-09-19T09:50:30.367368+0000","last_clean":"2024-09-19T09:50:30.367368+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:50:30.367368+0000","last_undegraded":"2024-09-19T09:50:30.367368+0000","last_fullsized":"2024-09-19T09:50:30.367368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350960+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:50:30.350960+0000","last_peered":"2024-09-19T09:50:30.350960+0000","last_clean":"2024-09-19T09:50:30.350960+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:50:30.350960+0000","last_undegraded":"2024-09-19T09:50:30.350960+0000","last_fullsized":"2024-09-19T09:50:30.350960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350141+0000","last_change":"2024-09-19T09:50:29.353493+0000","last_active":"2024-09-19T09:50:30.350141+0000","last_peered":"2024-09-19T09:50:30.350141+0000","last_clean":"2024-09-19T09:50:30.350141+0000","last_became_active":"2024-09-19T09:50:29.353040+0000","last_became_peered":"2024-09-19T09:50:29.353040+0000","last_unstale":"2024-09-19T09:50:30.350141+0000","last_undegraded":"2024-09-19T09:50:30.350141+0000","last_fullsized":"2024-09-19T09:50:30.350141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:07.751702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365257+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:50:30.365257+0000","last_peered":"2024-09-19T09:50:30.365257+0000","last_clean":"2024-09-19T09:50:30.365257+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:50:30.365257+0000","last_undegraded":"2024-09-19T09:50:30.365257+0000","last_fullsized":"2024-09-19T09:50:30.365257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365019+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:50:30.365019+0000","last_peered":"2024-09-19T09:50:30.365019+0000","last_clean":"2024-09-19T09:50:30.365019+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:50:30.365019+0000","last_undegraded":"2024-09-19T09:50:30.365019+0000","last_fullsized":"2024-09-19T09:50:30.365019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364552+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:50:30.364552+0000","last_peered":"2024-09-19T09:50:30.364552+0000","last_clean":"2024-09-19T09:50:30.364552+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:50:30.364552+0000","last_undegraded":"2024-09-19T09:50:30.364552+0000","last_fullsized":"2024-09-19T09:50:30.364552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350989+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:50:30.350989+0000","last_peered":"2024-09-19T09:50:30.350989+0000","last_clean":"2024-09-19T09:50:30.350989+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:50:30.350989+0000","last_undegraded":"2024-09-19T09:50:30.350989+0000","last_fullsized":"2024-09-19T09:50:30.350989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361305+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:50:30.361305+0000","last_peered":"2024-09-19T09:50:30.361305+0000","last_clean":"2024-09-19T09:50:30.361305+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:50:30.361305+0000","last_undegraded":"2024-09-19T09:50:30.361305+0000","last_fullsized":"2024-09-19T09:50:30.361305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363634+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:50:30.363634+0000","last_peered":"2024-09-19T09:50:30.363634+0000","last_clean":"2024-09-19T09:50:30.363634+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:50:30.363634+0000","last_undegraded":"2024-09-19T09:50:30.363634+0000","last_fullsized":"2024-09-19T09:50:30.363634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350740+0000","last_change":"2024-09-19T09:50:29.352834+0000","last_active":"2024-09-19T09:50:30.350740+0000","last_peered":"2024-09-19T09:50:30.350740+0000","last_clean":"2024-09-19T09:50:30.350740+0000","last_became_active":"2024-09-19T09:50:29.352483+0000","last_became_peered":"2024-09-19T09:50:29.352483+0000","last_unstale":"2024-09-19T09:50:30.350740+0000","last_undegraded":"2024-09-19T09:50:30.350740+0000","last_fullsized":"2024-09-19T09:50:30.350740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:43.916024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350217+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:50:30.350217+0000","last_peered":"2024-09-19T09:50:30.350217+0000","last_clean":"2024-09-19T09:50:30.350217+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:50:30.350217+0000","last_undegraded":"2024-09-19T09:50:30.350217+0000","last_fullsized":"2024-09-19T09:50:30.350217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364926+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:50:30.364926+0000","last_peered":"2024-09-19T09:50:30.364926+0000","last_clean":"2024-09-19T09:50:30.364926+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:50:30.364926+0000","last_undegraded":"2024-09-19T09:50:30.364926+0000","last_fullsized":"2024-09-19T09:50:30.364926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361960+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:50:30.361960+0000","last_peered":"2024-09-19T09:50:30.361960+0000","last_clean":"2024-09-19T09:50:30.361960+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:50:30.361960+0000","last_undegraded":"2024-09-19T09:50:30.361960+0000","last_fullsized":"2024-09-19T09:50:30.361960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366668+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:50:30.366668+0000","last_peered":"2024-09-19T09:50:30.366668+0000","last_clean":"2024-09-19T09:50:30.366668+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:50:30.366668+0000","last_undegraded":"2024-09-19T09:50:30.366668+0000","last_fullsized":"2024-09-19T09:50:30.366668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361980+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:50:30.361980+0000","last_peered":"2024-09-19T09:50:30.361980+0000","last_clean":"2024-09-19T09:50:30.361980+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:50:30.361980+0000","last_undegraded":"2024-09-19T09:50:30.361980+0000","last_fullsized":"2024-09-19T09:50:30.361980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363189+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:50:30.363189+0000","last_peered":"2024-09-19T09:50:30.363189+0000","last_clean":"2024-09-19T09:50:30.363189+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:50:30.363189+0000","last_undegraded":"2024-09-19T09:50:30.363189+0000","last_fullsized":"2024-09-19T09:50:30.363189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350918+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:50:30.350918+0000","last_peered":"2024-09-19T09:50:30.350918+0000","last_clean":"2024-09-19T09:50:30.350918+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:50:30.350918+0000","last_undegraded":"2024-09-19T09:50:30.350918+0000","last_fullsized":"2024-09-19T09:50:30.350918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350297+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:50:30.350297+0000","last_peered":"2024-09-19T09:50:30.350297+0000","last_clean":"2024-09-19T09:50:30.350297+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:50:30.350297+0000","last_undegraded":"2024-09-19T09:50:30.350297+0000","last_fullsized":"2024-09-19T09:50:30.350297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365151+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:50:30.365151+0000","last_peered":"2024-09-19T09:50:30.365151+0000","last_clean":"2024-09-19T09:50:30.365151+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:50:30.365151+0000","last_undegraded":"2024-09-19T09:50:30.365151+0000","last_fullsized":"2024-09-19T09:50:30.365151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365091+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:50:30.365091+0000","last_peered":"2024-09-19T09:50:30.365091+0000","last_clean":"2024-09-19T09:50:30.365091+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:50:30.365091+0000","last_undegraded":"2024-09-19T09:50:30.365091+0000","last_fullsized":"2024-09-19T09:50:30.365091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362893+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:50:30.362893+0000","last_peered":"2024-09-19T09:50:30.362893+0000","last_clean":"2024-09-19T09:50:30.362893+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:50:30.362893+0000","last_undegraded":"2024-09-19T09:50:30.362893+0000","last_fullsized":"2024-09-19T09:50:30.362893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350596+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:50:30.350596+0000","last_peered":"2024-09-19T09:50:30.350596+0000","last_clean":"2024-09-19T09:50:30.350596+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:50:30.350596+0000","last_undegraded":"2024-09-19T09:50:30.350596+0000","last_fullsized":"2024-09-19T09:50:30.350596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363157+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:50:30.363157+0000","last_peered":"2024-09-19T09:50:30.363157+0000","last_clean":"2024-09-19T09:50:30.363157+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:50:30.363157+0000","last_undegraded":"2024-09-19T09:50:30.363157+0000","last_fullsized":"2024-09-19T09:50:30.363157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:51.357221+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:50:51.357221+0000","last_peered":"2024-09-19T09:50:51.357221+0000","last_clean":"2024-09-19T09:50:51.357221+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:50:51.357221+0000","last_undegraded":"2024-09-19T09:50:51.357221+0000","last_fullsized":"2024-09-19T09:50:51.357221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361870+0000","last_change":"2024-09-19T09:50:29.368212+0000","last_active":"2024-09-19T09:50:30.361870+0000","last_peered":"2024-09-19T09:50:30.361870+0000","last_clean":"2024-09-19T09:50:30.361870+0000","last_became_active":"2024-09-19T09:50:29.367866+0000","last_became_peered":"2024-09-19T09:50:29.367866+0000","last_unstale":"2024-09-19T09:50:30.361870+0000","last_undegraded":"2024-09-19T09:50:30.361870+0000","last_fullsized":"2024-09-19T09:50:30.361870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:57.270280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.415673+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:50:39.415673+0000","last_peered":"2024-09-19T09:50:39.415673+0000","last_clean":"2024-09-19T09:50:39.415673+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:50:39.415673+0000","last_undegraded":"2024-09-19T09:50:39.415673+0000","last_fullsized":"2024-09-19T09:50:39.415673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:38.410952+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:50:38.410952+0000","last_peered":"2024-09-19T09:50:38.410952+0000","last_clean":"2024-09-19T09:50:38.410952+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:50:38.410952+0000","last_undegraded":"2024-09-19T09:50:38.410952+0000","last_fullsized":"2024-09-19T09:50:38.410952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362772+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:50:30.362772+0000","last_peered":"2024-09-19T09:50:30.362772+0000","last_clean":"2024-09-19T09:50:30.362772+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:50:30.362772+0000","last_undegraded":"2024-09-19T09:50:30.362772+0000","last_fullsized":"2024-09-19T09:50:30.362772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340115+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:50:40.340115+0000","last_peered":"2024-09-19T09:50:40.340115+0000","last_clean":"2024-09-19T09:50:40.340115+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:50:40.340115+0000","last_undegraded":"2024-09-19T09:50:40.340115+0000","last_fullsized":"2024-09-19T09:50:40.340115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361653+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:50:30.361653+0000","last_peered":"2024-09-19T09:50:30.361653+0000","last_clean":"2024-09-19T09:50:30.361653+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:50:30.361653+0000","last_undegraded":"2024-09-19T09:50:30.361653+0000","last_fullsized":"2024-09-19T09:50:30.361653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:53.359637+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:50:53.359637+0000","last_peered":"2024-09-19T09:50:53.359637+0000","last_clean":"2024-09-19T09:50:53.359637+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:50:53.359637+0000","last_undegraded":"2024-09-19T09:50:53.359637+0000","last_fullsized":"2024-09-19T09:50:53.359637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365496+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:50:30.365496+0000","last_peered":"2024-09-19T09:50:30.365496+0000","last_clean":"2024-09-19T09:50:30.365496+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:50:30.365496+0000","last_undegraded":"2024-09-19T09:50:30.365496+0000","last_fullsized":"2024-09-19T09:50:30.365496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.338958+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:50:40.338958+0000","last_peered":"2024-09-19T09:50:40.338958+0000","last_clean":"2024-09-19T09:50:40.338958+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:50:40.338958+0000","last_undegraded":"2024-09-19T09:50:40.338958+0000","last_fullsized":"2024-09-19T09:50:40.338958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365928+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:50:30.365928+0000","last_peered":"2024-09-19T09:50:30.365928+0000","last_clean":"2024-09-19T09:50:30.365928+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:50:30.365928+0000","last_undegraded":"2024-09-19T09:50:30.365928+0000","last_fullsized":"2024-09-19T09:50:30.365928+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.415364+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:50:39.415364+0000","last_peered":"2024-09-19T09:50:39.415364+0000","last_clean":"2024-09-19T09:50:39.415364+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:50:39.415364+0000","last_undegraded":"2024-09-19T09:50:39.415364+0000","last_fullsized":"2024-09-19T09:50:39.415364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365535+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:50:30.365535+0000","last_peered":"2024-09-19T09:50:30.365535+0000","last_clean":"2024-09-19T09:50:30.365535+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:50:30.365535+0000","last_undegraded":"2024-09-19T09:50:30.365535+0000","last_fullsized":"2024-09-19T09:50:30.365535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'27","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:53.362698+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:50:53.362698+0000","last_peered":"2024-09-19T09:50:53.362698+0000","last_clean":"2024-09-19T09:50:53.362698+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:50:53.362698+0000","last_undegraded":"2024-09-19T09:50:53.362698+0000","last_fullsized":"2024-09-19T09:50:53.362698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50117,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":65,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364413+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:50:30.364413+0000","last_peered":"2024-09-19T09:50:30.364413+0000","last_clean":"2024-09-19T09:50:30.364413+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:50:30.364413+0000","last_undegraded":"2024-09-19T09:50:30.364413+0000","last_fullsized":"2024-09-19T09:50:30.364413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340658+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:50:40.340658+0000","last_peered":"2024-09-19T09:50:40.340658+0000","last_clean":"2024-09-19T09:50:40.340658+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:50:40.340658+0000","last_undegraded":"2024-09-19T09:50:40.340658+0000","last_fullsized":"2024-09-19T09:50:40.340658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.349959+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:50:30.349959+0000","last_peered":"2024-09-19T09:50:30.349959+0000","last_clean":"2024-09-19T09:50:30.349959+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:50:30.349959+0000","last_undegraded":"2024-09-19T09:50:30.349959+0000","last_fullsized":"2024-09-19T09:50:30.349959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.341939+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:50:40.341939+0000","last_peered":"2024-09-19T09:50:40.341939+0000","last_clean":"2024-09-19T09:50:40.341939+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:50:40.341939+0000","last_undegraded":"2024-09-19T09:50:40.341939+0000","last_fullsized":"2024-09-19T09:50:40.341939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366752+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:50:30.366752+0000","last_peered":"2024-09-19T09:50:30.366752+0000","last_clean":"2024-09-19T09:50:30.366752+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:50:30.366752+0000","last_undegraded":"2024-09-19T09:50:30.366752+0000","last_fullsized":"2024-09-19T09:50:30.366752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:52.359806+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:50:52.359806+0000","last_peered":"2024-09-19T09:50:52.359806+0000","last_clean":"2024-09-19T09:50:52.359806+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:50:52.359806+0000","last_undegraded":"2024-09-19T09:50:52.359806+0000","last_fullsized":"2024-09-19T09:50:52.359806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365819+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:50:30.365819+0000","last_peered":"2024-09-19T09:50:30.365819+0000","last_clean":"2024-09-19T09:50:30.365819+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:50:30.365819+0000","last_undegraded":"2024-09-19T09:50:30.365819+0000","last_fullsized":"2024-09-19T09:50:30.365819+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.333564+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:50:40.333564+0000","last_peered":"2024-09-19T09:50:40.333564+0000","last_clean":"2024-09-19T09:50:40.333564+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:50:40.333564+0000","last_undegraded":"2024-09-19T09:50:40.333564+0000","last_fullsized":"2024-09-19T09:50:40.333564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361933+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:50:30.361933+0000","last_peered":"2024-09-19T09:50:30.361933+0000","last_clean":"2024-09-19T09:50:30.361933+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:50:30.361933+0000","last_undegraded":"2024-09-19T09:50:30.361933+0000","last_fullsized":"2024-09-19T09:50:30.361933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.407032+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:50:39.407032+0000","last_peered":"2024-09-19T09:50:39.407032+0000","last_clean":"2024-09-19T09:50:39.407032+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:50:39.407032+0000","last_undegraded":"2024-09-19T09:50:39.407032+0000","last_fullsized":"2024-09-19T09:50:39.407032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350865+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:50:30.350865+0000","last_peered":"2024-09-19T09:50:30.350865+0000","last_clean":"2024-09-19T09:50:30.350865+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:50:30.350865+0000","last_undegraded":"2024-09-19T09:50:30.350865+0000","last_fullsized":"2024-09-19T09:50:30.350865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.337189+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:50:40.337189+0000","last_peered":"2024-09-19T09:50:40.337189+0000","last_clean":"2024-09-19T09:50:40.337189+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:50:40.337189+0000","last_undegraded":"2024-09-19T09:50:40.337189+0000","last_fullsized":"2024-09-19T09:50:40.337189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367067+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:50:30.367067+0000","last_peered":"2024-09-19T09:50:30.367067+0000","last_clean":"2024-09-19T09:50:30.367067+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:50:30.367067+0000","last_undegraded":"2024-09-19T09:50:30.367067+0000","last_fullsized":"2024-09-19T09:50:30.367067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.332929+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:50:40.332929+0000","last_peered":"2024-09-19T09:50:40.332929+0000","last_clean":"2024-09-19T09:50:40.332929+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:50:40.332929+0000","last_undegraded":"2024-09-19T09:50:40.332929+0000","last_fullsized":"2024-09-19T09:50:40.332929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365560+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:50:30.365560+0000","last_peered":"2024-09-19T09:50:30.365560+0000","last_clean":"2024-09-19T09:50:30.365560+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:50:30.365560+0000","last_undegraded":"2024-09-19T09:50:30.365560+0000","last_fullsized":"2024-09-19T09:50:30.365560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:50.355585+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:50:50.355585+0000","last_peered":"2024-09-19T09:50:50.355585+0000","last_clean":"2024-09-19T09:50:50.355585+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:50:50.355585+0000","last_undegraded":"2024-09-19T09:50:50.355585+0000","last_fullsized":"2024-09-19T09:50:50.355585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367413+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:50:30.367413+0000","last_peered":"2024-09-19T09:50:30.367413+0000","last_clean":"2024-09-19T09:50:30.367413+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:50:30.367413+0000","last_undegraded":"2024-09-19T09:50:30.367413+0000","last_fullsized":"2024-09-19T09:50:30.367413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366182+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:50:30.366182+0000","last_peered":"2024-09-19T09:50:30.366182+0000","last_clean":"2024-09-19T09:50:30.366182+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:50:30.366182+0000","last_undegraded":"2024-09-19T09:50:30.366182+0000","last_fullsized":"2024-09-19T09:50:30.366182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.342531+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:50:40.342531+0000","last_peered":"2024-09-19T09:50:40.342531+0000","last_clean":"2024-09-19T09:50:40.342531+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:50:40.342531+0000","last_undegraded":"2024-09-19T09:50:40.342531+0000","last_fullsized":"2024-09-19T09:50:40.342531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362554+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:50:30.362554+0000","last_peered":"2024-09-19T09:50:30.362554+0000","last_clean":"2024-09-19T09:50:30.362554+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:50:30.362554+0000","last_undegraded":"2024-09-19T09:50:30.362554+0000","last_fullsized":"2024-09-19T09:50:30.362554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:38.412358+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:50:38.412358+0000","last_peered":"2024-09-19T09:50:38.412358+0000","last_clean":"2024-09-19T09:50:38.412358+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:50:38.412358+0000","last_undegraded":"2024-09-19T09:50:38.412358+0000","last_fullsized":"2024-09-19T09:50:38.412358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.349830+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:50:30.349830+0000","last_peered":"2024-09-19T09:50:30.349830+0000","last_clean":"2024-09-19T09:50:30.349830+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:50:30.349830+0000","last_undegraded":"2024-09-19T09:50:30.349830+0000","last_fullsized":"2024-09-19T09:50:30.349830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:52.359291+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:50:52.359291+0000","last_peered":"2024-09-19T09:50:52.359291+0000","last_clean":"2024-09-19T09:50:52.359291+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:50:52.359291+0000","last_undegraded":"2024-09-19T09:50:52.359291+0000","last_fullsized":"2024-09-19T09:50:52.359291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366839+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:50:30.366839+0000","last_peered":"2024-09-19T09:50:30.366839+0000","last_clean":"2024-09-19T09:50:30.366839+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:50:30.366839+0000","last_undegraded":"2024-09-19T09:50:30.366839+0000","last_fullsized":"2024-09-19T09:50:30.366839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:52.364753+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:50:52.364753+0000","last_peered":"2024-09-19T09:50:52.364753+0000","last_clean":"2024-09-19T09:50:52.364753+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:50:52.364753+0000","last_undegraded":"2024-09-19T09:50:52.364753+0000","last_fullsized":"2024-09-19T09:50:52.364753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362118+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:50:30.362118+0000","last_peered":"2024-09-19T09:50:30.362118+0000","last_clean":"2024-09-19T09:50:30.362118+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:50:30.362118+0000","last_undegraded":"2024-09-19T09:50:30.362118+0000","last_fullsized":"2024-09-19T09:50:30.362118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361503+0000","last_change":"2024-09-19T09:50:27.784718+0000","last_active":"2024-09-19T09:50:30.361503+0000","last_peered":"2024-09-19T09:50:30.361503+0000","last_clean":"2024-09-19T09:50:30.361503+0000","last_became_active":"2024-09-19T09:50:27.784381+0000","last_became_peered":"2024-09-19T09:50:27.784381+0000","last_unstale":"2024-09-19T09:50:30.361503+0000","last_undegraded":"2024-09-19T09:50:30.361503+0000","last_fullsized":"2024-09-19T09:50:30.361503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:14.507786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362021+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:50:30.362021+0000","last_peered":"2024-09-19T09:50:30.362021+0000","last_clean":"2024-09-19T09:50:30.362021+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:50:30.362021+0000","last_undegraded":"2024-09-19T09:50:30.362021+0000","last_fullsized":"2024-09-19T09:50:30.362021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.333703+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:50:40.333703+0000","last_peered":"2024-09-19T09:50:40.333703+0000","last_clean":"2024-09-19T09:50:40.333703+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:50:40.333703+0000","last_undegraded":"2024-09-19T09:50:40.333703+0000","last_fullsized":"2024-09-19T09:50:40.333703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350173+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:50:30.350173+0000","last_peered":"2024-09-19T09:50:30.350173+0000","last_clean":"2024-09-19T09:50:30.350173+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:50:30.350173+0000","last_undegraded":"2024-09-19T09:50:30.350173+0000","last_fullsized":"2024-09-19T09:50:30.350173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'10","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:45.360402+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:50:45.360402+0000","last_peered":"2024-09-19T09:50:45.360402+0000","last_clean":"2024-09-19T09:50:45.360402+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:50:45.360402+0000","last_undegraded":"2024-09-19T09:50:45.360402+0000","last_fullsized":"2024-09-19T09:50:45.360402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362298+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:50:30.362298+0000","last_peered":"2024-09-19T09:50:30.362298+0000","last_clean":"2024-09-19T09:50:30.362298+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:50:30.362298+0000","last_undegraded":"2024-09-19T09:50:30.362298+0000","last_fullsized":"2024-09-19T09:50:30.362298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340977+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:50:40.340977+0000","last_peered":"2024-09-19T09:50:40.340977+0000","last_clean":"2024-09-19T09:50:40.340977+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:50:40.340977+0000","last_undegraded":"2024-09-19T09:50:40.340977+0000","last_fullsized":"2024-09-19T09:50:40.340977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365749+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:50:30.365749+0000","last_peered":"2024-09-19T09:50:30.365749+0000","last_clean":"2024-09-19T09:50:30.365749+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:50:30.365749+0000","last_undegraded":"2024-09-19T09:50:30.365749+0000","last_fullsized":"2024-09-19T09:50:30.365749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.396716+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:50:37.396716+0000","last_peered":"2024-09-19T09:50:37.396716+0000","last_clean":"2024-09-19T09:50:37.396716+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:50:37.396716+0000","last_undegraded":"2024-09-19T09:50:37.396716+0000","last_fullsized":"2024-09-19T09:50:37.396716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361625+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:50:30.361625+0000","last_peered":"2024-09-19T09:50:30.361625+0000","last_clean":"2024-09-19T09:50:30.361625+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:50:30.361625+0000","last_undegraded":"2024-09-19T09:50:30.361625+0000","last_fullsized":"2024-09-19T09:50:30.361625+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340021+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:50:40.340021+0000","last_peered":"2024-09-19T09:50:40.340021+0000","last_clean":"2024-09-19T09:50:40.340021+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:50:40.340021+0000","last_undegraded":"2024-09-19T09:50:40.340021+0000","last_fullsized":"2024-09-19T09:50:40.340021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350782+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:50:30.350782+0000","last_peered":"2024-09-19T09:50:30.350782+0000","last_clean":"2024-09-19T09:50:30.350782+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:50:30.350782+0000","last_undegraded":"2024-09-19T09:50:30.350782+0000","last_fullsized":"2024-09-19T09:50:30.350782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.414486+0000","last_change":"2024-09-19T09:50:27.344357+0000","last_active":"2024-09-19T09:50:39.414486+0000","last_peered":"2024-09-19T09:50:39.414486+0000","last_clean":"2024-09-19T09:50:39.414486+0000","last_became_active":"2024-09-19T09:50:27.343727+0000","last_became_peered":"2024-09-19T09:50:27.343727+0000","last_unstale":"2024-09-19T09:50:39.414486+0000","last_undegraded":"2024-09-19T09:50:39.414486+0000","last_fullsized":"2024-09-19T09:50:39.414486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:58.824686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362989+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:50:30.362989+0000","last_peered":"2024-09-19T09:50:30.362989+0000","last_clean":"2024-09-19T09:50:30.362989+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:50:30.362989+0000","last_undegraded":"2024-09-19T09:50:30.362989+0000","last_fullsized":"2024-09-19T09:50:30.362989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.398274+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:50:37.398274+0000","last_peered":"2024-09-19T09:50:37.398274+0000","last_clean":"2024-09-19T09:50:37.398274+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:50:37.398274+0000","last_undegraded":"2024-09-19T09:50:37.398274+0000","last_fullsized":"2024-09-19T09:50:37.398274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366534+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:50:30.366534+0000","last_peered":"2024-09-19T09:50:30.366534+0000","last_clean":"2024-09-19T09:50:30.366534+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:50:30.366534+0000","last_undegraded":"2024-09-19T09:50:30.366534+0000","last_fullsized":"2024-09-19T09:50:30.366534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364268+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:50:30.364268+0000","last_peered":"2024-09-19T09:50:30.364268+0000","last_clean":"2024-09-19T09:50:30.364268+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:50:30.364268+0000","last_undegraded":"2024-09-19T09:50:30.364268+0000","last_fullsized":"2024-09-19T09:50:30.364268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.344467+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:50:40.344467+0000","last_peered":"2024-09-19T09:50:40.344467+0000","last_clean":"2024-09-19T09:50:40.344467+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:50:40.344467+0000","last_undegraded":"2024-09-19T09:50:40.344467+0000","last_fullsized":"2024-09-19T09:50:40.344467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365134+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:50:30.365134+0000","last_peered":"2024-09-19T09:50:30.365134+0000","last_clean":"2024-09-19T09:50:30.365134+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:50:30.365134+0000","last_undegraded":"2024-09-19T09:50:30.365134+0000","last_fullsized":"2024-09-19T09:50:30.365134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.344696+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:50:40.344696+0000","last_peered":"2024-09-19T09:50:40.344696+0000","last_clean":"2024-09-19T09:50:40.344696+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:50:40.344696+0000","last_undegraded":"2024-09-19T09:50:40.344696+0000","last_fullsized":"2024-09-19T09:50:40.344696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365889+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:50:30.365889+0000","last_peered":"2024-09-19T09:50:30.365889+0000","last_clean":"2024-09-19T09:50:30.365889+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:50:30.365889+0000","last_undegraded":"2024-09-19T09:50:30.365889+0000","last_fullsized":"2024-09-19T09:50:30.365889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.370521+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:50:30.370521+0000","last_peered":"2024-09-19T09:50:30.370521+0000","last_clean":"2024-09-19T09:50:30.370521+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:50:30.370521+0000","last_undegraded":"2024-09-19T09:50:30.370521+0000","last_fullsized":"2024-09-19T09:50:30.370521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362615+0000","last_change":"2024-09-19T09:50:29.365288+0000","last_active":"2024-09-19T09:50:30.362615+0000","last_peered":"2024-09-19T09:50:30.362615+0000","last_clean":"2024-09-19T09:50:30.362615+0000","last_became_active":"2024-09-19T09:50:29.364977+0000","last_became_peered":"2024-09-19T09:50:29.364977+0000","last_unstale":"2024-09-19T09:50:30.362615+0000","last_undegraded":"2024-09-19T09:50:30.362615+0000","last_fullsized":"2024-09-19T09:50:30.362615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:45.978204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:48.359039+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:50:48.359039+0000","last_peered":"2024-09-19T09:50:48.359039+0000","last_clean":"2024-09-19T09:50:48.359039+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:50:48.359039+0000","last_undegraded":"2024-09-19T09:50:48.359039+0000","last_fullsized":"2024-09-19T09:50:48.359039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57325,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":169,"num_read_kb":148,"num_write":230,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":171975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":425781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1067320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906971,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":425711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":426089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364837,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1511424,"data_stored":1019002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528363,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":901120,"data_stored":425821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712480,"statfs":{"total":95995035648,"available":95961579520,"internally_reserved":0,"allocated":1523712,"data_stored":1017894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953525,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":425682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":425253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":476678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":954368,"data_stored":476851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":426767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":52262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":52089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":52246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:50:56.183 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:50:56.184 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T09:50:56.184 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T09:50:56.447 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:56.695 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:56 smithi018 ceph-mon[30956]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:50:56.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.895+0000 7f2db6e11640 1 -- 172.21.15.18:0/1327937229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db01026d0 msgr2=0x7f2db0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:56.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.895+0000 7f2db6e11640 1 --2- 172.21.15.18:0/1327937229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db01026d0 0x7f2db0108f60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009ca0 tx=0x7f2da802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:50:56.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.895+0000 7f2db6e11640 1 -- 172.21.15.18:0/1327937229 shutdown_connections 2024-09-19T09:50:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.895+0000 7f2db6e11640 1 --2- 172.21.15.18:0/1327937229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db01026d0 0x7f2db0108f60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.895+0000 7f2db6e11640 1 --2- 172.21.15.18:0/1327937229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0101d10 0x7f2db0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.895+0000 7f2db6e11640 1 --2- 172.21.15.18:0/1327937229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db0100b10 0x7f2db0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.895+0000 7f2db6e11640 1 -- 172.21.15.18:0/1327937229 >> 172.21.15.18:0/1327937229 conn(0x7f2db00fc2a0 msgr2=0x7f2db00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.895+0000 7f2db6e11640 1 -- 172.21.15.18:0/1327937229 shutdown_connections 2024-09-19T09:50:56.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.895+0000 7f2db6e11640 1 -- 172.21.15.18:0/1327937229 wait complete. 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2db6e11640 1 Processor -- start 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2db6e11640 1 -- start start 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2db6e11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0100b10 0x7f2db0104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2db6e11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db0101d10 0x7f2db01030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2db6e11640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db01026d0 0x7f2db0103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2db6e11640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2db010c790 con 0x7f2db0101d10 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2db6e11640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2db010c610 con 0x7f2db01026d0 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2db6e11640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2db010c910 con 0x7f2db0100b10 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2daffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db0101d10 0x7f2db01030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2daffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db0101d10 0x7f2db01030f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32956/0 (socket says 172.21.15.18:32956) 2024-09-19T09:50:56.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2daffff640 1 -- 172.21.15.18:0/3090754649 learned_addr learned my addr 172.21.15.18:0/3090754649 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.896+0000 7f2db4bad640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0100b10 0x7f2db0104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2db53ae640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db01026d0 0x7f2db0103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2daffff640 1 -- 172.21.15.18:0/3090754649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0100b10 msgr2=0x7f2db0104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2daffff640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0100b10 0x7f2db0104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2daffff640 1 -- 172.21.15.18:0/3090754649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db01026d0 msgr2=0x7f2db0103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2daffff640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db01026d0 0x7f2db0103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2daffff640 1 -- 172.21.15.18:0/3090754649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db0103ef0 con 0x7f2db0101d10 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2db53ae640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db01026d0 0x7f2db0103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2daffff640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db0101d10 0x7f2db01030f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00d770 tx=0x7f2d9c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2dadffb640 1 -- 172.21.15.18:0/3090754649 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c017070 con 0x7f2db0101d10 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2dadffb640 1 -- 172.21.15.18:0/3090754649 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d9c005500 con 0x7f2db0101d10 2024-09-19T09:50:56.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2db6e11640 1 -- 172.21.15.18:0/3090754649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db01a20d0 con 0x7f2db0101d10 2024-09-19T09:50:56.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2dadffb640 1 -- 172.21.15.18:0/3090754649 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c004e00 con 0x7f2db0101d10 2024-09-19T09:50:56.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.897+0000 7f2db6e11640 1 -- 172.21.15.18:0/3090754649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db01a2590 con 0x7f2db0101d10 2024-09-19T09:50:56.902 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:56 smithi049 ceph-mon[34858]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:50:56.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.898+0000 7f2db6e11640 1 -- 172.21.15.18:0/3090754649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db01a27c0 con 0x7f2db0101d10 2024-09-19T09:50:56.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.899+0000 7f2dadffb640 1 -- 172.21.15.18:0/3090754649 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2d9c004fa0 con 0x7f2db0101d10 2024-09-19T09:50:56.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.900+0000 7f2dadffb640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a32d0 0x7f2da00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:56.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.900+0000 7f2db4bad640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a32d0 0x7f2da00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:56.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.900+0000 7f2dadffb640 1 -- 172.21.15.18:0/3090754649 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f2d9c0cf350 con 0x7f2db0101d10 2024-09-19T09:50:56.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.901+0000 7f2db4bad640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a32d0 0x7f2da00a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2db0101b70 tx=0x7f2da400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:56.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:56.904+0000 7f2dadffb640 1 -- 172.21.15.18:0/3090754649 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2d9c09c0c0 con 0x7f2db0101d10 2024-09-19T09:50:56.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:56 smithi162 ceph-mon[35174]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:50:57.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.150+0000 7f2db6e11640 1 -- 172.21.15.18:0/3090754649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f2db01a2f00 con 0x7f2db0101d10 2024-09-19T09:50:57.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.153+0000 7f2dadffb640 1 -- 172.21.15.18:0/3090754649 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f2d9c09b9c0 con 0x7f2db0101d10 2024-09-19T09:50:57.157 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:50:57.157 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAB9OtmjWUPCRAAtRshNVhu09girxj/ts+JgA== 2024-09-19T09:50:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 -- 172.21.15.18:0/3090754649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a32d0 msgr2=0x7f2da00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a32d0 0x7f2da00a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2db0101b70 tx=0x7f2da400b390 comp rx=0 tx=0).stop 2024-09-19T09:50:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 -- 172.21.15.18:0/3090754649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db0101d10 msgr2=0x7f2db01030f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db0101d10 0x7f2db01030f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00d770 tx=0x7f2d9c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:50:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 -- 172.21.15.18:0/3090754649 shutdown_connections 2024-09-19T09:50:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2da00a32d0 0x7f2da00a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2db01026d0 0x7f2db0103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2db0101d10 0x7f2db01030f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 --2- 172.21.15.18:0/3090754649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db0100b10 0x7f2db0104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:57.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 -- 172.21.15.18:0/3090754649 >> 172.21.15.18:0/3090754649 conn(0x7f2db00fc2a0 msgr2=0x7f2db00fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:57.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 -- 172.21.15.18:0/3090754649 shutdown_connections 2024-09-19T09:50:57.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:57.155+0000 7f2db6e11640 1 -- 172.21.15.18:0/3090754649 wait complete. 2024-09-19T09:50:57.770 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:57 smithi018 ceph-mon[30956]: pgmap v295: 97 pgs: 97 active+clean; 633 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-09-19T09:50:57.771 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:57 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3090754649' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:50:57.771 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:57 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3090754649' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:50:57.799 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:50:57.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T09:50:57.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T09:50:57.838 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T09:50:57.838 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T09:50:57.838 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T09:50:57.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:57 smithi049 ceph-mon[34858]: pgmap v295: 97 pgs: 97 active+clean; 633 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-09-19T09:50:57.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:57 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3090754649' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:50:57.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:57 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3090754649' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:50:57.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:57 smithi162 ceph-mon[35174]: pgmap v295: 97 pgs: 97 active+clean; 633 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-09-19T09:50:57.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:57 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3090754649' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:50:57.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:57 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3090754649' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:50:58.140 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:58.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.580+0000 7f5a0d89c640 1 -- 172.21.15.18:0/3444162216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a08102ef0 msgr2=0x7f5a0810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:58.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.580+0000 7f5a0d89c640 1 --2- 172.21.15.18:0/3444162216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a08102ef0 0x7f5a0810da40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009ca0 tx=0x7f5a0002a950 comp rx=0 tx=0).stop 2024-09-19T09:50:58.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.580+0000 7f5a0d89c640 1 -- 172.21.15.18:0/3444162216 shutdown_connections 2024-09-19T09:50:58.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.580+0000 7f5a0d89c640 1 --2- 172.21.15.18:0/3444162216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a08102ef0 0x7f5a0810da40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:58.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.580+0000 7f5a0d89c640 1 --2- 172.21.15.18:0/3444162216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a08102570 0x7f5a081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:58.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.580+0000 7f5a0d89c640 1 --2- 172.21.15.18:0/3444162216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a08100e20 0x7f5a08101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:58.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.581+0000 7f5a0d89c640 1 -- 172.21.15.18:0/3444162216 >> 172.21.15.18:0/3444162216 conn(0x7f5a080fc7d0 msgr2=0x7f5a080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:58.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.581+0000 7f5a0d89c640 1 -- 172.21.15.18:0/3444162216 shutdown_connections 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.581+0000 7f5a0d89c640 1 -- 172.21.15.18:0/3444162216 wait complete. 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.581+0000 7f5a0d89c640 1 Processor -- start 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.581+0000 7f5a0d89c640 1 -- start start 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a0d89c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a08100e20 0x7f5a0819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a0d89c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a08102570 0x7f5a0819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a0d89c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a08102ef0 0x7f5a0819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a0d89c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a08110fa0 con 0x7f5a08100e20 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a0d89c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5a08110e20 con 0x7f5a08102570 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a0d89c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a08111120 con 0x7f5a08102ef0 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a06ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a08100e20 0x7f5a0819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a06ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a08100e20 0x7f5a0819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32976/0 (socket says 172.21.15.18:32976) 2024-09-19T09:50:58.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a06ffd640 1 -- 172.21.15.18:0/1386895758 learned_addr learned my addr 172.21.15.18:0/1386895758 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f59fffff640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a08102570 0x7f5a0819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a077fe640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a08102ef0 0x7f5a0819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a06ffd640 1 -- 172.21.15.18:0/1386895758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a08102ef0 msgr2=0x7f5a0819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a06ffd640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a08102ef0 0x7f5a0819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a06ffd640 1 -- 172.21.15.18:0/1386895758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a08102570 msgr2=0x7f5a0819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a06ffd640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a08102570 0x7f5a0819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a06ffd640 1 -- 172.21.15.18:0/1386895758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0819f620 con 0x7f5a08100e20 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a077fe640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a08102ef0 0x7f5a0819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.582+0000 7f5a06ffd640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a08100e20 0x7f5a0819a670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f59f800c920 tx=0x7f59f800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.583+0000 7f5a0c89a640 1 -- 172.21.15.18:0/1386895758 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8007bb0 con 0x7f5a08100e20 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.583+0000 7f5a0c89a640 1 -- 172.21.15.18:0/1386895758 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59f8007d50 con 0x7f5a08100e20 2024-09-19T09:50:58.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.583+0000 7f5a0d89c640 1 -- 172.21.15.18:0/1386895758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0819f910 con 0x7f5a08100e20 2024-09-19T09:50:58.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.583+0000 7f5a0c89a640 1 -- 172.21.15.18:0/1386895758 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f80187d0 con 0x7f5a08100e20 2024-09-19T09:50:58.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.583+0000 7f5a0d89c640 1 -- 172.21.15.18:0/1386895758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a081a71f0 con 0x7f5a08100e20 2024-09-19T09:50:58.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.584+0000 7f5a0d89c640 1 -- 172.21.15.18:0/1386895758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a08101200 con 0x7f5a08100e20 2024-09-19T09:50:58.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.585+0000 7f5a0c89a640 1 -- 172.21.15.18:0/1386895758 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f59f800f450 con 0x7f5a08100e20 2024-09-19T09:50:58.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.586+0000 7f5a0c89a640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f59f40a3350 0x7f59f40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:50:58.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.586+0000 7f59fffff640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f59f40a3350 0x7f59f40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:50:58.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.586+0000 7f5a0c89a640 1 -- 172.21.15.18:0/1386895758 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f59f80cfb30 con 0x7f5a08100e20 2024-09-19T09:50:58.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.586+0000 7f59fffff640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f59f40a3350 0x7f59f40a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5a0810ddf0 tx=0x7f59f0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:50:58.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.589+0000 7f5a0c89a640 1 -- 172.21.15.18:0/1386895758 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f59f8014030 con 0x7f5a08100e20 2024-09-19T09:50:58.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.815+0000 7f5a0d89c640 1 -- 172.21.15.18:0/1386895758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5a081a7480 con 0x7f5a08100e20 2024-09-19T09:50:58.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.820+0000 7f5a0c89a640 1 -- 172.21.15.18:0/1386895758 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264046 (secure 0 0 0) 0x7f59f801f300 con 0x7f5a08100e20 2024-09-19T09:50:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:50:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 -- 172.21.15.18:0/1386895758 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f59f40a3350 msgr2=0x7f59f40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f59f40a3350 0x7f59f40a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5a0810ddf0 tx=0x7f59f0009110 comp rx=0 tx=0).stop 2024-09-19T09:50:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 -- 172.21.15.18:0/1386895758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a08100e20 msgr2=0x7f5a0819a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:50:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a08100e20 0x7f5a0819a670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f59f800c920 tx=0x7f59f800cd20 comp rx=0 tx=0).stop 2024-09-19T09:50:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 -- 172.21.15.18:0/1386895758 shutdown_connections 2024-09-19T09:50:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f59f40a3350 0x7f59f40a5810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a08102ef0 0x7f5a0819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a08102570 0x7f5a0819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 --2- 172.21.15.18:0/1386895758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a08100e20 0x7f5a0819a670 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:50:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 -- 172.21.15.18:0/1386895758 >> 172.21.15.18:0/1386895758 conn(0x7f5a080fc7d0 msgr2=0x7f5a0806a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:50:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 -- 172.21.15.18:0/1386895758 shutdown_connections 2024-09-19T09:50:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:50:58.823+0000 7f5a0d89c640 1 -- 172.21.15.18:0/1386895758 wait complete. 2024-09-19T09:50:59.585 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":817115447},{"type":"v1","addr":"172.21.15.18:6801","nonce":817115447}]},"active_addr":"172.21.15.18:6801/817115447","active_change":"2024-09-19T09:43:30.259718+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.18:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":3119153448}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":155217648}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":3777931333}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":2724140338}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":3465241951}]}]} 2024-09-19T09:50:59.593 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T09:50:59.593 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T09:50:59.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:50:59.855 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:50:59.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:59 smithi018 ceph-mon[30956]: pgmap v296: 97 pgs: 97 active+clean; 633 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-19T09:50:59.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:50:59 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1386895758' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:50:59.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:59 smithi049 ceph-mon[34858]: pgmap v296: 97 pgs: 97 active+clean; 633 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-19T09:50:59.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:50:59 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1386895758' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:50:59.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:59 smithi162 ceph-mon[35174]: pgmap v296: 97 pgs: 97 active+clean; 633 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-19T09:50:59.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:50:59 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1386895758' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:51:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.342+0000 7f2fd2789640 1 -- 172.21.15.18:0/3792027745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc106f10 msgr2=0x7f2fcc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.342+0000 7f2fd2789640 1 --2- 172.21.15.18:0/3792027745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc106f10 0x7f2fcc10ea90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009ca0 tx=0x7f2fc402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.342+0000 7f2fd2789640 1 -- 172.21.15.18:0/3792027745 shutdown_connections 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.342+0000 7f2fd2789640 1 --2- 172.21.15.18:0/3792027745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc106f10 0x7f2fcc10ea90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.342+0000 7f2fd2789640 1 --2- 172.21.15.18:0/3792027745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc102790 0x7f2fcc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.342+0000 7f2fd2789640 1 --2- 172.21.15.18:0/3792027745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc101de0 0x7f2fcc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.342+0000 7f2fd2789640 1 -- 172.21.15.18:0/3792027745 >> 172.21.15.18:0/3792027745 conn(0x7f2fcc0fd8c0 msgr2=0x7f2fcc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.343+0000 7f2fd2789640 1 -- 172.21.15.18:0/3792027745 shutdown_connections 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.343+0000 7f2fd2789640 1 -- 172.21.15.18:0/3792027745 wait complete. 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.343+0000 7f2fd2789640 1 Processor -- start 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.343+0000 7f2fd2789640 1 -- start start 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fd2789640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc101de0 0x7f2fcc1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fd2789640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc102790 0x7f2fcc1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fd2789640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc106f10 0x7f2fcc19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fd2789640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc111f70 con 0x7f2fcc101de0 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fd2789640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc111df0 con 0x7f2fcc102790 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fd2789640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc1120f0 con 0x7f2fcc106f10 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fcbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc101de0 0x7f2fcc1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fcbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc101de0 0x7f2fcc1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32990/0 (socket says 172.21.15.18:32990) 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fcbfff640 1 -- 172.21.15.18:0/2122546470 learned_addr learned my addr 172.21.15.18:0/2122546470 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fcb7fe640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc102790 0x7f2fcc1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fd0d26640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc106f10 0x7f2fcc19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fcbfff640 1 -- 172.21.15.18:0/2122546470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc106f10 msgr2=0x7f2fcc19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fcbfff640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc106f10 0x7f2fcc19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fcbfff640 1 -- 172.21.15.18:0/2122546470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc102790 msgr2=0x7f2fcc1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fcbfff640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc102790 0x7f2fcc1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fcbfff640 1 -- 172.21.15.18:0/2122546470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc19d360 con 0x7f2fcc101de0 2024-09-19T09:51:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fcbfff640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc101de0 0x7f2fcc1983b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00d950 tx=0x7f2fbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fc97fa640 1 -- 172.21.15.18:0/2122546470 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc017070 con 0x7f2fcc101de0 2024-09-19T09:51:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fd2789640 1 -- 172.21.15.18:0/2122546470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fcc19d650 con 0x7f2fcc101de0 2024-09-19T09:51:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fc97fa640 1 -- 172.21.15.18:0/2122546470 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fbc009c30 con 0x7f2fcc101de0 2024-09-19T09:51:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.344+0000 7f2fc97fa640 1 -- 172.21.15.18:0/2122546470 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00f6b0 con 0x7f2fcc101de0 2024-09-19T09:51:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.345+0000 7f2fd2789640 1 -- 172.21.15.18:0/2122546470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fcc1a4f30 con 0x7f2fcc101de0 2024-09-19T09:51:00.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.346+0000 7f2fd2789640 1 -- 172.21.15.18:0/2122546470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fcc1021c0 con 0x7f2fcc101de0 2024-09-19T09:51:00.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.347+0000 7f2fc97fa640 1 -- 172.21.15.18:0/2122546470 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2fbc0109d0 con 0x7f2fcc101de0 2024-09-19T09:51:00.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.347+0000 7f2fc97fa640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fb40a32d0 0x7f2fb40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:00.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.347+0000 7f2fcb7fe640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fb40a32d0 0x7f2fb40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:00.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.347+0000 7f2fc97fa640 1 -- 172.21.15.18:0/2122546470 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f2fbc0cf4b0 con 0x7f2fcc101de0 2024-09-19T09:51:00.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.348+0000 7f2fcb7fe640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fb40a32d0 0x7f2fb40a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc1088e0 tx=0x7f2fc000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:00.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.352+0000 7f2fc97fa640 1 -- 172.21.15.18:0/2122546470 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2fbc009de0 con 0x7f2fcc101de0 2024-09-19T09:51:00.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.529+0000 7f2fd2789640 1 -- 172.21.15.18:0/2122546470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fcc109b60 con 0x7f2fcc101de0 2024-09-19T09:51:00.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.531+0000 7f2fc97fa640 1 -- 172.21.15.18:0/2122546470 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22240 (secure 0 0 0) 0x7f2fbc09bbd0 con 0x7f2fcc101de0 2024-09-19T09:51:00.533 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:00.533 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:50:29.937394+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:51:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 -- 172.21.15.18:0/2122546470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fb40a32d0 msgr2=0x7f2fb40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fb40a32d0 0x7f2fb40a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc1088e0 tx=0x7f2fc000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 -- 172.21.15.18:0/2122546470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc101de0 msgr2=0x7f2fcc1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc101de0 0x7f2fcc1983b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00d950 tx=0x7f2fbc00de10 comp rx=0 tx=0).stop 2024-09-19T09:51:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 -- 172.21.15.18:0/2122546470 shutdown_connections 2024-09-19T09:51:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fb40a32d0 0x7f2fb40a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc106f10 0x7f2fcc19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc102790 0x7f2fcc1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 --2- 172.21.15.18:0/2122546470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc101de0 0x7f2fcc1983b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 -- 172.21.15.18:0/2122546470 >> 172.21.15.18:0/2122546470 conn(0x7f2fcc0fd8c0 msgr2=0x7f2fcc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 -- 172.21.15.18:0/2122546470 shutdown_connections 2024-09-19T09:51:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:00.533+0000 7f2fd2789640 1 -- 172.21.15.18:0/2122546470 wait complete. 2024-09-19T09:51:01.247 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T09:51:01.247 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:51:01.511 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:01.633 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:01 smithi018 ceph-mon[30956]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.6 KiB/s wr, 14 op/s 2024-09-19T09:51:01.633 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:01 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2122546470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:51:01.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:01 smithi049 ceph-mon[34858]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.6 KiB/s wr, 14 op/s 2024-09-19T09:51:01.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:01 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2122546470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:51:01.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:01 smithi162 ceph-mon[35174]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.6 KiB/s wr, 14 op/s 2024-09-19T09:51:01.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:01 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2122546470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:51:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.003+0000 7f1a28787640 1 -- 172.21.15.18:0/841540250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a20102da0 msgr2=0x7f1a20103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.003+0000 7f1a28787640 1 --2- 172.21.15.18:0/841540250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a20102da0 0x7f1a20103180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009900 tx=0x7f1a1c02a480 comp rx=0 tx=0).stop 2024-09-19T09:51:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 -- 172.21.15.18:0/841540250 shutdown_connections 2024-09-19T09:51:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 --2- 172.21.15.18:0/841540250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a2010c180 0x7f1a2010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 --2- 172.21.15.18:0/841540250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a201036c0 0x7f1a2010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 --2- 172.21.15.18:0/841540250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a20102da0 0x7f1a20103180 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 -- 172.21.15.18:0/841540250 >> 172.21.15.18:0/841540250 conn(0x7f1a200fc7a0 msgr2=0x7f1a200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 -- 172.21.15.18:0/841540250 shutdown_connections 2024-09-19T09:51:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 -- 172.21.15.18:0/841540250 wait complete. 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 Processor -- start 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 -- start start 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a20102da0 0x7f1a201984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201036c0 0x7f1a20198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.004+0000 7f1a28787640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2010c180 0x7f1a2019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a28787640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20111fa0 con 0x7f1a201036c0 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a28787640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20111e20 con 0x7f1a2010c180 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a28787640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20112120 con 0x7f1a20102da0 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a25d22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201036c0 0x7f1a20198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a25d22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201036c0 0x7f1a20198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33012/0 (socket says 172.21.15.18:33012) 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a25d22640 1 -- 172.21.15.18:0/3502286001 learned_addr learned my addr 172.21.15.18:0/3502286001 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a26523640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a20102da0 0x7f1a201984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a26d24640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2010c180 0x7f1a2019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a25d22640 1 -- 172.21.15.18:0/3502286001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a20102da0 msgr2=0x7f1a201984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a25d22640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a20102da0 0x7f1a201984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a25d22640 1 -- 172.21.15.18:0/3502286001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2010c180 msgr2=0x7f1a2019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a25d22640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2010c180 0x7f1a2019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a25d22640 1 -- 172.21.15.18:0/3502286001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2019d470 con 0x7f1a201036c0 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a26d24640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2010c180 0x7f1a2019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a25d22640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201036c0 0x7f1a20198a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000b4a0 tx=0x7f1a1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a177fe640 1 -- 172.21.15.18:0/3502286001 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a10014070 con 0x7f1a201036c0 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a28787640 1 -- 172.21.15.18:0/3502286001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2019d760 con 0x7f1a201036c0 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a177fe640 1 -- 172.21.15.18:0/3502286001 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a10010af0 con 0x7f1a201036c0 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a177fe640 1 -- 172.21.15.18:0/3502286001 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a10017d10 con 0x7f1a201036c0 2024-09-19T09:51:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.005+0000 7f1a28787640 1 -- 172.21.15.18:0/3502286001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a201a5040 con 0x7f1a201036c0 2024-09-19T09:51:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.006+0000 7f1a28787640 1 -- 172.21.15.18:0/3502286001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a20103180 con 0x7f1a201036c0 2024-09-19T09:51:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.007+0000 7f1a177fe640 1 -- 172.21.15.18:0/3502286001 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1a10017070 con 0x7f1a201036c0 2024-09-19T09:51:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.008+0000 7f1a177fe640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a0c0a32d0 0x7f1a0c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.009+0000 7f1a26523640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a0c0a32d0 0x7f1a0c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.009+0000 7f1a177fe640 1 -- 172.21.15.18:0/3502286001 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f1a100cebb0 con 0x7f1a201036c0 2024-09-19T09:51:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.009+0000 7f1a26523640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a0c0a32d0 0x7f1a0c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c000c00 tx=0x7f1a1c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.013+0000 7f1a177fe640 1 -- 172.21.15.18:0/3502286001 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a100d5080 con 0x7f1a201036c0 2024-09-19T09:51:02.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.190+0000 7f1a28787640 1 -- 172.21.15.18:0/3502286001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a20106c70 con 0x7f1a201036c0 2024-09-19T09:51:02.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.192+0000 7f1a177fe640 1 -- 172.21.15.18:0/3502286001 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22240 (secure 0 0 0) 0x7f1a1009ba30 con 0x7f1a201036c0 2024-09-19T09:51:02.194 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:02.194 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:50:29.937394+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:51:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 -- 172.21.15.18:0/3502286001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a0c0a32d0 msgr2=0x7f1a0c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a0c0a32d0 0x7f1a0c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c000c00 tx=0x7f1a1c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:51:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 -- 172.21.15.18:0/3502286001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201036c0 msgr2=0x7f1a20198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201036c0 0x7f1a20198a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000b4a0 tx=0x7f1a1000b960 comp rx=0 tx=0).stop 2024-09-19T09:51:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 -- 172.21.15.18:0/3502286001 shutdown_connections 2024-09-19T09:51:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a0c0a32d0 0x7f1a0c0a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a2010c180 0x7f1a2019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a201036c0 0x7f1a20198a00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 --2- 172.21.15.18:0/3502286001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a20102da0 0x7f1a201984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:02.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 -- 172.21.15.18:0/3502286001 >> 172.21.15.18:0/3502286001 conn(0x7f1a200fc7a0 msgr2=0x7f1a200fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:02.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 -- 172.21.15.18:0/3502286001 shutdown_connections 2024-09-19T09:51:02.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:02.194+0000 7f1a28787640 1 -- 172.21.15.18:0/3502286001 wait complete. 2024-09-19T09:51:02.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:02 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3502286001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:51:02.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:02 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3502286001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:51:02.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:02 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3502286001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:51:02.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T09:51:02.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T09:51:02.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T09:51:02.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T09:51:02.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T09:51:02.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T09:51:02.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T09:51:02.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T09:51:02.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T09:51:02.924 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T09:51:02.924 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T09:51:02.924 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T09:51:03.693 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.704 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.705 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.709 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.719 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.736 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.739 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:03.843 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:03 smithi018 ceph-mon[30956]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T09:51:03.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:03 smithi049 ceph-mon[34858]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T09:51:03.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:03 smithi162 ceph-mon[35174]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T09:51:04.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.446+0000 7f36ce03b640 1 -- 172.21.15.18:0/2145321038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36c810c180 msgr2=0x7f36c810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:04.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.446+0000 7f36ce03b640 1 --2- 172.21.15.18:0/2145321038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36c810c180 0x7f36c810e600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009ca0 tx=0x7f36c002a950 comp rx=0 tx=0).stop 2024-09-19T09:51:04.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.446+0000 7f36ce03b640 1 -- 172.21.15.18:0/2145321038 shutdown_connections 2024-09-19T09:51:04.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.446+0000 7f36ce03b640 1 --2- 172.21.15.18:0/2145321038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36c810c180 0x7f36c810e600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:04.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.446+0000 7f36ce03b640 1 --2- 172.21.15.18:0/2145321038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36c81036c0 0x7f36c810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:04.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.446+0000 7f36ce03b640 1 --2- 172.21.15.18:0/2145321038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36c8102da0 0x7f36c8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:04.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.446+0000 7f36ce03b640 1 -- 172.21.15.18:0/2145321038 >> 172.21.15.18:0/2145321038 conn(0x7f36c80fc7a0 msgr2=0x7f36c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:04.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.446+0000 7f36ce03b640 1 -- 172.21.15.18:0/2145321038 shutdown_connections 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.446+0000 7f36ce03b640 1 -- 172.21.15.18:0/2145321038 wait complete. 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.446+0000 7f36ce03b640 1 Processor -- start 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36ce03b640 1 -- start start 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36ce03b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36c8102da0 0x7f36c8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36ce03b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36c81036c0 0x7f36c8198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36ce03b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36c810c180 0x7f36c819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36ce03b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36c8112020 con 0x7f36c8102da0 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36ce03b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f36c8111ea0 con 0x7f36c81036c0 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36ce03b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f36c81121a0 con 0x7f36c810c180 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36c8102da0 0x7f36c8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36c8102da0 0x7f36c8198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33020/0 (socket says 172.21.15.18:33020) 2024-09-19T09:51:04.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c77fe640 1 -- 172.21.15.18:0/1708738332 learned_addr learned my addr 172.21.15.18:0/1708738332 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c7fff640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36c810c180 0x7f36c819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c6ffd640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36c81036c0 0x7f36c8198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c77fe640 1 -- 172.21.15.18:0/1708738332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36c810c180 msgr2=0x7f36c819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c77fe640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36c810c180 0x7f36c819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c77fe640 1 -- 172.21.15.18:0/1708738332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36c81036c0 msgr2=0x7f36c8198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c77fe640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36c81036c0 0x7f36c8198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c77fe640 1 -- 172.21.15.18:0/1708738332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c819d510 con 0x7f36c8102da0 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c6ffd640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36c81036c0 0x7f36c8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.447+0000 7f36c77fe640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36c8102da0 0x7f36c8198560 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36b800b4a0 tx=0x7f36b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.448+0000 7f36c4ff9640 1 -- 172.21.15.18:0/1708738332 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8014070 con 0x7f36c8102da0 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.448+0000 7f36c4ff9640 1 -- 172.21.15.18:0/1708738332 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36b8010af0 con 0x7f36c8102da0 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.448+0000 7f36c4ff9640 1 -- 172.21.15.18:0/1708738332 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8017d10 con 0x7f36c8102da0 2024-09-19T09:51:04.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.448+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c819d800 con 0x7f36c8102da0 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.448+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c81a50e0 con 0x7f36c8102da0 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.448+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36c8062980 con 0x7f36c8102da0 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.450+0000 7f36c4ff9640 1 -- 172.21.15.18:0/1708738332 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f36b8017070 con 0x7f36c8102da0 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.450+0000 7f36c4ff9640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f36b00a32d0 0x7f36b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.451+0000 7f36c6ffd640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f36b00a32d0 0x7f36b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.451+0000 7f36c4ff9640 1 -- 172.21.15.18:0/1708738332 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f36b80cef80 con 0x7f36c8102da0 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.451+0000 7f36c4ff9640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] conn(0x7f36b00acb20 0x7f36b00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.451+0000 7f36c4ff9640 1 -- 172.21.15.18:0/1708738332 --> [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36b00af5f0 con 0x7f36b00acb20 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.451+0000 7f36c4ff9640 1 -- 172.21.15.18:0/1708738332 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f36b80cf460 con 0x7f36c8102da0 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.451+0000 7f36c6ffd640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f36b00a32d0 0x7f36b00a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36c80feea0 tx=0x7f36bc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.451+0000 7f36c7fff640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] conn(0x7f36b00acb20 0x7f36b00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:04.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.451+0000 7f36c7fff640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] conn(0x7f36b00acb20 0x7f36b00aef40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.452+0000 7f36c4ff9640 1 -- 172.21.15.18:0/1708738332 <== osd.8 v2:172.21.15.162:6816/2887612683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f36b00af5f0 con 0x7f36b00acb20 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.469+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 --> [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f36c8062e00 con 0x7f36b00acb20 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.469+0000 7f36c4ff9640 1 -- 172.21.15.18:0/1708738332 <== osd.8 v2:172.21.15.162:6816/2887612683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f36c8062e00 con 0x7f36b00acb20 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 >> [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] conn(0x7f36b00acb20 msgr2=0x7f36b00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36ce03b640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] conn(0x7f36b00acb20 0x7f36b00aef40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f36b00a32d0 msgr2=0x7f36b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36ce03b640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f36b00a32d0 0x7f36b00a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36c80feea0 tx=0x7f36bc008040 comp rx=0 tx=0).stop 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36c8102da0 msgr2=0x7f36c8198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36ce03b640 1 --2- 172.21.15.18:0/1708738332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36c8102da0 0x7f36c8198560 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36b800b4a0 tx=0x7f36b800b960 comp rx=0 tx=0).stop 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36c7fff640 1 -- 172.21.15.18:0/1708738332 reap_dead start 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 shutdown_connections 2024-09-19T09:51:04.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 >> 172.21.15.18:0/1708738332 conn(0x7f36c80fc7a0 msgr2=0x7f36c80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:04.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 shutdown_connections 2024-09-19T09:51:04.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:04.470+0000 7f36ce03b640 1 -- 172.21.15.18:0/1708738332 wait complete. 2024-09-19T09:51:05.600 INFO:teuthology.orchestra.run.smithi018.stdout:244813135907 2024-09-19T09:51:05.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T09:51:05.746 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:05 smithi018 ceph-mon[30956]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-19T09:51:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.744+0000 7f7ae7f44640 1 -- 172.21.15.18:0/801131704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ae01009b0 msgr2=0x7f7ae0100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.744+0000 7f7ae7f44640 1 --2- 172.21.15.18:0/801131704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ae01009b0 0x7f7ae0100d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009900 tx=0x7f7adc02a410 comp rx=0 tx=0).stop 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.744+0000 7f7ae7f44640 1 -- 172.21.15.18:0/801131704 shutdown_connections 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.744+0000 7f7ae7f44640 1 --2- 172.21.15.18:0/801131704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae010e4d0 0x7f7ae01108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.744+0000 7f7ae7f44640 1 --2- 172.21.15.18:0/801131704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0101360 0x7f7ae010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.744+0000 7f7ae7f44640 1 --2- 172.21.15.18:0/801131704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ae01009b0 0x7f7ae0100d90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.744+0000 7f7ae7f44640 1 -- 172.21.15.18:0/801131704 >> 172.21.15.18:0/801131704 conn(0x7f7ae00fc7d0 msgr2=0x7f7ae00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.744+0000 7f7ae7f44640 1 -- 172.21.15.18:0/801131704 shutdown_connections 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.744+0000 7f7ae7f44640 1 -- 172.21.15.18:0/801131704 wait complete. 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae7f44640 1 Processor -- start 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae7f44640 1 -- start start 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae7f44640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ae01009b0 0x7f7ae019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae7f44640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0101360 0x7f7ae019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae7f44640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae010e4d0 0x7f7ae019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae7f44640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0114230 con 0x7f7ae01009b0 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae7f44640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae01140b0 con 0x7f7ae0101360 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae7f44640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae01143b0 con 0x7f7ae010e4d0 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae5ce0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ae01009b0 0x7f7ae019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae5ce0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ae01009b0 0x7f7ae019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33048/0 (socket says 172.21.15.18:33048) 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae5ce0640 1 -- 172.21.15.18:0/1119114060 learned_addr learned my addr 172.21.15.18:0/1119114060 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.745+0000 7f7ae54df640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0101360 0x7f7ae019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ae64e1640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae010e4d0 0x7f7ae019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ae5ce0640 1 -- 172.21.15.18:0/1119114060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae010e4d0 msgr2=0x7f7ae019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ae5ce0640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ae010e4d0 0x7f7ae019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ae5ce0640 1 -- 172.21.15.18:0/1119114060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0101360 msgr2=0x7f7ae019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ae5ce0640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0101360 0x7f7ae019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ae5ce0640 1 -- 172.21.15.18:0/1119114060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae019f6e0 con 0x7f7ae01009b0 2024-09-19T09:51:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ae5ce0640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ae01009b0 0x7f7ae019a730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005ab0 tx=0x7f7adc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ad6ffd640 1 -- 172.21.15.18:0/1119114060 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc03f030 con 0x7f7ae01009b0 2024-09-19T09:51:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ad6ffd640 1 -- 172.21.15.18:0/1119114060 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7adc003ce0 con 0x7f7ae01009b0 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae019f970 con 0x7f7ae01009b0 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ad6ffd640 1 -- 172.21.15.18:0/1119114060 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc035070 con 0x7f7ae01009b0 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.746+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae01a72b0 con 0x7f7ae01009b0 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.747+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ae0062940 con 0x7f7ae01009b0 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.748+0000 7f7ad6ffd640 1 -- 172.21.15.18:0/1119114060 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7adc042030 con 0x7f7ae01009b0 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.749+0000 7f7ad6ffd640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7acc0a32d0 0x7f7acc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.749+0000 7f7ae54df640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7acc0a32d0 0x7f7acc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.749+0000 7f7ad6ffd640 1 -- 172.21.15.18:0/1119114060 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f7adc0f01c0 con 0x7f7ae01009b0 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.749+0000 7f7ad6ffd640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] conn(0x7f7acc0acb20 0x7f7acc0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.749+0000 7f7ad6ffd640 1 -- 172.21.15.18:0/1119114060 --> [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7adc02fec0 con 0x7f7acc0acb20 2024-09-19T09:51:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.750+0000 7f7ad6ffd640 1 -- 172.21.15.18:0/1119114060 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f7adc0f7050 con 0x7f7ae01009b0 2024-09-19T09:51:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.750+0000 7f7ae54df640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7acc0a32d0 0x7f7acc0a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7ae010e8f0 tx=0x7f7ad000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.750+0000 7f7ae64e1640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] conn(0x7f7acc0acb20 0x7f7acc0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.750+0000 7f7ae64e1640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] conn(0x7f7acc0acb20 0x7f7acc0aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.751+0000 7f7ad6ffd640 1 -- 172.21.15.18:0/1119114060 <== osd.7 v2:172.21.15.49:6816/3068141986 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7adc02fec0 con 0x7f7acc0acb20 2024-09-19T09:51:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.765+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 --> [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ae0062dc0 con 0x7f7acc0acb20 2024-09-19T09:51:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.765+0000 7f7ad6ffd640 1 -- 172.21.15.18:0/1119114060 <== osd.7 v2:172.21.15.49:6816/3068141986 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7ae0062dc0 con 0x7f7acc0acb20 2024-09-19T09:51:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 >> [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] conn(0x7f7acc0acb20 msgr2=0x7f7acc0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae7f44640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] conn(0x7f7acc0acb20 0x7f7acc0aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7acc0a32d0 msgr2=0x7f7acc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae7f44640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7acc0a32d0 0x7f7acc0a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7ae010e8f0 tx=0x7f7ad000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ae01009b0 msgr2=0x7f7ae019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae7f44640 1 --2- 172.21.15.18:0/1119114060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ae01009b0 0x7f7ae019a730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005ab0 tx=0x7f7adc0042f0 comp rx=0 tx=0).stop 2024-09-19T09:51:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae64e1640 1 -- 172.21.15.18:0/1119114060 reap_dead start 2024-09-19T09:51:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 shutdown_connections 2024-09-19T09:51:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 >> 172.21.15.18:0/1119114060 conn(0x7f7ae00fc7d0 msgr2=0x7f7ae00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 shutdown_connections 2024-09-19T09:51:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.766+0000 7f7ae7f44640 1 -- 172.21.15.18:0/1119114060 wait complete. 2024-09-19T09:51:05.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:05 smithi049 ceph-mon[34858]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-19T09:51:05.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:05 smithi162 ceph-mon[35174]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-09-19T09:51:07.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.598+0000 7f8258077640 1 -- 172.21.15.18:0/582895217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8250100e20 msgr2=0x7f8250101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.598+0000 7f8258077640 1 --2- 172.21.15.18:0/582895217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8250100e20 0x7f8250101200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f824c009900 tx=0x7f824c02a480 comp rx=0 tx=0).stop 2024-09-19T09:51:07.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.598+0000 7f8258077640 1 -- 172.21.15.18:0/582895217 shutdown_connections 2024-09-19T09:51:07.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.598+0000 7f8258077640 1 --2- 172.21.15.18:0/582895217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8250102ef0 0x7f825010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.598+0000 7f8258077640 1 --2- 172.21.15.18:0/582895217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8250102570 0x7f82501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.598+0000 7f8258077640 1 --2- 172.21.15.18:0/582895217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8250100e20 0x7f8250101200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.598+0000 7f8258077640 1 -- 172.21.15.18:0/582895217 >> 172.21.15.18:0/582895217 conn(0x7f82500fc7d0 msgr2=0x7f82500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.598+0000 7f8258077640 1 -- 172.21.15.18:0/582895217 shutdown_connections 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.598+0000 7f8258077640 1 -- 172.21.15.18:0/582895217 wait complete. 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8258077640 1 Processor -- start 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8258077640 1 -- start start 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8258077640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8250100e20 0x7f8250103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8258077640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8250102570 0x7f8250103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8258077640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8250102ef0 0x7f82501041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8258077640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8250110fd0 con 0x7f8250100e20 2024-09-19T09:51:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8258077640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8250110e50 con 0x7f8250102570 2024-09-19T09:51:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8258077640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8250111150 con 0x7f8250102ef0 2024-09-19T09:51:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8255e13640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8250100e20 0x7f8250103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8255e13640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8250100e20 0x7f8250103750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57906/0 (socket says 172.21.15.18:57906) 2024-09-19T09:51:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8255e13640 1 -- 172.21.15.18:0/1055753409 learned_addr learned my addr 172.21.15.18:0/1055753409 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8256614640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8250102ef0 0x7f82501041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8255612640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8250102570 0x7f8250103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8255e13640 1 -- 172.21.15.18:0/1055753409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8250102ef0 msgr2=0x7f82501041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8255e13640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8250102ef0 0x7f82501041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8255e13640 1 -- 172.21.15.18:0/1055753409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8250102570 msgr2=0x7f8250103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8255e13640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8250102570 0x7f8250103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8255e13640 1 -- 172.21.15.18:0/1055753409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82501a6920 con 0x7f8250100e20 2024-09-19T09:51:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.599+0000 7f8255612640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8250102570 0x7f8250103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.600+0000 7f8255e13640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8250100e20 0x7f8250103750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f824c02aa70 tx=0x7f824c003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.600+0000 7f8246ffd640 1 -- 172.21.15.18:0/1055753409 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c03f070 con 0x7f8250100e20 2024-09-19T09:51:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.600+0000 7f8246ffd640 1 -- 172.21.15.18:0/1055753409 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f824c031c20 con 0x7f8250100e20 2024-09-19T09:51:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.600+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82501a6bb0 con 0x7f8250100e20 2024-09-19T09:51:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.600+0000 7f8246ffd640 1 -- 172.21.15.18:0/1055753409 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c035030 con 0x7f8250100e20 2024-09-19T09:51:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.600+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82501a70e0 con 0x7f8250100e20 2024-09-19T09:51:07.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.601+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8250106bb0 con 0x7f8250100e20 2024-09-19T09:51:07.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.602+0000 7f8246ffd640 1 -- 172.21.15.18:0/1055753409 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f824c042070 con 0x7f8250100e20 2024-09-19T09:51:07.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.603+0000 7f8246ffd640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f823c0a3350 0x7f823c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:07.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.603+0000 7f8255612640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f823c0a3350 0x7f823c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:07.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.603+0000 7f8246ffd640 1 -- 172.21.15.18:0/1055753409 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f824c0f0570 con 0x7f8250100e20 2024-09-19T09:51:07.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.603+0000 7f8246ffd640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] conn(0x7f823c0acba0 0x7f823c0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:07.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.603+0000 7f8246ffd640 1 -- 172.21.15.18:0/1055753409 --> [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f824c046e50 con 0x7f823c0acba0 2024-09-19T09:51:07.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.603+0000 7f8246ffd640 1 -- 172.21.15.18:0/1055753409 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f824c0f0a50 con 0x7f8250100e20 2024-09-19T09:51:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.603+0000 7f8256614640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] conn(0x7f823c0acba0 0x7f823c0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.603+0000 7f8255612640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f823c0a3350 0x7f823c0a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f82400058c0 tx=0x7f8240005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.603+0000 7f8256614640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] conn(0x7f823c0acba0 0x7f823c0aefc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.604+0000 7f8246ffd640 1 -- 172.21.15.18:0/1055753409 <== osd.9 v2:172.21.15.18:6826/3527304690 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f824c046e50 con 0x7f823c0acba0 2024-09-19T09:51:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 --> [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82501021b0 con 0x7f823c0acba0 2024-09-19T09:51:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8246ffd640 1 -- 172.21.15.18:0/1055753409 <== osd.9 v2:172.21.15.18:6826/3527304690 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f82501021b0 con 0x7f823c0acba0 2024-09-19T09:51:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] conn(0x7f823c0acba0 msgr2=0x7f823c0aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8258077640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] conn(0x7f823c0acba0 0x7f823c0aefc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f823c0a3350 msgr2=0x7f823c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8258077640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f823c0a3350 0x7f823c0a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f82400058c0 tx=0x7f8240005850 comp rx=0 tx=0).stop 2024-09-19T09:51:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8250100e20 msgr2=0x7f8250103750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8258077640 1 --2- 172.21.15.18:0/1055753409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8250100e20 0x7f8250103750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f824c02aa70 tx=0x7f824c003b60 comp rx=0 tx=0).stop 2024-09-19T09:51:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8256614640 1 -- 172.21.15.18:0/1055753409 reap_dead start 2024-09-19T09:51:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 shutdown_connections 2024-09-19T09:51:07.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 >> 172.21.15.18:0/1055753409 conn(0x7f82500fc7d0 msgr2=0x7f825006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:07.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.619+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 shutdown_connections 2024-09-19T09:51:07.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:06.620+0000 7f8258077640 1 -- 172.21.15.18:0/1055753409 wait complete. 2024-09-19T09:51:07.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:07 smithi018 ceph-mon[30956]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-19T09:51:07.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.639+0000 7f9d70bda640 1 -- 172.21.15.18:0/3888137271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d6c100a80 msgr2=0x7f9d6c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.639+0000 7f9d70bda640 1 --2- 172.21.15.18:0/3888137271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d6c100a80 0x7f9d6c100ee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009930 tx=0x7f9d5402a420 comp rx=0 tx=0).stop 2024-09-19T09:51:07.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.639+0000 7f9d70bda640 1 -- 172.21.15.18:0/3888137271 shutdown_connections 2024-09-19T09:51:07.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.639+0000 7f9d70bda640 1 --2- 172.21.15.18:0/3888137271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d6c101420 0x7f9d6c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.639+0000 7f9d70bda640 1 --2- 172.21.15.18:0/3888137271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d6c100a80 0x7f9d6c100ee0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.639+0000 7f9d70bda640 1 --2- 172.21.15.18:0/3888137271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d6c106a80 0x7f9d6c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.639+0000 7f9d70bda640 1 -- 172.21.15.18:0/3888137271 >> 172.21.15.18:0/3888137271 conn(0x7f9d6c0fc7a0 msgr2=0x7f9d6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:07.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.639+0000 7f9d70bda640 1 -- 172.21.15.18:0/3888137271 shutdown_connections 2024-09-19T09:51:07.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.639+0000 7f9d70bda640 1 -- 172.21.15.18:0/3888137271 wait complete. 2024-09-19T09:51:07.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d70bda640 1 Processor -- start 2024-09-19T09:51:07.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d70bda640 1 -- start start 2024-09-19T09:51:07.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d70bda640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d6c100a80 0x7f9d6c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:07.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d70bda640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d6c101420 0x7f9d6c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:07.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d70bda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d6c106a80 0x7f9d6c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:07.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d70bda640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c110e40 con 0x7f9d6c106a80 2024-09-19T09:51:07.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d70bda640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c110cc0 con 0x7f9d6c100a80 2024-09-19T09:51:07.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d70bda640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c110fc0 con 0x7f9d6c101420 2024-09-19T09:51:07.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d6ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d6c106a80 0x7f9d6c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:07.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d6ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d6c106a80 0x7f9d6c19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57924/0 (socket says 172.21.15.18:57924) 2024-09-19T09:51:07.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d6ad9d640 1 -- 172.21.15.18:0/221695415 learned_addr learned my addr 172.21.15.18:0/221695415 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:07.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d6a59c640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d6c100a80 0x7f9d6c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:07.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.640+0000 7f9d63fff640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d6c101420 0x7f9d6c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:07.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d6ad9d640 1 -- 172.21.15.18:0/221695415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d6c101420 msgr2=0x7f9d6c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d6ad9d640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d6c101420 0x7f9d6c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d6ad9d640 1 -- 172.21.15.18:0/221695415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d6c100a80 msgr2=0x7f9d6c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d6ad9d640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d6c100a80 0x7f9d6c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d6ad9d640 1 -- 172.21.15.18:0/221695415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6c19d390 con 0x7f9d6c106a80 2024-09-19T09:51:07.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d6ad9d640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d6c106a80 0x7f9d6c19ccb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400eaa0 tx=0x7f9d6400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:07.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d637fe640 1 -- 172.21.15.18:0/221695415 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64004d20 con 0x7f9d6c106a80 2024-09-19T09:51:07.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d637fe640 1 -- 172.21.15.18:0/221695415 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d64005020 con 0x7f9d6c106a80 2024-09-19T09:51:07.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6c19d680 con 0x7f9d6c106a80 2024-09-19T09:51:07.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d637fe640 1 -- 172.21.15.18:0/221695415 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d640116d0 con 0x7f9d6c106a80 2024-09-19T09:51:07.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.641+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d6c1a4f60 con 0x7f9d6c106a80 2024-09-19T09:51:07.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.642+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d6c062980 con 0x7f9d6c106a80 2024-09-19T09:51:07.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.643+0000 7f9d637fe640 1 -- 172.21.15.18:0/221695415 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9d640051d0 con 0x7f9d6c106a80 2024-09-19T09:51:07.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.644+0000 7f9d637fe640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d580a32d0 0x7f9d580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:07.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.644+0000 7f9d6a59c640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d580a32d0 0x7f9d580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:07.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.644+0000 7f9d637fe640 1 -- 172.21.15.18:0/221695415 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f9d640cff50 con 0x7f9d6c106a80 2024-09-19T09:51:07.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.644+0000 7f9d637fe640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] conn(0x7f9d580acb20 0x7f9d580aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:07.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.644+0000 7f9d637fe640 1 -- 172.21.15.18:0/221695415 --> [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d64014ec0 con 0x7f9d580acb20 2024-09-19T09:51:07.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.644+0000 7f9d637fe640 1 -- 172.21.15.18:0/221695415 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f9d640d0430 con 0x7f9d6c106a80 2024-09-19T09:51:07.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.645+0000 7f9d6a59c640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d580a32d0 0x7f9d580a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00ab60 tx=0x7f9d5c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:07.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.645+0000 7f9d63fff640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] conn(0x7f9d580acb20 0x7f9d580aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:07.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.645+0000 7f9d63fff640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] conn(0x7f9d580acb20 0x7f9d580aef40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:07.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.646+0000 7f9d637fe640 1 -- 172.21.15.18:0/221695415 <== osd.5 v2:172.21.15.162:6808/2223869485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d64014ec0 con 0x7f9d580acb20 2024-09-19T09:51:07.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.660+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 --> [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9d6c062e00 con 0x7f9d580acb20 2024-09-19T09:51:07.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.660+0000 7f9d637fe640 1 -- 172.21.15.18:0/221695415 <== osd.5 v2:172.21.15.162:6808/2223869485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9d6c062e00 con 0x7f9d580acb20 2024-09-19T09:51:07.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 >> [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] conn(0x7f9d580acb20 msgr2=0x7f9d580aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d70bda640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] conn(0x7f9d580acb20 0x7f9d580aef40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d580a32d0 msgr2=0x7f9d580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d70bda640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9d580a32d0 0x7f9d580a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00ab60 tx=0x7f9d5c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d6c106a80 msgr2=0x7f9d6c19ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:07.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d70bda640 1 --2- 172.21.15.18:0/221695415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d6c106a80 0x7f9d6c19ccb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400eaa0 tx=0x7f9d6400eea0 comp rx=0 tx=0).stop 2024-09-19T09:51:07.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d6ad9d640 1 -- 172.21.15.18:0/221695415 reap_dead start 2024-09-19T09:51:07.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 shutdown_connections 2024-09-19T09:51:07.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 >> 172.21.15.18:0/221695415 conn(0x7f9d6c0fc7a0 msgr2=0x7f9d6c06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:07.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 shutdown_connections 2024-09-19T09:51:07.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:07.661+0000 7f9d70bda640 1 -- 172.21.15.18:0/221695415 wait complete. 2024-09-19T09:51:07.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:07 smithi049 ceph-mon[34858]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-19T09:51:07.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:07 smithi162 ceph-mon[35174]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-19T09:51:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.009+0000 7f1b10e26640 1 -- 172.21.15.18:0/1478501614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b0c106f10 msgr2=0x7f1b0c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.009+0000 7f1b10e26640 1 --2- 172.21.15.18:0/1478501614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b0c106f10 0x7f1b0c10ea90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009900 tx=0x7f1b0402a410 comp rx=0 tx=0).stop 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.009+0000 7f1b10e26640 1 -- 172.21.15.18:0/1478501614 shutdown_connections 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.009+0000 7f1b10e26640 1 --2- 172.21.15.18:0/1478501614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b0c106f10 0x7f1b0c10ea90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.009+0000 7f1b10e26640 1 --2- 172.21.15.18:0/1478501614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b0c102790 0x7f1b0c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.009+0000 7f1b10e26640 1 --2- 172.21.15.18:0/1478501614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b0c101de0 0x7f1b0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.009+0000 7f1b10e26640 1 -- 172.21.15.18:0/1478501614 >> 172.21.15.18:0/1478501614 conn(0x7f1b0c0fd8c0 msgr2=0x7f1b0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.010+0000 7f1b10e26640 1 -- 172.21.15.18:0/1478501614 shutdown_connections 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.010+0000 7f1b10e26640 1 -- 172.21.15.18:0/1478501614 wait complete. 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.010+0000 7f1b10e26640 1 Processor -- start 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.010+0000 7f1b10e26640 1 -- start start 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.010+0000 7f1b10e26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b0c101de0 0x7f1b0c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b10e26640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b0c102790 0x7f1b0c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b10e26640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b0c106f10 0x7f1b0c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b10e26640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c111f70 con 0x7f1b0c101de0 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b10e26640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c111df0 con 0x7f1b0c102790 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b10e26640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c1120f0 con 0x7f1b0c106f10 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b0a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b0c101de0 0x7f1b0c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b0a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b0c101de0 0x7f1b0c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57946/0 (socket says 172.21.15.18:57946) 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b0a59c640 1 -- 172.21.15.18:0/4082658496 learned_addr learned my addr 172.21.15.18:0/4082658496 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b09d9b640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b0c102790 0x7f1b0c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b0ad9d640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b0c106f10 0x7f1b0c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b0a59c640 1 -- 172.21.15.18:0/4082658496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b0c106f10 msgr2=0x7f1b0c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b0a59c640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b0c106f10 0x7f1b0c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b0a59c640 1 -- 172.21.15.18:0/4082658496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b0c102790 msgr2=0x7f1b0c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b0a59c640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b0c102790 0x7f1b0c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b0a59c640 1 -- 172.21.15.18:0/4082658496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c1a6870 con 0x7f1b0c101de0 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b0a59c640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b0c101de0 0x7f1b0c0744f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00cce0 tx=0x7f1afc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b037fe640 1 -- 172.21.15.18:0/4082658496 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc004b20 con 0x7f1b0c101de0 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c1a6b60 con 0x7f1b0c101de0 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b037fe640 1 -- 172.21.15.18:0/4082658496 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1afc004cc0 con 0x7f1b0c101de0 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b037fe640 1 -- 172.21.15.18:0/4082658496 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc00f7d0 con 0x7f1b0c101de0 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.011+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c1a70f0 con 0x7f1b0c101de0 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.012+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b0c0628c0 con 0x7f1b0c101de0 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.013+0000 7f1b037fe640 1 -- 172.21.15.18:0/4082658496 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1afc00f970 con 0x7f1b0c101de0 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.014+0000 7f1b037fe640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1af80a32d0 0x7f1af80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:08.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.014+0000 7f1b09d9b640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1af80a32d0 0x7f1af80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.014+0000 7f1b037fe640 1 -- 172.21.15.18:0/4082658496 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f1afc0cfe20 con 0x7f1b0c101de0 2024-09-19T09:51:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.015+0000 7f1b037fe640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] conn(0x7f1af80acb20 0x7f1af80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.015+0000 7f1b037fe640 1 -- 172.21.15.18:0/4082658496 --> [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1af80af5f0 con 0x7f1af80acb20 2024-09-19T09:51:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.015+0000 7f1b037fe640 1 -- 172.21.15.18:0/4082658496 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f1afc0d01d0 con 0x7f1b0c101de0 2024-09-19T09:51:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.015+0000 7f1b0ad9d640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] conn(0x7f1af80acb20 0x7f1af80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.015+0000 7f1b09d9b640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1af80a32d0 0x7f1af80a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c075f80 tx=0x7f1af400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.015+0000 7f1b0ad9d640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] conn(0x7f1af80acb20 0x7f1af80aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.016+0000 7f1b037fe640 1 -- 172.21.15.18:0/4082658496 <== osd.3 v2:172.21.15.18:6810/2371576209 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1af80af5f0 con 0x7f1af80acb20 2024-09-19T09:51:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.029+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 --> [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1b0c062cc0 con 0x7f1af80acb20 2024-09-19T09:51:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b037fe640 1 -- 172.21.15.18:0/4082658496 <== osd.3 v2:172.21.15.18:6810/2371576209 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1b0c062cc0 con 0x7f1af80acb20 2024-09-19T09:51:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] conn(0x7f1af80acb20 msgr2=0x7f1af80aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b10e26640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] conn(0x7f1af80acb20 0x7f1af80aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1af80a32d0 msgr2=0x7f1af80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b10e26640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1af80a32d0 0x7f1af80a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c075f80 tx=0x7f1af400b390 comp rx=0 tx=0).stop 2024-09-19T09:51:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b0c101de0 msgr2=0x7f1b0c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b10e26640 1 --2- 172.21.15.18:0/4082658496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b0c101de0 0x7f1b0c0744f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00cce0 tx=0x7f1afc00a620 comp rx=0 tx=0).stop 2024-09-19T09:51:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b0ad9d640 1 -- 172.21.15.18:0/4082658496 reap_dead start 2024-09-19T09:51:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 shutdown_connections 2024-09-19T09:51:08.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 >> 172.21.15.18:0/4082658496 conn(0x7f1b0c0fd8c0 msgr2=0x7f1b0c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:08.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 shutdown_connections 2024-09-19T09:51:08.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.030+0000 7f1b10e26640 1 -- 172.21.15.18:0/4082658496 wait complete. 2024-09-19T09:51:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.854+0000 7f4793c50640 1 -- 172.21.15.18:0/2009552663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f478c101de0 msgr2=0x7f478c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.854+0000 7f4793c50640 1 --2- 172.21.15.18:0/2009552663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f478c101de0 0x7f478c1021c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4788009900 tx=0x7f478802a410 comp rx=0 tx=0).stop 2024-09-19T09:51:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.854+0000 7f4793c50640 1 -- 172.21.15.18:0/2009552663 shutdown_connections 2024-09-19T09:51:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.854+0000 7f4793c50640 1 --2- 172.21.15.18:0/2009552663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f478c106f10 0x7f478c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 --2- 172.21.15.18:0/2009552663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c102790 0x7f478c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 --2- 172.21.15.18:0/2009552663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f478c101de0 0x7f478c1021c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 -- 172.21.15.18:0/2009552663 >> 172.21.15.18:0/2009552663 conn(0x7f478c0fd8c0 msgr2=0x7f478c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 -- 172.21.15.18:0/2009552663 shutdown_connections 2024-09-19T09:51:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 -- 172.21.15.18:0/2009552663 wait complete. 2024-09-19T09:51:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 Processor -- start 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 -- start start 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f478c101de0 0x7f478c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c102790 0x7f478c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f478c106f10 0x7f478c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f478c111f30 con 0x7f478c101de0 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f478c111db0 con 0x7f478c106f10 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.855+0000 7f4793c50640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f478c1120b0 con 0x7f478c102790 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47919ec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f478c101de0 0x7f478c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47919ec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f478c101de0 0x7f478c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33070/0 (socket says 172.21.15.18:33070) 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47919ec640 1 -- 172.21.15.18:0/2372464287 learned_addr learned my addr 172.21.15.18:0/2372464287 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47921ed640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f478c106f10 0x7f478c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47919ec640 1 -- 172.21.15.18:0/2372464287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c102790 msgr2=0x7f478c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47911eb640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c102790 0x7f478c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47919ec640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c102790 0x7f478c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47919ec640 1 -- 172.21.15.18:0/2372464287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f478c106f10 msgr2=0x7f478c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47919ec640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f478c106f10 0x7f478c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47919ec640 1 -- 172.21.15.18:0/2372464287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c19d410 con 0x7f478c101de0 2024-09-19T09:51:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47921ed640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f478c106f10 0x7f478c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47911eb640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478c102790 0x7f478c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f47919ec640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f478c101de0 0x7f478c198460 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4788006010 tx=0x7f47880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f4782ffd640 1 -- 172.21.15.18:0/2372464287 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478803f030 con 0x7f478c101de0 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478c19d6a0 con 0x7f478c101de0 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f4782ffd640 1 -- 172.21.15.18:0/2372464287 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4788003ce0 con 0x7f478c101de0 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f4782ffd640 1 -- 172.21.15.18:0/2372464287 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788035070 con 0x7f478c101de0 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.856+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478c1a4fe0 con 0x7f478c101de0 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.857+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f478c062980 con 0x7f478c101de0 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.859+0000 7f4782ffd640 1 -- 172.21.15.18:0/2372464287 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4788042030 con 0x7f478c101de0 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.859+0000 7f4782ffd640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47780a32d0 0x7f47780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.859+0000 7f47911eb640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47780a32d0 0x7f47780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.859+0000 7f4782ffd640 1 -- 172.21.15.18:0/2372464287 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f47880f0500 con 0x7f478c101de0 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.860+0000 7f4782ffd640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] conn(0x7f47780acb20 0x7f47780aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.860+0000 7f4782ffd640 1 -- 172.21.15.18:0/2372464287 --> [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4788036e90 con 0x7f47780acb20 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.860+0000 7f4782ffd640 1 -- 172.21.15.18:0/2372464287 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f47880f09e0 con 0x7f478c101de0 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.860+0000 7f47911eb640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47780a32d0 0x7f47780a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f477c005d00 tx=0x7f477c009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.860+0000 7f47921ed640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] conn(0x7f47780acb20 0x7f47780aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.860+0000 7f47921ed640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] conn(0x7f47780acb20 0x7f47780aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.861+0000 7f4782ffd640 1 -- 172.21.15.18:0/2372464287 <== osd.1 v2:172.21.15.49:6800/368229306 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4788036e90 con 0x7f47780acb20 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.875+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 --> [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f478c062d80 con 0x7f47780acb20 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.875+0000 7f4782ffd640 1 -- 172.21.15.18:0/2372464287 <== osd.1 v2:172.21.15.49:6800/368229306 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f478c062d80 con 0x7f47780acb20 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 >> [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] conn(0x7f47780acb20 msgr2=0x7f47780aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f4793c50640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] conn(0x7f47780acb20 0x7f47780aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47780a32d0 msgr2=0x7f47780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f4793c50640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47780a32d0 0x7f47780a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f477c005d00 tx=0x7f477c009550 comp rx=0 tx=0).stop 2024-09-19T09:51:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f478c101de0 msgr2=0x7f478c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f4793c50640 1 --2- 172.21.15.18:0/2372464287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f478c101de0 0x7f478c198460 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4788006010 tx=0x7f47880042f0 comp rx=0 tx=0).stop 2024-09-19T09:51:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f47921ed640 1 -- 172.21.15.18:0/2372464287 reap_dead start 2024-09-19T09:51:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 shutdown_connections 2024-09-19T09:51:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 >> 172.21.15.18:0/2372464287 conn(0x7f478c0fd8c0 msgr2=0x7f478c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 shutdown_connections 2024-09-19T09:51:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:05.876+0000 7f4793c50640 1 -- 172.21.15.18:0/2372464287 wait complete. 2024-09-19T09:51:09.282 INFO:teuthology.orchestra.run.smithi018.stdout:55834574919 2024-09-19T09:51:09.282 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T09:51:09.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.455+0000 7f22a38ca640 1 -- 172.21.15.18:0/1878254704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f229c1082a0 msgr2=0x7f229c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.455+0000 7f22a38ca640 1 --2- 172.21.15.18:0/1878254704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f229c1082a0 0x7f229c10ec40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2294009cd0 tx=0x7f229402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.455+0000 7f22a38ca640 1 -- 172.21.15.18:0/1878254704 shutdown_connections 2024-09-19T09:51:09.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.455+0000 7f22a38ca640 1 --2- 172.21.15.18:0/1878254704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f229c1082a0 0x7f229c10ec40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.455+0000 7f22a38ca640 1 --2- 172.21.15.18:0/1878254704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f229c1036e0 0x7f229c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.455+0000 7f22a38ca640 1 --2- 172.21.15.18:0/1878254704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229c102d30 0x7f229c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.455+0000 7f22a38ca640 1 -- 172.21.15.18:0/1878254704 >> 172.21.15.18:0/1878254704 conn(0x7f229c0fc7d0 msgr2=0x7f229c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:09.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.455+0000 7f22a38ca640 1 -- 172.21.15.18:0/1878254704 shutdown_connections 2024-09-19T09:51:09.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.455+0000 7f22a38ca640 1 -- 172.21.15.18:0/1878254704 wait complete. 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a38ca640 1 Processor -- start 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a38ca640 1 -- start start 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a38ca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f229c102d30 0x7f229c1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a38ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229c1036e0 0x7f229c1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a38ca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f229c1082a0 0x7f229c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a38ca640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f229c1120a0 con 0x7f229c1082a0 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a38ca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f229c111f20 con 0x7f229c1036e0 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a38ca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f229c112220 con 0x7f229c102d30 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a0e65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229c1036e0 0x7f229c1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a0e65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229c1036e0 0x7f229c1a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43642/0 (socket says 172.21.15.18:43642) 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.456+0000 7f22a0e65640 1 -- 172.21.15.18:0/529622797 learned_addr learned my addr 172.21.15.18:0/529622797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:09.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a1666640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f229c102d30 0x7f229c1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a1e67640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f229c1082a0 0x7f229c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a0e65640 1 -- 172.21.15.18:0/529622797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f229c102d30 msgr2=0x7f229c1a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a0e65640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f229c102d30 0x7f229c1a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a0e65640 1 -- 172.21.15.18:0/529622797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f229c1082a0 msgr2=0x7f229c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a0e65640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f229c1082a0 0x7f229c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a0e65640 1 -- 172.21.15.18:0/529622797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229c19acf0 con 0x7f229c1036e0 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a1666640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f229c102d30 0x7f229c1a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a0e65640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229c1036e0 0x7f229c1a0940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f228c00e9c0 tx=0x7f228c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22927fc640 1 -- 172.21.15.18:0/529622797 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c00ccc0 con 0x7f229c1036e0 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229c19afe0 con 0x7f229c1036e0 2024-09-19T09:51:09.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22927fc640 1 -- 172.21.15.18:0/529622797 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f228c005500 con 0x7f229c1036e0 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22927fc640 1 -- 172.21.15.18:0/529622797 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c010690 con 0x7f229c1036e0 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.457+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f229c1a72d0 con 0x7f229c1036e0 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.458+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f229c102330 con 0x7f229c1036e0 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.460+0000 7f22927fc640 1 -- 172.21.15.18:0/529622797 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f228c004e80 con 0x7f229c1036e0 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.461+0000 7f22927fc640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22880a32d0 0x7f22880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.461+0000 7f22a1666640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22880a32d0 0x7f22880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.461+0000 7f22927fc640 1 -- 172.21.15.18:0/529622797 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f228c0d00d0 con 0x7f229c1036e0 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.461+0000 7f22927fc640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] conn(0x7f22880acb20 0x7f22880aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.461+0000 7f22927fc640 1 -- 172.21.15.18:0/529622797 --> [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f228c017e50 con 0x7f22880acb20 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.461+0000 7f22927fc640 1 -- 172.21.15.18:0/529622797 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f228c0d0530 con 0x7f229c1036e0 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.461+0000 7f22a1666640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22880a32d0 0x7f22880a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2298005d00 tx=0x7f229800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:09.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.461+0000 7f22a1e67640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] conn(0x7f22880acb20 0x7f22880aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:09.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.462+0000 7f22a1e67640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] conn(0x7f22880acb20 0x7f22880aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:09.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.463+0000 7f22927fc640 1 -- 172.21.15.18:0/529622797 <== osd.2 v2:172.21.15.162:6800/1401721539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f228c017e50 con 0x7f22880acb20 2024-09-19T09:51:09.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.477+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 --> [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f229c06a850 con 0x7f22880acb20 2024-09-19T09:51:09.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.477+0000 7f22927fc640 1 -- 172.21.15.18:0/529622797 <== osd.2 v2:172.21.15.162:6800/1401721539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f229c06a850 con 0x7f22880acb20 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 >> [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] conn(0x7f22880acb20 msgr2=0x7f22880aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a38ca640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] conn(0x7f22880acb20 0x7f22880aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22880a32d0 msgr2=0x7f22880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a38ca640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22880a32d0 0x7f22880a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2298005d00 tx=0x7f229800b410 comp rx=0 tx=0).stop 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229c1036e0 msgr2=0x7f229c1a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a38ca640 1 --2- 172.21.15.18:0/529622797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f229c1036e0 0x7f229c1a0940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f228c00e9c0 tx=0x7f228c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a1e67640 1 -- 172.21.15.18:0/529622797 reap_dead start 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 shutdown_connections 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 >> 172.21.15.18:0/529622797 conn(0x7f229c0fc7d0 msgr2=0x7f229c1008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 shutdown_connections 2024-09-19T09:51:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:09.478+0000 7f22a38ca640 1 -- 172.21.15.18:0/529622797 wait complete. 2024-09-19T09:51:09.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:09 smithi018 ceph-mon[30956]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T09:51:09.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.134+0000 7f57a28fa640 1 -- 172.21.15.18:0/4162632723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579c106a80 msgr2=0x7f579c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.134+0000 7f57a28fa640 1 --2- 172.21.15.18:0/4162632723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579c106a80 0x7f579c106e60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f578c009930 tx=0x7f578c02a420 comp rx=0 tx=0).stop 2024-09-19T09:51:09.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.134+0000 7f57a28fa640 1 -- 172.21.15.18:0/4162632723 shutdown_connections 2024-09-19T09:51:09.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.134+0000 7f57a28fa640 1 --2- 172.21.15.18:0/4162632723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f579c101420 0x7f579c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.134+0000 7f57a28fa640 1 --2- 172.21.15.18:0/4162632723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c100a80 0x7f579c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.134+0000 7f57a28fa640 1 --2- 172.21.15.18:0/4162632723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579c106a80 0x7f579c106e60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.134+0000 7f57a28fa640 1 -- 172.21.15.18:0/4162632723 >> 172.21.15.18:0/4162632723 conn(0x7f579c0fc7a0 msgr2=0x7f579c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.134+0000 7f57a28fa640 1 -- 172.21.15.18:0/4162632723 shutdown_connections 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.134+0000 7f57a28fa640 1 -- 172.21.15.18:0/4162632723 wait complete. 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.135+0000 7f57a28fa640 1 Processor -- start 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.135+0000 7f57a28fa640 1 -- start start 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f57a28fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579c100a80 0x7f579c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f57a28fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f579c101420 0x7f579c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f57a28fa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c106a80 0x7f579c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f57a28fa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f579c111fa0 con 0x7f579c100a80 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f57a28fa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f579c111e20 con 0x7f579c106a80 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f57a28fa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f579c112120 con 0x7f579c101420 2024-09-19T09:51:09.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f579bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579c100a80 0x7f579c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f579bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579c100a80 0x7f579c1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57950/0 (socket says 172.21.15.18:57950) 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f579bfff640 1 -- 172.21.15.18:0/1615591357 learned_addr learned my addr 172.21.15.18:0/1615591357 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f57a0e97640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c106a80 0x7f579c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f579b7fe640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f579c101420 0x7f579c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f579bfff640 1 -- 172.21.15.18:0/1615591357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f579c101420 msgr2=0x7f579c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f579bfff640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f579c101420 0x7f579c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f579bfff640 1 -- 172.21.15.18:0/1615591357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c106a80 msgr2=0x7f579c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f579bfff640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f579c106a80 0x7f579c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f579bfff640 1 -- 172.21.15.18:0/1615591357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c19d390 con 0x7f579c100a80 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f579bfff640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579c100a80 0x7f579c1983e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f578c009230 tx=0x7f578c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f57997fa640 1 -- 172.21.15.18:0/1615591357 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c03f030 con 0x7f579c100a80 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.136+0000 7f57997fa640 1 -- 172.21.15.18:0/1615591357 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f578c003ad0 con 0x7f579c100a80 2024-09-19T09:51:09.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.137+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579c19d620 con 0x7f579c100a80 2024-09-19T09:51:09.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.137+0000 7f57997fa640 1 -- 172.21.15.18:0/1615591357 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c035070 con 0x7f579c100a80 2024-09-19T09:51:09.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.137+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579c1a4f60 con 0x7f579c100a80 2024-09-19T09:51:09.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.137+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f579c0fe940 con 0x7f579c100a80 2024-09-19T09:51:09.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.139+0000 7f57997fa640 1 -- 172.21.15.18:0/1615591357 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f578c042030 con 0x7f579c100a80 2024-09-19T09:51:09.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.139+0000 7f57997fa640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57840a3350 0x7f57840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.140+0000 7f579b7fe640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57840a3350 0x7f57840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.140+0000 7f57997fa640 1 -- 172.21.15.18:0/1615591357 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f578c0f0360 con 0x7f579c100a80 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.140+0000 7f57997fa640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] conn(0x7f57840acba0 0x7f57840aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.140+0000 7f57997fa640 1 -- 172.21.15.18:0/1615591357 --> [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f578c007e80 con 0x7f57840acba0 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.140+0000 7f57997fa640 1 -- 172.21.15.18:0/1615591357 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f578c0f0840 con 0x7f579c100a80 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.140+0000 7f579b7fe640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57840a3350 0x7f57840a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f579c1060f0 tx=0x7f5790005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.140+0000 7f57a0e97640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] conn(0x7f57840acba0 0x7f57840aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.141+0000 7f57a0e97640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] conn(0x7f57840acba0 0x7f57840aefc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.142+0000 7f57997fa640 1 -- 172.21.15.18:0/1615591357 <== osd.4 v2:172.21.15.49:6808/3971547728 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f578c007e80 con 0x7f57840acba0 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.155+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 --> [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f579c1021c0 con 0x7f57840acba0 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57997fa640 1 -- 172.21.15.18:0/1615591357 <== osd.4 v2:172.21.15.49:6808/3971547728 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f579c1021c0 con 0x7f57840acba0 2024-09-19T09:51:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 >> [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] conn(0x7f57840acba0 msgr2=0x7f57840aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a28fa640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] conn(0x7f57840acba0 0x7f57840aefc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57840a3350 msgr2=0x7f57840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a28fa640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57840a3350 0x7f57840a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f579c1060f0 tx=0x7f5790005f90 comp rx=0 tx=0).stop 2024-09-19T09:51:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579c100a80 msgr2=0x7f579c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a28fa640 1 --2- 172.21.15.18:0/1615591357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f579c100a80 0x7f579c1983e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f578c009230 tx=0x7f578c004270 comp rx=0 tx=0).stop 2024-09-19T09:51:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a0e97640 1 -- 172.21.15.18:0/1615591357 reap_dead start 2024-09-19T09:51:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 shutdown_connections 2024-09-19T09:51:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 >> 172.21.15.18:0/1615591357 conn(0x7f579c0fc7a0 msgr2=0x7f579c0fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 shutdown_connections 2024-09-19T09:51:09.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:08.156+0000 7f57a28fa640 1 -- 172.21.15.18:0/1615591357 wait complete. 2024-09-19T09:51:09.805 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:09.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:09 smithi049 ceph-mon[34858]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T09:51:09.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:09 smithi162 ceph-mon[35174]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T09:51:11.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.116+0000 7fbb39193640 1 -- 172.21.15.18:0/308058697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb341002f0 msgr2=0x7fbb341006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.116+0000 7fbb39193640 1 --2- 172.21.15.18:0/308058697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb341002f0 0x7fbb341006d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009930 tx=0x7fbb2402a420 comp rx=0 tx=0).stop 2024-09-19T09:51:11.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.116+0000 7fbb39193640 1 -- 172.21.15.18:0/308058697 shutdown_connections 2024-09-19T09:51:11.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.116+0000 7fbb39193640 1 --2- 172.21.15.18:0/308058697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb34106f50 0x7fbb3410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.116+0000 7fbb39193640 1 --2- 172.21.15.18:0/308058697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb34100ca0 0x7fbb34106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.116+0000 7fbb39193640 1 --2- 172.21.15.18:0/308058697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb341002f0 0x7fbb341006d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.116+0000 7fbb39193640 1 -- 172.21.15.18:0/308058697 >> 172.21.15.18:0/308058697 conn(0x7fbb34077210 msgr2=0x7fbb340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.116+0000 7fbb39193640 1 -- 172.21.15.18:0/308058697 shutdown_connections 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.116+0000 7fbb39193640 1 -- 172.21.15.18:0/308058697 wait complete. 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb39193640 1 Processor -- start 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb39193640 1 -- start start 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb39193640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb341002f0 0x7fbb34101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb39193640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb34100ca0 0x7fbb341017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb39193640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb34106f50 0x7fbb34101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb39193640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34111fa0 con 0x7fbb34106f50 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb39193640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34111e20 con 0x7fbb341002f0 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb39193640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34112120 con 0x7fbb34100ca0 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb3359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb34106f50 0x7fbb34101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb3359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb34106f50 0x7fbb34101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57994/0 (socket says 172.21.15.18:57994) 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb3359e640 1 -- 172.21.15.18:0/1506359940 learned_addr learned my addr 172.21.15.18:0/1506359940 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb32d9d640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb341002f0 0x7fbb34101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.117+0000 7fbb3259c640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb34100ca0 0x7fbb341017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb3359e640 1 -- 172.21.15.18:0/1506359940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb34100ca0 msgr2=0x7fbb341017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb3359e640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb34100ca0 0x7fbb341017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb3359e640 1 -- 172.21.15.18:0/1506359940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb341002f0 msgr2=0x7fbb34101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb3359e640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb341002f0 0x7fbb34101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb3359e640 1 -- 172.21.15.18:0/1506359940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb341a6970 con 0x7fbb34106f50 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb3359e640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb34106f50 0x7fbb34101cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00eaa0 tx=0x7fbb2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb1bfff640 1 -- 172.21.15.18:0/1506359940 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c00cdb0 con 0x7fbb34106f50 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb341a6c60 con 0x7fbb34106f50 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb1bfff640 1 -- 172.21.15.18:0/1506359940 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb2c005020 con 0x7fbb34106f50 2024-09-19T09:51:11.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb1bfff640 1 -- 172.21.15.18:0/1506359940 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0116b0 con 0x7fbb34106f50 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.118+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb341a71a0 con 0x7fbb34106f50 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.119+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb340628c0 con 0x7fbb34106f50 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.120+0000 7fbb1bfff640 1 -- 172.21.15.18:0/1506359940 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbb2c005560 con 0x7fbb34106f50 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.121+0000 7fbb1bfff640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbb1c0a32d0 0x7fbb1c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.121+0000 7fbb32d9d640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbb1c0a32d0 0x7fbb1c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.121+0000 7fbb1bfff640 1 -- 172.21.15.18:0/1506359940 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fbb2c0d0000 con 0x7fbb34106f50 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.121+0000 7fbb1bfff640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] conn(0x7fbb1c0acb20 0x7fbb1c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.121+0000 7fbb1bfff640 1 -- 172.21.15.18:0/1506359940 --> [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb2c014ec0 con 0x7fbb1c0acb20 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.121+0000 7fbb1bfff640 1 -- 172.21.15.18:0/1506359940 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fbb2c0d03b0 con 0x7fbb34106f50 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.121+0000 7fbb32d9d640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbb1c0a32d0 0x7fbb1c0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009900 tx=0x7fbb240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.121+0000 7fbb3259c640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] conn(0x7fbb1c0acb20 0x7fbb1c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:11.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.122+0000 7fbb3259c640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] conn(0x7fbb1c0acb20 0x7fbb1c0aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:11.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.123+0000 7fbb1bfff640 1 -- 172.21.15.18:0/1506359940 <== osd.11 v2:172.21.15.162:6824/3607280204 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb2c014ec0 con 0x7fbb1c0acb20 2024-09-19T09:51:11.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.136+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 --> [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbb34062d40 con 0x7fbb1c0acb20 2024-09-19T09:51:11.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.137+0000 7fbb1bfff640 1 -- 172.21.15.18:0/1506359940 <== osd.11 v2:172.21.15.162:6824/3607280204 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbb34062d40 con 0x7fbb1c0acb20 2024-09-19T09:51:11.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.137+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 >> [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] conn(0x7fbb1c0acb20 msgr2=0x7fbb1c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.137+0000 7fbb39193640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] conn(0x7fbb1c0acb20 0x7fbb1c0aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.137+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbb1c0a32d0 msgr2=0x7fbb1c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.137+0000 7fbb39193640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbb1c0a32d0 0x7fbb1c0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009900 tx=0x7fbb240058d0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.137+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb34106f50 msgr2=0x7fbb34101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.137+0000 7fbb39193640 1 --2- 172.21.15.18:0/1506359940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb34106f50 0x7fbb34101cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00eaa0 tx=0x7fbb2c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:51:11.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.137+0000 7fbb3359e640 1 -- 172.21.15.18:0/1506359940 reap_dead start 2024-09-19T09:51:11.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.137+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 shutdown_connections 2024-09-19T09:51:11.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.137+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 >> 172.21.15.18:0/1506359940 conn(0x7fbb34077210 msgr2=0x7fbb341052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:11.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.138+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 shutdown_connections 2024-09-19T09:51:11.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.138+0000 7fbb39193640 1 -- 172.21.15.18:0/1506359940 wait complete. 2024-09-19T09:51:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.314+0000 7f256d6a7640 1 -- 172.21.15.18:0/2476905585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2568106f10 msgr2=0x7f256810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.314+0000 7f256d6a7640 1 --2- 172.21.15.18:0/2476905585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2568106f10 0x7f256810ea90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2560009ca0 tx=0x7f256002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.314+0000 7f256d6a7640 1 -- 172.21.15.18:0/2476905585 shutdown_connections 2024-09-19T09:51:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.314+0000 7f256d6a7640 1 --2- 172.21.15.18:0/2476905585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2568106f10 0x7f256810ea90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.314+0000 7f256d6a7640 1 --2- 172.21.15.18:0/2476905585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2568102790 0x7f25681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.314+0000 7f256d6a7640 1 --2- 172.21.15.18:0/2476905585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2568101de0 0x7f25681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.314+0000 7f256d6a7640 1 -- 172.21.15.18:0/2476905585 >> 172.21.15.18:0/2476905585 conn(0x7f25680fd8c0 msgr2=0x7f25680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.314+0000 7f256d6a7640 1 -- 172.21.15.18:0/2476905585 shutdown_connections 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.314+0000 7f256d6a7640 1 -- 172.21.15.18:0/2476905585 wait complete. 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f256d6a7640 1 Processor -- start 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f256d6a7640 1 -- start start 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f256d6a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2568101de0 0x7f2568198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f256d6a7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2568102790 0x7f2568198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f256d6a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2568106f10 0x7f256819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f256d6a7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2568112010 con 0x7f2568106f10 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f256d6a7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2568111e90 con 0x7f2568101de0 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f256d6a7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2568112190 con 0x7f2568102790 2024-09-19T09:51:11.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f25677fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2568106f10 0x7f256819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f25677fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2568106f10 0x7f256819ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58026/0 (socket says 172.21.15.18:58026) 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f25677fe640 1 -- 172.21.15.18:0/2816134909 learned_addr learned my addr 172.21.15.18:0/2816134909 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.315+0000 7f2566ffd640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2568101de0 0x7f2568198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f25667fc640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2568102790 0x7f2568198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f25677fe640 1 -- 172.21.15.18:0/2816134909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2568102790 msgr2=0x7f2568198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f25677fe640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2568102790 0x7f2568198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f25677fe640 1 -- 172.21.15.18:0/2816134909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2568101de0 msgr2=0x7f2568198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f25677fe640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2568101de0 0x7f2568198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f25677fe640 1 -- 172.21.15.18:0/2816134909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256819d540 con 0x7f2568106f10 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f25667fc640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2568102790 0x7f2568198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f2566ffd640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2568101de0 0x7f2568198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:51:11.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f25677fe640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2568106f10 0x7f256819ce60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2560031a60 tx=0x7f2560031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f254ffff640 1 -- 172.21.15.18:0/2816134909 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560003b70 con 0x7f2568106f10 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f254ffff640 1 -- 172.21.15.18:0/2816134909 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2560003d10 con 0x7f2568106f10 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256819d7d0 con 0x7f2568106f10 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f254ffff640 1 -- 172.21.15.18:0/2816134909 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560004770 con 0x7f2568106f10 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.316+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25681a5110 con 0x7f2568106f10 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.317+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2568062980 con 0x7f2568106f10 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.318+0000 7f254ffff640 1 -- 172.21.15.18:0/2816134909 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f256002f790 con 0x7f2568106f10 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.319+0000 7f254ffff640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25500a32d0 0x7f25500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.319+0000 7f254ffff640 1 -- 172.21.15.18:0/2816134909 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f25600f0d90 con 0x7f2568106f10 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.319+0000 7f2566ffd640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25500a32d0 0x7f25500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.319+0000 7f254ffff640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] conn(0x7f25500acb20 0x7f25500aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.319+0000 7f254ffff640 1 -- 172.21.15.18:0/2816134909 --> [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25500af5f0 con 0x7f25500acb20 2024-09-19T09:51:11.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.319+0000 7f254ffff640 1 -- 172.21.15.18:0/2816134909 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f25600f1270 con 0x7f2568106f10 2024-09-19T09:51:11.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.320+0000 7f2566ffd640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25500a32d0 0x7f25500a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2558009d60 tx=0x7f2558009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:11.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.320+0000 7f25667fc640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] conn(0x7f25500acb20 0x7f25500aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:11.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.320+0000 7f25667fc640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] conn(0x7f25500acb20 0x7f25500aef40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:11.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.321+0000 7f254ffff640 1 -- 172.21.15.18:0/2816134909 <== osd.10 v2:172.21.15.49:6824/2226510047 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25500af5f0 con 0x7f25500acb20 2024-09-19T09:51:11.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.335+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 --> [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2568062e00 con 0x7f25500acb20 2024-09-19T09:51:11.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.335+0000 7f254ffff640 1 -- 172.21.15.18:0/2816134909 <== osd.10 v2:172.21.15.49:6824/2226510047 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2568062e00 con 0x7f25500acb20 2024-09-19T09:51:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 >> [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] conn(0x7f25500acb20 msgr2=0x7f25500aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f256d6a7640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] conn(0x7f25500acb20 0x7f25500aef40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25500a32d0 msgr2=0x7f25500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f256d6a7640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25500a32d0 0x7f25500a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2558009d60 tx=0x7f2558009110 comp rx=0 tx=0).stop 2024-09-19T09:51:11.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2568106f10 msgr2=0x7f256819ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:11.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f256d6a7640 1 --2- 172.21.15.18:0/2816134909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2568106f10 0x7f256819ce60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2560031a60 tx=0x7f2560031a90 comp rx=0 tx=0).stop 2024-09-19T09:51:11.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f25677fe640 1 -- 172.21.15.18:0/2816134909 reap_dead start 2024-09-19T09:51:11.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 shutdown_connections 2024-09-19T09:51:11.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 >> 172.21.15.18:0/2816134909 conn(0x7f25680fd8c0 msgr2=0x7f25680fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:11.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 shutdown_connections 2024-09-19T09:51:11.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:11.336+0000 7f256d6a7640 1 -- 172.21.15.18:0/2816134909 wait complete. 2024-09-19T09:51:11.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:11 smithi018 ceph-mon[30956]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:51:11.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:11 smithi049 ceph-mon[34858]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:51:11.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:11 smithi162 ceph-mon[35174]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:51:12.293 INFO:teuthology.orchestra.run.smithi018.stdout:158913790002 2024-09-19T09:51:12.294 INFO:teuthology.orchestra.run.smithi018.stdout:296352743450 2024-09-19T09:51:12.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T09:51:12.296 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T09:51:12.662 INFO:teuthology.orchestra.run.smithi018.stdout:137438953528 2024-09-19T09:51:12.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T09:51:13.085 INFO:teuthology.orchestra.run.smithi018.stdout:274877906975 2024-09-19T09:51:13.085 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T09:51:13.621 INFO:teuthology.orchestra.run.smithi018.stdout:326417514517 2024-09-19T09:51:13.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T09:51:13.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:13 smithi018 ceph-mon[30956]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 596 B/s wr, 9 op/s 2024-09-19T09:51:13.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:13 smithi049 ceph-mon[34858]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 596 B/s wr, 9 op/s 2024-09-19T09:51:13.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:13 smithi162 ceph-mon[35174]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 596 B/s wr, 9 op/s 2024-09-19T09:51:13.991 INFO:teuthology.orchestra.run.smithi018.stdout:107374182461 2024-09-19T09:51:13.992 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T09:51:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.306+0000 7fb7f27a2640 1 -- 172.21.15.18:0/654538115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7ec1019e0 msgr2=0x7fb7ec101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.306+0000 7fb7f27a2640 1 --2- 172.21.15.18:0/654538115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7ec1019e0 0x7fb7ec101e40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009930 tx=0x7fb7dc02a420 comp rx=0 tx=0).stop 2024-09-19T09:51:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.306+0000 7fb7f27a2640 1 -- 172.21.15.18:0/654538115 shutdown_connections 2024-09-19T09:51:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.306+0000 7fb7f27a2640 1 --2- 172.21.15.18:0/654538115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7ec102380 0x7fb7ec10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.306+0000 7fb7f27a2640 1 --2- 172.21.15.18:0/654538115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7ec1019e0 0x7fb7ec101e40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.306+0000 7fb7f27a2640 1 --2- 172.21.15.18:0/654538115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7ec107af0 0x7fb7ec107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.306+0000 7fb7f27a2640 1 -- 172.21.15.18:0/654538115 >> 172.21.15.18:0/654538115 conn(0x7fb7ec0fd700 msgr2=0x7fb7ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f27a2640 1 -- 172.21.15.18:0/654538115 shutdown_connections 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f27a2640 1 -- 172.21.15.18:0/654538115 wait complete. 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f27a2640 1 Processor -- start 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f27a2640 1 -- start start 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f27a2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7ec1019e0 0x7fb7ec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f27a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7ec102380 0x7fb7ec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f27a2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7ec107af0 0x7fb7ec074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f27a2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec111f10 con 0x7fb7ec107af0 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f27a2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec111d90 con 0x7fb7ec1019e0 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f27a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec112090 con 0x7fb7ec102380 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.307+0000 7fb7f1fa1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7ec107af0 0x7fb7ec074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f1fa1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7ec107af0 0x7fb7ec074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58042/0 (socket says 172.21.15.18:58042) 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f1fa1640 1 -- 172.21.15.18:0/1540715346 learned_addr learned my addr 172.21.15.18:0/1540715346 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f17a0640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7ec1019e0 0x7fb7ec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f0f9f640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7ec102380 0x7fb7ec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f1fa1640 1 -- 172.21.15.18:0/1540715346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7ec102380 msgr2=0x7fb7ec074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f1fa1640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7ec102380 0x7fb7ec074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f1fa1640 1 -- 172.21.15.18:0/1540715346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7ec1019e0 msgr2=0x7fb7ec0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f1fa1640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7ec1019e0 0x7fb7ec0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f1fa1640 1 -- 172.21.15.18:0/1540715346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec1a6910 con 0x7fb7ec107af0 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f1fa1640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7ec107af0 0x7fb7ec074f70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400cad0 tx=0x7fb7e400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7e27fc640 1 -- 172.21.15.18:0/1540715346 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400ad60 con 0x7fb7ec107af0 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7e27fc640 1 -- 172.21.15.18:0/1540715346 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7e4005020 con 0x7fb7ec107af0 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ec1a6c00 con 0x7fb7ec107af0 2024-09-19T09:51:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7e27fc640 1 -- 172.21.15.18:0/1540715346 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400f6b0 con 0x7fb7ec107af0 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.308+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ec1a7110 con 0x7fb7ec107af0 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.309+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7ec101e40 con 0x7fb7ec107af0 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.310+0000 7fb7e27fc640 1 -- 172.21.15.18:0/1540715346 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb7e4005560 con 0x7fb7ec107af0 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.311+0000 7fb7e27fc640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb7d80a3350 0x7fb7d80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.311+0000 7fb7f17a0640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb7d80a3350 0x7fb7d80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.311+0000 7fb7e27fc640 1 -- 172.21.15.18:0/1540715346 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fb7e40cfdc0 con 0x7fb7ec107af0 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.311+0000 7fb7e27fc640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] conn(0x7fb7d80acba0 0x7fb7d80aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.311+0000 7fb7e27fc640 1 -- 172.21.15.18:0/1540715346 --> [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7d80af670 con 0x7fb7d80acba0 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.311+0000 7fb7e27fc640 1 -- 172.21.15.18:0/1540715346 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fb7e40d0170 con 0x7fb7ec107af0 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.311+0000 7fb7f0f9f640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] conn(0x7fb7d80acba0 0x7fb7d80aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.312+0000 7fb7f17a0640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb7d80a3350 0x7fb7d80a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009990 tx=0x7fb7e8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.312+0000 7fb7f0f9f640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] conn(0x7fb7d80acba0 0x7fb7d80aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.312+0000 7fb7e27fc640 1 -- 172.21.15.18:0/1540715346 <== osd.0 v2:172.21.15.18:6802/92239132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7d80af670 con 0x7fb7d80acba0 2024-09-19T09:51:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.326+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 --> [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb7ec062900 con 0x7fb7d80acba0 2024-09-19T09:51:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.326+0000 7fb7e27fc640 1 -- 172.21.15.18:0/1540715346 <== osd.0 v2:172.21.15.18:6802/92239132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb7ec062900 con 0x7fb7d80acba0 2024-09-19T09:51:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] conn(0x7fb7d80acba0 msgr2=0x7fb7d80aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f27a2640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] conn(0x7fb7d80acba0 0x7fb7d80aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb7d80a3350 msgr2=0x7fb7d80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:14.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f27a2640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb7d80a3350 0x7fb7d80a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009990 tx=0x7fb7e8009110 comp rx=0 tx=0).stop 2024-09-19T09:51:14.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7ec107af0 msgr2=0x7fb7ec074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:14.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f27a2640 1 --2- 172.21.15.18:0/1540715346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7ec107af0 0x7fb7ec074f70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400cad0 tx=0x7fb7e400ced0 comp rx=0 tx=0).stop 2024-09-19T09:51:14.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f1fa1640 1 -- 172.21.15.18:0/1540715346 reap_dead start 2024-09-19T09:51:14.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 shutdown_connections 2024-09-19T09:51:14.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 >> 172.21.15.18:0/1540715346 conn(0x7fb7ec0fd700 msgr2=0x7fb7ec0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:14.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 shutdown_connections 2024-09-19T09:51:14.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:14.327+0000 7fb7f27a2640 1 -- 172.21.15.18:0/1540715346 wait complete. 2024-09-19T09:51:14.889 INFO:teuthology.orchestra.run.smithi018.stdout:77309411394 2024-09-19T09:51:14.889 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T09:51:15.401 INFO:teuthology.orchestra.run.smithi018.stdout:34359738445 2024-09-19T09:51:15.401 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T09:51:15.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:15 smithi018 ceph-mon[30956]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 596 B/s wr, 11 op/s 2024-09-19T09:51:15.829 INFO:teuthology.orchestra.run.smithi018.stdout:214748364840 2024-09-19T09:51:15.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T09:51:15.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:15 smithi049 ceph-mon[34858]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 596 B/s wr, 11 op/s 2024-09-19T09:51:15.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:15 smithi162 ceph-mon[35174]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 596 B/s wr, 11 op/s 2024-09-19T09:51:16.203 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:16.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.198+0000 7f4593da9640 1 -- 172.21.15.18:0/2075554385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f458c104990 msgr2=0x7f458c1089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:16.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.199+0000 7f4593da9640 1 --2- 172.21.15.18:0/2075554385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f458c104990 0x7f458c1089e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f457c009900 tx=0x7f457c02a410 comp rx=0 tx=0).stop 2024-09-19T09:51:16.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.199+0000 7f4593da9640 1 -- 172.21.15.18:0/2075554385 shutdown_connections 2024-09-19T09:51:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.199+0000 7f4593da9640 1 --2- 172.21.15.18:0/2075554385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458c109110 0x7f458c110c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.199+0000 7f4593da9640 1 --2- 172.21.15.18:0/2075554385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f458c104990 0x7f458c1089e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.199+0000 7f4593da9640 1 --2- 172.21.15.18:0/2075554385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c103fe0 0x7f458c1043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.200+0000 7f4593da9640 1 -- 172.21.15.18:0/2075554385 >> 172.21.15.18:0/2075554385 conn(0x7f458c0ffa40 msgr2=0x7f458c101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.200+0000 7f4593da9640 1 -- 172.21.15.18:0/2075554385 shutdown_connections 2024-09-19T09:51:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.200+0000 7f4593da9640 1 -- 172.21.15.18:0/2075554385 wait complete. 2024-09-19T09:51:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.201+0000 7f4593da9640 1 Processor -- start 2024-09-19T09:51:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.202+0000 7f4593da9640 1 -- start start 2024-09-19T09:51:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.202+0000 7f4593da9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458c103fe0 0x7f458c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.203+0000 7f4593da9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f458c104990 0x7f458c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.203+0000 7f4591344640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f458c104990 0x7f458c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.203+0000 7f4591344640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f458c104990 0x7f458c19ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58054/0 (socket says 172.21.15.18:58054) 2024-09-19T09:51:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.203+0000 7f4591344640 1 -- 172.21.15.18:0/596156736 learned_addr learned my addr 172.21.15.18:0/596156736 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.203+0000 7f4593da9640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c109110 0x7f458c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.204+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f458c114160 con 0x7f458c104990 2024-09-19T09:51:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.204+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f458c113fe0 con 0x7f458c103fe0 2024-09-19T09:51:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.204+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1142e0 con 0x7f458c109110 2024-09-19T09:51:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.205+0000 7f4591344640 1 -- 172.21.15.18:0/596156736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c109110 msgr2=0x7f458c19ef90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:51:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.205+0000 7f4591344640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c109110 0x7f458c19ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.205+0000 7f4591344640 1 -- 172.21.15.18:0/596156736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458c103fe0 msgr2=0x7f458c19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.205+0000 7f4591344640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f458c103fe0 0x7f458c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.205+0000 7f4591344640 1 -- 172.21.15.18:0/596156736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c19f670 con 0x7f458c104990 2024-09-19T09:51:16.208 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:16.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.205+0000 7f4591344640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f458c104990 0x7f458c19ac00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f457c006010 tx=0x7f457c0052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:16.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.206+0000 7f4582ffd640 1 -- 172.21.15.18:0/596156736 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c040030 con 0x7f458c104990 2024-09-19T09:51:16.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.206+0000 7f4582ffd640 1 -- 172.21.15.18:0/596156736 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f457c0054a0 con 0x7f458c104990 2024-09-19T09:51:16.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.207+0000 7f4582ffd640 1 -- 172.21.15.18:0/596156736 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c03c9c0 con 0x7f458c104990 2024-09-19T09:51:16.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.208+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c19f900 con 0x7f458c104990 2024-09-19T09:51:16.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.208+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c19fca0 con 0x7f458c104990 2024-09-19T09:51:16.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.212+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f458c062900 con 0x7f458c104990 2024-09-19T09:51:16.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.213+0000 7f4582ffd640 1 -- 172.21.15.18:0/596156736 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f457c043030 con 0x7f458c104990 2024-09-19T09:51:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.218+0000 7f4582ffd640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f45780a3380 0x7f45780a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.219+0000 7f4591b45640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f45780a3380 0x7f45780a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.219+0000 7f4582ffd640 1 -- 172.21.15.18:0/596156736 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f457c0f0490 con 0x7f458c104990 2024-09-19T09:51:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.219+0000 7f4582ffd640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] conn(0x7f45780acbd0 0x7f45780aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.219+0000 7f4582ffd640 1 -- 172.21.15.18:0/596156736 --> [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f457c03bec0 con 0x7f45780acbd0 2024-09-19T09:51:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.219+0000 7f4582ffd640 1 -- 172.21.15.18:0/596156736 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f457c0f7050 con 0x7f458c104990 2024-09-19T09:51:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.220+0000 7f4592346640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] conn(0x7f45780acbd0 0x7f45780aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.220+0000 7f4591b45640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f45780a3380 0x7f45780a5840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f45880058c0 tx=0x7f4588005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:16.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.220+0000 7f4592346640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] conn(0x7f45780acbd0 0x7f45780aeff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:16.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.221+0000 7f4582ffd640 1 -- 172.21.15.18:0/596156736 <== osd.6 v2:172.21.15.18:6818/1979863681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f457c03bec0 con 0x7f45780acbd0 2024-09-19T09:51:16.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.258+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 --> [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f458c062d80 con 0x7f45780acbd0 2024-09-19T09:51:16.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.259+0000 7f4582ffd640 1 -- 172.21.15.18:0/596156736 <== osd.6 v2:172.21.15.18:6818/1979863681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f458c062d80 con 0x7f45780acbd0 2024-09-19T09:51:16.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.261+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] conn(0x7f45780acbd0 msgr2=0x7f45780aeff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:16.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.261+0000 7f4593da9640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] conn(0x7f45780acbd0 0x7f45780aeff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:16.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.261+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f45780a3380 msgr2=0x7f45780a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:16.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.261+0000 7f4593da9640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f45780a3380 0x7f45780a5840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f45880058c0 tx=0x7f4588005850 comp rx=0 tx=0).stop 2024-09-19T09:51:16.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.261+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f458c104990 msgr2=0x7f458c19ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:16.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.261+0000 7f4593da9640 1 --2- 172.21.15.18:0/596156736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f458c104990 0x7f458c19ac00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f457c006010 tx=0x7f457c0052b0 comp rx=0 tx=0).stop 2024-09-19T09:51:16.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.261+0000 7f4592346640 1 -- 172.21.15.18:0/596156736 reap_dead start 2024-09-19T09:51:16.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.262+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 shutdown_connections 2024-09-19T09:51:16.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.262+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 >> 172.21.15.18:0/596156736 conn(0x7f458c0ffa40 msgr2=0x7f458c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:16.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.262+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 shutdown_connections 2024-09-19T09:51:16.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:16.262+0000 7f4593da9640 1 -- 172.21.15.18:0/596156736 wait complete. 2024-09-19T09:51:16.598 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:16.598 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:16.598 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:16.603 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:16.604 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:17.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.156+0000 7f92f7472640 1 -- 172.21.15.18:0/1931000513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f0103780 msgr2=0x7f92f0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.156+0000 7f92f7472640 1 --2- 172.21.15.18:0/1931000513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f0103780 0x7f92f0107bc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009930 tx=0x7f92e002a420 comp rx=0 tx=0).stop 2024-09-19T09:51:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.156+0000 7f92f7472640 1 -- 172.21.15.18:0/1931000513 shutdown_connections 2024-09-19T09:51:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.156+0000 7f92f7472640 1 --2- 172.21.15.18:0/1931000513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0108300 0x7f92f010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.156+0000 7f92f7472640 1 --2- 172.21.15.18:0/1931000513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f0103780 0x7f92f0107bc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.156+0000 7f92f7472640 1 --2- 172.21.15.18:0/1931000513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f0102dd0 0x7f92f01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.156+0000 7f92f7472640 1 -- 172.21.15.18:0/1931000513 >> 172.21.15.18:0/1931000513 conn(0x7f92f00fc7d0 msgr2=0x7f92f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.156+0000 7f92f7472640 1 -- 172.21.15.18:0/1931000513 shutdown_connections 2024-09-19T09:51:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.156+0000 7f92f7472640 1 -- 172.21.15.18:0/1931000513 wait complete. 2024-09-19T09:51:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.157+0000 7f92f7472640 1 Processor -- start 2024-09-19T09:51:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.157+0000 7f92f7472640 1 -- start start 2024-09-19T09:51:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.157+0000 7f92f7472640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0102dd0 0x7f92f0100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f7472640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f0103780 0x7f92f0100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f7472640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f0108300 0x7f92f01014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f7472640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f92f01120c0 con 0x7f92f0103780 2024-09-19T09:51:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f7472640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0111f40 con 0x7f92f0102dd0 2024-09-19T09:51:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f7472640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0112240 con 0x7f92f0108300 2024-09-19T09:51:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f4a0d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f0103780 0x7f92f0100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f520e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0102dd0 0x7f92f0100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f4a0d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f0103780 0x7f92f0100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42616/0 (socket says 172.21.15.18:42616) 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f4a0d640 1 -- 172.21.15.18:0/3258427378 learned_addr learned my addr 172.21.15.18:0/3258427378 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f5a0f640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f0108300 0x7f92f01014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f4a0d640 1 -- 172.21.15.18:0/3258427378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f0108300 msgr2=0x7f92f01014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f4a0d640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f0108300 0x7f92f01014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f4a0d640 1 -- 172.21.15.18:0/3258427378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0102dd0 msgr2=0x7f92f0100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f4a0d640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0102dd0 0x7f92f0100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f4a0d640 1 -- 172.21.15.18:0/3258427378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f01a6ac0 con 0x7f92f0103780 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f520e640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0102dd0 0x7f92f0100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:51:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.158+0000 7f92f4a0d640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f0103780 0x7f92f0100f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f92e002a940 tx=0x7f92e0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.159+0000 7f92e67fc640 1 -- 172.21.15.18:0/3258427378 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e003f070 con 0x7f92f0103780 2024-09-19T09:51:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.159+0000 7f92f7472640 1 -- 172.21.15.18:0/3258427378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f01a6d50 con 0x7f92f0103780 2024-09-19T09:51:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.159+0000 7f92e67fc640 1 -- 172.21.15.18:0/3258427378 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e0031c90 con 0x7f92f0103780 2024-09-19T09:51:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.159+0000 7f92e67fc640 1 -- 172.21.15.18:0/3258427378 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0035030 con 0x7f92f0103780 2024-09-19T09:51:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.159+0000 7f92f7472640 1 -- 172.21.15.18:0/3258427378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f0198360 con 0x7f92f0103780 2024-09-19T09:51:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.160+0000 7f92f7472640 1 -- 172.21.15.18:0/3258427378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f01031b0 con 0x7f92f0103780 2024-09-19T09:51:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.161+0000 7f92e67fc640 1 -- 172.21.15.18:0/3258427378 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f92e0042070 con 0x7f92f0103780 2024-09-19T09:51:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.162+0000 7f92e67fc640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f92dc0abb60 0x7f92dc0ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.162+0000 7f92f520e640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f92dc0abb60 0x7f92dc0ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.162+0000 7f92e67fc640 1 -- 172.21.15.18:0/3258427378 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f92e00eff90 con 0x7f92f0103780 2024-09-19T09:51:17.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.163+0000 7f92f520e640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f92dc0abb60 0x7f92dc0ae020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f92ec005fd0 tx=0x7f92ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:17.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.167+0000 7f92e67fc640 1 -- 172.21.15.18:0/3258427378 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f92e00bc6b0 con 0x7f92f0103780 2024-09-19T09:51:17.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.345+0000 7f92f7472640 1 -- 172.21.15.18:0/3258427378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f92f010a290 con 0x7f92f0103780 2024-09-19T09:51:17.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.345+0000 7f92e67fc640 1 -- 172.21.15.18:0/3258427378 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f92e00c09b0 con 0x7f92f0103780 2024-09-19T09:51:17.347 INFO:teuthology.orchestra.run.smithi018.stdout:55834574922 2024-09-19T09:51:17.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 -- 172.21.15.18:0/3258427378 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f92dc0abb60 msgr2=0x7f92dc0ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:17.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f92dc0abb60 0x7f92dc0ae020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f92ec005fd0 tx=0x7f92ec00b390 comp rx=0 tx=0).stop 2024-09-19T09:51:17.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 -- 172.21.15.18:0/3258427378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f0103780 msgr2=0x7f92f0100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:17.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f0103780 0x7f92f0100f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f92e002a940 tx=0x7f92e0003b90 comp rx=0 tx=0).stop 2024-09-19T09:51:17.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 -- 172.21.15.18:0/3258427378 shutdown_connections 2024-09-19T09:51:17.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f92dc0abb60 0x7f92dc0ae020 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:17.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f0108300 0x7f92f01014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:17.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f0103780 0x7f92f0100f70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:17.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 --2- 172.21.15.18:0/3258427378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f0102dd0 0x7f92f0100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:17.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 -- 172.21.15.18:0/3258427378 >> 172.21.15.18:0/3258427378 conn(0x7f92f00fc7d0 msgr2=0x7f92f0105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:17.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 -- 172.21.15.18:0/3258427378 shutdown_connections 2024-09-19T09:51:17.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:17.347+0000 7f92f7472640 1 -- 172.21.15.18:0/3258427378 wait complete. 2024-09-19T09:51:17.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:17 smithi018 ceph-mon[30956]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-19T09:51:17.515 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:17 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3258427378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:51:17.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:17 smithi049 ceph-mon[34858]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-19T09:51:17.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:17 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3258427378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:51:17.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:17 smithi162 ceph-mon[35174]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-19T09:51:17.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:17 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3258427378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:51:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.065+0000 7fea3f006640 1 -- 172.21.15.18:0/468299749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea38102570 msgr2=0x7fea381029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.065+0000 7fea3f006640 1 --2- 172.21.15.18:0/468299749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea38102570 0x7fea381029b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fea24009900 tx=0x7fea2402a480 comp rx=0 tx=0).stop 2024-09-19T09:51:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.066+0000 7fea3f006640 1 -- 172.21.15.18:0/468299749 shutdown_connections 2024-09-19T09:51:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.066+0000 7fea3f006640 1 --2- 172.21.15.18:0/468299749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea38102ef0 0x7fea3810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.066+0000 7fea3f006640 1 --2- 172.21.15.18:0/468299749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea38102570 0x7fea381029b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.066+0000 7fea3f006640 1 --2- 172.21.15.18:0/468299749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea38100e20 0x7fea38101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.066+0000 7fea3f006640 1 -- 172.21.15.18:0/468299749 >> 172.21.15.18:0/468299749 conn(0x7fea380fc7d0 msgr2=0x7fea380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.066+0000 7fea3f006640 1 -- 172.21.15.18:0/468299749 shutdown_connections 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.066+0000 7fea3f006640 1 -- 172.21.15.18:0/468299749 wait complete. 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.066+0000 7fea3f006640 1 Processor -- start 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.066+0000 7fea3f006640 1 -- start start 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3f006640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea38100e20 0x7fea380fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3f006640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea38102570 0x7fea380fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3f006640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea38102ef0 0x7fea380fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3f006640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fea38110fa0 con 0x7fea38102ef0 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3f006640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fea38110e20 con 0x7fea38100e20 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3f006640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fea38111120 con 0x7fea38102570 2024-09-19T09:51:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3d5a3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea38102ef0 0x7fea380fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3d5a3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea38102ef0 0x7fea380fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42644/0 (socket says 172.21.15.18:42644) 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3d5a3640 1 -- 172.21.15.18:0/940084449 learned_addr learned my addr 172.21.15.18:0/940084449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea37fff640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea38102570 0x7fea380fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3cda2640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea38100e20 0x7fea380fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3d5a3640 1 -- 172.21.15.18:0/940084449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea38102570 msgr2=0x7fea380fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3d5a3640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea38102570 0x7fea380fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3d5a3640 1 -- 172.21.15.18:0/940084449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea38100e20 msgr2=0x7fea380fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3d5a3640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea38100e20 0x7fea380fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3d5a3640 1 -- 172.21.15.18:0/940084449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea381a6a10 con 0x7fea38102ef0 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3cda2640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea38100e20 0x7fea380fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.067+0000 7fea3d5a3640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea38102ef0 0x7fea380fd700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fea3000b970 tx=0x7fea3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.068+0000 7fea35ffb640 1 -- 172.21.15.18:0/940084449 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30019070 con 0x7fea38102ef0 2024-09-19T09:51:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.068+0000 7fea3f006640 1 -- 172.21.15.18:0/940084449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea381a6d00 con 0x7fea38102ef0 2024-09-19T09:51:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.068+0000 7fea35ffb640 1 -- 172.21.15.18:0/940084449 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea3000cb40 con 0x7fea38102ef0 2024-09-19T09:51:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.068+0000 7fea35ffb640 1 -- 172.21.15.18:0/940084449 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30007650 con 0x7fea38102ef0 2024-09-19T09:51:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.068+0000 7fea3f006640 1 -- 172.21.15.18:0/940084449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea381a7240 con 0x7fea38102ef0 2024-09-19T09:51:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.069+0000 7fea3f006640 1 -- 172.21.15.18:0/940084449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea38101200 con 0x7fea38102ef0 2024-09-19T09:51:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.070+0000 7fea35ffb640 1 -- 172.21.15.18:0/940084449 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fea3001c070 con 0x7fea38102ef0 2024-09-19T09:51:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.070+0000 7fea35ffb640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fea280a3350 0x7fea280a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.071+0000 7fea3cda2640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fea280a3350 0x7fea280a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.071+0000 7fea35ffb640 1 -- 172.21.15.18:0/940084449 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fea300cee90 con 0x7fea38102ef0 2024-09-19T09:51:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.071+0000 7fea3cda2640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fea280a3350 0x7fea280a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00baa0 tx=0x7fea2c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.075+0000 7fea35ffb640 1 -- 172.21.15.18:0/940084449 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea3009bc10 con 0x7fea38102ef0 2024-09-19T09:51:18.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.251+0000 7fea3f006640 1 -- 172.21.15.18:0/940084449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fea3810a0a0 con 0x7fea38102ef0 2024-09-19T09:51:18.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.252+0000 7fea35ffb640 1 -- 172.21.15.18:0/940084449 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fea300d0020 con 0x7fea38102ef0 2024-09-19T09:51:18.254 INFO:teuthology.orchestra.run.smithi018.stdout:107374182462 2024-09-19T09:51:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 -- 172.21.15.18:0/940084449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fea280a3350 msgr2=0x7fea280a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fea280a3350 0x7fea280a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00baa0 tx=0x7fea2c005d90 comp rx=0 tx=0).stop 2024-09-19T09:51:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 -- 172.21.15.18:0/940084449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea38102ef0 msgr2=0x7fea380fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea38102ef0 0x7fea380fd700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fea3000b970 tx=0x7fea3000be30 comp rx=0 tx=0).stop 2024-09-19T09:51:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 -- 172.21.15.18:0/940084449 shutdown_connections 2024-09-19T09:51:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fea280a3350 0x7fea280a5810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea38102ef0 0x7fea380fd700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea38102570 0x7fea380fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 --2- 172.21.15.18:0/940084449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea38100e20 0x7fea380fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 -- 172.21.15.18:0/940084449 >> 172.21.15.18:0/940084449 conn(0x7fea380fc7d0 msgr2=0x7fea3806a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 -- 172.21.15.18:0/940084449 shutdown_connections 2024-09-19T09:51:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:18.254+0000 7fea3f006640 1 -- 172.21.15.18:0/940084449 wait complete. 2024-09-19T09:51:18.390 INFO:teuthology.orchestra.run.smithi018.stdout:193273528368 2024-09-19T09:51:18.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T09:51:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:18 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/940084449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:51:18.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:18 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/940084449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:51:18.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:18 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/940084449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:51:19.023 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182461 got 107374182462 for osd.3 2024-09-19T09:51:19.023 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:19.546 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:19 smithi018 ceph-mon[30956]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-19T09:51:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:19.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:19 smithi049 ceph-mon[34858]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-19T09:51:19.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:19 smithi162 ceph-mon[35174]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-19T09:51:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.931+0000 7fe344c81640 1 -- 172.21.15.18:0/2112898300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe340106a80 msgr2=0x7fe340106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.931+0000 7fe344c81640 1 --2- 172.21.15.18:0/2112898300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe340106a80 0x7fe340106e60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe330009930 tx=0x7fe33002a420 comp rx=0 tx=0).stop 2024-09-19T09:51:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.931+0000 7fe344c81640 1 -- 172.21.15.18:0/2112898300 shutdown_connections 2024-09-19T09:51:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.931+0000 7fe344c81640 1 --2- 172.21.15.18:0/2112898300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe340101420 0x7fe34010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.931+0000 7fe344c81640 1 --2- 172.21.15.18:0/2112898300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe340100a80 0x7fe340100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.931+0000 7fe344c81640 1 --2- 172.21.15.18:0/2112898300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe340106a80 0x7fe340106e60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.931+0000 7fe344c81640 1 -- 172.21.15.18:0/2112898300 >> 172.21.15.18:0/2112898300 conn(0x7fe3400fc7a0 msgr2=0x7fe3400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.931+0000 7fe344c81640 1 -- 172.21.15.18:0/2112898300 shutdown_connections 2024-09-19T09:51:19.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.931+0000 7fe344c81640 1 -- 172.21.15.18:0/2112898300 wait complete. 2024-09-19T09:51:19.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.932+0000 7fe344c81640 1 Processor -- start 2024-09-19T09:51:19.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.932+0000 7fe344c81640 1 -- start start 2024-09-19T09:51:19.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.932+0000 7fe344c81640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe340100a80 0x7fe3401984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:19.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.932+0000 7fe344c81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe340101420 0x7fe340198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:19.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.932+0000 7fe344c81640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe340106a80 0x7fe34019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:19.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.932+0000 7fe344c81640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe340110ea0 con 0x7fe340101420 2024-09-19T09:51:19.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.932+0000 7fe344c81640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe340110d20 con 0x7fe340100a80 2024-09-19T09:51:19.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.932+0000 7fe344c81640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe340111020 con 0x7fe340106a80 2024-09-19T09:51:19.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.932+0000 7fe33dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe340101420 0x7fe340198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:19.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe33dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe340101420 0x7fe340198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42654/0 (socket says 172.21.15.18:42654) 2024-09-19T09:51:19.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe33dd9b640 1 -- 172.21.15.18:0/436381663 learned_addr learned my addr 172.21.15.18:0/436381663 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:19.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe33e59c640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe340100a80 0x7fe3401984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:19.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe33ed9d640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe340106a80 0x7fe34019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:19.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe33dd9b640 1 -- 172.21.15.18:0/436381663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe340106a80 msgr2=0x7fe34019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:19.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe33dd9b640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe340106a80 0x7fe34019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:19.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe33dd9b640 1 -- 172.21.15.18:0/436381663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe340100a80 msgr2=0x7fe3401984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:19.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe33dd9b640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe340100a80 0x7fe3401984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe33dd9b640 1 -- 172.21.15.18:0/436381663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34019d470 con 0x7fe340101420 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe33dd9b640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe340101420 0x7fe340198a00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe33400b4a0 tx=0x7fe33400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe32f7fe640 1 -- 172.21.15.18:0/436381663 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334014070 con 0x7fe340101420 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe32f7fe640 1 -- 172.21.15.18:0/436381663 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe334010af0 con 0x7fe340101420 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe344c81640 1 -- 172.21.15.18:0/436381663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34019d760 con 0x7fe340101420 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe32f7fe640 1 -- 172.21.15.18:0/436381663 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334017d10 con 0x7fe340101420 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.933+0000 7fe344c81640 1 -- 172.21.15.18:0/436381663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3401a5040 con 0x7fe340101420 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.934+0000 7fe344c81640 1 -- 172.21.15.18:0/436381663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe340100ee0 con 0x7fe340101420 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.935+0000 7fe32f7fe640 1 -- 172.21.15.18:0/436381663 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe334017070 con 0x7fe340101420 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.936+0000 7fe32f7fe640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3280a32d0 0x7fe3280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.936+0000 7fe33e59c640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3280a32d0 0x7fe3280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:19.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.936+0000 7fe32f7fe640 1 -- 172.21.15.18:0/436381663 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fe3340cebb0 con 0x7fe340101420 2024-09-19T09:51:19.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.937+0000 7fe33e59c640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3280a32d0 0x7fe3280a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe330009900 tx=0x7fe3300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:19.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:19.940+0000 7fe32f7fe640 1 -- 172.21.15.18:0/436381663 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3340d5080 con 0x7fe340101420 2024-09-19T09:51:19.968 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.121+0000 7fe344c81640 1 -- 172.21.15.18:0/436381663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe34002d7c0 con 0x7fe340101420 2024-09-19T09:51:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.121+0000 7fe32f7fe640 1 -- 172.21.15.18:0/436381663 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe33409ba30 con 0x7fe340101420 2024-09-19T09:51:20.123 INFO:teuthology.orchestra.run.smithi018.stdout:326417514519 2024-09-19T09:51:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 -- 172.21.15.18:0/436381663 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3280a32d0 msgr2=0x7fe3280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3280a32d0 0x7fe3280a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe330009900 tx=0x7fe3300058d0 comp rx=0 tx=0).stop 2024-09-19T09:51:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 -- 172.21.15.18:0/436381663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe340101420 msgr2=0x7fe340198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe340101420 0x7fe340198a00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe33400b4a0 tx=0x7fe33400b960 comp rx=0 tx=0).stop 2024-09-19T09:51:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 -- 172.21.15.18:0/436381663 shutdown_connections 2024-09-19T09:51:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3280a32d0 0x7fe3280a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe340106a80 0x7fe34019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe340101420 0x7fe340198a00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 --2- 172.21.15.18:0/436381663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe340100a80 0x7fe3401984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 -- 172.21.15.18:0/436381663 >> 172.21.15.18:0/436381663 conn(0x7fe3400fc7a0 msgr2=0x7fe34006aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 -- 172.21.15.18:0/436381663 shutdown_connections 2024-09-19T09:51:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:20.124+0000 7fe344c81640 1 -- 172.21.15.18:0/436381663 wait complete. 2024-09-19T09:51:20.390 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574922 for osd.1 2024-09-19T09:51:20.390 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:20.678 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:20 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/436381663' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:51:20.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:20 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/436381663' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:51:20.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:20 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/436381663' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:51:21.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.065+0000 7fb61f4b6640 1 -- 172.21.15.18:0/1732496813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb618101280 msgr2=0x7fb61810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:21.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.065+0000 7fb61f4b6640 1 --2- 172.21.15.18:0/1732496813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb618101280 0x7fb61810df40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb608009900 tx=0x7fb60802a410 comp rx=0 tx=0).stop 2024-09-19T09:51:21.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.065+0000 7fb61f4b6640 1 -- 172.21.15.18:0/1732496813 shutdown_connections 2024-09-19T09:51:21.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.065+0000 7fb61f4b6640 1 --2- 172.21.15.18:0/1732496813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb61810e480 0x7fb618110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.065+0000 7fb61f4b6640 1 --2- 172.21.15.18:0/1732496813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb618101280 0x7fb61810df40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.065+0000 7fb61f4b6640 1 --2- 172.21.15.18:0/1732496813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6181008d0 0x7fb618100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.065+0000 7fb61f4b6640 1 -- 172.21.15.18:0/1732496813 >> 172.21.15.18:0/1732496813 conn(0x7fb6180fc7a0 msgr2=0x7fb6180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.065+0000 7fb61f4b6640 1 -- 172.21.15.18:0/1732496813 shutdown_connections 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.065+0000 7fb61f4b6640 1 -- 172.21.15.18:0/1732496813 wait complete. 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.066+0000 7fb61f4b6640 1 Processor -- start 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.066+0000 7fb61f4b6640 1 -- start start 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.066+0000 7fb61f4b6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6181008d0 0x7fb61819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.066+0000 7fb61f4b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb618101280 0x7fb61819ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.066+0000 7fb61f4b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb61810e480 0x7fb61819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.066+0000 7fb61f4b6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6181141b0 con 0x7fb6181008d0 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61f4b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb618114030 con 0x7fb618101280 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61f4b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb618114330 con 0x7fb61810e480 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61d252640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6181008d0 0x7fb61819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:21.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61d252640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6181008d0 0x7fb61819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42682/0 (socket says 172.21.15.18:42682) 2024-09-19T09:51:21.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61d252640 1 -- 172.21.15.18:0/595013372 learned_addr learned my addr 172.21.15.18:0/595013372 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:21.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61ca51640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb618101280 0x7fb61819ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:21.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61da53640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb61810e480 0x7fb61819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:21.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61d252640 1 -- 172.21.15.18:0/595013372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb61810e480 msgr2=0x7fb61819efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:21.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61d252640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb61810e480 0x7fb61819efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61d252640 1 -- 172.21.15.18:0/595013372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb618101280 msgr2=0x7fb61819ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:21.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61d252640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb618101280 0x7fb61819ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61d252640 1 -- 172.21.15.18:0/595013372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61819f6c0 con 0x7fb6181008d0 2024-09-19T09:51:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61d252640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6181008d0 0x7fb61819a710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb61400d770 tx=0x7fb61400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb60e7fc640 1 -- 172.21.15.18:0/595013372 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614017070 con 0x7fb6181008d0 2024-09-19T09:51:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb60e7fc640 1 -- 172.21.15.18:0/595013372 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb614005500 con 0x7fb6181008d0 2024-09-19T09:51:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb61f4b6640 1 -- 172.21.15.18:0/595013372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61819f9b0 con 0x7fb6181008d0 2024-09-19T09:51:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.067+0000 7fb60e7fc640 1 -- 172.21.15.18:0/595013372 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614004e00 con 0x7fb6181008d0 2024-09-19T09:51:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.068+0000 7fb61f4b6640 1 -- 172.21.15.18:0/595013372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6181a7290 con 0x7fb6181008d0 2024-09-19T09:51:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.069+0000 7fb61f4b6640 1 -- 172.21.15.18:0/595013372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb61806b070 con 0x7fb6181008d0 2024-09-19T09:51:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.070+0000 7fb60e7fc640 1 -- 172.21.15.18:0/595013372 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb614004fa0 con 0x7fb6181008d0 2024-09-19T09:51:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.071+0000 7fb60e7fc640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6040a32d0 0x7fb6040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:21.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.071+0000 7fb61ca51640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6040a32d0 0x7fb6040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:21.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.071+0000 7fb60e7fc640 1 -- 172.21.15.18:0/595013372 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fb6140cf2c0 con 0x7fb6181008d0 2024-09-19T09:51:21.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.071+0000 7fb61ca51640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6040a32d0 0x7fb6040a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb608009230 tx=0x7fb6080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:21.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.075+0000 7fb60e7fc640 1 -- 172.21.15.18:0/595013372 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb61409b9e0 con 0x7fb6181008d0 2024-09-19T09:51:21.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.252+0000 7fb61f4b6640 1 -- 172.21.15.18:0/595013372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb618109610 con 0x7fb6181008d0 2024-09-19T09:51:21.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.252+0000 7fb60e7fc640 1 -- 172.21.15.18:0/595013372 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb61409fce0 con 0x7fb6181008d0 2024-09-19T09:51:21.255 INFO:teuthology.orchestra.run.smithi018.stdout:77309411396 2024-09-19T09:51:21.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 -- 172.21.15.18:0/595013372 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6040a32d0 msgr2=0x7fb6040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:21.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6040a32d0 0x7fb6040a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb608009230 tx=0x7fb6080058d0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 -- 172.21.15.18:0/595013372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6181008d0 msgr2=0x7fb61819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:21.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6181008d0 0x7fb61819a710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb61400d770 tx=0x7fb61400dc30 comp rx=0 tx=0).stop 2024-09-19T09:51:21.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 -- 172.21.15.18:0/595013372 shutdown_connections 2024-09-19T09:51:21.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6040a32d0 0x7fb6040a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb61810e480 0x7fb61819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb618101280 0x7fb61819ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 --2- 172.21.15.18:0/595013372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6181008d0 0x7fb61819a710 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 -- 172.21.15.18:0/595013372 >> 172.21.15.18:0/595013372 conn(0x7fb6180fc7a0 msgr2=0x7fb61810f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:21.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 -- 172.21.15.18:0/595013372 shutdown_connections 2024-09-19T09:51:21.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.254+0000 7fb61f4b6640 1 -- 172.21.15.18:0/595013372 wait complete. 2024-09-19T09:51:21.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.288+0000 7f8542ca5640 1 -- 172.21.15.18:0/3390578215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c1027a0 msgr2=0x7f853c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:21.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.288+0000 7f8542ca5640 1 --2- 172.21.15.18:0/3390578215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c1027a0 0x7f853c1067f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f852c009ca0 tx=0x7f852c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.288+0000 7f8542ca5640 1 -- 172.21.15.18:0/3390578215 shutdown_connections 2024-09-19T09:51:21.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.288+0000 7f8542ca5640 1 --2- 172.21.15.18:0/3390578215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f853c106f20 0x7f853c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.288+0000 7f8542ca5640 1 --2- 172.21.15.18:0/3390578215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c1027a0 0x7f853c1067f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.288+0000 7f8542ca5640 1 --2- 172.21.15.18:0/3390578215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f853c101df0 0x7f853c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.288+0000 7f8542ca5640 1 -- 172.21.15.18:0/3390578215 >> 172.21.15.18:0/3390578215 conn(0x7f853c0fd8f0 msgr2=0x7f853c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:21.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.289+0000 7f8542ca5640 1 -- 172.21.15.18:0/3390578215 shutdown_connections 2024-09-19T09:51:21.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.289+0000 7f8542ca5640 1 -- 172.21.15.18:0/3390578215 wait complete. 2024-09-19T09:51:21.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.289+0000 7f8542ca5640 1 Processor -- start 2024-09-19T09:51:21.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.289+0000 7f8542ca5640 1 -- start start 2024-09-19T09:51:21.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.289+0000 7f8542ca5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f853c101df0 0x7f853c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:21.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.289+0000 7f8542ca5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f853c1027a0 0x7f853c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:21.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.289+0000 7f8542ca5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c106f20 0x7f853c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:21.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.289+0000 7f8542ca5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f853c111fd0 con 0x7f853c106f20 2024-09-19T09:51:21.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.289+0000 7f8542ca5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f853c111e50 con 0x7f853c1027a0 2024-09-19T09:51:21.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.289+0000 7f8542ca5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f853c112150 con 0x7f853c101df0 2024-09-19T09:51:21.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8541242640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c106f20 0x7f853c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:21.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8541242640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c106f20 0x7f853c19cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42704/0 (socket says 172.21.15.18:42704) 2024-09-19T09:51:21.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8541242640 1 -- 172.21.15.18:0/512079960 learned_addr learned my addr 172.21.15.18:0/512079960 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:21.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8540a41640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f853c101df0 0x7f853c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:21.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f853bfff640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f853c1027a0 0x7f853c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:21.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8541242640 1 -- 172.21.15.18:0/512079960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f853c101df0 msgr2=0x7f853c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:21.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8541242640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f853c101df0 0x7f853c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8541242640 1 -- 172.21.15.18:0/512079960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f853c1027a0 msgr2=0x7f853c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:21.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8541242640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f853c1027a0 0x7f853c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8541242640 1 -- 172.21.15.18:0/512079960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853c19d4a0 con 0x7f853c106f20 2024-09-19T09:51:21.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8541242640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c106f20 0x7f853c19cdc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f853400d950 tx=0x7f853400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:21.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8539ffb640 1 -- 172.21.15.18:0/512079960 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534017030 con 0x7f853c106f20 2024-09-19T09:51:21.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8542ca5640 1 -- 172.21.15.18:0/512079960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f853c19d790 con 0x7f853c106f20 2024-09-19T09:51:21.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8539ffb640 1 -- 172.21.15.18:0/512079960 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8534004020 con 0x7f853c106f20 2024-09-19T09:51:21.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.290+0000 7f8539ffb640 1 -- 172.21.15.18:0/512079960 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534003c00 con 0x7f853c106f20 2024-09-19T09:51:21.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.291+0000 7f8542ca5640 1 -- 172.21.15.18:0/512079960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f853c1a5070 con 0x7f853c106f20 2024-09-19T09:51:21.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.292+0000 7f8542ca5640 1 -- 172.21.15.18:0/512079960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f853c1021d0 con 0x7f853c106f20 2024-09-19T09:51:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.293+0000 7f8539ffb640 1 -- 172.21.15.18:0/512079960 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f853401a070 con 0x7f853c106f20 2024-09-19T09:51:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.293+0000 7f8539ffb640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85280a32d0 0x7f85280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.294+0000 7f8539ffb640 1 -- 172.21.15.18:0/512079960 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f85340cf240 con 0x7f853c106f20 2024-09-19T09:51:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.294+0000 7f8540a41640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85280a32d0 0x7f85280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.294+0000 7f8540a41640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85280a32d0 0x7f85280a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8524009b60 tx=0x7f8524005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.298+0000 7f8539ffb640 1 -- 172.21.15.18:0/512079960 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8534021070 con 0x7f853c106f20 2024-09-19T09:51:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.475+0000 7f8542ca5640 1 -- 172.21.15.18:0/512079960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f853c10a160 con 0x7f853c106f20 2024-09-19T09:51:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.475+0000 7f8539ffb640 1 -- 172.21.15.18:0/512079960 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f853409bfb0 con 0x7f853c106f20 2024-09-19T09:51:21.477 INFO:teuthology.orchestra.run.smithi018.stdout:34359738446 2024-09-19T09:51:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 -- 172.21.15.18:0/512079960 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85280a32d0 msgr2=0x7f85280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85280a32d0 0x7f85280a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8524009b60 tx=0x7f8524005f90 comp rx=0 tx=0).stop 2024-09-19T09:51:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 -- 172.21.15.18:0/512079960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c106f20 msgr2=0x7f853c19cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c106f20 0x7f853c19cdc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f853400d950 tx=0x7f853400de10 comp rx=0 tx=0).stop 2024-09-19T09:51:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 -- 172.21.15.18:0/512079960 shutdown_connections 2024-09-19T09:51:21.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85280a32d0 0x7f85280a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c106f20 0x7f853c19cdc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f853c1027a0 0x7f853c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 --2- 172.21.15.18:0/512079960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f853c101df0 0x7f853c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:21.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 -- 172.21.15.18:0/512079960 >> 172.21.15.18:0/512079960 conn(0x7f853c0fd8f0 msgr2=0x7f853c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:21.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 -- 172.21.15.18:0/512079960 shutdown_connections 2024-09-19T09:51:21.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:21.478+0000 7f8542ca5640 1 -- 172.21.15.18:0/512079960 wait complete. 2024-09-19T09:51:21.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:21 smithi018 ceph-mon[30956]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-09-19T09:51:21.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:21 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/595013372' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:51:21.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:21 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/512079960' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:51:21.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:21 smithi049 ceph-mon[34858]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-09-19T09:51:21.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:21 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/595013372' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:51:21.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:21 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/512079960' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:51:21.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:21 smithi162 ceph-mon[35174]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-09-19T09:51:21.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:21 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/595013372' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:51:21.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:21 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/512079960' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:51:21.937 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411396 for osd.2 2024-09-19T09:51:21.937 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:22.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.192+0000 7f7429a6b640 1 -- 172.21.15.18:0/1914583140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7424102d90 msgr2=0x7f7424103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:22.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.192+0000 7f7429a6b640 1 --2- 172.21.15.18:0/1914583140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7424102d90 0x7f7424103170 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7414009cd0 tx=0x7f741402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.193+0000 7f7429a6b640 1 -- 172.21.15.18:0/1914583140 shutdown_connections 2024-09-19T09:51:22.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.193+0000 7f7429a6b640 1 --2- 172.21.15.18:0/1914583140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7424108290 0x7f742410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.193+0000 7f7429a6b640 1 --2- 172.21.15.18:0/1914583140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7424103740 0x7f7424107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.193+0000 7f7429a6b640 1 --2- 172.21.15.18:0/1914583140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7424102d90 0x7f7424103170 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.193+0000 7f7429a6b640 1 -- 172.21.15.18:0/1914583140 >> 172.21.15.18:0/1914583140 conn(0x7f74240fc7d0 msgr2=0x7f74240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:22.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.193+0000 7f7429a6b640 1 -- 172.21.15.18:0/1914583140 shutdown_connections 2024-09-19T09:51:22.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.193+0000 7f7429a6b640 1 -- 172.21.15.18:0/1914583140 wait complete. 2024-09-19T09:51:22.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.193+0000 7f7429a6b640 1 Processor -- start 2024-09-19T09:51:22.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.193+0000 7f7429a6b640 1 -- start start 2024-09-19T09:51:22.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7429a6b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7424102d90 0x7f74241009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:22.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7429a6b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7424103740 0x7f7424100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:22.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7429a6b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7424108290 0x7f7424101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:22.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7429a6b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7424112120 con 0x7f7424103740 2024-09-19T09:51:22.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7429a6b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7424111fa0 con 0x7f7424102d90 2024-09-19T09:51:22.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7429a6b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74241122a0 con 0x7f7424108290 2024-09-19T09:51:22.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7422ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7424103740 0x7f7424100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7422ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7424103740 0x7f7424100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42738/0 (socket says 172.21.15.18:42738) 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7422ffd640 1 -- 172.21.15.18:0/74729381 learned_addr learned my addr 172.21.15.18:0/74729381 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7423fff640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7424108290 0x7f7424101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f74237fe640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7424102d90 0x7f74241009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7422ffd640 1 -- 172.21.15.18:0/74729381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7424108290 msgr2=0x7f7424101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7422ffd640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7424108290 0x7f7424101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7422ffd640 1 -- 172.21.15.18:0/74729381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7424102d90 msgr2=0x7f74241009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7422ffd640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7424102d90 0x7f74241009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7422ffd640 1 -- 172.21.15.18:0/74729381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74241a6a80 con 0x7f7424103740 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7423fff640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7424108290 0x7f7424101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7422ffd640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7424103740 0x7f7424100f30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f741800d770 tx=0x7f741800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:22.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.194+0000 7f7420ff9640 1 -- 172.21.15.18:0/74729381 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418017070 con 0x7f7424103740 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.195+0000 7f7429a6b640 1 -- 172.21.15.18:0/74729381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74241a6d70 con 0x7f7424103740 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.195+0000 7f7420ff9640 1 -- 172.21.15.18:0/74729381 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7418009c30 con 0x7f7424103740 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.195+0000 7f7420ff9640 1 -- 172.21.15.18:0/74729381 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741800f620 con 0x7f7424103740 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.195+0000 7f7429a6b640 1 -- 172.21.15.18:0/74729381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74241a7270 con 0x7f7424103740 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.196+0000 7f7429a6b640 1 -- 172.21.15.18:0/74729381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742406a7f0 con 0x7f7424103740 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.198+0000 7f7420ff9640 1 -- 172.21.15.18:0/74729381 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f741801a070 con 0x7f7424103740 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.198+0000 7f7420ff9640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f740c0a32d0 0x7f740c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.199+0000 7f74237fe640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f740c0a32d0 0x7f740c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.199+0000 7f7420ff9640 1 -- 172.21.15.18:0/74729381 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f74180cef10 con 0x7f7424103740 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.199+0000 7f74237fe640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f740c0a32d0 0x7f740c0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7414000f80 tx=0x7f7414031550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.203+0000 7f7420ff9640 1 -- 172.21.15.18:0/74729381 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7418009de0 con 0x7f7424103740 2024-09-19T09:51:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.383+0000 7f7429a6b640 1 -- 172.21.15.18:0/74729381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f74241a74a0 con 0x7f7424103740 2024-09-19T09:51:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.383+0000 7f7420ff9640 1 -- 172.21.15.18:0/74729381 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f741809bb80 con 0x7f7424103740 2024-09-19T09:51:22.386 INFO:teuthology.orchestra.run.smithi018.stdout:244813135910 2024-09-19T09:51:22.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.385+0000 7f7429a6b640 1 -- 172.21.15.18:0/74729381 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f740c0a32d0 msgr2=0x7f740c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:22.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.385+0000 7f7429a6b640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f740c0a32d0 0x7f740c0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7414000f80 tx=0x7f7414031550 comp rx=0 tx=0).stop 2024-09-19T09:51:22.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.385+0000 7f7429a6b640 1 -- 172.21.15.18:0/74729381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7424103740 msgr2=0x7f7424100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.385+0000 7f7429a6b640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7424103740 0x7f7424100f30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f741800d770 tx=0x7f741800dc30 comp rx=0 tx=0).stop 2024-09-19T09:51:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.385+0000 7f7429a6b640 1 -- 172.21.15.18:0/74729381 shutdown_connections 2024-09-19T09:51:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.385+0000 7f7429a6b640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f740c0a32d0 0x7f740c0a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.385+0000 7f7429a6b640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7424108290 0x7f7424101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.385+0000 7f7429a6b640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7424103740 0x7f7424100f30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.385+0000 7f7429a6b640 1 --2- 172.21.15.18:0/74729381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7424102d90 0x7f74241009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.385+0000 7f7429a6b640 1 -- 172.21.15.18:0/74729381 >> 172.21.15.18:0/74729381 conn(0x7f74240fc7d0 msgr2=0x7f7424105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.386+0000 7f7429a6b640 1 -- 172.21.15.18:0/74729381 shutdown_connections 2024-09-19T09:51:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.386+0000 7f7429a6b640 1 -- 172.21.15.18:0/74729381 wait complete. 2024-09-19T09:51:22.614 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:22 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1731926409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:51:22.614 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:22 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/74729381' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:51:22.621 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:22.648 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514517 got 326417514519 for osd.11 2024-09-19T09:51:22.649 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:22.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:22 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1731926409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:51:22.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:22 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/74729381' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:51:22.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:22 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1731926409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:51:22.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:22 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/74729381' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:51:22.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 -- 172.21.15.18:0/2843266197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54cc102d30 msgr2=0x7f54cc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:22.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 --2- 172.21.15.18:0/2843266197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54cc102d30 0x7f54cc103110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009cd0 tx=0x7f54c402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 -- 172.21.15.18:0/2843266197 shutdown_connections 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 --2- 172.21.15.18:0/2843266197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc1082a0 0x7f54cc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 --2- 172.21.15.18:0/2843266197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc1036e0 0x7f54cc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 --2- 172.21.15.18:0/2843266197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54cc102d30 0x7f54cc103110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 -- 172.21.15.18:0/2843266197 >> 172.21.15.18:0/2843266197 conn(0x7f54cc0fc7d0 msgr2=0x7f54cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 -- 172.21.15.18:0/2843266197 shutdown_connections 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 -- 172.21.15.18:0/2843266197 wait complete. 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 Processor -- start 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.099+0000 7f54d312a640 1 -- start start 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54d312a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc102d30 0x7f54cc1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54d312a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54cc1036e0 0x7f54cc198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:22.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54d312a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc1082a0 0x7f54cc19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54d312a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc1120a0 con 0x7f54cc1036e0 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54d312a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc111f20 con 0x7f54cc102d30 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54d312a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc112220 con 0x7f54cc1082a0 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54cbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54cc1036e0 0x7f54cc198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54cbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54cc1036e0 0x7f54cc198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42720/0 (socket says 172.21.15.18:42720) 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54cbfff640 1 -- 172.21.15.18:0/1731926409 learned_addr learned my addr 172.21.15.18:0/1731926409 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54d16c7640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc1082a0 0x7f54cc19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54d0ec6640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc102d30 0x7f54cc1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54cbfff640 1 -- 172.21.15.18:0/1731926409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc1082a0 msgr2=0x7f54cc19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54cbfff640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc1082a0 0x7f54cc19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54cbfff640 1 -- 172.21.15.18:0/1731926409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc102d30 msgr2=0x7f54cc1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54cbfff640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc102d30 0x7f54cc1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54cbfff640 1 -- 172.21.15.18:0/1731926409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc19d570 con 0x7f54cc1036e0 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54d16c7640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc1082a0 0x7f54cc19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54cbfff640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54cc1036e0 0x7f54cc198b00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f54b400c8c0 tx=0x7f54b400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54c9ffb640 1 -- 172.21.15.18:0/1731926409 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4007bb0 con 0x7f54cc1036e0 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54d312a640 1 -- 172.21.15.18:0/1731926409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc19d860 con 0x7f54cc1036e0 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54c9ffb640 1 -- 172.21.15.18:0/1731926409 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b4007d50 con 0x7f54cc1036e0 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.100+0000 7f54c9ffb640 1 -- 172.21.15.18:0/1731926409 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4018830 con 0x7f54cc1036e0 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.101+0000 7f54d312a640 1 -- 172.21.15.18:0/1731926409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc1a5140 con 0x7f54cc1036e0 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.102+0000 7f54d312a640 1 -- 172.21.15.18:0/1731926409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54cc06a850 con 0x7f54cc1036e0 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.103+0000 7f54c9ffb640 1 -- 172.21.15.18:0/1731926409 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f54b4018a10 con 0x7f54cc1036e0 2024-09-19T09:51:22.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.103+0000 7f54c9ffb640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54b80a32d0 0x7f54b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.104+0000 7f54c9ffb640 1 -- 172.21.15.18:0/1731926409 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f54b40cfbd0 con 0x7f54cc1036e0 2024-09-19T09:51:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.104+0000 7f54d0ec6640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54b80a32d0 0x7f54b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.104+0000 7f54d0ec6640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54b80a32d0 0x7f54b80a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f54c4006010 tx=0x7f54c4000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:22.953 INFO:teuthology.orchestra.run.smithi018.stdout:158913790005 2024-09-19T09:51:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.108+0000 7f54c9ffb640 1 -- 172.21.15.18:0/1731926409 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f54b4014030 con 0x7f54cc1036e0 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.290+0000 7f54d312a640 1 -- 172.21.15.18:0/1731926409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f54cc10a2b0 con 0x7f54cc1036e0 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.290+0000 7f54c9ffb640 1 -- 172.21.15.18:0/1731926409 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f54b401f300 con 0x7f54cc1036e0 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 -- 172.21.15.18:0/1731926409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54b80a32d0 msgr2=0x7f54b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54b80a32d0 0x7f54b80a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f54c4006010 tx=0x7f54c4000f40 comp rx=0 tx=0).stop 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 -- 172.21.15.18:0/1731926409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54cc1036e0 msgr2=0x7f54cc198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54cc1036e0 0x7f54cc198b00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f54b400c8c0 tx=0x7f54b400cd80 comp rx=0 tx=0).stop 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 -- 172.21.15.18:0/1731926409 shutdown_connections 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54b80a32d0 0x7f54b80a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc1082a0 0x7f54cc19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54cc1036e0 0x7f54cc198b00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 --2- 172.21.15.18:0/1731926409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54cc102d30 0x7f54cc1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 -- 172.21.15.18:0/1731926409 >> 172.21.15.18:0/1731926409 conn(0x7f54cc0fc7d0 msgr2=0x7f54cc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:22.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 -- 172.21.15.18:0/1731926409 shutdown_connections 2024-09-19T09:51:22.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:22.292+0000 7f54d312a640 1 -- 172.21.15.18:0/1731926409 wait complete. 2024-09-19T09:51:23.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:23 smithi018 ceph-mon[30956]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:51:23.869 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135907 got 244813135910 for osd.8 2024-09-19T09:51:23.870 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:23.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:23 smithi049 ceph-mon[34858]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:51:23.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:23 smithi162 ceph-mon[35174]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:51:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.061+0000 7fd131aed640 1 -- 172.21.15.18:0/1441898595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd12c102570 msgr2=0x7fd12c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.061+0000 7fd131aed640 1 --2- 172.21.15.18:0/1441898595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd12c102570 0x7fd12c1029b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd120009900 tx=0x7fd12002a480 comp rx=0 tx=0).stop 2024-09-19T09:51:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.061+0000 7fd131aed640 1 -- 172.21.15.18:0/1441898595 shutdown_connections 2024-09-19T09:51:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.061+0000 7fd131aed640 1 --2- 172.21.15.18:0/1441898595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c102ef0 0x7fd12c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.061+0000 7fd131aed640 1 --2- 172.21.15.18:0/1441898595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd12c102570 0x7fd12c1029b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.061+0000 7fd131aed640 1 --2- 172.21.15.18:0/1441898595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd12c100e20 0x7fd12c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.061+0000 7fd131aed640 1 -- 172.21.15.18:0/1441898595 >> 172.21.15.18:0/1441898595 conn(0x7fd12c0fc7d0 msgr2=0x7fd12c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.062+0000 7fd131aed640 1 -- 172.21.15.18:0/1441898595 shutdown_connections 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.062+0000 7fd131aed640 1 -- 172.21.15.18:0/1441898595 wait complete. 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.062+0000 7fd131aed640 1 Processor -- start 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.062+0000 7fd131aed640 1 -- start start 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd131aed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd12c100e20 0x7fd12c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd131aed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c102570 0x7fd12c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd131aed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd12c102ef0 0x7fd12c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd131aed640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c110fa0 con 0x7fd12c102ef0 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd131aed640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c110e20 con 0x7fd12c102570 2024-09-19T09:51:24.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd131aed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c111120 con 0x7fd12c100e20 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd12c102ef0 0x7fd12c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd12c102ef0 0x7fd12c19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42754/0 (socket says 172.21.15.18:42754) 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12bfff640 1 -- 172.21.15.18:0/2487437769 learned_addr learned my addr 172.21.15.18:0/2487437769 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12b7fe640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd12c100e20 0x7fd12c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12affd640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c102570 0x7fd12c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12bfff640 1 -- 172.21.15.18:0/2487437769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd12c100e20 msgr2=0x7fd12c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12bfff640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd12c100e20 0x7fd12c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12bfff640 1 -- 172.21.15.18:0/2487437769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c102570 msgr2=0x7fd12c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12bfff640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c102570 0x7fd12c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12bfff640 1 -- 172.21.15.18:0/2487437769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12c19d490 con 0x7fd12c102ef0 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd12bfff640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd12c102ef0 0x7fd12c19cdb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd124009fd0 tx=0x7fd12400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:24.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd128ff9640 1 -- 172.21.15.18:0/2487437769 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124011830 con 0x7fd12c102ef0 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.063+0000 7fd128ff9640 1 -- 172.21.15.18:0/2487437769 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd124016070 con 0x7fd12c102ef0 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.064+0000 7fd131aed640 1 -- 172.21.15.18:0/2487437769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd12c19d780 con 0x7fd12c102ef0 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.064+0000 7fd128ff9640 1 -- 172.21.15.18:0/2487437769 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12400f2e0 con 0x7fd12c102ef0 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.064+0000 7fd131aed640 1 -- 172.21.15.18:0/2487437769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd12c1a5060 con 0x7fd12c102ef0 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.065+0000 7fd131aed640 1 -- 172.21.15.18:0/2487437769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12c101200 con 0x7fd12c102ef0 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.066+0000 7fd128ff9640 1 -- 172.21.15.18:0/2487437769 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd1240119d0 con 0x7fd12c102ef0 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.067+0000 7fd128ff9640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd1140a3350 0x7fd1140a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.067+0000 7fd12b7fe640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd1140a3350 0x7fd1140a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.067+0000 7fd128ff9640 1 -- 172.21.15.18:0/2487437769 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fd1240cf5c0 con 0x7fd12c102ef0 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.067+0000 7fd12b7fe640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd1140a3350 0x7fd1140a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd11c007ec0 tx=0x7fd11c0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.070+0000 7fd128ff9640 1 -- 172.21.15.18:0/2487437769 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd12409c340 con 0x7fd12c102ef0 2024-09-19T09:51:24.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.254+0000 7fd131aed640 1 -- 172.21.15.18:0/2487437769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd12c10a0a0 con 0x7fd12c102ef0 2024-09-19T09:51:24.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.255+0000 7fd128ff9640 1 -- 172.21.15.18:0/2487437769 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd12409bc40 con 0x7fd12c102ef0 2024-09-19T09:51:24.257 INFO:teuthology.orchestra.run.smithi018.stdout:137438953531 2024-09-19T09:51:24.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 -- 172.21.15.18:0/2487437769 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd1140a3350 msgr2=0x7fd1140a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:24.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd1140a3350 0x7fd1140a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd11c007ec0 tx=0x7fd11c0075b0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 -- 172.21.15.18:0/2487437769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd12c102ef0 msgr2=0x7fd12c19cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:24.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd12c102ef0 0x7fd12c19cdb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd124009fd0 tx=0x7fd12400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 -- 172.21.15.18:0/2487437769 shutdown_connections 2024-09-19T09:51:24.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd1140a3350 0x7fd1140a5810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd12c102ef0 0x7fd12c19cdb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12c102570 0x7fd12c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 --2- 172.21.15.18:0/2487437769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd12c100e20 0x7fd12c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 -- 172.21.15.18:0/2487437769 >> 172.21.15.18:0/2487437769 conn(0x7fd12c0fc7d0 msgr2=0x7fd12c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:24.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 -- 172.21.15.18:0/2487437769 shutdown_connections 2024-09-19T09:51:24.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.257+0000 7fd131aed640 1 -- 172.21.15.18:0/2487437769 wait complete. 2024-09-19T09:51:24.762 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:24 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2487437769' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:51:24.762 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:24 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:51:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 -- 172.21.15.18:0/1890271858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86fc102790 msgr2=0x7f86fc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 --2- 172.21.15.18:0/1890271858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86fc102790 0x7f86fc1067e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009900 tx=0x7f86ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:51:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 -- 172.21.15.18:0/1890271858 shutdown_connections 2024-09-19T09:51:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 --2- 172.21.15.18:0/1890271858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86fc106f10 0x7f86fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 --2- 172.21.15.18:0/1890271858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86fc102790 0x7f86fc1067e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 --2- 172.21.15.18:0/1890271858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc101de0 0x7f86fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 -- 172.21.15.18:0/1890271858 >> 172.21.15.18:0/1890271858 conn(0x7f86fc0fd8c0 msgr2=0x7f86fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 -- 172.21.15.18:0/1890271858 shutdown_connections 2024-09-19T09:51:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 -- 172.21.15.18:0/1890271858 wait complete. 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 Processor -- start 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.844+0000 7f870332a640 1 -- start start 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f870332a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc101de0 0x7f86fc1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f870332a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86fc102790 0x7f86fc1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f870332a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86fc106f10 0x7f86fc19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f870332a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc111f70 con 0x7f86fc102790 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f870332a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc111df0 con 0x7f86fc106f10 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f870332a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1120f0 con 0x7f86fc101de0 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87008c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86fc102790 0x7f86fc1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87008c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86fc102790 0x7f86fc1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42772/0 (socket says 172.21.15.18:42772) 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87010c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc101de0 0x7f86fc1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87008c5640 1 -- 172.21.15.18:0/1550095767 learned_addr learned my addr 172.21.15.18:0/1550095767 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87018c7640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86fc106f10 0x7f86fc19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87008c5640 1 -- 172.21.15.18:0/1550095767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc101de0 msgr2=0x7f86fc1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87008c5640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc101de0 0x7f86fc1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87008c5640 1 -- 172.21.15.18:0/1550095767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86fc106f10 msgr2=0x7f86fc19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87008c5640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86fc106f10 0x7f86fc19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87008c5640 1 -- 172.21.15.18:0/1550095767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc19d460 con 0x7f86fc102790 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87010c6640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc101de0 0x7f86fc1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f87008c5640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86fc102790 0x7f86fc1989f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f86ec006010 tx=0x7f86ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f86f27fc640 1 -- 172.21.15.18:0/1550095767 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec03f030 con 0x7f86fc102790 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f86f27fc640 1 -- 172.21.15.18:0/1550095767 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ec003ce0 con 0x7f86fc102790 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f870332a640 1 -- 172.21.15.18:0/1550095767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86fc19d6f0 con 0x7f86fc102790 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.845+0000 7f86f27fc640 1 -- 172.21.15.18:0/1550095767 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec035070 con 0x7f86fc102790 2024-09-19T09:51:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.846+0000 7f870332a640 1 -- 172.21.15.18:0/1550095767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86fc1a5030 con 0x7f86fc102790 2024-09-19T09:51:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.846+0000 7f870332a640 1 -- 172.21.15.18:0/1550095767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86fc1021c0 con 0x7f86fc102790 2024-09-19T09:51:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.848+0000 7f86f27fc640 1 -- 172.21.15.18:0/1550095767 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f86ec042030 con 0x7f86fc102790 2024-09-19T09:51:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.848+0000 7f86f27fc640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f86e80a3350 0x7f86e80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.848+0000 7f87010c6640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f86e80a3350 0x7f86e80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.848+0000 7f86f27fc640 1 -- 172.21.15.18:0/1550095767 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f86ec0ef8e0 con 0x7f86fc102790 2024-09-19T09:51:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.849+0000 7f87010c6640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f86e80a3350 0x7f86e80a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009fc0 tx=0x7f86f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:24.852+0000 7f86f27fc640 1 -- 172.21.15.18:0/1550095767 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f86ec0bc0c0 con 0x7f86fc102790 2024-09-19T09:51:24.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:24 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2487437769' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:51:24.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:24 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:51:24.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:24 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2487437769' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:51:24.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:24 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:51:25.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.032+0000 7f870332a640 1 -- 172.21.15.18:0/1550095767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f86fc10a150 con 0x7f86fc102790 2024-09-19T09:51:25.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.033+0000 7f86f27fc640 1 -- 172.21.15.18:0/1550095767 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f86ec0c03c0 con 0x7f86fc102790 2024-09-19T09:51:25.035 INFO:teuthology.orchestra.run.smithi018.stdout:296352743453 2024-09-19T09:51:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 -- 172.21.15.18:0/1550095767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f86e80a3350 msgr2=0x7f86e80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f86e80a3350 0x7f86e80a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009fc0 tx=0x7f86f8005f90 comp rx=0 tx=0).stop 2024-09-19T09:51:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 -- 172.21.15.18:0/1550095767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86fc102790 msgr2=0x7f86fc1989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86fc102790 0x7f86fc1989f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f86ec006010 tx=0x7f86ec0042f0 comp rx=0 tx=0).stop 2024-09-19T09:51:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 -- 172.21.15.18:0/1550095767 shutdown_connections 2024-09-19T09:51:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f86e80a3350 0x7f86e80a5810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86fc106f10 0x7f86fc19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86fc102790 0x7f86fc1989f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 --2- 172.21.15.18:0/1550095767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc101de0 0x7f86fc1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 -- 172.21.15.18:0/1550095767 >> 172.21.15.18:0/1550095767 conn(0x7f86fc0fd8c0 msgr2=0x7f86fc0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 -- 172.21.15.18:0/1550095767 shutdown_connections 2024-09-19T09:51:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:25.035+0000 7f870332a640 1 -- 172.21.15.18:0/1550095767 wait complete. 2024-09-19T09:51:25.353 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738446 for osd.0 2024-09-19T09:51:25.354 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:25.629 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:25 smithi018 ceph-mon[30956]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-19T09:51:25.629 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:25 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1550095767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:51:25.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:25 smithi049 ceph-mon[34858]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-19T09:51:25.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:25 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1550095767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:51:25.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:25 smithi162 ceph-mon[35174]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-19T09:51:25.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:25 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1550095767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:51:25.932 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790002 got 158913790005 for osd.5 2024-09-19T09:51:25.933 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:26.362 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953528 got 137438953531 for osd.4 2024-09-19T09:51:26.362 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:26.559 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:26.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.772+0000 7f8553a4a640 1 -- 172.21.15.18:0/3782880377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c1036e0 msgr2=0x7f854c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.772+0000 7f8553a4a640 1 --2- 172.21.15.18:0/3782880377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c1036e0 0x7f854c107b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f853c009930 tx=0x7f853c02a420 comp rx=0 tx=0).stop 2024-09-19T09:51:26.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.772+0000 7f8553a4a640 1 -- 172.21.15.18:0/3782880377 shutdown_connections 2024-09-19T09:51:26.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.772+0000 7f8553a4a640 1 --2- 172.21.15.18:0/3782880377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c1082a0 0x7f854c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.772+0000 7f8553a4a640 1 --2- 172.21.15.18:0/3782880377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c1036e0 0x7f854c107b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.772+0000 7f8553a4a640 1 --2- 172.21.15.18:0/3782880377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102d30 0x7f854c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.772+0000 7f8553a4a640 1 -- 172.21.15.18:0/3782880377 >> 172.21.15.18:0/3782880377 conn(0x7f854c0fc7d0 msgr2=0x7f854c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:26.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.772+0000 7f8553a4a640 1 -- 172.21.15.18:0/3782880377 shutdown_connections 2024-09-19T09:51:26.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.772+0000 7f8553a4a640 1 -- 172.21.15.18:0/3782880377 wait complete. 2024-09-19T09:51:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.773+0000 7f8553a4a640 1 Processor -- start 2024-09-19T09:51:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.773+0000 7f8553a4a640 1 -- start start 2024-09-19T09:51:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.773+0000 7f8553a4a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d30 0x7f854c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.773+0000 7f8553a4a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c1036e0 0x7f854c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.773+0000 7f8553a4a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c1082a0 0x7f854c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.773+0000 7f8553a4a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f854c1120b0 con 0x7f854c102d30 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.773+0000 7f8553a4a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f854c111f30 con 0x7f854c1082a0 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.773+0000 7f8553a4a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f854c112230 con 0x7f854c1036e0 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f85517e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d30 0x7f854c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f85517e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d30 0x7f854c100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50754/0 (socket says 172.21.15.18:50754) 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f85517e6640 1 -- 172.21.15.18:0/1402000391 learned_addr learned my addr 172.21.15.18:0/1402000391 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f8551fe7640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c1082a0 0x7f854c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f8550fe5640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c1036e0 0x7f854c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f85517e6640 1 -- 172.21.15.18:0/1402000391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c1036e0 msgr2=0x7f854c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f85517e6640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c1036e0 0x7f854c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f85517e6640 1 -- 172.21.15.18:0/1402000391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c1082a0 msgr2=0x7f854c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f85517e6640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c1082a0 0x7f854c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f85517e6640 1 -- 172.21.15.18:0/1402000391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c1a6a50 con 0x7f854c102d30 2024-09-19T09:51:26.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f85517e6640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d30 0x7f854c100990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f854800ea60 tx=0x7f854800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:26.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f85427fc640 1 -- 172.21.15.18:0/1402000391 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854800cde0 con 0x7f854c102d30 2024-09-19T09:51:26.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.774+0000 7f8553a4a640 1 -- 172.21.15.18:0/1402000391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c1a6d40 con 0x7f854c102d30 2024-09-19T09:51:26.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.775+0000 7f85427fc640 1 -- 172.21.15.18:0/1402000391 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85480035f0 con 0x7f854c102d30 2024-09-19T09:51:26.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.775+0000 7f85427fc640 1 -- 172.21.15.18:0/1402000391 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548010670 con 0x7f854c102d30 2024-09-19T09:51:26.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.775+0000 7f8553a4a640 1 -- 172.21.15.18:0/1402000391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c1a7240 con 0x7f854c102d30 2024-09-19T09:51:26.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.776+0000 7f8553a4a640 1 -- 172.21.15.18:0/1402000391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c103110 con 0x7f854c102d30 2024-09-19T09:51:26.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.778+0000 7f85427fc640 1 -- 172.21.15.18:0/1402000391 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f85480037a0 con 0x7f854c102d30 2024-09-19T09:51:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.779+0000 7f85427fc640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85380a32d0 0x7f85380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.779+0000 7f85427fc640 1 -- 172.21.15.18:0/1402000391 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f85480cfc70 con 0x7f854c102d30 2024-09-19T09:51:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.780+0000 7f8550fe5640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85380a32d0 0x7f85380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:26.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.780+0000 7f8550fe5640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85380a32d0 0x7f85380a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f853c02a940 tx=0x7f853c005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:26.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.782+0000 7f85427fc640 1 -- 172.21.15.18:0/1402000391 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f854809ca70 con 0x7f854c102d30 2024-09-19T09:51:26.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.963+0000 7f8553a4a640 1 -- 172.21.15.18:0/1402000391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f854c101ec0 con 0x7f854c102d30 2024-09-19T09:51:26.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:26.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:26.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:26.965 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:26 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:26.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.963+0000 7f85427fc640 1 -- 172.21.15.18:0/1402000391 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f854c101ec0 con 0x7f854c102d30 2024-09-19T09:51:26.966 INFO:teuthology.orchestra.run.smithi018.stdout:274877906979 2024-09-19T09:51:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 -- 172.21.15.18:0/1402000391 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85380a32d0 msgr2=0x7f85380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85380a32d0 0x7f85380a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f853c02a940 tx=0x7f853c005a40 comp rx=0 tx=0).stop 2024-09-19T09:51:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 -- 172.21.15.18:0/1402000391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d30 msgr2=0x7f854c100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d30 0x7f854c100990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f854800ea60 tx=0x7f854800ef20 comp rx=0 tx=0).stop 2024-09-19T09:51:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 -- 172.21.15.18:0/1402000391 shutdown_connections 2024-09-19T09:51:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f85380a32d0 0x7f85380a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c1082a0 0x7f854c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f854c1036e0 0x7f854c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 --2- 172.21.15.18:0/1402000391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d30 0x7f854c100990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:26.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 -- 172.21.15.18:0/1402000391 >> 172.21.15.18:0/1402000391 conn(0x7f854c0fc7d0 msgr2=0x7f854c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:26.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 -- 172.21.15.18:0/1402000391 shutdown_connections 2024-09-19T09:51:26.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:26.965+0000 7f8553a4a640 1 -- 172.21.15.18:0/1402000391 wait complete. 2024-09-19T09:51:27.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:27.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:27.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:27.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:26 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:27.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:27.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:27.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:27.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:26 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:27.810 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743450 got 296352743453 for osd.10 2024-09-19T09:51:27.810 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.929+0000 7f6957765640 1 -- 172.21.15.18:0/3833842538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6950102ef0 msgr2=0x7f695010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.929+0000 7f6957765640 1 --2- 172.21.15.18:0/3833842538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6950102ef0 0x7f695010da40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6948009ca0 tx=0x7f694802a950 comp rx=0 tx=0).stop 2024-09-19T09:51:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.929+0000 7f6957765640 1 -- 172.21.15.18:0/3833842538 shutdown_connections 2024-09-19T09:51:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.929+0000 7f6957765640 1 --2- 172.21.15.18:0/3833842538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6950102ef0 0x7f695010da40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.929+0000 7f6957765640 1 --2- 172.21.15.18:0/3833842538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6950102570 0x7f69501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.929+0000 7f6957765640 1 --2- 172.21.15.18:0/3833842538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6950100e20 0x7f6950101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.929+0000 7f6957765640 1 -- 172.21.15.18:0/3833842538 >> 172.21.15.18:0/3833842538 conn(0x7f69500fc7d0 msgr2=0x7f69500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.929+0000 7f6957765640 1 -- 172.21.15.18:0/3833842538 shutdown_connections 2024-09-19T09:51:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.929+0000 7f6957765640 1 -- 172.21.15.18:0/3833842538 wait complete. 2024-09-19T09:51:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6957765640 1 Processor -- start 2024-09-19T09:51:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6957765640 1 -- start start 2024-09-19T09:51:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6957765640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6950100e20 0x7f6950198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6957765640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6950102570 0x7f6950198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6957765640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6950102ef0 0x7f695019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6957765640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6950110f80 con 0x7f6950102ef0 2024-09-19T09:51:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6957765640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6950110e00 con 0x7f6950100e20 2024-09-19T09:51:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6957765640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6950111100 con 0x7f6950102570 2024-09-19T09:51:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6955d02640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6950102ef0 0x7f695019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6955d02640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6950102ef0 0x7f695019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50776/0 (socket says 172.21.15.18:50776) 2024-09-19T09:51:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6955d02640 1 -- 172.21.15.18:0/2465510155 learned_addr learned my addr 172.21.15.18:0/2465510155 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.930+0000 7f6955501640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6950100e20 0x7f6950198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f6954d00640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6950102570 0x7f6950198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f6955d02640 1 -- 172.21.15.18:0/2465510155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6950102570 msgr2=0x7f6950198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f6955d02640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6950102570 0x7f6950198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f6955d02640 1 -- 172.21.15.18:0/2465510155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6950100e20 msgr2=0x7f6950198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f6955d02640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6950100e20 0x7f6950198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f6955d02640 1 -- 172.21.15.18:0/2465510155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695019d4b0 con 0x7f6950102ef0 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f6954d00640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6950102570 0x7f6950198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f6955d02640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6950102ef0 0x7f695019cdd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f694802ae70 tx=0x7f694802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f69427fc640 1 -- 172.21.15.18:0/2465510155 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948034040 con 0x7f6950102ef0 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f69427fc640 1 -- 172.21.15.18:0/2465510155 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6948030920 con 0x7f6950102ef0 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f6957765640 1 -- 172.21.15.18:0/2465510155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695019d740 con 0x7f6950102ef0 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f69427fc640 1 -- 172.21.15.18:0/2465510155 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948045480 con 0x7f6950102ef0 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.931+0000 7f6957765640 1 -- 172.21.15.18:0/2465510155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69501a5080 con 0x7f6950102ef0 2024-09-19T09:51:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.932+0000 7f6957765640 1 -- 172.21.15.18:0/2465510155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69501021b0 con 0x7f6950102ef0 2024-09-19T09:51:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.934+0000 7f69427fc640 1 -- 172.21.15.18:0/2465510155 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6948037020 con 0x7f6950102ef0 2024-09-19T09:51:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.934+0000 7f69427fc640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f693c0a32d0 0x7f693c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.934+0000 7f6955501640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f693c0a32d0 0x7f693c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.934+0000 7f69427fc640 1 -- 172.21.15.18:0/2465510155 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f69480f0860 con 0x7f6950102ef0 2024-09-19T09:51:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.935+0000 7f6955501640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f693c0a32d0 0x7f693c0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f694c005fd0 tx=0x7f694c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:27.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:27.937+0000 7f69427fc640 1 -- 172.21.15.18:0/2465510155 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6948081210 con 0x7f6950102ef0 2024-09-19T09:51:28.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:27 smithi018 ceph-mon[30956]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:51:28.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:27 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1402000391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:51:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.115+0000 7f6957765640 1 -- 172.21.15.18:0/2465510155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f695010a0a0 con 0x7f6950102ef0 2024-09-19T09:51:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.115+0000 7f69427fc640 1 -- 172.21.15.18:0/2465510155 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f69480bd6e0 con 0x7f6950102ef0 2024-09-19T09:51:28.117 INFO:teuthology.orchestra.run.smithi018.stdout:214748364844 2024-09-19T09:51:28.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 -- 172.21.15.18:0/2465510155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f693c0a32d0 msgr2=0x7f693c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:28.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f693c0a32d0 0x7f693c0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f694c005fd0 tx=0x7f694c00b390 comp rx=0 tx=0).stop 2024-09-19T09:51:28.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 -- 172.21.15.18:0/2465510155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6950102ef0 msgr2=0x7f695019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:28.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6950102ef0 0x7f695019cdd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f694802ae70 tx=0x7f694802f5d0 comp rx=0 tx=0).stop 2024-09-19T09:51:28.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 -- 172.21.15.18:0/2465510155 shutdown_connections 2024-09-19T09:51:28.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f693c0a32d0 0x7f693c0a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:28.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6950102ef0 0x7f695019cdd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:28.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6950102570 0x7f6950198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:28.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 --2- 172.21.15.18:0/2465510155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6950100e20 0x7f6950198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:28.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 -- 172.21.15.18:0/2465510155 >> 172.21.15.18:0/2465510155 conn(0x7f69500fc7d0 msgr2=0x7f695006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:28.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 -- 172.21.15.18:0/2465510155 shutdown_connections 2024-09-19T09:51:28.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.117+0000 7f6957765640 1 -- 172.21.15.18:0/2465510155 wait complete. 2024-09-19T09:51:28.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:27 smithi049 ceph-mon[34858]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:51:28.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:27 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1402000391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:51:28.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:27 smithi162 ceph-mon[35174]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:51:28.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:27 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1402000391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:51:28.387 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906975 got 274877906979 for osd.9 2024-09-19T09:51:28.388 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:28.895 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:28 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2465510155' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:51:29.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.979+0000 7f9f95d50640 1 -- 172.21.15.18:0/4221550675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f90102ef0 msgr2=0x7f9f9010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.979+0000 7f9f95d50640 1 --2- 172.21.15.18:0/4221550675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f90102ef0 0x7f9f9010da40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009ca0 tx=0x7f9f8802a950 comp rx=0 tx=0).stop 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.979+0000 7f9f95d50640 1 -- 172.21.15.18:0/4221550675 shutdown_connections 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.979+0000 7f9f95d50640 1 --2- 172.21.15.18:0/4221550675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f90102ef0 0x7f9f9010da40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.979+0000 7f9f95d50640 1 --2- 172.21.15.18:0/4221550675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f90102570 0x7f9f901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.979+0000 7f9f95d50640 1 --2- 172.21.15.18:0/4221550675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90100e20 0x7f9f90101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.979+0000 7f9f95d50640 1 -- 172.21.15.18:0/4221550675 >> 172.21.15.18:0/4221550675 conn(0x7f9f900fc7d0 msgr2=0x7f9f900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.979+0000 7f9f95d50640 1 -- 172.21.15.18:0/4221550675 shutdown_connections 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.979+0000 7f9f95d50640 1 -- 172.21.15.18:0/4221550675 wait complete. 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.979+0000 7f9f95d50640 1 Processor -- start 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f95d50640 1 -- start start 2024-09-19T09:51:29.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f95d50640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f90100e20 0x7f9f900fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f95d50640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f90102570 0x7f9f900fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f95d50640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90102ef0 0x7f9f900fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f95d50640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f90111020 con 0x7f9f90102570 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f95d50640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9f90110ea0 con 0x7f9f90102ef0 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f95d50640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9f901111a0 con 0x7f9f90100e20 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f8effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f90102570 0x7f9f900fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f8effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f90102570 0x7f9f900fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50794/0 (socket says 172.21.15.18:50794) 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f8effd640 1 -- 172.21.15.18:0/3986480955 learned_addr learned my addr 172.21.15.18:0/3986480955 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f8f7fe640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f90100e20 0x7f9f900fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f8ffff640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90102ef0 0x7f9f900fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f8effd640 1 -- 172.21.15.18:0/3986480955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f90100e20 msgr2=0x7f9f900fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:29.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f8effd640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f90100e20 0x7f9f900fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f8effd640 1 -- 172.21.15.18:0/3986480955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90102ef0 msgr2=0x7f9f900fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f8effd640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90102ef0 0x7f9f900fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.980+0000 7f9f8effd640 1 -- 172.21.15.18:0/3986480955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f901a6aa0 con 0x7f9f90102570 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.981+0000 7f9f8effd640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f90102570 0x7f9f900fd1c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400b4a0 tx=0x7f9f8400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.981+0000 7f9f8cff9640 1 -- 172.21.15.18:0/3986480955 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f84015020 con 0x7f9f90102570 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.981+0000 7f9f8cff9640 1 -- 172.21.15.18:0/3986480955 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f84011d10 con 0x7f9f90102570 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.981+0000 7f9f95d50640 1 -- 172.21.15.18:0/3986480955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f901a6d90 con 0x7f9f90102570 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.981+0000 7f9f8cff9640 1 -- 172.21.15.18:0/3986480955 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400f2e0 con 0x7f9f90102570 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.981+0000 7f9f95d50640 1 -- 172.21.15.18:0/3986480955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f901a7270 con 0x7f9f90102570 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.982+0000 7f9f95d50640 1 -- 172.21.15.18:0/3986480955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f90101280 con 0x7f9f90102570 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.983+0000 7f9f8cff9640 1 -- 172.21.15.18:0/3986480955 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9f84018020 con 0x7f9f90102570 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.984+0000 7f9f8cff9640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9f780a32d0 0x7f9f780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:29.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.984+0000 7f9f8f7fe640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9f780a32d0 0x7f9f780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:29.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.984+0000 7f9f8cff9640 1 -- 172.21.15.18:0/3986480955 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f9f840cf030 con 0x7f9f90102570 2024-09-19T09:51:29.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.984+0000 7f9f8f7fe640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9f780a32d0 0x7f9f780a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009990 tx=0x7f9f80009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:29.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:28.988+0000 7f9f8cff9640 1 -- 172.21.15.18:0/3986480955 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9f8401f020 con 0x7f9f90102570 2024-09-19T09:51:29.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:28 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2465510155' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:51:29.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:28 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2465510155' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:51:29.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.168+0000 7f9f95d50640 1 -- 172.21.15.18:0/3986480955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9f900fe1b0 con 0x7f9f90102570 2024-09-19T09:51:29.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.168+0000 7f9f8cff9640 1 -- 172.21.15.18:0/3986480955 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9f900fe1b0 con 0x7f9f90102570 2024-09-19T09:51:29.170 INFO:teuthology.orchestra.run.smithi018.stdout:193273528370 2024-09-19T09:51:29.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.170+0000 7f9f95d50640 1 -- 172.21.15.18:0/3986480955 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9f780a32d0 msgr2=0x7f9f780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.170+0000 7f9f95d50640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9f780a32d0 0x7f9f780a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009990 tx=0x7f9f80009110 comp rx=0 tx=0).stop 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.170+0000 7f9f95d50640 1 -- 172.21.15.18:0/3986480955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f90102570 msgr2=0x7f9f900fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.170+0000 7f9f95d50640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f90102570 0x7f9f900fd1c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400b4a0 tx=0x7f9f8400b8a0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.171+0000 7f9f95d50640 1 -- 172.21.15.18:0/3986480955 shutdown_connections 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.171+0000 7f9f95d50640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9f780a32d0 0x7f9f780a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.171+0000 7f9f95d50640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f90102ef0 0x7f9f900fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.171+0000 7f9f95d50640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f90102570 0x7f9f900fd1c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.171+0000 7f9f95d50640 1 --2- 172.21.15.18:0/3986480955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f90100e20 0x7f9f900fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.171+0000 7f9f95d50640 1 -- 172.21.15.18:0/3986480955 >> 172.21.15.18:0/3986480955 conn(0x7f9f900fc7d0 msgr2=0x7f9f9006a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.171+0000 7f9f95d50640 1 -- 172.21.15.18:0/3986480955 shutdown_connections 2024-09-19T09:51:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:29.171+0000 7f9f95d50640 1 -- 172.21.15.18:0/3986480955 wait complete. 2024-09-19T09:51:29.882 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528368 got 193273528370 for osd.6 2024-09-19T09:51:29.883 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:30.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:29 smithi018 ceph-mon[30956]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-19T09:51:30.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:29 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3986480955' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:51:30.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:29 smithi049 ceph-mon[34858]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-19T09:51:30.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:29 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3986480955' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:51:30.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:29 smithi162 ceph-mon[35174]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-19T09:51:30.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:29 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3986480955' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:51:30.535 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364840 got 214748364844 for osd.7 2024-09-19T09:51:30.535 DEBUG:teuthology.parallel:result is None 2024-09-19T09:51:30.535 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:51:30.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:51:30.806 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:31.071 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-19T09:51:31.072 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:51:31.072 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T09:51:31.072 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T09:51:31.072 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-19T09:51:31.072 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-19T09:51:31.072 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:30 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-19T09:51:31.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-19T09:51:31.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:51:31.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T09:51:31.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T09:51:31.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-19T09:51:31.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-19T09:51:31.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:30 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-19T09:51:31.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-19T09:51:31.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:51:31.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T09:51:31.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T09:51:31.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-19T09:51:31.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-19T09:51:31.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:30 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-09-19T09:51:31.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.242+0000 7feb04aee640 1 -- 172.21.15.18:0/430078816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb00102570 msgr2=0x7feb001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.242+0000 7feb04aee640 1 --2- 172.21.15.18:0/430078816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb00102570 0x7feb001029b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009900 tx=0x7feaf402a480 comp rx=0 tx=0).stop 2024-09-19T09:51:31.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.243+0000 7feb04aee640 1 -- 172.21.15.18:0/430078816 shutdown_connections 2024-09-19T09:51:31.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.243+0000 7feb04aee640 1 --2- 172.21.15.18:0/430078816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb00102ef0 0x7feb0010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.243+0000 7feb04aee640 1 --2- 172.21.15.18:0/430078816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb00102570 0x7feb001029b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.243+0000 7feb04aee640 1 --2- 172.21.15.18:0/430078816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb00100e20 0x7feb00101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.243+0000 7feb04aee640 1 -- 172.21.15.18:0/430078816 >> 172.21.15.18:0/430078816 conn(0x7feb000fc7d0 msgr2=0x7feb000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:31.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.243+0000 7feb04aee640 1 -- 172.21.15.18:0/430078816 shutdown_connections 2024-09-19T09:51:31.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.243+0000 7feb04aee640 1 -- 172.21.15.18:0/430078816 wait complete. 2024-09-19T09:51:31.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.243+0000 7feb04aee640 1 Processor -- start 2024-09-19T09:51:31.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.243+0000 7feb04aee640 1 -- start start 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feb04aee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb00100e20 0x7feb00198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feb04aee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb00102570 0x7feb00198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feb04aee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb00102ef0 0x7feb0019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feb04aee640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb001120a0 con 0x7feb00102ef0 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feb04aee640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7feb00111f20 con 0x7feb00102570 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feb04aee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb00112220 con 0x7feb00100e20 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb00102ef0 0x7feb0019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafdd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb00102570 0x7feb00198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb00102ef0 0x7feb0019ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50810/0 (socket says 172.21.15.18:50810) 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafed9d640 1 -- 172.21.15.18:0/1620198904 learned_addr learned my addr 172.21.15.18:0/1620198904 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafe59c640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb00100e20 0x7feb00198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafed9d640 1 -- 172.21.15.18:0/1620198904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb00100e20 msgr2=0x7feb00198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafed9d640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb00100e20 0x7feb00198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafed9d640 1 -- 172.21.15.18:0/1620198904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb00102570 msgr2=0x7feb00198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafed9d640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb00102570 0x7feb00198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafed9d640 1 -- 172.21.15.18:0/1620198904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0019d510 con 0x7feb00102ef0 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.244+0000 7feafed9d640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb00102ef0 0x7feb0019ce30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feaf800c970 tx=0x7feaf800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.245+0000 7feaef7fe640 1 -- 172.21.15.18:0/1620198904 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8007bb0 con 0x7feb00102ef0 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.245+0000 7feaef7fe640 1 -- 172.21.15.18:0/1620198904 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf8007d50 con 0x7feb00102ef0 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.245+0000 7feb04aee640 1 -- 172.21.15.18:0/1620198904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0019d800 con 0x7feb00102ef0 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.245+0000 7feaef7fe640 1 -- 172.21.15.18:0/1620198904 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf800f450 con 0x7feb00102ef0 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.245+0000 7feb04aee640 1 -- 172.21.15.18:0/1620198904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb001a50e0 con 0x7feb00102ef0 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.246+0000 7feb04aee640 1 -- 172.21.15.18:0/1620198904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb00101200 con 0x7feb00102ef0 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.247+0000 7feaef7fe640 1 -- 172.21.15.18:0/1620198904 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7feaf8004f60 con 0x7feb00102ef0 2024-09-19T09:51:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.247+0000 7feaef7fe640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feae80a32d0 0x7feae80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:31.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.248+0000 7feafe59c640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feae80a32d0 0x7feae80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:31.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.248+0000 7feaef7fe640 1 -- 172.21.15.18:0/1620198904 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7feaf80cf730 con 0x7feb00102ef0 2024-09-19T09:51:31.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.248+0000 7feafe59c640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feae80a32d0 0x7feae80a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feaf000a400 tx=0x7feaf000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:31.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.252+0000 7feaef7fe640 1 -- 172.21.15.18:0/1620198904 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feaf8014030 con 0x7feb00102ef0 2024-09-19T09:51:31.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.433+0000 7feb04aee640 1 -- 172.21.15.18:0/1620198904 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb00062630 con 0x7feae80a32d0 2024-09-19T09:51:31.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.439+0000 7feaef7fe640 1 -- 172.21.15.18:0/1620198904 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258737 (secure 0 0 0) 0x7feb00062630 con 0x7feae80a32d0 2024-09-19T09:51:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:31.446 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:51:31.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.442+0000 7feb04aee640 1 -- 172.21.15.18:0/1620198904 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feae80a32d0 msgr2=0x7feae80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.442+0000 7feb04aee640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feae80a32d0 0x7feae80a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feaf000a400 tx=0x7feaf000d040 comp rx=0 tx=0).stop 2024-09-19T09:51:31.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.442+0000 7feb04aee640 1 -- 172.21.15.18:0/1620198904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb00102ef0 msgr2=0x7feb0019ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:31.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.442+0000 7feb04aee640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb00102ef0 0x7feb0019ce30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feaf800c970 tx=0x7feaf800ce30 comp rx=0 tx=0).stop 2024-09-19T09:51:31.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.443+0000 7feb04aee640 1 -- 172.21.15.18:0/1620198904 shutdown_connections 2024-09-19T09:51:31.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.443+0000 7feb04aee640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feae80a32d0 0x7feae80a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.443+0000 7feb04aee640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb00102ef0 0x7feb0019ce30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.443+0000 7feb04aee640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb00102570 0x7feb00198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.443+0000 7feb04aee640 1 --2- 172.21.15.18:0/1620198904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb00100e20 0x7feb00198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:31.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.443+0000 7feb04aee640 1 -- 172.21.15.18:0/1620198904 >> 172.21.15.18:0/1620198904 conn(0x7feb000fc7d0 msgr2=0x7feb000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:31.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.443+0000 7feb04aee640 1 -- 172.21.15.18:0/1620198904 shutdown_connections 2024-09-19T09:51:31.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:31.443+0000 7feb04aee640 1 -- 172.21.15.18:0/1620198904 wait complete. 2024-09-19T09:51:32.050 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-19T09:51:30.812183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658429,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":652,"num_read_kb":449,"num_write":425,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374364,"kb_used_data":12636,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567460,"statfs":{"total":1151940427776,"available":1151557079040,"internally_reserved":0,"allocated":12939264,"data_stored":7070355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.451431"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350952+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:50:30.350952+0000","last_peered":"2024-09-19T09:50:30.350952+0000","last_clean":"2024-09-19T09:50:30.350952+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:50:30.350952+0000","last_undegraded":"2024-09-19T09:50:30.350952+0000","last_fullsized":"2024-09-19T09:50:30.350952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365706+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:50:30.365706+0000","last_peered":"2024-09-19T09:50:30.365706+0000","last_clean":"2024-09-19T09:50:30.365706+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:50:30.365706+0000","last_undegraded":"2024-09-19T09:50:30.365706+0000","last_fullsized":"2024-09-19T09:50:30.365706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365686+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:50:30.365686+0000","last_peered":"2024-09-19T09:50:30.365686+0000","last_clean":"2024-09-19T09:50:30.365686+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:50:30.365686+0000","last_undegraded":"2024-09-19T09:50:30.365686+0000","last_fullsized":"2024-09-19T09:50:30.365686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350884+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:50:30.350884+0000","last_peered":"2024-09-19T09:50:30.350884+0000","last_clean":"2024-09-19T09:50:30.350884+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:50:30.350884+0000","last_undegraded":"2024-09-19T09:50:30.350884+0000","last_fullsized":"2024-09-19T09:50:30.350884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363363+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:50:30.363363+0000","last_peered":"2024-09-19T09:50:30.363363+0000","last_clean":"2024-09-19T09:50:30.363363+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:50:30.363363+0000","last_undegraded":"2024-09-19T09:50:30.363363+0000","last_fullsized":"2024-09-19T09:50:30.363363+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361812+0000","last_change":"2024-09-19T09:50:29.355326+0000","last_active":"2024-09-19T09:50:30.361812+0000","last_peered":"2024-09-19T09:50:30.361812+0000","last_clean":"2024-09-19T09:50:30.361812+0000","last_became_active":"2024-09-19T09:50:29.353527+0000","last_became_peered":"2024-09-19T09:50:29.353527+0000","last_unstale":"2024-09-19T09:50:30.361812+0000","last_undegraded":"2024-09-19T09:50:30.361812+0000","last_fullsized":"2024-09-19T09:50:30.361812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:24.250263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364898+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:50:30.364898+0000","last_peered":"2024-09-19T09:50:30.364898+0000","last_clean":"2024-09-19T09:50:30.364898+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:50:30.364898+0000","last_undegraded":"2024-09-19T09:50:30.364898+0000","last_fullsized":"2024-09-19T09:50:30.364898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362061+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:50:30.362061+0000","last_peered":"2024-09-19T09:50:30.362061+0000","last_clean":"2024-09-19T09:50:30.362061+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:50:30.362061+0000","last_undegraded":"2024-09-19T09:50:30.362061+0000","last_fullsized":"2024-09-19T09:50:30.362061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365738+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:50:30.365738+0000","last_peered":"2024-09-19T09:50:30.365738+0000","last_clean":"2024-09-19T09:50:30.365738+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:50:30.365738+0000","last_undegraded":"2024-09-19T09:50:30.365738+0000","last_fullsized":"2024-09-19T09:50:30.365738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362476+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:50:30.362476+0000","last_peered":"2024-09-19T09:50:30.362476+0000","last_clean":"2024-09-19T09:50:30.362476+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:50:30.362476+0000","last_undegraded":"2024-09-19T09:50:30.362476+0000","last_fullsized":"2024-09-19T09:50:30.362476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367368+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:50:30.367368+0000","last_peered":"2024-09-19T09:50:30.367368+0000","last_clean":"2024-09-19T09:50:30.367368+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:50:30.367368+0000","last_undegraded":"2024-09-19T09:50:30.367368+0000","last_fullsized":"2024-09-19T09:50:30.367368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350960+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:50:30.350960+0000","last_peered":"2024-09-19T09:50:30.350960+0000","last_clean":"2024-09-19T09:50:30.350960+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:50:30.350960+0000","last_undegraded":"2024-09-19T09:50:30.350960+0000","last_fullsized":"2024-09-19T09:50:30.350960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350141+0000","last_change":"2024-09-19T09:50:29.353493+0000","last_active":"2024-09-19T09:50:30.350141+0000","last_peered":"2024-09-19T09:50:30.350141+0000","last_clean":"2024-09-19T09:50:30.350141+0000","last_became_active":"2024-09-19T09:50:29.353040+0000","last_became_peered":"2024-09-19T09:50:29.353040+0000","last_unstale":"2024-09-19T09:50:30.350141+0000","last_undegraded":"2024-09-19T09:50:30.350141+0000","last_fullsized":"2024-09-19T09:50:30.350141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:07.751702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365257+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:50:30.365257+0000","last_peered":"2024-09-19T09:50:30.365257+0000","last_clean":"2024-09-19T09:50:30.365257+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:50:30.365257+0000","last_undegraded":"2024-09-19T09:50:30.365257+0000","last_fullsized":"2024-09-19T09:50:30.365257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365019+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:50:30.365019+0000","last_peered":"2024-09-19T09:50:30.365019+0000","last_clean":"2024-09-19T09:50:30.365019+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:50:30.365019+0000","last_undegraded":"2024-09-19T09:50:30.365019+0000","last_fullsized":"2024-09-19T09:50:30.365019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364552+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:50:30.364552+0000","last_peered":"2024-09-19T09:50:30.364552+0000","last_clean":"2024-09-19T09:50:30.364552+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:50:30.364552+0000","last_undegraded":"2024-09-19T09:50:30.364552+0000","last_fullsized":"2024-09-19T09:50:30.364552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350989+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:50:30.350989+0000","last_peered":"2024-09-19T09:50:30.350989+0000","last_clean":"2024-09-19T09:50:30.350989+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:50:30.350989+0000","last_undegraded":"2024-09-19T09:50:30.350989+0000","last_fullsized":"2024-09-19T09:50:30.350989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361305+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:50:30.361305+0000","last_peered":"2024-09-19T09:50:30.361305+0000","last_clean":"2024-09-19T09:50:30.361305+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:50:30.361305+0000","last_undegraded":"2024-09-19T09:50:30.361305+0000","last_fullsized":"2024-09-19T09:50:30.361305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363634+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:50:30.363634+0000","last_peered":"2024-09-19T09:50:30.363634+0000","last_clean":"2024-09-19T09:50:30.363634+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:50:30.363634+0000","last_undegraded":"2024-09-19T09:50:30.363634+0000","last_fullsized":"2024-09-19T09:50:30.363634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350740+0000","last_change":"2024-09-19T09:50:29.352834+0000","last_active":"2024-09-19T09:50:30.350740+0000","last_peered":"2024-09-19T09:50:30.350740+0000","last_clean":"2024-09-19T09:50:30.350740+0000","last_became_active":"2024-09-19T09:50:29.352483+0000","last_became_peered":"2024-09-19T09:50:29.352483+0000","last_unstale":"2024-09-19T09:50:30.350740+0000","last_undegraded":"2024-09-19T09:50:30.350740+0000","last_fullsized":"2024-09-19T09:50:30.350740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:43.916024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350217+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:50:30.350217+0000","last_peered":"2024-09-19T09:50:30.350217+0000","last_clean":"2024-09-19T09:50:30.350217+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:50:30.350217+0000","last_undegraded":"2024-09-19T09:50:30.350217+0000","last_fullsized":"2024-09-19T09:50:30.350217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364926+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:50:30.364926+0000","last_peered":"2024-09-19T09:50:30.364926+0000","last_clean":"2024-09-19T09:50:30.364926+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:50:30.364926+0000","last_undegraded":"2024-09-19T09:50:30.364926+0000","last_fullsized":"2024-09-19T09:50:30.364926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361960+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:50:30.361960+0000","last_peered":"2024-09-19T09:50:30.361960+0000","last_clean":"2024-09-19T09:50:30.361960+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:50:30.361960+0000","last_undegraded":"2024-09-19T09:50:30.361960+0000","last_fullsized":"2024-09-19T09:50:30.361960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366668+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:50:30.366668+0000","last_peered":"2024-09-19T09:50:30.366668+0000","last_clean":"2024-09-19T09:50:30.366668+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:50:30.366668+0000","last_undegraded":"2024-09-19T09:50:30.366668+0000","last_fullsized":"2024-09-19T09:50:30.366668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361980+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:50:30.361980+0000","last_peered":"2024-09-19T09:50:30.361980+0000","last_clean":"2024-09-19T09:50:30.361980+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:50:30.361980+0000","last_undegraded":"2024-09-19T09:50:30.361980+0000","last_fullsized":"2024-09-19T09:50:30.361980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363189+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:50:30.363189+0000","last_peered":"2024-09-19T09:50:30.363189+0000","last_clean":"2024-09-19T09:50:30.363189+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:50:30.363189+0000","last_undegraded":"2024-09-19T09:50:30.363189+0000","last_fullsized":"2024-09-19T09:50:30.363189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350918+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:50:30.350918+0000","last_peered":"2024-09-19T09:50:30.350918+0000","last_clean":"2024-09-19T09:50:30.350918+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:50:30.350918+0000","last_undegraded":"2024-09-19T09:50:30.350918+0000","last_fullsized":"2024-09-19T09:50:30.350918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350297+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:50:30.350297+0000","last_peered":"2024-09-19T09:50:30.350297+0000","last_clean":"2024-09-19T09:50:30.350297+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:50:30.350297+0000","last_undegraded":"2024-09-19T09:50:30.350297+0000","last_fullsized":"2024-09-19T09:50:30.350297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365151+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:50:30.365151+0000","last_peered":"2024-09-19T09:50:30.365151+0000","last_clean":"2024-09-19T09:50:30.365151+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:50:30.365151+0000","last_undegraded":"2024-09-19T09:50:30.365151+0000","last_fullsized":"2024-09-19T09:50:30.365151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365091+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:50:30.365091+0000","last_peered":"2024-09-19T09:50:30.365091+0000","last_clean":"2024-09-19T09:50:30.365091+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:50:30.365091+0000","last_undegraded":"2024-09-19T09:50:30.365091+0000","last_fullsized":"2024-09-19T09:50:30.365091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362893+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:50:30.362893+0000","last_peered":"2024-09-19T09:50:30.362893+0000","last_clean":"2024-09-19T09:50:30.362893+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:50:30.362893+0000","last_undegraded":"2024-09-19T09:50:30.362893+0000","last_fullsized":"2024-09-19T09:50:30.362893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350596+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:50:30.350596+0000","last_peered":"2024-09-19T09:50:30.350596+0000","last_clean":"2024-09-19T09:50:30.350596+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:50:30.350596+0000","last_undegraded":"2024-09-19T09:50:30.350596+0000","last_fullsized":"2024-09-19T09:50:30.350596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363157+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:50:30.363157+0000","last_peered":"2024-09-19T09:50:30.363157+0000","last_clean":"2024-09-19T09:50:30.363157+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:50:30.363157+0000","last_undegraded":"2024-09-19T09:50:30.363157+0000","last_fullsized":"2024-09-19T09:50:30.363157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:26.407040+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:51:26.407040+0000","last_peered":"2024-09-19T09:51:26.407040+0000","last_clean":"2024-09-19T09:51:26.407040+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:51:26.407040+0000","last_undegraded":"2024-09-19T09:51:26.407040+0000","last_fullsized":"2024-09-19T09:51:26.407040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361870+0000","last_change":"2024-09-19T09:50:29.368212+0000","last_active":"2024-09-19T09:50:30.361870+0000","last_peered":"2024-09-19T09:50:30.361870+0000","last_clean":"2024-09-19T09:50:30.361870+0000","last_became_active":"2024-09-19T09:50:29.367866+0000","last_became_peered":"2024-09-19T09:50:29.367866+0000","last_unstale":"2024-09-19T09:50:30.361870+0000","last_undegraded":"2024-09-19T09:50:30.361870+0000","last_fullsized":"2024-09-19T09:50:30.361870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:57.270280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.415673+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:50:39.415673+0000","last_peered":"2024-09-19T09:50:39.415673+0000","last_clean":"2024-09-19T09:50:39.415673+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:50:39.415673+0000","last_undegraded":"2024-09-19T09:50:39.415673+0000","last_fullsized":"2024-09-19T09:50:39.415673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:38.410952+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:50:38.410952+0000","last_peered":"2024-09-19T09:50:38.410952+0000","last_clean":"2024-09-19T09:50:38.410952+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:50:38.410952+0000","last_undegraded":"2024-09-19T09:50:38.410952+0000","last_fullsized":"2024-09-19T09:50:38.410952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362772+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:50:30.362772+0000","last_peered":"2024-09-19T09:50:30.362772+0000","last_clean":"2024-09-19T09:50:30.362772+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:50:30.362772+0000","last_undegraded":"2024-09-19T09:50:30.362772+0000","last_fullsized":"2024-09-19T09:50:30.362772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340115+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:50:40.340115+0000","last_peered":"2024-09-19T09:50:40.340115+0000","last_clean":"2024-09-19T09:50:40.340115+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:50:40.340115+0000","last_undegraded":"2024-09-19T09:50:40.340115+0000","last_fullsized":"2024-09-19T09:50:40.340115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361653+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:50:30.361653+0000","last_peered":"2024-09-19T09:50:30.361653+0000","last_clean":"2024-09-19T09:50:30.361653+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:50:30.361653+0000","last_undegraded":"2024-09-19T09:50:30.361653+0000","last_fullsized":"2024-09-19T09:50:30.361653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:28.408967+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:28.408967+0000","last_peered":"2024-09-19T09:51:28.408967+0000","last_clean":"2024-09-19T09:51:28.408967+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:51:28.408967+0000","last_undegraded":"2024-09-19T09:51:28.408967+0000","last_fullsized":"2024-09-19T09:51:28.408967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365496+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:50:30.365496+0000","last_peered":"2024-09-19T09:50:30.365496+0000","last_clean":"2024-09-19T09:50:30.365496+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:50:30.365496+0000","last_undegraded":"2024-09-19T09:50:30.365496+0000","last_fullsized":"2024-09-19T09:50:30.365496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.338958+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:50:40.338958+0000","last_peered":"2024-09-19T09:50:40.338958+0000","last_clean":"2024-09-19T09:50:40.338958+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:50:40.338958+0000","last_undegraded":"2024-09-19T09:50:40.338958+0000","last_fullsized":"2024-09-19T09:50:40.338958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365928+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:50:30.365928+0000","last_peered":"2024-09-19T09:50:30.365928+0000","last_clean":"2024-09-19T09:50:30.365928+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:50:30.365928+0000","last_undegraded":"2024-09-19T09:50:30.365928+0000","last_fullsized":"2024-09-19T09:50:30.365928+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.415364+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:50:39.415364+0000","last_peered":"2024-09-19T09:50:39.415364+0000","last_clean":"2024-09-19T09:50:39.415364+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:50:39.415364+0000","last_undegraded":"2024-09-19T09:50:39.415364+0000","last_fullsized":"2024-09-19T09:50:39.415364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365535+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:50:30.365535+0000","last_peered":"2024-09-19T09:50:30.365535+0000","last_clean":"2024-09-19T09:50:30.365535+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:50:30.365535+0000","last_undegraded":"2024-09-19T09:50:30.365535+0000","last_fullsized":"2024-09-19T09:50:30.365535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":154,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:28.409066+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:51:28.409066+0000","last_peered":"2024-09-19T09:51:28.409066+0000","last_clean":"2024-09-19T09:51:28.409066+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:51:28.409066+0000","last_undegraded":"2024-09-19T09:51:28.409066+0000","last_fullsized":"2024-09-19T09:51:28.409066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60619,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":112,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364413+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:50:30.364413+0000","last_peered":"2024-09-19T09:50:30.364413+0000","last_clean":"2024-09-19T09:50:30.364413+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:50:30.364413+0000","last_undegraded":"2024-09-19T09:50:30.364413+0000","last_fullsized":"2024-09-19T09:50:30.364413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340658+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:50:40.340658+0000","last_peered":"2024-09-19T09:50:40.340658+0000","last_clean":"2024-09-19T09:50:40.340658+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:50:40.340658+0000","last_undegraded":"2024-09-19T09:50:40.340658+0000","last_fullsized":"2024-09-19T09:50:40.340658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.349959+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:50:30.349959+0000","last_peered":"2024-09-19T09:50:30.349959+0000","last_clean":"2024-09-19T09:50:30.349959+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:50:30.349959+0000","last_undegraded":"2024-09-19T09:50:30.349959+0000","last_fullsized":"2024-09-19T09:50:30.349959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.341939+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:50:40.341939+0000","last_peered":"2024-09-19T09:50:40.341939+0000","last_clean":"2024-09-19T09:50:40.341939+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:50:40.341939+0000","last_undegraded":"2024-09-19T09:50:40.341939+0000","last_fullsized":"2024-09-19T09:50:40.341939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366752+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:50:30.366752+0000","last_peered":"2024-09-19T09:50:30.366752+0000","last_clean":"2024-09-19T09:50:30.366752+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:50:30.366752+0000","last_undegraded":"2024-09-19T09:50:30.366752+0000","last_fullsized":"2024-09-19T09:50:30.366752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:27.405079+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:51:27.405079+0000","last_peered":"2024-09-19T09:51:27.405079+0000","last_clean":"2024-09-19T09:51:27.405079+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:51:27.405079+0000","last_undegraded":"2024-09-19T09:51:27.405079+0000","last_fullsized":"2024-09-19T09:51:27.405079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365819+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:50:30.365819+0000","last_peered":"2024-09-19T09:50:30.365819+0000","last_clean":"2024-09-19T09:50:30.365819+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:50:30.365819+0000","last_undegraded":"2024-09-19T09:50:30.365819+0000","last_fullsized":"2024-09-19T09:50:30.365819+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.333564+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:50:40.333564+0000","last_peered":"2024-09-19T09:50:40.333564+0000","last_clean":"2024-09-19T09:50:40.333564+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:50:40.333564+0000","last_undegraded":"2024-09-19T09:50:40.333564+0000","last_fullsized":"2024-09-19T09:50:40.333564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361933+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:50:30.361933+0000","last_peered":"2024-09-19T09:50:30.361933+0000","last_clean":"2024-09-19T09:50:30.361933+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:50:30.361933+0000","last_undegraded":"2024-09-19T09:50:30.361933+0000","last_fullsized":"2024-09-19T09:50:30.361933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.407032+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:50:39.407032+0000","last_peered":"2024-09-19T09:50:39.407032+0000","last_clean":"2024-09-19T09:50:39.407032+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:50:39.407032+0000","last_undegraded":"2024-09-19T09:50:39.407032+0000","last_fullsized":"2024-09-19T09:50:39.407032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350865+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:50:30.350865+0000","last_peered":"2024-09-19T09:50:30.350865+0000","last_clean":"2024-09-19T09:50:30.350865+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:50:30.350865+0000","last_undegraded":"2024-09-19T09:50:30.350865+0000","last_fullsized":"2024-09-19T09:50:30.350865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.337189+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:50:40.337189+0000","last_peered":"2024-09-19T09:50:40.337189+0000","last_clean":"2024-09-19T09:50:40.337189+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:50:40.337189+0000","last_undegraded":"2024-09-19T09:50:40.337189+0000","last_fullsized":"2024-09-19T09:50:40.337189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367067+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:50:30.367067+0000","last_peered":"2024-09-19T09:50:30.367067+0000","last_clean":"2024-09-19T09:50:30.367067+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:50:30.367067+0000","last_undegraded":"2024-09-19T09:50:30.367067+0000","last_fullsized":"2024-09-19T09:50:30.367067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.332929+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:50:40.332929+0000","last_peered":"2024-09-19T09:50:40.332929+0000","last_clean":"2024-09-19T09:50:40.332929+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:50:40.332929+0000","last_undegraded":"2024-09-19T09:50:40.332929+0000","last_fullsized":"2024-09-19T09:50:40.332929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365560+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:50:30.365560+0000","last_peered":"2024-09-19T09:50:30.365560+0000","last_clean":"2024-09-19T09:50:30.365560+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:50:30.365560+0000","last_undegraded":"2024-09-19T09:50:30.365560+0000","last_fullsized":"2024-09-19T09:50:30.365560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:25.405731+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:51:25.405731+0000","last_peered":"2024-09-19T09:51:25.405731+0000","last_clean":"2024-09-19T09:51:25.405731+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:51:25.405731+0000","last_undegraded":"2024-09-19T09:51:25.405731+0000","last_fullsized":"2024-09-19T09:51:25.405731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367413+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:50:30.367413+0000","last_peered":"2024-09-19T09:50:30.367413+0000","last_clean":"2024-09-19T09:50:30.367413+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:50:30.367413+0000","last_undegraded":"2024-09-19T09:50:30.367413+0000","last_fullsized":"2024-09-19T09:50:30.367413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366182+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:50:30.366182+0000","last_peered":"2024-09-19T09:50:30.366182+0000","last_clean":"2024-09-19T09:50:30.366182+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:50:30.366182+0000","last_undegraded":"2024-09-19T09:50:30.366182+0000","last_fullsized":"2024-09-19T09:50:30.366182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.342531+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:50:40.342531+0000","last_peered":"2024-09-19T09:50:40.342531+0000","last_clean":"2024-09-19T09:50:40.342531+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:50:40.342531+0000","last_undegraded":"2024-09-19T09:50:40.342531+0000","last_fullsized":"2024-09-19T09:50:40.342531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362554+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:50:30.362554+0000","last_peered":"2024-09-19T09:50:30.362554+0000","last_clean":"2024-09-19T09:50:30.362554+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:50:30.362554+0000","last_undegraded":"2024-09-19T09:50:30.362554+0000","last_fullsized":"2024-09-19T09:50:30.362554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:38.412358+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:50:38.412358+0000","last_peered":"2024-09-19T09:50:38.412358+0000","last_clean":"2024-09-19T09:50:38.412358+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:50:38.412358+0000","last_undegraded":"2024-09-19T09:50:38.412358+0000","last_fullsized":"2024-09-19T09:50:38.412358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.349830+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:50:30.349830+0000","last_peered":"2024-09-19T09:50:30.349830+0000","last_clean":"2024-09-19T09:50:30.349830+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:50:30.349830+0000","last_undegraded":"2024-09-19T09:50:30.349830+0000","last_fullsized":"2024-09-19T09:50:30.349830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:27.404386+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:51:27.404386+0000","last_peered":"2024-09-19T09:51:27.404386+0000","last_clean":"2024-09-19T09:51:27.404386+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:51:27.404386+0000","last_undegraded":"2024-09-19T09:51:27.404386+0000","last_fullsized":"2024-09-19T09:51:27.404386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366839+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:50:30.366839+0000","last_peered":"2024-09-19T09:50:30.366839+0000","last_clean":"2024-09-19T09:50:30.366839+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:50:30.366839+0000","last_undegraded":"2024-09-19T09:50:30.366839+0000","last_fullsized":"2024-09-19T09:50:30.366839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:27.404996+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:51:27.404996+0000","last_peered":"2024-09-19T09:51:27.404996+0000","last_clean":"2024-09-19T09:51:27.404996+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:51:27.404996+0000","last_undegraded":"2024-09-19T09:51:27.404996+0000","last_fullsized":"2024-09-19T09:51:27.404996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362118+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:50:30.362118+0000","last_peered":"2024-09-19T09:50:30.362118+0000","last_clean":"2024-09-19T09:50:30.362118+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:50:30.362118+0000","last_undegraded":"2024-09-19T09:50:30.362118+0000","last_fullsized":"2024-09-19T09:50:30.362118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361503+0000","last_change":"2024-09-19T09:50:27.784718+0000","last_active":"2024-09-19T09:50:30.361503+0000","last_peered":"2024-09-19T09:50:30.361503+0000","last_clean":"2024-09-19T09:50:30.361503+0000","last_became_active":"2024-09-19T09:50:27.784381+0000","last_became_peered":"2024-09-19T09:50:27.784381+0000","last_unstale":"2024-09-19T09:50:30.361503+0000","last_undegraded":"2024-09-19T09:50:30.361503+0000","last_fullsized":"2024-09-19T09:50:30.361503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:14.507786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362021+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:50:30.362021+0000","last_peered":"2024-09-19T09:50:30.362021+0000","last_clean":"2024-09-19T09:50:30.362021+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:50:30.362021+0000","last_undegraded":"2024-09-19T09:50:30.362021+0000","last_fullsized":"2024-09-19T09:50:30.362021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.333703+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:50:40.333703+0000","last_peered":"2024-09-19T09:50:40.333703+0000","last_clean":"2024-09-19T09:50:40.333703+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:50:40.333703+0000","last_undegraded":"2024-09-19T09:50:40.333703+0000","last_fullsized":"2024-09-19T09:50:40.333703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350173+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:50:30.350173+0000","last_peered":"2024-09-19T09:50:30.350173+0000","last_clean":"2024-09-19T09:50:30.350173+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:50:30.350173+0000","last_undegraded":"2024-09-19T09:50:30.350173+0000","last_fullsized":"2024-09-19T09:50:30.350173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:53.361845+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:50:53.361845+0000","last_peered":"2024-09-19T09:50:53.361845+0000","last_clean":"2024-09-19T09:50:53.361845+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:50:53.361845+0000","last_undegraded":"2024-09-19T09:50:53.361845+0000","last_fullsized":"2024-09-19T09:50:53.361845+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362298+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:50:30.362298+0000","last_peered":"2024-09-19T09:50:30.362298+0000","last_clean":"2024-09-19T09:50:30.362298+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:50:30.362298+0000","last_undegraded":"2024-09-19T09:50:30.362298+0000","last_fullsized":"2024-09-19T09:50:30.362298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340977+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:50:40.340977+0000","last_peered":"2024-09-19T09:50:40.340977+0000","last_clean":"2024-09-19T09:50:40.340977+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:50:40.340977+0000","last_undegraded":"2024-09-19T09:50:40.340977+0000","last_fullsized":"2024-09-19T09:50:40.340977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365749+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:50:30.365749+0000","last_peered":"2024-09-19T09:50:30.365749+0000","last_clean":"2024-09-19T09:50:30.365749+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:50:30.365749+0000","last_undegraded":"2024-09-19T09:50:30.365749+0000","last_fullsized":"2024-09-19T09:50:30.365749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.396716+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:50:37.396716+0000","last_peered":"2024-09-19T09:50:37.396716+0000","last_clean":"2024-09-19T09:50:37.396716+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:50:37.396716+0000","last_undegraded":"2024-09-19T09:50:37.396716+0000","last_fullsized":"2024-09-19T09:50:37.396716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361625+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:50:30.361625+0000","last_peered":"2024-09-19T09:50:30.361625+0000","last_clean":"2024-09-19T09:50:30.361625+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:50:30.361625+0000","last_undegraded":"2024-09-19T09:50:30.361625+0000","last_fullsized":"2024-09-19T09:50:30.361625+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340021+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:50:40.340021+0000","last_peered":"2024-09-19T09:50:40.340021+0000","last_clean":"2024-09-19T09:50:40.340021+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:50:40.340021+0000","last_undegraded":"2024-09-19T09:50:40.340021+0000","last_fullsized":"2024-09-19T09:50:40.340021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350782+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:50:30.350782+0000","last_peered":"2024-09-19T09:50:30.350782+0000","last_clean":"2024-09-19T09:50:30.350782+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:50:30.350782+0000","last_undegraded":"2024-09-19T09:50:30.350782+0000","last_fullsized":"2024-09-19T09:50:30.350782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.414486+0000","last_change":"2024-09-19T09:50:27.344357+0000","last_active":"2024-09-19T09:50:39.414486+0000","last_peered":"2024-09-19T09:50:39.414486+0000","last_clean":"2024-09-19T09:50:39.414486+0000","last_became_active":"2024-09-19T09:50:27.343727+0000","last_became_peered":"2024-09-19T09:50:27.343727+0000","last_unstale":"2024-09-19T09:50:39.414486+0000","last_undegraded":"2024-09-19T09:50:39.414486+0000","last_fullsized":"2024-09-19T09:50:39.414486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:58.824686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362989+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:50:30.362989+0000","last_peered":"2024-09-19T09:50:30.362989+0000","last_clean":"2024-09-19T09:50:30.362989+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:50:30.362989+0000","last_undegraded":"2024-09-19T09:50:30.362989+0000","last_fullsized":"2024-09-19T09:50:30.362989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.398274+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:50:37.398274+0000","last_peered":"2024-09-19T09:50:37.398274+0000","last_clean":"2024-09-19T09:50:37.398274+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:50:37.398274+0000","last_undegraded":"2024-09-19T09:50:37.398274+0000","last_fullsized":"2024-09-19T09:50:37.398274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366534+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:50:30.366534+0000","last_peered":"2024-09-19T09:50:30.366534+0000","last_clean":"2024-09-19T09:50:30.366534+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:50:30.366534+0000","last_undegraded":"2024-09-19T09:50:30.366534+0000","last_fullsized":"2024-09-19T09:50:30.366534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364268+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:50:30.364268+0000","last_peered":"2024-09-19T09:50:30.364268+0000","last_clean":"2024-09-19T09:50:30.364268+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:50:30.364268+0000","last_undegraded":"2024-09-19T09:50:30.364268+0000","last_fullsized":"2024-09-19T09:50:30.364268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.344467+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:50:40.344467+0000","last_peered":"2024-09-19T09:50:40.344467+0000","last_clean":"2024-09-19T09:50:40.344467+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:50:40.344467+0000","last_undegraded":"2024-09-19T09:50:40.344467+0000","last_fullsized":"2024-09-19T09:50:40.344467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365134+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:50:30.365134+0000","last_peered":"2024-09-19T09:50:30.365134+0000","last_clean":"2024-09-19T09:50:30.365134+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:50:30.365134+0000","last_undegraded":"2024-09-19T09:50:30.365134+0000","last_fullsized":"2024-09-19T09:50:30.365134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.344696+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:50:40.344696+0000","last_peered":"2024-09-19T09:50:40.344696+0000","last_clean":"2024-09-19T09:50:40.344696+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:50:40.344696+0000","last_undegraded":"2024-09-19T09:50:40.344696+0000","last_fullsized":"2024-09-19T09:50:40.344696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365889+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:50:30.365889+0000","last_peered":"2024-09-19T09:50:30.365889+0000","last_clean":"2024-09-19T09:50:30.365889+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:50:30.365889+0000","last_undegraded":"2024-09-19T09:50:30.365889+0000","last_fullsized":"2024-09-19T09:50:30.365889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.370521+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:50:30.370521+0000","last_peered":"2024-09-19T09:50:30.370521+0000","last_clean":"2024-09-19T09:50:30.370521+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:50:30.370521+0000","last_undegraded":"2024-09-19T09:50:30.370521+0000","last_fullsized":"2024-09-19T09:50:30.370521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362615+0000","last_change":"2024-09-19T09:50:29.365288+0000","last_active":"2024-09-19T09:50:30.362615+0000","last_peered":"2024-09-19T09:50:30.362615+0000","last_clean":"2024-09-19T09:50:30.362615+0000","last_became_active":"2024-09-19T09:50:29.364977+0000","last_became_peered":"2024-09-19T09:50:29.364977+0000","last_unstale":"2024-09-19T09:50:30.362615+0000","last_undegraded":"2024-09-19T09:50:30.362615+0000","last_fullsized":"2024-09-19T09:50:30.362615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:45.978204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:28.405887+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:51:28.405887+0000","last_peered":"2024-09-19T09:51:28.405887+0000","last_clean":"2024-09-19T09:51:28.405887+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:51:28.405887+0000","last_undegraded":"2024-09-19T09:51:28.405887+0000","last_fullsized":"2024-09-19T09:51:28.405887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67827,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":526,"num_read_kb":340,"num_write":242,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":203481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514521,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":425781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743454,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1593344,"data_stored":1077822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906980,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":425711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":426089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364845,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1511424,"data_stored":1019002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528371,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":901120,"data_stored":425821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712480,"statfs":{"total":95995035648,"available":95961579520,"internally_reserved":0,"allocated":1523712,"data_stored":1017894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":425682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":425253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":487180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":962560,"data_stored":487353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":426767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:51:32.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:51:32.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-19T09:51:32.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-19T09:51:32.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:51:32.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T09:51:32.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T09:51:32.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-19T09:51:32.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-19T09:51:32.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-19T09:51:32.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:51:32.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:32.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:32.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:51:32.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:51:32.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:32.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:51:32.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:32.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-19T09:51:32.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-19T09:51:32.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:51:32.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T09:51:32.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T09:51:32.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-19T09:51:32.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-19T09:51:32.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-09-19T09:51:32.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:51:32.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:32.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:32.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:51:32.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:51:32.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:51:32.311 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:32.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.849+0000 7fec5835e640 1 -- 172.21.15.18:0/1412885818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec50101de0 msgr2=0x7fec501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:32.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.849+0000 7fec5835e640 1 --2- 172.21.15.18:0/1412885818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec50101de0 0x7fec501021c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009900 tx=0x7fec4c02a410 comp rx=0 tx=0).stop 2024-09-19T09:51:32.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.849+0000 7fec5835e640 1 -- 172.21.15.18:0/1412885818 shutdown_connections 2024-09-19T09:51:32.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.849+0000 7fec5835e640 1 --2- 172.21.15.18:0/1412885818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec50106f10 0x7fec5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:32.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.849+0000 7fec5835e640 1 --2- 172.21.15.18:0/1412885818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec50102790 0x7fec501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:32.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.849+0000 7fec5835e640 1 --2- 172.21.15.18:0/1412885818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec50101de0 0x7fec501021c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:32.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.849+0000 7fec5835e640 1 -- 172.21.15.18:0/1412885818 >> 172.21.15.18:0/1412885818 conn(0x7fec500fd8e0 msgr2=0x7fec500ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.849+0000 7fec5835e640 1 -- 172.21.15.18:0/1412885818 shutdown_connections 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.849+0000 7fec5835e640 1 -- 172.21.15.18:0/1412885818 wait complete. 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec5835e640 1 Processor -- start 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec5835e640 1 -- start start 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec5835e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec50101de0 0x7fec501985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec5835e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec50102790 0x7fec50198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec5835e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec50106f10 0x7fec5019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec5835e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec50112010 con 0x7fec50102790 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec5835e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fec50111e90 con 0x7fec50106f10 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec5835e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec50112190 con 0x7fec50101de0 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec558f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec50102790 0x7fec50198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec558f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec50102790 0x7fec50198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50832/0 (socket says 172.21.15.18:50832) 2024-09-19T09:51:32.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec558f9640 1 -- 172.21.15.18:0/860288930 learned_addr learned my addr 172.21.15.18:0/860288930 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec568fb640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec50106f10 0x7fec5019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec560fa640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec50101de0 0x7fec501985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec558f9640 1 -- 172.21.15.18:0/860288930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec50101de0 msgr2=0x7fec501985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec558f9640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec50101de0 0x7fec501985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec558f9640 1 -- 172.21.15.18:0/860288930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec50106f10 msgr2=0x7fec5019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec558f9640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec50106f10 0x7fec5019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec558f9640 1 -- 172.21.15.18:0/860288930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5019d560 con 0x7fec50102790 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.850+0000 7fec560fa640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec50101de0 0x7fec501985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.851+0000 7fec558f9640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec50102790 0x7fec50198af0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fec4000b4a0 tx=0x7fec4000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.851+0000 7fec477fe640 1 -- 172.21.15.18:0/860288930 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec40014070 con 0x7fec50102790 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.851+0000 7fec477fe640 1 -- 172.21.15.18:0/860288930 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec40010af0 con 0x7fec50102790 2024-09-19T09:51:32.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.851+0000 7fec477fe640 1 -- 172.21.15.18:0/860288930 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec40017d10 con 0x7fec50102790 2024-09-19T09:51:32.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.851+0000 7fec5835e640 1 -- 172.21.15.18:0/860288930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5019d850 con 0x7fec50102790 2024-09-19T09:51:32.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.851+0000 7fec5835e640 1 -- 172.21.15.18:0/860288930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec501a5130 con 0x7fec50102790 2024-09-19T09:51:32.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.852+0000 7fec5835e640 1 -- 172.21.15.18:0/860288930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec50102240 con 0x7fec50102790 2024-09-19T09:51:32.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.853+0000 7fec477fe640 1 -- 172.21.15.18:0/860288930 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fec40017070 con 0x7fec50102790 2024-09-19T09:51:32.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.854+0000 7fec477fe640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fec3c0a32d0 0x7fec3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:32.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.854+0000 7fec560fa640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fec3c0a32d0 0x7fec3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:32.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.854+0000 7fec477fe640 1 -- 172.21.15.18:0/860288930 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fec400ced90 con 0x7fec50102790 2024-09-19T09:51:32.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.854+0000 7fec560fa640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fec3c0a32d0 0x7fec3c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fec4c005ab0 tx=0x7fec4c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:32.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:32.858+0000 7fec477fe640 1 -- 172.21.15.18:0/860288930 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fec4009ba30 con 0x7fec50102790 2024-09-19T09:51:33.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.030+0000 7fec5835e640 1 -- 172.21.15.18:0/860288930 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec50062630 con 0x7fec3c0a32d0 2024-09-19T09:51:33.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:32 smithi018 ceph-mon[30956]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:33.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:32 smithi018 ceph-mon[30956]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:51:33.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.036+0000 7fec477fe640 1 -- 172.21.15.18:0/860288930 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258659 (secure 0 0 0) 0x7fec50062630 con 0x7fec3c0a32d0 2024-09-19T09:51:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:33.041 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:51:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 -- 172.21.15.18:0/860288930 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fec3c0a32d0 msgr2=0x7fec3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fec3c0a32d0 0x7fec3c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fec4c005ab0 tx=0x7fec4c005a20 comp rx=0 tx=0).stop 2024-09-19T09:51:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 -- 172.21.15.18:0/860288930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec50102790 msgr2=0x7fec50198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec50102790 0x7fec50198af0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fec4000b4a0 tx=0x7fec4000b960 comp rx=0 tx=0).stop 2024-09-19T09:51:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 -- 172.21.15.18:0/860288930 shutdown_connections 2024-09-19T09:51:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fec3c0a32d0 0x7fec3c0a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fec50106f10 0x7fec5019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec50102790 0x7fec50198af0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 --2- 172.21.15.18:0/860288930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec50101de0 0x7fec501985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 -- 172.21.15.18:0/860288930 >> 172.21.15.18:0/860288930 conn(0x7fec500fd8e0 msgr2=0x7fec500fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 -- 172.21.15.18:0/860288930 shutdown_connections 2024-09-19T09:51:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:33.039+0000 7fec5835e640 1 -- 172.21.15.18:0/860288930 wait complete. 2024-09-19T09:51:33.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:32 smithi049 ceph-mon[34858]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:33.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:32 smithi049 ceph-mon[34858]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:51:33.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:32 smithi162 ceph-mon[35174]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:33.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:32 smithi162 ceph-mon[35174]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:51:33.600 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-19T09:51:32.363665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658429,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":657,"num_read_kb":449,"num_write":425,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374396,"kb_used_data":12660,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567428,"statfs":{"total":1151940427776,"available":1151557046272,"internally_reserved":0,"allocated":12963840,"data_stored":7087525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001926"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.819452+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:51:30.819452+0000","last_peered":"2024-09-19T09:51:30.819452+0000","last_clean":"2024-09-19T09:51:30.819452+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:51:30.819452+0000","last_undegraded":"2024-09-19T09:51:30.819452+0000","last_fullsized":"2024-09-19T09:51:30.819452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815832+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:51:30.815832+0000","last_peered":"2024-09-19T09:51:30.815832+0000","last_clean":"2024-09-19T09:51:30.815832+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:51:30.815832+0000","last_undegraded":"2024-09-19T09:51:30.815832+0000","last_fullsized":"2024-09-19T09:51:30.815832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.816268+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:51:30.816268+0000","last_peered":"2024-09-19T09:51:30.816268+0000","last_clean":"2024-09-19T09:51:30.816268+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:51:30.816268+0000","last_undegraded":"2024-09-19T09:51:30.816268+0000","last_fullsized":"2024-09-19T09:51:30.816268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350884+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:50:30.350884+0000","last_peered":"2024-09-19T09:50:30.350884+0000","last_clean":"2024-09-19T09:50:30.350884+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:50:30.350884+0000","last_undegraded":"2024-09-19T09:50:30.350884+0000","last_fullsized":"2024-09-19T09:50:30.350884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363363+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:50:30.363363+0000","last_peered":"2024-09-19T09:50:30.363363+0000","last_clean":"2024-09-19T09:50:30.363363+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:50:30.363363+0000","last_undegraded":"2024-09-19T09:50:30.363363+0000","last_fullsized":"2024-09-19T09:50:30.363363+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361812+0000","last_change":"2024-09-19T09:50:29.355326+0000","last_active":"2024-09-19T09:50:30.361812+0000","last_peered":"2024-09-19T09:50:30.361812+0000","last_clean":"2024-09-19T09:50:30.361812+0000","last_became_active":"2024-09-19T09:50:29.353527+0000","last_became_peered":"2024-09-19T09:50:29.353527+0000","last_unstale":"2024-09-19T09:50:30.361812+0000","last_undegraded":"2024-09-19T09:50:30.361812+0000","last_fullsized":"2024-09-19T09:50:30.361812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:24.250263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364898+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:50:30.364898+0000","last_peered":"2024-09-19T09:50:30.364898+0000","last_clean":"2024-09-19T09:50:30.364898+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:50:30.364898+0000","last_undegraded":"2024-09-19T09:50:30.364898+0000","last_fullsized":"2024-09-19T09:50:30.364898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362061+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:50:30.362061+0000","last_peered":"2024-09-19T09:50:30.362061+0000","last_clean":"2024-09-19T09:50:30.362061+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:50:30.362061+0000","last_undegraded":"2024-09-19T09:50:30.362061+0000","last_fullsized":"2024-09-19T09:50:30.362061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.814417+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:51:30.814417+0000","last_peered":"2024-09-19T09:51:30.814417+0000","last_clean":"2024-09-19T09:51:30.814417+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:51:30.814417+0000","last_undegraded":"2024-09-19T09:51:30.814417+0000","last_fullsized":"2024-09-19T09:51:30.814417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362476+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:50:30.362476+0000","last_peered":"2024-09-19T09:50:30.362476+0000","last_clean":"2024-09-19T09:50:30.362476+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:50:30.362476+0000","last_undegraded":"2024-09-19T09:50:30.362476+0000","last_fullsized":"2024-09-19T09:50:30.362476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367368+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:50:30.367368+0000","last_peered":"2024-09-19T09:50:30.367368+0000","last_clean":"2024-09-19T09:50:30.367368+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:50:30.367368+0000","last_undegraded":"2024-09-19T09:50:30.367368+0000","last_fullsized":"2024-09-19T09:50:30.367368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350960+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:50:30.350960+0000","last_peered":"2024-09-19T09:50:30.350960+0000","last_clean":"2024-09-19T09:50:30.350960+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:50:30.350960+0000","last_undegraded":"2024-09-19T09:50:30.350960+0000","last_fullsized":"2024-09-19T09:50:30.350960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350141+0000","last_change":"2024-09-19T09:50:29.353493+0000","last_active":"2024-09-19T09:50:30.350141+0000","last_peered":"2024-09-19T09:50:30.350141+0000","last_clean":"2024-09-19T09:50:30.350141+0000","last_became_active":"2024-09-19T09:50:29.353040+0000","last_became_peered":"2024-09-19T09:50:29.353040+0000","last_unstale":"2024-09-19T09:50:30.350141+0000","last_undegraded":"2024-09-19T09:50:30.350141+0000","last_fullsized":"2024-09-19T09:50:30.350141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:07.751702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815989+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:51:30.815989+0000","last_peered":"2024-09-19T09:51:30.815989+0000","last_clean":"2024-09-19T09:51:30.815989+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:51:30.815989+0000","last_undegraded":"2024-09-19T09:51:30.815989+0000","last_fullsized":"2024-09-19T09:51:30.815989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815848+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:51:30.815848+0000","last_peered":"2024-09-19T09:51:30.815848+0000","last_clean":"2024-09-19T09:51:30.815848+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:51:30.815848+0000","last_undegraded":"2024-09-19T09:51:30.815848+0000","last_fullsized":"2024-09-19T09:51:30.815848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.813833+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:51:30.813833+0000","last_peered":"2024-09-19T09:51:30.813833+0000","last_clean":"2024-09-19T09:51:30.813833+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:51:30.813833+0000","last_undegraded":"2024-09-19T09:51:30.813833+0000","last_fullsized":"2024-09-19T09:51:30.813833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.819582+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:51:30.819582+0000","last_peered":"2024-09-19T09:51:30.819582+0000","last_clean":"2024-09-19T09:51:30.819582+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:51:30.819582+0000","last_undegraded":"2024-09-19T09:51:30.819582+0000","last_fullsized":"2024-09-19T09:51:30.819582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361305+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:50:30.361305+0000","last_peered":"2024-09-19T09:50:30.361305+0000","last_clean":"2024-09-19T09:50:30.361305+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:50:30.361305+0000","last_undegraded":"2024-09-19T09:50:30.361305+0000","last_fullsized":"2024-09-19T09:50:30.361305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822743+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:51:31.822743+0000","last_peered":"2024-09-19T09:51:31.822743+0000","last_clean":"2024-09-19T09:51:31.822743+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:51:31.822743+0000","last_undegraded":"2024-09-19T09:51:31.822743+0000","last_fullsized":"2024-09-19T09:51:31.822743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-19T09:50:31.308235+0000","last_change":"2024-09-19T09:51:30.820297+0000","last_active":"2024-09-19T09:51:30.820297+0000","last_peered":"2024-09-19T09:50:31.308235+0000","last_clean":"2024-09-19T09:50:31.308235+0000","last_became_active":"2024-09-19T09:50:29.352483+0000","last_became_peered":"2024-09-19T09:50:29.352483+0000","last_unstale":"2024-09-19T09:50:31.308235+0000","last_undegraded":"2024-09-19T09:50:31.308235+0000","last_fullsized":"2024-09-19T09:50:31.308235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,8,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350217+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:50:30.350217+0000","last_peered":"2024-09-19T09:50:30.350217+0000","last_clean":"2024-09-19T09:50:30.350217+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:50:30.350217+0000","last_undegraded":"2024-09-19T09:50:30.350217+0000","last_fullsized":"2024-09-19T09:50:30.350217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.813935+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:51:30.813935+0000","last_peered":"2024-09-19T09:51:30.813935+0000","last_clean":"2024-09-19T09:51:30.813935+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:51:30.813935+0000","last_undegraded":"2024-09-19T09:51:30.813935+0000","last_fullsized":"2024-09-19T09:51:30.813935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361960+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:50:30.361960+0000","last_peered":"2024-09-19T09:50:30.361960+0000","last_clean":"2024-09-19T09:50:30.361960+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:50:30.361960+0000","last_undegraded":"2024-09-19T09:50:30.361960+0000","last_fullsized":"2024-09-19T09:50:30.361960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366668+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:50:30.366668+0000","last_peered":"2024-09-19T09:50:30.366668+0000","last_clean":"2024-09-19T09:50:30.366668+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:50:30.366668+0000","last_undegraded":"2024-09-19T09:50:30.366668+0000","last_fullsized":"2024-09-19T09:50:30.366668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361980+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:50:30.361980+0000","last_peered":"2024-09-19T09:50:30.361980+0000","last_clean":"2024-09-19T09:50:30.361980+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:50:30.361980+0000","last_undegraded":"2024-09-19T09:50:30.361980+0000","last_fullsized":"2024-09-19T09:50:30.361980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822114+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:51:31.822114+0000","last_peered":"2024-09-19T09:51:31.822114+0000","last_clean":"2024-09-19T09:51:31.822114+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:51:31.822114+0000","last_undegraded":"2024-09-19T09:51:31.822114+0000","last_fullsized":"2024-09-19T09:51:31.822114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.819276+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:51:30.819276+0000","last_peered":"2024-09-19T09:51:30.819276+0000","last_clean":"2024-09-19T09:51:30.819276+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:51:30.819276+0000","last_undegraded":"2024-09-19T09:51:30.819276+0000","last_fullsized":"2024-09-19T09:51:30.819276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350297+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:50:30.350297+0000","last_peered":"2024-09-19T09:50:30.350297+0000","last_clean":"2024-09-19T09:50:30.350297+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:50:30.350297+0000","last_undegraded":"2024-09-19T09:50:30.350297+0000","last_fullsized":"2024-09-19T09:50:30.350297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.816045+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:51:30.816045+0000","last_peered":"2024-09-19T09:51:30.816045+0000","last_clean":"2024-09-19T09:51:30.816045+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:51:30.816045+0000","last_undegraded":"2024-09-19T09:51:30.816045+0000","last_fullsized":"2024-09-19T09:51:30.816045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822590+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:51:31.822590+0000","last_peered":"2024-09-19T09:51:31.822590+0000","last_clean":"2024-09-19T09:51:31.822590+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:51:31.822590+0000","last_undegraded":"2024-09-19T09:51:31.822590+0000","last_fullsized":"2024-09-19T09:51:31.822590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821965+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:51:31.821965+0000","last_peered":"2024-09-19T09:51:31.821965+0000","last_clean":"2024-09-19T09:51:31.821965+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:51:31.821965+0000","last_undegraded":"2024-09-19T09:51:31.821965+0000","last_fullsized":"2024-09-19T09:51:31.821965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.818645+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:51:30.818645+0000","last_peered":"2024-09-19T09:51:30.818645+0000","last_clean":"2024-09-19T09:51:30.818645+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:51:30.818645+0000","last_undegraded":"2024-09-19T09:51:30.818645+0000","last_fullsized":"2024-09-19T09:51:30.818645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363157+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:50:30.363157+0000","last_peered":"2024-09-19T09:50:30.363157+0000","last_clean":"2024-09-19T09:50:30.363157+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:50:30.363157+0000","last_undegraded":"2024-09-19T09:50:30.363157+0000","last_fullsized":"2024-09-19T09:50:30.363157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:26.407040+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:51:26.407040+0000","last_peered":"2024-09-19T09:51:26.407040+0000","last_clean":"2024-09-19T09:51:26.407040+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:51:26.407040+0000","last_undegraded":"2024-09-19T09:51:26.407040+0000","last_fullsized":"2024-09-19T09:51:26.407040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361870+0000","last_change":"2024-09-19T09:50:29.368212+0000","last_active":"2024-09-19T09:50:30.361870+0000","last_peered":"2024-09-19T09:50:30.361870+0000","last_clean":"2024-09-19T09:50:30.361870+0000","last_became_active":"2024-09-19T09:50:29.367866+0000","last_became_peered":"2024-09-19T09:50:29.367866+0000","last_unstale":"2024-09-19T09:50:30.361870+0000","last_undegraded":"2024-09-19T09:50:30.361870+0000","last_fullsized":"2024-09-19T09:50:30.361870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:57.270280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.415673+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:50:39.415673+0000","last_peered":"2024-09-19T09:50:39.415673+0000","last_clean":"2024-09-19T09:50:39.415673+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:50:39.415673+0000","last_undegraded":"2024-09-19T09:50:39.415673+0000","last_fullsized":"2024-09-19T09:50:39.415673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:38.410952+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:50:38.410952+0000","last_peered":"2024-09-19T09:50:38.410952+0000","last_clean":"2024-09-19T09:50:38.410952+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:50:38.410952+0000","last_undegraded":"2024-09-19T09:50:38.410952+0000","last_fullsized":"2024-09-19T09:50:38.410952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362772+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:50:30.362772+0000","last_peered":"2024-09-19T09:50:30.362772+0000","last_clean":"2024-09-19T09:50:30.362772+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:50:30.362772+0000","last_undegraded":"2024-09-19T09:50:30.362772+0000","last_fullsized":"2024-09-19T09:50:30.362772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340115+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:50:40.340115+0000","last_peered":"2024-09-19T09:50:40.340115+0000","last_clean":"2024-09-19T09:50:40.340115+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:50:40.340115+0000","last_undegraded":"2024-09-19T09:50:40.340115+0000","last_fullsized":"2024-09-19T09:50:40.340115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361653+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:50:30.361653+0000","last_peered":"2024-09-19T09:50:30.361653+0000","last_clean":"2024-09-19T09:50:30.361653+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:50:30.361653+0000","last_undegraded":"2024-09-19T09:50:30.361653+0000","last_fullsized":"2024-09-19T09:50:30.361653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:28.408967+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:28.408967+0000","last_peered":"2024-09-19T09:51:28.408967+0000","last_clean":"2024-09-19T09:51:28.408967+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:51:28.408967+0000","last_undegraded":"2024-09-19T09:51:28.408967+0000","last_fullsized":"2024-09-19T09:51:28.408967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.814324+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:51:30.814324+0000","last_peered":"2024-09-19T09:51:30.814324+0000","last_clean":"2024-09-19T09:51:30.814324+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:51:30.814324+0000","last_undegraded":"2024-09-19T09:51:30.814324+0000","last_fullsized":"2024-09-19T09:51:30.814324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.338958+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:50:40.338958+0000","last_peered":"2024-09-19T09:50:40.338958+0000","last_clean":"2024-09-19T09:50:40.338958+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:50:40.338958+0000","last_undegraded":"2024-09-19T09:50:40.338958+0000","last_fullsized":"2024-09-19T09:50:40.338958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815978+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:51:30.815978+0000","last_peered":"2024-09-19T09:51:30.815978+0000","last_clean":"2024-09-19T09:51:30.815978+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:51:30.815978+0000","last_undegraded":"2024-09-19T09:51:30.815978+0000","last_fullsized":"2024-09-19T09:51:30.815978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.415364+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:50:39.415364+0000","last_peered":"2024-09-19T09:50:39.415364+0000","last_clean":"2024-09-19T09:50:39.415364+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:50:39.415364+0000","last_undegraded":"2024-09-19T09:50:39.415364+0000","last_fullsized":"2024-09-19T09:50:39.415364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.813979+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:51:30.813979+0000","last_peered":"2024-09-19T09:51:30.813979+0000","last_clean":"2024-09-19T09:51:30.813979+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:51:30.813979+0000","last_undegraded":"2024-09-19T09:51:30.813979+0000","last_fullsized":"2024-09-19T09:51:30.813979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":154,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:28.409066+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:51:28.409066+0000","last_peered":"2024-09-19T09:51:28.409066+0000","last_clean":"2024-09-19T09:51:28.409066+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:51:28.409066+0000","last_undegraded":"2024-09-19T09:51:28.409066+0000","last_fullsized":"2024-09-19T09:51:28.409066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60619,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":112,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364413+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:50:30.364413+0000","last_peered":"2024-09-19T09:50:30.364413+0000","last_clean":"2024-09-19T09:50:30.364413+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:50:30.364413+0000","last_undegraded":"2024-09-19T09:50:30.364413+0000","last_fullsized":"2024-09-19T09:50:30.364413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821655+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:51:31.821655+0000","last_peered":"2024-09-19T09:51:31.821655+0000","last_clean":"2024-09-19T09:51:31.821655+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:51:31.821655+0000","last_undegraded":"2024-09-19T09:51:31.821655+0000","last_fullsized":"2024-09-19T09:51:31.821655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.349959+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:50:30.349959+0000","last_peered":"2024-09-19T09:50:30.349959+0000","last_clean":"2024-09-19T09:50:30.349959+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:50:30.349959+0000","last_undegraded":"2024-09-19T09:50:30.349959+0000","last_fullsized":"2024-09-19T09:50:30.349959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.341939+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:50:40.341939+0000","last_peered":"2024-09-19T09:50:40.341939+0000","last_clean":"2024-09-19T09:50:40.341939+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:50:40.341939+0000","last_undegraded":"2024-09-19T09:50:40.341939+0000","last_fullsized":"2024-09-19T09:50:40.341939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366752+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:50:30.366752+0000","last_peered":"2024-09-19T09:50:30.366752+0000","last_clean":"2024-09-19T09:50:30.366752+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:50:30.366752+0000","last_undegraded":"2024-09-19T09:50:30.366752+0000","last_fullsized":"2024-09-19T09:50:30.366752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:27.405079+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:51:27.405079+0000","last_peered":"2024-09-19T09:51:27.405079+0000","last_clean":"2024-09-19T09:51:27.405079+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:51:27.405079+0000","last_undegraded":"2024-09-19T09:51:27.405079+0000","last_fullsized":"2024-09-19T09:51:27.405079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365819+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:50:30.365819+0000","last_peered":"2024-09-19T09:50:30.365819+0000","last_clean":"2024-09-19T09:50:30.365819+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:50:30.365819+0000","last_undegraded":"2024-09-19T09:50:30.365819+0000","last_fullsized":"2024-09-19T09:50:30.365819+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.333564+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:50:40.333564+0000","last_peered":"2024-09-19T09:50:40.333564+0000","last_clean":"2024-09-19T09:50:40.333564+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:50:40.333564+0000","last_undegraded":"2024-09-19T09:50:40.333564+0000","last_fullsized":"2024-09-19T09:50:40.333564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361933+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:50:30.361933+0000","last_peered":"2024-09-19T09:50:30.361933+0000","last_clean":"2024-09-19T09:50:30.361933+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:50:30.361933+0000","last_undegraded":"2024-09-19T09:50:30.361933+0000","last_fullsized":"2024-09-19T09:50:30.361933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.407032+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:50:39.407032+0000","last_peered":"2024-09-19T09:50:39.407032+0000","last_clean":"2024-09-19T09:50:39.407032+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:50:39.407032+0000","last_undegraded":"2024-09-19T09:50:39.407032+0000","last_fullsized":"2024-09-19T09:50:39.407032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.819152+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:51:30.819152+0000","last_peered":"2024-09-19T09:51:30.819152+0000","last_clean":"2024-09-19T09:51:30.819152+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:51:30.819152+0000","last_undegraded":"2024-09-19T09:51:30.819152+0000","last_fullsized":"2024-09-19T09:51:30.819152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.337189+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:50:40.337189+0000","last_peered":"2024-09-19T09:50:40.337189+0000","last_clean":"2024-09-19T09:50:40.337189+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:50:40.337189+0000","last_undegraded":"2024-09-19T09:50:40.337189+0000","last_fullsized":"2024-09-19T09:50:40.337189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367067+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:50:30.367067+0000","last_peered":"2024-09-19T09:50:30.367067+0000","last_clean":"2024-09-19T09:50:30.367067+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:50:30.367067+0000","last_undegraded":"2024-09-19T09:50:30.367067+0000","last_fullsized":"2024-09-19T09:50:30.367067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.332929+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:50:40.332929+0000","last_peered":"2024-09-19T09:50:40.332929+0000","last_clean":"2024-09-19T09:50:40.332929+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:50:40.332929+0000","last_undegraded":"2024-09-19T09:50:40.332929+0000","last_fullsized":"2024-09-19T09:50:40.332929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.365560+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:50:30.365560+0000","last_peered":"2024-09-19T09:50:30.365560+0000","last_clean":"2024-09-19T09:50:30.365560+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:50:30.365560+0000","last_undegraded":"2024-09-19T09:50:30.365560+0000","last_fullsized":"2024-09-19T09:50:30.365560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":81,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822227+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:51:31.822227+0000","last_peered":"2024-09-19T09:51:31.822227+0000","last_clean":"2024-09-19T09:51:31.822227+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:51:31.822227+0000","last_undegraded":"2024-09-19T09:51:31.822227+0000","last_fullsized":"2024-09-19T09:51:31.822227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.367413+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:50:30.367413+0000","last_peered":"2024-09-19T09:50:30.367413+0000","last_clean":"2024-09-19T09:50:30.367413+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:50:30.367413+0000","last_undegraded":"2024-09-19T09:50:30.367413+0000","last_fullsized":"2024-09-19T09:50:30.367413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366182+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:50:30.366182+0000","last_peered":"2024-09-19T09:50:30.366182+0000","last_clean":"2024-09-19T09:50:30.366182+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:50:30.366182+0000","last_undegraded":"2024-09-19T09:50:30.366182+0000","last_fullsized":"2024-09-19T09:50:30.366182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.342531+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:50:40.342531+0000","last_peered":"2024-09-19T09:50:40.342531+0000","last_clean":"2024-09-19T09:50:40.342531+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:50:40.342531+0000","last_undegraded":"2024-09-19T09:50:40.342531+0000","last_fullsized":"2024-09-19T09:50:40.342531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362554+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:50:30.362554+0000","last_peered":"2024-09-19T09:50:30.362554+0000","last_clean":"2024-09-19T09:50:30.362554+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:50:30.362554+0000","last_undegraded":"2024-09-19T09:50:30.362554+0000","last_fullsized":"2024-09-19T09:50:30.362554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:38.412358+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:50:38.412358+0000","last_peered":"2024-09-19T09:50:38.412358+0000","last_clean":"2024-09-19T09:50:38.412358+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:50:38.412358+0000","last_undegraded":"2024-09-19T09:50:38.412358+0000","last_fullsized":"2024-09-19T09:50:38.412358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.349830+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:50:30.349830+0000","last_peered":"2024-09-19T09:50:30.349830+0000","last_clean":"2024-09-19T09:50:30.349830+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:50:30.349830+0000","last_undegraded":"2024-09-19T09:50:30.349830+0000","last_fullsized":"2024-09-19T09:50:30.349830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:27.404386+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:51:27.404386+0000","last_peered":"2024-09-19T09:51:27.404386+0000","last_clean":"2024-09-19T09:51:27.404386+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:51:27.404386+0000","last_undegraded":"2024-09-19T09:51:27.404386+0000","last_fullsized":"2024-09-19T09:51:27.404386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366839+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:50:30.366839+0000","last_peered":"2024-09-19T09:50:30.366839+0000","last_clean":"2024-09-19T09:50:30.366839+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:50:30.366839+0000","last_undegraded":"2024-09-19T09:50:30.366839+0000","last_fullsized":"2024-09-19T09:50:30.366839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:27.404996+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:51:27.404996+0000","last_peered":"2024-09-19T09:51:27.404996+0000","last_clean":"2024-09-19T09:51:27.404996+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:51:27.404996+0000","last_undegraded":"2024-09-19T09:51:27.404996+0000","last_fullsized":"2024-09-19T09:51:27.404996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362118+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:50:30.362118+0000","last_peered":"2024-09-19T09:50:30.362118+0000","last_clean":"2024-09-19T09:50:30.362118+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:50:30.362118+0000","last_undegraded":"2024-09-19T09:50:30.362118+0000","last_fullsized":"2024-09-19T09:50:30.362118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361503+0000","last_change":"2024-09-19T09:50:27.784718+0000","last_active":"2024-09-19T09:50:30.361503+0000","last_peered":"2024-09-19T09:50:30.361503+0000","last_clean":"2024-09-19T09:50:30.361503+0000","last_became_active":"2024-09-19T09:50:27.784381+0000","last_became_peered":"2024-09-19T09:50:27.784381+0000","last_unstale":"2024-09-19T09:50:30.361503+0000","last_undegraded":"2024-09-19T09:50:30.361503+0000","last_fullsized":"2024-09-19T09:50:30.361503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:14.507786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362021+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:50:30.362021+0000","last_peered":"2024-09-19T09:50:30.362021+0000","last_clean":"2024-09-19T09:50:30.362021+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:50:30.362021+0000","last_undegraded":"2024-09-19T09:50:30.362021+0000","last_fullsized":"2024-09-19T09:50:30.362021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.333703+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:50:40.333703+0000","last_peered":"2024-09-19T09:50:40.333703+0000","last_clean":"2024-09-19T09:50:40.333703+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:50:40.333703+0000","last_undegraded":"2024-09-19T09:50:40.333703+0000","last_fullsized":"2024-09-19T09:50:40.333703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.350173+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:50:30.350173+0000","last_peered":"2024-09-19T09:50:30.350173+0000","last_clean":"2024-09-19T09:50:30.350173+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:50:30.350173+0000","last_undegraded":"2024-09-19T09:50:30.350173+0000","last_fullsized":"2024-09-19T09:50:30.350173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:53.361845+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:50:53.361845+0000","last_peered":"2024-09-19T09:50:53.361845+0000","last_clean":"2024-09-19T09:50:53.361845+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:50:53.361845+0000","last_undegraded":"2024-09-19T09:50:53.361845+0000","last_fullsized":"2024-09-19T09:50:53.361845+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362298+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:50:30.362298+0000","last_peered":"2024-09-19T09:50:30.362298+0000","last_clean":"2024-09-19T09:50:30.362298+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:50:30.362298+0000","last_undegraded":"2024-09-19T09:50:30.362298+0000","last_fullsized":"2024-09-19T09:50:30.362298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340977+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:50:40.340977+0000","last_peered":"2024-09-19T09:50:40.340977+0000","last_clean":"2024-09-19T09:50:40.340977+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:50:40.340977+0000","last_undegraded":"2024-09-19T09:50:40.340977+0000","last_fullsized":"2024-09-19T09:50:40.340977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815958+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:51:30.815958+0000","last_peered":"2024-09-19T09:51:30.815958+0000","last_clean":"2024-09-19T09:51:30.815958+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:51:30.815958+0000","last_undegraded":"2024-09-19T09:51:30.815958+0000","last_fullsized":"2024-09-19T09:51:30.815958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.813973+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:51:30.813973+0000","last_peered":"2024-09-19T09:51:30.813973+0000","last_clean":"2024-09-19T09:51:30.813973+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:51:30.813973+0000","last_undegraded":"2024-09-19T09:51:30.813973+0000","last_fullsized":"2024-09-19T09:51:30.813973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361625+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:50:30.361625+0000","last_peered":"2024-09-19T09:50:30.361625+0000","last_clean":"2024-09-19T09:50:30.361625+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:50:30.361625+0000","last_undegraded":"2024-09-19T09:50:30.361625+0000","last_fullsized":"2024-09-19T09:50:30.361625+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.340021+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:50:40.340021+0000","last_peered":"2024-09-19T09:50:40.340021+0000","last_clean":"2024-09-19T09:50:40.340021+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:50:40.340021+0000","last_undegraded":"2024-09-19T09:50:40.340021+0000","last_fullsized":"2024-09-19T09:50:40.340021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.818901+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:51:30.818901+0000","last_peered":"2024-09-19T09:51:30.818901+0000","last_clean":"2024-09-19T09:51:30.818901+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:51:30.818901+0000","last_undegraded":"2024-09-19T09:51:30.818901+0000","last_fullsized":"2024-09-19T09:51:30.818901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":2,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-19T09:50:40.410187+0000","last_change":"2024-09-19T09:51:31.314423+0000","last_active":"2024-09-19T09:51:31.314423+0000","last_peered":"2024-09-19T09:50:40.410187+0000","last_clean":"2024-09-19T09:50:40.410187+0000","last_became_active":"2024-09-19T09:50:27.343727+0000","last_became_peered":"2024-09-19T09:50:27.343727+0000","last_unstale":"2024-09-19T09:50:40.410187+0000","last_undegraded":"2024-09-19T09:50:40.410187+0000","last_fullsized":"2024-09-19T09:50:40.410187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362989+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:50:30.362989+0000","last_peered":"2024-09-19T09:50:30.362989+0000","last_clean":"2024-09-19T09:50:30.362989+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:50:30.362989+0000","last_undegraded":"2024-09-19T09:50:30.362989+0000","last_fullsized":"2024-09-19T09:50:30.362989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.398274+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:50:37.398274+0000","last_peered":"2024-09-19T09:50:37.398274+0000","last_clean":"2024-09-19T09:50:37.398274+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:50:37.398274+0000","last_undegraded":"2024-09-19T09:50:37.398274+0000","last_fullsized":"2024-09-19T09:50:37.398274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.366534+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:50:30.366534+0000","last_peered":"2024-09-19T09:50:30.366534+0000","last_clean":"2024-09-19T09:50:30.366534+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:50:30.366534+0000","last_undegraded":"2024-09-19T09:50:30.366534+0000","last_fullsized":"2024-09-19T09:50:30.366534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364268+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:50:30.364268+0000","last_peered":"2024-09-19T09:50:30.364268+0000","last_clean":"2024-09-19T09:50:30.364268+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:50:30.364268+0000","last_undegraded":"2024-09-19T09:50:30.364268+0000","last_fullsized":"2024-09-19T09:50:30.364268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.344467+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:50:40.344467+0000","last_peered":"2024-09-19T09:50:40.344467+0000","last_clean":"2024-09-19T09:50:40.344467+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:50:40.344467+0000","last_undegraded":"2024-09-19T09:50:40.344467+0000","last_fullsized":"2024-09-19T09:50:40.344467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.813988+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:51:30.813988+0000","last_peered":"2024-09-19T09:51:30.813988+0000","last_clean":"2024-09-19T09:51:30.813988+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:51:30.813988+0000","last_undegraded":"2024-09-19T09:51:30.813988+0000","last_fullsized":"2024-09-19T09:51:30.813988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.344696+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:50:40.344696+0000","last_peered":"2024-09-19T09:50:40.344696+0000","last_clean":"2024-09-19T09:50:40.344696+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:50:40.344696+0000","last_undegraded":"2024-09-19T09:50:40.344696+0000","last_fullsized":"2024-09-19T09:50:40.344696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815980+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:51:30.815980+0000","last_peered":"2024-09-19T09:51:30.815980+0000","last_clean":"2024-09-19T09:51:30.815980+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:51:30.815980+0000","last_undegraded":"2024-09-19T09:51:30.815980+0000","last_fullsized":"2024-09-19T09:51:30.815980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.370521+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:50:30.370521+0000","last_peered":"2024-09-19T09:50:30.370521+0000","last_clean":"2024-09-19T09:50:30.370521+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:50:30.370521+0000","last_undegraded":"2024-09-19T09:50:30.370521+0000","last_fullsized":"2024-09-19T09:50:30.370521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362615+0000","last_change":"2024-09-19T09:50:29.365288+0000","last_active":"2024-09-19T09:50:30.362615+0000","last_peered":"2024-09-19T09:50:30.362615+0000","last_clean":"2024-09-19T09:50:30.362615+0000","last_became_active":"2024-09-19T09:50:29.364977+0000","last_became_peered":"2024-09-19T09:50:29.364977+0000","last_unstale":"2024-09-19T09:50:30.362615+0000","last_undegraded":"2024-09-19T09:50:30.362615+0000","last_fullsized":"2024-09-19T09:50:30.362615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:45.978204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:28.405887+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:51:28.405887+0000","last_peered":"2024-09-19T09:51:28.405887+0000","last_clean":"2024-09-19T09:51:28.405887+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:51:28.405887+0000","last_undegraded":"2024-09-19T09:51:28.405887+0000","last_fullsized":"2024-09-19T09:51:28.405887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67827,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":531,"num_read_kb":340,"num_write":242,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":203481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514522,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":425781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743454,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1593344,"data_stored":1077822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906980,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":425711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":426089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364845,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1511424,"data_stored":1019002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528371,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":901120,"data_stored":425821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712480,"statfs":{"total":95995035648,"available":95961579520,"internally_reserved":0,"allocated":1523712,"data_stored":1017894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":425682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":425253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":995328,"data_stored":495765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":962560,"data_stored":487353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":435352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:51:33.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:51:33.861 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:34.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:33 smithi018 ceph-mon[30956]: pgmap v315: 97 pgs: 2 peering, 95 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:51:34.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:33 smithi018 ceph-mon[30956]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:51:34.100 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:33 smithi018 ceph-mon[30956]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:34.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:33 smithi049 ceph-mon[34858]: pgmap v315: 97 pgs: 2 peering, 95 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:51:34.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:33 smithi049 ceph-mon[34858]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:51:34.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:33 smithi049 ceph-mon[34858]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:34.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:33 smithi162 ceph-mon[35174]: pgmap v315: 97 pgs: 2 peering, 95 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:51:34.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:33 smithi162 ceph-mon[35174]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:51:34.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:33 smithi162 ceph-mon[35174]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:34.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 -- 172.21.15.18:0/1059290598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c10c170 msgr2=0x7fac3c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 --2- 172.21.15.18:0/1059290598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c10c170 0x7fac3c10e610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fac34009ca0 tx=0x7fac3402a950 comp rx=0 tx=0).stop 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 -- 172.21.15.18:0/1059290598 shutdown_connections 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 --2- 172.21.15.18:0/1059290598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c10c170 0x7fac3c10e610 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 --2- 172.21.15.18:0/1059290598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c103660 0x7fac3c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 --2- 172.21.15.18:0/1059290598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac3c102d40 0x7fac3c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 -- 172.21.15.18:0/1059290598 >> 172.21.15.18:0/1059290598 conn(0x7fac3c0fc7a0 msgr2=0x7fac3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 -- 172.21.15.18:0/1059290598 shutdown_connections 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 -- 172.21.15.18:0/1059290598 wait complete. 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 Processor -- start 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.306+0000 7fac42df6640 1 -- start start 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac42df6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac3c102d40 0x7fac3c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac42df6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c103660 0x7fac3c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac42df6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c10c170 0x7fac3c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac42df6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c112000 con 0x7fac3c10c170 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac42df6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c111e80 con 0x7fac3c103660 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac42df6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c112180 con 0x7fac3c102d40 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac41393640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c10c170 0x7fac3c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac41393640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c10c170 0x7fac3c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50846/0 (socket says 172.21.15.18:50846) 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac41393640 1 -- 172.21.15.18:0/2827250888 learned_addr learned my addr 172.21.15.18:0/2827250888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac40b92640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac3c102d40 0x7fac3c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac3bfff640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c103660 0x7fac3c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac41393640 1 -- 172.21.15.18:0/2827250888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac3c102d40 msgr2=0x7fac3c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac41393640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac3c102d40 0x7fac3c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac41393640 1 -- 172.21.15.18:0/2827250888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c103660 msgr2=0x7fac3c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac41393640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c103660 0x7fac3c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac41393640 1 -- 172.21.15.18:0/2827250888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c1a69a0 con 0x7fac3c10c170 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac40b92640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac3c102d40 0x7fac3c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac3bfff640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c103660 0x7fac3c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac41393640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c10c170 0x7fac3c101420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac34009dc0 tx=0x7fac34003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.307+0000 7fac39ffb640 1 -- 172.21.15.18:0/2827250888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34034040 con 0x7fac3c10c170 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.308+0000 7fac39ffb640 1 -- 172.21.15.18:0/2827250888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac3402fe20 con 0x7fac3c10c170 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.308+0000 7fac42df6640 1 -- 172.21.15.18:0/2827250888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3c1a6c30 con 0x7fac3c10c170 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.308+0000 7fac39ffb640 1 -- 172.21.15.18:0/2827250888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac340047f0 con 0x7fac3c10c170 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.308+0000 7fac42df6640 1 -- 172.21.15.18:0/2827250888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3c1a7110 con 0x7fac3c10c170 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.309+0000 7fac42df6640 1 -- 172.21.15.18:0/2827250888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac3c103120 con 0x7fac3c10c170 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.310+0000 7fac39ffb640 1 -- 172.21.15.18:0/2827250888 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fac34037020 con 0x7fac3c10c170 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.311+0000 7fac39ffb640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac280a32d0 0x7fac280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.311+0000 7fac39ffb640 1 -- 172.21.15.18:0/2827250888 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fac340f0980 con 0x7fac3c10c170 2024-09-19T09:51:34.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.311+0000 7fac40b92640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac280a32d0 0x7fac280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:34.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.311+0000 7fac40b92640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac280a32d0 0x7fac280a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0058c0 tx=0x7fac2c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:34.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.315+0000 7fac39ffb640 1 -- 172.21.15.18:0/2827250888 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac340bd620 con 0x7fac3c10c170 2024-09-19T09:51:34.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.488+0000 7fac42df6640 1 -- 172.21.15.18:0/2827250888 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac3c0fe520 con 0x7fac280a32d0 2024-09-19T09:51:34.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.494+0000 7fac39ffb640 1 -- 172.21.15.18:0/2827250888 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258661 (secure 0 0 0) 0x7fac3c0fe520 con 0x7fac280a32d0 2024-09-19T09:51:34.498 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:34.499 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:51:34.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 -- 172.21.15.18:0/2827250888 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac280a32d0 msgr2=0x7fac280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:34.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac280a32d0 0x7fac280a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0058c0 tx=0x7fac2c005850 comp rx=0 tx=0).stop 2024-09-19T09:51:34.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 -- 172.21.15.18:0/2827250888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c10c170 msgr2=0x7fac3c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:34.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c10c170 0x7fac3c101420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac34009dc0 tx=0x7fac34003f10 comp rx=0 tx=0).stop 2024-09-19T09:51:34.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 -- 172.21.15.18:0/2827250888 shutdown_connections 2024-09-19T09:51:34.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac280a32d0 0x7fac280a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:34.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c10c170 0x7fac3c101420 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:34.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c103660 0x7fac3c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:34.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 --2- 172.21.15.18:0/2827250888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac3c102d40 0x7fac3c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:34.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 -- 172.21.15.18:0/2827250888 >> 172.21.15.18:0/2827250888 conn(0x7fac3c0fc7a0 msgr2=0x7fac3c0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:34.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 -- 172.21.15.18:0/2827250888 shutdown_connections 2024-09-19T09:51:34.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:34.497+0000 7fac42df6640 1 -- 172.21.15.18:0/2827250888 wait complete. 2024-09-19T09:51:35.185 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-19T09:51:34.364030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658429,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":697,"num_read_kb":469,"num_write":425,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":288,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374584,"kb_used_data":12804,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567240,"statfs":{"total":1151940427776,"available":1151556853760,"internally_reserved":0,"allocated":13111296,"data_stored":7189567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001776"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.819452+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:51:30.819452+0000","last_peered":"2024-09-19T09:51:30.819452+0000","last_clean":"2024-09-19T09:51:30.819452+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:51:30.819452+0000","last_undegraded":"2024-09-19T09:51:30.819452+0000","last_fullsized":"2024-09-19T09:51:30.819452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815832+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:51:30.815832+0000","last_peered":"2024-09-19T09:51:30.815832+0000","last_clean":"2024-09-19T09:51:30.815832+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:51:30.815832+0000","last_undegraded":"2024-09-19T09:51:30.815832+0000","last_fullsized":"2024-09-19T09:51:30.815832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.816268+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:51:30.816268+0000","last_peered":"2024-09-19T09:51:30.816268+0000","last_clean":"2024-09-19T09:51:30.816268+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:51:30.816268+0000","last_undegraded":"2024-09-19T09:51:30.816268+0000","last_fullsized":"2024-09-19T09:51:30.816268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.169978+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:51:32.169978+0000","last_peered":"2024-09-19T09:51:32.169978+0000","last_clean":"2024-09-19T09:51:32.169978+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:51:32.169978+0000","last_undegraded":"2024-09-19T09:51:32.169978+0000","last_fullsized":"2024-09-19T09:51:32.169978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363363+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:50:30.363363+0000","last_peered":"2024-09-19T09:50:30.363363+0000","last_clean":"2024-09-19T09:50:30.363363+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:50:30.363363+0000","last_undegraded":"2024-09-19T09:50:30.363363+0000","last_fullsized":"2024-09-19T09:50:30.363363+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818907+0000","last_change":"2024-09-19T09:51:31.818907+0000","last_active":"2024-09-19T09:51:31.818907+0000","last_peered":"2024-09-19T09:51:31.818907+0000","last_clean":"2024-09-19T09:51:31.818907+0000","last_became_active":"2024-09-19T09:51:31.818522+0000","last_became_peered":"2024-09-19T09:51:31.818522+0000","last_unstale":"2024-09-19T09:51:31.818907+0000","last_undegraded":"2024-09-19T09:51:31.818907+0000","last_fullsized":"2024-09-19T09:51:31.818907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:04.062704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414658+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:51:32.414658+0000","last_peered":"2024-09-19T09:51:32.414658+0000","last_clean":"2024-09-19T09:51:32.414658+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:51:32.414658+0000","last_undegraded":"2024-09-19T09:51:32.414658+0000","last_fullsized":"2024-09-19T09:51:32.414658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823102+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:51:31.823102+0000","last_peered":"2024-09-19T09:51:31.823102+0000","last_clean":"2024-09-19T09:51:31.823102+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:51:31.823102+0000","last_undegraded":"2024-09-19T09:51:31.823102+0000","last_fullsized":"2024-09-19T09:51:31.823102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.814417+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:51:30.814417+0000","last_peered":"2024-09-19T09:51:30.814417+0000","last_clean":"2024-09-19T09:51:30.814417+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:51:30.814417+0000","last_undegraded":"2024-09-19T09:51:30.814417+0000","last_fullsized":"2024-09-19T09:51:30.814417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816435+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:51:31.816435+0000","last_peered":"2024-09-19T09:51:31.816435+0000","last_clean":"2024-09-19T09:51:31.816435+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:51:31.816435+0000","last_undegraded":"2024-09-19T09:51:31.816435+0000","last_fullsized":"2024-09-19T09:51:31.816435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415084+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:51:32.415084+0000","last_peered":"2024-09-19T09:51:32.415084+0000","last_clean":"2024-09-19T09:51:32.415084+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:51:32.415084+0000","last_undegraded":"2024-09-19T09:51:32.415084+0000","last_fullsized":"2024-09-19T09:51:32.415084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170120+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:51:32.170120+0000","last_peered":"2024-09-19T09:51:32.170120+0000","last_clean":"2024-09-19T09:51:32.170120+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:51:32.170120+0000","last_undegraded":"2024-09-19T09:51:32.170120+0000","last_fullsized":"2024-09-19T09:51:32.170120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818910+0000","last_change":"2024-09-19T09:51:31.818910+0000","last_active":"2024-09-19T09:51:31.818910+0000","last_peered":"2024-09-19T09:51:31.818910+0000","last_clean":"2024-09-19T09:51:31.818910+0000","last_became_active":"2024-09-19T09:51:31.818581+0000","last_became_peered":"2024-09-19T09:51:31.818581+0000","last_unstale":"2024-09-19T09:51:31.818910+0000","last_undegraded":"2024-09-19T09:51:31.818910+0000","last_fullsized":"2024-09-19T09:51:31.818910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.736835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815989+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:51:30.815989+0000","last_peered":"2024-09-19T09:51:30.815989+0000","last_clean":"2024-09-19T09:51:30.815989+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:51:30.815989+0000","last_undegraded":"2024-09-19T09:51:30.815989+0000","last_fullsized":"2024-09-19T09:51:30.815989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815848+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:51:30.815848+0000","last_peered":"2024-09-19T09:51:30.815848+0000","last_clean":"2024-09-19T09:51:30.815848+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:51:30.815848+0000","last_undegraded":"2024-09-19T09:51:30.815848+0000","last_fullsized":"2024-09-19T09:51:30.815848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.813833+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:51:30.813833+0000","last_peered":"2024-09-19T09:51:30.813833+0000","last_clean":"2024-09-19T09:51:30.813833+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:51:30.813833+0000","last_undegraded":"2024-09-19T09:51:30.813833+0000","last_fullsized":"2024-09-19T09:51:30.813833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.819582+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:51:30.819582+0000","last_peered":"2024-09-19T09:51:30.819582+0000","last_clean":"2024-09-19T09:51:30.819582+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:51:30.819582+0000","last_undegraded":"2024-09-19T09:51:30.819582+0000","last_fullsized":"2024-09-19T09:51:30.819582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361305+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:50:30.361305+0000","last_peered":"2024-09-19T09:50:30.361305+0000","last_clean":"2024-09-19T09:50:30.361305+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:50:30.361305+0000","last_undegraded":"2024-09-19T09:50:30.361305+0000","last_fullsized":"2024-09-19T09:50:30.361305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822743+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:51:31.822743+0000","last_peered":"2024-09-19T09:51:31.822743+0000","last_clean":"2024-09-19T09:51:31.822743+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:51:31.822743+0000","last_undegraded":"2024-09-19T09:51:31.822743+0000","last_fullsized":"2024-09-19T09:51:31.822743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-19T09:50:31.308235+0000","last_change":"2024-09-19T09:51:30.820297+0000","last_active":"2024-09-19T09:51:30.820297+0000","last_peered":"2024-09-19T09:50:31.308235+0000","last_clean":"2024-09-19T09:50:31.308235+0000","last_became_active":"2024-09-19T09:50:29.352483+0000","last_became_peered":"2024-09-19T09:50:29.352483+0000","last_unstale":"2024-09-19T09:50:31.308235+0000","last_undegraded":"2024-09-19T09:50:31.308235+0000","last_fullsized":"2024-09-19T09:50:31.308235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,8,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814751+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:51:31.814751+0000","last_peered":"2024-09-19T09:51:31.814751+0000","last_clean":"2024-09-19T09:51:31.814751+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:51:31.814751+0000","last_undegraded":"2024-09-19T09:51:31.814751+0000","last_fullsized":"2024-09-19T09:51:31.814751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.813935+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:51:30.813935+0000","last_peered":"2024-09-19T09:51:30.813935+0000","last_clean":"2024-09-19T09:51:30.813935+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:51:30.813935+0000","last_undegraded":"2024-09-19T09:51:30.813935+0000","last_fullsized":"2024-09-19T09:51:30.813935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823164+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:51:31.823164+0000","last_peered":"2024-09-19T09:51:31.823164+0000","last_clean":"2024-09-19T09:51:31.823164+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:51:31.823164+0000","last_undegraded":"2024-09-19T09:51:31.823164+0000","last_fullsized":"2024-09-19T09:51:31.823164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815405+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:51:31.815405+0000","last_peered":"2024-09-19T09:51:31.815405+0000","last_clean":"2024-09-19T09:51:31.815405+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:51:31.815405+0000","last_undegraded":"2024-09-19T09:51:31.815405+0000","last_fullsized":"2024-09-19T09:51:31.815405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823588+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:51:31.823588+0000","last_peered":"2024-09-19T09:51:31.823588+0000","last_clean":"2024-09-19T09:51:31.823588+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:51:31.823588+0000","last_undegraded":"2024-09-19T09:51:31.823588+0000","last_fullsized":"2024-09-19T09:51:31.823588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822114+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:51:31.822114+0000","last_peered":"2024-09-19T09:51:31.822114+0000","last_clean":"2024-09-19T09:51:31.822114+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:51:31.822114+0000","last_undegraded":"2024-09-19T09:51:31.822114+0000","last_fullsized":"2024-09-19T09:51:31.822114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.819276+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:51:30.819276+0000","last_peered":"2024-09-19T09:51:30.819276+0000","last_clean":"2024-09-19T09:51:30.819276+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:51:30.819276+0000","last_undegraded":"2024-09-19T09:51:30.819276+0000","last_fullsized":"2024-09-19T09:51:30.819276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814663+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:51:31.814663+0000","last_peered":"2024-09-19T09:51:31.814663+0000","last_clean":"2024-09-19T09:51:31.814663+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:51:31.814663+0000","last_undegraded":"2024-09-19T09:51:31.814663+0000","last_fullsized":"2024-09-19T09:51:31.814663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.816045+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:51:30.816045+0000","last_peered":"2024-09-19T09:51:30.816045+0000","last_clean":"2024-09-19T09:51:30.816045+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:51:30.816045+0000","last_undegraded":"2024-09-19T09:51:30.816045+0000","last_fullsized":"2024-09-19T09:51:30.816045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822590+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:51:31.822590+0000","last_peered":"2024-09-19T09:51:31.822590+0000","last_clean":"2024-09-19T09:51:31.822590+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:51:31.822590+0000","last_undegraded":"2024-09-19T09:51:31.822590+0000","last_fullsized":"2024-09-19T09:51:31.822590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821965+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:51:31.821965+0000","last_peered":"2024-09-19T09:51:31.821965+0000","last_clean":"2024-09-19T09:51:31.821965+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:51:31.821965+0000","last_undegraded":"2024-09-19T09:51:31.821965+0000","last_fullsized":"2024-09-19T09:51:31.821965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.818645+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:51:30.818645+0000","last_peered":"2024-09-19T09:51:30.818645+0000","last_clean":"2024-09-19T09:51:30.818645+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:51:30.818645+0000","last_undegraded":"2024-09-19T09:51:30.818645+0000","last_fullsized":"2024-09-19T09:51:30.818645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.363157+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:50:30.363157+0000","last_peered":"2024-09-19T09:50:30.363157+0000","last_clean":"2024-09-19T09:50:30.363157+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:50:30.363157+0000","last_undegraded":"2024-09-19T09:50:30.363157+0000","last_fullsized":"2024-09-19T09:50:30.363157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":82,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816129+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:51:31.816129+0000","last_peered":"2024-09-19T09:51:31.816129+0000","last_clean":"2024-09-19T09:51:31.816129+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:51:31.816129+0000","last_undegraded":"2024-09-19T09:51:31.816129+0000","last_fullsized":"2024-09-19T09:51:31.816129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.825618+0000","last_change":"2024-09-19T09:51:31.825618+0000","last_active":"2024-09-19T09:51:31.825618+0000","last_peered":"2024-09-19T09:51:31.825618+0000","last_clean":"2024-09-19T09:51:31.825618+0000","last_became_active":"2024-09-19T09:51:31.824727+0000","last_became_peered":"2024-09-19T09:51:31.824727+0000","last_unstale":"2024-09-19T09:51:31.825618+0000","last_undegraded":"2024-09-19T09:51:31.825618+0000","last_fullsized":"2024-09-19T09:51:31.825618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:52.094074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816210+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:51:31.816210+0000","last_peered":"2024-09-19T09:51:31.816210+0000","last_clean":"2024-09-19T09:51:31.816210+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:51:31.816210+0000","last_undegraded":"2024-09-19T09:51:31.816210+0000","last_fullsized":"2024-09-19T09:51:31.816210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814498+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:51:31.814498+0000","last_peered":"2024-09-19T09:51:31.814498+0000","last_clean":"2024-09-19T09:51:31.814498+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:51:31.814498+0000","last_undegraded":"2024-09-19T09:51:31.814498+0000","last_fullsized":"2024-09-19T09:51:31.814498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823230+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:51:31.823230+0000","last_peered":"2024-09-19T09:51:31.823230+0000","last_clean":"2024-09-19T09:51:31.823230+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:51:31.823230+0000","last_undegraded":"2024-09-19T09:51:31.823230+0000","last_fullsized":"2024-09-19T09:51:31.823230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815599+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:51:31.815599+0000","last_peered":"2024-09-19T09:51:31.815599+0000","last_clean":"2024-09-19T09:51:31.815599+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:51:31.815599+0000","last_undegraded":"2024-09-19T09:51:31.815599+0000","last_fullsized":"2024-09-19T09:51:31.815599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361653+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:50:30.361653+0000","last_peered":"2024-09-19T09:50:30.361653+0000","last_clean":"2024-09-19T09:50:30.361653+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:50:30.361653+0000","last_undegraded":"2024-09-19T09:50:30.361653+0000","last_fullsized":"2024-09-19T09:50:30.361653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:33.415912+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:33.415912+0000","last_peered":"2024-09-19T09:51:33.415912+0000","last_clean":"2024-09-19T09:51:33.415912+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:51:33.415912+0000","last_undegraded":"2024-09-19T09:51:33.415912+0000","last_fullsized":"2024-09-19T09:51:33.415912+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.814324+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:51:30.814324+0000","last_peered":"2024-09-19T09:51:30.814324+0000","last_clean":"2024-09-19T09:51:30.814324+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:51:30.814324+0000","last_undegraded":"2024-09-19T09:51:30.814324+0000","last_fullsized":"2024-09-19T09:51:30.814324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415018+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:51:32.415018+0000","last_peered":"2024-09-19T09:51:32.415018+0000","last_clean":"2024-09-19T09:51:32.415018+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:51:32.415018+0000","last_undegraded":"2024-09-19T09:51:32.415018+0000","last_fullsized":"2024-09-19T09:51:32.415018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815978+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:51:30.815978+0000","last_peered":"2024-09-19T09:51:30.815978+0000","last_clean":"2024-09-19T09:51:30.815978+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:51:30.815978+0000","last_undegraded":"2024-09-19T09:51:30.815978+0000","last_fullsized":"2024-09-19T09:51:30.815978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815716+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:51:31.815716+0000","last_peered":"2024-09-19T09:51:31.815716+0000","last_clean":"2024-09-19T09:51:31.815716+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:51:31.815716+0000","last_undegraded":"2024-09-19T09:51:31.815716+0000","last_fullsized":"2024-09-19T09:51:31.815716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.813979+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:51:30.813979+0000","last_peered":"2024-09-19T09:51:30.813979+0000","last_clean":"2024-09-19T09:51:30.813979+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:51:30.813979+0000","last_undegraded":"2024-09-19T09:51:30.813979+0000","last_fullsized":"2024-09-19T09:51:30.813979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":168,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:33.415903+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:51:33.415903+0000","last_peered":"2024-09-19T09:51:33.415903+0000","last_clean":"2024-09-19T09:51:33.415903+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:51:33.415903+0000","last_undegraded":"2024-09-19T09:51:33.415903+0000","last_fullsized":"2024-09-19T09:51:33.415903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60619,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":117,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.364413+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:50:30.364413+0000","last_peered":"2024-09-19T09:50:30.364413+0000","last_clean":"2024-09-19T09:50:30.364413+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:50:30.364413+0000","last_undegraded":"2024-09-19T09:50:30.364413+0000","last_fullsized":"2024-09-19T09:50:30.364413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821655+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:51:31.821655+0000","last_peered":"2024-09-19T09:51:31.821655+0000","last_clean":"2024-09-19T09:51:31.821655+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:51:31.821655+0000","last_undegraded":"2024-09-19T09:51:31.821655+0000","last_fullsized":"2024-09-19T09:51:31.821655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814554+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:51:31.814554+0000","last_peered":"2024-09-19T09:51:31.814554+0000","last_clean":"2024-09-19T09:51:31.814554+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:51:31.814554+0000","last_undegraded":"2024-09-19T09:51:31.814554+0000","last_fullsized":"2024-09-19T09:51:31.814554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815497+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:31.815497+0000","last_peered":"2024-09-19T09:51:31.815497+0000","last_clean":"2024-09-19T09:51:31.815497+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:51:31.815497+0000","last_undegraded":"2024-09-19T09:51:31.815497+0000","last_fullsized":"2024-09-19T09:51:31.815497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415126+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:51:32.415126+0000","last_peered":"2024-09-19T09:51:32.415126+0000","last_clean":"2024-09-19T09:51:32.415126+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:51:32.415126+0000","last_undegraded":"2024-09-19T09:51:32.415126+0000","last_fullsized":"2024-09-19T09:51:32.415126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.411698+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:51:32.411698+0000","last_peered":"2024-09-19T09:51:32.411698+0000","last_clean":"2024-09-19T09:51:32.411698+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:51:32.411698+0000","last_undegraded":"2024-09-19T09:51:32.411698+0000","last_fullsized":"2024-09-19T09:51:32.411698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414551+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:51:32.414551+0000","last_peered":"2024-09-19T09:51:32.414551+0000","last_clean":"2024-09-19T09:51:32.414551+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:51:32.414551+0000","last_undegraded":"2024-09-19T09:51:32.414551+0000","last_fullsized":"2024-09-19T09:51:32.414551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.333564+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:50:40.333564+0000","last_peered":"2024-09-19T09:50:40.333564+0000","last_clean":"2024-09-19T09:50:40.333564+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:50:40.333564+0000","last_undegraded":"2024-09-19T09:50:40.333564+0000","last_fullsized":"2024-09-19T09:50:40.333564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815462+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:51:31.815462+0000","last_peered":"2024-09-19T09:51:31.815462+0000","last_clean":"2024-09-19T09:51:31.815462+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:51:31.815462+0000","last_undegraded":"2024-09-19T09:51:31.815462+0000","last_fullsized":"2024-09-19T09:51:31.815462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:39.407032+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:50:39.407032+0000","last_peered":"2024-09-19T09:50:39.407032+0000","last_clean":"2024-09-19T09:50:39.407032+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:50:39.407032+0000","last_undegraded":"2024-09-19T09:50:39.407032+0000","last_fullsized":"2024-09-19T09:50:39.407032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.819152+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:51:30.819152+0000","last_peered":"2024-09-19T09:51:30.819152+0000","last_clean":"2024-09-19T09:51:30.819152+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:51:30.819152+0000","last_undegraded":"2024-09-19T09:51:30.819152+0000","last_fullsized":"2024-09-19T09:51:30.819152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814756+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:51:31.814756+0000","last_peered":"2024-09-19T09:51:31.814756+0000","last_clean":"2024-09-19T09:51:31.814756+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:51:31.814756+0000","last_undegraded":"2024-09-19T09:51:31.814756+0000","last_fullsized":"2024-09-19T09:51:31.814756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415283+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:51:32.415283+0000","last_peered":"2024-09-19T09:51:32.415283+0000","last_clean":"2024-09-19T09:51:32.415283+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:51:32.415283+0000","last_undegraded":"2024-09-19T09:51:32.415283+0000","last_fullsized":"2024-09-19T09:51:32.415283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815831+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:51:31.815831+0000","last_peered":"2024-09-19T09:51:31.815831+0000","last_clean":"2024-09-19T09:51:31.815831+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:51:31.815831+0000","last_undegraded":"2024-09-19T09:51:31.815831+0000","last_fullsized":"2024-09-19T09:51:31.815831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414880+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:51:32.414880+0000","last_peered":"2024-09-19T09:51:32.414880+0000","last_clean":"2024-09-19T09:51:32.414880+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:51:32.414880+0000","last_undegraded":"2024-09-19T09:51:32.414880+0000","last_fullsized":"2024-09-19T09:51:32.414880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":81,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822227+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:51:31.822227+0000","last_peered":"2024-09-19T09:51:31.822227+0000","last_clean":"2024-09-19T09:51:31.822227+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:51:31.822227+0000","last_undegraded":"2024-09-19T09:51:31.822227+0000","last_fullsized":"2024-09-19T09:51:31.822227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415176+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:51:32.415176+0000","last_peered":"2024-09-19T09:51:32.415176+0000","last_clean":"2024-09-19T09:51:32.415176+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:51:32.415176+0000","last_undegraded":"2024-09-19T09:51:32.415176+0000","last_fullsized":"2024-09-19T09:51:32.415176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414710+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:51:32.414710+0000","last_peered":"2024-09-19T09:51:32.414710+0000","last_clean":"2024-09-19T09:51:32.414710+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:51:32.414710+0000","last_undegraded":"2024-09-19T09:51:32.414710+0000","last_fullsized":"2024-09-19T09:51:32.414710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.169977+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:51:32.169977+0000","last_peered":"2024-09-19T09:51:32.169977+0000","last_clean":"2024-09-19T09:51:32.169977+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:51:32.169977+0000","last_undegraded":"2024-09-19T09:51:32.169977+0000","last_fullsized":"2024-09-19T09:51:32.169977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824825+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:51:31.824825+0000","last_peered":"2024-09-19T09:51:31.824825+0000","last_clean":"2024-09-19T09:51:31.824825+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:51:31.824825+0000","last_undegraded":"2024-09-19T09:51:31.824825+0000","last_fullsized":"2024-09-19T09:51:31.824825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414691+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:51:32.414691+0000","last_peered":"2024-09-19T09:51:32.414691+0000","last_clean":"2024-09-19T09:51:32.414691+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:51:32.414691+0000","last_undegraded":"2024-09-19T09:51:32.414691+0000","last_fullsized":"2024-09-19T09:51:32.414691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814496+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:51:31.814496+0000","last_peered":"2024-09-19T09:51:31.814496+0000","last_clean":"2024-09-19T09:51:31.814496+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:51:31.814496+0000","last_undegraded":"2024-09-19T09:51:31.814496+0000","last_fullsized":"2024-09-19T09:51:31.814496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":82,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.411173+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:51:32.411173+0000","last_peered":"2024-09-19T09:51:32.411173+0000","last_clean":"2024-09-19T09:51:32.411173+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:51:32.411173+0000","last_undegraded":"2024-09-19T09:51:32.411173+0000","last_fullsized":"2024-09-19T09:51:32.411173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815467+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:51:31.815467+0000","last_peered":"2024-09-19T09:51:31.815467+0000","last_clean":"2024-09-19T09:51:31.815467+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:51:31.815467+0000","last_undegraded":"2024-09-19T09:51:31.815467+0000","last_fullsized":"2024-09-19T09:51:31.815467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415281+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:51:32.415281+0000","last_peered":"2024-09-19T09:51:32.415281+0000","last_clean":"2024-09-19T09:51:32.415281+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:51:32.415281+0000","last_undegraded":"2024-09-19T09:51:32.415281+0000","last_fullsized":"2024-09-19T09:51:32.415281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815856+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:51:31.815856+0000","last_peered":"2024-09-19T09:51:31.815856+0000","last_clean":"2024-09-19T09:51:31.815856+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:51:31.815856+0000","last_undegraded":"2024-09-19T09:51:31.815856+0000","last_fullsized":"2024-09-19T09:51:31.815856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361503+0000","last_change":"2024-09-19T09:50:27.784718+0000","last_active":"2024-09-19T09:50:30.361503+0000","last_peered":"2024-09-19T09:50:30.361503+0000","last_clean":"2024-09-19T09:50:30.361503+0000","last_became_active":"2024-09-19T09:50:27.784381+0000","last_became_peered":"2024-09-19T09:50:27.784381+0000","last_unstale":"2024-09-19T09:50:30.361503+0000","last_undegraded":"2024-09-19T09:50:30.361503+0000","last_fullsized":"2024-09-19T09:50:30.361503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:14.507786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815803+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:51:31.815803+0000","last_peered":"2024-09-19T09:51:31.815803+0000","last_clean":"2024-09-19T09:51:31.815803+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:51:31.815803+0000","last_undegraded":"2024-09-19T09:51:31.815803+0000","last_fullsized":"2024-09-19T09:51:31.815803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.333703+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:50:40.333703+0000","last_peered":"2024-09-19T09:50:40.333703+0000","last_clean":"2024-09-19T09:50:40.333703+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:50:40.333703+0000","last_undegraded":"2024-09-19T09:50:40.333703+0000","last_fullsized":"2024-09-19T09:50:40.333703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814777+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:51:31.814777+0000","last_peered":"2024-09-19T09:51:31.814777+0000","last_clean":"2024-09-19T09:51:31.814777+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:51:31.814777+0000","last_undegraded":"2024-09-19T09:51:31.814777+0000","last_fullsized":"2024-09-19T09:51:31.814777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:53.361845+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:50:53.361845+0000","last_peered":"2024-09-19T09:50:53.361845+0000","last_clean":"2024-09-19T09:50:53.361845+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:50:53.361845+0000","last_undegraded":"2024-09-19T09:50:53.361845+0000","last_fullsized":"2024-09-19T09:50:53.361845+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823704+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:51:31.823704+0000","last_peered":"2024-09-19T09:51:31.823704+0000","last_clean":"2024-09-19T09:51:31.823704+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:51:31.823704+0000","last_undegraded":"2024-09-19T09:51:31.823704+0000","last_fullsized":"2024-09-19T09:51:31.823704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170286+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:51:32.170286+0000","last_peered":"2024-09-19T09:51:32.170286+0000","last_clean":"2024-09-19T09:51:32.170286+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:51:32.170286+0000","last_undegraded":"2024-09-19T09:51:32.170286+0000","last_fullsized":"2024-09-19T09:51:32.170286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815958+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:51:30.815958+0000","last_peered":"2024-09-19T09:51:30.815958+0000","last_clean":"2024-09-19T09:51:30.815958+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:51:30.815958+0000","last_undegraded":"2024-09-19T09:51:30.815958+0000","last_fullsized":"2024-09-19T09:51:30.815958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.813973+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:51:30.813973+0000","last_peered":"2024-09-19T09:51:30.813973+0000","last_clean":"2024-09-19T09:51:30.813973+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:51:30.813973+0000","last_undegraded":"2024-09-19T09:51:30.813973+0000","last_fullsized":"2024-09-19T09:51:30.813973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.361625+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:50:30.361625+0000","last_peered":"2024-09-19T09:50:30.361625+0000","last_clean":"2024-09-19T09:50:30.361625+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:50:30.361625+0000","last_undegraded":"2024-09-19T09:50:30.361625+0000","last_fullsized":"2024-09-19T09:50:30.361625+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823345+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:51:31.823345+0000","last_peered":"2024-09-19T09:51:31.823345+0000","last_clean":"2024-09-19T09:51:31.823345+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:51:31.823345+0000","last_undegraded":"2024-09-19T09:51:31.823345+0000","last_fullsized":"2024-09-19T09:51:31.823345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.818901+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:51:30.818901+0000","last_peered":"2024-09-19T09:51:30.818901+0000","last_clean":"2024-09-19T09:51:30.818901+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:51:30.818901+0000","last_undegraded":"2024-09-19T09:51:30.818901+0000","last_fullsized":"2024-09-19T09:51:30.818901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":2,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-19T09:50:40.410187+0000","last_change":"2024-09-19T09:51:31.314423+0000","last_active":"2024-09-19T09:51:31.314423+0000","last_peered":"2024-09-19T09:50:40.410187+0000","last_clean":"2024-09-19T09:50:40.410187+0000","last_became_active":"2024-09-19T09:50:27.343727+0000","last_became_peered":"2024-09-19T09:50:27.343727+0000","last_unstale":"2024-09-19T09:50:40.410187+0000","last_undegraded":"2024-09-19T09:50:40.410187+0000","last_fullsized":"2024-09-19T09:50:40.410187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823448+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:51:31.823448+0000","last_peered":"2024-09-19T09:51:31.823448+0000","last_clean":"2024-09-19T09:51:31.823448+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:51:31.823448+0000","last_undegraded":"2024-09-19T09:51:31.823448+0000","last_fullsized":"2024-09-19T09:51:31.823448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:37.398274+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:50:37.398274+0000","last_peered":"2024-09-19T09:50:37.398274+0000","last_clean":"2024-09-19T09:50:37.398274+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:50:37.398274+0000","last_undegraded":"2024-09-19T09:50:37.398274+0000","last_fullsized":"2024-09-19T09:50:37.398274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414846+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:51:32.414846+0000","last_peered":"2024-09-19T09:51:32.414846+0000","last_clean":"2024-09-19T09:51:32.414846+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:51:32.414846+0000","last_undegraded":"2024-09-19T09:51:32.414846+0000","last_fullsized":"2024-09-19T09:51:32.414846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815694+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:51:31.815694+0000","last_peered":"2024-09-19T09:51:31.815694+0000","last_clean":"2024-09-19T09:51:31.815694+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:51:31.815694+0000","last_undegraded":"2024-09-19T09:51:31.815694+0000","last_fullsized":"2024-09-19T09:51:31.815694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.344467+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:50:40.344467+0000","last_peered":"2024-09-19T09:50:40.344467+0000","last_clean":"2024-09-19T09:50:40.344467+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:50:40.344467+0000","last_undegraded":"2024-09-19T09:50:40.344467+0000","last_fullsized":"2024-09-19T09:50:40.344467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.813988+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:51:30.813988+0000","last_peered":"2024-09-19T09:51:30.813988+0000","last_clean":"2024-09-19T09:51:30.813988+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:51:30.813988+0000","last_undegraded":"2024-09-19T09:51:30.813988+0000","last_fullsized":"2024-09-19T09:51:30.813988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:40.344696+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:50:40.344696+0000","last_peered":"2024-09-19T09:50:40.344696+0000","last_clean":"2024-09-19T09:50:40.344696+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:50:40.344696+0000","last_undegraded":"2024-09-19T09:50:40.344696+0000","last_fullsized":"2024-09-19T09:50:40.344696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:51:30.815980+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:51:30.815980+0000","last_peered":"2024-09-19T09:51:30.815980+0000","last_clean":"2024-09-19T09:51:30.815980+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:51:30.815980+0000","last_undegraded":"2024-09-19T09:51:30.815980+0000","last_fullsized":"2024-09-19T09:51:30.815980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823942+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:51:31.823942+0000","last_peered":"2024-09-19T09:51:31.823942+0000","last_clean":"2024-09-19T09:51:31.823942+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:51:31.823942+0000","last_undegraded":"2024-09-19T09:51:31.823942+0000","last_fullsized":"2024-09-19T09:51:31.823942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:50:30.362615+0000","last_change":"2024-09-19T09:50:29.365288+0000","last_active":"2024-09-19T09:50:30.362615+0000","last_peered":"2024-09-19T09:50:30.362615+0000","last_clean":"2024-09-19T09:50:30.362615+0000","last_became_active":"2024-09-19T09:50:29.364977+0000","last_became_peered":"2024-09-19T09:50:29.364977+0000","last_unstale":"2024-09-19T09:50:30.362615+0000","last_undegraded":"2024-09-19T09:50:30.362615+0000","last_fullsized":"2024-09-19T09:50:30.362615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:45.978204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:51:28.405887+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:51:28.405887+0000","last_peered":"2024-09-19T09:51:28.405887+0000","last_clean":"2024-09-19T09:51:28.405887+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:51:28.405887+0000","last_undegraded":"2024-09-19T09:51:28.405887+0000","last_fullsized":"2024-09-19T09:51:28.405887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67827,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":571,"num_read_kb":360,"num_write":242,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":203481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514522,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":425781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1617920,"data_stored":1094829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906980,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":425711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":426089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364846,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36848,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708304,"statfs":{"total":95995035648,"available":95957303296,"internally_reserved":0,"allocated":1536000,"data_stored":1036009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40416,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704736,"statfs":{"total":95995035648,"available":95953649664,"internally_reserved":0,"allocated":925696,"data_stored":442828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32704,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712448,"statfs":{"total":95995035648,"available":95961546752,"internally_reserved":0,"allocated":1548288,"data_stored":1034901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953534,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":925696,"data_stored":442689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":442260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":995328,"data_stored":495765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":962560,"data_stored":487353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":435352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:51:35.190 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-19T09:51:35.190 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 82, 'state': 'peering', 'last_fresh': '2024-09-19T09:50:31.308235+0000', 'last_change': '2024-09-19T09:51:30.820297+0000', 'last_active': '2024-09-19T09:51:30.820297+0000', 'last_peered': '2024-09-19T09:50:31.308235+0000', 'last_clean': '2024-09-19T09:50:31.308235+0000', 'last_became_active': '2024-09-19T09:50:29.352483+0000', 'last_became_peered': '2024-09-19T09:50:29.352483+0000', 'last_unstale': '2024-09-19T09:50:31.308235+0000', 'last_undegraded': '2024-09-19T09:50:31.308235+0000', 'last_fullsized': '2024-09-19T09:50:31.308235+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 81, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:50:28.330329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:50:28.330329+0000', 'last_clean_scrub_stamp': '2024-09-19T09:50:28.330329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 9, 8], 'acting': [11, 9, 8], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 8, 9], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-09-19T09:51:35.190 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-19T09:51:35.190 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.a', 'version': "82'3", 'reported_seq': 2, 'reported_epoch': 83, 'state': 'peering', 'last_fresh': '2024-09-19T09:50:40.410187+0000', 'last_change': '2024-09-19T09:51:31.314423+0000', 'last_active': '2024-09-19T09:51:31.314423+0000', 'last_peered': '2024-09-19T09:50:40.410187+0000', 'last_clean': '2024-09-19T09:50:40.410187+0000', 'last_became_active': '2024-09-19T09:50:27.343727+0000', 'last_became_peered': '2024-09-19T09:50:27.343727+0000', 'last_unstale': '2024-09-19T09:50:40.410187+0000', 'last_undegraded': '2024-09-19T09:50:40.410187+0000', 'last_fullsized': '2024-09-19T09:50:40.410187+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 79, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:50:26.322872+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:50:26.322872+0000', 'last_clean_scrub_stamp': '2024-09-19T09:50:26.322872+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 0, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 2, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 2, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 2, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 3, 8], 'acting': [11, 3, 8], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-09-19T09:51:35.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph status --format=json 2024-09-19T09:51:35.450 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.870+0000 7f08e931b640 1 -- 172.21.15.18:0/774447206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08e4101de0 msgr2=0x7f08e41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.870+0000 7f08e931b640 1 --2- 172.21.15.18:0/774447206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08e4101de0 0x7f08e41021c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f08d4009900 tx=0x7f08d402a410 comp rx=0 tx=0).stop 2024-09-19T09:51:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.870+0000 7f08e931b640 1 -- 172.21.15.18:0/774447206 shutdown_connections 2024-09-19T09:51:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.870+0000 7f08e931b640 1 --2- 172.21.15.18:0/774447206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e4106f10 0x7f08e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.870+0000 7f08e931b640 1 --2- 172.21.15.18:0/774447206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08e4102790 0x7f08e41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.870+0000 7f08e931b640 1 --2- 172.21.15.18:0/774447206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08e4101de0 0x7f08e41021c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.870+0000 7f08e931b640 1 -- 172.21.15.18:0/774447206 >> 172.21.15.18:0/774447206 conn(0x7f08e40fd8c0 msgr2=0x7f08e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.870+0000 7f08e931b640 1 -- 172.21.15.18:0/774447206 shutdown_connections 2024-09-19T09:51:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.870+0000 7f08e931b640 1 -- 172.21.15.18:0/774447206 wait complete. 2024-09-19T09:51:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e931b640 1 Processor -- start 2024-09-19T09:51:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e931b640 1 -- start start 2024-09-19T09:51:35.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e931b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08e4101de0 0x7f08e419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:35.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e931b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08e4102790 0x7f08e419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:35.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e931b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e4106f10 0x7f08e419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:35.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e931b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f08e4111f70 con 0x7f08e4101de0 2024-09-19T09:51:35.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e931b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f08e4111df0 con 0x7f08e4102790 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e931b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08e41120f0 con 0x7f08e4106f10 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08e4101de0 0x7f08e419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08e4101de0 0x7f08e419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50866/0 (socket says 172.21.15.18:50866) 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e2ffd640 1 -- 172.21.15.18:0/2890206557 learned_addr learned my addr 172.21.15.18:0/2890206557 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e27fc640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08e4102790 0x7f08e419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.871+0000 7f08e37fe640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e4106f10 0x7f08e419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08e2ffd640 1 -- 172.21.15.18:0/2890206557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e4106f10 msgr2=0x7f08e419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08e2ffd640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e4106f10 0x7f08e419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08e2ffd640 1 -- 172.21.15.18:0/2890206557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08e4102790 msgr2=0x7f08e419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08e2ffd640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08e4102790 0x7f08e419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08e2ffd640 1 -- 172.21.15.18:0/2890206557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e419f5f0 con 0x7f08e4101de0 2024-09-19T09:51:35.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08e37fe640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e4106f10 0x7f08e419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:35.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08e27fc640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08e4102790 0x7f08e419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:35.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08e2ffd640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08e4101de0 0x7f08e419a640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f08d4006010 tx=0x7f08d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:35.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08cbfff640 1 -- 172.21.15.18:0/2890206557 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d403f030 con 0x7f08e4101de0 2024-09-19T09:51:35.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08e931b640 1 -- 172.21.15.18:0/2890206557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e419f880 con 0x7f08e4101de0 2024-09-19T09:51:35.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08cbfff640 1 -- 172.21.15.18:0/2890206557 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08d4003ce0 con 0x7f08e4101de0 2024-09-19T09:51:35.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08cbfff640 1 -- 172.21.15.18:0/2890206557 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4035070 con 0x7f08e4101de0 2024-09-19T09:51:35.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.872+0000 7f08e931b640 1 -- 172.21.15.18:0/2890206557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e41a71c0 con 0x7f08e4101de0 2024-09-19T09:51:35.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.873+0000 7f08e931b640 1 -- 172.21.15.18:0/2890206557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e41021c0 con 0x7f08e4101de0 2024-09-19T09:51:35.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.874+0000 7f08cbfff640 1 -- 172.21.15.18:0/2890206557 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f08d4042030 con 0x7f08e4101de0 2024-09-19T09:51:35.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.875+0000 7f08cbfff640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f08cc0a32d0 0x7f08cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:35.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.875+0000 7f08e27fc640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f08cc0a32d0 0x7f08cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:35.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.875+0000 7f08cbfff640 1 -- 172.21.15.18:0/2890206557 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f08d40f0340 con 0x7f08e4101de0 2024-09-19T09:51:35.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.875+0000 7f08e27fc640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f08cc0a32d0 0x7f08cc0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f08e40ff750 tx=0x7f08d8009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:35.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:35.879+0000 7f08cbfff640 1 -- 172.21.15.18:0/2890206557 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08d40bcf90 con 0x7f08e4101de0 2024-09-19T09:51:36.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.122+0000 7f08e931b640 1 -- 172.21.15.18:0/2890206557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f08e41a7390 con 0x7f08e4101de0 2024-09-19T09:51:36.125 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:35 smithi018 ceph-mon[30956]: pgmap v316: 97 pgs: 2 peering, 95 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-19T09:51:36.125 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:35 smithi018 ceph-mon[30956]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:36.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.123+0000 7f08cbfff640 1 -- 172.21.15.18:0/2890206557 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3356 (secure 0 0 0) 0x7f08d40bc890 con 0x7f08e4101de0 2024-09-19T09:51:36.125 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:36.126 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"5b174660-766b-11ef-bceb-c7b262605968","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 1 pg peering","count":1},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":434,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":12,"num_up_osds":12,"osd_up_since":1726739380,"num_in_osds":12,"osd_in_since":1726739356,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"peering","count":2}],"num_pgs":97,"num_pools":3,"num_objects":102,"data_bytes":658429,"bytes_used":383574016,"bytes_avail":1151556853760,"bytes_total":1151940427776,"inactive_pgs_ratio":0.020618556067347527,"read_bytes_sec":5758,"read_op_per_sec":11,"write_op_per_sec":0},"fsmap":{"epoch":27,"btime":"2024-09-19T09:50:41:339962+0000","id":1,"up":5,"in":5,"max":5,"by_rank":[{"filesystem_id":1,"rank":4,"name":"g","status":"up:standby-replay","gid":14580},{"filesystem_id":1,"rank":4,"name":"a","status":"up:active","gid":14592},{"filesystem_id":1,"rank":3,"name":"l","status":"up:standby-replay","gid":24430},{"filesystem_id":1,"rank":2,"name":"k","status":"up:standby-replay","gid":24440},{"filesystem_id":1,"rank":1,"name":"f","status":"up:standby-replay","gid":24457},{"filesystem_id":1,"rank":0,"name":"c","status":"up:standby-replay","gid":24463},{"filesystem_id":1,"rank":3,"name":"e","status":"up:active","gid":24470},{"filesystem_id":1,"rank":2,"name":"i","status":"up:active","gid":24484},{"filesystem_id":1,"rank":1,"name":"h","status":"up:active","gid":24488},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24524}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.18:8443/"}},"servicemap":{"epoch":20,"modified":"2024-09-19T09:51:00.348605+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"k":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"l":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.125+0000 7f08e931b640 1 -- 172.21.15.18:0/2890206557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f08cc0a32d0 msgr2=0x7f08cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.125+0000 7f08e931b640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f08cc0a32d0 0x7f08cc0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f08e40ff750 tx=0x7f08d8009520 comp rx=0 tx=0).stop 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.125+0000 7f08e931b640 1 -- 172.21.15.18:0/2890206557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08e4101de0 msgr2=0x7f08e419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.125+0000 7f08e931b640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08e4101de0 0x7f08e419a640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f08d4006010 tx=0x7f08d40042f0 comp rx=0 tx=0).stop 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.125+0000 7f08e931b640 1 -- 172.21.15.18:0/2890206557 shutdown_connections 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.125+0000 7f08e931b640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f08cc0a32d0 0x7f08cc0a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.125+0000 7f08e931b640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e4106f10 0x7f08e419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.125+0000 7f08e931b640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08e4102790 0x7f08e419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.125+0000 7f08e931b640 1 --2- 172.21.15.18:0/2890206557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08e4101de0 0x7f08e419a640 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.125+0000 7f08e931b640 1 -- 172.21.15.18:0/2890206557 >> 172.21.15.18:0/2890206557 conn(0x7f08e40fd8c0 msgr2=0x7f08e40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.126+0000 7f08e931b640 1 -- 172.21.15.18:0/2890206557 shutdown_connections 2024-09-19T09:51:36.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:36.126+0000 7f08e931b640 1 -- 172.21.15.18:0/2890206557 wait complete. 2024-09-19T09:51:36.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:35 smithi049 ceph-mon[34858]: pgmap v316: 97 pgs: 2 peering, 95 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-19T09:51:36.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:35 smithi049 ceph-mon[34858]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:36.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:35 smithi162 ceph-mon[35174]: pgmap v316: 97 pgs: 2 peering, 95 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-19T09:51:36.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:35 smithi162 ceph-mon[35174]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:36.815 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T09:51:36.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:51:37.072 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:37.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:36 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2890206557' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T09:51:37.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:36 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2890206557' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T09:51:37.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:36 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2890206557' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T09:51:37.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.535+0000 7fcc1b59a640 1 -- 172.21.15.18:0/4105142720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc14106f50 msgr2=0x7fcc1410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.535+0000 7fcc1b59a640 1 --2- 172.21.15.18:0/4105142720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc14106f50 0x7fcc1410eaf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009cd0 tx=0x7fcc0c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.535+0000 7fcc1b59a640 1 -- 172.21.15.18:0/4105142720 shutdown_connections 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.535+0000 7fcc1b59a640 1 --2- 172.21.15.18:0/4105142720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc14106f50 0x7fcc1410eaf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.535+0000 7fcc1b59a640 1 --2- 172.21.15.18:0/4105142720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14100d00 0x7fcc14106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.535+0000 7fcc1b59a640 1 --2- 172.21.15.18:0/4105142720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc14100350 0x7fcc14100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.535+0000 7fcc1b59a640 1 -- 172.21.15.18:0/4105142720 >> 172.21.15.18:0/4105142720 conn(0x7fcc14077210 msgr2=0x7fcc140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.535+0000 7fcc1b59a640 1 -- 172.21.15.18:0/4105142720 shutdown_connections 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.535+0000 7fcc1b59a640 1 -- 172.21.15.18:0/4105142720 wait complete. 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc1b59a640 1 Processor -- start 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc1b59a640 1 -- start start 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc1b59a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc14100350 0x7fcc141984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc1b59a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14100d00 0x7fcc141989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc1b59a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc14106f50 0x7fcc1419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc1b59a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc14112000 con 0x7fcc14100350 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc1b59a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcc14111e80 con 0x7fcc14100d00 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc1b59a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc14112180 con 0x7fcc14106f50 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc19336640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc14100350 0x7fcc141984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc19336640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc14100350 0x7fcc141984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57330/0 (socket says 172.21.15.18:57330) 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.536+0000 7fcc19336640 1 -- 172.21.15.18:0/575773095 learned_addr learned my addr 172.21.15.18:0/575773095 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc18b35640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14100d00 0x7fcc141989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc19336640 1 -- 172.21.15.18:0/575773095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc14106f50 msgr2=0x7fcc1419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc19b37640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc14106f50 0x7fcc1419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc19336640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc14106f50 0x7fcc1419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc19336640 1 -- 172.21.15.18:0/575773095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14100d00 msgr2=0x7fcc141989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc19336640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14100d00 0x7fcc141989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc19336640 1 -- 172.21.15.18:0/575773095 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1419d450 con 0x7fcc14100350 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc18b35640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14100d00 0x7fcc141989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc19b37640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc14106f50 0x7fcc1419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc19336640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc14100350 0x7fcc141984a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000b4a0 tx=0x7fcc1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc0a7fc640 1 -- 172.21.15.18:0/575773095 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10014070 con 0x7fcc14100350 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc0a7fc640 1 -- 172.21.15.18:0/575773095 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc10010af0 con 0x7fcc14100350 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc1b59a640 1 -- 172.21.15.18:0/575773095 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1419d740 con 0x7fcc14100350 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc0a7fc640 1 -- 172.21.15.18:0/575773095 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10017d10 con 0x7fcc14100350 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.537+0000 7fcc1b59a640 1 -- 172.21.15.18:0/575773095 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc141a5020 con 0x7fcc14100350 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.538+0000 7fcc1b59a640 1 -- 172.21.15.18:0/575773095 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc14100730 con 0x7fcc14100350 2024-09-19T09:51:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.539+0000 7fcc0a7fc640 1 -- 172.21.15.18:0/575773095 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcc10017070 con 0x7fcc14100350 2024-09-19T09:51:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.540+0000 7fcc0a7fc640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc000a32d0 0x7fcc000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.540+0000 7fcc18b35640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc000a32d0 0x7fcc000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.540+0000 7fcc0a7fc640 1 -- 172.21.15.18:0/575773095 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcc100cf170 con 0x7fcc14100350 2024-09-19T09:51:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.541+0000 7fcc18b35640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc000a32d0 0x7fcc000a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcc14104830 tx=0x7fcc04005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.543+0000 7fcc0a7fc640 1 -- 172.21.15.18:0/575773095 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcc1009be70 con 0x7fcc14100350 2024-09-19T09:51:37.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.717+0000 7fcc1b59a640 1 -- 172.21.15.18:0/575773095 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc14062630 con 0x7fcc000a32d0 2024-09-19T09:51:37.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.723+0000 7fcc0a7fc640 1 -- 172.21.15.18:0/575773095 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258744 (secure 0 0 0) 0x7fcc14062630 con 0x7fcc000a32d0 2024-09-19T09:51:37.727 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:37.728 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:51:37.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 -- 172.21.15.18:0/575773095 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc000a32d0 msgr2=0x7fcc000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:37.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc000a32d0 0x7fcc000a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcc14104830 tx=0x7fcc04005d30 comp rx=0 tx=0).stop 2024-09-19T09:51:37.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 -- 172.21.15.18:0/575773095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc14100350 msgr2=0x7fcc141984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:37.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc14100350 0x7fcc141984a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000b4a0 tx=0x7fcc1000b960 comp rx=0 tx=0).stop 2024-09-19T09:51:37.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 -- 172.21.15.18:0/575773095 shutdown_connections 2024-09-19T09:51:37.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc000a32d0 0x7fcc000a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:37.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc14106f50 0x7fcc1419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:37.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14100d00 0x7fcc141989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:37.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 --2- 172.21.15.18:0/575773095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc14100350 0x7fcc141984a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:37.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 -- 172.21.15.18:0/575773095 >> 172.21.15.18:0/575773095 conn(0x7fcc14077210 msgr2=0x7fcc140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:37.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 -- 172.21.15.18:0/575773095 shutdown_connections 2024-09-19T09:51:37.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:37.726+0000 7fcc1b59a640 1 -- 172.21.15.18:0/575773095 wait complete. 2024-09-19T09:51:38.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:37 smithi018 ceph-mon[30956]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:38.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:37 smithi018 ceph-mon[30956]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T09:51:38.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:37 smithi018 ceph-mon[30956]: Cluster is now healthy 2024-09-19T09:51:38.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:37 smithi049 ceph-mon[34858]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:38.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:37 smithi049 ceph-mon[34858]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T09:51:38.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:37 smithi049 ceph-mon[34858]: Cluster is now healthy 2024-09-19T09:51:38.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:37 smithi162 ceph-mon[35174]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:38.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:37 smithi162 ceph-mon[35174]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T09:51:38.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:37 smithi162 ceph-mon[35174]: Cluster is now healthy 2024-09-19T09:51:38.349 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-19T09:51:36.364545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658429,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":702,"num_read_kb":474,"num_write":425,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374716,"kb_used_data":12912,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567108,"statfs":{"total":1151940427776,"available":1151556718592,"internally_reserved":0,"allocated":13221888,"data_stored":7266017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001854"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818582+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:51:31.818582+0000","last_peered":"2024-09-19T09:51:31.818582+0000","last_clean":"2024-09-19T09:51:31.818582+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:51:31.818582+0000","last_undegraded":"2024-09-19T09:51:31.818582+0000","last_fullsized":"2024-09-19T09:51:31.818582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821823+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:51:31.821823+0000","last_peered":"2024-09-19T09:51:31.821823+0000","last_clean":"2024-09-19T09:51:31.821823+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:51:31.821823+0000","last_undegraded":"2024-09-19T09:51:31.821823+0000","last_fullsized":"2024-09-19T09:51:31.821823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821899+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:51:31.821899+0000","last_peered":"2024-09-19T09:51:31.821899+0000","last_clean":"2024-09-19T09:51:31.821899+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:51:31.821899+0000","last_undegraded":"2024-09-19T09:51:31.821899+0000","last_fullsized":"2024-09-19T09:51:31.821899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.169978+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:51:32.169978+0000","last_peered":"2024-09-19T09:51:32.169978+0000","last_clean":"2024-09-19T09:51:32.169978+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:51:32.169978+0000","last_undegraded":"2024-09-19T09:51:32.169978+0000","last_fullsized":"2024-09-19T09:51:32.169978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821639+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:51:31.821639+0000","last_peered":"2024-09-19T09:51:31.821639+0000","last_clean":"2024-09-19T09:51:31.821639+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:51:31.821639+0000","last_undegraded":"2024-09-19T09:51:31.821639+0000","last_fullsized":"2024-09-19T09:51:31.821639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818907+0000","last_change":"2024-09-19T09:51:31.818907+0000","last_active":"2024-09-19T09:51:31.818907+0000","last_peered":"2024-09-19T09:51:31.818907+0000","last_clean":"2024-09-19T09:51:31.818907+0000","last_became_active":"2024-09-19T09:51:31.818522+0000","last_became_peered":"2024-09-19T09:51:31.818522+0000","last_unstale":"2024-09-19T09:51:31.818907+0000","last_undegraded":"2024-09-19T09:51:31.818907+0000","last_fullsized":"2024-09-19T09:51:31.818907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:04.062704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414658+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:51:32.414658+0000","last_peered":"2024-09-19T09:51:32.414658+0000","last_clean":"2024-09-19T09:51:32.414658+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:51:32.414658+0000","last_undegraded":"2024-09-19T09:51:32.414658+0000","last_fullsized":"2024-09-19T09:51:32.414658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823102+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:51:31.823102+0000","last_peered":"2024-09-19T09:51:31.823102+0000","last_clean":"2024-09-19T09:51:31.823102+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:51:31.823102+0000","last_undegraded":"2024-09-19T09:51:31.823102+0000","last_fullsized":"2024-09-19T09:51:31.823102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.965021+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:51:32.965021+0000","last_peered":"2024-09-19T09:51:32.965021+0000","last_clean":"2024-09-19T09:51:32.965021+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:51:32.965021+0000","last_undegraded":"2024-09-19T09:51:32.965021+0000","last_fullsized":"2024-09-19T09:51:32.965021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816435+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:51:31.816435+0000","last_peered":"2024-09-19T09:51:31.816435+0000","last_clean":"2024-09-19T09:51:31.816435+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:51:31.816435+0000","last_undegraded":"2024-09-19T09:51:31.816435+0000","last_fullsized":"2024-09-19T09:51:31.816435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415084+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:51:32.415084+0000","last_peered":"2024-09-19T09:51:32.415084+0000","last_clean":"2024-09-19T09:51:32.415084+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:51:32.415084+0000","last_undegraded":"2024-09-19T09:51:32.415084+0000","last_fullsized":"2024-09-19T09:51:32.415084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170120+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:51:32.170120+0000","last_peered":"2024-09-19T09:51:32.170120+0000","last_clean":"2024-09-19T09:51:32.170120+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:51:32.170120+0000","last_undegraded":"2024-09-19T09:51:32.170120+0000","last_fullsized":"2024-09-19T09:51:32.170120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818910+0000","last_change":"2024-09-19T09:51:31.818910+0000","last_active":"2024-09-19T09:51:31.818910+0000","last_peered":"2024-09-19T09:51:31.818910+0000","last_clean":"2024-09-19T09:51:31.818910+0000","last_became_active":"2024-09-19T09:51:31.818581+0000","last_became_peered":"2024-09-19T09:51:31.818581+0000","last_unstale":"2024-09-19T09:51:31.818910+0000","last_undegraded":"2024-09-19T09:51:31.818910+0000","last_fullsized":"2024-09-19T09:51:31.818910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.736835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822148+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:51:31.822148+0000","last_peered":"2024-09-19T09:51:31.822148+0000","last_clean":"2024-09-19T09:51:31.822148+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:51:31.822148+0000","last_undegraded":"2024-09-19T09:51:31.822148+0000","last_fullsized":"2024-09-19T09:51:31.822148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821822+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:51:31.821822+0000","last_peered":"2024-09-19T09:51:31.821822+0000","last_clean":"2024-09-19T09:51:31.821822+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:51:31.821822+0000","last_undegraded":"2024-09-19T09:51:31.821822+0000","last_fullsized":"2024-09-19T09:51:31.821822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964443+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:51:32.964443+0000","last_peered":"2024-09-19T09:51:32.964443+0000","last_clean":"2024-09-19T09:51:32.964443+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:51:32.964443+0000","last_undegraded":"2024-09-19T09:51:32.964443+0000","last_fullsized":"2024-09-19T09:51:32.964443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.819209+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:51:31.819209+0000","last_peered":"2024-09-19T09:51:31.819209+0000","last_clean":"2024-09-19T09:51:31.819209+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:51:31.819209+0000","last_undegraded":"2024-09-19T09:51:31.819209+0000","last_fullsized":"2024-09-19T09:51:31.819209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817865+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:51:31.817865+0000","last_peered":"2024-09-19T09:51:31.817865+0000","last_clean":"2024-09-19T09:51:31.817865+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:51:31.817865+0000","last_undegraded":"2024-09-19T09:51:31.817865+0000","last_fullsized":"2024-09-19T09:51:31.817865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822743+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:51:31.822743+0000","last_peered":"2024-09-19T09:51:31.822743+0000","last_clean":"2024-09-19T09:51:31.822743+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:51:31.822743+0000","last_undegraded":"2024-09-19T09:51:31.822743+0000","last_fullsized":"2024-09-19T09:51:31.822743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823803+0000","last_change":"2024-09-19T09:51:31.823803+0000","last_active":"2024-09-19T09:51:31.823803+0000","last_peered":"2024-09-19T09:51:31.823803+0000","last_clean":"2024-09-19T09:51:31.823803+0000","last_became_active":"2024-09-19T09:51:31.823361+0000","last_became_peered":"2024-09-19T09:51:31.823361+0000","last_unstale":"2024-09-19T09:51:31.823803+0000","last_undegraded":"2024-09-19T09:51:31.823803+0000","last_fullsized":"2024-09-19T09:51:31.823803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:33.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814751+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:51:31.814751+0000","last_peered":"2024-09-19T09:51:31.814751+0000","last_clean":"2024-09-19T09:51:31.814751+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:51:31.814751+0000","last_undegraded":"2024-09-19T09:51:31.814751+0000","last_fullsized":"2024-09-19T09:51:31.814751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964645+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:51:32.964645+0000","last_peered":"2024-09-19T09:51:32.964645+0000","last_clean":"2024-09-19T09:51:32.964645+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:51:32.964645+0000","last_undegraded":"2024-09-19T09:51:32.964645+0000","last_fullsized":"2024-09-19T09:51:32.964645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823164+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:51:31.823164+0000","last_peered":"2024-09-19T09:51:31.823164+0000","last_clean":"2024-09-19T09:51:31.823164+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:51:31.823164+0000","last_undegraded":"2024-09-19T09:51:31.823164+0000","last_fullsized":"2024-09-19T09:51:31.823164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815405+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:51:31.815405+0000","last_peered":"2024-09-19T09:51:31.815405+0000","last_clean":"2024-09-19T09:51:31.815405+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:51:31.815405+0000","last_undegraded":"2024-09-19T09:51:31.815405+0000","last_fullsized":"2024-09-19T09:51:31.815405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823588+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:51:31.823588+0000","last_peered":"2024-09-19T09:51:31.823588+0000","last_clean":"2024-09-19T09:51:31.823588+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:51:31.823588+0000","last_undegraded":"2024-09-19T09:51:31.823588+0000","last_fullsized":"2024-09-19T09:51:31.823588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822114+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:51:31.822114+0000","last_peered":"2024-09-19T09:51:31.822114+0000","last_clean":"2024-09-19T09:51:31.822114+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:51:31.822114+0000","last_undegraded":"2024-09-19T09:51:31.822114+0000","last_fullsized":"2024-09-19T09:51:31.822114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818315+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:51:31.818315+0000","last_peered":"2024-09-19T09:51:31.818315+0000","last_clean":"2024-09-19T09:51:31.818315+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:51:31.818315+0000","last_undegraded":"2024-09-19T09:51:31.818315+0000","last_fullsized":"2024-09-19T09:51:31.818315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814663+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:51:31.814663+0000","last_peered":"2024-09-19T09:51:31.814663+0000","last_clean":"2024-09-19T09:51:31.814663+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:51:31.814663+0000","last_undegraded":"2024-09-19T09:51:31.814663+0000","last_fullsized":"2024-09-19T09:51:31.814663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822090+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:51:31.822090+0000","last_peered":"2024-09-19T09:51:31.822090+0000","last_clean":"2024-09-19T09:51:31.822090+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:51:31.822090+0000","last_undegraded":"2024-09-19T09:51:31.822090+0000","last_fullsized":"2024-09-19T09:51:31.822090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822590+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:51:31.822590+0000","last_peered":"2024-09-19T09:51:31.822590+0000","last_clean":"2024-09-19T09:51:31.822590+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:51:31.822590+0000","last_undegraded":"2024-09-19T09:51:31.822590+0000","last_fullsized":"2024-09-19T09:51:31.822590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821965+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:51:31.821965+0000","last_peered":"2024-09-19T09:51:31.821965+0000","last_clean":"2024-09-19T09:51:31.821965+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:51:31.821965+0000","last_undegraded":"2024-09-19T09:51:31.821965+0000","last_fullsized":"2024-09-19T09:51:31.821965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817953+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:51:31.817953+0000","last_peered":"2024-09-19T09:51:31.817953+0000","last_clean":"2024-09-19T09:51:31.817953+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:51:31.817953+0000","last_undegraded":"2024-09-19T09:51:31.817953+0000","last_fullsized":"2024-09-19T09:51:31.817953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822282+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:51:31.822282+0000","last_peered":"2024-09-19T09:51:31.822282+0000","last_clean":"2024-09-19T09:51:31.822282+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:51:31.822282+0000","last_undegraded":"2024-09-19T09:51:31.822282+0000","last_fullsized":"2024-09-19T09:51:31.822282+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":82,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816129+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:51:31.816129+0000","last_peered":"2024-09-19T09:51:31.816129+0000","last_clean":"2024-09-19T09:51:31.816129+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:51:31.816129+0000","last_undegraded":"2024-09-19T09:51:31.816129+0000","last_fullsized":"2024-09-19T09:51:31.816129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.825618+0000","last_change":"2024-09-19T09:51:31.825618+0000","last_active":"2024-09-19T09:51:31.825618+0000","last_peered":"2024-09-19T09:51:31.825618+0000","last_clean":"2024-09-19T09:51:31.825618+0000","last_became_active":"2024-09-19T09:51:31.824727+0000","last_became_peered":"2024-09-19T09:51:31.824727+0000","last_unstale":"2024-09-19T09:51:31.825618+0000","last_undegraded":"2024-09-19T09:51:31.825618+0000","last_fullsized":"2024-09-19T09:51:31.825618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:52.094074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816210+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:51:31.816210+0000","last_peered":"2024-09-19T09:51:31.816210+0000","last_clean":"2024-09-19T09:51:31.816210+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:51:31.816210+0000","last_undegraded":"2024-09-19T09:51:31.816210+0000","last_fullsized":"2024-09-19T09:51:31.816210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814498+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:51:31.814498+0000","last_peered":"2024-09-19T09:51:31.814498+0000","last_clean":"2024-09-19T09:51:31.814498+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:51:31.814498+0000","last_undegraded":"2024-09-19T09:51:31.814498+0000","last_fullsized":"2024-09-19T09:51:31.814498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823230+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:51:31.823230+0000","last_peered":"2024-09-19T09:51:31.823230+0000","last_clean":"2024-09-19T09:51:31.823230+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:51:31.823230+0000","last_undegraded":"2024-09-19T09:51:31.823230+0000","last_fullsized":"2024-09-19T09:51:31.823230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815599+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:51:31.815599+0000","last_peered":"2024-09-19T09:51:31.815599+0000","last_clean":"2024-09-19T09:51:31.815599+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:51:31.815599+0000","last_undegraded":"2024-09-19T09:51:31.815599+0000","last_fullsized":"2024-09-19T09:51:31.815599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817475+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:51:31.817475+0000","last_peered":"2024-09-19T09:51:31.817475+0000","last_clean":"2024-09-19T09:51:31.817475+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:51:31.817475+0000","last_undegraded":"2024-09-19T09:51:31.817475+0000","last_fullsized":"2024-09-19T09:51:31.817475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:33.415912+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:33.415912+0000","last_peered":"2024-09-19T09:51:33.415912+0000","last_clean":"2024-09-19T09:51:33.415912+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:51:33.415912+0000","last_undegraded":"2024-09-19T09:51:33.415912+0000","last_fullsized":"2024-09-19T09:51:33.415912+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964896+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:51:32.964896+0000","last_peered":"2024-09-19T09:51:32.964896+0000","last_clean":"2024-09-19T09:51:32.964896+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:51:32.964896+0000","last_undegraded":"2024-09-19T09:51:32.964896+0000","last_fullsized":"2024-09-19T09:51:32.964896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415018+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:51:32.415018+0000","last_peered":"2024-09-19T09:51:32.415018+0000","last_clean":"2024-09-19T09:51:32.415018+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:51:32.415018+0000","last_undegraded":"2024-09-19T09:51:32.415018+0000","last_fullsized":"2024-09-19T09:51:32.415018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822777+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:51:31.822777+0000","last_peered":"2024-09-19T09:51:31.822777+0000","last_clean":"2024-09-19T09:51:31.822777+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:51:31.822777+0000","last_undegraded":"2024-09-19T09:51:31.822777+0000","last_fullsized":"2024-09-19T09:51:31.822777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815716+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:51:31.815716+0000","last_peered":"2024-09-19T09:51:31.815716+0000","last_clean":"2024-09-19T09:51:31.815716+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:51:31.815716+0000","last_undegraded":"2024-09-19T09:51:31.815716+0000","last_fullsized":"2024-09-19T09:51:31.815716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964623+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:51:32.964623+0000","last_peered":"2024-09-19T09:51:32.964623+0000","last_clean":"2024-09-19T09:51:32.964623+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:51:32.964623+0000","last_undegraded":"2024-09-19T09:51:32.964623+0000","last_fullsized":"2024-09-19T09:51:32.964623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":168,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:33.415903+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:51:33.415903+0000","last_peered":"2024-09-19T09:51:33.415903+0000","last_clean":"2024-09-19T09:51:33.415903+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:51:33.415903+0000","last_undegraded":"2024-09-19T09:51:33.415903+0000","last_fullsized":"2024-09-19T09:51:33.415903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60619,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":117,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822830+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:51:31.822830+0000","last_peered":"2024-09-19T09:51:31.822830+0000","last_clean":"2024-09-19T09:51:31.822830+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:51:31.822830+0000","last_undegraded":"2024-09-19T09:51:31.822830+0000","last_fullsized":"2024-09-19T09:51:31.822830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821655+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:51:31.821655+0000","last_peered":"2024-09-19T09:51:31.821655+0000","last_clean":"2024-09-19T09:51:31.821655+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:51:31.821655+0000","last_undegraded":"2024-09-19T09:51:31.821655+0000","last_fullsized":"2024-09-19T09:51:31.821655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814554+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:51:31.814554+0000","last_peered":"2024-09-19T09:51:31.814554+0000","last_clean":"2024-09-19T09:51:31.814554+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:51:31.814554+0000","last_undegraded":"2024-09-19T09:51:31.814554+0000","last_fullsized":"2024-09-19T09:51:31.814554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815497+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:31.815497+0000","last_peered":"2024-09-19T09:51:31.815497+0000","last_clean":"2024-09-19T09:51:31.815497+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:51:31.815497+0000","last_undegraded":"2024-09-19T09:51:31.815497+0000","last_fullsized":"2024-09-19T09:51:31.815497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415126+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:51:32.415126+0000","last_peered":"2024-09-19T09:51:32.415126+0000","last_clean":"2024-09-19T09:51:32.415126+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:51:32.415126+0000","last_undegraded":"2024-09-19T09:51:32.415126+0000","last_fullsized":"2024-09-19T09:51:32.415126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.411698+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:51:32.411698+0000","last_peered":"2024-09-19T09:51:32.411698+0000","last_clean":"2024-09-19T09:51:32.411698+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:51:32.411698+0000","last_undegraded":"2024-09-19T09:51:32.411698+0000","last_fullsized":"2024-09-19T09:51:32.411698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414551+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:51:32.414551+0000","last_peered":"2024-09-19T09:51:32.414551+0000","last_clean":"2024-09-19T09:51:32.414551+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:51:32.414551+0000","last_undegraded":"2024-09-19T09:51:32.414551+0000","last_fullsized":"2024-09-19T09:51:32.414551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821556+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:51:31.821556+0000","last_peered":"2024-09-19T09:51:31.821556+0000","last_clean":"2024-09-19T09:51:31.821556+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:51:31.821556+0000","last_undegraded":"2024-09-19T09:51:31.821556+0000","last_fullsized":"2024-09-19T09:51:31.821556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815462+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:51:31.815462+0000","last_peered":"2024-09-19T09:51:31.815462+0000","last_clean":"2024-09-19T09:51:31.815462+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:51:31.815462+0000","last_undegraded":"2024-09-19T09:51:31.815462+0000","last_fullsized":"2024-09-19T09:51:31.815462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822495+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:51:31.822495+0000","last_peered":"2024-09-19T09:51:31.822495+0000","last_clean":"2024-09-19T09:51:31.822495+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:51:31.822495+0000","last_undegraded":"2024-09-19T09:51:31.822495+0000","last_fullsized":"2024-09-19T09:51:31.822495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818407+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:51:31.818407+0000","last_peered":"2024-09-19T09:51:31.818407+0000","last_clean":"2024-09-19T09:51:31.818407+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:51:31.818407+0000","last_undegraded":"2024-09-19T09:51:31.818407+0000","last_fullsized":"2024-09-19T09:51:31.818407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814756+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:51:31.814756+0000","last_peered":"2024-09-19T09:51:31.814756+0000","last_clean":"2024-09-19T09:51:31.814756+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:51:31.814756+0000","last_undegraded":"2024-09-19T09:51:31.814756+0000","last_fullsized":"2024-09-19T09:51:31.814756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415283+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:51:32.415283+0000","last_peered":"2024-09-19T09:51:32.415283+0000","last_clean":"2024-09-19T09:51:32.415283+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:51:32.415283+0000","last_undegraded":"2024-09-19T09:51:32.415283+0000","last_fullsized":"2024-09-19T09:51:32.415283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815831+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:51:31.815831+0000","last_peered":"2024-09-19T09:51:31.815831+0000","last_clean":"2024-09-19T09:51:31.815831+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:51:31.815831+0000","last_undegraded":"2024-09-19T09:51:31.815831+0000","last_fullsized":"2024-09-19T09:51:31.815831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414880+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:51:32.414880+0000","last_peered":"2024-09-19T09:51:32.414880+0000","last_clean":"2024-09-19T09:51:32.414880+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:51:32.414880+0000","last_undegraded":"2024-09-19T09:51:32.414880+0000","last_fullsized":"2024-09-19T09:51:32.414880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":81,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822227+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:51:31.822227+0000","last_peered":"2024-09-19T09:51:31.822227+0000","last_clean":"2024-09-19T09:51:31.822227+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:51:31.822227+0000","last_undegraded":"2024-09-19T09:51:31.822227+0000","last_fullsized":"2024-09-19T09:51:31.822227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415176+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:51:32.415176+0000","last_peered":"2024-09-19T09:51:32.415176+0000","last_clean":"2024-09-19T09:51:32.415176+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:51:32.415176+0000","last_undegraded":"2024-09-19T09:51:32.415176+0000","last_fullsized":"2024-09-19T09:51:32.415176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414710+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:51:32.414710+0000","last_peered":"2024-09-19T09:51:32.414710+0000","last_clean":"2024-09-19T09:51:32.414710+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:51:32.414710+0000","last_undegraded":"2024-09-19T09:51:32.414710+0000","last_fullsized":"2024-09-19T09:51:32.414710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.169977+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:51:32.169977+0000","last_peered":"2024-09-19T09:51:32.169977+0000","last_clean":"2024-09-19T09:51:32.169977+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:51:32.169977+0000","last_undegraded":"2024-09-19T09:51:32.169977+0000","last_fullsized":"2024-09-19T09:51:32.169977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824825+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:51:31.824825+0000","last_peered":"2024-09-19T09:51:31.824825+0000","last_clean":"2024-09-19T09:51:31.824825+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:51:31.824825+0000","last_undegraded":"2024-09-19T09:51:31.824825+0000","last_fullsized":"2024-09-19T09:51:31.824825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414691+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:51:32.414691+0000","last_peered":"2024-09-19T09:51:32.414691+0000","last_clean":"2024-09-19T09:51:32.414691+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:51:32.414691+0000","last_undegraded":"2024-09-19T09:51:32.414691+0000","last_fullsized":"2024-09-19T09:51:32.414691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814496+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:51:31.814496+0000","last_peered":"2024-09-19T09:51:31.814496+0000","last_clean":"2024-09-19T09:51:31.814496+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:51:31.814496+0000","last_undegraded":"2024-09-19T09:51:31.814496+0000","last_fullsized":"2024-09-19T09:51:31.814496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":82,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.411173+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:51:32.411173+0000","last_peered":"2024-09-19T09:51:32.411173+0000","last_clean":"2024-09-19T09:51:32.411173+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:51:32.411173+0000","last_undegraded":"2024-09-19T09:51:32.411173+0000","last_fullsized":"2024-09-19T09:51:32.411173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815467+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:51:31.815467+0000","last_peered":"2024-09-19T09:51:31.815467+0000","last_clean":"2024-09-19T09:51:31.815467+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:51:31.815467+0000","last_undegraded":"2024-09-19T09:51:31.815467+0000","last_fullsized":"2024-09-19T09:51:31.815467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415281+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:51:32.415281+0000","last_peered":"2024-09-19T09:51:32.415281+0000","last_clean":"2024-09-19T09:51:32.415281+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:51:32.415281+0000","last_undegraded":"2024-09-19T09:51:32.415281+0000","last_fullsized":"2024-09-19T09:51:32.415281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815856+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:51:31.815856+0000","last_peered":"2024-09-19T09:51:31.815856+0000","last_clean":"2024-09-19T09:51:31.815856+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:51:31.815856+0000","last_undegraded":"2024-09-19T09:51:31.815856+0000","last_fullsized":"2024-09-19T09:51:31.815856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824076+0000","last_change":"2024-09-19T09:51:31.824076+0000","last_active":"2024-09-19T09:51:31.824076+0000","last_peered":"2024-09-19T09:51:31.824076+0000","last_clean":"2024-09-19T09:51:31.824076+0000","last_became_active":"2024-09-19T09:51:31.823642+0000","last_became_peered":"2024-09-19T09:51:31.823642+0000","last_unstale":"2024-09-19T09:51:31.824076+0000","last_undegraded":"2024-09-19T09:51:31.824076+0000","last_fullsized":"2024-09-19T09:51:31.824076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:53.035531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815803+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:51:31.815803+0000","last_peered":"2024-09-19T09:51:31.815803+0000","last_clean":"2024-09-19T09:51:31.815803+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:51:31.815803+0000","last_undegraded":"2024-09-19T09:51:31.815803+0000","last_fullsized":"2024-09-19T09:51:31.815803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822947+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:51:31.822947+0000","last_peered":"2024-09-19T09:51:31.822947+0000","last_clean":"2024-09-19T09:51:31.822947+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:51:31.822947+0000","last_undegraded":"2024-09-19T09:51:31.822947+0000","last_fullsized":"2024-09-19T09:51:31.822947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814777+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:51:31.814777+0000","last_peered":"2024-09-19T09:51:31.814777+0000","last_clean":"2024-09-19T09:51:31.814777+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:51:31.814777+0000","last_undegraded":"2024-09-19T09:51:31.814777+0000","last_fullsized":"2024-09-19T09:51:31.814777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817943+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:51:31.817943+0000","last_peered":"2024-09-19T09:51:31.817943+0000","last_clean":"2024-09-19T09:51:31.817943+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:51:31.817943+0000","last_undegraded":"2024-09-19T09:51:31.817943+0000","last_fullsized":"2024-09-19T09:51:31.817943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823704+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:51:31.823704+0000","last_peered":"2024-09-19T09:51:31.823704+0000","last_clean":"2024-09-19T09:51:31.823704+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:51:31.823704+0000","last_undegraded":"2024-09-19T09:51:31.823704+0000","last_fullsized":"2024-09-19T09:51:31.823704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170286+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:51:32.170286+0000","last_peered":"2024-09-19T09:51:32.170286+0000","last_clean":"2024-09-19T09:51:32.170286+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:51:32.170286+0000","last_undegraded":"2024-09-19T09:51:32.170286+0000","last_fullsized":"2024-09-19T09:51:32.170286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821979+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:51:31.821979+0000","last_peered":"2024-09-19T09:51:31.821979+0000","last_clean":"2024-09-19T09:51:31.821979+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:51:31.821979+0000","last_undegraded":"2024-09-19T09:51:31.821979+0000","last_fullsized":"2024-09-19T09:51:31.821979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964590+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:51:32.964590+0000","last_peered":"2024-09-19T09:51:32.964590+0000","last_clean":"2024-09-19T09:51:32.964590+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:51:32.964590+0000","last_undegraded":"2024-09-19T09:51:32.964590+0000","last_fullsized":"2024-09-19T09:51:32.964590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821712+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:51:31.821712+0000","last_peered":"2024-09-19T09:51:31.821712+0000","last_clean":"2024-09-19T09:51:31.821712+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:51:31.821712+0000","last_undegraded":"2024-09-19T09:51:31.821712+0000","last_fullsized":"2024-09-19T09:51:31.821712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823345+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:51:31.823345+0000","last_peered":"2024-09-19T09:51:31.823345+0000","last_clean":"2024-09-19T09:51:31.823345+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:51:31.823345+0000","last_undegraded":"2024-09-19T09:51:31.823345+0000","last_fullsized":"2024-09-19T09:51:31.823345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818062+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:51:31.818062+0000","last_peered":"2024-09-19T09:51:31.818062+0000","last_clean":"2024-09-19T09:51:31.818062+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:51:31.818062+0000","last_undegraded":"2024-09-19T09:51:31.818062+0000","last_fullsized":"2024-09-19T09:51:31.818062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.830511+0000","last_change":"2024-09-19T09:51:31.830511+0000","last_active":"2024-09-19T09:51:31.830511+0000","last_peered":"2024-09-19T09:51:31.830511+0000","last_clean":"2024-09-19T09:51:31.830511+0000","last_became_active":"2024-09-19T09:51:31.825672+0000","last_became_peered":"2024-09-19T09:51:31.825672+0000","last_unstale":"2024-09-19T09:51:31.830511+0000","last_undegraded":"2024-09-19T09:51:31.830511+0000","last_fullsized":"2024-09-19T09:51:31.830511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.101027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823448+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:51:31.823448+0000","last_peered":"2024-09-19T09:51:31.823448+0000","last_clean":"2024-09-19T09:51:31.823448+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:51:31.823448+0000","last_undegraded":"2024-09-19T09:51:31.823448+0000","last_fullsized":"2024-09-19T09:51:31.823448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821791+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:51:31.821791+0000","last_peered":"2024-09-19T09:51:31.821791+0000","last_clean":"2024-09-19T09:51:31.821791+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:51:31.821791+0000","last_undegraded":"2024-09-19T09:51:31.821791+0000","last_fullsized":"2024-09-19T09:51:31.821791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414846+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:51:32.414846+0000","last_peered":"2024-09-19T09:51:32.414846+0000","last_clean":"2024-09-19T09:51:32.414846+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:51:32.414846+0000","last_undegraded":"2024-09-19T09:51:32.414846+0000","last_fullsized":"2024-09-19T09:51:32.414846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815694+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:51:31.815694+0000","last_peered":"2024-09-19T09:51:31.815694+0000","last_clean":"2024-09-19T09:51:31.815694+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:51:31.815694+0000","last_undegraded":"2024-09-19T09:51:31.815694+0000","last_fullsized":"2024-09-19T09:51:31.815694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822749+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:51:31.822749+0000","last_peered":"2024-09-19T09:51:31.822749+0000","last_clean":"2024-09-19T09:51:31.822749+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:51:31.822749+0000","last_undegraded":"2024-09-19T09:51:31.822749+0000","last_fullsized":"2024-09-19T09:51:31.822749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964620+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:51:32.964620+0000","last_peered":"2024-09-19T09:51:32.964620+0000","last_clean":"2024-09-19T09:51:32.964620+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:51:32.964620+0000","last_undegraded":"2024-09-19T09:51:32.964620+0000","last_fullsized":"2024-09-19T09:51:32.964620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822889+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:51:31.822889+0000","last_peered":"2024-09-19T09:51:31.822889+0000","last_clean":"2024-09-19T09:51:31.822889+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:51:31.822889+0000","last_undegraded":"2024-09-19T09:51:31.822889+0000","last_fullsized":"2024-09-19T09:51:31.822889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822677+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:51:31.822677+0000","last_peered":"2024-09-19T09:51:31.822677+0000","last_clean":"2024-09-19T09:51:31.822677+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:51:31.822677+0000","last_undegraded":"2024-09-19T09:51:31.822677+0000","last_fullsized":"2024-09-19T09:51:31.822677+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823942+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:51:31.823942+0000","last_peered":"2024-09-19T09:51:31.823942+0000","last_clean":"2024-09-19T09:51:31.823942+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:51:31.823942+0000","last_undegraded":"2024-09-19T09:51:31.823942+0000","last_fullsized":"2024-09-19T09:51:31.823942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.825269+0000","last_change":"2024-09-19T09:51:31.824910+0000","last_active":"2024-09-19T09:51:31.825269+0000","last_peered":"2024-09-19T09:51:31.825269+0000","last_clean":"2024-09-19T09:51:31.825269+0000","last_became_active":"2024-09-19T09:51:31.824521+0000","last_became_peered":"2024-09-19T09:51:31.824521+0000","last_unstale":"2024-09-19T09:51:31.825269+0000","last_undegraded":"2024-09-19T09:51:31.825269+0000","last_fullsized":"2024-09-19T09:51:31.825269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:43.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":90,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:33.415848+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:51:33.415848+0000","last_peered":"2024-09-19T09:51:33.415848+0000","last_clean":"2024-09-19T09:51:33.415848+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:51:33.415848+0000","last_undegraded":"2024-09-19T09:51:33.415848+0000","last_fullsized":"2024-09-19T09:51:33.415848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67827,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":576,"num_read_kb":365,"num_write":242,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":203481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":442788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1617920,"data_stored":1094829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":442718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":443096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364846,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36848,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708304,"statfs":{"total":95995035648,"available":95957303296,"internally_reserved":0,"allocated":1536000,"data_stored":1036009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40416,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704736,"statfs":{"total":95995035648,"available":95953649664,"internally_reserved":0,"allocated":925696,"data_stored":442828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32704,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712448,"statfs":{"total":95995035648,"available":95961546752,"internally_reserved":0,"allocated":1548288,"data_stored":1034901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953534,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":925696,"data_stored":442689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":442260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":995328,"data_stored":495765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40472,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704680,"statfs":{"total":95995035648,"available":95953592320,"internally_reserved":0,"allocated":987136,"data_stored":504360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":946176,"data_stored":443774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:51:39.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:38 smithi018 ceph-mon[30956]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:39.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:38 smithi049 ceph-mon[34858]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:39.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:38 smithi162 ceph-mon[35174]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:40.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:39 smithi018 ceph-mon[30956]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:40.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:39 smithi049 ceph-mon[34858]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:40.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:39 smithi162 ceph-mon[35174]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:41.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:51:41.626 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:42.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:41 smithi018 ceph-mon[30956]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:42.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.111+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1758709215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e14102da0 msgr2=0x7f1e14103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.111+0000 7f1e1b68f640 1 --2- 172.21.15.18:0/1758709215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e14102da0 0x7f1e14103180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009900 tx=0x7f1e1002a480 comp rx=0 tx=0).stop 2024-09-19T09:51:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.111+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1758709215 shutdown_connections 2024-09-19T09:51:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.111+0000 7f1e1b68f640 1 --2- 172.21.15.18:0/1758709215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e1410c180 0x7f1e1410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.111+0000 7f1e1b68f640 1 --2- 172.21.15.18:0/1758709215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e141036c0 0x7f1e1410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.111+0000 7f1e1b68f640 1 --2- 172.21.15.18:0/1758709215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e14102da0 0x7f1e14103180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.111+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1758709215 >> 172.21.15.18:0/1758709215 conn(0x7f1e140fc7a0 msgr2=0x7f1e140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.111+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1758709215 shutdown_connections 2024-09-19T09:51:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.111+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1758709215 wait complete. 2024-09-19T09:51:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e1b68f640 1 Processor -- start 2024-09-19T09:51:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e1b68f640 1 -- start start 2024-09-19T09:51:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e1b68f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e14102da0 0x7f1e14198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e1b68f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e141036c0 0x7f1e141989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e1b68f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e1410c180 0x7f1e1419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e1b68f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14111fa0 con 0x7f1e1410c180 2024-09-19T09:51:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e1b68f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14111e20 con 0x7f1e141036c0 2024-09-19T09:51:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e1b68f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14112120 con 0x7f1e14102da0 2024-09-19T09:51:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e19c2c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e1410c180 0x7f1e1419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e19c2c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e1410c180 0x7f1e1419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57340/0 (socket says 172.21.15.18:57340) 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e19c2c640 1 -- 172.21.15.18:0/1007114979 learned_addr learned my addr 172.21.15.18:0/1007114979 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.112+0000 7f1e18c2a640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e141036c0 0x7f1e141989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e1942b640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e14102da0 0x7f1e14198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e19c2c640 1 -- 172.21.15.18:0/1007114979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e14102da0 msgr2=0x7f1e14198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e19c2c640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e14102da0 0x7f1e14198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e19c2c640 1 -- 172.21.15.18:0/1007114979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e141036c0 msgr2=0x7f1e141989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e19c2c640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e141036c0 0x7f1e141989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e19c2c640 1 -- 172.21.15.18:0/1007114979 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e1419d430 con 0x7f1e1410c180 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e1942b640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e14102da0 0x7f1e14198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e19c2c640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e1410c180 0x7f1e1419cd50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00b970 tx=0x7f1e0c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e0a7fc640 1 -- 172.21.15.18:0/1007114979 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c019070 con 0x7f1e1410c180 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e0a7fc640 1 -- 172.21.15.18:0/1007114979 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e0c00cb40 con 0x7f1e1410c180 2024-09-19T09:51:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1007114979 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e1419d720 con 0x7f1e1410c180 2024-09-19T09:51:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e0a7fc640 1 -- 172.21.15.18:0/1007114979 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c007650 con 0x7f1e1410c180 2024-09-19T09:51:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.113+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1007114979 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e141a5000 con 0x7f1e1410c180 2024-09-19T09:51:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.114+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1007114979 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e14103180 con 0x7f1e1410c180 2024-09-19T09:51:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.115+0000 7f1e0a7fc640 1 -- 172.21.15.18:0/1007114979 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1e0c01c070 con 0x7f1e1410c180 2024-09-19T09:51:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.116+0000 7f1e0a7fc640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e000a3350 0x7f1e000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.116+0000 7f1e1942b640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e000a3350 0x7f1e000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.116+0000 7f1e0a7fc640 1 -- 172.21.15.18:0/1007114979 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1e0c0cef40 con 0x7f1e1410c180 2024-09-19T09:51:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.116+0000 7f1e1942b640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e000a3350 0x7f1e000a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1e10000c00 tx=0x7f1e10032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:42.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.120+0000 7f1e0a7fc640 1 -- 172.21.15.18:0/1007114979 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e0c09b590 con 0x7f1e1410c180 2024-09-19T09:51:42.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:41 smithi049 ceph-mon[34858]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:41 smithi162 ceph-mon[35174]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.296+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1007114979 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e14062630 con 0x7f1e000a3350 2024-09-19T09:51:42.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.302+0000 7f1e0a7fc640 1 -- 172.21.15.18:0/1007114979 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258746 (secure 0 0 0) 0x7f1e14062630 con 0x7f1e000a3350 2024-09-19T09:51:42.307 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:51:42.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1007114979 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e000a3350 msgr2=0x7f1e000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:42.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e000a3350 0x7f1e000a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1e10000c00 tx=0x7f1e10032d50 comp rx=0 tx=0).stop 2024-09-19T09:51:42.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1007114979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e1410c180 msgr2=0x7f1e1419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:42.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e1410c180 0x7f1e1419cd50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00b970 tx=0x7f1e0c00be30 comp rx=0 tx=0).stop 2024-09-19T09:51:42.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1007114979 shutdown_connections 2024-09-19T09:51:42.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e000a3350 0x7f1e000a5810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e1410c180 0x7f1e1419cd50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e141036c0 0x7f1e141989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 --2- 172.21.15.18:0/1007114979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e14102da0 0x7f1e14198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:42.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1007114979 >> 172.21.15.18:0/1007114979 conn(0x7f1e140fc7a0 msgr2=0x7f1e140fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:42.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.306+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1007114979 shutdown_connections 2024-09-19T09:51:42.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:42.307+0000 7f1e1b68f640 1 -- 172.21.15.18:0/1007114979 wait complete. 2024-09-19T09:51:43.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:42 smithi018 ceph-mon[30956]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:43.066 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-19T09:51:40.365825+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658429,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":752,"num_read_kb":499,"num_write":425,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374732,"kb_used_data":12924,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567092,"statfs":{"total":1151940427776,"available":1151556702208,"internally_reserved":0,"allocated":13234176,"data_stored":7274439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.553641"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818582+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:51:31.818582+0000","last_peered":"2024-09-19T09:51:31.818582+0000","last_clean":"2024-09-19T09:51:31.818582+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:51:31.818582+0000","last_undegraded":"2024-09-19T09:51:31.818582+0000","last_fullsized":"2024-09-19T09:51:31.818582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821823+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:51:31.821823+0000","last_peered":"2024-09-19T09:51:31.821823+0000","last_clean":"2024-09-19T09:51:31.821823+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:51:31.821823+0000","last_undegraded":"2024-09-19T09:51:31.821823+0000","last_fullsized":"2024-09-19T09:51:31.821823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821899+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:51:31.821899+0000","last_peered":"2024-09-19T09:51:31.821899+0000","last_clean":"2024-09-19T09:51:31.821899+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:51:31.821899+0000","last_undegraded":"2024-09-19T09:51:31.821899+0000","last_fullsized":"2024-09-19T09:51:31.821899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.169978+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:51:32.169978+0000","last_peered":"2024-09-19T09:51:32.169978+0000","last_clean":"2024-09-19T09:51:32.169978+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:51:32.169978+0000","last_undegraded":"2024-09-19T09:51:32.169978+0000","last_fullsized":"2024-09-19T09:51:32.169978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821639+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:51:31.821639+0000","last_peered":"2024-09-19T09:51:31.821639+0000","last_clean":"2024-09-19T09:51:31.821639+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:51:31.821639+0000","last_undegraded":"2024-09-19T09:51:31.821639+0000","last_fullsized":"2024-09-19T09:51:31.821639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818907+0000","last_change":"2024-09-19T09:51:31.818907+0000","last_active":"2024-09-19T09:51:31.818907+0000","last_peered":"2024-09-19T09:51:31.818907+0000","last_clean":"2024-09-19T09:51:31.818907+0000","last_became_active":"2024-09-19T09:51:31.818522+0000","last_became_peered":"2024-09-19T09:51:31.818522+0000","last_unstale":"2024-09-19T09:51:31.818907+0000","last_undegraded":"2024-09-19T09:51:31.818907+0000","last_fullsized":"2024-09-19T09:51:31.818907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:04.062704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414658+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:51:32.414658+0000","last_peered":"2024-09-19T09:51:32.414658+0000","last_clean":"2024-09-19T09:51:32.414658+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:51:32.414658+0000","last_undegraded":"2024-09-19T09:51:32.414658+0000","last_fullsized":"2024-09-19T09:51:32.414658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823102+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:51:31.823102+0000","last_peered":"2024-09-19T09:51:31.823102+0000","last_clean":"2024-09-19T09:51:31.823102+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:51:31.823102+0000","last_undegraded":"2024-09-19T09:51:31.823102+0000","last_fullsized":"2024-09-19T09:51:31.823102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.965021+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:51:32.965021+0000","last_peered":"2024-09-19T09:51:32.965021+0000","last_clean":"2024-09-19T09:51:32.965021+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:51:32.965021+0000","last_undegraded":"2024-09-19T09:51:32.965021+0000","last_fullsized":"2024-09-19T09:51:32.965021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816435+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:51:31.816435+0000","last_peered":"2024-09-19T09:51:31.816435+0000","last_clean":"2024-09-19T09:51:31.816435+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:51:31.816435+0000","last_undegraded":"2024-09-19T09:51:31.816435+0000","last_fullsized":"2024-09-19T09:51:31.816435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415084+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:51:32.415084+0000","last_peered":"2024-09-19T09:51:32.415084+0000","last_clean":"2024-09-19T09:51:32.415084+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:51:32.415084+0000","last_undegraded":"2024-09-19T09:51:32.415084+0000","last_fullsized":"2024-09-19T09:51:32.415084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170120+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:51:32.170120+0000","last_peered":"2024-09-19T09:51:32.170120+0000","last_clean":"2024-09-19T09:51:32.170120+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:51:32.170120+0000","last_undegraded":"2024-09-19T09:51:32.170120+0000","last_fullsized":"2024-09-19T09:51:32.170120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818910+0000","last_change":"2024-09-19T09:51:31.818910+0000","last_active":"2024-09-19T09:51:31.818910+0000","last_peered":"2024-09-19T09:51:31.818910+0000","last_clean":"2024-09-19T09:51:31.818910+0000","last_became_active":"2024-09-19T09:51:31.818581+0000","last_became_peered":"2024-09-19T09:51:31.818581+0000","last_unstale":"2024-09-19T09:51:31.818910+0000","last_undegraded":"2024-09-19T09:51:31.818910+0000","last_fullsized":"2024-09-19T09:51:31.818910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.736835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822148+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:51:31.822148+0000","last_peered":"2024-09-19T09:51:31.822148+0000","last_clean":"2024-09-19T09:51:31.822148+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:51:31.822148+0000","last_undegraded":"2024-09-19T09:51:31.822148+0000","last_fullsized":"2024-09-19T09:51:31.822148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821822+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:51:31.821822+0000","last_peered":"2024-09-19T09:51:31.821822+0000","last_clean":"2024-09-19T09:51:31.821822+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:51:31.821822+0000","last_undegraded":"2024-09-19T09:51:31.821822+0000","last_fullsized":"2024-09-19T09:51:31.821822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964443+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:51:32.964443+0000","last_peered":"2024-09-19T09:51:32.964443+0000","last_clean":"2024-09-19T09:51:32.964443+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:51:32.964443+0000","last_undegraded":"2024-09-19T09:51:32.964443+0000","last_fullsized":"2024-09-19T09:51:32.964443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.819209+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:51:31.819209+0000","last_peered":"2024-09-19T09:51:31.819209+0000","last_clean":"2024-09-19T09:51:31.819209+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:51:31.819209+0000","last_undegraded":"2024-09-19T09:51:31.819209+0000","last_fullsized":"2024-09-19T09:51:31.819209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817865+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:51:31.817865+0000","last_peered":"2024-09-19T09:51:31.817865+0000","last_clean":"2024-09-19T09:51:31.817865+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:51:31.817865+0000","last_undegraded":"2024-09-19T09:51:31.817865+0000","last_fullsized":"2024-09-19T09:51:31.817865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822743+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:51:31.822743+0000","last_peered":"2024-09-19T09:51:31.822743+0000","last_clean":"2024-09-19T09:51:31.822743+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:51:31.822743+0000","last_undegraded":"2024-09-19T09:51:31.822743+0000","last_fullsized":"2024-09-19T09:51:31.822743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823803+0000","last_change":"2024-09-19T09:51:31.823803+0000","last_active":"2024-09-19T09:51:31.823803+0000","last_peered":"2024-09-19T09:51:31.823803+0000","last_clean":"2024-09-19T09:51:31.823803+0000","last_became_active":"2024-09-19T09:51:31.823361+0000","last_became_peered":"2024-09-19T09:51:31.823361+0000","last_unstale":"2024-09-19T09:51:31.823803+0000","last_undegraded":"2024-09-19T09:51:31.823803+0000","last_fullsized":"2024-09-19T09:51:31.823803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:33.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814751+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:51:31.814751+0000","last_peered":"2024-09-19T09:51:31.814751+0000","last_clean":"2024-09-19T09:51:31.814751+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:51:31.814751+0000","last_undegraded":"2024-09-19T09:51:31.814751+0000","last_fullsized":"2024-09-19T09:51:31.814751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964645+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:51:32.964645+0000","last_peered":"2024-09-19T09:51:32.964645+0000","last_clean":"2024-09-19T09:51:32.964645+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:51:32.964645+0000","last_undegraded":"2024-09-19T09:51:32.964645+0000","last_fullsized":"2024-09-19T09:51:32.964645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823164+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:51:31.823164+0000","last_peered":"2024-09-19T09:51:31.823164+0000","last_clean":"2024-09-19T09:51:31.823164+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:51:31.823164+0000","last_undegraded":"2024-09-19T09:51:31.823164+0000","last_fullsized":"2024-09-19T09:51:31.823164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815405+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:51:31.815405+0000","last_peered":"2024-09-19T09:51:31.815405+0000","last_clean":"2024-09-19T09:51:31.815405+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:51:31.815405+0000","last_undegraded":"2024-09-19T09:51:31.815405+0000","last_fullsized":"2024-09-19T09:51:31.815405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823588+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:51:31.823588+0000","last_peered":"2024-09-19T09:51:31.823588+0000","last_clean":"2024-09-19T09:51:31.823588+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:51:31.823588+0000","last_undegraded":"2024-09-19T09:51:31.823588+0000","last_fullsized":"2024-09-19T09:51:31.823588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822114+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:51:31.822114+0000","last_peered":"2024-09-19T09:51:31.822114+0000","last_clean":"2024-09-19T09:51:31.822114+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:51:31.822114+0000","last_undegraded":"2024-09-19T09:51:31.822114+0000","last_fullsized":"2024-09-19T09:51:31.822114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818315+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:51:31.818315+0000","last_peered":"2024-09-19T09:51:31.818315+0000","last_clean":"2024-09-19T09:51:31.818315+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:51:31.818315+0000","last_undegraded":"2024-09-19T09:51:31.818315+0000","last_fullsized":"2024-09-19T09:51:31.818315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814663+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:51:31.814663+0000","last_peered":"2024-09-19T09:51:31.814663+0000","last_clean":"2024-09-19T09:51:31.814663+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:51:31.814663+0000","last_undegraded":"2024-09-19T09:51:31.814663+0000","last_fullsized":"2024-09-19T09:51:31.814663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822090+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:51:31.822090+0000","last_peered":"2024-09-19T09:51:31.822090+0000","last_clean":"2024-09-19T09:51:31.822090+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:51:31.822090+0000","last_undegraded":"2024-09-19T09:51:31.822090+0000","last_fullsized":"2024-09-19T09:51:31.822090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822590+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:51:31.822590+0000","last_peered":"2024-09-19T09:51:31.822590+0000","last_clean":"2024-09-19T09:51:31.822590+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:51:31.822590+0000","last_undegraded":"2024-09-19T09:51:31.822590+0000","last_fullsized":"2024-09-19T09:51:31.822590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821965+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:51:31.821965+0000","last_peered":"2024-09-19T09:51:31.821965+0000","last_clean":"2024-09-19T09:51:31.821965+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:51:31.821965+0000","last_undegraded":"2024-09-19T09:51:31.821965+0000","last_fullsized":"2024-09-19T09:51:31.821965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817953+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:51:31.817953+0000","last_peered":"2024-09-19T09:51:31.817953+0000","last_clean":"2024-09-19T09:51:31.817953+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:51:31.817953+0000","last_undegraded":"2024-09-19T09:51:31.817953+0000","last_fullsized":"2024-09-19T09:51:31.817953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822282+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:51:31.822282+0000","last_peered":"2024-09-19T09:51:31.822282+0000","last_clean":"2024-09-19T09:51:31.822282+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:51:31.822282+0000","last_undegraded":"2024-09-19T09:51:31.822282+0000","last_fullsized":"2024-09-19T09:51:31.822282+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":87,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:36.420756+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:51:36.420756+0000","last_peered":"2024-09-19T09:51:36.420756+0000","last_clean":"2024-09-19T09:51:36.420756+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:51:36.420756+0000","last_undegraded":"2024-09-19T09:51:36.420756+0000","last_fullsized":"2024-09-19T09:51:36.420756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.825618+0000","last_change":"2024-09-19T09:51:31.825618+0000","last_active":"2024-09-19T09:51:31.825618+0000","last_peered":"2024-09-19T09:51:31.825618+0000","last_clean":"2024-09-19T09:51:31.825618+0000","last_became_active":"2024-09-19T09:51:31.824727+0000","last_became_peered":"2024-09-19T09:51:31.824727+0000","last_unstale":"2024-09-19T09:51:31.825618+0000","last_undegraded":"2024-09-19T09:51:31.825618+0000","last_fullsized":"2024-09-19T09:51:31.825618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:52.094074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816210+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:51:31.816210+0000","last_peered":"2024-09-19T09:51:31.816210+0000","last_clean":"2024-09-19T09:51:31.816210+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:51:31.816210+0000","last_undegraded":"2024-09-19T09:51:31.816210+0000","last_fullsized":"2024-09-19T09:51:31.816210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814498+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:51:31.814498+0000","last_peered":"2024-09-19T09:51:31.814498+0000","last_clean":"2024-09-19T09:51:31.814498+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:51:31.814498+0000","last_undegraded":"2024-09-19T09:51:31.814498+0000","last_fullsized":"2024-09-19T09:51:31.814498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823230+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:51:31.823230+0000","last_peered":"2024-09-19T09:51:31.823230+0000","last_clean":"2024-09-19T09:51:31.823230+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:51:31.823230+0000","last_undegraded":"2024-09-19T09:51:31.823230+0000","last_fullsized":"2024-09-19T09:51:31.823230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815599+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:51:31.815599+0000","last_peered":"2024-09-19T09:51:31.815599+0000","last_clean":"2024-09-19T09:51:31.815599+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:51:31.815599+0000","last_undegraded":"2024-09-19T09:51:31.815599+0000","last_fullsized":"2024-09-19T09:51:31.815599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817475+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:51:31.817475+0000","last_peered":"2024-09-19T09:51:31.817475+0000","last_clean":"2024-09-19T09:51:31.817475+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:51:31.817475+0000","last_undegraded":"2024-09-19T09:51:31.817475+0000","last_fullsized":"2024-09-19T09:51:31.817475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:38.423082+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:38.423082+0000","last_peered":"2024-09-19T09:51:38.423082+0000","last_clean":"2024-09-19T09:51:38.423082+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:51:38.423082+0000","last_undegraded":"2024-09-19T09:51:38.423082+0000","last_fullsized":"2024-09-19T09:51:38.423082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964896+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:51:32.964896+0000","last_peered":"2024-09-19T09:51:32.964896+0000","last_clean":"2024-09-19T09:51:32.964896+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:51:32.964896+0000","last_undegraded":"2024-09-19T09:51:32.964896+0000","last_fullsized":"2024-09-19T09:51:32.964896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415018+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:51:32.415018+0000","last_peered":"2024-09-19T09:51:32.415018+0000","last_clean":"2024-09-19T09:51:32.415018+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:51:32.415018+0000","last_undegraded":"2024-09-19T09:51:32.415018+0000","last_fullsized":"2024-09-19T09:51:32.415018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822777+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:51:31.822777+0000","last_peered":"2024-09-19T09:51:31.822777+0000","last_clean":"2024-09-19T09:51:31.822777+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:51:31.822777+0000","last_undegraded":"2024-09-19T09:51:31.822777+0000","last_fullsized":"2024-09-19T09:51:31.822777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815716+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:51:31.815716+0000","last_peered":"2024-09-19T09:51:31.815716+0000","last_clean":"2024-09-19T09:51:31.815716+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:51:31.815716+0000","last_undegraded":"2024-09-19T09:51:31.815716+0000","last_fullsized":"2024-09-19T09:51:31.815716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964623+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:51:32.964623+0000","last_peered":"2024-09-19T09:51:32.964623+0000","last_clean":"2024-09-19T09:51:32.964623+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:51:32.964623+0000","last_undegraded":"2024-09-19T09:51:32.964623+0000","last_fullsized":"2024-09-19T09:51:32.964623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":178,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:38.423080+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:51:38.423080+0000","last_peered":"2024-09-19T09:51:38.423080+0000","last_clean":"2024-09-19T09:51:38.423080+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:51:38.423080+0000","last_undegraded":"2024-09-19T09:51:38.423080+0000","last_fullsized":"2024-09-19T09:51:38.423080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60619,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822830+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:51:31.822830+0000","last_peered":"2024-09-19T09:51:31.822830+0000","last_clean":"2024-09-19T09:51:31.822830+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:51:31.822830+0000","last_undegraded":"2024-09-19T09:51:31.822830+0000","last_fullsized":"2024-09-19T09:51:31.822830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821655+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:51:31.821655+0000","last_peered":"2024-09-19T09:51:31.821655+0000","last_clean":"2024-09-19T09:51:31.821655+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:51:31.821655+0000","last_undegraded":"2024-09-19T09:51:31.821655+0000","last_fullsized":"2024-09-19T09:51:31.821655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814554+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:51:31.814554+0000","last_peered":"2024-09-19T09:51:31.814554+0000","last_clean":"2024-09-19T09:51:31.814554+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:51:31.814554+0000","last_undegraded":"2024-09-19T09:51:31.814554+0000","last_fullsized":"2024-09-19T09:51:31.814554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815497+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:31.815497+0000","last_peered":"2024-09-19T09:51:31.815497+0000","last_clean":"2024-09-19T09:51:31.815497+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:51:31.815497+0000","last_undegraded":"2024-09-19T09:51:31.815497+0000","last_fullsized":"2024-09-19T09:51:31.815497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415126+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:51:32.415126+0000","last_peered":"2024-09-19T09:51:32.415126+0000","last_clean":"2024-09-19T09:51:32.415126+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:51:32.415126+0000","last_undegraded":"2024-09-19T09:51:32.415126+0000","last_fullsized":"2024-09-19T09:51:32.415126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":90,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:37.418982+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:51:37.418982+0000","last_peered":"2024-09-19T09:51:37.418982+0000","last_clean":"2024-09-19T09:51:37.418982+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:51:37.418982+0000","last_undegraded":"2024-09-19T09:51:37.418982+0000","last_fullsized":"2024-09-19T09:51:37.418982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414551+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:51:32.414551+0000","last_peered":"2024-09-19T09:51:32.414551+0000","last_clean":"2024-09-19T09:51:32.414551+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:51:32.414551+0000","last_undegraded":"2024-09-19T09:51:32.414551+0000","last_fullsized":"2024-09-19T09:51:32.414551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821556+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:51:31.821556+0000","last_peered":"2024-09-19T09:51:31.821556+0000","last_clean":"2024-09-19T09:51:31.821556+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:51:31.821556+0000","last_undegraded":"2024-09-19T09:51:31.821556+0000","last_fullsized":"2024-09-19T09:51:31.821556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815462+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:51:31.815462+0000","last_peered":"2024-09-19T09:51:31.815462+0000","last_clean":"2024-09-19T09:51:31.815462+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:51:31.815462+0000","last_undegraded":"2024-09-19T09:51:31.815462+0000","last_fullsized":"2024-09-19T09:51:31.815462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822495+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:51:31.822495+0000","last_peered":"2024-09-19T09:51:31.822495+0000","last_clean":"2024-09-19T09:51:31.822495+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:51:31.822495+0000","last_undegraded":"2024-09-19T09:51:31.822495+0000","last_fullsized":"2024-09-19T09:51:31.822495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818407+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:51:31.818407+0000","last_peered":"2024-09-19T09:51:31.818407+0000","last_clean":"2024-09-19T09:51:31.818407+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:51:31.818407+0000","last_undegraded":"2024-09-19T09:51:31.818407+0000","last_fullsized":"2024-09-19T09:51:31.818407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814756+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:51:31.814756+0000","last_peered":"2024-09-19T09:51:31.814756+0000","last_clean":"2024-09-19T09:51:31.814756+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:51:31.814756+0000","last_undegraded":"2024-09-19T09:51:31.814756+0000","last_fullsized":"2024-09-19T09:51:31.814756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415283+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:51:32.415283+0000","last_peered":"2024-09-19T09:51:32.415283+0000","last_clean":"2024-09-19T09:51:32.415283+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:51:32.415283+0000","last_undegraded":"2024-09-19T09:51:32.415283+0000","last_fullsized":"2024-09-19T09:51:32.415283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815831+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:51:31.815831+0000","last_peered":"2024-09-19T09:51:31.815831+0000","last_clean":"2024-09-19T09:51:31.815831+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:51:31.815831+0000","last_undegraded":"2024-09-19T09:51:31.815831+0000","last_fullsized":"2024-09-19T09:51:31.815831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414880+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:51:32.414880+0000","last_peered":"2024-09-19T09:51:32.414880+0000","last_clean":"2024-09-19T09:51:32.414880+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:51:32.414880+0000","last_undegraded":"2024-09-19T09:51:32.414880+0000","last_fullsized":"2024-09-19T09:51:32.414880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":86,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:35.419273+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:51:35.419273+0000","last_peered":"2024-09-19T09:51:35.419273+0000","last_clean":"2024-09-19T09:51:35.419273+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:51:35.419273+0000","last_undegraded":"2024-09-19T09:51:35.419273+0000","last_fullsized":"2024-09-19T09:51:35.419273+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":59,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415176+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:51:32.415176+0000","last_peered":"2024-09-19T09:51:32.415176+0000","last_clean":"2024-09-19T09:51:32.415176+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:51:32.415176+0000","last_undegraded":"2024-09-19T09:51:32.415176+0000","last_fullsized":"2024-09-19T09:51:32.415176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414710+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:51:32.414710+0000","last_peered":"2024-09-19T09:51:32.414710+0000","last_clean":"2024-09-19T09:51:32.414710+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:51:32.414710+0000","last_undegraded":"2024-09-19T09:51:32.414710+0000","last_fullsized":"2024-09-19T09:51:32.414710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.169977+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:51:32.169977+0000","last_peered":"2024-09-19T09:51:32.169977+0000","last_clean":"2024-09-19T09:51:32.169977+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:51:32.169977+0000","last_undegraded":"2024-09-19T09:51:32.169977+0000","last_fullsized":"2024-09-19T09:51:32.169977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824825+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:51:31.824825+0000","last_peered":"2024-09-19T09:51:31.824825+0000","last_clean":"2024-09-19T09:51:31.824825+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:51:31.824825+0000","last_undegraded":"2024-09-19T09:51:31.824825+0000","last_fullsized":"2024-09-19T09:51:31.824825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414691+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:51:32.414691+0000","last_peered":"2024-09-19T09:51:32.414691+0000","last_clean":"2024-09-19T09:51:32.414691+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:51:32.414691+0000","last_undegraded":"2024-09-19T09:51:32.414691+0000","last_fullsized":"2024-09-19T09:51:32.414691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814496+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:51:31.814496+0000","last_peered":"2024-09-19T09:51:31.814496+0000","last_clean":"2024-09-19T09:51:31.814496+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:51:31.814496+0000","last_undegraded":"2024-09-19T09:51:31.814496+0000","last_fullsized":"2024-09-19T09:51:31.814496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":87,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:37.418410+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:51:37.418410+0000","last_peered":"2024-09-19T09:51:37.418410+0000","last_clean":"2024-09-19T09:51:37.418410+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:51:37.418410+0000","last_undegraded":"2024-09-19T09:51:37.418410+0000","last_fullsized":"2024-09-19T09:51:37.418410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815467+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:51:31.815467+0000","last_peered":"2024-09-19T09:51:31.815467+0000","last_clean":"2024-09-19T09:51:31.815467+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:51:31.815467+0000","last_undegraded":"2024-09-19T09:51:31.815467+0000","last_fullsized":"2024-09-19T09:51:31.815467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":88,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:37.420371+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:51:37.420371+0000","last_peered":"2024-09-19T09:51:37.420371+0000","last_clean":"2024-09-19T09:51:37.420371+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:51:37.420371+0000","last_undegraded":"2024-09-19T09:51:37.420371+0000","last_fullsized":"2024-09-19T09:51:37.420371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815856+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:51:31.815856+0000","last_peered":"2024-09-19T09:51:31.815856+0000","last_clean":"2024-09-19T09:51:31.815856+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:51:31.815856+0000","last_undegraded":"2024-09-19T09:51:31.815856+0000","last_fullsized":"2024-09-19T09:51:31.815856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824076+0000","last_change":"2024-09-19T09:51:31.824076+0000","last_active":"2024-09-19T09:51:31.824076+0000","last_peered":"2024-09-19T09:51:31.824076+0000","last_clean":"2024-09-19T09:51:31.824076+0000","last_became_active":"2024-09-19T09:51:31.823642+0000","last_became_peered":"2024-09-19T09:51:31.823642+0000","last_unstale":"2024-09-19T09:51:31.824076+0000","last_undegraded":"2024-09-19T09:51:31.824076+0000","last_fullsized":"2024-09-19T09:51:31.824076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:53.035531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815803+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:51:31.815803+0000","last_peered":"2024-09-19T09:51:31.815803+0000","last_clean":"2024-09-19T09:51:31.815803+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:51:31.815803+0000","last_undegraded":"2024-09-19T09:51:31.815803+0000","last_fullsized":"2024-09-19T09:51:31.815803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822947+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:51:31.822947+0000","last_peered":"2024-09-19T09:51:31.822947+0000","last_clean":"2024-09-19T09:51:31.822947+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:51:31.822947+0000","last_undegraded":"2024-09-19T09:51:31.822947+0000","last_fullsized":"2024-09-19T09:51:31.822947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814777+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:51:31.814777+0000","last_peered":"2024-09-19T09:51:31.814777+0000","last_clean":"2024-09-19T09:51:31.814777+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:51:31.814777+0000","last_undegraded":"2024-09-19T09:51:31.814777+0000","last_fullsized":"2024-09-19T09:51:31.814777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817943+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:51:31.817943+0000","last_peered":"2024-09-19T09:51:31.817943+0000","last_clean":"2024-09-19T09:51:31.817943+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:51:31.817943+0000","last_undegraded":"2024-09-19T09:51:31.817943+0000","last_fullsized":"2024-09-19T09:51:31.817943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823704+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:51:31.823704+0000","last_peered":"2024-09-19T09:51:31.823704+0000","last_clean":"2024-09-19T09:51:31.823704+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:51:31.823704+0000","last_undegraded":"2024-09-19T09:51:31.823704+0000","last_fullsized":"2024-09-19T09:51:31.823704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170286+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:51:32.170286+0000","last_peered":"2024-09-19T09:51:32.170286+0000","last_clean":"2024-09-19T09:51:32.170286+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:51:32.170286+0000","last_undegraded":"2024-09-19T09:51:32.170286+0000","last_fullsized":"2024-09-19T09:51:32.170286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821979+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:51:31.821979+0000","last_peered":"2024-09-19T09:51:31.821979+0000","last_clean":"2024-09-19T09:51:31.821979+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:51:31.821979+0000","last_undegraded":"2024-09-19T09:51:31.821979+0000","last_fullsized":"2024-09-19T09:51:31.821979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964590+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:51:32.964590+0000","last_peered":"2024-09-19T09:51:32.964590+0000","last_clean":"2024-09-19T09:51:32.964590+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:51:32.964590+0000","last_undegraded":"2024-09-19T09:51:32.964590+0000","last_fullsized":"2024-09-19T09:51:32.964590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821712+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:51:31.821712+0000","last_peered":"2024-09-19T09:51:31.821712+0000","last_clean":"2024-09-19T09:51:31.821712+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:51:31.821712+0000","last_undegraded":"2024-09-19T09:51:31.821712+0000","last_fullsized":"2024-09-19T09:51:31.821712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823345+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:51:31.823345+0000","last_peered":"2024-09-19T09:51:31.823345+0000","last_clean":"2024-09-19T09:51:31.823345+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:51:31.823345+0000","last_undegraded":"2024-09-19T09:51:31.823345+0000","last_fullsized":"2024-09-19T09:51:31.823345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.818062+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:51:31.818062+0000","last_peered":"2024-09-19T09:51:31.818062+0000","last_clean":"2024-09-19T09:51:31.818062+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:51:31.818062+0000","last_undegraded":"2024-09-19T09:51:31.818062+0000","last_fullsized":"2024-09-19T09:51:31.818062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.830511+0000","last_change":"2024-09-19T09:51:31.830511+0000","last_active":"2024-09-19T09:51:31.830511+0000","last_peered":"2024-09-19T09:51:31.830511+0000","last_clean":"2024-09-19T09:51:31.830511+0000","last_became_active":"2024-09-19T09:51:31.825672+0000","last_became_peered":"2024-09-19T09:51:31.825672+0000","last_unstale":"2024-09-19T09:51:31.830511+0000","last_undegraded":"2024-09-19T09:51:31.830511+0000","last_fullsized":"2024-09-19T09:51:31.830511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.101027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823448+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:51:31.823448+0000","last_peered":"2024-09-19T09:51:31.823448+0000","last_clean":"2024-09-19T09:51:31.823448+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:51:31.823448+0000","last_undegraded":"2024-09-19T09:51:31.823448+0000","last_fullsized":"2024-09-19T09:51:31.823448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821791+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:51:31.821791+0000","last_peered":"2024-09-19T09:51:31.821791+0000","last_clean":"2024-09-19T09:51:31.821791+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:51:31.821791+0000","last_undegraded":"2024-09-19T09:51:31.821791+0000","last_fullsized":"2024-09-19T09:51:31.821791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414846+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:51:32.414846+0000","last_peered":"2024-09-19T09:51:32.414846+0000","last_clean":"2024-09-19T09:51:32.414846+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:51:32.414846+0000","last_undegraded":"2024-09-19T09:51:32.414846+0000","last_fullsized":"2024-09-19T09:51:32.414846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815694+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:51:31.815694+0000","last_peered":"2024-09-19T09:51:31.815694+0000","last_clean":"2024-09-19T09:51:31.815694+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:51:31.815694+0000","last_undegraded":"2024-09-19T09:51:31.815694+0000","last_fullsized":"2024-09-19T09:51:31.815694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822749+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:51:31.822749+0000","last_peered":"2024-09-19T09:51:31.822749+0000","last_clean":"2024-09-19T09:51:31.822749+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:51:31.822749+0000","last_undegraded":"2024-09-19T09:51:31.822749+0000","last_fullsized":"2024-09-19T09:51:31.822749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964620+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:51:32.964620+0000","last_peered":"2024-09-19T09:51:32.964620+0000","last_clean":"2024-09-19T09:51:32.964620+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:51:32.964620+0000","last_undegraded":"2024-09-19T09:51:32.964620+0000","last_fullsized":"2024-09-19T09:51:32.964620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822889+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:51:31.822889+0000","last_peered":"2024-09-19T09:51:31.822889+0000","last_clean":"2024-09-19T09:51:31.822889+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:51:31.822889+0000","last_undegraded":"2024-09-19T09:51:31.822889+0000","last_fullsized":"2024-09-19T09:51:31.822889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822677+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:51:31.822677+0000","last_peered":"2024-09-19T09:51:31.822677+0000","last_clean":"2024-09-19T09:51:31.822677+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:51:31.822677+0000","last_undegraded":"2024-09-19T09:51:31.822677+0000","last_fullsized":"2024-09-19T09:51:31.822677+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823942+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:51:31.823942+0000","last_peered":"2024-09-19T09:51:31.823942+0000","last_clean":"2024-09-19T09:51:31.823942+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:51:31.823942+0000","last_undegraded":"2024-09-19T09:51:31.823942+0000","last_fullsized":"2024-09-19T09:51:31.823942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.825269+0000","last_change":"2024-09-19T09:51:31.824910+0000","last_active":"2024-09-19T09:51:31.825269+0000","last_peered":"2024-09-19T09:51:31.825269+0000","last_clean":"2024-09-19T09:51:31.825269+0000","last_became_active":"2024-09-19T09:51:31.824521+0000","last_became_peered":"2024-09-19T09:51:31.824521+0000","last_unstale":"2024-09-19T09:51:31.825269+0000","last_undegraded":"2024-09-19T09:51:31.825269+0000","last_fullsized":"2024-09-19T09:51:31.825269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:43.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":95,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:38.420928+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:51:38.420928+0000","last_peered":"2024-09-19T09:51:38.420928+0000","last_clean":"2024-09-19T09:51:38.420928+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:51:38.420928+0000","last_undegraded":"2024-09-19T09:51:38.420928+0000","last_fullsized":"2024-09-19T09:51:38.420928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67827,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":626,"num_read_kb":390,"num_write":242,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":203481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":442788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743456,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1617920,"data_stored":1094829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906982,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":442718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":443096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364847,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36848,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708304,"statfs":{"total":95995035648,"available":95957303296,"internally_reserved":0,"allocated":1536000,"data_stored":1036009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528373,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40416,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704736,"statfs":{"total":95995035648,"available":95953649664,"internally_reserved":0,"allocated":925696,"data_stored":442828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790009,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32704,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712448,"statfs":{"total":95995035648,"available":95961546752,"internally_reserved":0,"allocated":1548288,"data_stored":1034901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953535,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":925696,"data_stored":442689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":442260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1007616,"data_stored":504187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40472,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704680,"statfs":{"total":95995035648,"available":95953592320,"internally_reserved":0,"allocated":987136,"data_stored":504360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":946176,"data_stored":443774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:51:43.070 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:51:43.070 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T09:51:43.071 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T09:51:43.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T09:51:43.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:42 smithi049 ceph-mon[34858]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:43.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:42 smithi162 ceph-mon[35174]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:51:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:43.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.809+0000 7fbda1224640 1 -- 172.21.15.18:0/1287120352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd9c100370 msgr2=0x7fbd9c100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.809+0000 7fbda1224640 1 --2- 172.21.15.18:0/1287120352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd9c100370 0x7fbd9c100750 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009cd0 tx=0x7fbd8c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.809+0000 7fbda1224640 1 -- 172.21.15.18:0/1287120352 shutdown_connections 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.809+0000 7fbda1224640 1 --2- 172.21.15.18:0/1287120352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c106fc0 0x7fbd9c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.809+0000 7fbda1224640 1 --2- 172.21.15.18:0/1287120352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd9c100d20 0x7fbd9c106860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.809+0000 7fbda1224640 1 --2- 172.21.15.18:0/1287120352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd9c100370 0x7fbd9c100750 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.809+0000 7fbda1224640 1 -- 172.21.15.18:0/1287120352 >> 172.21.15.18:0/1287120352 conn(0x7fbd9c077210 msgr2=0x7fbd9c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.809+0000 7fbda1224640 1 -- 172.21.15.18:0/1287120352 shutdown_connections 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.809+0000 7fbda1224640 1 -- 172.21.15.18:0/1287120352 wait complete. 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.809+0000 7fbda1224640 1 Processor -- start 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbda1224640 1 -- start start 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbda1224640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd9c100370 0x7fbd9c1012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbda1224640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c100d20 0x7fbd9c101830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbda1224640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd9c106fc0 0x7fbd9c101d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbda1224640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c111fe0 con 0x7fbd9c100370 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbda1224640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c111e60 con 0x7fbd9c106fc0 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbda1224640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c112160 con 0x7fbd9c100d20 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd9c100370 0x7fbd9c1012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd9c100370 0x7fbd9c1012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57350/0 (socket says 172.21.15.18:57350) 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9ad9d640 1 -- 172.21.15.18:0/3743305920 learned_addr learned my addr 172.21.15.18:0/3743305920 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9b59e640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd9c106fc0 0x7fbd9c101d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9a59c640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c100d20 0x7fbd9c101830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9ad9d640 1 -- 172.21.15.18:0/3743305920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c100d20 msgr2=0x7fbd9c101830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9ad9d640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c100d20 0x7fbd9c101830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9ad9d640 1 -- 172.21.15.18:0/3743305920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd9c106fc0 msgr2=0x7fbd9c101d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9ad9d640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd9c106fc0 0x7fbd9c101d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9ad9d640 1 -- 172.21.15.18:0/3743305920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c1a6940 con 0x7fbd9c100370 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9a59c640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c100d20 0x7fbd9c101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.810+0000 7fbd9ad9d640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd9c100370 0x7fbd9c1012f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c02ae00 tx=0x7fbd8c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.811+0000 7fbd83fff640 1 -- 172.21.15.18:0/3743305920 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c004040 con 0x7fbd9c100370 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.811+0000 7fbd83fff640 1 -- 172.21.15.18:0/3743305920 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd8c0046c0 con 0x7fbd9c100370 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.811+0000 7fbd83fff640 1 -- 172.21.15.18:0/3743305920 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c046480 con 0x7fbd9c100370 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.811+0000 7fbda1224640 1 -- 172.21.15.18:0/3743305920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9c1a6bd0 con 0x7fbd9c100370 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.811+0000 7fbda1224640 1 -- 172.21.15.18:0/3743305920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9c1a70c0 con 0x7fbd9c100370 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.812+0000 7fbda1224640 1 -- 172.21.15.18:0/3743305920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd9c100750 con 0x7fbd9c100370 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.813+0000 7fbd83fff640 1 -- 172.21.15.18:0/3743305920 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbd8c0305a0 con 0x7fbd9c100370 2024-09-19T09:51:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.814+0000 7fbd83fff640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbd840a3350 0x7fbd840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:43.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.814+0000 7fbd9a59c640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbd840a3350 0x7fbd840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:43.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.814+0000 7fbd83fff640 1 -- 172.21.15.18:0/3743305920 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbd8c02e030 con 0x7fbd9c100370 2024-09-19T09:51:43.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.814+0000 7fbd9a59c640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbd840a3350 0x7fbd840a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd90005d00 tx=0x7fbd90009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:43.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:43.818+0000 7fbd83fff640 1 -- 172.21.15.18:0/3743305920 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd8c04b060 con 0x7fbd9c100370 2024-09-19T09:51:44.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.037+0000 7fbda1224640 1 -- 172.21.15.18:0/3743305920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbd9c02d7c0 con 0x7fbd9c100370 2024-09-19T09:51:44.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:43 smithi018 ceph-mon[30956]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:44.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.037+0000 7fbd83fff640 1 -- 172.21.15.18:0/3743305920 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbd8c030890 con 0x7fbd9c100370 2024-09-19T09:51:44.040 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:44.040 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T09:51:44.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 -- 172.21.15.18:0/3743305920 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbd840a3350 msgr2=0x7fbd840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:44.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbd840a3350 0x7fbd840a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd90005d00 tx=0x7fbd90009550 comp rx=0 tx=0).stop 2024-09-19T09:51:44.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 -- 172.21.15.18:0/3743305920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd9c100370 msgr2=0x7fbd9c1012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:44.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd9c100370 0x7fbd9c1012f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c02ae00 tx=0x7fbd8c003970 comp rx=0 tx=0).stop 2024-09-19T09:51:44.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 -- 172.21.15.18:0/3743305920 shutdown_connections 2024-09-19T09:51:44.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbd840a3350 0x7fbd840a5810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd9c106fc0 0x7fbd9c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c100d20 0x7fbd9c101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 --2- 172.21.15.18:0/3743305920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd9c100370 0x7fbd9c1012f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:44.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 -- 172.21.15.18:0/3743305920 >> 172.21.15.18:0/3743305920 conn(0x7fbd9c077210 msgr2=0x7fbd9c0fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:44.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 -- 172.21.15.18:0/3743305920 shutdown_connections 2024-09-19T09:51:44.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:44.039+0000 7fbda1224640 1 -- 172.21.15.18:0/3743305920 wait complete. 2024-09-19T09:51:44.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:43 smithi049 ceph-mon[34858]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:44.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:43 smithi162 ceph-mon[35174]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:44.664 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T09:51:44.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:51:44.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:44 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3743305920' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:51:44.922 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:45.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:44 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3743305920' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:51:45.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:44 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3743305920' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:51:45.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.358+0000 7f9b5d51e640 1 -- 172.21.15.18:0/60258976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b58106f10 msgr2=0x7f9b5810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:45.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.358+0000 7f9b5d51e640 1 --2- 172.21.15.18:0/60258976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b58106f10 0x7f9b5810ea90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009ca0 tx=0x7f9b5002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:51:45.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.358+0000 7f9b5d51e640 1 -- 172.21.15.18:0/60258976 shutdown_connections 2024-09-19T09:51:45.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.358+0000 7f9b5d51e640 1 --2- 172.21.15.18:0/60258976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b58106f10 0x7f9b5810ea90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:45.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.358+0000 7f9b5d51e640 1 --2- 172.21.15.18:0/60258976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b58102790 0x7f9b581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:45.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.358+0000 7f9b5d51e640 1 --2- 172.21.15.18:0/60258976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b58101de0 0x7f9b581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:45.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.358+0000 7f9b5d51e640 1 -- 172.21.15.18:0/60258976 >> 172.21.15.18:0/60258976 conn(0x7f9b580fd8c0 msgr2=0x7f9b580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:45.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.358+0000 7f9b5d51e640 1 -- 172.21.15.18:0/60258976 shutdown_connections 2024-09-19T09:51:45.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.358+0000 7f9b5d51e640 1 -- 172.21.15.18:0/60258976 wait complete. 2024-09-19T09:51:45.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.359+0000 7f9b5d51e640 1 Processor -- start 2024-09-19T09:51:45.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.359+0000 7f9b5d51e640 1 -- start start 2024-09-19T09:51:45.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.359+0000 7f9b5d51e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b58101de0 0x7f9b581983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:45.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.359+0000 7f9b5d51e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b58102790 0x7f9b58198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:45.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.359+0000 7f9b5d51e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b58106f10 0x7f9b5819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:45.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.359+0000 7f9b5d51e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b58111f70 con 0x7f9b58102790 2024-09-19T09:51:45.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.359+0000 7f9b5d51e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9b58111df0 con 0x7f9b58106f10 2024-09-19T09:51:45.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.359+0000 7f9b5d51e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9b581120f0 con 0x7f9b58101de0 2024-09-19T09:51:45.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b4ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b58102790 0x7f9b58198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:45.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b4ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b58102790 0x7f9b58198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57370/0 (socket says 172.21.15.18:57370) 2024-09-19T09:51:45.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b4ffff640 1 -- 172.21.15.18:0/949168117 learned_addr learned my addr 172.21.15.18:0/949168117 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:45.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b56ffd640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b58101de0 0x7f9b581983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:45.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b577fe640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b58106f10 0x7f9b5819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:45.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b4ffff640 1 -- 172.21.15.18:0/949168117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b58101de0 msgr2=0x7f9b581983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:45.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b4ffff640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b58101de0 0x7f9b581983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:45.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b4ffff640 1 -- 172.21.15.18:0/949168117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b58106f10 msgr2=0x7f9b5819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:45.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b4ffff640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b58106f10 0x7f9b5819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:45.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b4ffff640 1 -- 172.21.15.18:0/949168117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5819d380 con 0x7f9b58102790 2024-09-19T09:51:45.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b56ffd640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b58101de0 0x7f9b581983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:51:45.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b4ffff640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b58102790 0x7f9b58198910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000c890 tx=0x7f9b4000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:45.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b54ff9640 1 -- 172.21.15.18:0/949168117 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40004220 con 0x7f9b58102790 2024-09-19T09:51:45.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b54ff9640 1 -- 172.21.15.18:0/949168117 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b400043c0 con 0x7f9b58102790 2024-09-19T09:51:45.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b54ff9640 1 -- 172.21.15.18:0/949168117 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b400049e0 con 0x7f9b58102790 2024-09-19T09:51:45.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.360+0000 7f9b5d51e640 1 -- 172.21.15.18:0/949168117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b5819d670 con 0x7f9b58102790 2024-09-19T09:51:45.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.361+0000 7f9b5d51e640 1 -- 172.21.15.18:0/949168117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b581a4f50 con 0x7f9b58102790 2024-09-19T09:51:45.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.362+0000 7f9b5d51e640 1 -- 172.21.15.18:0/949168117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b581021c0 con 0x7f9b58102790 2024-09-19T09:51:45.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.363+0000 7f9b54ff9640 1 -- 172.21.15.18:0/949168117 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9b400079b0 con 0x7f9b58102790 2024-09-19T09:51:45.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.364+0000 7f9b54ff9640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9b440a32d0 0x7f9b440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:45.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.364+0000 7f9b56ffd640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9b440a32d0 0x7f9b440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:45.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.364+0000 7f9b54ff9640 1 -- 172.21.15.18:0/949168117 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9b400cf9c0 con 0x7f9b58102790 2024-09-19T09:51:45.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.364+0000 7f9b56ffd640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9b440a32d0 0x7f9b440a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b48005fd0 tx=0x7f9b4800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:45.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.367+0000 7f9b54ff9640 1 -- 172.21.15.18:0/949168117 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9b40014030 con 0x7f9b58102790 2024-09-19T09:51:45.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.580+0000 7f9b5d51e640 1 -- 172.21.15.18:0/949168117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b58199730 con 0x7f9b58102790 2024-09-19T09:51:45.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.580+0000 7f9b54ff9640 1 -- 172.21.15.18:0/949168117 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11954 (secure 0 0 0) 0x7f9b58199730 con 0x7f9b58102790 2024-09-19T09:51:45.582 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:45.583 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"btime":"2024-09-19T09:50:41:339962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:50:41.339939+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[24488,24484,24470,24524,14592]},"id":1}]} 2024-09-19T09:51:45.583 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 -- 172.21.15.18:0/949168117 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9b440a32d0 msgr2=0x7f9b440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9b440a32d0 0x7f9b440a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b48005fd0 tx=0x7f9b4800b390 comp rx=0 tx=0).stop 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 -- 172.21.15.18:0/949168117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b58102790 msgr2=0x7f9b58198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b58102790 0x7f9b58198910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000c890 tx=0x7f9b4000cd50 comp rx=0 tx=0).stop 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 -- 172.21.15.18:0/949168117 shutdown_connections 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9b440a32d0 0x7f9b440a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b58106f10 0x7f9b5819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b58102790 0x7f9b58198910 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 --2- 172.21.15.18:0/949168117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b58101de0 0x7f9b581983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 -- 172.21.15.18:0/949168117 >> 172.21.15.18:0/949168117 conn(0x7f9b580fd8c0 msgr2=0x7f9b580feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 -- 172.21.15.18:0/949168117 shutdown_connections 2024-09-19T09:51:45.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:45.583+0000 7f9b5d51e640 1 -- 172.21.15.18:0/949168117 wait complete. 2024-09-19T09:51:46.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:45 smithi018 ceph-mon[30956]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:46.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:45 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/949168117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:51:46.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:45 smithi049 ceph-mon[34858]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:46.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:45 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/949168117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:51:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:45 smithi162 ceph-mon[35174]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:45 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/949168117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:51:46.179 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:51:46.440 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:46.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.916+0000 7fccacb93640 1 -- 172.21.15.18:0/2210162660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcca8101de0 msgr2=0x7fcca81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:46.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.916+0000 7fccacb93640 1 --2- 172.21.15.18:0/2210162660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcca8101de0 0x7fcca81021c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009900 tx=0x7fcc9802a410 comp rx=0 tx=0).stop 2024-09-19T09:51:46.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.916+0000 7fccacb93640 1 -- 172.21.15.18:0/2210162660 shutdown_connections 2024-09-19T09:51:46.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.916+0000 7fccacb93640 1 --2- 172.21.15.18:0/2210162660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcca8106f10 0x7fcca810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:46.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.916+0000 7fccacb93640 1 --2- 172.21.15.18:0/2210162660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca8102790 0x7fcca81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:46.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.916+0000 7fccacb93640 1 --2- 172.21.15.18:0/2210162660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcca8101de0 0x7fcca81021c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:46.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.916+0000 7fccacb93640 1 -- 172.21.15.18:0/2210162660 >> 172.21.15.18:0/2210162660 conn(0x7fcca80fd8c0 msgr2=0x7fcca80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:46.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.916+0000 7fccacb93640 1 -- 172.21.15.18:0/2210162660 shutdown_connections 2024-09-19T09:51:46.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.916+0000 7fccacb93640 1 -- 172.21.15.18:0/2210162660 wait complete. 2024-09-19T09:51:46.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fccacb93640 1 Processor -- start 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fccacb93640 1 -- start start 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fccacb93640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca8101de0 0x7fcca81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fccacb93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcca8102790 0x7fcca8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fccacb93640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcca8106f10 0x7fcca819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fccacb93640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcca8111f70 con 0x7fcca8102790 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fccacb93640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcca8111df0 con 0x7fcca8106f10 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fccacb93640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcca81120f0 con 0x7fcca8101de0 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fcc9ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcca8102790 0x7fcca8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fcc9ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcca8102790 0x7fcca8198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50896/0 (socket says 172.21.15.18:50896) 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fcc9ffff640 1 -- 172.21.15.18:0/2698696438 learned_addr learned my addr 172.21.15.18:0/2698696438 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fcca659c640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca8101de0 0x7fcca81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:46.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.917+0000 7fcca6d9d640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcca8106f10 0x7fcca819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fcc9ffff640 1 -- 172.21.15.18:0/2698696438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca8101de0 msgr2=0x7fcca81984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fcc9ffff640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca8101de0 0x7fcca81984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fcc9ffff640 1 -- 172.21.15.18:0/2698696438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcca8106f10 msgr2=0x7fcca819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fcc9ffff640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcca8106f10 0x7fcca819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fcc9ffff640 1 -- 172.21.15.18:0/2698696438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca819d480 con 0x7fcca8102790 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fcca6d9d640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcca8106f10 0x7fcca819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fcc9ffff640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcca8102790 0x7fcca8198a10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000c890 tx=0x7fcc9000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fcc9f7fe640 1 -- 172.21.15.18:0/2698696438 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90004220 con 0x7fcca8102790 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fcc9f7fe640 1 -- 172.21.15.18:0/2698696438 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc900043c0 con 0x7fcca8102790 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fccacb93640 1 -- 172.21.15.18:0/2698696438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca819d770 con 0x7fcca8102790 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fcc9f7fe640 1 -- 172.21.15.18:0/2698696438 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc900049e0 con 0x7fcca8102790 2024-09-19T09:51:46.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.918+0000 7fccacb93640 1 -- 172.21.15.18:0/2698696438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca81a5050 con 0x7fcca8102790 2024-09-19T09:51:46.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.919+0000 7fccacb93640 1 -- 172.21.15.18:0/2698696438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca81021c0 con 0x7fcca8102790 2024-09-19T09:51:46.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.920+0000 7fcc9f7fe640 1 -- 172.21.15.18:0/2698696438 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcc900079b0 con 0x7fcca8102790 2024-09-19T09:51:46.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.921+0000 7fcc9f7fe640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc940a32d0 0x7fcc940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:46.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.922+0000 7fcca659c640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc940a32d0 0x7fcc940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:46.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.922+0000 7fcc9f7fe640 1 -- 172.21.15.18:0/2698696438 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcc900cfad0 con 0x7fcca8102790 2024-09-19T09:51:46.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.922+0000 7fcca659c640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc940a32d0 0x7fcc940a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcc98000c00 tx=0x7fcc980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:46.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:46.926+0000 7fcc9f7fe640 1 -- 172.21.15.18:0/2698696438 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcc90014030 con 0x7fcca8102790 2024-09-19T09:51:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.137+0000 7fccacb93640 1 -- 172.21.15.18:0/2698696438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcca8109b60 con 0x7fcca8102790 2024-09-19T09:51:47.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.138+0000 7fcc9f7fe640 1 -- 172.21.15.18:0/2698696438 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11954 (secure 0 0 0) 0x7fcc9009c6c0 con 0x7fcca8102790 2024-09-19T09:51:47.206 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:47.206 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"btime":"2024-09-19T09:50:41:339962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:50:41.339939+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[24488,24484,24470,24524,14592]},"id":1}]} 2024-09-19T09:51:47.206 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 -- 172.21.15.18:0/2698696438 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc940a32d0 msgr2=0x7fcc940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc940a32d0 0x7fcc940a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcc98000c00 tx=0x7fcc980058d0 comp rx=0 tx=0).stop 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 -- 172.21.15.18:0/2698696438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcca8102790 msgr2=0x7fcca8198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcca8102790 0x7fcca8198a10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000c890 tx=0x7fcc9000cd50 comp rx=0 tx=0).stop 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 -- 172.21.15.18:0/2698696438 shutdown_connections 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc940a32d0 0x7fcc940a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcca8106f10 0x7fcca819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcca8102790 0x7fcca8198a10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 --2- 172.21.15.18:0/2698696438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcca8101de0 0x7fcca81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 -- 172.21.15.18:0/2698696438 >> 172.21.15.18:0/2698696438 conn(0x7fcca80fd8c0 msgr2=0x7fcca80fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:47.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 -- 172.21.15.18:0/2698696438 shutdown_connections 2024-09-19T09:51:47.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:47.140+0000 7fccacb93640 1 -- 172.21.15.18:0/2698696438 wait complete. 2024-09-19T09:51:47.735 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:51:47.994 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:48.115 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:47 smithi018 ceph-mon[30956]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:48.115 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:47 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2698696438' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:51:48.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:47 smithi049 ceph-mon[34858]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:48.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:47 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2698696438' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:51:48.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:47 smithi162 ceph-mon[35174]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:51:48.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:47 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2698696438' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:51:48.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.444+0000 7ff72407c640 1 -- 172.21.15.18:0/2469922452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff71c101df0 msgr2=0x7ff71c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:48.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.444+0000 7ff72407c640 1 --2- 172.21.15.18:0/2469922452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff71c101df0 0x7ff71c1021d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff710009900 tx=0x7ff71002a410 comp rx=0 tx=0).stop 2024-09-19T09:51:48.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.444+0000 7ff72407c640 1 -- 172.21.15.18:0/2469922452 shutdown_connections 2024-09-19T09:51:48.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.444+0000 7ff72407c640 1 --2- 172.21.15.18:0/2469922452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff71c106f20 0x7ff71c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.444+0000 7ff72407c640 1 --2- 172.21.15.18:0/2469922452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff71c1027a0 0x7ff71c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.444+0000 7ff72407c640 1 --2- 172.21.15.18:0/2469922452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff71c101df0 0x7ff71c1021d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.444+0000 7ff72407c640 1 -- 172.21.15.18:0/2469922452 >> 172.21.15.18:0/2469922452 conn(0x7ff71c0fd8f0 msgr2=0x7ff71c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.444+0000 7ff72407c640 1 -- 172.21.15.18:0/2469922452 shutdown_connections 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.444+0000 7ff72407c640 1 -- 172.21.15.18:0/2469922452 wait complete. 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.444+0000 7ff72407c640 1 Processor -- start 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff72407c640 1 -- start start 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff72407c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff71c101df0 0x7ff71c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff72407c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff71c1027a0 0x7ff71c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff72407c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff71c106f20 0x7ff71c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff72407c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c111f80 con 0x7ff71c106f20 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff72407c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c111e00 con 0x7ff71c1027a0 2024-09-19T09:51:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff72407c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c112100 con 0x7ff71c101df0 2024-09-19T09:51:48.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff722619640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff71c106f20 0x7ff71c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:48.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff722619640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff71c106f20 0x7ff71c19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50918/0 (socket says 172.21.15.18:50918) 2024-09-19T09:51:48.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff722619640 1 -- 172.21.15.18:0/1385042085 learned_addr learned my addr 172.21.15.18:0/1385042085 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:48.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff721e18640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff71c101df0 0x7ff71c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:48.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff721617640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff71c1027a0 0x7ff71c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:48.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff722619640 1 -- 172.21.15.18:0/1385042085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff71c101df0 msgr2=0x7ff71c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff722619640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff71c101df0 0x7ff71c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff722619640 1 -- 172.21.15.18:0/1385042085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff71c1027a0 msgr2=0x7ff71c198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff722619640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff71c1027a0 0x7ff71c198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff722619640 1 -- 172.21.15.18:0/1385042085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71c19d300 con 0x7ff71c106f20 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.445+0000 7ff722619640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff71c106f20 0x7ff71c19cc20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff71400eaa0 tx=0x7ff71400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.446+0000 7ff70effd640 1 -- 172.21.15.18:0/1385042085 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71400cdb0 con 0x7ff71c106f20 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.446+0000 7ff70effd640 1 -- 172.21.15.18:0/1385042085 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff714005020 con 0x7ff71c106f20 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.446+0000 7ff72407c640 1 -- 172.21.15.18:0/1385042085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71c19d5f0 con 0x7ff71c106f20 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.446+0000 7ff70effd640 1 -- 172.21.15.18:0/1385042085 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140116b0 con 0x7ff71c106f20 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.446+0000 7ff72407c640 1 -- 172.21.15.18:0/1385042085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71c1a4ed0 con 0x7ff71c106f20 2024-09-19T09:51:48.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.447+0000 7ff72407c640 1 -- 172.21.15.18:0/1385042085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff71c1021d0 con 0x7ff71c106f20 2024-09-19T09:51:48.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.448+0000 7ff70effd640 1 -- 172.21.15.18:0/1385042085 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff714005560 con 0x7ff71c106f20 2024-09-19T09:51:48.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.449+0000 7ff70effd640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7080a32d0 0x7ff7080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:48.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.449+0000 7ff721e18640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7080a32d0 0x7ff7080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:48.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.449+0000 7ff70effd640 1 -- 172.21.15.18:0/1385042085 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff7140cfcd0 con 0x7ff71c106f20 2024-09-19T09:51:48.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.449+0000 7ff721e18640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7080a32d0 0x7ff7080a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff710005ab0 tx=0x7ff710005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:48.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.453+0000 7ff70effd640 1 -- 172.21.15.18:0/1385042085 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff714016030 con 0x7ff71c106f20 2024-09-19T09:51:48.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.630+0000 7ff72407c640 1 -- 172.21.15.18:0/1385042085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff71c109b70 con 0x7ff71c106f20 2024-09-19T09:51:48.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.631+0000 7ff70effd640 1 -- 172.21.15.18:0/1385042085 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22571 (secure 0 0 0) 0x7ff71409c8c0 con 0x7ff71c106f20 2024-09-19T09:51:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:48.634 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:51:31.811334+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:51:48.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.633+0000 7ff72407c640 1 -- 172.21.15.18:0/1385042085 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7080a32d0 msgr2=0x7ff7080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:48.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.633+0000 7ff72407c640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7080a32d0 0x7ff7080a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff710005ab0 tx=0x7ff710005a20 comp rx=0 tx=0).stop 2024-09-19T09:51:48.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.633+0000 7ff72407c640 1 -- 172.21.15.18:0/1385042085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff71c106f20 msgr2=0x7ff71c19cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:48.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.634+0000 7ff72407c640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff71c106f20 0x7ff71c19cc20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff71400eaa0 tx=0x7ff71400ef60 comp rx=0 tx=0).stop 2024-09-19T09:51:48.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.634+0000 7ff72407c640 1 -- 172.21.15.18:0/1385042085 shutdown_connections 2024-09-19T09:51:48.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.634+0000 7ff72407c640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7080a32d0 0x7ff7080a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.634+0000 7ff72407c640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff71c106f20 0x7ff71c19cc20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.634+0000 7ff72407c640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff71c1027a0 0x7ff71c198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.634+0000 7ff72407c640 1 --2- 172.21.15.18:0/1385042085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff71c101df0 0x7ff71c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:48.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.634+0000 7ff72407c640 1 -- 172.21.15.18:0/1385042085 >> 172.21.15.18:0/1385042085 conn(0x7ff71c0fd8f0 msgr2=0x7ff71c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:48.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.634+0000 7ff72407c640 1 -- 172.21.15.18:0/1385042085 shutdown_connections 2024-09-19T09:51:48.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:48.634+0000 7ff72407c640 1 -- 172.21.15.18:0/1385042085 wait complete. 2024-09-19T09:51:49.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:48 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1385042085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:51:49.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:48 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1385042085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:51:49.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:48 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1385042085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:51:49.278 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:51:49.538 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:49.950 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:49 smithi018 ceph-mon[30956]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:51:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.947+0000 7faf11bbf640 1 -- 172.21.15.18:0/3162124107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c101dd0 msgr2=0x7faf0c1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.947+0000 7faf11bbf640 1 --2- 172.21.15.18:0/3162124107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c101dd0 0x7faf0c1021b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faefc009900 tx=0x7faefc02a410 comp rx=0 tx=0).stop 2024-09-19T09:51:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.947+0000 7faf11bbf640 1 -- 172.21.15.18:0/3162124107 shutdown_connections 2024-09-19T09:51:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.947+0000 7faf11bbf640 1 --2- 172.21.15.18:0/3162124107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c106f00 0x7faf0c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.947+0000 7faf11bbf640 1 --2- 172.21.15.18:0/3162124107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf0c102780 0x7faf0c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.947+0000 7faf11bbf640 1 --2- 172.21.15.18:0/3162124107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c101dd0 0x7faf0c1021b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.947+0000 7faf11bbf640 1 -- 172.21.15.18:0/3162124107 >> 172.21.15.18:0/3162124107 conn(0x7faf0c0fd890 msgr2=0x7faf0c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.947+0000 7faf11bbf640 1 -- 172.21.15.18:0/3162124107 shutdown_connections 2024-09-19T09:51:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.947+0000 7faf11bbf640 1 -- 172.21.15.18:0/3162124107 wait complete. 2024-09-19T09:51:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf11bbf640 1 Processor -- start 2024-09-19T09:51:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf11bbf640 1 -- start start 2024-09-19T09:51:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf11bbf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c101dd0 0x7faf0c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf11bbf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c102780 0x7faf0c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf11bbf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf0c106f00 0x7faf0c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf11bbf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c111f60 con 0x7faf0c102780 2024-09-19T09:51:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf11bbf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c111de0 con 0x7faf0c101dd0 2024-09-19T09:51:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf11bbf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c1120e0 con 0x7faf0c106f00 2024-09-19T09:51:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf0affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c102780 0x7faf0c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf0affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c102780 0x7faf0c19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50946/0 (socket says 172.21.15.18:50946) 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf0affd640 1 -- 172.21.15.18:0/3437544868 learned_addr learned my addr 172.21.15.18:0/3437544868 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf0b7fe640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c101dd0 0x7faf0c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.948+0000 7faf0bfff640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf0c106f00 0x7faf0c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf0affd640 1 -- 172.21.15.18:0/3437544868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf0c106f00 msgr2=0x7faf0c19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf0affd640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf0c106f00 0x7faf0c19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf0affd640 1 -- 172.21.15.18:0/3437544868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c101dd0 msgr2=0x7faf0c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf0affd640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c101dd0 0x7faf0c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf0affd640 1 -- 172.21.15.18:0/3437544868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c19f610 con 0x7faf0c102780 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf0affd640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c102780 0x7faf0c19aba0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faf0000d950 tx=0x7faf0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf08ff9640 1 -- 172.21.15.18:0/3437544868 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00017070 con 0x7faf0c102780 2024-09-19T09:51:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf11bbf640 1 -- 172.21.15.18:0/3437544868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c19f900 con 0x7faf0c102780 2024-09-19T09:51:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf08ff9640 1 -- 172.21.15.18:0/3437544868 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf00009c30 con 0x7faf0c102780 2024-09-19T09:51:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf08ff9640 1 -- 172.21.15.18:0/3437544868 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0000f6b0 con 0x7faf0c102780 2024-09-19T09:51:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.949+0000 7faf11bbf640 1 -- 172.21.15.18:0/3437544868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c1a71e0 con 0x7faf0c102780 2024-09-19T09:51:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.951+0000 7faf11bbf640 1 -- 172.21.15.18:0/3437544868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c1021b0 con 0x7faf0c102780 2024-09-19T09:51:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.952+0000 7faf08ff9640 1 -- 172.21.15.18:0/3437544868 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7faf000109d0 con 0x7faf0c102780 2024-09-19T09:51:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.953+0000 7faf08ff9640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faef40a32d0 0x7faef40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.953+0000 7faf0b7fe640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faef40a32d0 0x7faef40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.953+0000 7faf08ff9640 1 -- 172.21.15.18:0/3437544868 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7faf000cf600 con 0x7faf0c102780 2024-09-19T09:51:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.954+0000 7faf0b7fe640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faef40a32d0 0x7faef40a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faefc009230 tx=0x7faefc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:49.956+0000 7faf08ff9640 1 -- 172.21.15.18:0/3437544868 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf00009de0 con 0x7faf0c102780 2024-09-19T09:51:50.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:49 smithi049 ceph-mon[34858]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:51:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:49 smithi162 ceph-mon[35174]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:51:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.168+0000 7faf11bbf640 1 -- 172.21.15.18:0/3437544868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf0c19b9c0 con 0x7faf0c102780 2024-09-19T09:51:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.169+0000 7faf08ff9640 1 -- 172.21.15.18:0/3437544868 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11954 (secure 0 0 0) 0x7faf0c19b9c0 con 0x7faf0c102780 2024-09-19T09:51:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:51:50.171 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"btime":"2024-09-19T09:50:41:339962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:50:41.339939+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[24488,24484,24470,24524,14592]},"id":1}]} 2024-09-19T09:51:50.171 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-09-19T09:51:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 -- 172.21.15.18:0/3437544868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faef40a32d0 msgr2=0x7faef40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faef40a32d0 0x7faef40a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faefc009230 tx=0x7faefc0058d0 comp rx=0 tx=0).stop 2024-09-19T09:51:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 -- 172.21.15.18:0/3437544868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c102780 msgr2=0x7faf0c19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c102780 0x7faf0c19aba0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faf0000d950 tx=0x7faf0000de10 comp rx=0 tx=0).stop 2024-09-19T09:51:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 -- 172.21.15.18:0/3437544868 shutdown_connections 2024-09-19T09:51:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faef40a32d0 0x7faef40a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf0c106f00 0x7faf0c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c102780 0x7faf0c19aba0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 --2- 172.21.15.18:0/3437544868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf0c101dd0 0x7faf0c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 -- 172.21.15.18:0/3437544868 >> 172.21.15.18:0/3437544868 conn(0x7faf0c0fd890 msgr2=0x7faf0c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 -- 172.21.15.18:0/3437544868 shutdown_connections 2024-09-19T09:51:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:50.171+0000 7faf11bbf640 1 -- 172.21.15.18:0/3437544868 wait complete. 2024-09-19T09:51:50.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:50:29.937674+0000', 'modified': '2024-09-19T09:50:41.339939+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24524, 'mds_1': 24488, 'mds_2': 24484, 'mds_3': 24470, 'mds_4': 14592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14580': {'gid': 14580, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6839/2438161705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6838', 'nonce': 2438161705}, {'type': 'v1', 'addr': '172.21.15.18:6839', 'nonce': 2438161705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14592': {'gid': 14592, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.18:6841/1971133018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6840', 'nonce': 1971133018}, {'type': 'v1', 'addr': '172.21.15.18:6841', 'nonce': 1971133018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6833/212444721', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 212444721}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 212444721}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.49:6833/94526458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 94526458}, {'type': 'v1', 'addr': '172.21.15.49:6833', 'nonce': 94526458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/2083709123', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 2083709123}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 2083709123}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6837/3104050334', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 3104050334}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 3104050334}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.49:6835/4145133674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 4145133674}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 4145133674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.162:6839/2783930861', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 2783930861}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 2783930861}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.49:6837/1773266295', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 1773266295}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 1773266295}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24524': {'gid': 24524, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.49:6839/189898808', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6838', 'nonce': 189898808}, {'type': 'v1', 'addr': '172.21.15.49:6839', 'nonce': 189898808}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24524, 'qdb_cluster': [24488, 24484, 24470, 24524, 14592]} 2024-09-19T09:51:50.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:51:50.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-19T09:51:51.029 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:51.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:50 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3437544868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:51:51.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:50 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3437544868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:51:51.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:50 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3437544868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:51:51.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.479+0000 7fca1384b640 1 -- 172.21.15.18:0/4069127157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca0c108300 msgr2=0x7fca0c10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.479+0000 7fca1384b640 1 --2- 172.21.15.18:0/4069127157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca0c108300 0x7fca0c10ec70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009cd0 tx=0x7fc9fc02a8f0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.480+0000 7fca1384b640 1 -- 172.21.15.18:0/4069127157 shutdown_connections 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.480+0000 7fca1384b640 1 --2- 172.21.15.18:0/4069127157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca0c108300 0x7fca0c10ec70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.480+0000 7fca1384b640 1 --2- 172.21.15.18:0/4069127157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca0c103780 0x7fca0c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.480+0000 7fca1384b640 1 --2- 172.21.15.18:0/4069127157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c102dd0 0x7fca0c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.480+0000 7fca1384b640 1 -- 172.21.15.18:0/4069127157 >> 172.21.15.18:0/4069127157 conn(0x7fca0c0fc7d0 msgr2=0x7fca0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.480+0000 7fca1384b640 1 -- 172.21.15.18:0/4069127157 shutdown_connections 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.480+0000 7fca1384b640 1 -- 172.21.15.18:0/4069127157 wait complete. 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.480+0000 7fca1384b640 1 Processor -- start 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.480+0000 7fca1384b640 1 -- start start 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.480+0000 7fca1384b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca0c102dd0 0x7fca0c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca1384b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c103780 0x7fca0c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca1384b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca0c108300 0x7fca0c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca1384b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c1120f0 con 0x7fca0c102dd0 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca1384b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c111f70 con 0x7fca0c103780 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca1384b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c112270 con 0x7fca0c108300 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca115e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca0c102dd0 0x7fca0c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca115e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca0c102dd0 0x7fca0c1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50966/0 (socket says 172.21.15.18:50966) 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca115e7640 1 -- 172.21.15.18:0/2589620497 learned_addr learned my addr 172.21.15.18:0/2589620497 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca10de6640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c103780 0x7fca0c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca11de8640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca0c108300 0x7fca0c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca115e7640 1 -- 172.21.15.18:0/2589620497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca0c108300 msgr2=0x7fca0c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca115e7640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca0c108300 0x7fca0c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca115e7640 1 -- 172.21.15.18:0/2589620497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c103780 msgr2=0x7fca0c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca115e7640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c103780 0x7fca0c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca115e7640 1 -- 172.21.15.18:0/2589620497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0c19d570 con 0x7fca0c102dd0 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca11de8640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca0c108300 0x7fca0c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca115e7640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca0c102dd0 0x7fca0c1985c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fca0400d950 tx=0x7fca0400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca0a7fc640 1 -- 172.21.15.18:0/2589620497 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04017070 con 0x7fca0c102dd0 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca0a7fc640 1 -- 172.21.15.18:0/2589620497 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca0400de80 con 0x7fca0c102dd0 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca1384b640 1 -- 172.21.15.18:0/2589620497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca0c19d860 con 0x7fca0c102dd0 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca0a7fc640 1 -- 172.21.15.18:0/2589620497 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0400f620 con 0x7fca0c102dd0 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.481+0000 7fca1384b640 1 -- 172.21.15.18:0/2589620497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca0c1a5140 con 0x7fca0c102dd0 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.484+0000 7fca0a7fc640 1 -- 172.21.15.18:0/2589620497 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fca04009c30 con 0x7fca0c102dd0 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.484+0000 7fca15c24740 1 Processor -- start 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.484+0000 7fca15c24740 1 -- start start 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.484+0000 7fca15c24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695a8f0 0x55908695acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.484+0000 7fca15c24740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695b210 0x559086969a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.484+0000 7fca15c24740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559086969fc0 0x55908696c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.484+0000 7fca15c24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5590868c1090 con 0x55908695a8f0 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.484+0000 7fca15c24740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559086868a70 con 0x55908695b210 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.484+0000 7fca15c24740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5590868bd050 con 0x559086969fc0 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695a8f0 0x55908695acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695a8f0 0x55908695acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50972/0 (socket says 172.21.15.18:50972) 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 -- 172.21.15.18:0/3106435649 learned_addr learned my addr 172.21.15.18:0/3106435649 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca115e7640 1 --2- 172.21.15.18:0/3106435649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695b210 0x559086969a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca0a7fc640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9f40a32d0 0x7fc9f40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca10de6640 1 --2- 172.21.15.18:0/3106435649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559086969fc0 0x55908696c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9f40a32d0 0x7fc9f40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 -- 172.21.15.18:0/3106435649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559086969fc0 msgr2=0x55908696c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:51.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 --2- 172.21.15.18:0/3106435649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559086969fc0 0x55908696c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 -- 172.21.15.18:0/3106435649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695b210 msgr2=0x559086969a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 --2- 172.21.15.18:0/3106435649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695b210 0x559086969a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 -- 172.21.15.18:0/3106435649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559086875130 con 0x55908695a8f0 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca0a7fc640 1 -- 172.21.15.18:0/2589620497 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fca040cf780 con 0x7fca0c102dd0 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 --2- 172.21.15.18:0/3106435649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695a8f0 0x55908695acd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc006010 tx=0x7fc9fc0309b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4516a1430d1133d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fc9f37fe640 1 -- 172.21.15.18:0/3106435649 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc004d40 con 0x55908695a8f0 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.485+0000 7fca11de8640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9f40a32d0 0x7fc9f40a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009a60 tx=0x7fc9fc04a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fc9f37fe640 1 -- 172.21.15.18:0/3106435649 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9fc04d070 con 0x55908695a8f0 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fc9f37fe640 1 -- 172.21.15.18:0/3106435649 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc004760 con 0x55908695a8f0 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fca15c24740 1 -- 172.21.15.18:0/3106435649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695a8f0 msgr2=0x55908695acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fca15c24740 1 --2- 172.21.15.18:0/3106435649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695a8f0 0x55908695acd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc006010 tx=0x7fc9fc0309b0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fca15c24740 1 -- 172.21.15.18:0/3106435649 shutdown_connections 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fca15c24740 1 --2- 172.21.15.18:0/3106435649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559086969fc0 0x55908696c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fca15c24740 1 --2- 172.21.15.18:0/3106435649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695b210 0x559086969a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fca15c24740 1 --2- 172.21.15.18:0/3106435649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695a8f0 0x55908695acd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fca15c24740 1 -- 172.21.15.18:0/3106435649 >> 172.21.15.18:0/3106435649 conn(0x559086956f60 msgr2=0x559086957340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fca15c24740 1 -- 172.21.15.18:0/3106435649 shutdown_connections 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.486+0000 7fca15c24740 1 -- 172.21.15.18:0/3106435649 wait complete. 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca15c24740 1 -- start start 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca15c24740 1 Processor -- start 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca15c24740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x5590869698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca15c24740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 0x559086966c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca15c24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x559086967180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca15c24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55908696cb30 con 0x559086969fc0 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca15c24740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55908687bf20 con 0x55908695a8f0 2024-09-19T09:51:51.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca15c24740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55908696ccb0 con 0x55908695b210 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca15c24740 10 client.0 _ll_register_callbacks cb 0x559086845030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca11de8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x559086967180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca11de8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x559086967180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50982/0 (socket says 172.21.15.18:50982) 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.487+0000 7fca11de8640 1 -- 172.21.15.18:0/4047424559 learned_addr learned my addr 172.21.15.18:0/4047424559 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca10de6640 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 0x559086966c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca115e7640 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x5590869698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca11de8640 1 -- 172.21.15.18:0/4047424559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 msgr2=0x559086966c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca11de8640 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 0x559086966c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca11de8640 1 -- 172.21.15.18:0/4047424559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 msgr2=0x5590869698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca11de8640 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x5590869698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca11de8640 1 -- 172.21.15.18:0/4047424559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590866322b0 con 0x559086969fc0 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca10de6640 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 0x559086966c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:51.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca11de8640 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x559086967180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009780 tx=0x7fc9fc005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c166503945363c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fc9f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/4047424559 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc061060 con 0x559086969fc0 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/4047424559 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc9fc0044e0 con 0x559086969fc0 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca15c24740 1 -- 172.21.15.18:0/4047424559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9fc04d070 con 0x559086969fc0 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/4047424559 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc9fc0046e0 con 0x559086969fc0 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca15c24740 10 client.14976 fetch_fsmap learned FSMap version 27 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fca15c24740 1 -- 172.21.15.18:0/4047424559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559086978520 con 0x559086969fc0 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.488+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/4047424559 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9fc04d070 con 0x559086969fc0 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.489+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/4047424559 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc9fc03a950 con 0x559086969fc0 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.489+0000 7fca15c24740 10 client.14976 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.489+0000 7fca15c24740 10 client.14976 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.489+0000 7fca15c24740 20 client.14976 populate_metadata read hostname 'smithi018' 2024-09-19T09:51:51.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.489+0000 7fca15c24740 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55908697a670 0x55908697bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.489+0000 7fca15c24740 4 client.14976 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.489+0000 7fca15c24740 1 -- 172.21.15.18:0/4047424559 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590868ce600 con 0x55908697a670 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.489+0000 7fca115e7640 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55908697a670 0x55908697bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.489+0000 7fc9f0ff9640 10 client.14976 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.489+0000 7fca115e7640 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55908697a670 0x55908697bae0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=88bb52d7618f212 server_cookie=35319331bea7dc51 in_seq=0 out_seq=0 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/4047424559 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590868ce600 con 0x55908697a670 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fc9f0ff9640 10 client.14976 handle_command_reply: tid=0 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 client.14976 shutdown 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 -- 172.21.15.18:0/4047424559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 msgr2=0x559086967180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x559086967180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009780 tx=0x7fc9fc005d80 comp rx=0 tx=0).stop 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 -- 172.21.15.18:0/4047424559 shutdown_connections 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55908697a670 0x55908697bae0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x559086967180 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fc9f0ff9640 0 client.14976 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:51:51.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 0x559086966c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 --2- 172.21.15.18:0/4047424559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x5590869698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 -- 172.21.15.18:0/4047424559 >> 172.21.15.18:0/4047424559 conn(0x559086956f60 msgr2=0x55908695cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:51.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 -- 172.21.15.18:0/4047424559 shutdown_connections 2024-09-19T09:51:51.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 1 -- 172.21.15.18:0/4047424559 wait complete. 2024-09-19T09:51:51.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.490+0000 7fca15c24740 20 client.14976 trim_cache size 0 max 16384 2024-09-19T09:51:51.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca15c24740 1 Processor -- start 2024-09-19T09:51:51.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca15c24740 1 -- start start 2024-09-19T09:51:51.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca15c24740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x55908697ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca15c24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695b210 0x559086955ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca15c24740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559086969fc0 0x559086963ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca15c24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559086979e20 con 0x55908695b210 2024-09-19T09:51:51.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca15c24740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55908697a4f0 con 0x55908695a8f0 2024-09-19T09:51:51.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca15c24740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55908697abc0 con 0x559086969fc0 2024-09-19T09:51:51.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca10de6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695b210 0x559086955ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca10de6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695b210 0x559086955ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50992/0 (socket says 172.21.15.18:50992) 2024-09-19T09:51:51.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca10de6640 1 -- 172.21.15.18:0/1924191325 learned_addr learned my addr 172.21.15.18:0/1924191325 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:51.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca10de6640 1 -- 172.21.15.18:0/1924191325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559086969fc0 msgr2=0x559086963ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:51.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca115e7640 1 --2- 172.21.15.18:0/1924191325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x55908697ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca10de6640 1 --2- 172.21.15.18:0/1924191325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559086969fc0 0x559086963ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca10de6640 1 -- 172.21.15.18:0/1924191325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 msgr2=0x55908697ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:51.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.509+0000 7fca10de6640 1 --2- 172.21.15.18:0/1924191325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x55908697ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.510+0000 7fca10de6640 1 -- 172.21.15.18:0/1924191325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559086967c80 con 0x55908695b210 2024-09-19T09:51:51.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.510+0000 7fca115e7640 1 --2- 172.21.15.18:0/1924191325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x55908697ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.510+0000 7fca10de6640 1 --2- 172.21.15.18:0/1924191325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695b210 0x559086955ef0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0697d0 tx=0x7fca00009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492cb0e885736e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.510+0000 7fc9f2ffd640 1 -- 172.21.15.18:0/1924191325 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0001a030 con 0x55908695b210 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.510+0000 7fc9f2ffd640 1 -- 172.21.15.18:0/1924191325 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca00013da0 con 0x55908695b210 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.510+0000 7fc9f2ffd640 1 -- 172.21.15.18:0/1924191325 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0001e3c0 con 0x55908695b210 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 -- 172.21.15.18:0/1924191325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695b210 msgr2=0x559086955ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 --2- 172.21.15.18:0/1924191325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695b210 0x559086955ef0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0697d0 tx=0x7fca00009110 comp rx=0 tx=0).stop 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 -- 172.21.15.18:0/1924191325 shutdown_connections 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 --2- 172.21.15.18:0/1924191325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559086969fc0 0x559086963ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 --2- 172.21.15.18:0/1924191325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55908695b210 0x559086955ef0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 --2- 172.21.15.18:0/1924191325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x55908697ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 -- 172.21.15.18:0/1924191325 >> 172.21.15.18:0/1924191325 conn(0x559086956f60 msgr2=0x5590869557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 -- 172.21.15.18:0/1924191325 shutdown_connections 2024-09-19T09:51:51.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 -- 172.21.15.18:0/1924191325 wait complete. 2024-09-19T09:51:51.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 -- start start 2024-09-19T09:51:51.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.511+0000 7fca15c24740 1 Processor -- start 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca15c24740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x55908697eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca15c24740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 0x55908697f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca15c24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x55908697f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca15c24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55908697b960 con 0x559086969fc0 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca15c24740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55908697b290 con 0x55908695a8f0 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca15c24740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55908697c030 con 0x55908695b210 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca15c24740 10 client.0 _ll_register_callbacks cb 0x7fca0409ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca11de8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x55908697f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca11de8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x55908697f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51002/0 (socket says 172.21.15.18:51002) 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca11de8640 1 -- 172.21.15.18:0/3297374543 learned_addr learned my addr 172.21.15.18:0/3297374543 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca115e7640 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x55908697eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca10de6640 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 0x55908697f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca11de8640 1 -- 172.21.15.18:0/3297374543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 msgr2=0x55908697f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca11de8640 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 0x55908697f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca11de8640 1 -- 172.21.15.18:0/3297374543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 msgr2=0x55908697eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca11de8640 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x55908697eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca11de8640 1 -- 172.21.15.18:0/3297374543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559086983c70 con 0x559086969fc0 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca11de8640 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x55908697f620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc03ada0 tx=0x7fc9fc004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396fdcb958497856 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fc9f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/3297374543 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc06c060 con 0x559086969fc0 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/3297374543 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc9fc0304a0 con 0x559086969fc0 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.512+0000 7fca15c24740 1 -- 172.21.15.18:0/3297374543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca00013da0 con 0x559086969fc0 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/3297374543 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc9fc061070 con 0x559086969fc0 2024-09-19T09:51:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fca15c24740 10 client.14982 fetch_fsmap learned FSMap version 27 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fca15c24740 1 -- 172.21.15.18:0/3297374543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5590869e5050 con 0x559086969fc0 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/3297374543 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca00013da0 con 0x559086969fc0 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/3297374543 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc9fc03a790 con 0x559086969fc0 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fca15c24740 10 client.14982 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fca15c24740 10 client.14982 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fca15c24740 20 client.14982 populate_metadata read hostname 'smithi018' 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fca15c24740 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55908697a670 0x5590869e8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fca15c24740 4 client.14982 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fca15c24740 1 -- 172.21.15.18:0/3297374543 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "status"}) -- 0x5590868c8b10 con 0x55908697a670 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.513+0000 7fca115e7640 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55908697a670 0x5590869e8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fc9f0ff9640 10 client.14982 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca115e7640 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55908697a670 0x5590869e8810 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ae61bcb46bd3a9bd server_cookie=67928d536eb0471f in_seq=0 out_seq=0 2024-09-19T09:51:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fc9f0ff9640 1 -- 172.21.15.18:0/3297374543 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5590868c8b10 con 0x55908697a670 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fc9f0ff9640 10 client.14982 handle_command_reply: tid=0 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 client.14982 shutdown 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 -- 172.21.15.18:0/3297374543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 msgr2=0x55908697f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x55908697f620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc03ada0 tx=0x7fc9fc004990 comp rx=0 tx=0).stop 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 -- 172.21.15.18:0/3297374543 shutdown_connections 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55908697a670 0x5590869e8810 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559086969fc0 0x55908697f620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55908695b210 0x55908697f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fc9f0ff9640 0 client.14982 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 --2- 172.21.15.18:0/3297374543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55908695a8f0 0x55908697eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 -- 172.21.15.18:0/3297374543 >> 172.21.15.18:0/3297374543 conn(0x559086956f60 msgr2=0x55908695cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 -- 172.21.15.18:0/3297374543 shutdown_connections 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 1 -- 172.21.15.18:0/3297374543 wait complete. 2024-09-19T09:51:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.514+0000 7fca15c24740 20 client.14982 trim_cache size 0 max 16384 2024-09-19T09:51:51.522 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:51:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:51:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 4, 2024-09-19T09:51:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 14592, 2024-09-19T09:51:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:51:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:51:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:51:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 71.182707033, 2024-09-19T09:51:51.522 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-09-19T09:51:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:51:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:51:51.523 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 94.711830993000007 2024-09-19T09:51:51.523 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:51:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 -- 172.21.15.18:0/2589620497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9f40a32d0 msgr2=0x7fc9f40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9f40a32d0 0x7fc9f40a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009a60 tx=0x7fc9fc04a000 comp rx=0 tx=0).stop 2024-09-19T09:51:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 -- 172.21.15.18:0/2589620497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca0c102dd0 msgr2=0x7fca0c1985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca0c102dd0 0x7fca0c1985c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fca0400d950 tx=0x7fca0400dd50 comp rx=0 tx=0).stop 2024-09-19T09:51:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 -- 172.21.15.18:0/2589620497 shutdown_connections 2024-09-19T09:51:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9f40a32d0 0x7fc9f40a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca0c108300 0x7fca0c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca0c103780 0x7fca0c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 --2- 172.21.15.18:0/2589620497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca0c102dd0 0x7fca0c1985c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 -- 172.21.15.18:0/2589620497 >> 172.21.15.18:0/2589620497 conn(0x7fca0c0fc7d0 msgr2=0x7fca0c105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 -- 172.21.15.18:0/2589620497 shutdown_connections 2024-09-19T09:51:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:51.515+0000 7fca1384b640 1 -- 172.21.15.18:0/2589620497 wait complete. 2024-09-19T09:51:52.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:51 smithi018 ceph-mon[30956]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:51:52.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:51 smithi049 ceph-mon[34858]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:51:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:51 smithi162 ceph-mon[35174]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:51:52.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.e status 2024-09-19T09:51:52.455 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:52.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.921+0000 7f49b9966640 1 -- 172.21.15.18:0/2144300818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49b4102790 msgr2=0x7f49b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.921+0000 7f49b9966640 1 --2- 172.21.15.18:0/2144300818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49b4102790 0x7f49b41067e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f499c009900 tx=0x7f499c02a410 comp rx=0 tx=0).stop 2024-09-19T09:51:52.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.921+0000 7f49b9966640 1 -- 172.21.15.18:0/2144300818 shutdown_connections 2024-09-19T09:51:52.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.921+0000 7f49b9966640 1 --2- 172.21.15.18:0/2144300818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4106f10 0x7f49b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.921+0000 7f49b9966640 1 --2- 172.21.15.18:0/2144300818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49b4102790 0x7f49b41067e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.921+0000 7f49b9966640 1 --2- 172.21.15.18:0/2144300818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49b4101de0 0x7f49b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.921+0000 7f49b9966640 1 -- 172.21.15.18:0/2144300818 >> 172.21.15.18:0/2144300818 conn(0x7f49b40fd8c0 msgr2=0x7f49b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:52.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.921+0000 7f49b9966640 1 -- 172.21.15.18:0/2144300818 shutdown_connections 2024-09-19T09:51:52.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.921+0000 7f49b9966640 1 -- 172.21.15.18:0/2144300818 wait complete. 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b9966640 1 Processor -- start 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b9966640 1 -- start start 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b9966640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49b4101de0 0x7f49b41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b9966640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102790 0x7f49b4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b9966640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49b4106f10 0x7f49b419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b9966640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4111fb0 con 0x7f49b4106f10 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b9966640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4111e30 con 0x7f49b4102790 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b9966640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4112130 con 0x7f49b4101de0 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49b4106f10 0x7f49b419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49b4106f10 0x7f49b419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51020/0 (socket says 172.21.15.18:51020) 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.922+0000 7f49b37fe640 1 -- 172.21.15.18:0/2531294926 learned_addr learned my addr 172.21.15.18:0/2531294926 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49abfff640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102790 0x7f49b4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49b4101de0 0x7f49b41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b37fe640 1 -- 172.21.15.18:0/2531294926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49b4101de0 msgr2=0x7f49b41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b37fe640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49b4101de0 0x7f49b41984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b37fe640 1 -- 172.21.15.18:0/2531294926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102790 msgr2=0x7f49b4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b37fe640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102790 0x7f49b4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b37fe640 1 -- 172.21.15.18:0/2531294926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b419d480 con 0x7f49b4106f10 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b37fe640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49b4106f10 0x7f49b419cda0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00b970 tx=0x7f49ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b8964640 1 -- 172.21.15.18:0/2531294926 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac019070 con 0x7f49b4106f10 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b8964640 1 -- 172.21.15.18:0/2531294926 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49ac00cb40 con 0x7f49b4106f10 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b9966640 1 -- 172.21.15.18:0/2531294926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b419d770 con 0x7f49b4106f10 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b8964640 1 -- 172.21.15.18:0/2531294926 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac007650 con 0x7f49b4106f10 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.923+0000 7f49b9966640 1 -- 172.21.15.18:0/2531294926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b41a5050 con 0x7f49b4106f10 2024-09-19T09:51:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.926+0000 7f49bbd3f740 1 Processor -- start 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.926+0000 7f49b8964640 1 -- 172.21.15.18:0/2531294926 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f49ac01c070 con 0x7f49b4106f10 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.926+0000 7f49bbd3f740 1 -- start start 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0969d0 0x55640e096db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0a1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55640dffd090 con 0x55640e0a1bb0 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55640dfa4a70 con 0x55640e0969d0 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55640dff9050 con 0x55640e0972f0 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49abfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49abfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0a3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51032/0 (socket says 172.21.15.18:51032) 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49abfff640 1 -- 172.21.15.18:0/906973580 learned_addr learned my addr 172.21.15.18:0/906973580 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49abfff640 1 --2- 172.21.15.18:0/906973580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0969d0 0x55640e096db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/906973580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49abfff640 1 -- 172.21.15.18:0/906973580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 msgr2=0x55640e0a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49abfff640 1 --2- 172.21.15.18:0/906973580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49abfff640 1 -- 172.21.15.18:0/906973580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0969d0 msgr2=0x55640e096db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49abfff640 1 --2- 172.21.15.18:0/906973580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0969d0 0x55640e096db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49abfff640 1 -- 172.21.15.18:0/906973580 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55640dfb1130 con 0x55640e0a1bb0 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49abfff640 1 --2- 172.21.15.18:0/906973580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0a3fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f499c009900 tx=0x7f499c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33977bf5ee396f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.927+0000 7f49b8964640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f49a00a3350 0x7f49a00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.928+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f49a00a3350 0x7f49a00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.928+0000 7f49a9ffb640 1 -- 172.21.15.18:0/906973580 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c035070 con 0x55640e0a1bb0 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.928+0000 7f49b8964640 1 -- 172.21.15.18:0/2531294926 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f49ac0ceee0 con 0x7f49b4106f10 2024-09-19T09:51:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.928+0000 7f49a9ffb640 1 -- 172.21.15.18:0/906973580 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f499c005020 con 0x55640e0a1bb0 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.928+0000 7f49a9ffb640 1 -- 172.21.15.18:0/906973580 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c0049e0 con 0x55640e0a1bb0 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.928+0000 7f49bbd3f740 1 -- 172.21.15.18:0/906973580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 msgr2=0x55640e0a3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.928+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f49a00a3350 0x7f49a00a5810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55640e093dc0 tx=0x7f49a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.928+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/906973580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0a3fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f499c009900 tx=0x7f499c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.929+0000 7f49bbd3f740 1 -- 172.21.15.18:0/906973580 shutdown_connections 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.929+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/906973580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0a3fa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.929+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/906973580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.929+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/906973580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0969d0 0x55640e096db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.929+0000 7f49bbd3f740 1 -- 172.21.15.18:0/906973580 >> 172.21.15.18:0/906973580 conn(0x55640e092f60 msgr2=0x55640e093340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.929+0000 7f49bbd3f740 1 -- 172.21.15.18:0/906973580 shutdown_connections 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.929+0000 7f49bbd3f740 1 -- 172.21.15.18:0/906973580 wait complete. 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.929+0000 7f49bbd3f740 1 -- start start 2024-09-19T09:51:52.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.929+0000 7f49bbd3f740 1 Processor -- start 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.929+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0972f0 0x55640e09e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0a1bb0 0x55640e09ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55640e0a4780 con 0x55640e0969d0 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55640dfb7f20 con 0x55640e0972f0 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55640e0a4900 con 0x55640e0a1bb0 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49bbd3f740 10 client.0 _ll_register_callbacks cb 0x55640df81030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51038/0 (socket says 172.21.15.18:51038) 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b2ffd640 1 -- 172.21.15.18:0/3397812041 learned_addr learned my addr 172.21.15.18:0/3397812041 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49abfff640 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0972f0 0x55640e09e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b37fe640 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0a1bb0 0x55640e09ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b2ffd640 1 -- 172.21.15.18:0/3397812041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0a1bb0 msgr2=0x55640e09ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0a1bb0 0x55640e09ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b2ffd640 1 -- 172.21.15.18:0/3397812041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0972f0 msgr2=0x55640e09e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0972f0 0x55640e09e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b2ffd640 1 -- 172.21.15.18:0/3397812041 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55640dd6e2b0 con 0x55640e0969d0 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b37fe640 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0a1bb0 0x55640e09ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0a1460 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f49a4003ea0 tx=0x7f49a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432ab007426bc284 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f4992ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f4992ffd640 1 -- 172.21.15.18:0/3397812041 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a401b660 con 0x55640e0969d0 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f4992ffd640 1 -- 172.21.15.18:0/3397812041 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f49a401b800 con 0x55640e0969d0 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f49bbd3f740 1 -- 172.21.15.18:0/3397812041 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f499c005020 con 0x55640e0969d0 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.930+0000 7f4992ffd640 1 -- 172.21.15.18:0/3397812041 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f49a401ba00 con 0x55640e0969d0 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f49bbd3f740 10 client.14994 fetch_fsmap learned FSMap version 27 2024-09-19T09:51:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f49bbd3f740 1 -- 172.21.15.18:0/3397812041 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55640e0b0150 con 0x55640e0969d0 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f4992ffd640 1 -- 172.21.15.18:0/3397812041 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f499c005020 con 0x55640e0969d0 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f4992ffd640 1 -- 172.21.15.18:0/3397812041 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f49a4024070 con 0x55640e0969d0 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f49bbd3f740 10 client.14994 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f49bbd3f740 10 client.14994 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f49bbd3f740 20 client.14994 populate_metadata read hostname 'smithi018' 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55640e0b27e0 0x55640e0b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f49bbd3f740 4 client.14994 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f49bbd3f740 1 -- 172.21.15.18:0/3397812041 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55640e00a600 con 0x55640e0b27e0 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.931+0000 7f49abfff640 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55640e0b27e0 0x55640e0b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.932+0000 7f49abfff640 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55640e0b27e0 0x55640e0b3c50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2e4e083c50c609c9 server_cookie=6f46ecf775c4e06e in_seq=0 out_seq=0 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.932+0000 7f4992ffd640 10 client.14994 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.932+0000 7f4992ffd640 1 -- 172.21.15.18:0/3397812041 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55640e00a600 con 0x55640e0b27e0 2024-09-19T09:51:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f4992ffd640 10 client.14994 handle_command_reply: tid=0 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 client.14994 shutdown 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 -- 172.21.15.18:0/3397812041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 msgr2=0x55640e0a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0a1460 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f49a4003ea0 tx=0x7f49a40046c0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 -- 172.21.15.18:0/3397812041 shutdown_connections 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55640e0b27e0 0x55640e0b3c50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0a1bb0 0x55640e09ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0972f0 0x55640e09e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/3397812041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0a1460 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f4992ffd640 0 client.14994 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 -- 172.21.15.18:0/3397812041 >> 172.21.15.18:0/3397812041 conn(0x55640e092f60 msgr2=0x55640e098c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 -- 172.21.15.18:0/3397812041 shutdown_connections 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 1 -- 172.21.15.18:0/3397812041 wait complete. 2024-09-19T09:51:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.933+0000 7f49bbd3f740 20 client.14994 trim_cache size 0 max 16384 2024-09-19T09:51:52.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.951+0000 7f49bbd3f740 1 Processor -- start 2024-09-19T09:51:52.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.951+0000 7f49bbd3f740 1 -- start start 2024-09-19T09:51:52.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.951+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0969d0 0x55640e099cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0bc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55640e0b1f90 con 0x55640e0a1bb0 2024-09-19T09:51:52.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55640e0b2660 con 0x55640e0969d0 2024-09-19T09:51:52.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55640e0b2d30 con 0x55640e0972f0 2024-09-19T09:51:52.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49b37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0bc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.983 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 3, 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24470, 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 73.551817732000004, 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 112.22737125499999 2024-09-19T09:51:52.984 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:51:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49b37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0bc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51050/0 (socket says 172.21.15.18:51050) 2024-09-19T09:51:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49b37fe640 1 -- 172.21.15.18:0/4098007185 learned_addr learned my addr 172.21.15.18:0/4098007185 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49abfff640 1 --2- 172.21.15.18:0/4098007185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/4098007185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0969d0 0x55640e099cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49b37fe640 1 -- 172.21.15.18:0/4098007185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 msgr2=0x55640e0bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49b37fe640 1 --2- 172.21.15.18:0/4098007185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49b37fe640 1 -- 172.21.15.18:0/4098007185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0969d0 msgr2=0x55640e099cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49b37fe640 1 --2- 172.21.15.18:0/4098007185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0969d0 0x55640e099cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49b37fe640 1 -- 172.21.15.18:0/4098007185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55640e0a1080 con 0x55640e0a1bb0 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49abfff640 1 --2- 172.21.15.18:0/4098007185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49b37fe640 1 --2- 172.21.15.18:0/4098007185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0bc470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0a3c20 tx=0x7f49ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46071f2563003e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49a97fa640 1 -- 172.21.15.18:0/4098007185 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0b4070 con 0x55640e0a1bb0 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49a97fa640 1 -- 172.21.15.18:0/4098007185 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49ac09f890 con 0x55640e0a1bb0 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.952+0000 7f49a97fa640 1 -- 172.21.15.18:0/4098007185 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0a3cc0 con 0x55640e0a1bb0 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.953+0000 7f49bbd3f740 1 -- 172.21.15.18:0/4098007185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 msgr2=0x55640e0bc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.953+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/4098007185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0bc470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0a3c20 tx=0x7f49ac004a40 comp rx=0 tx=0).stop 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.953+0000 7f49bbd3f740 1 -- 172.21.15.18:0/4098007185 shutdown_connections 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.953+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/4098007185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0a1bb0 0x55640e0bc470 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.953+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/4098007185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.953+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/4098007185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0969d0 0x55640e099cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.953+0000 7f49bbd3f740 1 -- 172.21.15.18:0/4098007185 >> 172.21.15.18:0/4098007185 conn(0x55640e092f60 msgr2=0x55640e0995c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.953+0000 7f49bbd3f740 1 -- 172.21.15.18:0/4098007185 shutdown_connections 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.953+0000 7f49bbd3f740 1 -- 172.21.15.18:0/4098007185 wait complete. 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.953+0000 7f49bbd3f740 1 -- start start 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49bbd3f740 1 Processor -- start 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0b7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0b7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49bbd3f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0a1bb0 0x55640e11aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55640e0b3ad0 con 0x55640e0969d0 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55640e0b3400 con 0x55640e0a1bb0 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49bbd3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55640e0b41a0 con 0x55640e0972f0 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49bbd3f740 10 client.0 _ll_register_callbacks cb 0x7f49a4003b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0b7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51064/0 (socket says 172.21.15.18:51064) 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b2ffd640 1 -- 172.21.15.18:0/622342871 learned_addr learned my addr 172.21.15.18:0/622342871 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b37fe640 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0a1bb0 0x55640e11aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49abfff640 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b2ffd640 1 -- 172.21.15.18:0/622342871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 msgr2=0x55640e0b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0b7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b2ffd640 1 -- 172.21.15.18:0/622342871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0a1bb0 msgr2=0x55640e11aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0a1bb0 0x55640e11aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b2ffd640 1 -- 172.21.15.18:0/622342871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55640e11b4d0 con 0x55640e0969d0 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b37fe640 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0a1bb0 0x55640e11aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49abfff640 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f49b2ffd640 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0b7440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f49a4003ea0 tx=0x7f49a4005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2c20540d4e5f98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:52.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.954+0000 7f4992ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f4992ffd640 1 -- 172.21.15.18:0/622342871 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4004520 con 0x55640e0969d0 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f4992ffd640 1 -- 172.21.15.18:0/622342871 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f49a401be30 con 0x55640e0969d0 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f49bbd3f740 1 -- 172.21.15.18:0/622342871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49ac09f890 con 0x55640e0969d0 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f4992ffd640 1 -- 172.21.15.18:0/622342871 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f49a400b400 con 0x55640e0969d0 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f49bbd3f740 10 client.15000 fetch_fsmap learned FSMap version 27 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f49bbd3f740 1 -- 172.21.15.18:0/622342871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55640e11c7b0 con 0x55640e0969d0 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f4992ffd640 1 -- 172.21.15.18:0/622342871 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49ac09f890 con 0x55640e0969d0 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f4992ffd640 1 -- 172.21.15.18:0/622342871 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f49a4024050 con 0x55640e0969d0 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f49bbd3f740 10 client.15000 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f49bbd3f740 10 client.15000 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f49bbd3f740 20 client.15000 populate_metadata read hostname 'smithi018' 2024-09-19T09:51:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55640e1213f0 0x55640e120100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f49bbd3f740 4 client.15000 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.955+0000 7f49bbd3f740 1 -- 172.21.15.18:0/622342871 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "status"}) -- 0x55640e004b10 con 0x55640e1213f0 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49abfff640 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55640e1213f0 0x55640e120100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f4992ffd640 10 client.15000 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49abfff640 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55640e1213f0 0x55640e120100 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4a1c6669f4a1388 server_cookie=b521b74b9c8d654f in_seq=0 out_seq=0 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f4992ffd640 1 -- 172.21.15.18:0/622342871 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55640e004b10 con 0x55640e1213f0 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f4992ffd640 10 client.15000 handle_command_reply: tid=0 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49bbd3f740 1 client.15000 shutdown 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49bbd3f740 1 -- 172.21.15.18:0/622342871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 msgr2=0x55640e0b7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0b7440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f49a4003ea0 tx=0x7f49a4005270 comp rx=0 tx=0).stop 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49bbd3f740 1 -- 172.21.15.18:0/622342871 shutdown_connections 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55640e1213f0 0x55640e120100 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55640e0a1bb0 0x55640e11aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640e0972f0 0x55640e0b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49bbd3f740 1 --2- 172.21.15.18:0/622342871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55640e0969d0 0x55640e0b7440 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f4992ffd640 0 client.15000 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.956+0000 7f49bbd3f740 1 -- 172.21.15.18:0/622342871 >> 172.21.15.18:0/622342871 conn(0x55640e092f60 msgr2=0x55640e099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49bbd3f740 1 -- 172.21.15.18:0/622342871 shutdown_connections 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49bbd3f740 1 -- 172.21.15.18:0/622342871 wait complete. 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49bbd3f740 20 client.15000 trim_cache size 0 max 16384 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 -- 172.21.15.18:0/2531294926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f49a00a3350 msgr2=0x7f49a00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f49a00a3350 0x7f49a00a5810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55640e093dc0 tx=0x7f49a400b390 comp rx=0 tx=0).stop 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 -- 172.21.15.18:0/2531294926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49b4106f10 msgr2=0x7f49b419cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49b4106f10 0x7f49b419cda0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00b970 tx=0x7f49ac00be30 comp rx=0 tx=0).stop 2024-09-19T09:51:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 -- 172.21.15.18:0/2531294926 shutdown_connections 2024-09-19T09:51:52.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f49a00a3350 0x7f49a00a5810 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49b4106f10 0x7f49b419cda0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102790 0x7f49b4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 --2- 172.21.15.18:0/2531294926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49b4101de0 0x7f49b41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:52.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 -- 172.21.15.18:0/2531294926 >> 172.21.15.18:0/2531294926 conn(0x7f49b40fd8c0 msgr2=0x7f49b40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:52.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 -- 172.21.15.18:0/2531294926 shutdown_connections 2024-09-19T09:51:52.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:52.957+0000 7f49b9966640 1 -- 172.21.15.18:0/2531294926 wait complete. 2024-09-19T09:51:53.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:51:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:54.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:53 smithi018 ceph-mon[30956]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:51:54.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:53 smithi049 ceph-mon[34858]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:51:54.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:53 smithi162 ceph-mon[35174]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:51:54.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.300+0000 7fbf37dac640 1 -- 172.21.15.18:0/2227129214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30101de0 msgr2=0x7fbf301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:54.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.300+0000 7fbf37dac640 1 --2- 172.21.15.18:0/2227129214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30101de0 0x7fbf301021c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009ca0 tx=0x7fbf2002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.300+0000 7fbf37dac640 1 -- 172.21.15.18:0/2227129214 shutdown_connections 2024-09-19T09:51:54.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.300+0000 7fbf37dac640 1 --2- 172.21.15.18:0/2227129214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf30106f10 0x7fbf3010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.300+0000 7fbf37dac640 1 --2- 172.21.15.18:0/2227129214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf30102790 0x7fbf301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.300+0000 7fbf37dac640 1 --2- 172.21.15.18:0/2227129214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30101de0 0x7fbf301021c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.300+0000 7fbf37dac640 1 -- 172.21.15.18:0/2227129214 >> 172.21.15.18:0/2227129214 conn(0x7fbf300fd8c0 msgr2=0x7fbf300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.300+0000 7fbf37dac640 1 -- 172.21.15.18:0/2227129214 shutdown_connections 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.300+0000 7fbf37dac640 1 -- 172.21.15.18:0/2227129214 wait complete. 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf37dac640 1 Processor -- start 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf37dac640 1 -- start start 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf37dac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf30101de0 0x7fbf300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf37dac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf30102790 0x7fbf30074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf37dac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30106f10 0x7fbf30074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf37dac640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf30111f90 con 0x7fbf30106f10 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf37dac640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbf30111e10 con 0x7fbf30102790 2024-09-19T09:51:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf37dac640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbf30112110 con 0x7fbf30101de0 2024-09-19T09:51:54.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf36349640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30106f10 0x7fbf30074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf36349640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30106f10 0x7fbf30074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51080/0 (socket says 172.21.15.18:51080) 2024-09-19T09:51:54.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.301+0000 7fbf36349640 1 -- 172.21.15.18:0/2952883346 learned_addr learned my addr 172.21.15.18:0/2952883346 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:54.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf35347640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf30102790 0x7fbf30074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf35b48640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf30101de0 0x7fbf300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf36349640 1 -- 172.21.15.18:0/2952883346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf30101de0 msgr2=0x7fbf300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf36349640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf30101de0 0x7fbf300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf36349640 1 -- 172.21.15.18:0/2952883346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf30102790 msgr2=0x7fbf30074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf36349640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf30102790 0x7fbf30074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf36349640 1 -- 172.21.15.18:0/2952883346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf301a69d0 con 0x7fbf30106f10 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf35347640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf30102790 0x7fbf30074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf35b48640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf30101de0 0x7fbf300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf36349640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30106f10 0x7fbf30074f70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800d750 tx=0x7fbf2800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf2effd640 1 -- 172.21.15.18:0/2952883346 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28017070 con 0x7fbf30106f10 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf37dac640 1 -- 172.21.15.18:0/2952883346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf301a6cc0 con 0x7fbf30106f10 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf2effd640 1 -- 172.21.15.18:0/2952883346 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf28005500 con 0x7fbf30106f10 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf2effd640 1 -- 172.21.15.18:0/2952883346 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28004d90 con 0x7fbf30106f10 2024-09-19T09:51:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.302+0000 7fbf37dac640 1 -- 172.21.15.18:0/2952883346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf301a71b0 con 0x7fbf30106f10 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.305+0000 7fbf2effd640 1 -- 172.21.15.18:0/2952883346 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbf28004f30 con 0x7fbf30106f10 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.305+0000 7fbf3a185740 1 Processor -- start 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf3a185740 1 -- start start 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a29254db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a2925f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a29261fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf3a185740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556a291bb090 con 0x556a2925fbb0 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf3a185740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556a29162a70 con 0x556a292552f0 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf3a185740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556a291b7050 con 0x556a292549d0 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf35347640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a29261fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf35347640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a29261fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51086/0 (socket says 172.21.15.18:51086) 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf35347640 1 -- 172.21.15.18:0/91430581 learned_addr learned my addr 172.21.15.18:0/91430581 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf35347640 1 --2- 172.21.15.18:0/91430581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a29254db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf35b48640 1 --2- 172.21.15.18:0/91430581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a2925f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf35347640 1 -- 172.21.15.18:0/91430581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 msgr2=0x556a29254db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf35347640 1 --2- 172.21.15.18:0/91430581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a29254db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf35347640 1 -- 172.21.15.18:0/91430581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 msgr2=0x556a2925f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf2effd640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf180a32d0 0x7fbf180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf35347640 1 --2- 172.21.15.18:0/91430581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a2925f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.306+0000 7fbf35347640 1 -- 172.21.15.18:0/91430581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a2916f130 con 0x556a2925fbb0 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.307+0000 7fbf36349640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf180a32d0 0x7fbf180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.307+0000 7fbf35347640 1 --2- 172.21.15.18:0/91430581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a29261fa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbf24016560 tx=0x7fbf2400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c95814d249b457 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.307+0000 7fbf2effd640 1 -- 172.21.15.18:0/2952883346 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbf280cf540 con 0x7fbf30106f10 2024-09-19T09:51:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.307+0000 7fbf17fff640 1 -- 172.21.15.18:0/91430581 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24018430 con 0x556a2925fbb0 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.307+0000 7fbf17fff640 1 -- 172.21.15.18:0/91430581 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf24018ab0 con 0x556a2925fbb0 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.307+0000 7fbf17fff640 1 -- 172.21.15.18:0/91430581 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf240178b0 con 0x556a2925fbb0 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 -- 172.21.15.18:0/91430581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 msgr2=0x556a29261fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf36349640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf180a32d0 0x7fbf180a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf28098400 tx=0x7fbf280663c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 --2- 172.21.15.18:0/91430581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a29261fa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbf24016560 tx=0x7fbf2400a340 comp rx=0 tx=0).stop 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 -- 172.21.15.18:0/91430581 shutdown_connections 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 --2- 172.21.15.18:0/91430581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a29261fa0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 --2- 172.21.15.18:0/91430581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a2925f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 --2- 172.21.15.18:0/91430581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a29254db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 -- 172.21.15.18:0/91430581 >> 172.21.15.18:0/91430581 conn(0x556a29250f60 msgr2=0x556a29251340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 -- 172.21.15.18:0/91430581 shutdown_connections 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 -- 172.21.15.18:0/91430581 wait complete. 2024-09-19T09:51:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 -- start start 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.308+0000 7fbf3a185740 1 Processor -- start 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292549d0 0x556a2925f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a2925c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a2925fbb0 0x556a2925cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf3a185740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556a29262780 con 0x556a292549d0 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf3a185740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556a29175f20 con 0x556a292552f0 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf3a185740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556a29262900 con 0x556a2925fbb0 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf3a185740 10 client.0 _ll_register_callbacks cb 0x556a2913f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35347640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292549d0 0x556a2925f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35347640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292549d0 0x556a2925f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51102/0 (socket says 172.21.15.18:51102) 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35347640 1 -- 172.21.15.18:0/2322186070 learned_addr learned my addr 172.21.15.18:0/2322186070 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35b48640 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a2925c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35347640 1 -- 172.21.15.18:0/2322186070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a2925fbb0 msgr2=0x556a2925cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35347640 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a2925fbb0 0x556a2925cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35347640 1 -- 172.21.15.18:0/2322186070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 msgr2=0x556a2925c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35347640 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a2925c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35347640 1 -- 172.21.15.18:0/2322186070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a28f2c2b0 con 0x556a292549d0 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35b48640 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a2925c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf35347640 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292549d0 0x556a2925f500 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbf24006a70 tx=0x7fbf2400aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade77ae3b8ceafd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.309+0000 7fbf157fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf157fa640 1 -- 172.21.15.18:0/2322186070 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24018840 con 0x556a292549d0 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf157fa640 1 -- 172.21.15.18:0/2322186070 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbf24017670 con 0x556a292549d0 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf3a185740 1 -- 172.21.15.18:0/2322186070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf24018ab0 con 0x556a292549d0 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf157fa640 1 -- 172.21.15.18:0/2322186070 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbf24017890 con 0x556a292549d0 2024-09-19T09:51:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf3a185740 10 client.15012 fetch_fsmap learned FSMap version 27 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf3a185740 1 -- 172.21.15.18:0/2322186070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556a2926e180 con 0x556a292549d0 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf157fa640 1 -- 172.21.15.18:0/2322186070 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf24018ab0 con 0x556a292549d0 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf157fa640 1 -- 172.21.15.18:0/2322186070 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbf24012050 con 0x556a292549d0 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf3a185740 10 client.15012 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf3a185740 10 client.15012 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf3a185740 20 client.15012 populate_metadata read hostname 'smithi018' 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf3a185740 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x556a2926f530 0x556a292716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf3a185740 4 client.15012 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.310+0000 7fbf3a185740 1 -- 172.21.15.18:0/2322186070 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a291c8600 con 0x556a2926f530 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.311+0000 7fbf35b48640 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x556a2926f530 0x556a292716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.311+0000 7fbf35b48640 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x556a2926f530 0x556a292716e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77c12547f3ea61e5 server_cookie=58b7b60ba7442512 in_seq=0 out_seq=0 2024-09-19T09:51:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.311+0000 7fbf157fa640 10 client.15012 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:51:54.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf157fa640 1 -- 172.21.15.18:0/2322186070 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a291c8600 con 0x556a2926f530 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf157fa640 10 client.15012 handle_command_reply: tid=0 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 client.15012 shutdown 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 -- 172.21.15.18:0/2322186070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292549d0 msgr2=0x556a2925f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292549d0 0x556a2925f500 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbf24006a70 tx=0x7fbf2400aaa0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 -- 172.21.15.18:0/2322186070 shutdown_connections 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x556a2926f530 0x556a292716e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a2925fbb0 0x556a2925cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a2925c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 --2- 172.21.15.18:0/2322186070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292549d0 0x556a2925f500 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf157fa640 0 client.15012 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 -- 172.21.15.18:0/2322186070 >> 172.21.15.18:0/2322186070 conn(0x556a29250f60 msgr2=0x556a29256c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 -- 172.21.15.18:0/2322186070 shutdown_connections 2024-09-19T09:51:54.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 1 -- 172.21.15.18:0/2322186070 wait complete. 2024-09-19T09:51:54.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.312+0000 7fbf3a185740 20 client.15012 trim_cache size 0 max 16384 2024-09-19T09:51:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.330+0000 7fbf3a185740 1 Processor -- start 2024-09-19T09:51:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.330+0000 7fbf3a185740 1 -- start start 2024-09-19T09:51:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.330+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a2926fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.330+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a29271010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.330+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a2925c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.330+0000 7fbf3a185740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556a2926fa20 con 0x556a2925fbb0 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.330+0000 7fbf3a185740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556a292700f0 con 0x556a292552f0 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.330+0000 7fbf3a185740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556a292707c0 con 0x556a292549d0 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35347640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a2925c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35347640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a2925c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51106/0 (socket says 172.21.15.18:51106) 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35347640 1 -- 172.21.15.18:0/881504675 learned_addr learned my addr 172.21.15.18:0/881504675 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35347640 1 --2- 172.21.15.18:0/881504675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a2926fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35b48640 1 --2- 172.21.15.18:0/881504675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a29271010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35347640 1 -- 172.21.15.18:0/881504675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 msgr2=0x556a2926fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35347640 1 --2- 172.21.15.18:0/881504675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a2926fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35347640 1 -- 172.21.15.18:0/881504675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 msgr2=0x556a29271010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35347640 1 --2- 172.21.15.18:0/881504675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a29271010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35347640 1 -- 172.21.15.18:0/881504675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a2925d390 con 0x556a2925fbb0 2024-09-19T09:51:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf35347640 1 --2- 172.21.15.18:0/881504675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a2925c130 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbf24006b50 tx=0x7fbf24000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d722c148face7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf177fe640 1 -- 172.21.15.18:0/881504675 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2400a730 con 0x556a2925fbb0 2024-09-19T09:51:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf177fe640 1 -- 172.21.15.18:0/881504675 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf24026070 con 0x556a2925fbb0 2024-09-19T09:51:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.331+0000 7fbf177fe640 1 -- 172.21.15.18:0/881504675 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24017240 con 0x556a2925fbb0 2024-09-19T09:51:54.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 -- 172.21.15.18:0/881504675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 msgr2=0x556a2925c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 --2- 172.21.15.18:0/881504675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a2925c130 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbf24006b50 tx=0x7fbf24000bc0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 -- 172.21.15.18:0/881504675 shutdown_connections 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 --2- 172.21.15.18:0/881504675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a2925fbb0 0x556a2925c130 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 --2- 172.21.15.18:0/881504675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a292552f0 0x556a29271010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 --2- 172.21.15.18:0/881504675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a2926fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 -- 172.21.15.18:0/881504675 >> 172.21.15.18:0/881504675 conn(0x556a29250f60 msgr2=0x556a29251340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 -- 172.21.15.18:0/881504675 shutdown_connections 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 -- 172.21.15.18:0/881504675 wait complete. 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 -- start start 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.332+0000 7fbf3a185740 1 Processor -- start 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a29272de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292552f0 0x556a29273320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf3a185740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a2925fbb0 0x556a292e1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf3a185740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556a29271560 con 0x556a292552f0 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf3a185740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556a29270e90 con 0x556a2925fbb0 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf3a185740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556a29271c30 con 0x556a292549d0 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf3a185740 10 client.0 _ll_register_callbacks cb 0x7fbf20009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35b48640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292552f0 0x556a29273320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35b48640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292552f0 0x556a29273320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51108/0 (socket says 172.21.15.18:51108) 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35b48640 1 -- 172.21.15.18:0/3132303344 learned_addr learned my addr 172.21.15.18:0/3132303344 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35347640 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a29272de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35347640 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a2925fbb0 0x556a292e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35b48640 1 -- 172.21.15.18:0/3132303344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 msgr2=0x556a29272de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35b48640 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a29272de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35b48640 1 -- 172.21.15.18:0/3132303344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a2925fbb0 msgr2=0x556a292e1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35b48640 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a2925fbb0 0x556a292e1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35b48640 1 -- 172.21.15.18:0/3132303344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a292e16f0 con 0x556a292552f0 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.333+0000 7fbf35347640 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a29272de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf35b48640 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292552f0 0x556a29273320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf20035000 tx=0x7fbf20031d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689e3d1737022134 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf157fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf157fa640 1 -- 172.21.15.18:0/3132303344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20003d80 con 0x556a292552f0 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf3a185740 1 -- 172.21.15.18:0/3132303344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf24026070 con 0x556a292552f0 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf157fa640 1 -- 172.21.15.18:0/3132303344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbf20031450 con 0x556a292552f0 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf157fa640 1 -- 172.21.15.18:0/3132303344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbf20031650 con 0x556a292552f0 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf3a185740 10 client.15018 fetch_fsmap learned FSMap version 27 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf3a185740 1 -- 172.21.15.18:0/3132303344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556a292e2a50 con 0x556a292552f0 2024-09-19T09:51:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf157fa640 1 -- 172.21.15.18:0/3132303344 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf24026070 con 0x556a292552f0 2024-09-19T09:51:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf157fa640 1 -- 172.21.15.18:0/3132303344 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbf2002f610 con 0x556a292552f0 2024-09-19T09:51:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf3a185740 10 client.15018 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:51:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf3a185740 10 client.15018 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:51:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf3a185740 20 client.15018 populate_metadata read hostname 'smithi018' 2024-09-19T09:51:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf3a185740 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x556a292e7600 0x556a292e6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf3a185740 4 client.15018 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:51:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.334+0000 7fbf3a185740 1 -- 172.21.15.18:0/3132303344 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "status"}) -- 0x556a291c2b10 con 0x556a292e7600 2024-09-19T09:51:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.335+0000 7fbf35347640 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x556a292e7600 0x556a292e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.335+0000 7fbf35347640 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x556a292e7600 0x556a292e6310 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8fcca8fb4ba3ea3f server_cookie=a86fd681eb1b418b in_seq=0 out_seq=0 2024-09-19T09:51:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.335+0000 7fbf157fa640 10 client.15018 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.335+0000 7fbf157fa640 1 -- 172.21.15.18:0/3132303344 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556a291c2b10 con 0x556a292e7600 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.335+0000 7fbf157fa640 10 client.15018 handle_command_reply: tid=0 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.335+0000 7fbf3a185740 1 client.15018 shutdown 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.335+0000 7fbf3a185740 1 -- 172.21.15.18:0/3132303344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292552f0 msgr2=0x556a29273320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.335+0000 7fbf3a185740 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292552f0 0x556a29273320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf20035000 tx=0x7fbf20031d10 comp rx=0 tx=0).stop 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.335+0000 7fbf3a185740 1 -- 172.21.15.18:0/3132303344 shutdown_connections 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf3a185740 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x556a292e7600 0x556a292e6310 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf3a185740 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a2925fbb0 0x556a292e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf3a185740 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a292552f0 0x556a29273320 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf3a185740 1 --2- 172.21.15.18:0/3132303344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556a292549d0 0x556a29272de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf3a185740 1 -- 172.21.15.18:0/3132303344 >> 172.21.15.18:0/3132303344 conn(0x556a29250f60 msgr2=0x556a29256c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf157fa640 0 client.15018 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:51:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf3a185740 1 -- 172.21.15.18:0/3132303344 shutdown_connections 2024-09-19T09:51:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf3a185740 1 -- 172.21.15.18:0/3132303344 wait complete. 2024-09-19T09:51:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf3a185740 20 client.15018 trim_cache size 0 max 16384 2024-09-19T09:51:54.345 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:51:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:51:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 2, 2024-09-19T09:51:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24484, 2024-09-19T09:51:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:51:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:51:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:51:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 75.934395499000004, 2024-09-19T09:51:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-09-19T09:51:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:51:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:51:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 103.365655584 2024-09-19T09:51:54.346 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:51:54.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 -- 172.21.15.18:0/2952883346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf180a32d0 msgr2=0x7fbf180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf180a32d0 0x7fbf180a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf28098400 tx=0x7fbf280663c0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 -- 172.21.15.18:0/2952883346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30106f10 msgr2=0x7fbf30074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30106f10 0x7fbf30074f70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800d750 tx=0x7fbf2800dc10 comp rx=0 tx=0).stop 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 -- 172.21.15.18:0/2952883346 shutdown_connections 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf180a32d0 0x7fbf180a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf30106f10 0x7fbf30074f70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf30102790 0x7fbf30074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 --2- 172.21.15.18:0/2952883346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf30101de0 0x7fbf300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 -- 172.21.15.18:0/2952883346 >> 172.21.15.18:0/2952883346 conn(0x7fbf300fd8c0 msgr2=0x7fbf300fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 -- 172.21.15.18:0/2952883346 shutdown_connections 2024-09-19T09:51:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:54.336+0000 7fbf37dac640 1 -- 172.21.15.18:0/2952883346 wait complete. 2024-09-19T09:51:55.090 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:51:55.348 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:55.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.759+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2306638898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a54106f10 msgr2=0x7f9a5410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:55.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.759+0000 7f9a5b75a640 1 --2- 172.21.15.18:0/2306638898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a54106f10 0x7f9a5410ea90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009ca0 tx=0x7f9a4c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.759+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2306638898 shutdown_connections 2024-09-19T09:51:55.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.759+0000 7f9a5b75a640 1 --2- 172.21.15.18:0/2306638898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a54106f10 0x7f9a5410ea90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.759+0000 7f9a5b75a640 1 --2- 172.21.15.18:0/2306638898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a54102790 0x7f9a541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.759+0000 7f9a5b75a640 1 --2- 172.21.15.18:0/2306638898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a54101de0 0x7f9a541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.759+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2306638898 >> 172.21.15.18:0/2306638898 conn(0x7f9a540fd8c0 msgr2=0x7f9a540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.759+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2306638898 shutdown_connections 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.759+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2306638898 wait complete. 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a5b75a640 1 Processor -- start 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a5b75a640 1 -- start start 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a5b75a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a54101de0 0x7f9a54198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a5b75a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a54102790 0x7f9a541988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a5b75a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a54106f10 0x7f9a5419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a5b75a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a54111f70 con 0x7f9a54101de0 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a5b75a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9a54111df0 con 0x7f9a54102790 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a5b75a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a541120f0 con 0x7f9a54106f10 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a594f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a54101de0 0x7f9a54198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a594f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a54101de0 0x7f9a54198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51120/0 (socket says 172.21.15.18:51120) 2024-09-19T09:51:55.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a594f6640 1 -- 172.21.15.18:0/2479985341 learned_addr learned my addr 172.21.15.18:0/2479985341 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a58cf5640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a54102790 0x7f9a541988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a594f6640 1 -- 172.21.15.18:0/2479985341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a54106f10 msgr2=0x7f9a5419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.760+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a54106f10 0x7f9a5419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.761+0000 7f9a594f6640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a54106f10 0x7f9a5419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.761+0000 7f9a594f6640 1 -- 172.21.15.18:0/2479985341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a54102790 msgr2=0x7f9a541988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.761+0000 7f9a594f6640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a54102790 0x7f9a541988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.761+0000 7f9a594f6640 1 -- 172.21.15.18:0/2479985341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5419d340 con 0x7f9a54101de0 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.761+0000 7f9a594f6640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a54101de0 0x7f9a54198390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000c920 tx=0x7f9a5000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.761+0000 7f9a4a7fc640 1 -- 172.21.15.18:0/2479985341 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50007c70 con 0x7f9a54101de0 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.761+0000 7f9a4a7fc640 1 -- 172.21.15.18:0/2479985341 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a50007e10 con 0x7f9a54101de0 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.761+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2479985341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5419d630 con 0x7f9a54101de0 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.761+0000 7f9a4a7fc640 1 -- 172.21.15.18:0/2479985341 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50018890 con 0x7f9a54101de0 2024-09-19T09:51:55.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.761+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2479985341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a541a4f10 con 0x7f9a54101de0 2024-09-19T09:51:55.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.763+0000 7f9a4a7fc640 1 -- 172.21.15.18:0/2479985341 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9a50018b30 con 0x7f9a54101de0 2024-09-19T09:51:55.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a5db33740 1 Processor -- start 2024-09-19T09:51:55.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a5db33740 1 -- start start 2024-09-19T09:51:55.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b17db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b182f0 0x560787b22670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b22bb0 0x560787b24fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a5db33740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560787a7e090 con 0x560787b182f0 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a5db33740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560787a25a70 con 0x560787b22bb0 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a5db33740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560787a7a050 con 0x560787b179d0 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a4a7fc640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a400a32d0 0x7f9a400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a594f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b182f0 0x560787b22670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a594f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b182f0 0x560787b22670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51126/0 (socket says 172.21.15.18:51126) 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a594f6640 1 -- 172.21.15.18:0/1993646819 learned_addr learned my addr 172.21.15.18:0/1993646819 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.764+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a400a32d0 0x7f9a400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a58cf5640 1 --2- 172.21.15.18:0/1993646819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b22bb0 0x560787b24fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/1993646819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b17db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a4a7fc640 1 -- 172.21.15.18:0/2479985341 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9a500cfc20 con 0x7f9a54101de0 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a594f6640 1 -- 172.21.15.18:0/1993646819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 msgr2=0x560787b17db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a594f6640 1 --2- 172.21.15.18:0/1993646819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b17db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a594f6640 1 -- 172.21.15.18:0/1993646819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b22bb0 msgr2=0x560787b24fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a594f6640 1 --2- 172.21.15.18:0/1993646819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b22bb0 0x560787b24fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a594f6640 1 -- 172.21.15.18:0/1993646819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560787a32130 con 0x560787b182f0 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a58cf5640 1 --2- 172.21.15.18:0/1993646819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b22bb0 0x560787b24fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a400a32d0 0x7f9a400a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009bf0 tx=0x7f9a4c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a594f6640 1 --2- 172.21.15.18:0/1993646819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b182f0 0x560787b22670 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a50098a80 tx=0x7f9a5000ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb37c180e65ece5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a3f7fe640 1 -- 172.21.15.18:0/1993646819 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50018e20 con 0x560787b182f0 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a3f7fe640 1 -- 172.21.15.18:0/1993646819 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a500a0460 con 0x560787b182f0 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.765+0000 7f9a3f7fe640 1 -- 172.21.15.18:0/1993646819 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a500cd7f0 con 0x560787b182f0 2024-09-19T09:51:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.766+0000 7f9a5db33740 1 -- 172.21.15.18:0/1993646819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b182f0 msgr2=0x560787b22670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:55.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.766+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1993646819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b182f0 0x560787b22670 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a50098a80 tx=0x7f9a5000ff30 comp rx=0 tx=0).stop 2024-09-19T09:51:55.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.766+0000 7f9a5db33740 1 -- 172.21.15.18:0/1993646819 shutdown_connections 2024-09-19T09:51:55.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.766+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1993646819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b22bb0 0x560787b24fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.766+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1993646819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b182f0 0x560787b22670 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.766+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1993646819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b17db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.766+0000 7f9a5db33740 1 -- 172.21.15.18:0/1993646819 >> 172.21.15.18:0/1993646819 conn(0x560787b13f60 msgr2=0x560787b14340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:55.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.766+0000 7f9a5db33740 1 -- 172.21.15.18:0/1993646819 shutdown_connections 2024-09-19T09:51:55.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.766+0000 7f9a5db33740 1 -- 172.21.15.18:0/1993646819 wait complete. 2024-09-19T09:51:55.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.766+0000 7f9a5db33740 1 -- start start 2024-09-19T09:51:55.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a5db33740 1 Processor -- start 2024-09-19T09:51:55.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b179d0 0x560787b223e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b182f0 0x560787b1f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a5db33740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560787b25780 con 0x560787b22bb0 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a5db33740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560787a38f20 con 0x560787b179d0 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a5db33740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560787b25900 con 0x560787b182f0 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a5db33740 10 client.0 _ll_register_callbacks cb 0x560787a02030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a59cf7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a59cf7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51140/0 (socket says 172.21.15.18:51140) 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a59cf7640 1 -- 172.21.15.18:0/1507403704 learned_addr learned my addr 172.21.15.18:0/1507403704 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a594f6640 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b179d0 0x560787b223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a58cf5640 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b182f0 0x560787b1f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a59cf7640 1 -- 172.21.15.18:0/1507403704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b182f0 msgr2=0x560787b1f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b182f0 0x560787b1f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a59cf7640 1 -- 172.21.15.18:0/1507403704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b179d0 msgr2=0x560787b223e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b179d0 0x560787b223e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.767+0000 7f9a59cf7640 1 -- 172.21.15.18:0/1507403704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607877ef2b0 con 0x560787b22bb0 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a58cf5640 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b182f0 0x560787b1f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1fc70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c003dc0 tx=0x7f9a4c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910eeaef908ad811 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1507403704 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c04e030 con 0x560787b22bb0 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a5db33740 1 -- 172.21.15.18:0/1507403704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a500a0460 con 0x560787b22bb0 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1507403704 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9a4c031820 con 0x560787b22bb0 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1507403704 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9a4c0045c0 con 0x560787b22bb0 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a5db33740 10 client.15030 fetch_fsmap learned FSMap version 27 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a5db33740 1 -- 172.21.15.18:0/1507403704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560787b31080 con 0x560787b22bb0 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1507403704 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a500a0460 con 0x560787b22bb0 2024-09-19T09:51:55.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1507403704 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9a4c0305c0 con 0x560787b22bb0 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.768+0000 7f9a5db33740 10 client.15030 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.769+0000 7f9a5db33740 10 client.15030 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.769+0000 7f9a5db33740 20 client.15030 populate_metadata read hostname 'smithi018' 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.769+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560787b33700 0x560787b34b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.769+0000 7f9a5db33740 4 client.15030 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.769+0000 7f9a5db33740 1 -- 172.21.15.18:0/1507403704 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560787a8b600 con 0x560787b33700 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.769+0000 7f9a594f6640 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560787b33700 0x560787b34b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.769+0000 7f9a594f6640 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560787b33700 0x560787b34b70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=62a713e2837a5469 server_cookie=bbce006533c2dbac in_seq=0 out_seq=0 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.769+0000 7f9a3cff9640 10 client.15030 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.770+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1507403704 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560787a8b600 con 0x560787b33700 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.770+0000 7f9a3cff9640 10 client.15030 handle_command_reply: tid=0 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.770+0000 7f9a5db33740 1 client.15030 shutdown 2024-09-19T09:51:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.770+0000 7f9a5db33740 1 -- 172.21.15.18:0/1507403704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 msgr2=0x560787b1fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.770+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1fc70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c003dc0 tx=0x7f9a4c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.770+0000 7f9a5db33740 1 -- 172.21.15.18:0/1507403704 shutdown_connections 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.770+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560787b33700 0x560787b34b70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.771+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1fc70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.771+0000 7f9a3cff9640 0 client.15030 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.771+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b182f0 0x560787b1f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.771+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1507403704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b179d0 0x560787b223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.771+0000 7f9a5db33740 1 -- 172.21.15.18:0/1507403704 >> 172.21.15.18:0/1507403704 conn(0x560787b13f60 msgr2=0x560787b19c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.771+0000 7f9a5db33740 1 -- 172.21.15.18:0/1507403704 shutdown_connections 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.771+0000 7f9a5db33740 1 -- 172.21.15.18:0/1507403704 wait complete. 2024-09-19T09:51:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.771+0000 7f9a5db33740 20 client.15030 trim_cache size 0 max 16384 2024-09-19T09:51:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.789+0000 7f9a5db33740 1 Processor -- start 2024-09-19T09:51:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.789+0000 7f9a5db33740 1 -- start start 2024-09-19T09:51:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.789+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b135d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.789+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 0x560787b1eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.789+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.789+0000 7f9a5db33740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560787b32eb0 con 0x560787b22bb0 2024-09-19T09:51:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.789+0000 7f9a5db33740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560787b33580 con 0x560787b182f0 2024-09-19T09:51:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.789+0000 7f9a5db33740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560787b33c50 con 0x560787b179d0 2024-09-19T09:51:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.789+0000 7f9a59cf7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a59cf7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51148/0 (socket says 172.21.15.18:51148) 2024-09-19T09:51:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a59cf7640 1 -- 172.21.15.18:0/3969296749 learned_addr learned my addr 172.21.15.18:0/3969296749 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a594f6640 1 --2- 172.21.15.18:0/3969296749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a58cf5640 1 --2- 172.21.15.18:0/3969296749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 0x560787b1eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a59cf7640 1 -- 172.21.15.18:0/3969296749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 msgr2=0x560787b135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/3969296749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b135d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a59cf7640 1 -- 172.21.15.18:0/3969296749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 msgr2=0x560787b1eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/3969296749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 0x560787b1eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a59cf7640 1 -- 172.21.15.18:0/3969296749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560787b25890 con 0x560787b22bb0 2024-09-19T09:51:55.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/3969296749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1e000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009620 tx=0x7f9a4c02f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2f83db0037fd8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:55.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a3effd640 1 -- 172.21.15.18:0/3969296749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c04e040 con 0x560787b22bb0 2024-09-19T09:51:55.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a3effd640 1 -- 172.21.15.18:0/3969296749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a4c036050 con 0x560787b22bb0 2024-09-19T09:51:55.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.790+0000 7f9a3effd640 1 -- 172.21.15.18:0/3969296749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c02faf0 con 0x560787b22bb0 2024-09-19T09:51:55.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 -- 172.21.15.18:0/3969296749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 msgr2=0x560787b1e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:55.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 --2- 172.21.15.18:0/3969296749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1e000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009620 tx=0x7f9a4c02f490 comp rx=0 tx=0).stop 2024-09-19T09:51:55.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 -- 172.21.15.18:0/3969296749 shutdown_connections 2024-09-19T09:51:55.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 --2- 172.21.15.18:0/3969296749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b1e000 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 --2- 172.21.15.18:0/3969296749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 0x560787b1eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 --2- 172.21.15.18:0/3969296749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 -- 172.21.15.18:0/3969296749 >> 172.21.15.18:0/3969296749 conn(0x560787b13f60 msgr2=0x560787b1f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 -- 172.21.15.18:0/3969296749 shutdown_connections 2024-09-19T09:51:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 -- 172.21.15.18:0/3969296749 wait complete. 2024-09-19T09:51:55.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 -- start start 2024-09-19T09:51:55.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.791+0000 7f9a5db33740 1 Processor -- start 2024-09-19T09:51:55.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b3cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 0x560787b3d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a5db33740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b38320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a5db33740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560787b349f0 con 0x560787b22bb0 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a5db33740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560787b34320 con 0x560787b182f0 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a5db33740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560787b350c0 con 0x560787b179d0 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a5db33740 10 client.0 _ll_register_callbacks cb 0x7f9a4c003ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a59cf7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b38320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a59cf7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b38320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51156/0 (socket says 172.21.15.18:51156) 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a59cf7640 1 -- 172.21.15.18:0/1393774801 learned_addr learned my addr 172.21.15.18:0/1393774801 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a58cf5640 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 0x560787b3d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a594f6640 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b3cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a59cf7640 1 -- 172.21.15.18:0/1393774801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 msgr2=0x560787b3cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b3cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a59cf7640 1 -- 172.21.15.18:0/1393774801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 msgr2=0x560787b3d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:55.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 0x560787b3d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a59cf7640 1 -- 172.21.15.18:0/1393774801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560787b38b50 con 0x560787b22bb0 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a594f6640 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b3cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a58cf5640 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 0x560787b3d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a59cf7640 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b38320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0309c0 tx=0x7f9a4c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81172a082b70413 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.792+0000 7f9a3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1393774801 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c04e040 con 0x560787b22bb0 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1393774801 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9a4c02f610 con 0x560787b22bb0 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a5db33740 1 -- 172.21.15.18:0/1393774801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a4c036050 con 0x560787b22bb0 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1393774801 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9a4c06d070 con 0x560787b22bb0 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a5db33740 10 client.15036 fetch_fsmap learned FSMap version 27 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a5db33740 1 -- 172.21.15.18:0/1393774801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560787b9d8f0 con 0x560787b22bb0 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1393774801 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a4c036050 con 0x560787b22bb0 2024-09-19T09:51:55.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1393774801 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9a4c065030 con 0x560787b22bb0 2024-09-19T09:51:55.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a5db33740 10 client.15036 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:51:55.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a5db33740 10 client.15036 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:51:55.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a5db33740 20 client.15036 populate_metadata read hostname 'smithi018' 2024-09-19T09:51:55.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560787ba20f0 0x560787ba0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:55.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a5db33740 4 client.15036 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:51:55.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a5db33740 1 -- 172.21.15.18:0/1393774801 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "status"}) -- 0x560787a85b10 con 0x560787ba20f0 2024-09-19T09:51:55.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.793+0000 7f9a594f6640 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560787ba20f0 0x560787ba0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:55.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a3cff9640 10 client.15036 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:51:55.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a594f6640 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560787ba20f0 0x560787ba0e00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe4a9229aa5d951e server_cookie=337b9dd723815d5 in_seq=0 out_seq=0 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a3cff9640 1 -- 172.21.15.18:0/1393774801 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560787a85b10 con 0x560787ba20f0 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a3cff9640 10 client.15036 handle_command_reply: tid=0 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a5db33740 1 client.15036 shutdown 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a5db33740 1 -- 172.21.15.18:0/1393774801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 msgr2=0x560787b38320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b38320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0309c0 tx=0x7f9a4c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a5db33740 1 -- 172.21.15.18:0/1393774801 shutdown_connections 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560787ba20f0 0x560787ba0e00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560787b22bb0 0x560787b38320 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560787b182f0 0x560787b3d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a5db33740 1 --2- 172.21.15.18:0/1393774801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560787b179d0 0x560787b3cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a5db33740 1 -- 172.21.15.18:0/1393774801 >> 172.21.15.18:0/1393774801 conn(0x560787b13f60 msgr2=0x560787b1dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a3cff9640 0 client.15036 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:51:55.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.794+0000 7f9a5db33740 1 -- 172.21.15.18:0/1393774801 shutdown_connections 2024-09-19T09:51:55.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5db33740 1 -- 172.21.15.18:0/1393774801 wait complete. 2024-09-19T09:51:55.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5db33740 20 client.15036 trim_cache size 0 max 16384 2024-09-19T09:51:55.807 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:51:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:51:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 1, 2024-09-19T09:51:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24488, 2024-09-19T09:51:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:51:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:51:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:51:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 78.407587681999999, 2024-09-19T09:51:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-09-19T09:51:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:51:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:51:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 107.246129258 2024-09-19T09:51:55.808 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2479985341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a400a32d0 msgr2=0x7f9a400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a400a32d0 0x7f9a400a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009bf0 tx=0x7f9a4c005ef0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2479985341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a54101de0 msgr2=0x7f9a54198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a54101de0 0x7f9a54198390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000c920 tx=0x7f9a5000cde0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2479985341 shutdown_connections 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a400a32d0 0x7f9a400a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a54106f10 0x7f9a5419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a54102790 0x7f9a541988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 --2- 172.21.15.18:0/2479985341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a54101de0 0x7f9a54198390 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2479985341 >> 172.21.15.18:0/2479985341 conn(0x7f9a540fd8c0 msgr2=0x7f9a540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2479985341 shutdown_connections 2024-09-19T09:51:55.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:55.795+0000 7f9a5b75a640 1 -- 172.21.15.18:0/2479985341 wait complete. 2024-09-19T09:51:56.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:55 smithi018 ceph-mon[30956]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:51:56.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:55 smithi049 ceph-mon[34858]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:51:56.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:55 smithi162 ceph-mon[35174]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:51:56.498 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:51:56.755 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:57.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.162+0000 7f46ab87d640 1 -- 172.21.15.18:0/3282164979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46a4100e20 msgr2=0x7f46a4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:57.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.162+0000 7f46ab87d640 1 --2- 172.21.15.18:0/3282164979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46a4100e20 0x7f46a4101200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4690009ca0 tx=0x7f469002a950 comp rx=0 tx=0).stop 2024-09-19T09:51:57.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.162+0000 7f46ab87d640 1 -- 172.21.15.18:0/3282164979 shutdown_connections 2024-09-19T09:51:57.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.162+0000 7f46ab87d640 1 --2- 172.21.15.18:0/3282164979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a4102ef0 0x7f46a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.162+0000 7f46ab87d640 1 --2- 172.21.15.18:0/3282164979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46a4102570 0x7f46a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.162+0000 7f46ab87d640 1 --2- 172.21.15.18:0/3282164979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46a4100e20 0x7f46a4101200 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.162+0000 7f46ab87d640 1 -- 172.21.15.18:0/3282164979 >> 172.21.15.18:0/3282164979 conn(0x7f46a40fc7d0 msgr2=0x7f46a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:57.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.163+0000 7f46ab87d640 1 -- 172.21.15.18:0/3282164979 shutdown_connections 2024-09-19T09:51:57.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.163+0000 7f46ab87d640 1 -- 172.21.15.18:0/3282164979 wait complete. 2024-09-19T09:51:57.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.163+0000 7f46ab87d640 1 Processor -- start 2024-09-19T09:51:57.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.163+0000 7f46ab87d640 1 -- start start 2024-09-19T09:51:57.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46ab87d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a4100e20 0x7f46a4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46ab87d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46a4102570 0x7f46a4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46ab87d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46a4102ef0 0x7f46a419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46ab87d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4110f80 con 0x7f46a4102ef0 2024-09-19T09:51:57.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46ab87d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4110e00 con 0x7f46a4102570 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46ab87d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4111100 con 0x7f46a4100e20 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a9e1a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46a4102ef0 0x7f46a419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a9e1a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46a4102ef0 0x7f46a419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33712/0 (socket says 172.21.15.18:33712) 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a9e1a640 1 -- 172.21.15.18:0/3027322493 learned_addr learned my addr 172.21.15.18:0/3027322493 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a9619640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a4100e20 0x7f46a4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46a4102570 0x7f46a4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a9e1a640 1 -- 172.21.15.18:0/3027322493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a4100e20 msgr2=0x7f46a4198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a9e1a640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a4100e20 0x7f46a4198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a9e1a640 1 -- 172.21.15.18:0/3027322493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46a4102570 msgr2=0x7f46a4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a9e1a640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46a4102570 0x7f46a4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a9e1a640 1 -- 172.21.15.18:0/3027322493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a419d4b0 con 0x7f46a4102ef0 2024-09-19T09:51:57.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.164+0000 7f46a9e1a640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46a4102ef0 0x7f46a419cdd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f469c00d750 tx=0x7f469c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:57.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.165+0000 7f46a27fc640 1 -- 172.21.15.18:0/3027322493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c017070 con 0x7f46a4102ef0 2024-09-19T09:51:57.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.165+0000 7f46ab87d640 1 -- 172.21.15.18:0/3027322493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a419d7a0 con 0x7f46a4102ef0 2024-09-19T09:51:57.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.165+0000 7f46a27fc640 1 -- 172.21.15.18:0/3027322493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f469c005500 con 0x7f46a4102ef0 2024-09-19T09:51:57.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.165+0000 7f46a27fc640 1 -- 172.21.15.18:0/3027322493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c004d90 con 0x7f46a4102ef0 2024-09-19T09:51:57.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.165+0000 7f46ab87d640 1 -- 172.21.15.18:0/3027322493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a41a5080 con 0x7f46a4102ef0 2024-09-19T09:51:57.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.168+0000 7f46adc56740 1 Processor -- start 2024-09-19T09:51:57.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.168+0000 7f46a27fc640 1 -- 172.21.15.18:0/3027322493 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f469c005020 con 0x7f46a4102ef0 2024-09-19T09:51:57.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.168+0000 7f46adc56740 1 -- start start 2024-09-19T09:51:57.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46adc56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 0x55a9823addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46adc56740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ae2f0 0x55a9823b8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46adc56740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823bafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46adc56740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a982314090 con 0x55a9823b8bb0 2024-09-19T09:51:57.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46adc56740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a9822bba70 con 0x55a9823ae2f0 2024-09-19T09:51:57.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46adc56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a982310050 con 0x55a9823ad9d0 2024-09-19T09:51:57.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a8e18640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823bafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a8e18640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823bafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33726/0 (socket says 172.21.15.18:33726) 2024-09-19T09:51:57.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a8e18640 1 -- 172.21.15.18:0/783508326 learned_addr learned my addr 172.21.15.18:0/783508326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a8e18640 1 --2- 172.21.15.18:0/783508326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 0x55a9823addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a9619640 1 --2- 172.21.15.18:0/783508326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ae2f0 0x55a9823b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a27fc640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46940a3350 0x7f46940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a8e18640 1 -- 172.21.15.18:0/783508326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 msgr2=0x55a9823addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a8e18640 1 --2- 172.21.15.18:0/783508326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 0x55a9823addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a8e18640 1 -- 172.21.15.18:0/783508326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ae2f0 msgr2=0x55a9823b8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a8e18640 1 --2- 172.21.15.18:0/783508326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ae2f0 0x55a9823b8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a8e18640 1 -- 172.21.15.18:0/783508326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9822c8130 con 0x55a9823b8bb0 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.169+0000 7f46a9e1a640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46940a3350 0x7f46940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.170+0000 7f46a27fc640 1 -- 172.21.15.18:0/3027322493 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f469c0cf340 con 0x7f46a4102ef0 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.170+0000 7f46a8e18640 1 --2- 172.21.15.18:0/783508326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823bafa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f46980127c0 tx=0x7f469800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b4d92645668722 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.170+0000 7f468f7fe640 1 -- 172.21.15.18:0/783508326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698012e00 con 0x55a9823b8bb0 2024-09-19T09:51:57.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.170+0000 7f468f7fe640 1 -- 172.21.15.18:0/783508326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4698010c50 con 0x55a9823b8bb0 2024-09-19T09:51:57.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.170+0000 7f468f7fe640 1 -- 172.21.15.18:0/783508326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469801eb50 con 0x55a9823b8bb0 2024-09-19T09:51:57.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.170+0000 7f46a9e1a640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46940a3350 0x7f46940a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f469c009610 tx=0x7f469c086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:57.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 -- 172.21.15.18:0/783508326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 msgr2=0x55a9823bafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:57.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 --2- 172.21.15.18:0/783508326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823bafa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f46980127c0 tx=0x7f469800b7c0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 -- 172.21.15.18:0/783508326 shutdown_connections 2024-09-19T09:51:57.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 --2- 172.21.15.18:0/783508326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823bafa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 --2- 172.21.15.18:0/783508326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ae2f0 0x55a9823b8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 --2- 172.21.15.18:0/783508326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 0x55a9823addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 -- 172.21.15.18:0/783508326 >> 172.21.15.18:0/783508326 conn(0x55a9823a9f60 msgr2=0x55a9823aa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:57.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 -- 172.21.15.18:0/783508326 shutdown_connections 2024-09-19T09:51:57.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 -- 172.21.15.18:0/783508326 wait complete. 2024-09-19T09:51:57.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 -- start start 2024-09-19T09:51:57.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.171+0000 7f46adc56740 1 Processor -- start 2024-09-19T09:51:57.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46adc56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 0x55a9823b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46adc56740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823b5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46adc56740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823b8bb0 0x55a9823b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46adc56740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a9823bb780 con 0x55a9823ae2f0 2024-09-19T09:51:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46adc56740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a9822cef20 con 0x55a9823b8bb0 2024-09-19T09:51:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46adc56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a9823bb900 con 0x55a9823ad9d0 2024-09-19T09:51:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46adc56740 10 client.0 _ll_register_callbacks cb 0x55a982298030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:51:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a9619640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a9619640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823b5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33738/0 (socket says 172.21.15.18:33738) 2024-09-19T09:51:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a9619640 1 -- 172.21.15.18:0/3013854257 learned_addr learned my addr 172.21.15.18:0/3013854257 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 0x55a9823b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823b8bb0 0x55a9823b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a9619640 1 -- 172.21.15.18:0/3013854257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 msgr2=0x55a9823b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a9619640 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 0x55a9823b8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a9619640 1 -- 172.21.15.18:0/3013854257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823b8bb0 msgr2=0x55a9823b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a9619640 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823b8bb0 0x55a9823b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a9619640 1 -- 172.21.15.18:0/3013854257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9820852b0 con 0x55a9823ae2f0 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.172+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 0x55a9823b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f46a9619640 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823b5780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4690006010 tx=0x7f469002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d888bf4e91940f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f468cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f468cff9640 1 -- 172.21.15.18:0/3013854257 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690049060 con 0x55a9823ae2f0 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f46adc56740 1 -- 172.21.15.18:0/3013854257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4698010c50 con 0x55a9823ae2f0 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f468cff9640 1 -- 172.21.15.18:0/3013854257 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4690003b70 con 0x55a9823ae2f0 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f468cff9640 1 -- 172.21.15.18:0/3013854257 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4690034040 con 0x55a9823ae2f0 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f46adc56740 10 client.15048 fetch_fsmap learned FSMap version 27 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f46adc56740 1 -- 172.21.15.18:0/3013854257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a9823c70e0 con 0x55a9823ae2f0 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f468cff9640 1 -- 172.21.15.18:0/3013854257 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4698010c50 con 0x55a9823ae2f0 2024-09-19T09:51:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f468cff9640 1 -- 172.21.15.18:0/3013854257 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4690030560 con 0x55a9823ae2f0 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f46adc56740 10 client.15048 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f46adc56740 10 client.15048 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.173+0000 7f46adc56740 20 client.15048 populate_metadata read hostname 'smithi018' 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.174+0000 7f46adc56740 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a9823c96b0 0x55a9823cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.174+0000 7f46adc56740 4 client.15048 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.174+0000 7f46adc56740 1 -- 172.21.15.18:0/3013854257 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a982321600 con 0x55a9823c96b0 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.174+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a9823c96b0 0x55a9823cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.174+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a9823c96b0 0x55a9823cab20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bf97b280023d261 server_cookie=bb69588d94c7107a in_seq=0 out_seq=0 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.174+0000 7f468cff9640 10 client.15048 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f468cff9640 1 -- 172.21.15.18:0/3013854257 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a982321600 con 0x55a9823c96b0 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f468cff9640 10 client.15048 handle_command_reply: tid=0 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 client.15048 shutdown 2024-09-19T09:51:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 -- 172.21.15.18:0/3013854257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 msgr2=0x55a9823b5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823b5780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4690006010 tx=0x7f469002f5d0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 -- 172.21.15.18:0/3013854257 shutdown_connections 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a9823c96b0 0x55a9823cab20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823b8bb0 0x55a9823b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823b5780 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f468cff9640 0 client.15048 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 --2- 172.21.15.18:0/3013854257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ad9d0 0x55a9823b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 -- 172.21.15.18:0/3013854257 >> 172.21.15.18:0/3013854257 conn(0x55a9823a9f60 msgr2=0x55a9823afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 -- 172.21.15.18:0/3013854257 shutdown_connections 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.175+0000 7f46adc56740 1 -- 172.21.15.18:0/3013854257 wait complete. 2024-09-19T09:51:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.176+0000 7f46adc56740 20 client.15048 trim_cache size 0 max 16384 2024-09-19T09:51:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.193+0000 7f46adc56740 1 Processor -- start 2024-09-19T09:51:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.193+0000 7f46adc56740 1 -- start start 2024-09-19T09:51:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46adc56740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ad9d0 0x55a9823cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46adc56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ae2f0 0x55a9823a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46adc56740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46adc56740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a9823c8e60 con 0x55a9823b8bb0 2024-09-19T09:51:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46adc56740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a9823c9530 con 0x55a9823ad9d0 2024-09-19T09:51:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46adc56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a9823c9c00 con 0x55a9823ae2f0 2024-09-19T09:51:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46a8e18640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46a8e18640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33740/0 (socket says 172.21.15.18:33740) 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46a8e18640 1 -- 172.21.15.18:0/2906198763 learned_addr learned my addr 172.21.15.18:0/2906198763 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46a9619640 1 --2- 172.21.15.18:0/2906198763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ae2f0 0x55a9823a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46a8e18640 1 --2- 172.21.15.18:0/2906198763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ad9d0 0x55a9823cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46a8e18640 1 -- 172.21.15.18:0/2906198763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ae2f0 msgr2=0x55a9823a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46a8e18640 1 --2- 172.21.15.18:0/2906198763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ae2f0 0x55a9823a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46a8e18640 1 -- 172.21.15.18:0/2906198763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ad9d0 msgr2=0x55a9823cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46a8e18640 1 --2- 172.21.15.18:0/2906198763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ad9d0 0x55a9823cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.194+0000 7f46a8e18640 1 -- 172.21.15.18:0/2906198763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9823b4730 con 0x55a9823b8bb0 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.195+0000 7f46a8e18640 1 --2- 172.21.15.18:0/2906198763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823b0d20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f46980127c0 tx=0x7f4698021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e0eb27d35c3d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.195+0000 7f468effd640 1 -- 172.21.15.18:0/2906198763 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698010740 con 0x55a9823b8bb0 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.195+0000 7f468effd640 1 -- 172.21.15.18:0/2906198763 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4698016040 con 0x55a9823b8bb0 2024-09-19T09:51:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.195+0000 7f468effd640 1 -- 172.21.15.18:0/2906198763 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469801e7a0 con 0x55a9823b8bb0 2024-09-19T09:51:57.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 -- 172.21.15.18:0/2906198763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 msgr2=0x55a9823b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 --2- 172.21.15.18:0/2906198763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823b0d20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f46980127c0 tx=0x7f4698021040 comp rx=0 tx=0).stop 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 -- 172.21.15.18:0/2906198763 shutdown_connections 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 --2- 172.21.15.18:0/2906198763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823b8bb0 0x55a9823b0d20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 --2- 172.21.15.18:0/2906198763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823ae2f0 0x55a9823a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 --2- 172.21.15.18:0/2906198763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ad9d0 0x55a9823cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 -- 172.21.15.18:0/2906198763 >> 172.21.15.18:0/2906198763 conn(0x55a9823a9f60 msgr2=0x55a9823b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 -- 172.21.15.18:0/2906198763 shutdown_connections 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 -- 172.21.15.18:0/2906198763 wait complete. 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 -- start start 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.196+0000 7f46adc56740 1 Processor -- start 2024-09-19T09:51:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46adc56740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ad9d0 0x55a9823d30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46adc56740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823d35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46adc56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823b8bb0 0x55a9823cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46adc56740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a9823ca9a0 con 0x55a9823ae2f0 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46adc56740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a9823ca2d0 con 0x55a9823ad9d0 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46adc56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a9823cb070 con 0x55a9823b8bb0 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46adc56740 10 client.0 _ll_register_callbacks cb 0x7f469002fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a9619640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823d35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a9619640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823d35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33750/0 (socket says 172.21.15.18:33750) 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a9619640 1 -- 172.21.15.18:0/3510232610 learned_addr learned my addr 172.21.15.18:0/3510232610 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ad9d0 0x55a9823d30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823b8bb0 0x55a9823cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a9619640 1 -- 172.21.15.18:0/3510232610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823b8bb0 msgr2=0x55a9823cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a9619640 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823b8bb0 0x55a9823cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a9619640 1 -- 172.21.15.18:0/3510232610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ad9d0 msgr2=0x55a9823d30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a9619640 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ad9d0 0x55a9823d30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a9619640 1 -- 172.21.15.18:0/3510232610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9823cccd0 con 0x55a9823ae2f0 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823b8bb0 0x55a9823cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f46a9619640 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823d35e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f469002ae70 tx=0x7f469002b0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6383306fe5b6bd0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f468cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.197+0000 7f468cff9640 1 -- 172.21.15.18:0/3510232610 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690049050 con 0x55a9823ae2f0 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f468cff9640 1 -- 172.21.15.18:0/3510232610 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4690003970 con 0x55a9823ae2f0 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f46adc56740 1 -- 172.21.15.18:0/3510232610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4698016040 con 0x55a9823ae2f0 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f468cff9640 1 -- 172.21.15.18:0/3510232610 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4690054070 con 0x55a9823ae2f0 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f46adc56740 10 client.15054 fetch_fsmap learned FSMap version 27 2024-09-19T09:51:57.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f46adc56740 1 -- 172.21.15.18:0/3510232610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a9823d17b0 con 0x55a9823ae2f0 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f468cff9640 1 -- 172.21.15.18:0/3510232610 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4698016040 con 0x55a9823ae2f0 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f468cff9640 1 -- 172.21.15.18:0/3510232610 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f469003a430 con 0x55a9823ae2f0 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f46adc56740 10 client.15054 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f46adc56740 10 client.15054 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f46adc56740 20 client.15054 populate_metadata read hostname 'smithi018' 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f46adc56740 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a982438560 0x55a982437270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f46adc56740 4 client.15054 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f46adc56740 1 -- 172.21.15.18:0/3510232610 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "status"}) -- 0x55a98231bb10 con 0x55a982438560 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.198+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a982438560 0x55a982437270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f46a8e18640 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a982438560 0x55a982437270 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bb65a1092cd7c77 server_cookie=41c81bde6a1bf23e in_seq=0 out_seq=0 2024-09-19T09:51:57.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f468cff9640 10 client.15054 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f468cff9640 1 -- 172.21.15.18:0/3510232610 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a98231bb10 con 0x55a982438560 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f468cff9640 10 client.15054 handle_command_reply: tid=0 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f46adc56740 1 client.15054 shutdown 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f46adc56740 1 -- 172.21.15.18:0/3510232610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 msgr2=0x55a9823d35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f46adc56740 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823d35e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f469002ae70 tx=0x7f469002b0e0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f46adc56740 1 -- 172.21.15.18:0/3510232610 shutdown_connections 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f46adc56740 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a982438560 0x55a982437270 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f468cff9640 0 client.15054 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f46adc56740 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9823b8bb0 0x55a9823cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f46adc56740 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9823ae2f0 0x55a9823d35e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f46adc56740 1 --2- 172.21.15.18:0/3510232610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9823ad9d0 0x55a9823d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.199+0000 7f46adc56740 1 -- 172.21.15.18:0/3510232610 >> 172.21.15.18:0/3510232610 conn(0x55a9823a9f60 msgr2=0x55a9823b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:57.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46adc56740 1 -- 172.21.15.18:0/3510232610 shutdown_connections 2024-09-19T09:51:57.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46adc56740 1 -- 172.21.15.18:0/3510232610 wait complete. 2024-09-19T09:51:57.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46adc56740 20 client.15054 trim_cache size 0 max 16384 2024-09-19T09:51:57.209 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:51:57.209 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:51:57.209 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:51:57.209 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24524, 2024-09-19T09:51:57.209 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:51:57.209 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:51:57.210 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:51:57.210 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 86.847175199000006, 2024-09-19T09:51:57.210 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-09-19T09:51:57.210 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:51:57.210 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:51:57.210 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 97.479567696000004 2024-09-19T09:51:57.210 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 -- 172.21.15.18:0/3027322493 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46940a3350 msgr2=0x7f46940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46940a3350 0x7f46940a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f469c009610 tx=0x7f469c086040 comp rx=0 tx=0).stop 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 -- 172.21.15.18:0/3027322493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46a4102ef0 msgr2=0x7f46a419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46a4102ef0 0x7f46a419cdd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f469c00d750 tx=0x7f469c00dc10 comp rx=0 tx=0).stop 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 -- 172.21.15.18:0/3027322493 shutdown_connections 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46940a3350 0x7f46940a5810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46a4102ef0 0x7f46a419cdd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46a4102570 0x7f46a4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 --2- 172.21.15.18:0/3027322493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a4100e20 0x7f46a4198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 -- 172.21.15.18:0/3027322493 >> 172.21.15.18:0/3027322493 conn(0x7f46a40fc7d0 msgr2=0x7f46a406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 -- 172.21.15.18:0/3027322493 shutdown_connections 2024-09-19T09:51:57.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:57.200+0000 7f46ab87d640 1 -- 172.21.15.18:0/3027322493 wait complete. 2024-09-19T09:51:57.873 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T09:51:57.873 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:51:57.883 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:51:57.883 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T09:51:58.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:57 smithi018 ceph-mon[30956]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:51:58.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:57 smithi049 ceph-mon[34858]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:51:58.152 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:51:58.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:57 smithi162 ceph-mon[35174]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:51:58.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.611+0000 7fc07f384640 1 -- 172.21.15.18:0/2806879880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc078102660 msgr2=0x7fc078104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.611+0000 7fc07f384640 1 --2- 172.21.15.18:0/2806879880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc078102660 0x7fc078104a50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc074009ca0 tx=0x7fc07402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.611+0000 7fc07f384640 1 -- 172.21.15.18:0/2806879880 shutdown_connections 2024-09-19T09:51:58.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.611+0000 7fc07f384640 1 --2- 172.21.15.18:0/2806879880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0781078c0 0x7fc078109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.611+0000 7fc07f384640 1 --2- 172.21.15.18:0/2806879880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc078104f90 0x7fc078107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.611+0000 7fc07f384640 1 --2- 172.21.15.18:0/2806879880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc078102660 0x7fc078104a50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.611+0000 7fc07f384640 1 -- 172.21.15.18:0/2806879880 >> 172.21.15.18:0/2806879880 conn(0x7fc0780fc280 msgr2=0x7fc0780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:58.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.611+0000 7fc07f384640 1 -- 172.21.15.18:0/2806879880 shutdown_connections 2024-09-19T09:51:58.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.611+0000 7fc07f384640 1 -- 172.21.15.18:0/2806879880 wait complete. 2024-09-19T09:51:58.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.611+0000 7fc07f384640 1 Processor -- start 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07f384640 1 -- start start 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07f384640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc078102660 0x7fc078101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07f384640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc078104f90 0x7fc078100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07f384640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0781078c0 0x7fc078100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07f384640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc07810d890 con 0x7fc078102660 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07f384640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc07810d710 con 0x7fc078104f90 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07f384640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc07810da10 con 0x7fc0781078c0 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07d120640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc078102660 0x7fc078101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07d120640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc078102660 0x7fc078101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33768/0 (socket says 172.21.15.18:33768) 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07d120640 1 -- 172.21.15.18:0/49160916 learned_addr learned my addr 172.21.15.18:0/49160916 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:51:58.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07d921640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0781078c0 0x7fc078100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07c91f640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc078104f90 0x7fc078100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07d120640 1 -- 172.21.15.18:0/49160916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0781078c0 msgr2=0x7fc078100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07d120640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0781078c0 0x7fc078100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07d120640 1 -- 172.21.15.18:0/49160916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc078104f90 msgr2=0x7fc078100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07d120640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc078104f90 0x7fc078100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07d120640 1 -- 172.21.15.18:0/49160916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc078101410 con 0x7fc078102660 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.612+0000 7fc07c91f640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc078104f90 0x7fc078100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.613+0000 7fc07d120640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc078102660 0x7fc078101fc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc074031a40 tx=0x7fc074031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.613+0000 7fc06e7fc640 1 -- 172.21.15.18:0/49160916 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07402faa0 con 0x7fc078102660 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.613+0000 7fc07f384640 1 -- 172.21.15.18:0/49160916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0781a2040 con 0x7fc078102660 2024-09-19T09:51:58.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.613+0000 7fc06e7fc640 1 -- 172.21.15.18:0/49160916 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc07402fc40 con 0x7fc078102660 2024-09-19T09:51:58.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.613+0000 7fc06e7fc640 1 -- 172.21.15.18:0/49160916 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07403a790 con 0x7fc078102660 2024-09-19T09:51:58.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.613+0000 7fc07f384640 1 -- 172.21.15.18:0/49160916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0781a2550 con 0x7fc078102660 2024-09-19T09:51:58.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.614+0000 7fc07f384640 1 -- 172.21.15.18:0/49160916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0780fdd70 con 0x7fc078102660 2024-09-19T09:51:58.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.615+0000 7fc06e7fc640 1 -- 172.21.15.18:0/49160916 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc074030b30 con 0x7fc078102660 2024-09-19T09:51:58.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.616+0000 7fc06e7fc640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc0640a32d0 0x7fc0640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:51:58.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.616+0000 7fc07c91f640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc0640a32d0 0x7fc0640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:51:58.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.616+0000 7fc06e7fc640 1 -- 172.21.15.18:0/49160916 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc0740f10c0 con 0x7fc078102660 2024-09-19T09:51:58.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.616+0000 7fc07c91f640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc0640a32d0 0x7fc0640a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc0680058c0 tx=0x7fc068005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:51:58.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.620+0000 7fc06e7fc640 1 -- 172.21.15.18:0/49160916 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc0740bdd60 con 0x7fc078102660 2024-09-19T09:51:58.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.814+0000 7fc07f384640 1 -- 172.21.15.18:0/49160916 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fc078062630 con 0x7fc0640a32d0 2024-09-19T09:51:58.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.815+0000 7fc06e7fc640 1 -- 172.21.15.18:0/49160916 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fc078062630 con 0x7fc0640a32d0 2024-09-19T09:51:58.818 INFO:teuthology.orchestra.run.smithi018.stdout:Backend: cephadm 2024-09-19T09:51:58.818 INFO:teuthology.orchestra.run.smithi018.stdout:Available: Yes 2024-09-19T09:51:58.818 INFO:teuthology.orchestra.run.smithi018.stdout:Paused: No 2024-09-19T09:51:58.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.817+0000 7fc07f384640 1 -- 172.21.15.18:0/49160916 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc0640a32d0 msgr2=0x7fc0640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.817+0000 7fc07f384640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc0640a32d0 0x7fc0640a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc0680058c0 tx=0x7fc068005850 comp rx=0 tx=0).stop 2024-09-19T09:51:58.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.817+0000 7fc07f384640 1 -- 172.21.15.18:0/49160916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc078102660 msgr2=0x7fc078101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:51:58.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.817+0000 7fc07f384640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc078102660 0x7fc078101fc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc074031a40 tx=0x7fc074031ec0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.818+0000 7fc07f384640 1 -- 172.21.15.18:0/49160916 shutdown_connections 2024-09-19T09:51:58.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.818+0000 7fc07f384640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc0640a32d0 0x7fc0640a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.818+0000 7fc07f384640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0781078c0 0x7fc078100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.818+0000 7fc07f384640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc078104f90 0x7fc078100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.818+0000 7fc07f384640 1 --2- 172.21.15.18:0/49160916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc078102660 0x7fc078101fc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:51:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.818+0000 7fc07f384640 1 -- 172.21.15.18:0/49160916 >> 172.21.15.18:0/49160916 conn(0x7fc0780fc280 msgr2=0x7fc0781030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:51:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.818+0000 7fc07f384640 1 -- 172.21.15.18:0/49160916 shutdown_connections 2024-09-19T09:51:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:51:58.818+0000 7fc07f384640 1 -- 172.21.15.18:0/49160916 wait complete. 2024-09-19T09:51:59.450 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T09:51:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:00.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:59 smithi018 ceph-mon[30956]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:52:00.086 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:51:59 smithi018 ceph-mon[30956]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:00.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:59 smithi049 ceph-mon[34858]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:52:00.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:51:59 smithi049 ceph-mon[34858]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:00.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:59 smithi162 ceph-mon[35174]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:52:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:51:59 smithi162 ceph-mon[35174]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:00.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.166+0000 7f0290689640 1 -- 172.21.15.18:0/3770255625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0288107900 msgr2=0x7f0288109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:00.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.166+0000 7f0290689640 1 --2- 172.21.15.18:0/3770255625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0288107900 0x7f0288109d50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0280009ca0 tx=0x7f028002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.166+0000 7f0290689640 1 -- 172.21.15.18:0/3770255625 shutdown_connections 2024-09-19T09:52:00.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.166+0000 7f0290689640 1 --2- 172.21.15.18:0/3770255625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0288107900 0x7f0288109d50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.166+0000 7f0290689640 1 --2- 172.21.15.18:0/3770255625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288104fd0 0x7f02881073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.166+0000 7f0290689640 1 --2- 172.21.15.18:0/3770255625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02881026a0 0x7f0288104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.166+0000 7f0290689640 1 -- 172.21.15.18:0/3770255625 >> 172.21.15.18:0/3770255625 conn(0x7f02880fc2a0 msgr2=0x7f02880fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.166+0000 7f0290689640 1 -- 172.21.15.18:0/3770255625 shutdown_connections 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.166+0000 7f0290689640 1 -- 172.21.15.18:0/3770255625 wait complete. 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f0290689640 1 Processor -- start 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f0290689640 1 -- start start 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f0290689640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02881026a0 0x7f0288197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f0290689640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0288104fd0 0x7f0288198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f0290689640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288107900 0x7f028819f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f0290689640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f028810d8c0 con 0x7f0288104fd0 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f0290689640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f028810d740 con 0x7f0288107900 2024-09-19T09:52:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f0290689640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f028810da40 con 0x7f02881026a0 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f028dc24640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0288104fd0 0x7f0288198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f028dc24640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0288104fd0 0x7f0288198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33780/0 (socket says 172.21.15.18:33780) 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f028dc24640 1 -- 172.21.15.18:0/3666370622 learned_addr learned my addr 172.21.15.18:0/3666370622 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.167+0000 7f028e425640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02881026a0 0x7f0288197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f028ec26640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288107900 0x7f028819f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f028dc24640 1 -- 172.21.15.18:0/3666370622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02881026a0 msgr2=0x7f0288197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f028dc24640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02881026a0 0x7f0288197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f028dc24640 1 -- 172.21.15.18:0/3666370622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288107900 msgr2=0x7f028819f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f028dc24640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288107900 0x7f028819f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f028dc24640 1 -- 172.21.15.18:0/3666370622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028819fb20 con 0x7f0288104fd0 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f028ec26640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288107900 0x7f028819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f028dc24640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0288104fd0 0x7f0288198430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0278005fd0 tx=0x7f027800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:00.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f027f7fe640 1 -- 172.21.15.18:0/3666370622 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278017070 con 0x7f0288104fd0 2024-09-19T09:52:00.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f027f7fe640 1 -- 172.21.15.18:0/3666370622 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0278009c30 con 0x7f0288104fd0 2024-09-19T09:52:00.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f0290689640 1 -- 172.21.15.18:0/3666370622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028819fe10 con 0x7f0288104fd0 2024-09-19T09:52:00.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f027f7fe640 1 -- 172.21.15.18:0/3666370622 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278010460 con 0x7f0288104fd0 2024-09-19T09:52:00.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.168+0000 7f0290689640 1 -- 172.21.15.18:0/3666370622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02881a0310 con 0x7f0288104fd0 2024-09-19T09:52:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.169+0000 7f0290689640 1 -- 172.21.15.18:0/3666370622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02880fdd90 con 0x7f0288104fd0 2024-09-19T09:52:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.171+0000 7f027f7fe640 1 -- 172.21.15.18:0/3666370622 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0278003e70 con 0x7f0288104fd0 2024-09-19T09:52:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.171+0000 7f027f7fe640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f02740a3380 0x7f02740a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.172+0000 7f028e425640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f02740a3380 0x7f02740a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.172+0000 7f027f7fe640 1 -- 172.21.15.18:0/3666370622 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f02780cfda0 con 0x7f0288104fd0 2024-09-19T09:52:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.172+0000 7f028e425640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f02740a3380 0x7f02740a5840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0284005fd0 tx=0x7f028400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:00.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.175+0000 7f027f7fe640 1 -- 172.21.15.18:0/3666370622 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0278020030 con 0x7f0288104fd0 2024-09-19T09:52:00.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.390+0000 7f0290689640 1 -- 172.21.15.18:0/3666370622 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0288062630 con 0x7f02740a3380 2024-09-19T09:52:00.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.402+0000 7f027f7fe640 1 -- 172.21.15.18:0/3666370622 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f0288062630 con 0x7f02740a3380 2024-09-19T09:52:00.405 INFO:teuthology.orchestra.run.smithi018.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:52:00.405 INFO:teuthology.orchestra.run.smithi018.stdout:mds.a smithi018 running (103s) 29s ago 103s 16.9M - 19.1.1-361-g2f599a46 d2baa855c067 6ba4d341ef5b 2024-09-19T09:52:00.405 INFO:teuthology.orchestra.run.smithi018.stdout:mds.b smithi049 running (101s) 34s ago 100s 25.9M - 19.1.1-361-g2f599a46 d2baa855c067 1b78794f5092 2024-09-19T09:52:00.405 INFO:teuthology.orchestra.run.smithi018.stdout:mds.c smithi162 running (115s) 34s ago 114s 18.1M - 19.1.1-361-g2f599a46 d2baa855c067 63e882ce8d8f 2024-09-19T09:52:00.405 INFO:teuthology.orchestra.run.smithi018.stdout:mds.d smithi018 running (2m) 29s ago 2m 13.6M - 19.1.1-361-g2f599a46 d2baa855c067 5a4381de00b2 2024-09-19T09:52:00.405 INFO:teuthology.orchestra.run.smithi018.stdout:mds.e smithi049 running (2m) 34s ago 119s 19.2M - 19.1.1-361-g2f599a46 d2baa855c067 47c0c5eac077 2024-09-19T09:52:00.405 INFO:teuthology.orchestra.run.smithi018.stdout:mds.f smithi162 running (117s) 34s ago 117s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 121aadc42177 2024-09-19T09:52:00.405 INFO:teuthology.orchestra.run.smithi018.stdout:mds.g smithi018 running (107s) 29s ago 106s 19.2M - 19.1.1-361-g2f599a46 d2baa855c067 cb39f182c715 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mds.h smithi049 running (112s) 34s ago 111s 18.1M - 19.1.1-361-g2f599a46 d2baa855c067 9c2cae7447ec 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mds.i smithi162 running (109s) 34s ago 109s 17.2M - 19.1.1-361-g2f599a46 d2baa855c067 bb436781b811 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mds.j smithi018 running (2m) 29s ago 2m 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 80f52a23bad7 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mds.k smithi049 running (2m) 34s ago 2m 16.9M - 19.1.1-361-g2f599a46 d2baa855c067 5017f0fbc729 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mds.l smithi162 running (2m) 34s ago 2m 18.5M - 19.1.1-361-g2f599a46 d2baa855c067 f09fc438a810 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.x smithi018 *:9283,8765 running (9m) 29s ago 9m 509M - 19.1.1-361-g2f599a46 d2baa855c067 b85b3a7035bb 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.y smithi049 *:8443,8765 running (7m) 34s ago 7m 441M - 19.1.1-361-g2f599a46 d2baa855c067 9075f74b746c 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.z smithi162 *:8443,8765 running (7m) 34s ago 7m 443M - 19.1.1-361-g2f599a46 d2baa855c067 5ca5d8182183 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a smithi018 running (9m) 29s ago 9m 52.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 f2f6048d23fd 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b smithi049 running (7m) 34s ago 7m 42.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 9465dea0d5d4 2024-09-19T09:52:00.406 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c smithi162 running (7m) 34s ago 7m 39.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 af4f767de581 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 smithi018 running (7m) 29s ago 7m 48.9M 4273M 19.1.1-361-g2f599a46 d2baa855c067 3a916090ffd9 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 smithi049 running (6m) 34s ago 6m 54.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 4dae0d201684 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 smithi162 running (6m) 34s ago 6m 52.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 3120b7ba7436 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 smithi018 running (5m) 29s ago 5m 46.9M 4273M 19.1.1-361-g2f599a46 d2baa855c067 e45c74c603a9 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 smithi049 running (5m) 34s ago 5m 45.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 03861a50d5fd 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 smithi162 running (5m) 34s ago 5m 52.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 6631fbacbf79 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 smithi018 running (4m) 29s ago 4m 50.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 1855421b6e0a 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 smithi049 running (4m) 34s ago 4m 53.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 b9b79ced0580 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.8 smithi162 running (3m) 34s ago 3m 46.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 dbae38d8f311 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.9 smithi018 running (3m) 29s ago 3m 46.3M 4273M 19.1.1-361-g2f599a46 d2baa855c067 660f3fae54bf 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.10 smithi049 running (2m) 34s ago 2m 46.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 caeddc6853e3 2024-09-19T09:52:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:osd.11 smithi162 running (2m) 34s ago 2m 46.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 8c0ad36cfe92 2024-09-19T09:52:00.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 -- 172.21.15.18:0/3666370622 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f02740a3380 msgr2=0x7f02740a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:00.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f02740a3380 0x7f02740a5840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0284005fd0 tx=0x7f028400b390 comp rx=0 tx=0).stop 2024-09-19T09:52:00.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 -- 172.21.15.18:0/3666370622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0288104fd0 msgr2=0x7f0288198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0288104fd0 0x7f0288198430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0278005fd0 tx=0x7f027800dde0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 -- 172.21.15.18:0/3666370622 shutdown_connections 2024-09-19T09:52:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f02740a3380 0x7f02740a5840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0288107900 0x7f028819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0288104fd0 0x7f0288198430 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 --2- 172.21.15.18:0/3666370622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02881026a0 0x7f0288197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 -- 172.21.15.18:0/3666370622 >> 172.21.15.18:0/3666370622 conn(0x7f02880fc2a0 msgr2=0x7f0288102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 -- 172.21.15.18:0/3666370622 shutdown_connections 2024-09-19T09:52:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:00.404+0000 7f0290689640 1 -- 172.21.15.18:0/3666370622 wait complete. 2024-09-19T09:52:01.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T09:52:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.747+0000 7f016dd07640 1 -- 172.21.15.18:0/2050554357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0168104f90 msgr2=0x7f0168107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.747+0000 7f016dd07640 1 --2- 172.21.15.18:0/2050554357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0168104f90 0x7f0168107380 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f015c009900 tx=0x7f015c02a410 comp rx=0 tx=0).stop 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.748+0000 7f016dd07640 1 -- 172.21.15.18:0/2050554357 shutdown_connections 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.748+0000 7f016dd07640 1 --2- 172.21.15.18:0/2050554357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01681078c0 0x7f0168109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.748+0000 7f016dd07640 1 --2- 172.21.15.18:0/2050554357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0168104f90 0x7f0168107380 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.748+0000 7f016dd07640 1 --2- 172.21.15.18:0/2050554357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0168102660 0x7f0168104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.748+0000 7f016dd07640 1 -- 172.21.15.18:0/2050554357 >> 172.21.15.18:0/2050554357 conn(0x7f01680fc280 msgr2=0x7f01680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.748+0000 7f016dd07640 1 -- 172.21.15.18:0/2050554357 shutdown_connections 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.748+0000 7f016dd07640 1 -- 172.21.15.18:0/2050554357 wait complete. 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.748+0000 7f016dd07640 1 Processor -- start 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f016dd07640 1 -- start start 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f016dd07640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0168102660 0x7f0168197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f016dd07640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0168104f90 0x7f01681984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f016dd07640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01681078c0 0x7f016819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f016dd07640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f016810d8c0 con 0x7f01681078c0 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f016dd07640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f016810d740 con 0x7f0168104f90 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f016dd07640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f016810da40 con 0x7f0168102660 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f0167fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01681078c0 0x7f016819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f0167fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01681078c0 0x7f016819f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33800/0 (socket says 172.21.15.18:33800) 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f0167fff640 1 -- 172.21.15.18:0/2765434189 learned_addr learned my addr 172.21.15.18:0/2765434189 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f0166ffd640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0168104f90 0x7f01681984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f01677fe640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0168102660 0x7f0168197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f0167fff640 1 -- 172.21.15.18:0/2765434189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0168102660 msgr2=0x7f0168197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f0167fff640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0168102660 0x7f0168197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f0167fff640 1 -- 172.21.15.18:0/2765434189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0168104f90 msgr2=0x7f01681984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f0167fff640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0168104f90 0x7f01681984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f0167fff640 1 -- 172.21.15.18:0/2765434189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016819fbe0 con 0x7f01681078c0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.749+0000 7f0167fff640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01681078c0 0x7f016819f570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f016000eaa0 tx=0x7f016000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.750+0000 7f0164ff9640 1 -- 172.21.15.18:0/2765434189 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016000cdb0 con 0x7f01681078c0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.750+0000 7f0164ff9640 1 -- 172.21.15.18:0/2765434189 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0160005020 con 0x7f01681078c0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.750+0000 7f016dd07640 1 -- 172.21.15.18:0/2765434189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f016819fed0 con 0x7f01681078c0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.750+0000 7f0164ff9640 1 -- 172.21.15.18:0/2765434189 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01600116b0 con 0x7f01681078c0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.750+0000 7f016dd07640 1 -- 172.21.15.18:0/2765434189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01681a03b0 con 0x7f01681078c0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.751+0000 7f016dd07640 1 -- 172.21.15.18:0/2765434189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01680fdd70 con 0x7f01681078c0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.752+0000 7f0164ff9640 1 -- 172.21.15.18:0/2765434189 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0160005560 con 0x7f01681078c0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.752+0000 7f0164ff9640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01500a3270 0x7f01500a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.753+0000 7f0164ff9640 1 -- 172.21.15.18:0/2765434189 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f01600cfbc0 con 0x7f01681078c0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.753+0000 7f01677fe640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01500a3270 0x7f01500a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.753+0000 7f01677fe640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01500a3270 0x7f01500a5730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0158009890 tx=0x7f0158008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.757+0000 7f0164ff9640 1 -- 172.21.15.18:0/2765434189 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0160016030 con 0x7f01681078c0 2024-09-19T09:52:01.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.942+0000 7f016dd07640 1 -- 172.21.15.18:0/2765434189 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0168062630 con 0x7f01500a3270 2024-09-19T09:52:01.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.947+0000 7f0164ff9640 1 -- 172.21.15.18:0/2765434189 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f0168062630 con 0x7f01500a3270 2024-09-19T09:52:01.950 INFO:teuthology.orchestra.run.smithi018.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T09:52:01.950 INFO:teuthology.orchestra.run.smithi018.stdout:mds.all 12/12 36s ago 2m smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi049=b;smithi049=e;smithi049=h;smithi049=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T09:52:01.950 INFO:teuthology.orchestra.run.smithi018.stdout:mgr 3/3 36s ago 7m smithi018=x;smithi049=y;smithi162=z;count:3 2024-09-19T09:52:01.950 INFO:teuthology.orchestra.run.smithi018.stdout:mon 3/3 36s ago 8m smithi018:172.21.15.18=a;smithi049:172.21.15.49=b;smithi162:172.21.15.162=c;count:3 2024-09-19T09:52:01.951 INFO:teuthology.orchestra.run.smithi018.stdout:osd 12 36s ago - 2024-09-19T09:52:01.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 -- 172.21.15.18:0/2765434189 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01500a3270 msgr2=0x7f01500a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:01.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01500a3270 0x7f01500a5730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0158009890 tx=0x7f0158008040 comp rx=0 tx=0).stop 2024-09-19T09:52:01.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 -- 172.21.15.18:0/2765434189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01681078c0 msgr2=0x7f016819f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:01.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01681078c0 0x7f016819f570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f016000eaa0 tx=0x7f016000ef60 comp rx=0 tx=0).stop 2024-09-19T09:52:01.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 -- 172.21.15.18:0/2765434189 shutdown_connections 2024-09-19T09:52:01.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01500a3270 0x7f01500a5730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:01.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01681078c0 0x7f016819f570 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:01.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0168104f90 0x7f01681984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:01.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 --2- 172.21.15.18:0/2765434189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0168102660 0x7f0168197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:01.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 -- 172.21.15.18:0/2765434189 >> 172.21.15.18:0/2765434189 conn(0x7f01680fc280 msgr2=0x7f0168103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:01.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 -- 172.21.15.18:0/2765434189 shutdown_connections 2024-09-19T09:52:01.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:01.950+0000 7f016dd07640 1 -- 172.21.15.18:0/2765434189 wait complete. 2024-09-19T09:52:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:01 smithi018 ceph-mon[30956]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:52:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:01 smithi018 ceph-mon[30956]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:02.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:01 smithi018 ceph-mon[30956]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:52:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:01 smithi049 ceph-mon[34858]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:52:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:01 smithi049 ceph-mon[34858]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:01 smithi049 ceph-mon[34858]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:52:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:01 smithi162 ceph-mon[35174]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:52:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:01 smithi162 ceph-mon[35174]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:01 smithi162 ceph-mon[35174]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:52:02.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T09:52:02.792 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:03.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:02 smithi049 ceph-mon[34858]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:03.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:02 smithi162 ceph-mon[35174]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:03.184 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:02 smithi018 ceph-mon[30956]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.265+0000 7f26d91ce640 1 -- 172.21.15.18:0/568268093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26d4100b10 msgr2=0x7f26d4100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.265+0000 7f26d91ce640 1 --2- 172.21.15.18:0/568268093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26d4100b10 0x7f26d4100f10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009900 tx=0x7f26c402a410 comp rx=0 tx=0).stop 2024-09-19T09:52:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.265+0000 7f26d91ce640 1 -- 172.21.15.18:0/568268093 shutdown_connections 2024-09-19T09:52:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.265+0000 7f26d91ce640 1 --2- 172.21.15.18:0/568268093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26d41026d0 0x7f26d4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.265+0000 7f26d91ce640 1 --2- 172.21.15.18:0/568268093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26d4101d10 0x7f26d4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.265+0000 7f26d91ce640 1 --2- 172.21.15.18:0/568268093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26d4100b10 0x7f26d4100f10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.265+0000 7f26d91ce640 1 -- 172.21.15.18:0/568268093 >> 172.21.15.18:0/568268093 conn(0x7f26d40fc2a0 msgr2=0x7f26d40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.265+0000 7f26d91ce640 1 -- 172.21.15.18:0/568268093 shutdown_connections 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.265+0000 7f26d91ce640 1 -- 172.21.15.18:0/568268093 wait complete. 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.265+0000 7f26d91ce640 1 Processor -- start 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d91ce640 1 -- start start 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d91ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26d4100b10 0x7f26d406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d91ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26d4101d10 0x7f26d419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d91ce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26d41026d0 0x7f26d419f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d91ce640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f26d410c870 con 0x7f26d4100b10 2024-09-19T09:52:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d91ce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f26d410c6f0 con 0x7f26d41026d0 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d91ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26d410c9f0 con 0x7f26d4101d10 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26d4100b10 0x7f26d406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26d4100b10 0x7f26d406b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33816/0 (socket says 172.21.15.18:33816) 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d2d9d640 1 -- 172.21.15.18:0/4190937140 learned_addr learned my addr 172.21.15.18:0/4190937140 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d359e640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26d41026d0 0x7f26d419f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d259c640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26d4101d10 0x7f26d419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d2d9d640 1 -- 172.21.15.18:0/4190937140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26d4101d10 msgr2=0x7f26d419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d2d9d640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26d4101d10 0x7f26d419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d2d9d640 1 -- 172.21.15.18:0/4190937140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26d41026d0 msgr2=0x7f26d419f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d2d9d640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26d41026d0 0x7f26d419f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d2d9d640 1 -- 172.21.15.18:0/4190937140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d419fd40 con 0x7f26d4100b10 2024-09-19T09:52:03.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.266+0000 7f26d259c640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26d4101d10 0x7f26d419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.267+0000 7f26d2d9d640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26d4100b10 0x7f26d406b2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f26c4031610 tx=0x7f26c40043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.267+0000 7f26bbfff640 1 -- 172.21.15.18:0/4190937140 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c403f030 con 0x7f26d4100b10 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.267+0000 7f26bbfff640 1 -- 172.21.15.18:0/4190937140 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26c4003ce0 con 0x7f26d4100b10 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.267+0000 7f26d91ce640 1 -- 172.21.15.18:0/4190937140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d419ff70 con 0x7f26d4100b10 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.267+0000 7f26bbfff640 1 -- 172.21.15.18:0/4190937140 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4035070 con 0x7f26d4100b10 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.267+0000 7f26d91ce640 1 -- 172.21.15.18:0/4190937140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d41a0450 con 0x7f26d4100b10 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.268+0000 7f26d91ce640 1 -- 172.21.15.18:0/4190937140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d4108000 con 0x7f26d4100b10 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.269+0000 7f26bbfff640 1 -- 172.21.15.18:0/4190937140 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f26c4042030 con 0x7f26d4100b10 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.269+0000 7f26bbfff640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f26bc0a32c0 0x7f26bc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.270+0000 7f26d259c640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f26bc0a32c0 0x7f26bc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.270+0000 7f26bbfff640 1 -- 172.21.15.18:0/4190937140 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f26c40f0040 con 0x7f26d4100b10 2024-09-19T09:52:03.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.270+0000 7f26d259c640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f26bc0a32c0 0x7f26bc0a5780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26c8006fd0 tx=0x7f26c8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:03.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.274+0000 7f26bbfff640 1 -- 172.21.15.18:0/4190937140 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26c40bcd30 con 0x7f26d4100b10 2024-09-19T09:52:03.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.456+0000 7f26d91ce640 1 -- 172.21.15.18:0/4190937140 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f26d4062630 con 0x7f26bc0a32c0 2024-09-19T09:52:03.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.458+0000 7f26bbfff640 1 -- 172.21.15.18:0/4190937140 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f26d4062630 con 0x7f26bc0a32c0 2024-09-19T09:52:03.461 INFO:teuthology.orchestra.run.smithi018.stdout:HOST ADDR LABELS STATUS 2024-09-19T09:52:03.461 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018 172.21.15.18 2024-09-19T09:52:03.461 INFO:teuthology.orchestra.run.smithi018.stdout:smithi049 172.21.15.49 2024-09-19T09:52:03.461 INFO:teuthology.orchestra.run.smithi018.stdout:smithi162 172.21.15.162 2024-09-19T09:52:03.461 INFO:teuthology.orchestra.run.smithi018.stdout:3 hosts in cluster 2024-09-19T09:52:03.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 -- 172.21.15.18:0/4190937140 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f26bc0a32c0 msgr2=0x7f26bc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:03.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f26bc0a32c0 0x7f26bc0a5780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26c8006fd0 tx=0x7f26c8008040 comp rx=0 tx=0).stop 2024-09-19T09:52:03.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 -- 172.21.15.18:0/4190937140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26d4100b10 msgr2=0x7f26d406b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:03.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26d4100b10 0x7f26d406b2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f26c4031610 tx=0x7f26c40043b0 comp rx=0 tx=0).stop 2024-09-19T09:52:03.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 -- 172.21.15.18:0/4190937140 shutdown_connections 2024-09-19T09:52:03.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f26bc0a32c0 0x7f26bc0a5780 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:03.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26d41026d0 0x7f26d419f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:03.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26d4101d10 0x7f26d419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:03.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 --2- 172.21.15.18:0/4190937140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26d4100b10 0x7f26d406b2f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:03.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 -- 172.21.15.18:0/4190937140 >> 172.21.15.18:0/4190937140 conn(0x7f26d40fc2a0 msgr2=0x7f26d41051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:03.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 -- 172.21.15.18:0/4190937140 shutdown_connections 2024-09-19T09:52:03.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:03.460+0000 7f26d91ce640 1 -- 172.21.15.18:0/4190937140 wait complete. 2024-09-19T09:52:04.148 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T09:52:04.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:03 smithi049 ceph-mon[34858]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:52:04.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:03 smithi162 ceph-mon[35174]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:52:04.173 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:03 smithi018 ceph-mon[30956]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:52:04.412 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:04.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.829+0000 7ff91dc66640 1 -- 172.21.15.18:0/3826196661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff918107900 msgr2=0x7ff918109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:04.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.829+0000 7ff91dc66640 1 --2- 172.21.15.18:0/3826196661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff918107900 0x7ff918109d50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff910009ca0 tx=0x7ff91002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:52:04.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.829+0000 7ff91dc66640 1 -- 172.21.15.18:0/3826196661 shutdown_connections 2024-09-19T09:52:04.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.829+0000 7ff91dc66640 1 --2- 172.21.15.18:0/3826196661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff918107900 0x7ff918109d50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:04.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.829+0000 7ff91dc66640 1 --2- 172.21.15.18:0/3826196661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff918104fd0 0x7ff9181073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:04.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.829+0000 7ff91dc66640 1 --2- 172.21.15.18:0/3826196661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9181026a0 0x7ff918104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:04.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.829+0000 7ff91dc66640 1 -- 172.21.15.18:0/3826196661 >> 172.21.15.18:0/3826196661 conn(0x7ff9180fc2a0 msgr2=0x7ff9180fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:04.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.829+0000 7ff91dc66640 1 -- 172.21.15.18:0/3826196661 shutdown_connections 2024-09-19T09:52:04.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.829+0000 7ff91dc66640 1 -- 172.21.15.18:0/3826196661 wait complete. 2024-09-19T09:52:04.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.829+0000 7ff91dc66640 1 Processor -- start 2024-09-19T09:52:04.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff91dc66640 1 -- start start 2024-09-19T09:52:04.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff91dc66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9181026a0 0x7ff918102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:04.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff91dc66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff918104fd0 0x7ff918100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:04.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff91dc66640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff918107900 0x7ff918100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:04.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff91dc66640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff91810d990 con 0x7ff918107900 2024-09-19T09:52:04.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff91dc66640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff91810d810 con 0x7ff918104fd0 2024-09-19T09:52:04.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff91dc66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff91810db10 con 0x7ff9181026a0 2024-09-19T09:52:04.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff917fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff918107900 0x7ff918100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff917fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff918107900 0x7ff918100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33838/0 (socket says 172.21.15.18:33838) 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff917fff640 1 -- 172.21.15.18:0/655529436 learned_addr learned my addr 172.21.15.18:0/655529436 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff9177fe640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9181026a0 0x7ff918102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.830+0000 7ff90effd640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff918104fd0 0x7ff918100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff917fff640 1 -- 172.21.15.18:0/655529436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9181026a0 msgr2=0x7ff918102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff917fff640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9181026a0 0x7ff918102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff917fff640 1 -- 172.21.15.18:0/655529436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff918104fd0 msgr2=0x7ff918100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff917fff640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff918104fd0 0x7ff918100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff917fff640 1 -- 172.21.15.18:0/655529436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff918101450 con 0x7ff918107900 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff90effd640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff918104fd0 0x7ff918100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff917fff640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff918107900 0x7ff918100b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff9100098d0 tx=0x7ff91002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff9157fa640 1 -- 172.21.15.18:0/655529436 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91002fc30 con 0x7ff918107900 2024-09-19T09:52:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff9157fa640 1 -- 172.21.15.18:0/655529436 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff910003e50 con 0x7ff918107900 2024-09-19T09:52:04.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff91dc66640 1 -- 172.21.15.18:0/655529436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9181a21a0 con 0x7ff918107900 2024-09-19T09:52:04.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff9157fa640 1 -- 172.21.15.18:0/655529436 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910004810 con 0x7ff918107900 2024-09-19T09:52:04.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.831+0000 7ff91dc66640 1 -- 172.21.15.18:0/655529436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9181a2780 con 0x7ff918107900 2024-09-19T09:52:04.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.832+0000 7ff91dc66640 1 -- 172.21.15.18:0/655529436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9180fdd90 con 0x7ff918107900 2024-09-19T09:52:04.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.834+0000 7ff9157fa640 1 -- 172.21.15.18:0/655529436 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff910004b40 con 0x7ff918107900 2024-09-19T09:52:04.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.835+0000 7ff9157fa640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff9040a32c0 0x7ff9040a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:04.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.835+0000 7ff9177fe640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff9040a32c0 0x7ff9040a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:04.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.835+0000 7ff9157fa640 1 -- 172.21.15.18:0/655529436 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff9100f0ed0 con 0x7ff918107900 2024-09-19T09:52:04.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.835+0000 7ff9177fe640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff9040a32c0 0x7ff9040a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff908009990 tx=0x7ff908009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:04.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:04.838+0000 7ff9157fa640 1 -- 172.21.15.18:0/655529436 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9100bdce0 con 0x7ff918107900 2024-09-19T09:52:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.022+0000 7ff91dc66640 1 -- 172.21.15.18:0/655529436 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7ff918062630 con 0x7ff9040a32c0 2024-09-19T09:52:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.023+0000 7ff9157fa640 1 -- 172.21.15.18:0/655529436 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7ff918062630 con 0x7ff9040a32c0 2024-09-19T09:52:05.026 INFO:teuthology.orchestra.run.smithi018.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T09:52:05.026 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120091480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T09:52:05.027 INFO:teuthology.orchestra.run.smithi018.stdout:smithi049 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747500D2480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:52:05.027 INFO:teuthology.orchestra.run.smithi018.stdout:smithi162 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JU400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:52:05.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.025+0000 7ff91dc66640 1 -- 172.21.15.18:0/655529436 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff9040a32c0 msgr2=0x7ff9040a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.025+0000 7ff91dc66640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff9040a32c0 0x7ff9040a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff908009990 tx=0x7ff908009110 comp rx=0 tx=0).stop 2024-09-19T09:52:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.025+0000 7ff91dc66640 1 -- 172.21.15.18:0/655529436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff918107900 msgr2=0x7ff918100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.025+0000 7ff91dc66640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff918107900 0x7ff918100b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff9100098d0 tx=0x7ff91002f840 comp rx=0 tx=0).stop 2024-09-19T09:52:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.026+0000 7ff91dc66640 1 -- 172.21.15.18:0/655529436 shutdown_connections 2024-09-19T09:52:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.026+0000 7ff91dc66640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff9040a32c0 0x7ff9040a5780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.026+0000 7ff91dc66640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff918107900 0x7ff918100b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.026+0000 7ff91dc66640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff918104fd0 0x7ff918100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.026+0000 7ff91dc66640 1 --2- 172.21.15.18:0/655529436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9181026a0 0x7ff918102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.026+0000 7ff91dc66640 1 -- 172.21.15.18:0/655529436 >> 172.21.15.18:0/655529436 conn(0x7ff9180fc2a0 msgr2=0x7ff918102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.026+0000 7ff91dc66640 1 -- 172.21.15.18:0/655529436 shutdown_connections 2024-09-19T09:52:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:05.026+0000 7ff91dc66640 1 -- 172.21.15.18:0/655529436 wait complete. 2024-09-19T09:52:05.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:04 smithi018 ceph-mon[30956]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:05.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:04 smithi162 ceph-mon[35174]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:05.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:04 smithi049 ceph-mon[34858]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:05.799 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:52:05.809 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:52:05.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:52:06.103 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:06.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:05 smithi018 ceph-mon[30956]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T09:52:06.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:05 smithi018 ceph-mon[30956]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:06.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:05 smithi162 ceph-mon[35174]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T09:52:06.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:05 smithi162 ceph-mon[35174]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:05 smithi049 ceph-mon[34858]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T09:52:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:05 smithi049 ceph-mon[34858]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:52:06.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1980416188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b9c102e00 msgr2=0x7f8b9c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:06.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 --2- 172.21.15.18:0/1980416188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b9c102e00 0x7f8b9c103280 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009900 tx=0x7f8b9002a410 comp rx=0 tx=0).stop 2024-09-19T09:52:06.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1980416188 shutdown_connections 2024-09-19T09:52:06.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 --2- 172.21.15.18:0/1980416188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c1037c0 0x7f8b9c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:06.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 --2- 172.21.15.18:0/1980416188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b9c102e00 0x7f8b9c103280 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:06.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 --2- 172.21.15.18:0/1980416188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b9c101c00 0x7f8b9c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:06.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1980416188 >> 172.21.15.18:0/1980416188 conn(0x7f8b9c0fd390 msgr2=0x7f8b9c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:06.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1980416188 shutdown_connections 2024-09-19T09:52:06.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1980416188 wait complete. 2024-09-19T09:52:06.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 Processor -- start 2024-09-19T09:52:06.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.550+0000 7f8ba27fd640 1 -- start start 2024-09-19T09:52:06.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8ba27fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b9c101c00 0x7f8b9c198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:06.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8ba27fd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b9c102e00 0x7f8b9c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:06.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8ba27fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c1037c0 0x7f8b9c19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:06.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8ba27fd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c10d9d0 con 0x7f8b9c102e00 2024-09-19T09:52:06.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8ba27fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c10d850 con 0x7f8b9c101c00 2024-09-19T09:52:06.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8ba27fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c10db50 con 0x7f8b9c1037c0 2024-09-19T09:52:06.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8b9b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b9c102e00 0x7f8b9c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:06.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8b9b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b9c102e00 0x7f8b9c1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51344/0 (socket says 172.21.15.18:51344) 2024-09-19T09:52:06.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8b9b7fe640 1 -- 172.21.15.18:0/1030619631 learned_addr learned my addr 172.21.15.18:0/1030619631 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:06.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8ba0d9a640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c1037c0 0x7f8b9c19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:06.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8b9bfff640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b9c101c00 0x7f8b9c198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:06.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8b9b7fe640 1 -- 172.21.15.18:0/1030619631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c1037c0 msgr2=0x7f8b9c19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:06.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8b9b7fe640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c1037c0 0x7f8b9c19f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:06.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8b9b7fe640 1 -- 172.21.15.18:0/1030619631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b9c101c00 msgr2=0x7f8b9c198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:06.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8b9b7fe640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b9c101c00 0x7f8b9c198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:06.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8b9b7fe640 1 -- 172.21.15.18:0/1030619631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c19fcb0 con 0x7f8b9c102e00 2024-09-19T09:52:06.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.551+0000 7f8b9b7fe640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b9c102e00 0x7f8b9c1985c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8b9002aa00 tx=0x7f8b90032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:06.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.552+0000 7f8b997fa640 1 -- 172.21.15.18:0/1030619631 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9003f030 con 0x7f8b9c102e00 2024-09-19T09:52:06.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.552+0000 7f8b997fa640 1 -- 172.21.15.18:0/1030619631 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b90003ce0 con 0x7f8b9c102e00 2024-09-19T09:52:06.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.552+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1030619631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c19ff40 con 0x7f8b9c102e00 2024-09-19T09:52:06.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.552+0000 7f8b997fa640 1 -- 172.21.15.18:0/1030619631 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90035070 con 0x7f8b9c102e00 2024-09-19T09:52:06.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.552+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1030619631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c1a0420 con 0x7f8b9c102e00 2024-09-19T09:52:06.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.553+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1030619631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9c109050 con 0x7f8b9c102e00 2024-09-19T09:52:06.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.554+0000 7f8b997fa640 1 -- 172.21.15.18:0/1030619631 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8b90042030 con 0x7f8b9c102e00 2024-09-19T09:52:06.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.554+0000 7f8b997fa640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8b840a32f0 0x7f8b840a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:06.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.555+0000 7f8b9bfff640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8b840a32f0 0x7f8b840a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:06.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.555+0000 7f8b997fa640 1 -- 172.21.15.18:0/1030619631 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8b900f03e0 con 0x7f8b9c102e00 2024-09-19T09:52:06.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.555+0000 7f8b9bfff640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8b840a32f0 0x7f8b840a57b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c102c60 tx=0x7f8b8c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:06.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.558+0000 7f8b997fa640 1 -- 172.21.15.18:0/1030619631 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b900bd130 con 0x7f8b9c102e00 2024-09-19T09:52:06.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.767+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1030619631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8b9c062e90 con 0x7f8b9c102e00 2024-09-19T09:52:06.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.768+0000 7f8b997fa640 1 -- 172.21.15.18:0/1030619631 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3115 (secure 0 0 0) 0x7f8b900bca30 con 0x7f8b9c102e00 2024-09-19T09:52:06.771 INFO:teuthology.orchestra.run.smithi018.stdout:e27 2024-09-19T09:52:06.771 INFO:teuthology.orchestra.run.smithi018.stdout:btime 2024-09-19T09:50:41:339962+0000 2024-09-19T09:52:06.771 INFO:teuthology.orchestra.run.smithi018.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:52:06.771 INFO:teuthology.orchestra.run.smithi018.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:52:06.771 INFO:teuthology.orchestra.run.smithi018.stdout:legacy client fscid: 1 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:fs_name cephfs 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 27 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-19T09:50:29.937674+0000 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-09-19T09:50:41.339939+0000 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:tableserver 0 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:root 0 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:session_timeout 300 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:session_autoclose 300 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:max_file_size 1099511627776 2024-09-19T09:52:06.772 INFO:teuthology.orchestra.run.smithi018.stdout:max_xattr_size 65536 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:required_client_features {} 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:last_failure 0 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:last_failure_osd_epoch 0 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:max_mds 5 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:in 0,1,2,3,4 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:up {0=24524,1=24488,2=24484,3=24470,4=14592} 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:failed 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:damaged 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:stopped 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:data_pools [3] 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:metadata_pool 2 2024-09-19T09:52:06.773 INFO:teuthology.orchestra.run.smithi018.stdout:inline_data disabled 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:balancer 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:bal_rank_mask -1 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:standby_count_wanted 0 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:qdb_cluster leader: 24524 members: 24488,24484,24470,24524,14592 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b{0:24524} state up:active seq 4 addr [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c{0:24463} state up:standby-replay seq 1 addr [v2:172.21.15.162:6836/3104050334,v1:172.21.15.162:6837/3104050334] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.h{1:24488} state up:active seq 9 addr [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.f{1:24457} state up:standby-replay seq 1 addr [v2:172.21.15.162:6834/2083709123,v1:172.21.15.162:6835/2083709123] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.i{2:24484} state up:active seq 8 addr [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.k{2:24440} state up:standby-replay seq 1 addr [v2:172.21.15.49:6832/94526458,v1:172.21.15.49:6833/94526458] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.e{3:24470} state up:active seq 11 addr [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.l{3:24430} state up:standby-replay seq 1 addr [v2:172.21.15.162:6832/212444721,v1:172.21.15.162:6833/212444721] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.774 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a{4:14592} state up:active seq 7 addr [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.775 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.g{4:14580} state up:standby-replay seq 1 addr [v2:172.21.15.18:6838/2438161705,v1:172.21.15.18:6839/2438161705] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:06.775 INFO:teuthology.orchestra.run.smithi018.stdout:Standby daemons: 2024-09-19T09:52:06.775 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:06.775 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.18:6834/643561171,v1:172.21.15.18:6835/643561171] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.775 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d{-1:14541} state up:standby seq 1 addr [v2:172.21.15.18:6836/70672754,v1:172.21.15.18:6837/70672754] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:52:06.775 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1030619631 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8b840a32f0 msgr2=0x7f8b840a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8b840a32f0 0x7f8b840a57b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c102c60 tx=0x7f8b8c008040 comp rx=0 tx=0).stop 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1030619631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b9c102e00 msgr2=0x7f8b9c1985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b9c102e00 0x7f8b9c1985c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8b9002aa00 tx=0x7f8b90032da0 comp rx=0 tx=0).stop 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1030619631 shutdown_connections 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8b840a32f0 0x7f8b840a57b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b9c1037c0 0x7f8b9c19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b9c102e00 0x7f8b9c1985c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 --2- 172.21.15.18:0/1030619631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b9c101c00 0x7f8b9c198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1030619631 >> 172.21.15.18:0/1030619631 conn(0x7f8b9c0fd390 msgr2=0x7f8b9c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:06.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1030619631 shutdown_connections 2024-09-19T09:52:06.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:06.770+0000 7f8ba27fd640 1 -- 172.21.15.18:0/1030619631 wait complete. 2024-09-19T09:52:07.069 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:06 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1030619631' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:52:07.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:06 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1030619631' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:52:07.358 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T09:52:07.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:06 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1030619631' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:52:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:08.030 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:07 smithi018 ceph-mon[30956]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T09:52:08.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.053+0000 7f42e4035640 1 -- 172.21.15.18:0/321755771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42dc101cd0 msgr2=0x7f42dc102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:08.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.053+0000 7f42e4035640 1 --2- 172.21.15.18:0/321755771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42dc101cd0 0x7f42dc102150 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009900 tx=0x7f42cc02a410 comp rx=0 tx=0).stop 2024-09-19T09:52:08.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.053+0000 7f42e4035640 1 -- 172.21.15.18:0/321755771 shutdown_connections 2024-09-19T09:52:08.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.053+0000 7f42e4035640 1 --2- 172.21.15.18:0/321755771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42dc102690 0x7f42dc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:08.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.053+0000 7f42e4035640 1 --2- 172.21.15.18:0/321755771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42dc101cd0 0x7f42dc102150 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:08.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.053+0000 7f42e4035640 1 --2- 172.21.15.18:0/321755771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42dc100ad0 0x7f42dc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:08.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.053+0000 7f42e4035640 1 -- 172.21.15.18:0/321755771 >> 172.21.15.18:0/321755771 conn(0x7f42dc0fc280 msgr2=0x7f42dc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:08.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.053+0000 7f42e4035640 1 -- 172.21.15.18:0/321755771 shutdown_connections 2024-09-19T09:52:08.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.053+0000 7f42e4035640 1 -- 172.21.15.18:0/321755771 wait complete. 2024-09-19T09:52:08.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e4035640 1 Processor -- start 2024-09-19T09:52:08.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e4035640 1 -- start start 2024-09-19T09:52:08.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e4035640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42dc100ad0 0x7f42dc104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:08.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e4035640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42dc101cd0 0x7f42dc1030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:08.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e4035640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42dc102690 0x7f42dc1035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:08.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e4035640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc10c730 con 0x7f42dc101cd0 2024-09-19T09:52:08.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e4035640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc10c5b0 con 0x7f42dc100ad0 2024-09-19T09:52:08.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e4035640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc10c8b0 con 0x7f42dc102690 2024-09-19T09:52:08.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e15d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42dc101cd0 0x7f42dc1030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:08.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e15d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42dc101cd0 0x7f42dc1030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51354/0 (socket says 172.21.15.18:51354) 2024-09-19T09:52:08.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e15d0640 1 -- 172.21.15.18:0/3180282410 learned_addr learned my addr 172.21.15.18:0/3180282410 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:08.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.054+0000 7f42e1dd1640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42dc100ad0 0x7f42dc104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:08.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42e25d2640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42dc102690 0x7f42dc1035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:08.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42e15d0640 1 -- 172.21.15.18:0/3180282410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42dc102690 msgr2=0x7f42dc1035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:08.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42e15d0640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42dc102690 0x7f42dc1035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:08.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42e15d0640 1 -- 172.21.15.18:0/3180282410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42dc100ad0 msgr2=0x7f42dc104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:08.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42e15d0640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42dc100ad0 0x7f42dc104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:08.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42e15d0640 1 -- 172.21.15.18:0/3180282410 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc103eb0 con 0x7f42dc101cd0 2024-09-19T09:52:08.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42e25d2640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42dc102690 0x7f42dc1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:08.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42e15d0640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42dc101cd0 0x7f42dc1030b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f42cc006010 tx=0x7f42cc004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:08.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42d2ffd640 1 -- 172.21.15.18:0/3180282410 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc03f030 con 0x7f42dc101cd0 2024-09-19T09:52:08.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42e4035640 1 -- 172.21.15.18:0/3180282410 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42dc1a2070 con 0x7f42dc101cd0 2024-09-19T09:52:08.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42d2ffd640 1 -- 172.21.15.18:0/3180282410 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42cc003ce0 con 0x7f42dc101cd0 2024-09-19T09:52:08.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42d2ffd640 1 -- 172.21.15.18:0/3180282410 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc035070 con 0x7f42dc101cd0 2024-09-19T09:52:08.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.055+0000 7f42e4035640 1 -- 172.21.15.18:0/3180282410 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42dc1a2520 con 0x7f42dc101cd0 2024-09-19T09:52:08.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.056+0000 7f42e4035640 1 -- 172.21.15.18:0/3180282410 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42dc1a2810 con 0x7f42dc101cd0 2024-09-19T09:52:08.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.058+0000 7f42d2ffd640 1 -- 172.21.15.18:0/3180282410 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f42cc042030 con 0x7f42dc101cd0 2024-09-19T09:52:08.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.058+0000 7f42d2ffd640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f42c80a3240 0x7f42c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:08.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.058+0000 7f42d2ffd640 1 -- 172.21.15.18:0/3180282410 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f42cc0f0200 con 0x7f42dc101cd0 2024-09-19T09:52:08.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.058+0000 7f42e1dd1640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f42c80a3240 0x7f42c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:08.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.059+0000 7f42e1dd1640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f42c80a3240 0x7f42c80a5700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f42d8005fd0 tx=0x7f42d800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:08.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.062+0000 7f42d2ffd640 1 -- 172.21.15.18:0/3180282410 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f42cc0bcf50 con 0x7f42dc101cd0 2024-09-19T09:52:08.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:07 smithi162 ceph-mon[35174]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T09:52:08.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.243+0000 7f42e4035640 1 -- 172.21.15.18:0/3180282410 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f42dc1a29e0 con 0x7f42dc101cd0 2024-09-19T09:52:08.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.244+0000 7f42d2ffd640 1 -- 172.21.15.18:0/3180282410 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5239 (secure 0 0 0) 0x7f42cc0bc850 con 0x7f42dc101cd0 2024-09-19T09:52:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 84 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:fsid 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-19T09:42:35.497952+0000 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-09-19T09:51:31.811334+0000 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:crush_version 26 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:full_ratio 0.95 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:backfillfull_ratio 0.9 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:nearfull_ratio 0.85 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:require_min_compat_client luminous 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:min_compat_client luminous 2024-09-19T09:52:08.248 INFO:teuthology.orchestra.run.smithi018.stdout:require_osd_release squid 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:stretch_mode_enabled false 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:max_osd 12 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 up in weight 1 up_from 8 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6802/92239132,v1:172.21.15.18:6803/92239132] [v2:172.21.15.18:6804/92239132,v1:172.21.15.18:6805/92239132] exists,up 703e518f-f9d8-41f1-84cb-2d8dfe53c98c 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 up in weight 1 up_from 13 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6800/368229306,v1:172.21.15.49:6801/368229306] [v2:172.21.15.49:6802/368229306,v1:172.21.15.49:6803/368229306] exists,up 5783af38-5921-4147-964c-d4a3f4f81ff6 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6800/1401721539,v1:172.21.15.162:6801/1401721539] [v2:172.21.15.162:6802/1401721539,v1:172.21.15.162:6803/1401721539] exists,up ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6810/2371576209,v1:172.21.15.18:6811/2371576209] [v2:172.21.15.18:6812/2371576209,v1:172.21.15.18:6813/2371576209] exists,up 3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 up in weight 1 up_from 32 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6808/3971547728,v1:172.21.15.49:6809/3971547728] [v2:172.21.15.49:6810/3971547728,v1:172.21.15.49:6811/3971547728] exists,up eb894107-ee7c-4c7c-8d84-173445174dcf 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 up in weight 1 up_from 37 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6808/2223869485,v1:172.21.15.162:6809/2223869485] [v2:172.21.15.162:6810/2223869485,v1:172.21.15.162:6811/2223869485] exists,up 2654f083-56fe-4de5-bc96-e47e8ef9dca1 2024-09-19T09:52:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 up in weight 1 up_from 45 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6818/1979863681,v1:172.21.15.18:6819/1979863681] [v2:172.21.15.18:6820/1979863681,v1:172.21.15.18:6821/1979863681] exists,up 9d62113a-1d28-4c49-a893-1ade15236dc7 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 up in weight 1 up_from 50 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6816/3068141986,v1:172.21.15.49:6817/3068141986] [v2:172.21.15.49:6818/3068141986,v1:172.21.15.49:6819/3068141986] exists,up 8ec6cadf-ad0b-4ae7-bafc-40c901da2173 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:osd.8 up in weight 1 up_from 57 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6816/2887612683,v1:172.21.15.162:6817/2887612683] [v2:172.21.15.162:6818/2887612683,v1:172.21.15.162:6819/2887612683] exists,up c9eed0ed-9719-4772-be83-f6849ab08bf3 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:osd.9 up in weight 1 up_from 64 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6826/3527304690,v1:172.21.15.18:6827/3527304690] [v2:172.21.15.18:6828/3527304690,v1:172.21.15.18:6829/3527304690] exists,up 1ba61d77-2981-4ff0-8253-e8a4aacf19b6 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:osd.10 up in weight 1 up_from 69 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6824/2226510047,v1:172.21.15.49:6825/2226510047] [v2:172.21.15.49:6826/2226510047,v1:172.21.15.49:6827/2226510047] exists,up da1f71af-43ea-4fa2-b5bb-f502936f4e6b 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:osd.11 up in weight 1 up_from 76 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6824/3607280204,v1:172.21.15.162:6825/3607280204] [v2:172.21.15.162:6826/3607280204,v1:172.21.15.162:6827/3607280204] exists,up 1202ee7d-aee9-4ee8-97cc-5ca3eaa99367 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.4 [2,11] 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.1b [4,8] 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.1e [3,9] 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.2c [4,9] 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.33 [5,9] 2024-09-19T09:52:08.250 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.3a [4,6] 2024-09-19T09:52:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/3655731262 expires 2024-09-20T09:43:30.259608+0000 2024-09-19T09:52:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/3886965559 expires 2024-09-20T09:43:30.259608+0000 2024-09-19T09:52:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/809218832 expires 2024-09-20T09:43:30.259608+0000 2024-09-19T09:52:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/1191027709 expires 2024-09-20T09:43:06.466314+0000 2024-09-19T09:52:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/288316346 expires 2024-09-20T09:43:06.466314+0000 2024-09-19T09:52:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6801/2865418420 expires 2024-09-20T09:43:06.466314+0000 2024-09-19T09:52:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/446921657 expires 2024-09-20T09:43:30.259608+0000 2024-09-19T09:52:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6801/809218832 expires 2024-09-20T09:43:30.259608+0000 2024-09-19T09:52:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/2865418420 expires 2024-09-20T09:43:06.466314+0000 2024-09-19T09:52:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/633086506 expires 2024-09-20T09:43:06.466314+0000 2024-09-19T09:52:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 -- 172.21.15.18:0/3180282410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f42c80a3240 msgr2=0x7f42c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f42c80a3240 0x7f42c80a5700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f42d8005fd0 tx=0x7f42d800b410 comp rx=0 tx=0).stop 2024-09-19T09:52:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 -- 172.21.15.18:0/3180282410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42dc101cd0 msgr2=0x7f42dc1030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42dc101cd0 0x7f42dc1030b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f42cc006010 tx=0x7f42cc004360 comp rx=0 tx=0).stop 2024-09-19T09:52:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 -- 172.21.15.18:0/3180282410 shutdown_connections 2024-09-19T09:52:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f42c80a3240 0x7f42c80a5700 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:08.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42dc102690 0x7f42dc1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:08.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42dc101cd0 0x7f42dc1030b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:08.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 --2- 172.21.15.18:0/3180282410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42dc100ad0 0x7f42dc104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:08.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 -- 172.21.15.18:0/3180282410 >> 172.21.15.18:0/3180282410 conn(0x7f42dc0fc280 msgr2=0x7f42dc06a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:08.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 -- 172.21.15.18:0/3180282410 shutdown_connections 2024-09-19T09:52:08.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:08.247+0000 7f42e4035640 1 -- 172.21.15.18:0/3180282410 wait complete. 2024-09-19T09:52:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:07 smithi049 ceph-mon[34858]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T09:52:09.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:08 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3180282410' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:52:09.064 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T09:52:09.075 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:52:09.332 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:09.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:08 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3180282410' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:52:09.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:08 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3180282410' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:52:09.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.753+0000 7f3b41af9640 1 -- 172.21.15.18:0/2671043740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b3c101de0 msgr2=0x7f3b3c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:09.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.753+0000 7f3b41af9640 1 --2- 172.21.15.18:0/2671043740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b3c101de0 0x7f3b3c1021c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009900 tx=0x7f3b2c02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.753+0000 7f3b41af9640 1 -- 172.21.15.18:0/2671043740 shutdown_connections 2024-09-19T09:52:09.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.753+0000 7f3b41af9640 1 --2- 172.21.15.18:0/2671043740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3c106f10 0x7f3b3c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.753+0000 7f3b41af9640 1 --2- 172.21.15.18:0/2671043740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c102790 0x7f3b3c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.753+0000 7f3b41af9640 1 --2- 172.21.15.18:0/2671043740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b3c101de0 0x7f3b3c1021c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.753+0000 7f3b41af9640 1 -- 172.21.15.18:0/2671043740 >> 172.21.15.18:0/2671043740 conn(0x7f3b3c0fd8c0 msgr2=0x7f3b3c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:09.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.753+0000 7f3b41af9640 1 -- 172.21.15.18:0/2671043740 shutdown_connections 2024-09-19T09:52:09.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.753+0000 7f3b41af9640 1 -- 172.21.15.18:0/2671043740 wait complete. 2024-09-19T09:52:09.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.754+0000 7f3b41af9640 1 Processor -- start 2024-09-19T09:52:09.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.754+0000 7f3b41af9640 1 -- start start 2024-09-19T09:52:09.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b41af9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3c101de0 0x7f3b3c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b41af9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b3c102790 0x7f3b3c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b41af9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c106f10 0x7f3b3c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b41af9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c111fe0 con 0x7f3b3c102790 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b41af9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c111e60 con 0x7f3b3c101de0 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b41af9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c112160 con 0x7f3b3c106f10 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b3c102790 0x7f3b3c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b3c102790 0x7f3b3c198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51380/0 (socket says 172.21.15.18:51380) 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3affd640 1 -- 172.21.15.18:0/485534516 learned_addr learned my addr 172.21.15.18:0/485534516 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3bfff640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c106f10 0x7f3b3c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3b7fe640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3c101de0 0x7f3b3c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3affd640 1 -- 172.21.15.18:0/485534516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c106f10 msgr2=0x7f3b3c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3affd640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c106f10 0x7f3b3c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3affd640 1 -- 172.21.15.18:0/485534516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3c101de0 msgr2=0x7f3b3c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3affd640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3c101de0 0x7f3b3c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3affd640 1 -- 172.21.15.18:0/485534516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c19d3d0 con 0x7f3b3c102790 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3bfff640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c106f10 0x7f3b3c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3b7fe640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3c101de0 0x7f3b3c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b3affd640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b3c102790 0x7f3b3c198960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000b4a0 tx=0x7f3b3000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.755+0000 7f3b38ff9640 1 -- 172.21.15.18:0/485534516 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30014070 con 0x7f3b3c102790 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.756+0000 7f3b41af9640 1 -- 172.21.15.18:0/485534516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3c19d6c0 con 0x7f3b3c102790 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.756+0000 7f3b38ff9640 1 -- 172.21.15.18:0/485534516 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b30010af0 con 0x7f3b3c102790 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.756+0000 7f3b38ff9640 1 -- 172.21.15.18:0/485534516 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30017d10 con 0x7f3b3c102790 2024-09-19T09:52:09.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.756+0000 7f3b41af9640 1 -- 172.21.15.18:0/485534516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3c1a4fa0 con 0x7f3b3c102790 2024-09-19T09:52:09.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.757+0000 7f3b41af9640 1 -- 172.21.15.18:0/485534516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b3c1021c0 con 0x7f3b3c102790 2024-09-19T09:52:09.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.758+0000 7f3b38ff9640 1 -- 172.21.15.18:0/485534516 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3b30017070 con 0x7f3b3c102790 2024-09-19T09:52:09.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.759+0000 7f3b38ff9640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b240a32c0 0x7f3b240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:09.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.760+0000 7f3b3b7fe640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b240a32c0 0x7f3b240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:09.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.760+0000 7f3b38ff9640 1 -- 172.21.15.18:0/485534516 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3b300cf090 con 0x7f3b3c102790 2024-09-19T09:52:09.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.760+0000 7f3b3b7fe640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b240a32c0 0x7f3b240a5780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c005ab0 tx=0x7f3b2c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.762+0000 7f3b38ff9640 1 -- 172.21.15.18:0/485534516 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b3009bde0 con 0x7f3b3c102790 2024-09-19T09:52:09.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.974+0000 7f3b41af9640 1 -- 172.21.15.18:0/485534516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b3c199780 con 0x7f3b3c102790 2024-09-19T09:52:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.975+0000 7f3b38ff9640 1 -- 172.21.15.18:0/485534516 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11954 (secure 0 0 0) 0x7f3b3c199780 con 0x7f3b3c102790 2024-09-19T09:52:09.978 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:09.978 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"btime":"2024-09-19T09:50:41:339962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:50:41.339939+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[24488,24484,24470,24524,14592]},"id":1}]} 2024-09-19T09:52:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-09-19T09:52:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 -- 172.21.15.18:0/485534516 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b240a32c0 msgr2=0x7f3b240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b240a32c0 0x7f3b240a5780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c005ab0 tx=0x7f3b2c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 -- 172.21.15.18:0/485534516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b3c102790 msgr2=0x7f3b3c198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b3c102790 0x7f3b3c198960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000b4a0 tx=0x7f3b3000b960 comp rx=0 tx=0).stop 2024-09-19T09:52:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 -- 172.21.15.18:0/485534516 shutdown_connections 2024-09-19T09:52:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b240a32c0 0x7f3b240a5780 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c106f10 0x7f3b3c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b3c102790 0x7f3b3c198960 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 --2- 172.21.15.18:0/485534516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b3c101de0 0x7f3b3c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:09.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 -- 172.21.15.18:0/485534516 >> 172.21.15.18:0/485534516 conn(0x7f3b3c0fd8c0 msgr2=0x7f3b3c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:09.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 -- 172.21.15.18:0/485534516 shutdown_connections 2024-09-19T09:52:09.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:09.978+0000 7f3b41af9640 1 -- 172.21.15.18:0/485534516 wait complete. 2024-09-19T09:52:10.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:09 smithi018 ceph-mon[30956]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T09:52:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:09 smithi049 ceph-mon[34858]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T09:52:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:09 smithi162 ceph-mon[35174]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T09:52:10.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:52:10.845 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:11.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:10 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/485534516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:11.589 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:10 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/485534516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:11.589 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:10 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/485534516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.270+0000 7f79cd635640 1 -- 172.21.15.18:0/1188356557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8102790 msgr2=0x7f79c81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.270+0000 7f79cd635640 1 --2- 172.21.15.18:0/1188356557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8102790 0x7f79c81067e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009900 tx=0x7f79bc02a410 comp rx=0 tx=0).stop 2024-09-19T09:52:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.270+0000 7f79cd635640 1 -- 172.21.15.18:0/1188356557 shutdown_connections 2024-09-19T09:52:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.270+0000 7f79cd635640 1 --2- 172.21.15.18:0/1188356557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c8106f10 0x7f79c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.270+0000 7f79cd635640 1 --2- 172.21.15.18:0/1188356557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8102790 0x7f79c81067e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.270+0000 7f79cd635640 1 --2- 172.21.15.18:0/1188356557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c8101de0 0x7f79c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.270+0000 7f79cd635640 1 -- 172.21.15.18:0/1188356557 >> 172.21.15.18:0/1188356557 conn(0x7f79c80fd8c0 msgr2=0x7f79c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.270+0000 7f79cd635640 1 -- 172.21.15.18:0/1188356557 shutdown_connections 2024-09-19T09:52:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.270+0000 7f79cd635640 1 -- 172.21.15.18:0/1188356557 wait complete. 2024-09-19T09:52:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.271+0000 7f79cd635640 1 Processor -- start 2024-09-19T09:52:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.271+0000 7f79cd635640 1 -- start start 2024-09-19T09:52:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.271+0000 7f79cd635640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c8101de0 0x7f79c8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.271+0000 7f79cd635640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c8102790 0x7f79c8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.271+0000 7f79cd635640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8106f10 0x7f79c819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.271+0000 7f79cd635640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8111fc0 con 0x7f79c8106f10 2024-09-19T09:52:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.271+0000 7f79cd635640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8111e40 con 0x7f79c8102790 2024-09-19T09:52:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.271+0000 7f79cd635640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8112140 con 0x7f79c8101de0 2024-09-19T09:52:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8106f10 0x7f79c819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8106f10 0x7f79c819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51396/0 (socket says 172.21.15.18:51396) 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c77fe640 1 -- 172.21.15.18:0/717511806 learned_addr learned my addr 172.21.15.18:0/717511806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c6ffd640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c8101de0 0x7f79c8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c67fc640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c8102790 0x7f79c8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c77fe640 1 -- 172.21.15.18:0/717511806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c8101de0 msgr2=0x7f79c8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c77fe640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c8101de0 0x7f79c8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c77fe640 1 -- 172.21.15.18:0/717511806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c8102790 msgr2=0x7f79c8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c77fe640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c8102790 0x7f79c8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c77fe640 1 -- 172.21.15.18:0/717511806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c819d3f0 con 0x7f79c8106f10 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c6ffd640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c8101de0 0x7f79c8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79c77fe640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8106f10 0x7f79c819cd10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009fd0 tx=0x7f79c000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79affff640 1 -- 172.21.15.18:0/717511806 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0017070 con 0x7f79c8106f10 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79affff640 1 -- 172.21.15.18:0/717511806 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79c0003e50 con 0x7f79c8106f10 2024-09-19T09:52:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79cd635640 1 -- 172.21.15.18:0/717511806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c819d6e0 con 0x7f79c8106f10 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79affff640 1 -- 172.21.15.18:0/717511806 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c00106c0 con 0x7f79c8106f10 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.272+0000 7f79cd635640 1 -- 172.21.15.18:0/717511806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c81a4fc0 con 0x7f79c8106f10 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.274+0000 7f79cd635640 1 -- 172.21.15.18:0/717511806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c81032c0 con 0x7f79c8106f10 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.275+0000 7f79affff640 1 -- 172.21.15.18:0/717511806 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f79c0003970 con 0x7f79c8106f10 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.276+0000 7f79affff640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b00a3240 0x7f79b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.276+0000 7f79c6ffd640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b00a3240 0x7f79b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.276+0000 7f79affff640 1 -- 172.21.15.18:0/717511806 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f79c00cf6c0 con 0x7f79c8106f10 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.276+0000 7f79c6ffd640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b00a3240 0x7f79b00a5700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f79b80058c0 tx=0x7f79b8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.280+0000 7f79affff640 1 -- 172.21.15.18:0/717511806 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79c009c410 con 0x7f79c8106f10 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.498+0000 7f79cd635640 1 -- 172.21.15.18:0/717511806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79c810a150 con 0x7f79c8106f10 2024-09-19T09:52:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.498+0000 7f79affff640 1 -- 172.21.15.18:0/717511806 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11954 (secure 0 0 0) 0x7f79c009bd10 con 0x7f79c8106f10 2024-09-19T09:52:11.594 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:11.594 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"btime":"2024-09-19T09:50:41:339962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:50:41.339939+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[24488,24484,24470,24524,14592]},"id":1}]} 2024-09-19T09:52:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-09-19T09:52:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 -- 172.21.15.18:0/717511806 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b00a3240 msgr2=0x7f79b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b00a3240 0x7f79b00a5700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f79b80058c0 tx=0x7f79b8005850 comp rx=0 tx=0).stop 2024-09-19T09:52:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 -- 172.21.15.18:0/717511806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8106f10 msgr2=0x7f79c819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8106f10 0x7f79c819cd10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009fd0 tx=0x7f79c000b260 comp rx=0 tx=0).stop 2024-09-19T09:52:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 -- 172.21.15.18:0/717511806 shutdown_connections 2024-09-19T09:52:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b00a3240 0x7f79b00a5700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:11.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8106f10 0x7f79c819cd10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:11.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c8102790 0x7f79c8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:11.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 --2- 172.21.15.18:0/717511806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79c8101de0 0x7f79c8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:11.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 -- 172.21.15.18:0/717511806 >> 172.21.15.18:0/717511806 conn(0x7f79c80fd8c0 msgr2=0x7f79c80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:11.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 -- 172.21.15.18:0/717511806 shutdown_connections 2024-09-19T09:52:11.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:11.501+0000 7f79cd635640 1 -- 172.21.15.18:0/717511806 wait complete. 2024-09-19T09:52:12.066 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:52:12.090 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:11 smithi018 ceph-mon[30956]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T09:52:12.090 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:11 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/717511806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:11 smithi049 ceph-mon[34858]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T09:52:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:11 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/717511806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:12.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:11 smithi162 ceph-mon[35174]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T09:52:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:11 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/717511806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.794+0000 7f91dd4e6640 1 -- 172.21.15.18:0/3806151339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d810e3c0 msgr2=0x7f91d8110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.794+0000 7f91dd4e6640 1 --2- 172.21.15.18:0/3806151339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d810e3c0 0x7f91d8110810 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009ca0 tx=0x7f91d002a950 comp rx=0 tx=0).stop 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.794+0000 7f91dd4e6640 1 -- 172.21.15.18:0/3806151339 shutdown_connections 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.794+0000 7f91dd4e6640 1 --2- 172.21.15.18:0/3806151339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d810e3c0 0x7f91d8110810 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.794+0000 7f91dd4e6640 1 --2- 172.21.15.18:0/3806151339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d8074f40 0x7f91d810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.794+0000 7f91dd4e6640 1 --2- 172.21.15.18:0/3806151339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d8074620 0x7f91d8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.794+0000 7f91dd4e6640 1 -- 172.21.15.18:0/3806151339 >> 172.21.15.18:0/3806151339 conn(0x7f91d80fd8c0 msgr2=0x7f91d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.794+0000 7f91dd4e6640 1 -- 172.21.15.18:0/3806151339 shutdown_connections 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.794+0000 7f91dd4e6640 1 -- 172.21.15.18:0/3806151339 wait complete. 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91dd4e6640 1 Processor -- start 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91dd4e6640 1 -- start start 2024-09-19T09:52:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91dd4e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d8074620 0x7f91d81a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91dd4e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d8074f40 0x7f91d81a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91dd4e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d810e3c0 0x7f91d819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91dd4e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f91d8114230 con 0x7f91d8074620 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91dd4e6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91d81140b0 con 0x7f91d810e3c0 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91dd4e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91d81143b0 con 0x7f91d8074f40 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91d6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d8074620 0x7f91d81a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91d6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d8074620 0x7f91d81a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51406/0 (socket says 172.21.15.18:51406) 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91d6ffd640 1 -- 172.21.15.18:0/2828110326 learned_addr learned my addr 172.21.15.18:0/2828110326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.795+0000 7f91d77fe640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d810e3c0 0x7f91d819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91d67fc640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d8074f40 0x7f91d81a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91d6ffd640 1 -- 172.21.15.18:0/2828110326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d8074f40 msgr2=0x7f91d81a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91d6ffd640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d8074f40 0x7f91d81a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91d6ffd640 1 -- 172.21.15.18:0/2828110326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d810e3c0 msgr2=0x7f91d819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91d6ffd640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d810e3c0 0x7f91d819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91d6ffd640 1 -- 172.21.15.18:0/2828110326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d819acf0 con 0x7f91d8074620 2024-09-19T09:52:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91d6ffd640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d8074620 0x7f91d81a0400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f91c800b4a0 tx=0x7f91c800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91bffff640 1 -- 172.21.15.18:0/2828110326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8014070 con 0x7f91d8074620 2024-09-19T09:52:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91dd4e6640 1 -- 172.21.15.18:0/2828110326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d819afe0 con 0x7f91d8074620 2024-09-19T09:52:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91dd4e6640 1 -- 172.21.15.18:0/2828110326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d81a72d0 con 0x7f91d8074620 2024-09-19T09:52:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91bffff640 1 -- 172.21.15.18:0/2828110326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c8010af0 con 0x7f91d8074620 2024-09-19T09:52:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.796+0000 7f91bffff640 1 -- 172.21.15.18:0/2828110326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8017d10 con 0x7f91d8074620 2024-09-19T09:52:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.797+0000 7f91dd4e6640 1 -- 172.21.15.18:0/2828110326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d8074a80 con 0x7f91d8074620 2024-09-19T09:52:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.798+0000 7f91bffff640 1 -- 172.21.15.18:0/2828110326 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f91c8017070 con 0x7f91d8074620 2024-09-19T09:52:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.799+0000 7f91bffff640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91c00a3240 0x7f91c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.799+0000 7f91bffff640 1 -- 172.21.15.18:0/2828110326 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f91c80cece0 con 0x7f91d8074620 2024-09-19T09:52:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.799+0000 7f91d67fc640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91c00a3240 0x7f91c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.799+0000 7f91d67fc640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91c00a3240 0x7f91c00a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f91d80fff30 tx=0x7f91cc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:12.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.803+0000 7f91bffff640 1 -- 172.21.15.18:0/2828110326 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91c809ba30 con 0x7f91d8074620 2024-09-19T09:52:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.982+0000 7f91dd4e6640 1 -- 172.21.15.18:0/2828110326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91d8109540 con 0x7f91d8074620 2024-09-19T09:52:12.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.983+0000 7f91bffff640 1 -- 172.21.15.18:0/2828110326 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22571 (secure 0 0 0) 0x7f91c809b330 con 0x7f91d8074620 2024-09-19T09:52:12.986 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:12.986 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:51:31.811334+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:52:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 -- 172.21.15.18:0/2828110326 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91c00a3240 msgr2=0x7f91c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91c00a3240 0x7f91c00a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f91d80fff30 tx=0x7f91cc008040 comp rx=0 tx=0).stop 2024-09-19T09:52:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 -- 172.21.15.18:0/2828110326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d8074620 msgr2=0x7f91d81a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d8074620 0x7f91d81a0400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f91c800b4a0 tx=0x7f91c800b960 comp rx=0 tx=0).stop 2024-09-19T09:52:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 -- 172.21.15.18:0/2828110326 shutdown_connections 2024-09-19T09:52:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91c00a3240 0x7f91c00a5700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91d810e3c0 0x7f91d819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91d8074f40 0x7f91d81a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 --2- 172.21.15.18:0/2828110326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91d8074620 0x7f91d81a0400 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 -- 172.21.15.18:0/2828110326 >> 172.21.15.18:0/2828110326 conn(0x7f91d80fd8c0 msgr2=0x7f91d80ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 -- 172.21.15.18:0/2828110326 shutdown_connections 2024-09-19T09:52:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:12.986+0000 7f91dd4e6640 1 -- 172.21.15.18:0/2828110326 wait complete. 2024-09-19T09:52:13.618 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:50:29.937674+0000', 'modified': '2024-09-19T09:50:41.339939+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24524, 'mds_1': 24488, 'mds_2': 24484, 'mds_3': 24470, 'mds_4': 14592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14580': {'gid': 14580, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6839/2438161705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6838', 'nonce': 2438161705}, {'type': 'v1', 'addr': '172.21.15.18:6839', 'nonce': 2438161705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14592': {'gid': 14592, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.18:6841/1971133018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6840', 'nonce': 1971133018}, {'type': 'v1', 'addr': '172.21.15.18:6841', 'nonce': 1971133018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6833/212444721', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 212444721}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 212444721}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.49:6833/94526458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 94526458}, {'type': 'v1', 'addr': '172.21.15.49:6833', 'nonce': 94526458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/2083709123', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 2083709123}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 2083709123}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6837/3104050334', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 3104050334}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 3104050334}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.49:6835/4145133674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 4145133674}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 4145133674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.162:6839/2783930861', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 2783930861}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 2783930861}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.49:6837/1773266295', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 1773266295}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 1773266295}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24524': {'gid': 24524, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.49:6839/189898808', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6838', 'nonce': 189898808}, {'type': 'v1', 'addr': '172.21.15.49:6839', 'nonce': 189898808}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24524, 'qdb_cluster': [24488, 24484, 24470, 24524, 14592]} 2024-09-19T09:52:13.618 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:52:13.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-19T09:52:13.922 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:14.185 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:13 smithi018 ceph-mon[30956]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T09:52:14.185 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:13 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2828110326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:14.202 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:13 smithi049 ceph-mon[34858]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T09:52:14.203 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:13 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2828110326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:14.215 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:13 smithi162 ceph-mon[35174]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T09:52:14.215 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:13 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2828110326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.347+0000 7fcd64857640 1 -- 172.21.15.18:0/105594182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd60101240 msgr2=0x7fcd60101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.347+0000 7fcd64857640 1 --2- 172.21.15.18:0/105594182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd60101240 0x7fcd60101680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009900 tx=0x7fcd5402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.347+0000 7fcd64857640 1 -- 172.21.15.18:0/105594182 shutdown_connections 2024-09-19T09:52:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.347+0000 7fcd64857640 1 --2- 172.21.15.18:0/105594182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd60101bc0 0x7fcd6010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.347+0000 7fcd64857640 1 --2- 172.21.15.18:0/105594182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd60101240 0x7fcd60101680 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.347+0000 7fcd64857640 1 --2- 172.21.15.18:0/105594182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60105a90 0x7fcd60105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.347+0000 7fcd64857640 1 -- 172.21.15.18:0/105594182 >> 172.21.15.18:0/105594182 conn(0x7fcd60077210 msgr2=0x7fcd600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.347+0000 7fcd64857640 1 -- 172.21.15.18:0/105594182 shutdown_connections 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.347+0000 7fcd64857640 1 -- 172.21.15.18:0/105594182 wait complete. 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd64857640 1 Processor -- start 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd64857640 1 -- start start 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd64857640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd60101240 0x7fcd6010e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd64857640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60101bc0 0x7fcd6010e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd64857640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd60105a90 0x7fcd6010eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd64857640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcd601120d0 con 0x7fcd60105a90 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd64857640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60111f50 con 0x7fcd60101240 2024-09-19T09:52:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd64857640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60112250 con 0x7fcd60101bc0 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd5ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd60105a90 0x7fcd6010eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd5e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd60101240 0x7fcd6010e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd5ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd60105a90 0x7fcd6010eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51422/0 (socket says 172.21.15.18:51422) 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.348+0000 7fcd5ed9d640 1 -- 172.21.15.18:0/2338957147 learned_addr learned my addr 172.21.15.18:0/2338957147 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60101bc0 0x7fcd6010e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd5ed9d640 1 -- 172.21.15.18:0/2338957147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60101bc0 msgr2=0x7fcd6010e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd5ed9d640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60101bc0 0x7fcd6010e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd5ed9d640 1 -- 172.21.15.18:0/2338957147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd60101240 msgr2=0x7fcd6010e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd5ed9d640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd60101240 0x7fcd6010e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd5ed9d640 1 -- 172.21.15.18:0/2338957147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd601a69b0 con 0x7fcd60105a90 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60101bc0 0x7fcd6010e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:14.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd5ed9d640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd60105a90 0x7fcd6010eb20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800eaa0 tx=0x7fcd5800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:14.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd4f7fe640 1 -- 172.21.15.18:0/2338957147 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800cdb0 con 0x7fcd60105a90 2024-09-19T09:52:14.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd4f7fe640 1 -- 172.21.15.18:0/2338957147 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd58005020 con 0x7fcd60105a90 2024-09-19T09:52:14.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd64857640 1 -- 172.21.15.18:0/2338957147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd601a6ca0 con 0x7fcd60105a90 2024-09-19T09:52:14.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd4f7fe640 1 -- 172.21.15.18:0/2338957147 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd580116b0 con 0x7fcd60105a90 2024-09-19T09:52:14.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.349+0000 7fcd64857640 1 -- 172.21.15.18:0/2338957147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd601a7160 con 0x7fcd60105a90 2024-09-19T09:52:14.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd4f7fe640 1 -- 172.21.15.18:0/2338957147 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcd58005560 con 0x7fcd60105a90 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd66c30740 1 Processor -- start 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd66c30740 1 -- start start 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e29d0 0x55f6437e2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e32f0 0x55f6437ed670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437effa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd66c30740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f643749090 con 0x55f6437e32f0 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd66c30740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f6436f0a70 con 0x55f6437e29d0 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd66c30740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f643745050 con 0x55f6437edbb0 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd5e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e32f0 0x55f6437ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.352+0000 7fcd5e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e32f0 0x55f6437ed670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51436/0 (socket says 172.21.15.18:51436) 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5e59c640 1 -- 172.21.15.18:0/3128727529 learned_addr learned my addr 172.21.15.18:0/3128727529 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:14.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/3128727529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e29d0 0x55f6437e2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/3128727529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437effa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5e59c640 1 -- 172.21.15.18:0/3128727529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 msgr2=0x55f6437effa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5e59c640 1 --2- 172.21.15.18:0/3128727529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437effa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd4f7fe640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcd480a3240 0x7fcd480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5e59c640 1 -- 172.21.15.18:0/3128727529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e29d0 msgr2=0x55f6437e2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5e59c640 1 --2- 172.21.15.18:0/3128727529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e29d0 0x55f6437e2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5e59c640 1 -- 172.21.15.18:0/3128727529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6436fd130 con 0x55f6437e32f0 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/3128727529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e29d0 0x55f6437e2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5ed9d640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcd480a3240 0x7fcd480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd4f7fe640 1 -- 172.21.15.18:0/2338957147 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcd580cfb30 con 0x7fcd60105a90 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd5e59c640 1 --2- 172.21.15.18:0/3128727529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e32f0 0x55f6437ed670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000b710 tx=0x7fcd50004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f17f4317ee2aed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:14.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd4cff9640 1 -- 172.21.15.18:0/3128727529 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50003bd0 con 0x55f6437e32f0 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd4cff9640 1 -- 172.21.15.18:0/3128727529 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd50015070 con 0x55f6437e32f0 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.353+0000 7fcd4cff9640 1 -- 172.21.15.18:0/3128727529 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50004e60 con 0x55f6437e32f0 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.354+0000 7fcd66c30740 1 -- 172.21.15.18:0/3128727529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e32f0 msgr2=0x55f6437ed670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.354+0000 7fcd5ed9d640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcd480a3240 0x7fcd480a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcd5809be80 tx=0x7fcd5801eb40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.354+0000 7fcd66c30740 1 --2- 172.21.15.18:0/3128727529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e32f0 0x55f6437ed670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000b710 tx=0x7fcd50004610 comp rx=0 tx=0).stop 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.354+0000 7fcd66c30740 1 -- 172.21.15.18:0/3128727529 shutdown_connections 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.354+0000 7fcd66c30740 1 --2- 172.21.15.18:0/3128727529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437effa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.354+0000 7fcd66c30740 1 --2- 172.21.15.18:0/3128727529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e32f0 0x55f6437ed670 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.354+0000 7fcd66c30740 1 --2- 172.21.15.18:0/3128727529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e29d0 0x55f6437e2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.354+0000 7fcd66c30740 1 -- 172.21.15.18:0/3128727529 >> 172.21.15.18:0/3128727529 conn(0x55f6437def60 msgr2=0x55f6437df340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.354+0000 7fcd66c30740 1 -- 172.21.15.18:0/3128727529 shutdown_connections 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.354+0000 7fcd66c30740 1 -- 172.21.15.18:0/3128727529 wait complete. 2024-09-19T09:52:14.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd66c30740 1 -- start start 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd66c30740 1 Processor -- start 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437ed470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6437ea7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437ead00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd66c30740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6437f0780 con 0x55f6437e29d0 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd66c30740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f643703f20 con 0x55f6437e32f0 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd66c30740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f6437f0900 con 0x55f6437edbb0 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd66c30740 10 client.0 _ll_register_callbacks cb 0x55f6436cd030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd5dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd5dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437ed470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51442/0 (socket says 172.21.15.18:51442) 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/2741124009 learned_addr learned my addr 172.21.15.18:0/2741124009 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:14.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd5e59c640 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6437ea7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/2741124009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 msgr2=0x55f6437ead00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437ead00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/2741124009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 msgr2=0x55f6437ea7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6437ea7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.355+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/2741124009 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6434ba2b0 con 0x55f6437e29d0 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437ed470 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcd540096c0 tx=0x7fcd5402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cab8b4711de456b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd45ffb640 1 -- 172.21.15.18:0/2741124009 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54035040 con 0x55f6437e29d0 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd45ffb640 1 -- 172.21.15.18:0/2741124009 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcd54003db0 con 0x55f6437e29d0 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd66c30740 1 -- 172.21.15.18:0/2741124009 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd50015070 con 0x55f6437e29d0 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd45ffb640 1 -- 172.21.15.18:0/2741124009 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcd54005020 con 0x55f6437e29d0 2024-09-19T09:52:14.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd66c30740 10 client.15126 fetch_fsmap learned FSMap version 27 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd66c30740 1 -- 172.21.15.18:0/2741124009 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f6437fc100 con 0x55f6437e29d0 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd45ffb640 1 -- 172.21.15.18:0/2741124009 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd50015070 con 0x55f6437e29d0 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd45ffb640 1 -- 172.21.15.18:0/2741124009 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fcd54048020 con 0x55f6437e29d0 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.356+0000 7fcd66c30740 10 client.15126 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.357+0000 7fcd66c30740 10 client.15126 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.357+0000 7fcd66c30740 20 client.15126 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.357+0000 7fcd66c30740 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f6437fe790 0x55f6437ffc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.357+0000 7fcd66c30740 4 client.15126 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.357+0000 7fcd66c30740 1 -- 172.21.15.18:0/2741124009 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f643756600 con 0x55f6437fe790 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.357+0000 7fcd5e59c640 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f6437fe790 0x55f6437ffc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.357+0000 7fcd45ffb640 10 client.15126 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.357+0000 7fcd5e59c640 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f6437fe790 0x55f6437ffc00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8325ed62d172580a server_cookie=adfaf9503822c0c6 in_seq=0 out_seq=0 2024-09-19T09:52:14.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd45ffb640 1 -- 172.21.15.18:0/2741124009 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f643756600 con 0x55f6437fe790 2024-09-19T09:52:14.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd45ffb640 10 client.15126 handle_command_reply: tid=0 2024-09-19T09:52:14.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 client.15126 shutdown 2024-09-19T09:52:14.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 -- 172.21.15.18:0/2741124009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 msgr2=0x55f6437ed470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:14.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437ed470 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcd540096c0 tx=0x7fcd5402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 -- 172.21.15.18:0/2741124009 shutdown_connections 2024-09-19T09:52:14.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f6437fe790 0x55f6437ffc00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437ead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6437ea7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 --2- 172.21.15.18:0/2741124009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437ed470 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 -- 172.21.15.18:0/2741124009 >> 172.21.15.18:0/2741124009 conn(0x55f6437def60 msgr2=0x55f6437e4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:14.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd45ffb640 0 client.15126 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:52:14.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 -- 172.21.15.18:0/2741124009 shutdown_connections 2024-09-19T09:52:14.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 1 -- 172.21.15.18:0/2741124009 wait complete. 2024-09-19T09:52:14.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.358+0000 7fcd66c30740 20 client.15126 trim_cache size 0 max 16384 2024-09-19T09:52:14.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.376+0000 7fcd66c30740 1 Processor -- start 2024-09-19T09:52:14.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.376+0000 7fcd66c30740 1 -- start start 2024-09-19T09:52:14.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437fe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6437e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437e7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd66c30740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6437fdf40 con 0x55f6437e29d0 2024-09-19T09:52:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd66c30740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f6437fe610 con 0x55f6437e32f0 2024-09-19T09:52:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd66c30740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f6437fece0 con 0x55f6437edbb0 2024-09-19T09:52:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd5dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437fe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd5dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437fe790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51456/0 (socket says 172.21.15.18:51456) 2024-09-19T09:52:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/1519879200 learned_addr learned my addr 172.21.15.18:0/1519879200 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/1519879200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 msgr2=0x55f6437e7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/1519879200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437e7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/1519879200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 msgr2=0x55f6437e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd5e59c640 1 --2- 172.21.15.18:0/1519879200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6437e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/1519879200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6437e7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/1519879200 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6437ed7e0 con 0x55f6437e29d0 2024-09-19T09:52:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/1519879200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437fe790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcd5402a910 tx=0x7fcd54009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b29ae160e38729 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd47fff640 1 -- 172.21.15.18:0/1519879200 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54035070 con 0x55f6437e29d0 2024-09-19T09:52:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd47fff640 1 -- 172.21.15.18:0/1519879200 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd54031860 con 0x55f6437e29d0 2024-09-19T09:52:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.377+0000 7fcd47fff640 1 -- 172.21.15.18:0/1519879200 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd540046c0 con 0x55f6437e29d0 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.378+0000 7fcd66c30740 1 -- 172.21.15.18:0/1519879200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 msgr2=0x55f6437fe790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.378+0000 7fcd66c30740 1 --2- 172.21.15.18:0/1519879200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437fe790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcd5402a910 tx=0x7fcd54009230 comp rx=0 tx=0).stop 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.378+0000 7fcd66c30740 1 -- 172.21.15.18:0/1519879200 shutdown_connections 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.378+0000 7fcd66c30740 1 --2- 172.21.15.18:0/1519879200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6437e7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.378+0000 7fcd66c30740 1 --2- 172.21.15.18:0/1519879200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6437e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.378+0000 7fcd66c30740 1 --2- 172.21.15.18:0/1519879200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6437fe790 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.378+0000 7fcd66c30740 1 -- 172.21.15.18:0/1519879200 >> 172.21.15.18:0/1519879200 conn(0x55f6437def60 msgr2=0x55f6437d9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.378+0000 7fcd66c30740 1 -- 172.21.15.18:0/1519879200 shutdown_connections 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.378+0000 7fcd66c30740 1 -- 172.21.15.18:0/1519879200 wait complete. 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.378+0000 7fcd66c30740 1 -- start start 2024-09-19T09:52:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd66c30740 1 Processor -- start 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6438081b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6438086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd66c30740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6438015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd66c30740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6437ffa80 con 0x55f6437e29d0 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd66c30740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f6437ff3b0 con 0x55f6437e32f0 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd66c30740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f643800150 con 0x55f6437edbb0 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd66c30740 10 client.0 _ll_register_callbacks cb 0x7fcd54009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd5dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6438081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd5dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6438081b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51472/0 (socket says 172.21.15.18:51472) 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/219727740 learned_addr learned my addr 172.21.15.18:0/219727740 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd5e59c640 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6438086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/219727740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 msgr2=0x55f6438015d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6438015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/219727740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 msgr2=0x55f6438086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6438086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd5dd9b640 1 -- 172.21.15.18:0/219727740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f643801dd0 con 0x55f6437e29d0 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd5dd9b640 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6438081b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009850 tx=0x7fcd54005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94f57baead77c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.379+0000 7fcd45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd45ffb640 1 -- 172.21.15.18:0/219727740 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54035040 con 0x55f6437e29d0 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd45ffb640 1 -- 172.21.15.18:0/219727740 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcd54003dc0 con 0x55f6437e29d0 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd66c30740 1 -- 172.21.15.18:0/219727740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd54031860 con 0x55f6437e29d0 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd45ffb640 1 -- 172.21.15.18:0/219727740 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcd54064050 con 0x55f6437e29d0 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd66c30740 10 client.15132 fetch_fsmap learned FSMap version 27 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd66c30740 1 -- 172.21.15.18:0/219727740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f643806870 con 0x55f6437e29d0 2024-09-19T09:52:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd45ffb640 1 -- 172.21.15.18:0/219727740 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd54031860 con 0x55f6437e29d0 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd45ffb640 1 -- 172.21.15.18:0/219727740 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fcd54048040 con 0x55f6437e29d0 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd66c30740 10 client.15132 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd66c30740 10 client.15132 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd66c30740 20 client.15132 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd66c30740 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f64386d310 0x55f64386c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd66c30740 4 client.15132 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd66c30740 1 -- 172.21.15.18:0/219727740 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "status"}) -- 0x55f643750b10 con 0x55f64386d310 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.380+0000 7fcd5e59c640 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f64386d310 0x55f64386c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd5e59c640 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f64386d310 0x55f64386c020 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fda966ce82973985 server_cookie=d7c3aaedff0aa09b in_seq=0 out_seq=0 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd45ffb640 10 client.15132 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd45ffb640 1 -- 172.21.15.18:0/219727740 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f643750b10 con 0x55f64386d310 2024-09-19T09:52:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd45ffb640 10 client.15132 handle_command_reply: tid=0 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 client.15132 shutdown 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 -- 172.21.15.18:0/219727740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 msgr2=0x55f6438081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6438081b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009850 tx=0x7fcd54005260 comp rx=0 tx=0).stop 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 -- 172.21.15.18:0/219727740 shutdown_connections 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f64386d310 0x55f64386c020 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6437edbb0 0x55f6438015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6437e32f0 0x55f6438086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 --2- 172.21.15.18:0/219727740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6437e29d0 0x55f6438081b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 -- 172.21.15.18:0/219727740 >> 172.21.15.18:0/219727740 conn(0x55f6437def60 msgr2=0x55f6437ebea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd45ffb640 0 client.15132 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 -- 172.21.15.18:0/219727740 shutdown_connections 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 1 -- 172.21.15.18:0/219727740 wait complete. 2024-09-19T09:52:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.381+0000 7fcd66c30740 20 client.15132 trim_cache size 0 max 16384 2024-09-19T09:52:14.390 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:14.390 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:52:14.390 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 4, 2024-09-19T09:52:14.390 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 14592, 2024-09-19T09:52:14.390 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:52:14.390 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:52:14.390 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:52:14.390 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 94.049831358999995, 2024-09-19T09:52:14.390 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-09-19T09:52:14.390 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:52:14.391 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:52:14.391 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 117.57895832299999 2024-09-19T09:52:14.391 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 -- 172.21.15.18:0/2338957147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcd480a3240 msgr2=0x7fcd480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcd480a3240 0x7fcd480a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcd5809be80 tx=0x7fcd5801eb40 comp rx=0 tx=0).stop 2024-09-19T09:52:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 -- 172.21.15.18:0/2338957147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd60105a90 msgr2=0x7fcd6010eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd60105a90 0x7fcd6010eb20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800eaa0 tx=0x7fcd5800ef60 comp rx=0 tx=0).stop 2024-09-19T09:52:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 -- 172.21.15.18:0/2338957147 shutdown_connections 2024-09-19T09:52:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcd480a3240 0x7fcd480a5700 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd60105a90 0x7fcd6010eb20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60101bc0 0x7fcd6010e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 --2- 172.21.15.18:0/2338957147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd60101240 0x7fcd6010e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 -- 172.21.15.18:0/2338957147 >> 172.21.15.18:0/2338957147 conn(0x7fcd60077210 msgr2=0x7fcd60103940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 -- 172.21.15.18:0/2338957147 shutdown_connections 2024-09-19T09:52:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:14.382+0000 7fcd64857640 1 -- 172.21.15.18:0/2338957147 wait complete. 2024-09-19T09:52:15.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.e status 2024-09-19T09:52:15.283 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:15.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.796+0000 7fdd5ff21640 1 -- 172.21.15.18:0/80456597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd58108290 msgr2=0x7fdd5810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:15.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.796+0000 7fdd5ff21640 1 --2- 172.21.15.18:0/80456597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd58108290 0x7fdd5810ec30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009930 tx=0x7fdd5002a420 comp rx=0 tx=0).stop 2024-09-19T09:52:15.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.797+0000 7fdd5ff21640 1 -- 172.21.15.18:0/80456597 shutdown_connections 2024-09-19T09:52:15.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.797+0000 7fdd5ff21640 1 --2- 172.21.15.18:0/80456597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd58108290 0x7fdd5810ec30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.797+0000 7fdd5ff21640 1 --2- 172.21.15.18:0/80456597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd58103740 0x7fdd58107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.797+0000 7fdd5ff21640 1 --2- 172.21.15.18:0/80456597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58102d90 0x7fdd58103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.797+0000 7fdd5ff21640 1 -- 172.21.15.18:0/80456597 >> 172.21.15.18:0/80456597 conn(0x7fdd580fc7d0 msgr2=0x7fdd580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.797+0000 7fdd5ff21640 1 -- 172.21.15.18:0/80456597 shutdown_connections 2024-09-19T09:52:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.797+0000 7fdd5ff21640 1 -- 172.21.15.18:0/80456597 wait complete. 2024-09-19T09:52:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.797+0000 7fdd5ff21640 1 Processor -- start 2024-09-19T09:52:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.797+0000 7fdd5ff21640 1 -- start start 2024-09-19T09:52:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5ff21640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd58102d90 0x7fdd581009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5ff21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58103740 0x7fdd58100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5ff21640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd58108290 0x7fdd58101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5ff21640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581120f0 con 0x7fdd58108290 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5ff21640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58111f70 con 0x7fdd58103740 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5ff21640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58112270 con 0x7fdd58102d90 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5e4be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd58108290 0x7fdd58101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5e4be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd58108290 0x7fdd58101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51496/0 (socket says 172.21.15.18:51496) 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5e4be640 1 -- 172.21.15.18:0/980396948 learned_addr learned my addr 172.21.15.18:0/980396948 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5dcbd640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd58102d90 0x7fdd581009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58103740 0x7fdd58100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5e4be640 1 -- 172.21.15.18:0/980396948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd58102d90 msgr2=0x7fdd581009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5e4be640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd58102d90 0x7fdd581009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5e4be640 1 -- 172.21.15.18:0/980396948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58103740 msgr2=0x7fdd58100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5e4be640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58103740 0x7fdd58100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5e4be640 1 -- 172.21.15.18:0/980396948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd581a6a90 con 0x7fdd58108290 2024-09-19T09:52:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58103740 0x7fdd58100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5e4be640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd58108290 0x7fdd58101470 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdd50005ab0 tx=0x7fdd500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd56ffd640 1 -- 172.21.15.18:0/980396948 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5003f030 con 0x7fdd58108290 2024-09-19T09:52:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd5ff21640 1 -- 172.21.15.18:0/980396948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd581a6d20 con 0x7fdd58108290 2024-09-19T09:52:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd56ffd640 1 -- 172.21.15.18:0/980396948 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd50003ce0 con 0x7fdd58108290 2024-09-19T09:52:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.798+0000 7fdd56ffd640 1 -- 172.21.15.18:0/980396948 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50035070 con 0x7fdd58108290 2024-09-19T09:52:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.799+0000 7fdd5ff21640 1 -- 172.21.15.18:0/980396948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd581a7200 con 0x7fdd58108290 2024-09-19T09:52:15.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.801+0000 7fdd56ffd640 1 -- 172.21.15.18:0/980396948 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdd50042030 con 0x7fdd58108290 2024-09-19T09:52:15.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.801+0000 7fdd622fa740 1 Processor -- start 2024-09-19T09:52:15.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.801+0000 7fdd622fa740 1 -- start start 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 0x5646822f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x564682300670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 0x564682302fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd622fa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56468225c090 con 0x564682300bb0 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd622fa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564682203a70 con 0x5646822f59d0 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd622fa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564682258050 con 0x5646822f62f0 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd56ffd640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdd400a3240 0x7fdd400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5d4bc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 0x564682302fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5d4bc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 0x5646822f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5d4bc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 0x5646822f5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:46602/0 (socket says 172.21.15.18:46602) 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5dcbd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x564682300670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/2399819276 learned_addr learned my addr 172.21.15.18:0/2399819276 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5e4be640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdd400a3240 0x7fdd400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd56ffd640 1 -- 172.21.15.18:0/980396948 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdd500efd60 con 0x7fdd58108290 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/2399819276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 msgr2=0x564682300670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/2399819276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x564682300670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/2399819276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 msgr2=0x564682302fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/2399819276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 0x564682302fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/2399819276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564682210130 con 0x5646822f59d0 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5e4be640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdd400a3240 0x7fdd400a5700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdd50004650 tx=0x7fdd500c0040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.802+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/2399819276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 0x5646822f5db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0149f0 tx=0x7fdd4c005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dbe37e30f9602d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.803+0000 7fdd3ffff640 1 -- 172.21.15.18:0/2399819276 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0142d0 con 0x5646822f59d0 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.803+0000 7fdd3ffff640 1 -- 172.21.15.18:0/2399819276 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd4c005500 con 0x5646822f59d0 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.803+0000 7fdd3ffff640 1 -- 172.21.15.18:0/2399819276 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0117e0 con 0x5646822f59d0 2024-09-19T09:52:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.803+0000 7fdd622fa740 1 -- 172.21.15.18:0/2399819276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 msgr2=0x5646822f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.803+0000 7fdd622fa740 1 --2- 172.21.15.18:0/2399819276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 0x5646822f5db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0149f0 tx=0x7fdd4c005850 comp rx=0 tx=0).stop 2024-09-19T09:52:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.803+0000 7fdd622fa740 1 -- 172.21.15.18:0/2399819276 shutdown_connections 2024-09-19T09:52:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.803+0000 7fdd622fa740 1 --2- 172.21.15.18:0/2399819276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 0x564682302fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.803+0000 7fdd622fa740 1 --2- 172.21.15.18:0/2399819276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x564682300670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.803+0000 7fdd622fa740 1 --2- 172.21.15.18:0/2399819276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 0x5646822f5db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.803+0000 7fdd622fa740 1 -- 172.21.15.18:0/2399819276 >> 172.21.15.18:0/2399819276 conn(0x5646822f1f60 msgr2=0x5646822f2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.804+0000 7fdd622fa740 1 -- 172.21.15.18:0/2399819276 shutdown_connections 2024-09-19T09:52:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.804+0000 7fdd622fa740 1 -- 172.21.15.18:0/2399819276 wait complete. 2024-09-19T09:52:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.804+0000 7fdd622fa740 1 -- start start 2024-09-19T09:52:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.804+0000 7fdd622fa740 1 Processor -- start 2024-09-19T09:52:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f59d0 0x5646823003f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f62f0 0x5646822fd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564682300bb0 0x5646822fdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd622fa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564682303780 con 0x5646822f62f0 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd622fa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564682216f20 con 0x564682300bb0 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd622fa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564682303900 con 0x5646822f59d0 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd622fa740 10 client.0 _ll_register_callbacks cb 0x5646821e0030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5dcbd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f62f0 0x5646822fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5dcbd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f62f0 0x5646822fd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51508/0 (socket says 172.21.15.18:51508) 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5dcbd640 1 -- 172.21.15.18:0/2067155126 learned_addr learned my addr 172.21.15.18:0/2067155126 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f59d0 0x5646823003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564682300bb0 0x5646822fdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5dcbd640 1 -- 172.21.15.18:0/2067155126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f59d0 msgr2=0x5646823003f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5dcbd640 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f59d0 0x5646823003f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5dcbd640 1 -- 172.21.15.18:0/2067155126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564682300bb0 msgr2=0x5646822fdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5dcbd640 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564682300bb0 0x5646822fdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5dcbd640 1 -- 172.21.15.18:0/2067155126 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564681fcd2b0 con 0x5646822f62f0 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564682300bb0 0x5646822fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd5dcbd640 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f62f0 0x5646822fd740 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800ab60 tx=0x7fdd48011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83649cca7753445b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/2067155126 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4801a070 con 0x5646822f62f0 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/2067155126 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdd48016450 con 0x5646822f62f0 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.805+0000 7fdd622fa740 1 -- 172.21.15.18:0/2067155126 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd4c005500 con 0x5646822f62f0 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/2067155126 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdd48026050 con 0x5646822f62f0 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd622fa740 10 client.15144 fetch_fsmap learned FSMap version 27 2024-09-19T09:52:15.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd622fa740 1 -- 172.21.15.18:0/2067155126 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56468230f100 con 0x5646822f62f0 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/2067155126 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd4c005500 con 0x5646822f62f0 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/2067155126 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fdd4801e6c0 con 0x5646822f62f0 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd622fa740 10 client.15144 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd622fa740 10 client.15144 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd622fa740 20 client.15144 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd622fa740 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564682311730 0x564682312ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd622fa740 4 client.15144 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd622fa740 1 -- 172.21.15.18:0/2067155126 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564682269600 con 0x564682311730 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.806+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564682311730 0x564682312ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.807+0000 7fdd3d7fa640 10 client.15144 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.807+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564682311730 0x564682312ba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=418fe17193f58928 server_cookie=8233b61b9925078c in_seq=0 out_seq=0 2024-09-19T09:52:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/2067155126 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564682269600 con 0x564682311730 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd3d7fa640 10 client.15144 handle_command_reply: tid=0 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 client.15144 shutdown 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 -- 172.21.15.18:0/2067155126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f62f0 msgr2=0x5646822fd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f62f0 0x5646822fd740 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800ab60 tx=0x7fdd48011580 comp rx=0 tx=0).stop 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 -- 172.21.15.18:0/2067155126 shutdown_connections 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564682311730 0x564682312ba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564682300bb0 0x5646822fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f62f0 0x5646822fd740 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 --2- 172.21.15.18:0/2067155126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f59d0 0x5646823003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd3d7fa640 0 client.15144 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 -- 172.21.15.18:0/2067155126 >> 172.21.15.18:0/2067155126 conn(0x5646822f1f60 msgr2=0x5646822f7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 -- 172.21.15.18:0/2067155126 shutdown_connections 2024-09-19T09:52:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 1 -- 172.21.15.18:0/2067155126 wait complete. 2024-09-19T09:52:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.808+0000 7fdd622fa740 20 client.15144 trim_cache size 0 max 16384 2024-09-19T09:52:15.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd622fa740 1 Processor -- start 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd622fa740 1 -- start start 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f59d0 0x564682312ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x5646822f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564682300bb0 0x5646822fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd622fa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564682310ee0 con 0x5646822f59d0 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd622fa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5646823115b0 con 0x564682300bb0 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd622fa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564682311c80 con 0x5646822f62f0 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd5d4bc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f59d0 0x564682312ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd5d4bc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f59d0 0x564682312ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51518/0 (socket says 172.21.15.18:51518) 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/3166921145 learned_addr learned my addr 172.21.15.18:0/3166921145 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/3166921145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 msgr2=0x5646822f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:15.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/3166921145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x5646822f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/3166921145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564682300bb0 msgr2=0x5646822fa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:15.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.826+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/3166921145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564682300bb0 0x5646822fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.827+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/3166921145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646822f6120 con 0x5646822f59d0 2024-09-19T09:52:15.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.827+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/3166921145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f59d0 0x564682312ba0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c005fd0 tx=0x7fdd4c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b774795621c4de3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:15.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.827+0000 7fdd3f7fe640 1 -- 172.21.15.18:0/3166921145 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c032070 con 0x5646822f59d0 2024-09-19T09:52:15.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.827+0000 7fdd3f7fe640 1 -- 172.21.15.18:0/3166921145 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd4c011c90 con 0x5646822f59d0 2024-09-19T09:52:15.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.827+0000 7fdd3f7fe640 1 -- 172.21.15.18:0/3166921145 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c02a040 con 0x5646822f59d0 2024-09-19T09:52:15.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.828+0000 7fdd622fa740 1 -- 172.21.15.18:0/3166921145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f59d0 msgr2=0x564682312ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:15.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.828+0000 7fdd622fa740 1 --2- 172.21.15.18:0/3166921145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f59d0 0x564682312ba0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c005fd0 tx=0x7fdd4c005850 comp rx=0 tx=0).stop 2024-09-19T09:52:15.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.828+0000 7fdd622fa740 1 -- 172.21.15.18:0/3166921145 shutdown_connections 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.828+0000 7fdd622fa740 1 --2- 172.21.15.18:0/3166921145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564682300bb0 0x5646822fa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.828+0000 7fdd622fa740 1 --2- 172.21.15.18:0/3166921145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x5646822f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.828+0000 7fdd622fa740 1 --2- 172.21.15.18:0/3166921145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5646822f59d0 0x564682312ba0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.828+0000 7fdd622fa740 1 -- 172.21.15.18:0/3166921145 >> 172.21.15.18:0/3166921145 conn(0x5646822f1f60 msgr2=0x5646822f8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.828+0000 7fdd622fa740 1 -- 172.21.15.18:0/3166921145 shutdown_connections 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.828+0000 7fdd622fa740 1 -- 172.21.15.18:0/3166921145 wait complete. 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.828+0000 7fdd622fa740 1 -- start start 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd622fa740 1 Processor -- start 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 0x56468231b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x564682314740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd622fa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 0x564682314c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd622fa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564682312a20 con 0x564682300bb0 2024-09-19T09:52:15.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd622fa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564682312350 con 0x5646822f59d0 2024-09-19T09:52:15.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd622fa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5646823130f0 con 0x5646822f62f0 2024-09-19T09:52:15.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd622fa740 10 client.0 _ll_register_callbacks cb 0x7fdd48009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:15.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5d4bc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 0x564682314c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5d4bc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 0x564682314c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51534/0 (socket says 172.21.15.18:51534) 2024-09-19T09:52:15.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/191439501 learned_addr learned my addr 172.21.15.18:0/191439501 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:15.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 0x56468231b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5dcbd640 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x564682314740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/191439501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 msgr2=0x564682314740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:15.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x564682314740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/191439501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 msgr2=0x56468231b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 0x56468231b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5d4bc640 1 -- 172.21.15.18:0/191439501 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564682315370 con 0x564682300bb0 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.829+0000 7fdd5dcbd640 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x564682314740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd5d4bc640 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 0x564682314c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c011ed0 tx=0x7fdd4c004880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9cbfdbe7807a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/191439501 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c03e060 con 0x564682300bb0 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/191439501 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdd4c0140d0 con 0x564682300bb0 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd622fa740 1 -- 172.21.15.18:0/191439501 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd4c011c90 con 0x564682300bb0 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/191439501 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdd4c032040 con 0x564682300bb0 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd622fa740 10 client.15150 fetch_fsmap learned FSMap version 27 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd622fa740 1 -- 172.21.15.18:0/191439501 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56468237be40 con 0x564682300bb0 2024-09-19T09:52:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/191439501 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd4c011c90 con 0x564682300bb0 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/191439501 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fdd4c038030 con 0x564682300bb0 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd622fa740 10 client.15150 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd622fa740 10 client.15150 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd622fa740 20 client.15150 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd622fa740 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564682380180 0x56468237ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd622fa740 4 client.15150 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.830+0000 7fdd622fa740 1 -- 172.21.15.18:0/191439501 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "status"}) -- 0x564682263b10 con 0x564682380180 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.831+0000 7fdd5dcbd640 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564682380180 0x56468237ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.831+0000 7fdd5dcbd640 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564682380180 0x56468237ee90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=342d537dc6d4553e server_cookie=ebcd29ee25c8fbb in_seq=0 out_seq=0 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.831+0000 7fdd3d7fa640 10 client.15150 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.831+0000 7fdd3d7fa640 1 -- 172.21.15.18:0/191439501 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564682263b10 con 0x564682380180 2024-09-19T09:52:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.831+0000 7fdd3d7fa640 10 client.15150 handle_command_reply: tid=0 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.831+0000 7fdd622fa740 1 client.15150 shutdown 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.831+0000 7fdd622fa740 1 -- 172.21.15.18:0/191439501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 msgr2=0x564682314c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.831+0000 7fdd622fa740 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 0x564682314c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c011ed0 tx=0x7fdd4c004880 comp rx=0 tx=0).stop 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd622fa740 1 -- 172.21.15.18:0/191439501 shutdown_connections 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd622fa740 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564682380180 0x56468237ee90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd622fa740 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564682300bb0 0x564682314c80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd622fa740 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5646822f62f0 0x564682314740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd3d7fa640 0 client.15150 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd622fa740 1 --2- 172.21.15.18:0/191439501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646822f59d0 0x56468231b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd622fa740 1 -- 172.21.15.18:0/191439501 >> 172.21.15.18:0/191439501 conn(0x5646822f1f60 msgr2=0x5646822ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd622fa740 1 -- 172.21.15.18:0/191439501 shutdown_connections 2024-09-19T09:52:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd622fa740 1 -- 172.21.15.18:0/191439501 wait complete. 2024-09-19T09:52:15.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd622fa740 20 client.15150 trim_cache size 0 max 16384 2024-09-19T09:52:15.840 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:15.840 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:52:15.840 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 3, 2024-09-19T09:52:15.840 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24470, 2024-09-19T09:52:15.840 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:52:15.840 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:52:15.840 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:52:15.840 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 96.426987689000001, 2024-09-19T09:52:15.841 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-09-19T09:52:15.841 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:52:15.841 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:52:15.841 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 135.102538799 2024-09-19T09:52:15.841 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:15.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd5ff21640 1 -- 172.21.15.18:0/980396948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdd400a3240 msgr2=0x7fdd400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd5ff21640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdd400a3240 0x7fdd400a5700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdd50004650 tx=0x7fdd500c0040 comp rx=0 tx=0).stop 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd5ff21640 1 -- 172.21.15.18:0/980396948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd58108290 msgr2=0x7fdd58101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd5ff21640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd58108290 0x7fdd58101470 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdd50005ab0 tx=0x7fdd500042f0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd5ff21640 1 -- 172.21.15.18:0/980396948 shutdown_connections 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd5ff21640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdd400a3240 0x7fdd400a5700 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd5ff21640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd58108290 0x7fdd58101470 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd5ff21640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd58103740 0x7fdd58100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd5ff21640 1 --2- 172.21.15.18:0/980396948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd58102d90 0x7fdd581009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.832+0000 7fdd5ff21640 1 -- 172.21.15.18:0/980396948 >> 172.21.15.18:0/980396948 conn(0x7fdd580fc7d0 msgr2=0x7fdd58106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.833+0000 7fdd5ff21640 1 -- 172.21.15.18:0/980396948 shutdown_connections 2024-09-19T09:52:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:15.833+0000 7fdd5ff21640 1 -- 172.21.15.18:0/980396948 wait complete. 2024-09-19T09:52:16.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:15 smithi018 ceph-mon[30956]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T09:52:16.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:15 smithi049 ceph-mon[34858]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T09:52:16.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:15 smithi162 ceph-mon[35174]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T09:52:16.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:52:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:17.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.381+0000 7fc4192cc640 1 -- 172.21.15.18:0/3805088348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4141002f0 msgr2=0x7fc4141006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:17.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.381+0000 7fc4192cc640 1 --2- 172.21.15.18:0/3805088348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4141002f0 0x7fc4141006d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc404009930 tx=0x7fc40402a420 comp rx=0 tx=0).stop 2024-09-19T09:52:17.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.381+0000 7fc4192cc640 1 -- 172.21.15.18:0/3805088348 shutdown_connections 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.381+0000 7fc4192cc640 1 --2- 172.21.15.18:0/3805088348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc414106f50 0x7fc41410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.381+0000 7fc4192cc640 1 --2- 172.21.15.18:0/3805088348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc414100ca0 0x7fc414106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.381+0000 7fc4192cc640 1 --2- 172.21.15.18:0/3805088348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4141002f0 0x7fc4141006d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.381+0000 7fc4192cc640 1 -- 172.21.15.18:0/3805088348 >> 172.21.15.18:0/3805088348 conn(0x7fc414077210 msgr2=0x7fc4140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.381+0000 7fc4192cc640 1 -- 172.21.15.18:0/3805088348 shutdown_connections 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.381+0000 7fc4192cc640 1 -- 172.21.15.18:0/3805088348 wait complete. 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4192cc640 1 Processor -- start 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4192cc640 1 -- start start 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4192cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4141002f0 0x7fc414101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4192cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc414100ca0 0x7fc4141017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4192cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc414106f50 0x7fc414101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4192cc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc414111fa0 con 0x7fc414106f50 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4192cc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc414111e20 con 0x7fc414100ca0 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4192cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc414112120 con 0x7fc4141002f0 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc414106f50 0x7fc414101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc414106f50 0x7fc414101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55614/0 (socket says 172.21.15.18:55614) 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4137fe640 1 -- 172.21.15.18:0/223000836 learned_addr learned my addr 172.21.15.18:0/223000836 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc412ffd640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4141002f0 0x7fc414101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4127fc640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc414100ca0 0x7fc4141017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4137fe640 1 -- 172.21.15.18:0/223000836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4141002f0 msgr2=0x7fc414101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4137fe640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4141002f0 0x7fc414101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4137fe640 1 -- 172.21.15.18:0/223000836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc414100ca0 msgr2=0x7fc4141017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4137fe640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc414100ca0 0x7fc4141017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.382+0000 7fc4137fe640 1 -- 172.21.15.18:0/223000836 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4141a69b0 con 0x7fc414106f50 2024-09-19T09:52:17.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.383+0000 7fc4137fe640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc414106f50 0x7fc414101cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009fd0 tx=0x7fc40c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:17.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.383+0000 7fc3fbfff640 1 -- 172.21.15.18:0/223000836 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c017070 con 0x7fc414106f50 2024-09-19T09:52:17.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.383+0000 7fc3fbfff640 1 -- 172.21.15.18:0/223000836 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc40c003e50 con 0x7fc414106f50 2024-09-19T09:52:17.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.383+0000 7fc4192cc640 1 -- 172.21.15.18:0/223000836 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4141a6ca0 con 0x7fc414106f50 2024-09-19T09:52:17.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.383+0000 7fc3fbfff640 1 -- 172.21.15.18:0/223000836 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c0106c0 con 0x7fc414106f50 2024-09-19T09:52:17.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.383+0000 7fc4192cc640 1 -- 172.21.15.18:0/223000836 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4141a7190 con 0x7fc414106f50 2024-09-19T09:52:17.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.385+0000 7fc3fbfff640 1 -- 172.21.15.18:0/223000836 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc40c003970 con 0x7fc414106f50 2024-09-19T09:52:17.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.385+0000 7fc41b6a5740 1 Processor -- start 2024-09-19T09:52:17.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc41b6a5740 1 -- start start 2024-09-19T09:52:17.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf819d0 0x55f66cf81db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf822f0 0x55f66cf8c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf8cbb0 0x55f66cf8efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f66cee8090 con 0x55f66cf819d0 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc3fbfff640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3fc0a3240 0x7fc3fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f66ce8fa70 con 0x55f66cf8cbb0 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f66cee4050 con 0x55f66cf822f0 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc4127fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf819d0 0x55f66cf81db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc4127fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf819d0 0x55f66cf81db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55616/0 (socket says 172.21.15.18:55616) 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc4127fc640 1 -- 172.21.15.18:0/1433491995 learned_addr learned my addr 172.21.15.18:0/1433491995 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc4137fe640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3fc0a3240 0x7fc3fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc4127fc640 1 -- 172.21.15.18:0/1433491995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf822f0 msgr2=0x55f66cf8c670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc4127fc640 1 --2- 172.21.15.18:0/1433491995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf822f0 0x55f66cf8c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc4127fc640 1 -- 172.21.15.18:0/1433491995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf8cbb0 msgr2=0x55f66cf8efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc4127fc640 1 --2- 172.21.15.18:0/1433491995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf8cbb0 0x55f66cf8efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc3fbfff640 1 -- 172.21.15.18:0/223000836 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc40c0cf5c0 con 0x7fc414106f50 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.386+0000 7fc4127fc640 1 -- 172.21.15.18:0/1433491995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66ce9c130 con 0x55f66cf819d0 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.387+0000 7fc4127fc640 1 --2- 172.21.15.18:0/1433491995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf819d0 0x55f66cf81db0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc40800b790 tx=0x7fc40800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858ce92e361045d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.387+0000 7fc4137fe640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3fc0a3240 0x7fc3fc0a5700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc40c096700 tx=0x7fc40c06eae0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.387+0000 7fc3f97fa640 1 -- 172.21.15.18:0/1433491995 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40800bea0 con 0x55f66cf819d0 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.387+0000 7fc3f97fa640 1 -- 172.21.15.18:0/1433491995 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc408015070 con 0x55f66cf819d0 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.387+0000 7fc3f97fa640 1 -- 172.21.15.18:0/1433491995 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408010440 con 0x55f66cf819d0 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.387+0000 7fc41b6a5740 1 -- 172.21.15.18:0/1433491995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf819d0 msgr2=0x55f66cf81db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.387+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/1433491995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf819d0 0x55f66cf81db0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc40800b790 tx=0x7fc40800bc50 comp rx=0 tx=0).stop 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 -- 172.21.15.18:0/1433491995 shutdown_connections 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/1433491995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf8cbb0 0x55f66cf8efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/1433491995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf822f0 0x55f66cf8c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/1433491995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf819d0 0x55f66cf81db0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 -- 172.21.15.18:0/1433491995 >> 172.21.15.18:0/1433491995 conn(0x55f66cf7df60 msgr2=0x55f66cf7e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 -- 172.21.15.18:0/1433491995 shutdown_connections 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 -- 172.21.15.18:0/1433491995 wait complete. 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 -- start start 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 Processor -- start 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf819d0 0x55f66cf8c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 0x55f66cf89770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf89cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf8f780 con 0x55f66cf8cbb0 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f66cea2f20 con 0x55f66cf822f0 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf8f900 con 0x55f66cf819d0 2024-09-19T09:52:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc41b6a5740 10 client.0 _ll_register_callbacks cb 0x55f66ce6c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.388+0000 7fc4127fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf89cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc4127fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf89cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55624/0 (socket says 172.21.15.18:55624) 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc4127fc640 1 -- 172.21.15.18:0/2555339623 learned_addr learned my addr 172.21.15.18:0/2555339623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc4127fc640 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf819d0 0x55f66cf8c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc412ffd640 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 0x55f66cf89770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc4127fc640 1 -- 172.21.15.18:0/2555339623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf819d0 msgr2=0x55f66cf8c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc4127fc640 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf819d0 0x55f66cf8c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc4127fc640 1 -- 172.21.15.18:0/2555339623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 msgr2=0x55f66cf89770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc4127fc640 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 0x55f66cf89770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc4127fc640 1 -- 172.21.15.18:0/2555339623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f66cc592b0 con 0x55f66cf8cbb0 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc412ffd640 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 0x55f66cf89770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc4127fc640 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf89cb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc408004950 tx=0x7fc408004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d185e16013125ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc3f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/2555339623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408023040 con 0x55f66cf8cbb0 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/2555339623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc408005170 con 0x55f66cf8cbb0 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.389+0000 7fc41b6a5740 1 -- 172.21.15.18:0/2555339623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc408015070 con 0x55f66cf8cbb0 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/2555339623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc408031050 con 0x55f66cf8cbb0 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc41b6a5740 10 client.15162 fetch_fsmap learned FSMap version 27 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc41b6a5740 1 -- 172.21.15.18:0/2555339623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f66cf9b070 con 0x55f66cf8cbb0 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/2555339623 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc408015070 con 0x55f66cf8cbb0 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/2555339623 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc408010ab0 con 0x55f66cf8cbb0 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc41b6a5740 10 client.15162 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc41b6a5740 10 client.15162 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc41b6a5740 20 client.15162 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55f66cf9d540 0x55f66cf9e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc41b6a5740 4 client.15162 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc41b6a5740 1 -- 172.21.15.18:0/2555339623 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f66cef5600 con 0x55f66cf9d540 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.390+0000 7fc412ffd640 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55f66cf9d540 0x55f66cf9e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.391+0000 7fc412ffd640 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55f66cf9d540 0x55f66cf9e9b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2a7e0670c5ba1ce7 server_cookie=9b8b7ebf58310cf3 in_seq=0 out_seq=0 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.391+0000 7fc3f6ff5640 10 client.15162 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/2555339623 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f66cef5600 con 0x55f66cf9d540 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc3f6ff5640 10 client.15162 handle_command_reply: tid=0 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 client.15162 shutdown 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 -- 172.21.15.18:0/2555339623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 msgr2=0x55f66cf89cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf89cb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc408004950 tx=0x7fc408004a50 comp rx=0 tx=0).stop 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 -- 172.21.15.18:0/2555339623 shutdown_connections 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55f66cf9d540 0x55f66cf9e9b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf89cb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 0x55f66cf89770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc3f6ff5640 0 client.15162 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/2555339623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf819d0 0x55f66cf8c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 -- 172.21.15.18:0/2555339623 >> 172.21.15.18:0/2555339623 conn(0x55f66cf7df60 msgr2=0x55f66cf83c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 -- 172.21.15.18:0/2555339623 shutdown_connections 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 1 -- 172.21.15.18:0/2555339623 wait complete. 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.392+0000 7fc41b6a5740 20 client.15162 trim_cache size 0 max 16384 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.410+0000 7fc41b6a5740 1 Processor -- start 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.410+0000 7fc41b6a5740 1 -- start start 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf819d0 0x55f66cf9e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 0x55f66cf7e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf7e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf9ccf0 con 0x55f66cf8cbb0 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf9d3c0 con 0x55f66cf822f0 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf9da90 con 0x55f66cf819d0 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc4127fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf7e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc4127fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf7e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55626/0 (socket says 172.21.15.18:55626) 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc4127fc640 1 -- 172.21.15.18:0/3285713378 learned_addr learned my addr 172.21.15.18:0/3285713378 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc4127fc640 1 --2- 172.21.15.18:0/3285713378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf819d0 0x55f66cf9e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc412ffd640 1 --2- 172.21.15.18:0/3285713378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 0x55f66cf7e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc4127fc640 1 -- 172.21.15.18:0/3285713378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf819d0 msgr2=0x55f66cf9e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc4127fc640 1 --2- 172.21.15.18:0/3285713378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf819d0 0x55f66cf9e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc4127fc640 1 -- 172.21.15.18:0/3285713378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 msgr2=0x55f66cf7e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc4127fc640 1 --2- 172.21.15.18:0/3285713378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 0x55f66cf7e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc4127fc640 1 -- 172.21.15.18:0/3285713378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66cf7d9e0 con 0x55f66cf8cbb0 2024-09-19T09:52:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc4127fc640 1 --2- 172.21.15.18:0/3285713378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf7e880 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc4080044d0 tx=0x7fc408003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d92d6c3f059231d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc3f8ff9640 1 -- 172.21.15.18:0/3285713378 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408004590 con 0x55f66cf8cbb0 2024-09-19T09:52:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc3f8ff9640 1 -- 172.21.15.18:0/3285713378 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc408015070 con 0x55f66cf8cbb0 2024-09-19T09:52:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.411+0000 7fc3f8ff9640 1 -- 172.21.15.18:0/3285713378 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080106a0 con 0x55f66cf8cbb0 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.412+0000 7fc41b6a5740 1 -- 172.21.15.18:0/3285713378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 msgr2=0x55f66cf7e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.412+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/3285713378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf7e880 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc4080044d0 tx=0x7fc408003f20 comp rx=0 tx=0).stop 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.412+0000 7fc41b6a5740 1 -- 172.21.15.18:0/3285713378 shutdown_connections 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.412+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/3285713378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cf7e880 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.412+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/3285713378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf822f0 0x55f66cf7e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.412+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/3285713378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf819d0 0x55f66cf9e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.412+0000 7fc41b6a5740 1 -- 172.21.15.18:0/3285713378 >> 172.21.15.18:0/3285713378 conn(0x55f66cf7df60 msgr2=0x55f66cf89730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.412+0000 7fc41b6a5740 1 -- 172.21.15.18:0/3285713378 shutdown_connections 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.412+0000 7fc41b6a5740 1 -- 172.21.15.18:0/3285713378 wait complete. 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc41b6a5740 1 -- start start 2024-09-19T09:52:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc41b6a5740 1 Processor -- start 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf819d0 0x55f66cfa7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf822f0 0x55f66cfa1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc41b6a5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cfa1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf9e830 con 0x55f66cf8cbb0 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf9e160 con 0x55f66cf819d0 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc41b6a5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f66cf9ef00 con 0x55f66cf822f0 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc41b6a5740 10 client.0 _ll_register_callbacks cb 0x7fc40800b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc4127fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cfa1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc4127fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cfa1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55636/0 (socket says 172.21.15.18:55636) 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc4127fc640 1 -- 172.21.15.18:0/671222772 learned_addr learned my addr 172.21.15.18:0/671222772 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc4127fc640 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf819d0 0x55f66cfa7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc412ffd640 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf822f0 0x55f66cfa1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc4127fc640 1 -- 172.21.15.18:0/671222772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf822f0 msgr2=0x55f66cfa1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc4127fc640 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf822f0 0x55f66cfa1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc4127fc640 1 -- 172.21.15.18:0/671222772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf819d0 msgr2=0x55f66cfa7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc4127fc640 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf819d0 0x55f66cfa7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc4127fc640 1 -- 172.21.15.18:0/671222772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f66cfa24d0 con 0x55f66cf8cbb0 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.413+0000 7fc412ffd640 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf822f0 0x55f66cfa1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc4127fc640 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cfa1ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc408005830 tx=0x7fc40800b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a22ad312ca775ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc3f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/671222772 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40803e040 con 0x55f66cf8cbb0 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/671222772 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc408004ca0 con 0x55f66cf8cbb0 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc41b6a5740 1 -- 172.21.15.18:0/671222772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc408015070 con 0x55f66cf8cbb0 2024-09-19T09:52:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/671222772 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc408004f50 con 0x55f66cf8cbb0 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc41b6a5740 10 client.15168 fetch_fsmap learned FSMap version 27 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc41b6a5740 1 -- 172.21.15.18:0/671222772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f66d006ce0 con 0x55f66cf8cbb0 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/671222772 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc408015070 con 0x55f66cf8cbb0 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/671222772 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc408045020 con 0x55f66cf8cbb0 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc41b6a5740 10 client.15168 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc41b6a5740 10 client.15168 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc41b6a5740 20 client.15168 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55f66d00b4c0 0x55f66d00a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc41b6a5740 4 client.15168 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.414+0000 7fc41b6a5740 1 -- 172.21.15.18:0/671222772 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "status"}) -- 0x55f66ceefb10 con 0x55f66d00b4c0 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc412ffd640 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55f66d00b4c0 0x55f66d00a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc412ffd640 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55f66d00b4c0 0x55f66d00a1d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c65b69601d75134 server_cookie=55649d832bb2790 in_seq=0 out_seq=0 2024-09-19T09:52:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc3f6ff5640 10 client.15168 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc3f6ff5640 1 -- 172.21.15.18:0/671222772 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55f66ceefb10 con 0x55f66d00b4c0 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc3f6ff5640 10 client.15168 handle_command_reply: tid=0 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc41b6a5740 1 client.15168 shutdown 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc41b6a5740 1 -- 172.21.15.18:0/671222772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 msgr2=0x55f66cfa1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cfa1ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc408005830 tx=0x7fc40800b5e0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc41b6a5740 1 -- 172.21.15.18:0/671222772 shutdown_connections 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55f66d00b4c0 0x55f66d00a1d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f66cf8cbb0 0x55f66cfa1ca0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f66cf822f0 0x55f66cfa1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc41b6a5740 1 --2- 172.21.15.18:0/671222772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f66cf819d0 0x55f66cfa7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.415+0000 7fc41b6a5740 1 -- 172.21.15.18:0/671222772 >> 172.21.15.18:0/671222772 conn(0x55f66cf7df60 msgr2=0x55f66cf89730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc3f6ff5640 0 client.15168 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:52:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc41b6a5740 1 -- 172.21.15.18:0/671222772 shutdown_connections 2024-09-19T09:52:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc41b6a5740 1 -- 172.21.15.18:0/671222772 wait complete. 2024-09-19T09:52:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc41b6a5740 20 client.15168 trim_cache size 0 max 16384 2024-09-19T09:52:17.431 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:17.431 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:52:17.431 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 2, 2024-09-19T09:52:17.431 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24484, 2024-09-19T09:52:17.431 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:52:17.431 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:52:17.431 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:52:17.432 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 99.013428671, 2024-09-19T09:52:17.432 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-09-19T09:52:17.432 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:52:17.432 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:52:17.432 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 126.44468843200001 2024-09-19T09:52:17.432 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc4192cc640 1 -- 172.21.15.18:0/223000836 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3fc0a3240 msgr2=0x7fc3fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc4192cc640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3fc0a3240 0x7fc3fc0a5700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc40c096700 tx=0x7fc40c06eae0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc4192cc640 1 -- 172.21.15.18:0/223000836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc414106f50 msgr2=0x7fc414101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc4192cc640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc414106f50 0x7fc414101cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009fd0 tx=0x7fc40c00b260 comp rx=0 tx=0).stop 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc4192cc640 1 -- 172.21.15.18:0/223000836 shutdown_connections 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc4192cc640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3fc0a3240 0x7fc3fc0a5700 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc4192cc640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc414106f50 0x7fc414101cf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc4192cc640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc414100ca0 0x7fc4141017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc4192cc640 1 --2- 172.21.15.18:0/223000836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4141002f0 0x7fc414101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.416+0000 7fc4192cc640 1 -- 172.21.15.18:0/223000836 >> 172.21.15.18:0/223000836 conn(0x7fc414077210 msgr2=0x7fc4140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.417+0000 7fc4192cc640 1 -- 172.21.15.18:0/223000836 shutdown_connections 2024-09-19T09:52:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:17.417+0000 7fc4192cc640 1 -- 172.21.15.18:0/223000836 wait complete. 2024-09-19T09:52:18.059 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:52:18.324 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:18.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:17 smithi018 ceph-mon[30956]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T09:52:18.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:17 smithi049 ceph-mon[34858]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T09:52:18.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:17 smithi162 ceph-mon[35174]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T09:52:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.846+0000 7f9eb1c31640 1 -- 172.21.15.18:0/1185911030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac102790 msgr2=0x7f9eac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.846+0000 7f9eb1c31640 1 --2- 172.21.15.18:0/1185911030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac102790 0x7f9eac1067e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009900 tx=0x7f9ea002a410 comp rx=0 tx=0).stop 2024-09-19T09:52:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.846+0000 7f9eb1c31640 1 -- 172.21.15.18:0/1185911030 shutdown_connections 2024-09-19T09:52:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.846+0000 7f9eb1c31640 1 --2- 172.21.15.18:0/1185911030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eac106f10 0x7f9eac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.846+0000 7f9eb1c31640 1 --2- 172.21.15.18:0/1185911030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac102790 0x7f9eac1067e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.846+0000 7f9eb1c31640 1 --2- 172.21.15.18:0/1185911030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac101de0 0x7f9eac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.846+0000 7f9eb1c31640 1 -- 172.21.15.18:0/1185911030 >> 172.21.15.18:0/1185911030 conn(0x7f9eac0fd8c0 msgr2=0x7f9eac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.846+0000 7f9eb1c31640 1 -- 172.21.15.18:0/1185911030 shutdown_connections 2024-09-19T09:52:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.846+0000 7f9eb1c31640 1 -- 172.21.15.18:0/1185911030 wait complete. 2024-09-19T09:52:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.847+0000 7f9eb1c31640 1 Processor -- start 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.847+0000 7f9eb1c31640 1 -- start start 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.847+0000 7f9eb1c31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac101de0 0x7f9eac198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.847+0000 7f9eb1c31640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eac102790 0x7f9eac1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.847+0000 7f9eb1c31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac106f10 0x7f9eac19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.847+0000 7f9eb1c31640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac111f90 con 0x7f9eac106f10 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.847+0000 7f9eb1c31640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac111e10 con 0x7f9eac102790 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.847+0000 7f9eb1c31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac112110 con 0x7f9eac101de0 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.847+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac106f10 0x7f9eac19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac106f10 0x7f9eac19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55664/0 (socket says 172.21.15.18:55664) 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eabfff640 1 -- 172.21.15.18:0/2495780583 learned_addr learned my addr 172.21.15.18:0/2495780583 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eac102790 0x7f9eac1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac101de0 0x7f9eac198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eabfff640 1 -- 172.21.15.18:0/2495780583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac101de0 msgr2=0x7f9eac198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eabfff640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac101de0 0x7f9eac198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eabfff640 1 -- 172.21.15.18:0/2495780583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eac102790 msgr2=0x7f9eac1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eabfff640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eac102790 0x7f9eac1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eabfff640 1 -- 172.21.15.18:0/2495780583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac19d440 con 0x7f9eac106f10 2024-09-19T09:52:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac101de0 0x7f9eac198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eabfff640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac106f10 0x7f9eac19cd60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400eaa0 tx=0x7f9ea400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9ea8ff9640 1 -- 172.21.15.18:0/2495780583 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400cdb0 con 0x7f9eac106f10 2024-09-19T09:52:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9ea8ff9640 1 -- 172.21.15.18:0/2495780583 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ea4005020 con 0x7f9eac106f10 2024-09-19T09:52:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eb1c31640 1 -- 172.21.15.18:0/2495780583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eac19d730 con 0x7f9eac106f10 2024-09-19T09:52:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9ea8ff9640 1 -- 172.21.15.18:0/2495780583 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea40116b0 con 0x7f9eac106f10 2024-09-19T09:52:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.848+0000 7f9eb1c31640 1 -- 172.21.15.18:0/2495780583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eac1a5010 con 0x7f9eac106f10 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.850+0000 7f9ea8ff9640 1 -- 172.21.15.18:0/2495780583 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9ea4005560 con 0x7f9eac106f10 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eb400a740 1 Processor -- start 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eb400a740 1 -- start start 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e29db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e34670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e36fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eb400a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fd91d90090 con 0x55fd91e299d0 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eb400a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fd91d37a70 con 0x55fd91e2a2f0 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eb400a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fd91d8c050 con 0x55fd91e34bb0 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e29db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e29db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55668/0 (socket says 172.21.15.18:55668) 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9eaaffd640 1 -- 172.21.15.18:0/4139811611 learned_addr learned my addr 172.21.15.18:0/4139811611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.851+0000 7f9ea8ff9640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9e940a3240 0x7f9e940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/4139811611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e34670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9eabfff640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9e940a3240 0x7f9e940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/4139811611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e36fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9eaaffd640 1 -- 172.21.15.18:0/4139811611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 msgr2=0x55fd91e36fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/4139811611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e36fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9eaaffd640 1 -- 172.21.15.18:0/4139811611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 msgr2=0x55fd91e34670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/4139811611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e34670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9eaaffd640 1 -- 172.21.15.18:0/4139811611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd91d44130 con 0x55fd91e299d0 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9ea8ff9640 1 -- 172.21.15.18:0/2495780583 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9ea40cfc70 con 0x7f9eac106f10 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/4139811611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e29db0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9ea002a930 tx=0x7f9ea0005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c6b00541851ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9eabfff640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9e940a3240 0x7f9e940a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9ea409c1a0 tx=0x7f9ea409c0b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9e91ffb640 1 -- 172.21.15.18:0/4139811611 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0043020 con 0x55fd91e299d0 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9e91ffb640 1 -- 172.21.15.18:0/4139811611 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ea0031980 con 0x55fd91e299d0 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.852+0000 7f9e91ffb640 1 -- 172.21.15.18:0/4139811611 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0035050 con 0x55fd91e299d0 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.853+0000 7f9eb400a740 1 -- 172.21.15.18:0/4139811611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 msgr2=0x55fd91e29db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.853+0000 7f9eb400a740 1 --2- 172.21.15.18:0/4139811611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e29db0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9ea002a930 tx=0x7f9ea0005d70 comp rx=0 tx=0).stop 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.853+0000 7f9eb400a740 1 -- 172.21.15.18:0/4139811611 shutdown_connections 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.853+0000 7f9eb400a740 1 --2- 172.21.15.18:0/4139811611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e36fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.853+0000 7f9eb400a740 1 --2- 172.21.15.18:0/4139811611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e34670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.853+0000 7f9eb400a740 1 --2- 172.21.15.18:0/4139811611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e29db0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.853+0000 7f9eb400a740 1 -- 172.21.15.18:0/4139811611 >> 172.21.15.18:0/4139811611 conn(0x55fd91e25f60 msgr2=0x55fd91e26340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.853+0000 7f9eb400a740 1 -- 172.21.15.18:0/4139811611 shutdown_connections 2024-09-19T09:52:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.853+0000 7f9eb400a740 1 -- 172.21.15.18:0/4139811611 wait complete. 2024-09-19T09:52:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.853+0000 7f9eb400a740 1 -- start start 2024-09-19T09:52:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eb400a740 1 Processor -- start 2024-09-19T09:52:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e34430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e31780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e31cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eb400a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fd91e37780 con 0x55fd91e299d0 2024-09-19T09:52:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eb400a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fd91d4af20 con 0x55fd91e2a2f0 2024-09-19T09:52:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eb400a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fd91e37900 con 0x55fd91e34bb0 2024-09-19T09:52:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eb400a740 10 client.0 _ll_register_callbacks cb 0x55fd91d14030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e34430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e34430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55676/0 (socket says 172.21.15.18:55676) 2024-09-19T09:52:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eaaffd640 1 -- 172.21.15.18:0/2338890357 learned_addr learned my addr 172.21.15.18:0/2338890357 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e31780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eaaffd640 1 -- 172.21.15.18:0/2338890357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 msgr2=0x55fd91e31cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e31cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eaaffd640 1 -- 172.21.15.18:0/2338890357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 msgr2=0x55fd91e31780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e31780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eaaffd640 1 -- 172.21.15.18:0/2338890357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd91b012b0 con 0x55fd91e299d0 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e34430 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0006010 tx=0x7f9ea0005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3268701f83913e9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.854+0000 7f9e8affd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9e8affd640 1 -- 172.21.15.18:0/2338890357 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea004d020 con 0x55fd91e299d0 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9e8affd640 1 -- 172.21.15.18:0/2338890357 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9ea0003a00 con 0x55fd91e299d0 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9eb400a740 1 -- 172.21.15.18:0/2338890357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ea0031980 con 0x55fd91e299d0 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9e8affd640 1 -- 172.21.15.18:0/2338890357 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9ea0043070 con 0x55fd91e299d0 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9eb400a740 10 client.15180 fetch_fsmap learned FSMap version 27 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9eb400a740 1 -- 172.21.15.18:0/2338890357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fd91e43090 con 0x55fd91e299d0 2024-09-19T09:52:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9e8affd640 1 -- 172.21.15.18:0/2338890357 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ea0031980 con 0x55fd91e299d0 2024-09-19T09:52:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9e8affd640 1 -- 172.21.15.18:0/2338890357 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9ea003ac90 con 0x55fd91e299d0 2024-09-19T09:52:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9eb400a740 10 client.15180 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:52:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9eb400a740 10 client.15180 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:52:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9eb400a740 20 client.15180 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55fd91e45250 0x55fd91e466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9eb400a740 4 client.15180 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.855+0000 7f9eb400a740 1 -- 172.21.15.18:0/2338890357 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd91d9d600 con 0x55fd91e45250 2024-09-19T09:52:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.856+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55fd91e45250 0x55fd91e466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.856+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55fd91e45250 0x55fd91e466c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1caf48717cbd6462 server_cookie=9ae2482710573ab0 in_seq=0 out_seq=0 2024-09-19T09:52:18.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.856+0000 7f9e8affd640 10 client.15180 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:52:18.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9e8affd640 1 -- 172.21.15.18:0/2338890357 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd91d9d600 con 0x55fd91e45250 2024-09-19T09:52:18.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9e8affd640 10 client.15180 handle_command_reply: tid=0 2024-09-19T09:52:18.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 client.15180 shutdown 2024-09-19T09:52:18.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 -- 172.21.15.18:0/2338890357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 msgr2=0x55fd91e34430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:18.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e34430 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0006010 tx=0x7f9ea0005720 comp rx=0 tx=0).stop 2024-09-19T09:52:18.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 -- 172.21.15.18:0/2338890357 shutdown_connections 2024-09-19T09:52:18.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55fd91e45250 0x55fd91e466c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e31cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e31780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2338890357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e34430 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 -- 172.21.15.18:0/2338890357 >> 172.21.15.18:0/2338890357 conn(0x55fd91e25f60 msgr2=0x55fd91e2bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:18.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9e8affd640 0 client.15180 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:52:18.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 -- 172.21.15.18:0/2338890357 shutdown_connections 2024-09-19T09:52:18.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 1 -- 172.21.15.18:0/2338890357 wait complete. 2024-09-19T09:52:18.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.857+0000 7f9eb400a740 20 client.15180 trim_cache size 0 max 16384 2024-09-19T09:52:18.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.876+0000 7f9eb400a740 1 Processor -- start 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.876+0000 7f9eb400a740 1 -- start start 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.876+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e45920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.876+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e30050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.876+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e4e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.876+0000 7f9eb400a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fd91e44a00 con 0x55fd91e299d0 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.876+0000 7f9eb400a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fd91e450d0 con 0x55fd91e2a2f0 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.876+0000 7f9eb400a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fd91e457a0 con 0x55fd91e34bb0 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e45920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e45920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55692/0 (socket says 172.21.15.18:55692) 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eaaffd640 1 -- 172.21.15.18:0/576879926 learned_addr learned my addr 172.21.15.18:0/576879926 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:18.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/576879926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e30050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/576879926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e4e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eaaffd640 1 -- 172.21.15.18:0/576879926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 msgr2=0x55fd91e4e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/576879926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e4e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eaaffd640 1 -- 172.21.15.18:0/576879926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 msgr2=0x55fd91e30050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/576879926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e30050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eaaffd640 1 -- 172.21.15.18:0/576879926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd91e259e0 con 0x55fd91e299d0 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/576879926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e45920 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0001eb0 tx=0x7f9ea0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9db42d68c98750c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9e917fa640 1 -- 172.21.15.18:0/576879926 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea004d070 con 0x55fd91e299d0 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9e917fa640 1 -- 172.21.15.18:0/576879926 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ea003d690 con 0x55fd91e299d0 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.877+0000 7f9e917fa640 1 -- 172.21.15.18:0/576879926 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0035040 con 0x55fd91e299d0 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.878+0000 7f9eb400a740 1 -- 172.21.15.18:0/576879926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 msgr2=0x55fd91e45920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:18.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.878+0000 7f9eb400a740 1 --2- 172.21.15.18:0/576879926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e45920 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0001eb0 tx=0x7f9ea0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.878+0000 7f9eb400a740 1 -- 172.21.15.18:0/576879926 shutdown_connections 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.878+0000 7f9eb400a740 1 --2- 172.21.15.18:0/576879926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e34bb0 0x55fd91e4e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.878+0000 7f9eb400a740 1 --2- 172.21.15.18:0/576879926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e30050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.878+0000 7f9eb400a740 1 --2- 172.21.15.18:0/576879926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e299d0 0x55fd91e45920 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.878+0000 7f9eb400a740 1 -- 172.21.15.18:0/576879926 >> 172.21.15.18:0/576879926 conn(0x55fd91e25f60 msgr2=0x55fd91e20ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.878+0000 7f9eb400a740 1 -- 172.21.15.18:0/576879926 shutdown_connections 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.878+0000 7f9eb400a740 1 -- 172.21.15.18:0/576879926 wait complete. 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.879+0000 7f9eb400a740 1 -- start start 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.879+0000 7f9eb400a740 1 Processor -- start 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e299d0 0x55fd91e2b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e2bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eb400a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e34bb0 0x55fd91e4d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eb400a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fd91e46540 con 0x55fd91e34bb0 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eb400a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fd91e45e70 con 0x55fd91e2a2f0 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eb400a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fd91e46c10 con 0x55fd91e299d0 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eb400a740 10 client.0 _ll_register_callbacks cb 0x7f9e9c00a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e34bb0 0x55fd91e4d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e34bb0 0x55fd91e4d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55700/0 (socket says 172.21.15.18:55700) 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eaaffd640 1 -- 172.21.15.18:0/2236428951 learned_addr learned my addr 172.21.15.18:0/2236428951 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e299d0 0x55fd91e2b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e2bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eaaffd640 1 -- 172.21.15.18:0/2236428951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e299d0 msgr2=0x55fd91e2b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e299d0 0x55fd91e2b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eaaffd640 1 -- 172.21.15.18:0/2236428951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 msgr2=0x55fd91e2bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e2bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eaaffd640 1 -- 172.21.15.18:0/2236428951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd91e2c5b0 con 0x55fd91e34bb0 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e34bb0 0x55fd91e4d910 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0005db0 tx=0x7f9ea0003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52221da5b3099d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9e8affd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9e8affd640 1 -- 172.21.15.18:0/2236428951 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0035070 con 0x55fd91e34bb0 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.880+0000 7f9e8affd640 1 -- 172.21.15.18:0/2236428951 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9ea003db10 con 0x55fd91e34bb0 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9eb400a740 1 -- 172.21.15.18:0/2236428951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ea003d690 con 0x55fd91e34bb0 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9e8affd640 1 -- 172.21.15.18:0/2236428951 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9ea004d040 con 0x55fd91e34bb0 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9eb400a740 10 client.15186 fetch_fsmap learned FSMap version 27 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9eb400a740 1 -- 172.21.15.18:0/2236428951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fd91e4eef0 con 0x55fd91e34bb0 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9e8affd640 1 -- 172.21.15.18:0/2236428951 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ea003d690 con 0x55fd91e34bb0 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9e8affd640 1 -- 172.21.15.18:0/2236428951 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9ea005e040 con 0x55fd91e34bb0 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9eb400a740 10 client.15186 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:52:18.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9eb400a740 10 client.15186 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:52:18.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9eb400a740 20 client.15186 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:18.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55fd91eb79d0 0x55fd91eb66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:18.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9eb400a740 4 client.15186 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:52:18.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9eb400a740 1 -- 172.21.15.18:0/2236428951 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "status"}) -- 0x55fd91d97b10 con 0x55fd91eb79d0 2024-09-19T09:52:18.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.881+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55fd91eb79d0 0x55fd91eb66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:18.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55fd91eb79d0 0x55fd91eb66e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53df27daefe7f2ef server_cookie=8db530ccae5b1d83 in_seq=0 out_seq=0 2024-09-19T09:52:18.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9e8affd640 10 client.15186 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:52:18.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9e8affd640 1 -- 172.21.15.18:0/2236428951 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55fd91d97b10 con 0x55fd91eb79d0 2024-09-19T09:52:18.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9e8affd640 10 client.15186 handle_command_reply: tid=0 2024-09-19T09:52:18.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9eb400a740 1 client.15186 shutdown 2024-09-19T09:52:18.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9eb400a740 1 -- 172.21.15.18:0/2236428951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e34bb0 msgr2=0x55fd91e4d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:18.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e34bb0 0x55fd91e4d910 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0005db0 tx=0x7f9ea0003a90 comp rx=0 tx=0).stop 2024-09-19T09:52:18.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9eb400a740 1 -- 172.21.15.18:0/2236428951 shutdown_connections 2024-09-19T09:52:18.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55fd91eb79d0 0x55fd91eb66e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd91e34bb0 0x55fd91e4d910 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd91e2a2f0 0x55fd91e2bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9eb400a740 1 --2- 172.21.15.18:0/2236428951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd91e299d0 0x55fd91e2b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.882+0000 7f9eb400a740 1 -- 172.21.15.18:0/2236428951 >> 172.21.15.18:0/2236428951 conn(0x55fd91e25f60 msgr2=0x55fd91e2fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:18.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.883+0000 7f9e8affd640 0 client.15186 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:52:18.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.883+0000 7f9eb400a740 1 -- 172.21.15.18:0/2236428951 shutdown_connections 2024-09-19T09:52:18.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.883+0000 7f9eb400a740 1 -- 172.21.15.18:0/2236428951 wait complete. 2024-09-19T09:52:18.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.883+0000 7f9eb400a740 20 client.15186 trim_cache size 0 max 16384 2024-09-19T09:52:18.892 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:52:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 1, 2024-09-19T09:52:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24488, 2024-09-19T09:52:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:52:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:52:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:52:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 101.494611695, 2024-09-19T09:52:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-09-19T09:52:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:52:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:52:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 130.333152412 2024-09-19T09:52:18.893 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 -- 172.21.15.18:0/2495780583 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9e940a3240 msgr2=0x7f9e940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9e940a3240 0x7f9e940a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9ea409c1a0 tx=0x7f9ea409c0b0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 -- 172.21.15.18:0/2495780583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac106f10 msgr2=0x7f9eac19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac106f10 0x7f9eac19cd60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400eaa0 tx=0x7f9ea400ef60 comp rx=0 tx=0).stop 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 -- 172.21.15.18:0/2495780583 shutdown_connections 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9e940a3240 0x7f9e940a5700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac106f10 0x7f9eac19cd60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9eac102790 0x7f9eac1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 --2- 172.21.15.18:0/2495780583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac101de0 0x7f9eac198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 -- 172.21.15.18:0/2495780583 >> 172.21.15.18:0/2495780583 conn(0x7f9eac0fd8c0 msgr2=0x7f9eac0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:18.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 -- 172.21.15.18:0/2495780583 shutdown_connections 2024-09-19T09:52:18.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:18.884+0000 7f9eb1c31640 1 -- 172.21.15.18:0/2495780583 wait complete. 2024-09-19T09:52:19.628 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:52:19.888 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:20.210 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:19 smithi018 ceph-mon[30956]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:52:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.291+0000 7ff85d847640 1 -- 172.21.15.18:0/1925938243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff85810c160 msgr2=0x7ff85810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.291+0000 7ff85d847640 1 --2- 172.21.15.18:0/1925938243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff85810c160 0x7ff85810e600 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff850009900 tx=0x7ff85002a480 comp rx=0 tx=0).stop 2024-09-19T09:52:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.292+0000 7ff85d847640 1 -- 172.21.15.18:0/1925938243 shutdown_connections 2024-09-19T09:52:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.292+0000 7ff85d847640 1 --2- 172.21.15.18:0/1925938243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff85810c160 0x7ff85810e600 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.292+0000 7ff85d847640 1 --2- 172.21.15.18:0/1925938243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff858103650 0x7ff85810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.292+0000 7ff85d847640 1 --2- 172.21.15.18:0/1925938243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858102d30 0x7ff858103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.292+0000 7ff85d847640 1 -- 172.21.15.18:0/1925938243 >> 172.21.15.18:0/1925938243 conn(0x7ff8580fc7d0 msgr2=0x7ff8580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.292+0000 7ff85d847640 1 -- 172.21.15.18:0/1925938243 shutdown_connections 2024-09-19T09:52:20.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.292+0000 7ff85d847640 1 -- 172.21.15.18:0/1925938243 wait complete. 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.292+0000 7ff85d847640 1 Processor -- start 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.292+0000 7ff85d847640 1 -- start start 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.292+0000 7ff85d847640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858102d30 0x7ff8581983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff85d847640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff858103650 0x7ff8581988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff85d847640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff85810c160 0x7ff85819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff85d847640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff858111f60 con 0x7ff85810c160 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff85d847640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff858111de0 con 0x7ff858102d30 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff85d847640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8581120e0 con 0x7ff858103650 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff85810c160 0x7ff85819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff85810c160 0x7ff85819cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55712/0 (socket says 172.21.15.18:55712) 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8577fe640 1 -- 172.21.15.18:0/634949424 learned_addr learned my addr 172.21.15.18:0/634949424 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8567fc640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff858103650 0x7ff8581988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff856ffd640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858102d30 0x7ff8581983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8577fe640 1 -- 172.21.15.18:0/634949424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff858103650 msgr2=0x7ff8581988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8577fe640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff858103650 0x7ff8581988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8577fe640 1 -- 172.21.15.18:0/634949424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858102d30 msgr2=0x7ff8581983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8577fe640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858102d30 0x7ff8581983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8577fe640 1 -- 172.21.15.18:0/634949424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85819d350 con 0x7ff85810c160 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8567fc640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff858103650 0x7ff8581988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff8577fe640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff85810c160 0x7ff85819cc70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff850005ab0 tx=0x7ff8500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff85c845640 1 -- 172.21.15.18:0/634949424 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85003f030 con 0x7ff85810c160 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff85d847640 1 -- 172.21.15.18:0/634949424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85819d5e0 con 0x7ff85810c160 2024-09-19T09:52:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.293+0000 7ff85c845640 1 -- 172.21.15.18:0/634949424 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff850003ce0 con 0x7ff85810c160 2024-09-19T09:52:20.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.294+0000 7ff85c845640 1 -- 172.21.15.18:0/634949424 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850035070 con 0x7ff85810c160 2024-09-19T09:52:20.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.294+0000 7ff85d847640 1 -- 172.21.15.18:0/634949424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8581008c0 con 0x7ff85810c160 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.296+0000 7ff85c845640 1 -- 172.21.15.18:0/634949424 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff850042030 con 0x7ff85810c160 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.296+0000 7ff85fc20740 1 Processor -- start 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.296+0000 7ff85fc20740 1 -- start start 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08a82f0 0x55fdb08b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb08b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff85fc20740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fdb080e090 con 0x55fdb08b2bb0 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff85fc20740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fdb07b5a70 con 0x55fdb08a79d0 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff85fc20740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fdb080a050 con 0x55fdb08a82f0 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff8567fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb08b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff8567fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb08b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55714/0 (socket says 172.21.15.18:55714) 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff8567fc640 1 -- 172.21.15.18:0/2893495628 learned_addr learned my addr 172.21.15.18:0/2893495628 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff8567fc640 1 --2- 172.21.15.18:0/2893495628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff856ffd640 1 --2- 172.21.15.18:0/2893495628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08a82f0 0x55fdb08b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff8567fc640 1 -- 172.21.15.18:0/2893495628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08a82f0 msgr2=0x55fdb08b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff8567fc640 1 --2- 172.21.15.18:0/2893495628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08a82f0 0x55fdb08b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff8567fc640 1 -- 172.21.15.18:0/2893495628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 msgr2=0x55fdb08a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff8567fc640 1 --2- 172.21.15.18:0/2893495628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08a7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff85c845640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8440a3240 0x7ff8440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff8567fc640 1 -- 172.21.15.18:0/2893495628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb07c2130 con 0x55fdb08b2bb0 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff856ffd640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8440a3240 0x7ff8440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff85c845640 1 -- 172.21.15.18:0/634949424 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff8500f0170 con 0x7ff85810c160 2024-09-19T09:52:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.297+0000 7ff8567fc640 1 --2- 172.21.15.18:0/2893495628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb08b4fa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff840012520 tx=0x7ff84000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15bfa1755931469 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff84dffb640 1 -- 172.21.15.18:0/2893495628 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840018030 con 0x55fdb08b2bb0 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff84dffb640 1 -- 172.21.15.18:0/2893495628 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff840005500 con 0x55fdb08b2bb0 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff84dffb640 1 -- 172.21.15.18:0/2893495628 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840010900 con 0x55fdb08b2bb0 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff85fc20740 1 -- 172.21.15.18:0/2893495628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 msgr2=0x55fdb08b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff856ffd640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8440a3240 0x7ff8440a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55fdb08a4dc0 tx=0x7ff848009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff85fc20740 1 --2- 172.21.15.18:0/2893495628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb08b4fa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff840012520 tx=0x7ff84000b610 comp rx=0 tx=0).stop 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff85fc20740 1 -- 172.21.15.18:0/2893495628 shutdown_connections 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff85fc20740 1 --2- 172.21.15.18:0/2893495628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb08b4fa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff85fc20740 1 --2- 172.21.15.18:0/2893495628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08a82f0 0x55fdb08b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff85fc20740 1 --2- 172.21.15.18:0/2893495628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.298+0000 7ff85fc20740 1 -- 172.21.15.18:0/2893495628 >> 172.21.15.18:0/2893495628 conn(0x55fdb08a3f60 msgr2=0x55fdb08a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 1 -- 172.21.15.18:0/2893495628 shutdown_connections 2024-09-19T09:52:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 1 -- 172.21.15.18:0/2893495628 wait complete. 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 1 -- start start 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 1 Processor -- start 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a79d0 0x55fdb08b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a82f0 0x55fdb08af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 0x55fdb08afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fdb08b5780 con 0x55fdb08a79d0 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fdb07c8f20 con 0x55fdb08a82f0 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fdb08b5900 con 0x55fdb08b2bb0 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff85fc20740 10 client.0 _ll_register_callbacks cb 0x55fdb0792030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.299+0000 7ff856ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a79d0 0x55fdb08b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff856ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a79d0 0x55fdb08b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55716/0 (socket says 172.21.15.18:55716) 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff856ffd640 1 -- 172.21.15.18:0/4146318863 learned_addr learned my addr 172.21.15.18:0/4146318863 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff8577fe640 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 0x55fdb08afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff8567fc640 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a82f0 0x55fdb08af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff856ffd640 1 -- 172.21.15.18:0/4146318863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 msgr2=0x55fdb08afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff856ffd640 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 0x55fdb08afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff856ffd640 1 -- 172.21.15.18:0/4146318863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a82f0 msgr2=0x55fdb08af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff856ffd640 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a82f0 0x55fdb08af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff856ffd640 1 -- 172.21.15.18:0/4146318863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb057f2b0 con 0x55fdb08a79d0 2024-09-19T09:52:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff856ffd640 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a79d0 0x55fdb08b24a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff848012950 tx=0x7ff848004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79247500ac6b19cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff836ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff836ffd640 1 -- 172.21.15.18:0/4146318863 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84800ec60 con 0x55fdb08a79d0 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff836ffd640 1 -- 172.21.15.18:0/4146318863 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff84800ee00 con 0x55fdb08a79d0 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff85fc20740 1 -- 172.21.15.18:0/4146318863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff840005500 con 0x55fdb08a79d0 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff836ffd640 1 -- 172.21.15.18:0/4146318863 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff848003970 con 0x55fdb08a79d0 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff85fc20740 10 client.15198 fetch_fsmap learned FSMap version 27 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.300+0000 7ff85fc20740 1 -- 172.21.15.18:0/4146318863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fdb08c1150 con 0x55fdb08a79d0 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.301+0000 7ff836ffd640 1 -- 172.21.15.18:0/4146318863 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff840005500 con 0x55fdb08a79d0 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.301+0000 7ff836ffd640 1 -- 172.21.15.18:0/4146318863 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff84800f040 con 0x55fdb08a79d0 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.301+0000 7ff85fc20740 10 client.15198 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.301+0000 7ff85fc20740 10 client.15198 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.301+0000 7ff85fc20740 20 client.15198 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.301+0000 7ff85fc20740 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fdb08c3860 0x55fdb08c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.301+0000 7ff85fc20740 4 client.15198 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.301+0000 7ff85fc20740 1 -- 172.21.15.18:0/4146318863 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdb081b600 con 0x55fdb08c3860 2024-09-19T09:52:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.301+0000 7ff8567fc640 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fdb08c3860 0x55fdb08c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.302+0000 7ff8567fc640 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fdb08c3860 0x55fdb08c4cd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2ad77de8a7ed9ff server_cookie=3ff7d083cd569712 in_seq=0 out_seq=0 2024-09-19T09:52:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.302+0000 7ff836ffd640 10 client.15198 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.302+0000 7ff836ffd640 1 -- 172.21.15.18:0/4146318863 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fdb081b600 con 0x55fdb08c3860 2024-09-19T09:52:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.302+0000 7ff836ffd640 10 client.15198 handle_command_reply: tid=0 2024-09-19T09:52:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.302+0000 7ff85fc20740 1 client.15198 shutdown 2024-09-19T09:52:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 1 -- 172.21.15.18:0/4146318863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a79d0 msgr2=0x55fdb08b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a79d0 0x55fdb08b24a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff848012950 tx=0x7ff848004a40 comp rx=0 tx=0).stop 2024-09-19T09:52:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 1 -- 172.21.15.18:0/4146318863 shutdown_connections 2024-09-19T09:52:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fdb08c3860 0x55fdb08c4cd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 0x55fdb08afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a82f0 0x55fdb08af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 1 --2- 172.21.15.18:0/4146318863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a79d0 0x55fdb08b24a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff836ffd640 0 client.15198 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 1 -- 172.21.15.18:0/4146318863 >> 172.21.15.18:0/4146318863 conn(0x55fdb08a3f60 msgr2=0x55fdb08a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 1 -- 172.21.15.18:0/4146318863 shutdown_connections 2024-09-19T09:52:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 1 -- 172.21.15.18:0/4146318863 wait complete. 2024-09-19T09:52:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.303+0000 7ff85fc20740 20 client.15198 trim_cache size 0 max 16384 2024-09-19T09:52:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff85fc20740 1 Processor -- start 2024-09-19T09:52:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff85fc20740 1 -- start start 2024-09-19T09:52:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a82f0 0x55fdb08ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 0x55fdb08cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff85fc20740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fdb08c3010 con 0x55fdb08a82f0 2024-09-19T09:52:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff85fc20740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fdb08c36e0 con 0x55fdb08a79d0 2024-09-19T09:52:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff85fc20740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fdb08c3db0 con 0x55fdb08b2bb0 2024-09-19T09:52:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff8567fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a82f0 0x55fdb08ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff8567fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a82f0 0x55fdb08ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55724/0 (socket says 172.21.15.18:55724) 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff8567fc640 1 -- 172.21.15.18:0/2290031483 learned_addr learned my addr 172.21.15.18:0/2290031483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff856ffd640 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff8567fc640 1 -- 172.21.15.18:0/2290031483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 msgr2=0x55fdb08cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff8577fe640 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 0x55fdb08cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff8567fc640 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 0x55fdb08cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff8567fc640 1 -- 172.21.15.18:0/2290031483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 msgr2=0x55fdb08c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff8567fc640 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08c4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff8567fc640 1 -- 172.21.15.18:0/2290031483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb08b20c0 con 0x55fdb08a82f0 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff856ffd640 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.321+0000 7ff8577fe640 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 0x55fdb08cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.322+0000 7ff8567fc640 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a82f0 0x55fdb08ccfb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff840012e70 tx=0x7ff840004d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab92c3d232a3cde2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.322+0000 7ff84d7fa640 1 -- 172.21.15.18:0/2290031483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840018040 con 0x55fdb08a82f0 2024-09-19T09:52:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.322+0000 7ff84d7fa640 1 -- 172.21.15.18:0/2290031483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff840004890 con 0x55fdb08a82f0 2024-09-19T09:52:20.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.322+0000 7ff84d7fa640 1 -- 172.21.15.18:0/2290031483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8400035f0 con 0x55fdb08a82f0 2024-09-19T09:52:20.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.322+0000 7ff85fc20740 1 -- 172.21.15.18:0/2290031483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a82f0 msgr2=0x55fdb08ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a82f0 0x55fdb08ccfb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff840012e70 tx=0x7ff840004d40 comp rx=0 tx=0).stop 2024-09-19T09:52:20.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 -- 172.21.15.18:0/2290031483 shutdown_connections 2024-09-19T09:52:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08b2bb0 0x55fdb08cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08a82f0 0x55fdb08ccfb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 --2- 172.21.15.18:0/2290031483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 -- 172.21.15.18:0/2290031483 >> 172.21.15.18:0/2290031483 conn(0x55fdb08a3f60 msgr2=0x55fdb08ae100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 -- 172.21.15.18:0/2290031483 shutdown_connections 2024-09-19T09:52:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 -- 172.21.15.18:0/2290031483 wait complete. 2024-09-19T09:52:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 -- start start 2024-09-19T09:52:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 Processor -- start 2024-09-19T09:52:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.323+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08a82f0 0x55fdb08c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff85fc20740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb092bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff85fc20740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fdb08c4b50 con 0x55fdb08b2bb0 2024-09-19T09:52:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff85fc20740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fdb08c4480 con 0x55fdb08a79d0 2024-09-19T09:52:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff85fc20740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fdb08c5220 con 0x55fdb08a82f0 2024-09-19T09:52:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff85fc20740 10 client.0 _ll_register_callbacks cb 0x7ff848009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff8577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb092bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff8577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb092bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55736/0 (socket says 172.21.15.18:55736) 2024-09-19T09:52:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff8577fe640 1 -- 172.21.15.18:0/461504818 learned_addr learned my addr 172.21.15.18:0/461504818 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff856ffd640 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff8567fc640 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08a82f0 0x55fdb08c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff8577fe640 1 -- 172.21.15.18:0/461504818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08a82f0 msgr2=0x55fdb08c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff8577fe640 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08a82f0 0x55fdb08c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff8577fe640 1 -- 172.21.15.18:0/461504818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 msgr2=0x55fdb08c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff8577fe640 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff8577fe640 1 -- 172.21.15.18:0/461504818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb092c5a0 con 0x55fdb08b2bb0 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff8577fe640 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb092bf60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff8500b9190 tx=0x7ff8500bc590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f5b6929d75104f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff836ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff836ffd640 1 -- 172.21.15.18:0/461504818 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850049040 con 0x55fdb08b2bb0 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff836ffd640 1 -- 172.21.15.18:0/461504818 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff850003800 con 0x55fdb08b2bb0 2024-09-19T09:52:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.324+0000 7ff85fc20740 1 -- 172.21.15.18:0/461504818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff840004890 con 0x55fdb08b2bb0 2024-09-19T09:52:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff836ffd640 1 -- 172.21.15.18:0/461504818 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8500044e0 con 0x55fdb08b2bb0 2024-09-19T09:52:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff85fc20740 10 client.15204 fetch_fsmap learned FSMap version 27 2024-09-19T09:52:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff85fc20740 1 -- 172.21.15.18:0/461504818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fdb092d7f0 con 0x55fdb08b2bb0 2024-09-19T09:52:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff836ffd640 1 -- 172.21.15.18:0/461504818 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff840004890 con 0x55fdb08b2bb0 2024-09-19T09:52:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff836ffd640 1 -- 172.21.15.18:0/461504818 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff8500d0ce0 con 0x55fdb08b2bb0 2024-09-19T09:52:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff85fc20740 10 client.15204 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:52:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff85fc20740 10 client.15204 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:52:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff85fc20740 20 client.15204 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:20.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff85fc20740 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fdb0932490 0x55fdb09311a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:20.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff85fc20740 4 client.15204 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:52:20.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff85fc20740 1 -- 172.21.15.18:0/461504818 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "status"}) -- 0x55fdb0815b10 con 0x55fdb0932490 2024-09-19T09:52:20.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.325+0000 7ff856ffd640 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fdb0932490 0x55fdb09311a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:20.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff856ffd640 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fdb0932490 0x55fdb09311a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eabbdc127beed7c3 server_cookie=1891c3cdb1555e67 in_seq=0 out_seq=0 2024-09-19T09:52:20.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff836ffd640 10 client.15204 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:20.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff836ffd640 1 -- 172.21.15.18:0/461504818 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fdb0815b10 con 0x55fdb0932490 2024-09-19T09:52:20.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff836ffd640 10 client.15204 handle_command_reply: tid=0 2024-09-19T09:52:20.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 client.15204 shutdown 2024-09-19T09:52:20.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 -- 172.21.15.18:0/461504818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 msgr2=0x55fdb092bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb092bf60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff8500b9190 tx=0x7ff8500bc590 comp rx=0 tx=0).stop 2024-09-19T09:52:20.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 -- 172.21.15.18:0/461504818 shutdown_connections 2024-09-19T09:52:20.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fdb0932490 0x55fdb09311a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fdb08b2bb0 0x55fdb092bf60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb08a82f0 0x55fdb08c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 --2- 172.21.15.18:0/461504818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fdb08a79d0 0x55fdb08c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff836ffd640 0 client.15204 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:20.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 -- 172.21.15.18:0/461504818 >> 172.21.15.18:0/461504818 conn(0x55fdb08a3f60 msgr2=0x55fdb08a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:20.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 -- 172.21.15.18:0/461504818 shutdown_connections 2024-09-19T09:52:20.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 1 -- 172.21.15.18:0/461504818 wait complete. 2024-09-19T09:52:20.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.326+0000 7ff85fc20740 20 client.15204 trim_cache size 0 max 16384 2024-09-19T09:52:20.337 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:20.337 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:52:20.337 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:52:20.337 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24524, 2024-09-19T09:52:20.337 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:52:20.338 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:52:20.338 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:52:20.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 109.973024416, 2024-09-19T09:52:20.338 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-09-19T09:52:20.338 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:52:20.338 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:52:20.338 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 120.60541671199999 2024-09-19T09:52:20.338 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 -- 172.21.15.18:0/634949424 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8440a3240 msgr2=0x7ff8440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8440a3240 0x7ff8440a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55fdb08a4dc0 tx=0x7ff848009580 comp rx=0 tx=0).stop 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 -- 172.21.15.18:0/634949424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff85810c160 msgr2=0x7ff85819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff85810c160 0x7ff85819cc70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff850005ab0 tx=0x7ff8500042f0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 -- 172.21.15.18:0/634949424 shutdown_connections 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8440a3240 0x7ff8440a5700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff85810c160 0x7ff85819cc70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff858103650 0x7ff8581988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 --2- 172.21.15.18:0/634949424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff858102d30 0x7ff8581983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 -- 172.21.15.18:0/634949424 >> 172.21.15.18:0/634949424 conn(0x7ff8580fc7d0 msgr2=0x7ff8580fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 -- 172.21.15.18:0/634949424 shutdown_connections 2024-09-19T09:52:20.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:20.327+0000 7ff85d847640 1 -- 172.21.15.18:0/634949424 wait complete. 2024-09-19T09:52:20.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:19 smithi049 ceph-mon[34858]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:52:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:19 smithi162 ceph-mon[35174]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:52:21.130 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T09:52:21.140 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T09:52:21.140 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T09:52:21.140 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T09:52:21.140 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T09:52:21.279 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T09:52:21.279 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T09:52:21.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:52:21.279 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:52:21.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:52:21.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-19T09:52:21.373 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-09-19T09:52:21.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:52:21.375 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-19T09:52:21.375 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:52:21.375 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:52:21.376 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:52:21.676 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:22.103 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:21 smithi018 ceph-mon[30956]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:52:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.100+0000 7f30ad7e0640 1 -- 172.21.15.18:0/255287520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30a8106f10 msgr2=0x7f30a810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.100+0000 7f30ad7e0640 1 --2- 172.21.15.18:0/255287520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30a8106f10 0x7f30a810ea90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009ca0 tx=0x7f30a002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.100+0000 7f30ad7e0640 1 -- 172.21.15.18:0/255287520 shutdown_connections 2024-09-19T09:52:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.100+0000 7f30ad7e0640 1 --2- 172.21.15.18:0/255287520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30a8106f10 0x7f30a810ea90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.100+0000 7f30ad7e0640 1 --2- 172.21.15.18:0/255287520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a8102790 0x7f30a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.100+0000 7f30ad7e0640 1 --2- 172.21.15.18:0/255287520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30a8101de0 0x7f30a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.100+0000 7f30ad7e0640 1 -- 172.21.15.18:0/255287520 >> 172.21.15.18:0/255287520 conn(0x7f30a80fd8c0 msgr2=0x7f30a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.100+0000 7f30ad7e0640 1 -- 172.21.15.18:0/255287520 shutdown_connections 2024-09-19T09:52:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.100+0000 7f30ad7e0640 1 -- 172.21.15.18:0/255287520 wait complete. 2024-09-19T09:52:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.101+0000 7f30ad7e0640 1 Processor -- start 2024-09-19T09:52:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.101+0000 7f30ad7e0640 1 -- start start 2024-09-19T09:52:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30ad7e0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30a8101de0 0x7f30a81a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30ad7e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a8102790 0x7f30a81a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30ad7e0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30a8106f10 0x7f30a810dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30ad7e0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8112010 con 0x7f30a8101de0 2024-09-19T09:52:22.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30ad7e0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8111e90 con 0x7f30a8106f10 2024-09-19T09:52:22.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30ad7e0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8112190 con 0x7f30a8102790 2024-09-19T09:52:22.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30a8101de0 0x7f30a81a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:22.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30a8101de0 0x7f30a81a4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55758/0 (socket says 172.21.15.18:55758) 2024-09-19T09:52:22.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a6ffd640 1 -- 172.21.15.18:0/2150754462 learned_addr learned my addr 172.21.15.18:0/2150754462 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:22.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a77fe640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30a8106f10 0x7f30a810dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:22.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a67fc640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a8102790 0x7f30a81a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:22.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a6ffd640 1 -- 172.21.15.18:0/2150754462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a8102790 msgr2=0x7f30a81a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:22.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a6ffd640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a8102790 0x7f30a81a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a6ffd640 1 -- 172.21.15.18:0/2150754462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30a8106f10 msgr2=0x7f30a810dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:22.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a6ffd640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30a8106f10 0x7f30a810dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a6ffd640 1 -- 172.21.15.18:0/2150754462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a810e580 con 0x7f30a8101de0 2024-09-19T09:52:22.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.102+0000 7f30a6ffd640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30a8101de0 0x7f30a81a4960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f309800b4a0 tx=0x7f309800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:22.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.103+0000 7f308ffff640 1 -- 172.21.15.18:0/2150754462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098015020 con 0x7f30a8101de0 2024-09-19T09:52:22.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.103+0000 7f308ffff640 1 -- 172.21.15.18:0/2150754462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3098011d10 con 0x7f30a8101de0 2024-09-19T09:52:22.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.103+0000 7f30ad7e0640 1 -- 172.21.15.18:0/2150754462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a810e870 con 0x7f30a8101de0 2024-09-19T09:52:22.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.103+0000 7f308ffff640 1 -- 172.21.15.18:0/2150754462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309800f2e0 con 0x7f30a8101de0 2024-09-19T09:52:22.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.103+0000 7f30ad7e0640 1 -- 172.21.15.18:0/2150754462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a81ab890 con 0x7f30a8101de0 2024-09-19T09:52:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.104+0000 7f30ad7e0640 1 -- 172.21.15.18:0/2150754462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a81032c0 con 0x7f30a8101de0 2024-09-19T09:52:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.105+0000 7f308ffff640 1 -- 172.21.15.18:0/2150754462 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3098018020 con 0x7f30a8101de0 2024-09-19T09:52:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.106+0000 7f308ffff640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30900a3240 0x7f30900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.106+0000 7f30a67fc640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30900a3240 0x7f30900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.106+0000 7f308ffff640 1 -- 172.21.15.18:0/2150754462 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f30980cf140 con 0x7f30a8101de0 2024-09-19T09:52:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.106+0000 7f30a67fc640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30900a3240 0x7f30900a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f30a81a0170 tx=0x7f309c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:22.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.110+0000 7f308ffff640 1 -- 172.21.15.18:0/2150754462 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f309801f020 con 0x7f30a8101de0 2024-09-19T09:52:22.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.325+0000 7f30ad7e0640 1 -- 172.21.15.18:0/2150754462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f30a8105ed0 con 0x7f30a8101de0 2024-09-19T09:52:22.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.326+0000 7f308ffff640 1 -- 172.21.15.18:0/2150754462 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f309809be90 con 0x7f30a8101de0 2024-09-19T09:52:22.328 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:52:22.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 -- 172.21.15.18:0/2150754462 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30900a3240 msgr2=0x7f30900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:22.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30900a3240 0x7f30900a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f30a81a0170 tx=0x7f309c009110 comp rx=0 tx=0).stop 2024-09-19T09:52:22.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 -- 172.21.15.18:0/2150754462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30a8101de0 msgr2=0x7f30a81a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:22.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30a8101de0 0x7f30a81a4960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f309800b4a0 tx=0x7f309800b8a0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 -- 172.21.15.18:0/2150754462 shutdown_connections 2024-09-19T09:52:22.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30900a3240 0x7f30900a5700 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30a8106f10 0x7f30a810dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a8102790 0x7f30a81a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 --2- 172.21.15.18:0/2150754462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30a8101de0 0x7f30a81a4960 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:22.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 -- 172.21.15.18:0/2150754462 >> 172.21.15.18:0/2150754462 conn(0x7f30a80fd8c0 msgr2=0x7f30a80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:22.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 -- 172.21.15.18:0/2150754462 shutdown_connections 2024-09-19T09:52:22.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:22.328+0000 7f30ad7e0640 1 -- 172.21.15.18:0/2150754462 wait complete. 2024-09-19T09:52:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:21 smithi049 ceph-mon[34858]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:52:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:21 smithi162 ceph-mon[35174]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:52:22.955 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:52:22.956 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:52:22.956 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:52:22.956 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:52:22.956 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:52:22.956 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:52:22.956 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:52:22.957 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:52:22.957 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:52:22.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:52:22.957 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:52:22.975 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:52:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:52:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:52:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:52:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42180sec preferred_lft 42180sec 2024-09-19T09:52:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:52:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:52:22.977 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:52:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:52:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:52:22.978 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:52:22.978 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:52:22.978 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:52:22.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:52:22.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-09-19T09:52:22.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-09-19T09:52:22.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:52:22.978 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:52:23.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:52:23.180 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:22 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2150754462' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:52:23.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:52:23.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:52:23.212 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:52:23.239 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:52:23.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:52:23.241 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:52:23.313 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:52:23.313 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:52:23.314 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:52:23.314 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:52:23.314 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:52:23.314 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:52:23.314 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:52:23.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:52:23.315 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:52:23.315 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:52:23.315 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:52:23.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:22 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2150754462' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:52:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:52:23.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:22 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2150754462' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:52:23.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:52:23.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:52:23.679 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:52:23.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:52:23.696 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-19T09:52:23.753 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:52:23.753 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:52:23.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:52:23.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:52:23.754 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:52:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:52:23.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:52:23.873 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:52:23.873 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:52:23.873 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:52:23.873 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:52:23.873 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:52:23.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:52:23.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:52:23.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:52:23.875 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:52:23.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:52:23.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:52:24.004 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:52:24.004 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:52:24.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:52:24.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:52:24.004 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:52:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:52:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:52:24.086 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:52:24.086 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:52:24.102 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:52:24.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:52:24.103 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:52:24.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:23 smithi018 ceph-mon[30956]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:52:24.150 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T09:52:24.150 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T09:52:24.150 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/f6f4fc47-84bb-421e-b05b-f5ce55d47ab2 2024-09-19T09:52:24.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:52:24.151 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/f6f4fc47-84bb-421e-b05b-f5ce55d47ab2 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T09:52:24.255 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T09:52:24.255 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-19T09:52:24.256 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:52:24.397 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T09:52:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-19T09:52:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:52:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.49:3300,172.21.15.162:3300" 2024-09-19T09:52:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:3300,172.21.15.49:3300,172.21.15.162:3300:/volumes/qa/sv_1/f6f4fc47-84bb-421e-b05b-f5ce55d47ab2 2024-09-19T09:52:24.398 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=5b174660-766b-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T09:52:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:52:24.399 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:52:24.399 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:52:24.399 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:52:24.399 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:52:24.400 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:52:24.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:52:24.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:52:24.402 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:23 smithi049 ceph-mon[34858]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:52:24.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:23 smithi162 ceph-mon[35174]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:52:24.432 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:52:24.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:52:24.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:52:24.530 INFO:teuthology.orchestra.run.smithi018.stdout:client24892 2024-09-19T09:52:24.531 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:52:24.531 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:52:24.549 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:52:24.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:52:24.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:52:24.646 INFO:teuthology.orchestra.run.smithi018.stdout:client24892 2024-09-19T09:52:24.647 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:52:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:52:24.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:52:24.704 INFO:teuthology.orchestra.run.smithi018.stdout:client24892 2024-09-19T09:52:24.705 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5b174660-766b-11ef-bceb-c7b262605968.client24892/status') 2024-09-19T09:52:24.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:52:24.764 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.24892 (3)172.21.15.18:0/1202897710 2024-09-19T09:52:24.765 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-09-19T09:52:24.765 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-09-19T09:52:24.765 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-09-19T09:52:24.765 INFO:teuthology.orchestra.run.smithi018.stderr:71 bytes copied, 2.4958e-05 s, 2.8 MB/s 2024-09-19T09:52:24.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:52:24.772 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T09:52:24.783 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T09:52:24.783 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:52:24.784 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T09:52:24.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.886+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/1509828270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a4101c50 msgr2=0x7fe2a41020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:24.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.886+0000 7fe2a9e3c640 1 --2- 172.21.15.18:0/1509828270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a4101c50 0x7fe2a41020d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe298009900 tx=0x7fe29802a410 comp rx=0 tx=0).stop 2024-09-19T09:52:24.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.887+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/1509828270 shutdown_connections 2024-09-19T09:52:24.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.887+0000 7fe2a9e3c640 1 --2- 172.21.15.18:0/1509828270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a4102610 0x7fe2a4108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:24.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.887+0000 7fe2a9e3c640 1 --2- 172.21.15.18:0/1509828270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a4101c50 0x7fe2a41020d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:24.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.887+0000 7fe2a9e3c640 1 --2- 172.21.15.18:0/1509828270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2a4100a60 0x7fe2a4100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.887+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/1509828270 >> 172.21.15.18:0/1509828270 conn(0x7fe2a40fc1e0 msgr2=0x7fe2a40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.887+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/1509828270 shutdown_connections 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.887+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/1509828270 wait complete. 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.887+0000 7fe2a9e3c640 1 Processor -- start 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.887+0000 7fe2a9e3c640 1 -- start start 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a9e3c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a4100a60 0x7fe2a4197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a9e3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a4101c50 0x7fe2a4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a9e3c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2a4102610 0x7fe2a419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a9e3c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a410c6e0 con 0x7fe2a4101c50 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a9e3c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a410c560 con 0x7fe2a4102610 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a9e3c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a410c860 con 0x7fe2a4100a60 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a4101c50 0x7fe2a4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:24.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a4101c50 0x7fe2a4198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55786/0 (socket says 172.21.15.18:55786) 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a2ffd640 1 -- 172.21.15.18:0/2364081173 learned_addr learned my addr 172.21.15.18:0/2364081173 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a37fe640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a4100a60 0x7fe2a4197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a3fff640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2a4102610 0x7fe2a419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a2ffd640 1 -- 172.21.15.18:0/2364081173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a4100a60 msgr2=0x7fe2a4197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a2ffd640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a4100a60 0x7fe2a4197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a2ffd640 1 -- 172.21.15.18:0/2364081173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2a4102610 msgr2=0x7fe2a419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a2ffd640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2a4102610 0x7fe2a419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a2ffd640 1 -- 172.21.15.18:0/2364081173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a419fa20 con 0x7fe2a4101c50 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a2ffd640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a4101c50 0x7fe2a4198340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe298009230 tx=0x7fe298031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a0ff9640 1 -- 172.21.15.18:0/2364081173 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29803f030 con 0x7fe2a4101c50 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/2364081173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a419fcb0 con 0x7fe2a4101c50 2024-09-19T09:52:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a0ff9640 1 -- 172.21.15.18:0/2364081173 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe298003ad0 con 0x7fe2a4101c50 2024-09-19T09:52:24.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.888+0000 7fe2a0ff9640 1 -- 172.21.15.18:0/2364081173 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298035070 con 0x7fe2a4101c50 2024-09-19T09:52:24.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.889+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/2364081173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a41a01a0 con 0x7fe2a4101c50 2024-09-19T09:52:24.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.890+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/2364081173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a41a0490 con 0x7fe2a4101c50 2024-09-19T09:52:24.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.891+0000 7fe2a0ff9640 1 -- 172.21.15.18:0/2364081173 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe298042030 con 0x7fe2a4101c50 2024-09-19T09:52:24.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.891+0000 7fe2a0ff9640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe28c0a32f0 0x7fe28c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:24.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.892+0000 7fe2a0ff9640 1 -- 172.21.15.18:0/2364081173 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe2980f0260 con 0x7fe2a4101c50 2024-09-19T09:52:24.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.892+0000 7fe2a37fe640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe28c0a32f0 0x7fe28c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:24.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.892+0000 7fe2a37fe640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe28c0a32f0 0x7fe28c0a57b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4101ab0 tx=0x7fe29400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:24.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:24.895+0000 7fe2a0ff9640 1 -- 172.21.15.18:0/2364081173 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2980bc900 con 0x7fe2a4101c50 2024-09-19T09:52:25.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.113+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/2364081173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fe2a41a0660 con 0x7fe2a4101c50 2024-09-19T09:52:25.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.949+0000 7fe2a0ff9640 1 -- 172.21.15.18:0/2364081173 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7fe2980c0c00 con 0x7fe2a4101c50 2024-09-19T09:52:25.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/2364081173 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe28c0a32f0 msgr2=0x7fe28c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:25.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe28c0a32f0 0x7fe28c0a57b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4101ab0 tx=0x7fe29400b390 comp rx=0 tx=0).stop 2024-09-19T09:52:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/2364081173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a4101c50 msgr2=0x7fe2a4198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a4101c50 0x7fe2a4198340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe298009230 tx=0x7fe298031b60 comp rx=0 tx=0).stop 2024-09-19T09:52:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/2364081173 shutdown_connections 2024-09-19T09:52:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe28c0a32f0 0x7fe28c0a57b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2a4102610 0x7fe2a419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a4101c50 0x7fe2a4198340 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 --2- 172.21.15.18:0/2364081173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a4100a60 0x7fe2a4197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/2364081173 >> 172.21.15.18:0/2364081173 conn(0x7fe2a40fc1e0 msgr2=0x7fe2a40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/2364081173 shutdown_connections 2024-09-19T09:52:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:25.952+0000 7fe2a9e3c640 1 -- 172.21.15.18:0/2364081173 wait complete. 2024-09-19T09:52:25.968 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T09:52:25.978 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T09:52:25.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:52:26.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.099+0000 7f1c139b0640 1 -- 172.21.15.18:0/3401097581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c0c102590 msgr2=0x7f1c0c104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.099+0000 7f1c139b0640 1 --2- 172.21.15.18:0/3401097581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c0c102590 0x7f1c0c104980 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009900 tx=0x7f1c0402a410 comp rx=0 tx=0).stop 2024-09-19T09:52:26.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.099+0000 7f1c139b0640 1 -- 172.21.15.18:0/3401097581 shutdown_connections 2024-09-19T09:52:26.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.099+0000 7f1c139b0640 1 --2- 172.21.15.18:0/3401097581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c0c1077f0 0x7f1c0c109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.099+0000 7f1c139b0640 1 --2- 172.21.15.18:0/3401097581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0c104ec0 0x7f1c0c1072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.099+0000 7f1c139b0640 1 --2- 172.21.15.18:0/3401097581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c0c102590 0x7f1c0c104980 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.099+0000 7f1c139b0640 1 -- 172.21.15.18:0/3401097581 >> 172.21.15.18:0/3401097581 conn(0x7f1c0c0fc170 msgr2=0x7f1c0c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:26.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.099+0000 7f1c139b0640 1 -- 172.21.15.18:0/3401097581 shutdown_connections 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.099+0000 7f1c139b0640 1 -- 172.21.15.18:0/3401097581 wait complete. 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c139b0640 1 Processor -- start 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c139b0640 1 -- start start 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c139b0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0c102590 0x7f1c0c101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c139b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c0c104ec0 0x7f1c0c100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c139b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c0c1077f0 0x7f1c0c100a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c139b0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c10d7d0 con 0x7f1c0c1077f0 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c139b0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c10d650 con 0x7f1c0c102590 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c139b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c10d950 con 0x7f1c0c104ec0 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c11f4d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c0c1077f0 0x7f1c0c100a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c11f4d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c0c1077f0 0x7f1c0c100a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55802/0 (socket says 172.21.15.18:55802) 2024-09-19T09:52:26.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c11f4d640 1 -- 172.21.15.18:0/470332992 learned_addr learned my addr 172.21.15.18:0/470332992 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c10f4b640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c0c104ec0 0x7f1c0c100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c1174c640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0c102590 0x7f1c0c101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c11f4d640 1 -- 172.21.15.18:0/470332992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c0c104ec0 msgr2=0x7f1c0c100540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c11f4d640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c0c104ec0 0x7f1c0c100540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c11f4d640 1 -- 172.21.15.18:0/470332992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0c102590 msgr2=0x7f1c0c101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c11f4d640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0c102590 0x7f1c0c101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.100+0000 7f1c11f4d640 1 -- 172.21.15.18:0/470332992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0c101310 con 0x7f1c0c1077f0 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.101+0000 7f1c11f4d640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c0c1077f0 0x7f1c0c100a80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00e9d0 tx=0x7f1bfc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.101+0000 7f1c0a7fc640 1 -- 172.21.15.18:0/470332992 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00cd80 con 0x7f1c0c1077f0 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.101+0000 7f1c0a7fc640 1 -- 172.21.15.18:0/470332992 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bfc005020 con 0x7f1c0c1077f0 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.101+0000 7f1c139b0640 1 -- 172.21.15.18:0/470332992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c0c1a1fb0 con 0x7f1c0c1077f0 2024-09-19T09:52:26.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.101+0000 7f1c0a7fc640 1 -- 172.21.15.18:0/470332992 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0116d0 con 0x7f1c0c1077f0 2024-09-19T09:52:26.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.101+0000 7f1c139b0640 1 -- 172.21.15.18:0/470332992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c0c1a23c0 con 0x7f1c0c1077f0 2024-09-19T09:52:26.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.102+0000 7f1c139b0640 1 -- 172.21.15.18:0/470332992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c0c0fdc60 con 0x7f1c0c1077f0 2024-09-19T09:52:26.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.103+0000 7f1c0a7fc640 1 -- 172.21.15.18:0/470332992 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1bfc0051d0 con 0x7f1c0c1077f0 2024-09-19T09:52:26.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.104+0000 7f1c0a7fc640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1bf40a3250 0x7f1bf40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.104+0000 7f1c1174c640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1bf40a3250 0x7f1bf40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.104+0000 7f1c0a7fc640 1 -- 172.21.15.18:0/470332992 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1bfc0cfd90 con 0x7f1c0c1077f0 2024-09-19T09:52:26.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.104+0000 7f1c1174c640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1bf40a3250 0x7f1bf40a5710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c040314e0 tx=0x7f1c04000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.107+0000 7f1c0a7fc640 1 -- 172.21.15.18:0/470332992 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1bfc016030 con 0x7f1c0c1077f0 2024-09-19T09:52:26.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.287+0000 7f1c139b0640 1 -- 172.21.15.18:0/470332992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c0c062e90 con 0x7f1c0c1077f0 2024-09-19T09:52:26.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.288+0000 7f1c0a7fc640 1 -- 172.21.15.18:0/470332992 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22571 (secure 0 0 0) 0x7f1bfc09c490 con 0x7f1c0c1077f0 2024-09-19T09:52:26.290 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:26.291 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:51:31.811334+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:52:26.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 -- 172.21.15.18:0/470332992 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1bf40a3250 msgr2=0x7f1bf40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1bf40a3250 0x7f1bf40a5710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c040314e0 tx=0x7f1c04000bc0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 -- 172.21.15.18:0/470332992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c0c1077f0 msgr2=0x7f1c0c100a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c0c1077f0 0x7f1c0c100a80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00e9d0 tx=0x7f1bfc00ee90 comp rx=0 tx=0).stop 2024-09-19T09:52:26.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 -- 172.21.15.18:0/470332992 shutdown_connections 2024-09-19T09:52:26.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1bf40a3250 0x7f1bf40a5710 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c0c1077f0 0x7f1c0c100a80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c0c104ec0 0x7f1c0c100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 --2- 172.21.15.18:0/470332992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c0c102590 0x7f1c0c101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 -- 172.21.15.18:0/470332992 >> 172.21.15.18:0/470332992 conn(0x7f1c0c0fc170 msgr2=0x7f1c0c102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:26.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.290+0000 7f1c139b0640 1 -- 172.21.15.18:0/470332992 shutdown_connections 2024-09-19T09:52:26.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.291+0000 7f1c139b0640 1 -- 172.21.15.18:0/470332992 wait complete. 2024-09-19T09:52:26.303 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:25 smithi018 ceph-mon[30956]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:52:26.303 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:25 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2364081173' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:52:26.304 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:45:52.767383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:50:25.894248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:50:28.299795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:52:26.305 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:52:26.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:25 smithi049 ceph-mon[34858]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:52:26.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:25 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2364081173' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 -- 172.21.15.18:0/4033359329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324104f30 msgr2=0x7fa324107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 --2- 172.21.15.18:0/4033359329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324104f30 0x7fa324107320 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009900 tx=0x7fa30c02a410 comp rx=0 tx=0).stop 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 -- 172.21.15.18:0/4033359329 shutdown_connections 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 --2- 172.21.15.18:0/4033359329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa324107860 0x7fa324109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 --2- 172.21.15.18:0/4033359329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324104f30 0x7fa324107320 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 --2- 172.21.15.18:0/4033359329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa324102600 0x7fa3241049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 -- 172.21.15.18:0/4033359329 >> 172.21.15.18:0/4033359329 conn(0x7fa3240fc140 msgr2=0x7fa3240fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 -- 172.21.15.18:0/4033359329 shutdown_connections 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 -- 172.21.15.18:0/4033359329 wait complete. 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 Processor -- start 2024-09-19T09:52:26.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 -- start start 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa324102600 0x7fa324197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.410+0000 7fa32a54b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa324104f30 0x7fa324198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa32a54b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324107860 0x7fa32419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa32a54b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa32410d7b0 con 0x7fa324107860 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa32a54b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa32410d630 con 0x7fa324104f30 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa32a54b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa32410d930 con 0x7fa324102600 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa328ae8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324107860 0x7fa32419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa328ae8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324107860 0x7fa32419f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55828/0 (socket says 172.21.15.18:55828) 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa328ae8640 1 -- 172.21.15.18:0/4256855995 learned_addr learned my addr 172.21.15.18:0/4256855995 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa31bfff640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa324104f30 0x7fa324198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa323fff640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa324102600 0x7fa324197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa328ae8640 1 -- 172.21.15.18:0/4256855995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa324102600 msgr2=0x7fa324197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa328ae8640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa324102600 0x7fa324197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa328ae8640 1 -- 172.21.15.18:0/4256855995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa324104f30 msgr2=0x7fa324198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa328ae8640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa324104f30 0x7fa324198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa328ae8640 1 -- 172.21.15.18:0/4256855995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32419fb40 con 0x7fa324107860 2024-09-19T09:52:26.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa31bfff640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa324104f30 0x7fa324198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:26.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa328ae8640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324107860 0x7fa32419f4d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00cab0 tx=0x7fa31c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa321ffb640 1 -- 172.21.15.18:0/4256855995 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c00ae20 con 0x7fa324107860 2024-09-19T09:52:26.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa321ffb640 1 -- 172.21.15.18:0/4256855995 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa31c00f930 con 0x7fa324107860 2024-09-19T09:52:26.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa321ffb640 1 -- 172.21.15.18:0/4256855995 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c018b80 con 0x7fa324107860 2024-09-19T09:52:26.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa32a54b640 1 -- 172.21.15.18:0/4256855995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32419fe30 con 0x7fa324107860 2024-09-19T09:52:26.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.411+0000 7fa32a54b640 1 -- 172.21.15.18:0/4256855995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3241a02a0 con 0x7fa324107860 2024-09-19T09:52:26.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:25 smithi162 ceph-mon[35174]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T09:52:26.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:25 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2364081173' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:52:26.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.412+0000 7fa32a54b640 1 -- 172.21.15.18:0/4256855995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3240fdc30 con 0x7fa324107860 2024-09-19T09:52:26.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.414+0000 7fa321ffb640 1 -- 172.21.15.18:0/4256855995 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa31c00fae0 con 0x7fa324107860 2024-09-19T09:52:26.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.414+0000 7fa321ffb640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3100a3250 0x7fa3100a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.414+0000 7fa321ffb640 1 -- 172.21.15.18:0/4256855995 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa31c0d0100 con 0x7fa324107860 2024-09-19T09:52:26.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.414+0000 7fa323fff640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3100a3250 0x7fa3100a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.415+0000 7fa323fff640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3100a3250 0x7fa3100a5710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa314005fd0 tx=0x7fa314005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.418+0000 7fa321ffb640 1 -- 172.21.15.18:0/4256855995 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa31c014030 con 0x7fa324107860 2024-09-19T09:52:26.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.595+0000 7fa32a54b640 1 -- 172.21.15.18:0/4256855995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa324062e90 con 0x7fa324107860 2024-09-19T09:52:26.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.595+0000 7fa321ffb640 1 -- 172.21.15.18:0/4256855995 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7fa31c09cdf0 con 0x7fa324107860 2024-09-19T09:52:26.597 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:52:26.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 -- 172.21.15.18:0/4256855995 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3100a3250 msgr2=0x7fa3100a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3100a3250 0x7fa3100a5710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa314005fd0 tx=0x7fa314005850 comp rx=0 tx=0).stop 2024-09-19T09:52:26.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 -- 172.21.15.18:0/4256855995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324107860 msgr2=0x7fa32419f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324107860 0x7fa32419f4d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00cab0 tx=0x7fa31c00cf70 comp rx=0 tx=0).stop 2024-09-19T09:52:26.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 -- 172.21.15.18:0/4256855995 shutdown_connections 2024-09-19T09:52:26.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3100a3250 0x7fa3100a5710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa324107860 0x7fa32419f4d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa324104f30 0x7fa324198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 --2- 172.21.15.18:0/4256855995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa324102600 0x7fa324197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 -- 172.21.15.18:0/4256855995 >> 172.21.15.18:0/4256855995 conn(0x7fa3240fc140 msgr2=0x7fa324103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:26.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 -- 172.21.15.18:0/4256855995 shutdown_connections 2024-09-19T09:52:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.597+0000 7fa32a54b640 1 -- 172.21.15.18:0/4256855995 wait complete. 2024-09-19T09:52:26.611 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:52:26.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.715+0000 7f2600f6f640 1 -- 172.21.15.18:0/2566385406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc1025b0 msgr2=0x7f25fc1049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.715+0000 7f2600f6f640 1 --2- 172.21.15.18:0/2566385406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc1025b0 0x7f25fc1049a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009900 tx=0x7f25f002a410 comp rx=0 tx=0).stop 2024-09-19T09:52:26.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.715+0000 7f2600f6f640 1 -- 172.21.15.18:0/2566385406 shutdown_connections 2024-09-19T09:52:26.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.715+0000 7f2600f6f640 1 --2- 172.21.15.18:0/2566385406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25fc107810 0x7f25fc109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.715+0000 7f2600f6f640 1 --2- 172.21.15.18:0/2566385406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25fc104ee0 0x7f25fc1072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.715+0000 7f2600f6f640 1 --2- 172.21.15.18:0/2566385406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc1025b0 0x7f25fc1049a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.715+0000 7f2600f6f640 1 -- 172.21.15.18:0/2566385406 >> 172.21.15.18:0/2566385406 conn(0x7f25fc0fc1b0 msgr2=0x7f25fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:26.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.715+0000 7f2600f6f640 1 -- 172.21.15.18:0/2566385406 shutdown_connections 2024-09-19T09:52:26.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.715+0000 7f2600f6f640 1 -- 172.21.15.18:0/2566385406 wait complete. 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.716+0000 7f2600f6f640 1 Processor -- start 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.716+0000 7f2600f6f640 1 -- start start 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.716+0000 7f2600f6f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25fc1025b0 0x7f25fc197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.716+0000 7f2600f6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc104ee0 0x7f25fc1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.716+0000 7f2600f6f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25fc107810 0x7f25fc19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.716+0000 7f2600f6f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc10d7f0 con 0x7f25fc104ee0 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.716+0000 7f2600f6f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc10d670 con 0x7f25fc1025b0 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.716+0000 7f2600f6f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc10d970 con 0x7f25fc107810 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25f9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc104ee0 0x7f25fc1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25f9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc104ee0 0x7f25fc1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39508/0 (socket says 172.21.15.18:39508) 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25f9d9b640 1 -- 172.21.15.18:0/2193027361 learned_addr learned my addr 172.21.15.18:0/2193027361 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25fa59c640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25fc1025b0 0x7f25fc197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25fad9d640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25fc107810 0x7f25fc19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25f9d9b640 1 -- 172.21.15.18:0/2193027361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25fc107810 msgr2=0x7f25fc19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25f9d9b640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25fc107810 0x7f25fc19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25f9d9b640 1 -- 172.21.15.18:0/2193027361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25fc1025b0 msgr2=0x7f25fc197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25f9d9b640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25fc1025b0 0x7f25fc197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25f9d9b640 1 -- 172.21.15.18:0/2193027361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc19fad0 con 0x7f25fc104ee0 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25fad9d640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25fc107810 0x7f25fc19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25fa59c640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25fc1025b0 0x7f25fc197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25f9d9b640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc104ee0 0x7f25fc1983f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00c970 tx=0x7f25ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25eb7fe640 1 -- 172.21.15.18:0/2193027361 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec007bb0 con 0x7f25fc104ee0 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25eb7fe640 1 -- 172.21.15.18:0/2193027361 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25ec007d50 con 0x7f25fc104ee0 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f2600f6f640 1 -- 172.21.15.18:0/2193027361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25fc19fdc0 con 0x7f25fc104ee0 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f25eb7fe640 1 -- 172.21.15.18:0/2193027361 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00f450 con 0x7f25fc104ee0 2024-09-19T09:52:26.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.717+0000 7f2600f6f640 1 -- 172.21.15.18:0/2193027361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25fc1a0280 con 0x7f25fc104ee0 2024-09-19T09:52:26.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.718+0000 7f2600f6f640 1 -- 172.21.15.18:0/2193027361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25fc0fdca0 con 0x7f25fc104ee0 2024-09-19T09:52:26.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.719+0000 7f25eb7fe640 1 -- 172.21.15.18:0/2193027361 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f25ec0046c0 con 0x7f25fc104ee0 2024-09-19T09:52:26.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.720+0000 7f25eb7fe640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25e40a3250 0x7f25e40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:26.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.720+0000 7f25fa59c640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25e40a3250 0x7f25e40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:26.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.721+0000 7f25eb7fe640 1 -- 172.21.15.18:0/2193027361 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f25ec0cfa00 con 0x7f25fc104ee0 2024-09-19T09:52:26.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.721+0000 7f25fa59c640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25e40a3250 0x7f25e40a5710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f0009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:26.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.725+0000 7f25eb7fe640 1 -- 172.21.15.18:0/2193027361 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25ec014030 con 0x7f25fc104ee0 2024-09-19T09:52:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.901+0000 7f2600f6f640 1 -- 172.21.15.18:0/2193027361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f25fc062f30 con 0x7f25fc104ee0 2024-09-19T09:52:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.901+0000 7f25eb7fe640 1 -- 172.21.15.18:0/2193027361 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f25ec09c6f0 con 0x7f25fc104ee0 2024-09-19T09:52:26.903 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-19T09:52:26.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 -- 172.21.15.18:0/2193027361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25e40a3250 msgr2=0x7f25e40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25e40a3250 0x7f25e40a5710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f0009560 comp rx=0 tx=0).stop 2024-09-19T09:52:26.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 -- 172.21.15.18:0/2193027361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc104ee0 msgr2=0x7f25fc1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:26.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc104ee0 0x7f25fc1983f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00c970 tx=0x7f25ec00ce30 comp rx=0 tx=0).stop 2024-09-19T09:52:26.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 -- 172.21.15.18:0/2193027361 shutdown_connections 2024-09-19T09:52:26.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25e40a3250 0x7f25e40a5710 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25fc107810 0x7f25fc19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc104ee0 0x7f25fc1983f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 --2- 172.21.15.18:0/2193027361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25fc1025b0 0x7f25fc197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:26.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 -- 172.21.15.18:0/2193027361 >> 172.21.15.18:0/2193027361 conn(0x7f25fc0fc1b0 msgr2=0x7f25fc102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:26.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 -- 172.21.15.18:0/2193027361 shutdown_connections 2024-09-19T09:52:26.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:26.903+0000 7f2600f6f640 1 -- 172.21.15.18:0/2193027361 wait complete. 2024-09-19T09:52:26.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:52:27.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.023+0000 7f61636b7640 1 -- 172.21.15.18:0/3461730064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f615c1001b0 msgr2=0x7f615c1005b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.023+0000 7f61636b7640 1 --2- 172.21.15.18:0/3461730064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f615c1001b0 0x7f615c1005b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6158009900 tx=0x7f615802a410 comp rx=0 tx=0).stop 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 -- 172.21.15.18:0/3461730064 shutdown_connections 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 --2- 172.21.15.18:0/3461730064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c101d60 0x7f615c1085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 --2- 172.21.15.18:0/3461730064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f615c1013a0 0x7f615c101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 --2- 172.21.15.18:0/3461730064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f615c1001b0 0x7f615c1005b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 -- 172.21.15.18:0/3461730064 >> 172.21.15.18:0/3461730064 conn(0x7f615c0fb950 msgr2=0x7f615c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 -- 172.21.15.18:0/3461730064 shutdown_connections 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 -- 172.21.15.18:0/3461730064 wait complete. 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 Processor -- start 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 -- start start 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c1001b0 0x7f615c109b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f615c1013a0 0x7f615c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f615c101d60 0x7f615c19f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f615c10c6f0 con 0x7f615c1013a0 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f615c10c570 con 0x7f615c1001b0 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f61636b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f615c10c870 con 0x7f615c101d60 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.024+0000 7f6160c52640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f615c1013a0 0x7f615c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f6160c52640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f615c1013a0 0x7f615c19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39528/0 (socket says 172.21.15.18:39528) 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f6160c52640 1 -- 172.21.15.18:0/2301492029 learned_addr learned my addr 172.21.15.18:0/2301492029 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f6161453640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c1001b0 0x7f615c109b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f6161c54640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f615c101d60 0x7f615c19f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f6160c52640 1 -- 172.21.15.18:0/2301492029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f615c101d60 msgr2=0x7f615c19f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f6160c52640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f615c101d60 0x7f615c19f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f6160c52640 1 -- 172.21.15.18:0/2301492029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c1001b0 msgr2=0x7f615c109b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f6160c52640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c1001b0 0x7f615c109b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f6160c52640 1 -- 172.21.15.18:0/2301492029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615c19fba0 con 0x7f615c1013a0 2024-09-19T09:52:27.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f6160c52640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f615c1013a0 0x7f615c19cc70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f614c00d770 tx=0x7f614c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f61527fc640 1 -- 172.21.15.18:0/2301492029 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c017070 con 0x7f615c1013a0 2024-09-19T09:52:27.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f61527fc640 1 -- 172.21.15.18:0/2301492029 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f614c005500 con 0x7f615c1013a0 2024-09-19T09:52:27.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f61636b7640 1 -- 172.21.15.18:0/2301492029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615c19fe30 con 0x7f615c1013a0 2024-09-19T09:52:27.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f61527fc640 1 -- 172.21.15.18:0/2301492029 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c004e00 con 0x7f615c1013a0 2024-09-19T09:52:27.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.025+0000 7f61636b7640 1 -- 172.21.15.18:0/2301492029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f615c1a02a0 con 0x7f615c1013a0 2024-09-19T09:52:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.026+0000 7f61636b7640 1 -- 172.21.15.18:0/2301492029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615c107640 con 0x7f615c1013a0 2024-09-19T09:52:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.027+0000 7f61527fc640 1 -- 172.21.15.18:0/2301492029 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f614c004fa0 con 0x7f615c1013a0 2024-09-19T09:52:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.028+0000 7f61527fc640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61480a3250 0x7f61480a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.028+0000 7f61527fc640 1 -- 172.21.15.18:0/2301492029 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f614c0cf310 con 0x7f615c1013a0 2024-09-19T09:52:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.028+0000 7f6161453640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61480a3250 0x7f61480a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.029+0000 7f6161453640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61480a3250 0x7f61480a5710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6158009230 tx=0x7f61580315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.032+0000 7f61527fc640 1 -- 172.21.15.18:0/2301492029 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f614c09c060 con 0x7f615c1013a0 2024-09-19T09:52:27.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.207+0000 7f61636b7640 1 -- 172.21.15.18:0/2301492029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f615c062e90 con 0x7f615c1013a0 2024-09-19T09:52:27.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.207+0000 7f61527fc640 1 -- 172.21.15.18:0/2301492029 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f614c09b960 con 0x7f615c1013a0 2024-09-19T09:52:27.209 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-19T09:52:27.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 -- 172.21.15.18:0/2301492029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61480a3250 msgr2=0x7f61480a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61480a3250 0x7f61480a5710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6158009230 tx=0x7f61580315b0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 -- 172.21.15.18:0/2301492029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f615c1013a0 msgr2=0x7f615c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f615c1013a0 0x7f615c19cc70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f614c00d770 tx=0x7f614c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:52:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 -- 172.21.15.18:0/2301492029 shutdown_connections 2024-09-19T09:52:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61480a3250 0x7f61480a5710 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f615c101d60 0x7f615c19f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f615c1013a0 0x7f615c19cc70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 --2- 172.21.15.18:0/2301492029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f615c1001b0 0x7f615c109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 -- 172.21.15.18:0/2301492029 >> 172.21.15.18:0/2301492029 conn(0x7f615c0fb950 msgr2=0x7f615c104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 -- 172.21.15.18:0/2301492029 shutdown_connections 2024-09-19T09:52:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.209+0000 7f61636b7640 1 -- 172.21.15.18:0/2301492029 wait complete. 2024-09-19T09:52:27.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2364081173' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:52:27.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:26 smithi018 ceph-mon[30956]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:52:27.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/470332992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:27.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4256855995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:52:27.221 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2193027361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:52:27.222 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T09:52:27.222 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:52:27.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:26 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2364081173' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:52:27.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:26 smithi049 ceph-mon[34858]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:52:27.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:26 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/470332992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:27.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:26 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/4256855995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:52:27.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:26 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2193027361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:52:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:26 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2364081173' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:52:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:26 smithi162 ceph-mon[35174]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:52:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:26 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/470332992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:26 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/4256855995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:52:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:26 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2193027361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:52:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.913+0000 7fb3665af640 1 -- 172.21.15.18:0/4022011077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb360102d30 msgr2=0x7fb360103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.913+0000 7fb3665af640 1 --2- 172.21.15.18:0/4022011077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb360102d30 0x7fb360103110 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb350009930 tx=0x7fb35002a420 comp rx=0 tx=0).stop 2024-09-19T09:52:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.913+0000 7fb3665af640 1 -- 172.21.15.18:0/4022011077 shutdown_connections 2024-09-19T09:52:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.913+0000 7fb3665af640 1 --2- 172.21.15.18:0/4022011077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3601082a0 0x7fb36010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.913+0000 7fb3665af640 1 --2- 172.21.15.18:0/4022011077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3601036e0 0x7fb360107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.913+0000 7fb3665af640 1 --2- 172.21.15.18:0/4022011077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb360102d30 0x7fb360103110 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.913+0000 7fb3665af640 1 -- 172.21.15.18:0/4022011077 >> 172.21.15.18:0/4022011077 conn(0x7fb3600fc7d0 msgr2=0x7fb3600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.913+0000 7fb3665af640 1 -- 172.21.15.18:0/4022011077 shutdown_connections 2024-09-19T09:52:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.913+0000 7fb3665af640 1 -- 172.21.15.18:0/4022011077 wait complete. 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb3665af640 1 Processor -- start 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb3665af640 1 -- start start 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb3665af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb360102d30 0x7fb360100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb3665af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3601036e0 0x7fb360100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb3665af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3601082a0 0x7fb360101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb3665af640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3601120a0 con 0x7fb360102d30 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb3665af640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb360111f20 con 0x7fb3601082a0 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb3665af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb360112220 con 0x7fb3601036e0 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb35ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb360102d30 0x7fb360100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb35ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb360102d30 0x7fb360100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39538/0 (socket says 172.21.15.18:39538) 2024-09-19T09:52:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb35ffff640 1 -- 172.21.15.18:0/3728314466 learned_addr learned my addr 172.21.15.18:0/3728314466 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.914+0000 7fb364b4c640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3601082a0 0x7fb360101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb35ffff640 1 -- 172.21.15.18:0/3728314466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3601036e0 msgr2=0x7fb360100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb35ffff640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3601036e0 0x7fb360100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb35ffff640 1 -- 172.21.15.18:0/3728314466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3601082a0 msgr2=0x7fb360101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb35ffff640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3601082a0 0x7fb360101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb35ffff640 1 -- 172.21.15.18:0/3728314466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3601a69e0 con 0x7fb360102d30 2024-09-19T09:52:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb35ffff640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb360102d30 0x7fb360100990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb350009a50 tx=0x7fb350004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb35d7fa640 1 -- 172.21.15.18:0/3728314466 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35003f030 con 0x7fb360102d30 2024-09-19T09:52:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb3665af640 1 -- 172.21.15.18:0/3728314466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3601a6c70 con 0x7fb360102d30 2024-09-19T09:52:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb35d7fa640 1 -- 172.21.15.18:0/3728314466 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb350003ce0 con 0x7fb360102d30 2024-09-19T09:52:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb35d7fa640 1 -- 172.21.15.18:0/3728314466 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350035070 con 0x7fb360102d30 2024-09-19T09:52:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.915+0000 7fb3665af640 1 -- 172.21.15.18:0/3728314466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3601a71a0 con 0x7fb360102d30 2024-09-19T09:52:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.916+0000 7fb3665af640 1 -- 172.21.15.18:0/3728314466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb360103110 con 0x7fb360102d30 2024-09-19T09:52:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.918+0000 7fb35d7fa640 1 -- 172.21.15.18:0/3728314466 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb350042030 con 0x7fb360102d30 2024-09-19T09:52:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.918+0000 7fb35d7fa640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb3480a3240 0x7fb3480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.918+0000 7fb35d7fa640 1 -- 172.21.15.18:0/3728314466 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb3500eff30 con 0x7fb360102d30 2024-09-19T09:52:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.918+0000 7fb35f7fe640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb3480a3240 0x7fb3480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.919+0000 7fb35f7fe640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb3480a3240 0x7fb3480a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb360102420 tx=0x7fb354005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:27.921+0000 7fb35d7fa640 1 -- 172.21.15.18:0/3728314466 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb3500bcc20 con 0x7fb360102d30 2024-09-19T09:52:28.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:27 smithi018 ceph-mon[30956]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T09:52:28.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:27 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2301492029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:52:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.136+0000 7fb3665af640 1 -- 172.21.15.18:0/3728314466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3601a7430 con 0x7fb360102d30 2024-09-19T09:52:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.137+0000 7fb35d7fa640 1 -- 172.21.15.18:0/3728314466 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fb3500bc520 con 0x7fb360102d30 2024-09-19T09:52:28.139 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:28.139 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:52:28.139 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:52:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 -- 172.21.15.18:0/3728314466 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb3480a3240 msgr2=0x7fb3480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb3480a3240 0x7fb3480a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb360102420 tx=0x7fb354005bf0 comp rx=0 tx=0).stop 2024-09-19T09:52:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 -- 172.21.15.18:0/3728314466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb360102d30 msgr2=0x7fb360100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb360102d30 0x7fb360100990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb350009a50 tx=0x7fb350004270 comp rx=0 tx=0).stop 2024-09-19T09:52:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 -- 172.21.15.18:0/3728314466 shutdown_connections 2024-09-19T09:52:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb3480a3240 0x7fb3480a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3601082a0 0x7fb360101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3601036e0 0x7fb360100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 --2- 172.21.15.18:0/3728314466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb360102d30 0x7fb360100990 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 -- 172.21.15.18:0/3728314466 >> 172.21.15.18:0/3728314466 conn(0x7fb3600fc7d0 msgr2=0x7fb360105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:28.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 -- 172.21.15.18:0/3728314466 shutdown_connections 2024-09-19T09:52:28.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:28.139+0000 7fb3665af640 1 -- 172.21.15.18:0/3728314466 wait complete. 2024-09-19T09:52:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:27 smithi049 ceph-mon[34858]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T09:52:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:27 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2301492029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:52:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:27 smithi162 ceph-mon[35174]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T09:52:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:27 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2301492029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:52:28.907 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T09:52:28.907 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T09:52:28.907 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:52:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.015+0000 7f25e944c640 1 -- 172.21.15.18:0/2420056522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4104ec0 msgr2=0x7f25e41072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.015+0000 7f25e944c640 1 --2- 172.21.15.18:0/2420056522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4104ec0 0x7f25e41072b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009900 tx=0x7f25d802a410 comp rx=0 tx=0).stop 2024-09-19T09:52:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.015+0000 7f25e944c640 1 -- 172.21.15.18:0/2420056522 shutdown_connections 2024-09-19T09:52:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.015+0000 7f25e944c640 1 --2- 172.21.15.18:0/2420056522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e41077f0 0x7f25e4109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.015+0000 7f25e944c640 1 --2- 172.21.15.18:0/2420056522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4104ec0 0x7f25e41072b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.015+0000 7f25e944c640 1 --2- 172.21.15.18:0/2420056522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4102590 0x7f25e4104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.015+0000 7f25e944c640 1 -- 172.21.15.18:0/2420056522 >> 172.21.15.18:0/2420056522 conn(0x7f25e40fc170 msgr2=0x7f25e40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.015+0000 7f25e944c640 1 -- 172.21.15.18:0/2420056522 shutdown_connections 2024-09-19T09:52:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.015+0000 7f25e944c640 1 -- 172.21.15.18:0/2420056522 wait complete. 2024-09-19T09:52:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.015+0000 7f25e944c640 1 Processor -- start 2024-09-19T09:52:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e944c640 1 -- start start 2024-09-19T09:52:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e944c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4102590 0x7f25e4197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e944c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4104ec0 0x7f25e4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e944c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e41077f0 0x7f25e419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e944c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25e410d7c0 con 0x7f25e4104ec0 2024-09-19T09:52:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e944c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f25e410d640 con 0x7f25e41077f0 2024-09-19T09:52:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e944c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f25e410d940 con 0x7f25e4102590 2024-09-19T09:52:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4104ec0 0x7f25e4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4104ec0 0x7f25e4198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39560/0 (socket says 172.21.15.18:39560) 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e27fc640 1 -- 172.21.15.18:0/1030681130 learned_addr learned my addr 172.21.15.18:0/1030681130 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e37fe640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e41077f0 0x7f25e419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e2ffd640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4102590 0x7f25e4197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e27fc640 1 -- 172.21.15.18:0/1030681130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4102590 msgr2=0x7f25e4197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e27fc640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4102590 0x7f25e4197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e27fc640 1 -- 172.21.15.18:0/1030681130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e41077f0 msgr2=0x7f25e419f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e27fc640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e41077f0 0x7f25e419f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e27fc640 1 -- 172.21.15.18:0/1030681130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e419fb20 con 0x7f25e4104ec0 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e2ffd640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4102590 0x7f25e4197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.016+0000 7f25e27fc640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4104ec0 0x7f25e4198440 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f25d8031610 tx=0x7f25d80043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.017+0000 7f25cbfff640 1 -- 172.21.15.18:0/1030681130 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d803f030 con 0x7f25e4104ec0 2024-09-19T09:52:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.017+0000 7f25e944c640 1 -- 172.21.15.18:0/1030681130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e419fdb0 con 0x7f25e4104ec0 2024-09-19T09:52:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.017+0000 7f25cbfff640 1 -- 172.21.15.18:0/1030681130 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25d8003ce0 con 0x7f25e4104ec0 2024-09-19T09:52:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.017+0000 7f25cbfff640 1 -- 172.21.15.18:0/1030681130 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d8035070 con 0x7f25e4104ec0 2024-09-19T09:52:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.017+0000 7f25e944c640 1 -- 172.21.15.18:0/1030681130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e41a0240 con 0x7f25e4104ec0 2024-09-19T09:52:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.018+0000 7f25e944c640 1 -- 172.21.15.18:0/1030681130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e40fdc60 con 0x7f25e4104ec0 2024-09-19T09:52:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.019+0000 7f25cbfff640 1 -- 172.21.15.18:0/1030681130 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f25d8042030 con 0x7f25e4104ec0 2024-09-19T09:52:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.020+0000 7f25cbfff640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25cc0a3250 0x7f25cc0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.020+0000 7f25e2ffd640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25cc0a3250 0x7f25cc0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.020+0000 7f25cbfff640 1 -- 172.21.15.18:0/1030681130 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f25d80efee0 con 0x7f25e4104ec0 2024-09-19T09:52:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.021+0000 7f25e2ffd640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25cc0a3250 0x7f25cc0a5710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25d4005c40 tx=0x7f25d400a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:29.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.024+0000 7f25cbfff640 1 -- 172.21.15.18:0/1030681130 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25d80bcbd0 con 0x7f25e4104ec0 2024-09-19T09:52:29.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:28 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3728314466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:29.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.196+0000 7f25e944c640 1 -- 172.21.15.18:0/1030681130 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25e4062630 con 0x7f25cc0a3250 2024-09-19T09:52:29.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.203+0000 7f25cbfff640 1 -- 172.21.15.18:0/1030681130 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258870 (secure 0 0 0) 0x7f25e4062630 con 0x7f25cc0a3250 2024-09-19T09:52:29.207 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:29.209 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:52:29.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 -- 172.21.15.18:0/1030681130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25cc0a3250 msgr2=0x7f25cc0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25cc0a3250 0x7f25cc0a5710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25d4005c40 tx=0x7f25d400a410 comp rx=0 tx=0).stop 2024-09-19T09:52:29.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 -- 172.21.15.18:0/1030681130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4104ec0 msgr2=0x7f25e4198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4104ec0 0x7f25e4198440 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f25d8031610 tx=0x7f25d80043b0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 -- 172.21.15.18:0/1030681130 shutdown_connections 2024-09-19T09:52:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f25cc0a3250 0x7f25cc0a5710 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e41077f0 0x7f25e419f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4104ec0 0x7f25e4198440 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 --2- 172.21.15.18:0/1030681130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4102590 0x7f25e4197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 -- 172.21.15.18:0/1030681130 >> 172.21.15.18:0/1030681130 conn(0x7f25e40fc170 msgr2=0x7f25e4102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 -- 172.21.15.18:0/1030681130 shutdown_connections 2024-09-19T09:52:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.206+0000 7f25e944c640 1 -- 172.21.15.18:0/1030681130 wait complete. 2024-09-19T09:52:29.219 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-19T09:52:28.377769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658960,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1215,"num_read_kb":727,"num_write":436,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374660,"kb_used_data":12932,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567164,"statfs":{"total":1151940427776,"available":1151556775936,"internally_reserved":0,"allocated":13242368,"data_stored":7285276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":50,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003351"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372723+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:52:00.372723+0000","last_peered":"2024-09-19T09:52:00.372723+0000","last_clean":"2024-09-19T09:52:00.372723+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:52:00.372723+0000","last_undegraded":"2024-09-19T09:52:00.372723+0000","last_fullsized":"2024-09-19T09:52:00.372723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360023+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:52:00.360023+0000","last_peered":"2024-09-19T09:52:00.360023+0000","last_clean":"2024-09-19T09:52:00.360023+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:52:00.360023+0000","last_undegraded":"2024-09-19T09:52:00.360023+0000","last_fullsized":"2024-09-19T09:52:00.360023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373218+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:52:00.373218+0000","last_peered":"2024-09-19T09:52:00.373218+0000","last_clean":"2024-09-19T09:52:00.373218+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:52:00.373218+0000","last_undegraded":"2024-09-19T09:52:00.373218+0000","last_fullsized":"2024-09-19T09:52:00.373218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362542+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:52:00.362542+0000","last_peered":"2024-09-19T09:52:00.362542+0000","last_clean":"2024-09-19T09:52:00.362542+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:52:00.362542+0000","last_undegraded":"2024-09-19T09:52:00.362542+0000","last_fullsized":"2024-09-19T09:52:00.362542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.335091+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:52:00.335091+0000","last_peered":"2024-09-19T09:52:00.335091+0000","last_clean":"2024-09-19T09:52:00.335091+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:52:00.335091+0000","last_undegraded":"2024-09-19T09:52:00.335091+0000","last_fullsized":"2024-09-19T09:52:00.335091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359516+0000","last_change":"2024-09-19T09:51:31.818907+0000","last_active":"2024-09-19T09:52:00.359516+0000","last_peered":"2024-09-19T09:52:00.359516+0000","last_clean":"2024-09-19T09:52:00.359516+0000","last_became_active":"2024-09-19T09:51:31.818522+0000","last_became_peered":"2024-09-19T09:51:31.818522+0000","last_unstale":"2024-09-19T09:52:00.359516+0000","last_undegraded":"2024-09-19T09:52:00.359516+0000","last_fullsized":"2024-09-19T09:52:00.359516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:04.062704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365337+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:52:00.365337+0000","last_peered":"2024-09-19T09:52:00.365337+0000","last_clean":"2024-09-19T09:52:00.365337+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:52:00.365337+0000","last_undegraded":"2024-09-19T09:52:00.365337+0000","last_fullsized":"2024-09-19T09:52:00.365337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358908+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:52:00.358908+0000","last_peered":"2024-09-19T09:52:00.358908+0000","last_clean":"2024-09-19T09:52:00.358908+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:52:00.358908+0000","last_undegraded":"2024-09-19T09:52:00.358908+0000","last_fullsized":"2024-09-19T09:52:00.358908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370979+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:52:00.370979+0000","last_peered":"2024-09-19T09:52:00.370979+0000","last_clean":"2024-09-19T09:52:00.370979+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:52:00.370979+0000","last_undegraded":"2024-09-19T09:52:00.370979+0000","last_fullsized":"2024-09-19T09:52:00.370979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364519+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:52:00.364519+0000","last_peered":"2024-09-19T09:52:00.364519+0000","last_clean":"2024-09-19T09:52:00.364519+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:52:00.364519+0000","last_undegraded":"2024-09-19T09:52:00.364519+0000","last_fullsized":"2024-09-19T09:52:00.364519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.368226+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:52:00.368226+0000","last_peered":"2024-09-19T09:52:00.368226+0000","last_clean":"2024-09-19T09:52:00.368226+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:52:00.368226+0000","last_undegraded":"2024-09-19T09:52:00.368226+0000","last_fullsized":"2024-09-19T09:52:00.368226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362431+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:52:00.362431+0000","last_peered":"2024-09-19T09:52:00.362431+0000","last_clean":"2024-09-19T09:52:00.362431+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:52:00.362431+0000","last_undegraded":"2024-09-19T09:52:00.362431+0000","last_fullsized":"2024-09-19T09:52:00.362431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351092+0000","last_change":"2024-09-19T09:51:31.818910+0000","last_active":"2024-09-19T09:52:00.351092+0000","last_peered":"2024-09-19T09:52:00.351092+0000","last_clean":"2024-09-19T09:52:00.351092+0000","last_became_active":"2024-09-19T09:51:31.818581+0000","last_became_peered":"2024-09-19T09:51:31.818581+0000","last_unstale":"2024-09-19T09:52:00.351092+0000","last_undegraded":"2024-09-19T09:52:00.351092+0000","last_fullsized":"2024-09-19T09:52:00.351092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.736835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365871+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:52:00.365871+0000","last_peered":"2024-09-19T09:52:00.365871+0000","last_clean":"2024-09-19T09:52:00.365871+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:52:00.365871+0000","last_undegraded":"2024-09-19T09:52:00.365871+0000","last_fullsized":"2024-09-19T09:52:00.365871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361631+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:52:00.361631+0000","last_peered":"2024-09-19T09:52:00.361631+0000","last_clean":"2024-09-19T09:52:00.361631+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:52:00.361631+0000","last_undegraded":"2024-09-19T09:52:00.361631+0000","last_fullsized":"2024-09-19T09:52:00.361631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372654+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:52:00.372654+0000","last_peered":"2024-09-19T09:52:00.372654+0000","last_clean":"2024-09-19T09:52:00.372654+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:52:00.372654+0000","last_undegraded":"2024-09-19T09:52:00.372654+0000","last_fullsized":"2024-09-19T09:52:00.372654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373008+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:52:00.373008+0000","last_peered":"2024-09-19T09:52:00.373008+0000","last_clean":"2024-09-19T09:52:00.373008+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:52:00.373008+0000","last_undegraded":"2024-09-19T09:52:00.373008+0000","last_fullsized":"2024-09-19T09:52:00.373008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372768+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:52:00.372768+0000","last_peered":"2024-09-19T09:52:00.372768+0000","last_clean":"2024-09-19T09:52:00.372768+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:52:00.372768+0000","last_undegraded":"2024-09-19T09:52:00.372768+0000","last_fullsized":"2024-09-19T09:52:00.372768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.356302+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:52:00.356302+0000","last_peered":"2024-09-19T09:52:00.356302+0000","last_clean":"2024-09-19T09:52:00.356302+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:52:00.356302+0000","last_undegraded":"2024-09-19T09:52:00.356302+0000","last_fullsized":"2024-09-19T09:52:00.356302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351159+0000","last_change":"2024-09-19T09:51:31.823803+0000","last_active":"2024-09-19T09:52:00.351159+0000","last_peered":"2024-09-19T09:52:00.351159+0000","last_clean":"2024-09-19T09:52:00.351159+0000","last_became_active":"2024-09-19T09:51:31.823361+0000","last_became_peered":"2024-09-19T09:51:31.823361+0000","last_unstale":"2024-09-19T09:52:00.351159+0000","last_undegraded":"2024-09-19T09:52:00.351159+0000","last_fullsized":"2024-09-19T09:52:00.351159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:33.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364330+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:52:00.364330+0000","last_peered":"2024-09-19T09:52:00.364330+0000","last_clean":"2024-09-19T09:52:00.364330+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:52:00.364330+0000","last_undegraded":"2024-09-19T09:52:00.364330+0000","last_fullsized":"2024-09-19T09:52:00.364330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370710+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:52:00.370710+0000","last_peered":"2024-09-19T09:52:00.370710+0000","last_clean":"2024-09-19T09:52:00.370710+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:52:00.370710+0000","last_undegraded":"2024-09-19T09:52:00.370710+0000","last_fullsized":"2024-09-19T09:52:00.370710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358193+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:52:00.358193+0000","last_peered":"2024-09-19T09:52:00.358193+0000","last_clean":"2024-09-19T09:52:00.358193+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:52:00.358193+0000","last_undegraded":"2024-09-19T09:52:00.358193+0000","last_fullsized":"2024-09-19T09:52:00.358193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358828+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:52:00.358828+0000","last_peered":"2024-09-19T09:52:00.358828+0000","last_clean":"2024-09-19T09:52:00.358828+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:52:00.358828+0000","last_undegraded":"2024-09-19T09:52:00.358828+0000","last_fullsized":"2024-09-19T09:52:00.358828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.367256+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:52:00.367256+0000","last_peered":"2024-09-19T09:52:00.367256+0000","last_clean":"2024-09-19T09:52:00.367256+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:52:00.367256+0000","last_undegraded":"2024-09-19T09:52:00.367256+0000","last_fullsized":"2024-09-19T09:52:00.367256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.357344+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:52:00.357344+0000","last_peered":"2024-09-19T09:52:00.357344+0000","last_clean":"2024-09-19T09:52:00.357344+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:52:00.357344+0000","last_undegraded":"2024-09-19T09:52:00.357344+0000","last_fullsized":"2024-09-19T09:52:00.357344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351848+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:52:00.351848+0000","last_peered":"2024-09-19T09:52:00.351848+0000","last_clean":"2024-09-19T09:52:00.351848+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:52:00.351848+0000","last_undegraded":"2024-09-19T09:52:00.351848+0000","last_fullsized":"2024-09-19T09:52:00.351848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350260+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:52:00.350260+0000","last_peered":"2024-09-19T09:52:00.350260+0000","last_clean":"2024-09-19T09:52:00.350260+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:52:00.350260+0000","last_undegraded":"2024-09-19T09:52:00.350260+0000","last_fullsized":"2024-09-19T09:52:00.350260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361673+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:52:00.361673+0000","last_peered":"2024-09-19T09:52:00.361673+0000","last_clean":"2024-09-19T09:52:00.361673+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:52:00.361673+0000","last_undegraded":"2024-09-19T09:52:00.361673+0000","last_fullsized":"2024-09-19T09:52:00.361673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355490+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:52:00.355490+0000","last_peered":"2024-09-19T09:52:00.355490+0000","last_clean":"2024-09-19T09:52:00.355490+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:52:00.355490+0000","last_undegraded":"2024-09-19T09:52:00.355490+0000","last_fullsized":"2024-09-19T09:52:00.355490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361354+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:52:00.361354+0000","last_peered":"2024-09-19T09:52:00.361354+0000","last_clean":"2024-09-19T09:52:00.361354+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:52:00.361354+0000","last_undegraded":"2024-09-19T09:52:00.361354+0000","last_fullsized":"2024-09-19T09:52:00.361354+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353327+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:52:00.353327+0000","last_peered":"2024-09-19T09:52:00.353327+0000","last_clean":"2024-09-19T09:52:00.353327+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:52:00.353327+0000","last_undegraded":"2024-09-19T09:52:00.353327+0000","last_fullsized":"2024-09-19T09:52:00.353327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.345044+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:52:00.345044+0000","last_peered":"2024-09-19T09:52:00.345044+0000","last_clean":"2024-09-19T09:52:00.345044+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:52:00.345044+0000","last_undegraded":"2024-09-19T09:52:00.345044+0000","last_fullsized":"2024-09-19T09:52:00.345044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:26.489107+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:52:26.489107+0000","last_peered":"2024-09-19T09:52:26.489107+0000","last_clean":"2024-09-19T09:52:26.489107+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:52:26.489107+0000","last_undegraded":"2024-09-19T09:52:26.489107+0000","last_fullsized":"2024-09-19T09:52:26.489107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359507+0000","last_change":"2024-09-19T09:51:31.825618+0000","last_active":"2024-09-19T09:52:00.359507+0000","last_peered":"2024-09-19T09:52:00.359507+0000","last_clean":"2024-09-19T09:52:00.359507+0000","last_became_active":"2024-09-19T09:51:31.824727+0000","last_became_peered":"2024-09-19T09:51:31.824727+0000","last_unstale":"2024-09-19T09:52:00.359507+0000","last_undegraded":"2024-09-19T09:52:00.359507+0000","last_fullsized":"2024-09-19T09:52:00.359507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:52.094074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816210+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:51:31.816210+0000","last_peered":"2024-09-19T09:51:31.816210+0000","last_clean":"2024-09-19T09:51:31.816210+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:51:31.816210+0000","last_undegraded":"2024-09-19T09:51:31.816210+0000","last_fullsized":"2024-09-19T09:51:31.816210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814498+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:51:31.814498+0000","last_peered":"2024-09-19T09:51:31.814498+0000","last_clean":"2024-09-19T09:51:31.814498+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:51:31.814498+0000","last_undegraded":"2024-09-19T09:51:31.814498+0000","last_fullsized":"2024-09-19T09:51:31.814498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355727+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:52:00.355727+0000","last_peered":"2024-09-19T09:52:00.355727+0000","last_clean":"2024-09-19T09:52:00.355727+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.355727+0000","last_undegraded":"2024-09-19T09:52:00.355727+0000","last_fullsized":"2024-09-19T09:52:00.355727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815599+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:51:31.815599+0000","last_peered":"2024-09-19T09:51:31.815599+0000","last_clean":"2024-09-19T09:51:31.815599+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:51:31.815599+0000","last_undegraded":"2024-09-19T09:51:31.815599+0000","last_fullsized":"2024-09-19T09:51:31.815599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363759+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:52:00.363759+0000","last_peered":"2024-09-19T09:52:00.363759+0000","last_clean":"2024-09-19T09:52:00.363759+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:52:00.363759+0000","last_undegraded":"2024-09-19T09:52:00.363759+0000","last_fullsized":"2024-09-19T09:52:00.363759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":234,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:23.484062+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:52:23.484062+0000","last_peered":"2024-09-19T09:52:23.484062+0000","last_clean":"2024-09-19T09:52:23.484062+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:52:23.484062+0000","last_undegraded":"2024-09-19T09:52:23.484062+0000","last_fullsized":"2024-09-19T09:52:23.484062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373477+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:52:00.373477+0000","last_peered":"2024-09-19T09:52:00.373477+0000","last_clean":"2024-09-19T09:52:00.373477+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:52:00.373477+0000","last_undegraded":"2024-09-19T09:52:00.373477+0000","last_fullsized":"2024-09-19T09:52:00.373477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415018+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:51:32.415018+0000","last_peered":"2024-09-19T09:51:32.415018+0000","last_clean":"2024-09-19T09:51:32.415018+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:51:32.415018+0000","last_undegraded":"2024-09-19T09:51:32.415018+0000","last_fullsized":"2024-09-19T09:51:32.415018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361630+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:52:00.361630+0000","last_peered":"2024-09-19T09:52:00.361630+0000","last_clean":"2024-09-19T09:52:00.361630+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:52:00.361630+0000","last_undegraded":"2024-09-19T09:52:00.361630+0000","last_fullsized":"2024-09-19T09:52:00.361630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815716+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:51:31.815716+0000","last_peered":"2024-09-19T09:51:31.815716+0000","last_clean":"2024-09-19T09:51:31.815716+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:51:31.815716+0000","last_undegraded":"2024-09-19T09:51:31.815716+0000","last_fullsized":"2024-09-19T09:51:31.815716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373858+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:52:00.373858+0000","last_peered":"2024-09-19T09:52:00.373858+0000","last_clean":"2024-09-19T09:52:00.373858+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:52:00.373858+0000","last_undegraded":"2024-09-19T09:52:00.373858+0000","last_fullsized":"2024-09-19T09:52:00.373858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":272,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:23.484057+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:52:23.484057+0000","last_peered":"2024-09-19T09:52:23.484057+0000","last_clean":"2024-09-19T09:52:23.484057+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:52:23.484057+0000","last_undegraded":"2024-09-19T09:52:23.484057+0000","last_fullsized":"2024-09-19T09:52:23.484057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60868,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":217,"num_read_kb":168,"num_write":35,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363505+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:52:00.363505+0000","last_peered":"2024-09-19T09:52:00.363505+0000","last_clean":"2024-09-19T09:52:00.363505+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:52:00.363505+0000","last_undegraded":"2024-09-19T09:52:00.363505+0000","last_fullsized":"2024-09-19T09:52:00.363505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821655+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:51:31.821655+0000","last_peered":"2024-09-19T09:51:31.821655+0000","last_clean":"2024-09-19T09:51:31.821655+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:51:31.821655+0000","last_undegraded":"2024-09-19T09:51:31.821655+0000","last_fullsized":"2024-09-19T09:51:31.821655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363961+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:52:00.363961+0000","last_peered":"2024-09-19T09:52:00.363961+0000","last_clean":"2024-09-19T09:52:00.363961+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:52:00.363961+0000","last_undegraded":"2024-09-19T09:52:00.363961+0000","last_fullsized":"2024-09-19T09:52:00.363961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815497+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:31.815497+0000","last_peered":"2024-09-19T09:51:31.815497+0000","last_clean":"2024-09-19T09:51:31.815497+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:51:31.815497+0000","last_undegraded":"2024-09-19T09:51:31.815497+0000","last_fullsized":"2024-09-19T09:51:31.815497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369638+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:52:00.369638+0000","last_peered":"2024-09-19T09:52:00.369638+0000","last_clean":"2024-09-19T09:52:00.369638+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:52:00.369638+0000","last_undegraded":"2024-09-19T09:52:00.369638+0000","last_fullsized":"2024-09-19T09:52:00.369638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'7","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:22.479521+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:52:22.479521+0000","last_peered":"2024-09-19T09:52:22.479521+0000","last_clean":"2024-09-19T09:52:22.479521+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:52:22.479521+0000","last_undegraded":"2024-09-19T09:52:22.479521+0000","last_fullsized":"2024-09-19T09:52:22.479521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365299+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:52:00.365299+0000","last_peered":"2024-09-19T09:52:00.365299+0000","last_clean":"2024-09-19T09:52:00.365299+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:52:00.365299+0000","last_undegraded":"2024-09-19T09:52:00.365299+0000","last_fullsized":"2024-09-19T09:52:00.365299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821556+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:51:31.821556+0000","last_peered":"2024-09-19T09:51:31.821556+0000","last_clean":"2024-09-19T09:51:31.821556+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:51:31.821556+0000","last_undegraded":"2024-09-19T09:51:31.821556+0000","last_fullsized":"2024-09-19T09:51:31.821556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359861+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:52:00.359861+0000","last_peered":"2024-09-19T09:52:00.359861+0000","last_clean":"2024-09-19T09:52:00.359861+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:52:00.359861+0000","last_undegraded":"2024-09-19T09:52:00.359861+0000","last_fullsized":"2024-09-19T09:52:00.359861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822551+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:51:31.822551+0000","last_peered":"2024-09-19T09:51:31.822551+0000","last_clean":"2024-09-19T09:51:31.822551+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:51:31.822551+0000","last_undegraded":"2024-09-19T09:51:31.822551+0000","last_fullsized":"2024-09-19T09:51:31.822551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.352459+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:52:00.352459+0000","last_peered":"2024-09-19T09:52:00.352459+0000","last_clean":"2024-09-19T09:52:00.352459+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:52:00.352459+0000","last_undegraded":"2024-09-19T09:52:00.352459+0000","last_fullsized":"2024-09-19T09:52:00.352459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814756+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:51:31.814756+0000","last_peered":"2024-09-19T09:51:31.814756+0000","last_clean":"2024-09-19T09:51:31.814756+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:51:31.814756+0000","last_undegraded":"2024-09-19T09:51:31.814756+0000","last_fullsized":"2024-09-19T09:51:31.814756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.366823+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:52:00.366823+0000","last_peered":"2024-09-19T09:52:00.366823+0000","last_clean":"2024-09-19T09:52:00.366823+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:52:00.366823+0000","last_undegraded":"2024-09-19T09:52:00.366823+0000","last_fullsized":"2024-09-19T09:52:00.366823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815831+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:51:31.815831+0000","last_peered":"2024-09-19T09:51:31.815831+0000","last_clean":"2024-09-19T09:51:31.815831+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:51:31.815831+0000","last_undegraded":"2024-09-19T09:51:31.815831+0000","last_fullsized":"2024-09-19T09:51:31.815831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365646+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:52:00.365646+0000","last_peered":"2024-09-19T09:52:00.365646+0000","last_clean":"2024-09-19T09:52:00.365646+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:52:00.365646+0000","last_undegraded":"2024-09-19T09:52:00.365646+0000","last_fullsized":"2024-09-19T09:52:00.365646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":136,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:25.487573+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:52:25.487573+0000","last_peered":"2024-09-19T09:52:25.487573+0000","last_clean":"2024-09-19T09:52:25.487573+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:52:25.487573+0000","last_undegraded":"2024-09-19T09:52:25.487573+0000","last_fullsized":"2024-09-19T09:52:25.487573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360813+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:52:00.360813+0000","last_peered":"2024-09-19T09:52:00.360813+0000","last_clean":"2024-09-19T09:52:00.360813+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:52:00.360813+0000","last_undegraded":"2024-09-19T09:52:00.360813+0000","last_fullsized":"2024-09-19T09:52:00.360813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414764+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:51:32.414764+0000","last_peered":"2024-09-19T09:51:32.414764+0000","last_clean":"2024-09-19T09:51:32.414764+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:51:32.414764+0000","last_undegraded":"2024-09-19T09:51:32.414764+0000","last_fullsized":"2024-09-19T09:51:32.414764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.169977+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:51:32.169977+0000","last_peered":"2024-09-19T09:51:32.169977+0000","last_clean":"2024-09-19T09:51:32.169977+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:51:32.169977+0000","last_undegraded":"2024-09-19T09:51:32.169977+0000","last_fullsized":"2024-09-19T09:51:32.169977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.348017+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:52:00.348017+0000","last_peered":"2024-09-19T09:52:00.348017+0000","last_clean":"2024-09-19T09:52:00.348017+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:52:00.348017+0000","last_undegraded":"2024-09-19T09:52:00.348017+0000","last_fullsized":"2024-09-19T09:52:00.348017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414691+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:51:32.414691+0000","last_peered":"2024-09-19T09:51:32.414691+0000","last_clean":"2024-09-19T09:51:32.414691+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:51:32.414691+0000","last_undegraded":"2024-09-19T09:51:32.414691+0000","last_fullsized":"2024-09-19T09:51:32.414691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350367+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:52:00.350367+0000","last_peered":"2024-09-19T09:52:00.350367+0000","last_clean":"2024-09-19T09:52:00.350367+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:52:00.350367+0000","last_undegraded":"2024-09-19T09:52:00.350367+0000","last_fullsized":"2024-09-19T09:52:00.350367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:22.478747+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:52:22.478747+0000","last_peered":"2024-09-19T09:52:22.478747+0000","last_clean":"2024-09-19T09:52:22.478747+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:52:22.478747+0000","last_undegraded":"2024-09-19T09:52:22.478747+0000","last_fullsized":"2024-09-19T09:52:22.478747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359314+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:52:00.359314+0000","last_peered":"2024-09-19T09:52:00.359314+0000","last_clean":"2024-09-19T09:52:00.359314+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:52:00.359314+0000","last_undegraded":"2024-09-19T09:52:00.359314+0000","last_fullsized":"2024-09-19T09:52:00.359314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":135,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:22.479412+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:52:22.479412+0000","last_peered":"2024-09-19T09:52:22.479412+0000","last_clean":"2024-09-19T09:52:22.479412+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:52:22.479412+0000","last_undegraded":"2024-09-19T09:52:22.479412+0000","last_fullsized":"2024-09-19T09:52:22.479412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363822+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:52:00.363822+0000","last_peered":"2024-09-19T09:52:00.363822+0000","last_clean":"2024-09-19T09:52:00.363822+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:52:00.363822+0000","last_undegraded":"2024-09-19T09:52:00.363822+0000","last_fullsized":"2024-09-19T09:52:00.363822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824076+0000","last_change":"2024-09-19T09:51:31.824076+0000","last_active":"2024-09-19T09:51:31.824076+0000","last_peered":"2024-09-19T09:51:31.824076+0000","last_clean":"2024-09-19T09:51:31.824076+0000","last_became_active":"2024-09-19T09:51:31.823642+0000","last_became_peered":"2024-09-19T09:51:31.823642+0000","last_unstale":"2024-09-19T09:51:31.824076+0000","last_undegraded":"2024-09-19T09:51:31.824076+0000","last_fullsized":"2024-09-19T09:51:31.824076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:53.035531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361772+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:52:00.361772+0000","last_peered":"2024-09-19T09:52:00.361772+0000","last_clean":"2024-09-19T09:52:00.361772+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:52:00.361772+0000","last_undegraded":"2024-09-19T09:52:00.361772+0000","last_fullsized":"2024-09-19T09:52:00.361772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822947+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:51:31.822947+0000","last_peered":"2024-09-19T09:51:31.822947+0000","last_clean":"2024-09-19T09:51:31.822947+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:51:31.822947+0000","last_undegraded":"2024-09-19T09:51:31.822947+0000","last_fullsized":"2024-09-19T09:51:31.822947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350408+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:52:00.350408+0000","last_peered":"2024-09-19T09:52:00.350408+0000","last_clean":"2024-09-19T09:52:00.350408+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:52:00.350408+0000","last_undegraded":"2024-09-19T09:52:00.350408+0000","last_fullsized":"2024-09-19T09:52:00.350408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'15","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817992+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:51:31.817992+0000","last_peered":"2024-09-19T09:51:31.817992+0000","last_clean":"2024-09-19T09:51:31.817992+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:51:31.817992+0000","last_undegraded":"2024-09-19T09:51:31.817992+0000","last_fullsized":"2024-09-19T09:51:31.817992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360865+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:52:00.360865+0000","last_peered":"2024-09-19T09:52:00.360865+0000","last_clean":"2024-09-19T09:52:00.360865+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:52:00.360865+0000","last_undegraded":"2024-09-19T09:52:00.360865+0000","last_fullsized":"2024-09-19T09:52:00.360865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170286+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:51:32.170286+0000","last_peered":"2024-09-19T09:51:32.170286+0000","last_clean":"2024-09-19T09:51:32.170286+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:51:32.170286+0000","last_undegraded":"2024-09-19T09:51:32.170286+0000","last_fullsized":"2024-09-19T09:51:32.170286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361925+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:52:00.361925+0000","last_peered":"2024-09-19T09:52:00.361925+0000","last_clean":"2024-09-19T09:52:00.361925+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:52:00.361925+0000","last_undegraded":"2024-09-19T09:52:00.361925+0000","last_fullsized":"2024-09-19T09:52:00.361925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964590+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:51:32.964590+0000","last_peered":"2024-09-19T09:51:32.964590+0000","last_clean":"2024-09-19T09:51:32.964590+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:51:32.964590+0000","last_undegraded":"2024-09-19T09:51:32.964590+0000","last_fullsized":"2024-09-19T09:51:32.964590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.320920+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:52:00.320920+0000","last_peered":"2024-09-19T09:52:00.320920+0000","last_clean":"2024-09-19T09:52:00.320920+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.320920+0000","last_undegraded":"2024-09-19T09:52:00.320920+0000","last_fullsized":"2024-09-19T09:52:00.320920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823345+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:51:31.823345+0000","last_peered":"2024-09-19T09:51:31.823345+0000","last_clean":"2024-09-19T09:51:31.823345+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:51:31.823345+0000","last_undegraded":"2024-09-19T09:51:31.823345+0000","last_fullsized":"2024-09-19T09:51:31.823345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353447+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:52:00.353447+0000","last_peered":"2024-09-19T09:52:00.353447+0000","last_clean":"2024-09-19T09:52:00.353447+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:52:00.353447+0000","last_undegraded":"2024-09-19T09:52:00.353447+0000","last_fullsized":"2024-09-19T09:52:00.353447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.830511+0000","last_change":"2024-09-19T09:51:31.830511+0000","last_active":"2024-09-19T09:51:31.830511+0000","last_peered":"2024-09-19T09:51:31.830511+0000","last_clean":"2024-09-19T09:51:31.830511+0000","last_became_active":"2024-09-19T09:51:31.825672+0000","last_became_peered":"2024-09-19T09:51:31.825672+0000","last_unstale":"2024-09-19T09:51:31.830511+0000","last_undegraded":"2024-09-19T09:51:31.830511+0000","last_fullsized":"2024-09-19T09:51:31.830511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.101027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360592+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:52:00.360592+0000","last_peered":"2024-09-19T09:52:00.360592+0000","last_clean":"2024-09-19T09:52:00.360592+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:52:00.360592+0000","last_undegraded":"2024-09-19T09:52:00.360592+0000","last_fullsized":"2024-09-19T09:52:00.360592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821791+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:51:31.821791+0000","last_peered":"2024-09-19T09:51:31.821791+0000","last_clean":"2024-09-19T09:51:31.821791+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:51:31.821791+0000","last_undegraded":"2024-09-19T09:51:31.821791+0000","last_fullsized":"2024-09-19T09:51:31.821791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361855+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:52:00.361855+0000","last_peered":"2024-09-19T09:52:00.361855+0000","last_clean":"2024-09-19T09:52:00.361855+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:52:00.361855+0000","last_undegraded":"2024-09-19T09:52:00.361855+0000","last_fullsized":"2024-09-19T09:52:00.361855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369084+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:52:00.369084+0000","last_peered":"2024-09-19T09:52:00.369084+0000","last_clean":"2024-09-19T09:52:00.369084+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:52:00.369084+0000","last_undegraded":"2024-09-19T09:52:00.369084+0000","last_fullsized":"2024-09-19T09:52:00.369084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822749+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:51:31.822749+0000","last_peered":"2024-09-19T09:51:31.822749+0000","last_clean":"2024-09-19T09:51:31.822749+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:51:31.822749+0000","last_undegraded":"2024-09-19T09:51:31.822749+0000","last_fullsized":"2024-09-19T09:51:31.822749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.371499+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:52:00.371499+0000","last_peered":"2024-09-19T09:52:00.371499+0000","last_clean":"2024-09-19T09:52:00.371499+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:52:00.371499+0000","last_undegraded":"2024-09-19T09:52:00.371499+0000","last_fullsized":"2024-09-19T09:52:00.371499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822889+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:51:31.822889+0000","last_peered":"2024-09-19T09:51:31.822889+0000","last_clean":"2024-09-19T09:51:31.822889+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:51:31.822889+0000","last_undegraded":"2024-09-19T09:51:31.822889+0000","last_fullsized":"2024-09-19T09:51:31.822889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373597+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:52:00.373597+0000","last_peered":"2024-09-19T09:52:00.373597+0000","last_clean":"2024-09-19T09:52:00.373597+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:52:00.373597+0000","last_undegraded":"2024-09-19T09:52:00.373597+0000","last_fullsized":"2024-09-19T09:52:00.373597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823978+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:51:31.823978+0000","last_peered":"2024-09-19T09:51:31.823978+0000","last_clean":"2024-09-19T09:51:31.823978+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:51:31.823978+0000","last_undegraded":"2024-09-19T09:51:31.823978+0000","last_fullsized":"2024-09-19T09:51:31.823978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.349804+0000","last_change":"2024-09-19T09:51:31.824910+0000","last_active":"2024-09-19T09:52:00.349804+0000","last_peered":"2024-09-19T09:52:00.349804+0000","last_clean":"2024-09-19T09:52:00.349804+0000","last_became_active":"2024-09-19T09:51:31.824521+0000","last_became_peered":"2024-09-19T09:51:31.824521+0000","last_unstale":"2024-09-19T09:52:00.349804+0000","last_undegraded":"2024-09-19T09:52:00.349804+0000","last_fullsized":"2024-09-19T09:52:00.349804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:43.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:23.480142+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:52:23.480142+0000","last_peered":"2024-09-19T09:52:23.480142+0000","last_clean":"2024-09-19T09:52:23.480142+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:52:23.480142+0000","last_undegraded":"2024-09-19T09:52:23.480142+0000","last_fullsized":"2024-09-19T09:52:23.480142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68358,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1089,"num_read_kb":618,"num_write":253,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":214318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514533,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":442788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1617920,"data_stored":1095219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906991,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":443096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364856,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1036291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528382,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":442969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1034901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":442830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":509058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40472,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704680,"statfs":{"total":95995035648,"available":95953592320,"internally_reserved":0,"allocated":991232,"data_stored":509372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":443774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:52:29.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:52:29.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.383+0000 7f78db0a5640 1 -- 172.21.15.18:0/3913602220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d4100a30 msgr2=0x7f78d4100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.383+0000 7f78db0a5640 1 --2- 172.21.15.18:0/3913602220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d4100a30 0x7f78d4100e30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009900 tx=0x7f78c802a410 comp rx=0 tx=0).stop 2024-09-19T09:52:29.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.383+0000 7f78db0a5640 1 -- 172.21.15.18:0/3913602220 shutdown_connections 2024-09-19T09:52:29.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.383+0000 7f78db0a5640 1 --2- 172.21.15.18:0/3913602220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78d41025e0 0x7f78d4108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.383+0000 7f78db0a5640 1 --2- 172.21.15.18:0/3913602220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78d4101c20 0x7f78d41020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.383+0000 7f78db0a5640 1 --2- 172.21.15.18:0/3913602220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d4100a30 0x7f78d4100e30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.383+0000 7f78db0a5640 1 -- 172.21.15.18:0/3913602220 >> 172.21.15.18:0/3913602220 conn(0x7f78d40fc1b0 msgr2=0x7f78d40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.383+0000 7f78db0a5640 1 -- 172.21.15.18:0/3913602220 shutdown_connections 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.383+0000 7f78db0a5640 1 -- 172.21.15.18:0/3913602220 wait complete. 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78db0a5640 1 Processor -- start 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78db0a5640 1 -- start start 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78db0a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d4100a30 0x7f78d4197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78db0a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78d4101c20 0x7f78d4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78db0a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78d41025e0 0x7f78d419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78db0a5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f78d410d820 con 0x7f78d4100a30 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78db0a5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f78d410d6a0 con 0x7f78d4101c20 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78db0a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f78d410d9a0 con 0x7f78d41025e0 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d8e41640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d4100a30 0x7f78d4197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d8e41640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d4100a30 0x7f78d4197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39570/0 (socket says 172.21.15.18:39570) 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d8e41640 1 -- 172.21.15.18:0/733268461 learned_addr learned my addr 172.21.15.18:0/733268461 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d3fff640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78d4101c20 0x7f78d4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d9642640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78d41025e0 0x7f78d419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d8e41640 1 -- 172.21.15.18:0/733268461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78d41025e0 msgr2=0x7f78d419f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d8e41640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78d41025e0 0x7f78d419f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d8e41640 1 -- 172.21.15.18:0/733268461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78d4101c20 msgr2=0x7f78d4198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d8e41640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78d4101c20 0x7f78d4198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d8e41640 1 -- 172.21.15.18:0/733268461 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d419fb20 con 0x7f78d4100a30 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.384+0000 7f78d3fff640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78d4101c20 0x7f78d4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.385+0000 7f78d8e41640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d4100a30 0x7f78d4197f00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f78c8031610 tx=0x7f78c80043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.385+0000 7f78d1ffb640 1 -- 172.21.15.18:0/733268461 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c803f030 con 0x7f78d4100a30 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.385+0000 7f78d1ffb640 1 -- 172.21.15.18:0/733268461 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78c8003ce0 con 0x7f78d4100a30 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.385+0000 7f78db0a5640 1 -- 172.21.15.18:0/733268461 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d419fdb0 con 0x7f78d4100a30 2024-09-19T09:52:29.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.385+0000 7f78d1ffb640 1 -- 172.21.15.18:0/733268461 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8035070 con 0x7f78d4100a30 2024-09-19T09:52:29.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.385+0000 7f78db0a5640 1 -- 172.21.15.18:0/733268461 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d41a0260 con 0x7f78d4100a30 2024-09-19T09:52:29.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.386+0000 7f78db0a5640 1 -- 172.21.15.18:0/733268461 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d4107ec0 con 0x7f78d4100a30 2024-09-19T09:52:29.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.387+0000 7f78d1ffb640 1 -- 172.21.15.18:0/733268461 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f78c8042030 con 0x7f78d4100a30 2024-09-19T09:52:29.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.388+0000 7f78d1ffb640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f78c40a3250 0x7f78c40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.388+0000 7f78d1ffb640 1 -- 172.21.15.18:0/733268461 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f78c80effc0 con 0x7f78d4100a30 2024-09-19T09:52:29.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.388+0000 7f78d3fff640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f78c40a3250 0x7f78c40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.388+0000 7f78d3fff640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f78c40a3250 0x7f78c40a5710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78d4199410 tx=0x7f78c0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:29.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.392+0000 7f78d1ffb640 1 -- 172.21.15.18:0/733268461 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78c80bccb0 con 0x7f78d4100a30 2024-09-19T09:52:29.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:28 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3728314466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:29.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:28 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3728314466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:29.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.567+0000 7f78db0a5640 1 -- 172.21.15.18:0/733268461 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78d4062630 con 0x7f78c40a3250 2024-09-19T09:52:29.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.573+0000 7f78d1ffb640 1 -- 172.21.15.18:0/733268461 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258870 (secure 0 0 0) 0x7f78d4062630 con 0x7f78c40a3250 2024-09-19T09:52:29.577 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:52:29.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 -- 172.21.15.18:0/733268461 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f78c40a3250 msgr2=0x7f78c40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f78c40a3250 0x7f78c40a5710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78d4199410 tx=0x7f78c0008040 comp rx=0 tx=0).stop 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 -- 172.21.15.18:0/733268461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d4100a30 msgr2=0x7f78d4197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d4100a30 0x7f78d4197f00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f78c8031610 tx=0x7f78c80043b0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 -- 172.21.15.18:0/733268461 shutdown_connections 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f78c40a3250 0x7f78c40a5710 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78d41025e0 0x7f78d419f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78d4101c20 0x7f78d4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 --2- 172.21.15.18:0/733268461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d4100a30 0x7f78d4197f00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 -- 172.21.15.18:0/733268461 >> 172.21.15.18:0/733268461 conn(0x7f78d40fc1b0 msgr2=0x7f78d4105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 -- 172.21.15.18:0/733268461 shutdown_connections 2024-09-19T09:52:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.577+0000 7f78db0a5640 1 -- 172.21.15.18:0/733268461 wait complete. 2024-09-19T09:52:29.590 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-19T09:52:28.377769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658960,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1215,"num_read_kb":727,"num_write":436,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374660,"kb_used_data":12932,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567164,"statfs":{"total":1151940427776,"available":1151556775936,"internally_reserved":0,"allocated":13242368,"data_stored":7285276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":50,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003351"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372723+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:52:00.372723+0000","last_peered":"2024-09-19T09:52:00.372723+0000","last_clean":"2024-09-19T09:52:00.372723+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:52:00.372723+0000","last_undegraded":"2024-09-19T09:52:00.372723+0000","last_fullsized":"2024-09-19T09:52:00.372723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360023+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:52:00.360023+0000","last_peered":"2024-09-19T09:52:00.360023+0000","last_clean":"2024-09-19T09:52:00.360023+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:52:00.360023+0000","last_undegraded":"2024-09-19T09:52:00.360023+0000","last_fullsized":"2024-09-19T09:52:00.360023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373218+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:52:00.373218+0000","last_peered":"2024-09-19T09:52:00.373218+0000","last_clean":"2024-09-19T09:52:00.373218+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:52:00.373218+0000","last_undegraded":"2024-09-19T09:52:00.373218+0000","last_fullsized":"2024-09-19T09:52:00.373218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362542+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:52:00.362542+0000","last_peered":"2024-09-19T09:52:00.362542+0000","last_clean":"2024-09-19T09:52:00.362542+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:52:00.362542+0000","last_undegraded":"2024-09-19T09:52:00.362542+0000","last_fullsized":"2024-09-19T09:52:00.362542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.335091+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:52:00.335091+0000","last_peered":"2024-09-19T09:52:00.335091+0000","last_clean":"2024-09-19T09:52:00.335091+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:52:00.335091+0000","last_undegraded":"2024-09-19T09:52:00.335091+0000","last_fullsized":"2024-09-19T09:52:00.335091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359516+0000","last_change":"2024-09-19T09:51:31.818907+0000","last_active":"2024-09-19T09:52:00.359516+0000","last_peered":"2024-09-19T09:52:00.359516+0000","last_clean":"2024-09-19T09:52:00.359516+0000","last_became_active":"2024-09-19T09:51:31.818522+0000","last_became_peered":"2024-09-19T09:51:31.818522+0000","last_unstale":"2024-09-19T09:52:00.359516+0000","last_undegraded":"2024-09-19T09:52:00.359516+0000","last_fullsized":"2024-09-19T09:52:00.359516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:04.062704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365337+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:52:00.365337+0000","last_peered":"2024-09-19T09:52:00.365337+0000","last_clean":"2024-09-19T09:52:00.365337+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:52:00.365337+0000","last_undegraded":"2024-09-19T09:52:00.365337+0000","last_fullsized":"2024-09-19T09:52:00.365337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358908+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:52:00.358908+0000","last_peered":"2024-09-19T09:52:00.358908+0000","last_clean":"2024-09-19T09:52:00.358908+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:52:00.358908+0000","last_undegraded":"2024-09-19T09:52:00.358908+0000","last_fullsized":"2024-09-19T09:52:00.358908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370979+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:52:00.370979+0000","last_peered":"2024-09-19T09:52:00.370979+0000","last_clean":"2024-09-19T09:52:00.370979+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:52:00.370979+0000","last_undegraded":"2024-09-19T09:52:00.370979+0000","last_fullsized":"2024-09-19T09:52:00.370979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364519+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:52:00.364519+0000","last_peered":"2024-09-19T09:52:00.364519+0000","last_clean":"2024-09-19T09:52:00.364519+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:52:00.364519+0000","last_undegraded":"2024-09-19T09:52:00.364519+0000","last_fullsized":"2024-09-19T09:52:00.364519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.368226+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:52:00.368226+0000","last_peered":"2024-09-19T09:52:00.368226+0000","last_clean":"2024-09-19T09:52:00.368226+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:52:00.368226+0000","last_undegraded":"2024-09-19T09:52:00.368226+0000","last_fullsized":"2024-09-19T09:52:00.368226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362431+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:52:00.362431+0000","last_peered":"2024-09-19T09:52:00.362431+0000","last_clean":"2024-09-19T09:52:00.362431+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:52:00.362431+0000","last_undegraded":"2024-09-19T09:52:00.362431+0000","last_fullsized":"2024-09-19T09:52:00.362431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351092+0000","last_change":"2024-09-19T09:51:31.818910+0000","last_active":"2024-09-19T09:52:00.351092+0000","last_peered":"2024-09-19T09:52:00.351092+0000","last_clean":"2024-09-19T09:52:00.351092+0000","last_became_active":"2024-09-19T09:51:31.818581+0000","last_became_peered":"2024-09-19T09:51:31.818581+0000","last_unstale":"2024-09-19T09:52:00.351092+0000","last_undegraded":"2024-09-19T09:52:00.351092+0000","last_fullsized":"2024-09-19T09:52:00.351092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.736835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365871+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:52:00.365871+0000","last_peered":"2024-09-19T09:52:00.365871+0000","last_clean":"2024-09-19T09:52:00.365871+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:52:00.365871+0000","last_undegraded":"2024-09-19T09:52:00.365871+0000","last_fullsized":"2024-09-19T09:52:00.365871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361631+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:52:00.361631+0000","last_peered":"2024-09-19T09:52:00.361631+0000","last_clean":"2024-09-19T09:52:00.361631+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:52:00.361631+0000","last_undegraded":"2024-09-19T09:52:00.361631+0000","last_fullsized":"2024-09-19T09:52:00.361631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372654+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:52:00.372654+0000","last_peered":"2024-09-19T09:52:00.372654+0000","last_clean":"2024-09-19T09:52:00.372654+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:52:00.372654+0000","last_undegraded":"2024-09-19T09:52:00.372654+0000","last_fullsized":"2024-09-19T09:52:00.372654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373008+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:52:00.373008+0000","last_peered":"2024-09-19T09:52:00.373008+0000","last_clean":"2024-09-19T09:52:00.373008+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:52:00.373008+0000","last_undegraded":"2024-09-19T09:52:00.373008+0000","last_fullsized":"2024-09-19T09:52:00.373008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372768+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:52:00.372768+0000","last_peered":"2024-09-19T09:52:00.372768+0000","last_clean":"2024-09-19T09:52:00.372768+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:52:00.372768+0000","last_undegraded":"2024-09-19T09:52:00.372768+0000","last_fullsized":"2024-09-19T09:52:00.372768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.356302+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:52:00.356302+0000","last_peered":"2024-09-19T09:52:00.356302+0000","last_clean":"2024-09-19T09:52:00.356302+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:52:00.356302+0000","last_undegraded":"2024-09-19T09:52:00.356302+0000","last_fullsized":"2024-09-19T09:52:00.356302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351159+0000","last_change":"2024-09-19T09:51:31.823803+0000","last_active":"2024-09-19T09:52:00.351159+0000","last_peered":"2024-09-19T09:52:00.351159+0000","last_clean":"2024-09-19T09:52:00.351159+0000","last_became_active":"2024-09-19T09:51:31.823361+0000","last_became_peered":"2024-09-19T09:51:31.823361+0000","last_unstale":"2024-09-19T09:52:00.351159+0000","last_undegraded":"2024-09-19T09:52:00.351159+0000","last_fullsized":"2024-09-19T09:52:00.351159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:33.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364330+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:52:00.364330+0000","last_peered":"2024-09-19T09:52:00.364330+0000","last_clean":"2024-09-19T09:52:00.364330+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:52:00.364330+0000","last_undegraded":"2024-09-19T09:52:00.364330+0000","last_fullsized":"2024-09-19T09:52:00.364330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370710+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:52:00.370710+0000","last_peered":"2024-09-19T09:52:00.370710+0000","last_clean":"2024-09-19T09:52:00.370710+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:52:00.370710+0000","last_undegraded":"2024-09-19T09:52:00.370710+0000","last_fullsized":"2024-09-19T09:52:00.370710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358193+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:52:00.358193+0000","last_peered":"2024-09-19T09:52:00.358193+0000","last_clean":"2024-09-19T09:52:00.358193+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:52:00.358193+0000","last_undegraded":"2024-09-19T09:52:00.358193+0000","last_fullsized":"2024-09-19T09:52:00.358193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358828+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:52:00.358828+0000","last_peered":"2024-09-19T09:52:00.358828+0000","last_clean":"2024-09-19T09:52:00.358828+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:52:00.358828+0000","last_undegraded":"2024-09-19T09:52:00.358828+0000","last_fullsized":"2024-09-19T09:52:00.358828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.367256+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:52:00.367256+0000","last_peered":"2024-09-19T09:52:00.367256+0000","last_clean":"2024-09-19T09:52:00.367256+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:52:00.367256+0000","last_undegraded":"2024-09-19T09:52:00.367256+0000","last_fullsized":"2024-09-19T09:52:00.367256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.357344+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:52:00.357344+0000","last_peered":"2024-09-19T09:52:00.357344+0000","last_clean":"2024-09-19T09:52:00.357344+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:52:00.357344+0000","last_undegraded":"2024-09-19T09:52:00.357344+0000","last_fullsized":"2024-09-19T09:52:00.357344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351848+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:52:00.351848+0000","last_peered":"2024-09-19T09:52:00.351848+0000","last_clean":"2024-09-19T09:52:00.351848+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:52:00.351848+0000","last_undegraded":"2024-09-19T09:52:00.351848+0000","last_fullsized":"2024-09-19T09:52:00.351848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350260+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:52:00.350260+0000","last_peered":"2024-09-19T09:52:00.350260+0000","last_clean":"2024-09-19T09:52:00.350260+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:52:00.350260+0000","last_undegraded":"2024-09-19T09:52:00.350260+0000","last_fullsized":"2024-09-19T09:52:00.350260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361673+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:52:00.361673+0000","last_peered":"2024-09-19T09:52:00.361673+0000","last_clean":"2024-09-19T09:52:00.361673+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:52:00.361673+0000","last_undegraded":"2024-09-19T09:52:00.361673+0000","last_fullsized":"2024-09-19T09:52:00.361673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355490+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:52:00.355490+0000","last_peered":"2024-09-19T09:52:00.355490+0000","last_clean":"2024-09-19T09:52:00.355490+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:52:00.355490+0000","last_undegraded":"2024-09-19T09:52:00.355490+0000","last_fullsized":"2024-09-19T09:52:00.355490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361354+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:52:00.361354+0000","last_peered":"2024-09-19T09:52:00.361354+0000","last_clean":"2024-09-19T09:52:00.361354+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:52:00.361354+0000","last_undegraded":"2024-09-19T09:52:00.361354+0000","last_fullsized":"2024-09-19T09:52:00.361354+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353327+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:52:00.353327+0000","last_peered":"2024-09-19T09:52:00.353327+0000","last_clean":"2024-09-19T09:52:00.353327+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:52:00.353327+0000","last_undegraded":"2024-09-19T09:52:00.353327+0000","last_fullsized":"2024-09-19T09:52:00.353327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.345044+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:52:00.345044+0000","last_peered":"2024-09-19T09:52:00.345044+0000","last_clean":"2024-09-19T09:52:00.345044+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:52:00.345044+0000","last_undegraded":"2024-09-19T09:52:00.345044+0000","last_fullsized":"2024-09-19T09:52:00.345044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:26.489107+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:52:26.489107+0000","last_peered":"2024-09-19T09:52:26.489107+0000","last_clean":"2024-09-19T09:52:26.489107+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:52:26.489107+0000","last_undegraded":"2024-09-19T09:52:26.489107+0000","last_fullsized":"2024-09-19T09:52:26.489107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359507+0000","last_change":"2024-09-19T09:51:31.825618+0000","last_active":"2024-09-19T09:52:00.359507+0000","last_peered":"2024-09-19T09:52:00.359507+0000","last_clean":"2024-09-19T09:52:00.359507+0000","last_became_active":"2024-09-19T09:51:31.824727+0000","last_became_peered":"2024-09-19T09:51:31.824727+0000","last_unstale":"2024-09-19T09:52:00.359507+0000","last_undegraded":"2024-09-19T09:52:00.359507+0000","last_fullsized":"2024-09-19T09:52:00.359507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:52.094074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816210+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:51:31.816210+0000","last_peered":"2024-09-19T09:51:31.816210+0000","last_clean":"2024-09-19T09:51:31.816210+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:51:31.816210+0000","last_undegraded":"2024-09-19T09:51:31.816210+0000","last_fullsized":"2024-09-19T09:51:31.816210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814498+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:51:31.814498+0000","last_peered":"2024-09-19T09:51:31.814498+0000","last_clean":"2024-09-19T09:51:31.814498+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:51:31.814498+0000","last_undegraded":"2024-09-19T09:51:31.814498+0000","last_fullsized":"2024-09-19T09:51:31.814498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355727+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:52:00.355727+0000","last_peered":"2024-09-19T09:52:00.355727+0000","last_clean":"2024-09-19T09:52:00.355727+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.355727+0000","last_undegraded":"2024-09-19T09:52:00.355727+0000","last_fullsized":"2024-09-19T09:52:00.355727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815599+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:51:31.815599+0000","last_peered":"2024-09-19T09:51:31.815599+0000","last_clean":"2024-09-19T09:51:31.815599+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:51:31.815599+0000","last_undegraded":"2024-09-19T09:51:31.815599+0000","last_fullsized":"2024-09-19T09:51:31.815599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363759+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:52:00.363759+0000","last_peered":"2024-09-19T09:52:00.363759+0000","last_clean":"2024-09-19T09:52:00.363759+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:52:00.363759+0000","last_undegraded":"2024-09-19T09:52:00.363759+0000","last_fullsized":"2024-09-19T09:52:00.363759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":234,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:23.484062+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:52:23.484062+0000","last_peered":"2024-09-19T09:52:23.484062+0000","last_clean":"2024-09-19T09:52:23.484062+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:52:23.484062+0000","last_undegraded":"2024-09-19T09:52:23.484062+0000","last_fullsized":"2024-09-19T09:52:23.484062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373477+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:52:00.373477+0000","last_peered":"2024-09-19T09:52:00.373477+0000","last_clean":"2024-09-19T09:52:00.373477+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:52:00.373477+0000","last_undegraded":"2024-09-19T09:52:00.373477+0000","last_fullsized":"2024-09-19T09:52:00.373477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415018+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:51:32.415018+0000","last_peered":"2024-09-19T09:51:32.415018+0000","last_clean":"2024-09-19T09:51:32.415018+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:51:32.415018+0000","last_undegraded":"2024-09-19T09:51:32.415018+0000","last_fullsized":"2024-09-19T09:51:32.415018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361630+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:52:00.361630+0000","last_peered":"2024-09-19T09:52:00.361630+0000","last_clean":"2024-09-19T09:52:00.361630+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:52:00.361630+0000","last_undegraded":"2024-09-19T09:52:00.361630+0000","last_fullsized":"2024-09-19T09:52:00.361630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815716+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:51:31.815716+0000","last_peered":"2024-09-19T09:51:31.815716+0000","last_clean":"2024-09-19T09:51:31.815716+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:51:31.815716+0000","last_undegraded":"2024-09-19T09:51:31.815716+0000","last_fullsized":"2024-09-19T09:51:31.815716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373858+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:52:00.373858+0000","last_peered":"2024-09-19T09:52:00.373858+0000","last_clean":"2024-09-19T09:52:00.373858+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:52:00.373858+0000","last_undegraded":"2024-09-19T09:52:00.373858+0000","last_fullsized":"2024-09-19T09:52:00.373858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":272,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:23.484057+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:52:23.484057+0000","last_peered":"2024-09-19T09:52:23.484057+0000","last_clean":"2024-09-19T09:52:23.484057+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:52:23.484057+0000","last_undegraded":"2024-09-19T09:52:23.484057+0000","last_fullsized":"2024-09-19T09:52:23.484057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60868,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":217,"num_read_kb":168,"num_write":35,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363505+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:52:00.363505+0000","last_peered":"2024-09-19T09:52:00.363505+0000","last_clean":"2024-09-19T09:52:00.363505+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:52:00.363505+0000","last_undegraded":"2024-09-19T09:52:00.363505+0000","last_fullsized":"2024-09-19T09:52:00.363505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821655+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:51:31.821655+0000","last_peered":"2024-09-19T09:51:31.821655+0000","last_clean":"2024-09-19T09:51:31.821655+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:51:31.821655+0000","last_undegraded":"2024-09-19T09:51:31.821655+0000","last_fullsized":"2024-09-19T09:51:31.821655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363961+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:52:00.363961+0000","last_peered":"2024-09-19T09:52:00.363961+0000","last_clean":"2024-09-19T09:52:00.363961+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:52:00.363961+0000","last_undegraded":"2024-09-19T09:52:00.363961+0000","last_fullsized":"2024-09-19T09:52:00.363961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815497+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:31.815497+0000","last_peered":"2024-09-19T09:51:31.815497+0000","last_clean":"2024-09-19T09:51:31.815497+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:51:31.815497+0000","last_undegraded":"2024-09-19T09:51:31.815497+0000","last_fullsized":"2024-09-19T09:51:31.815497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369638+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:52:00.369638+0000","last_peered":"2024-09-19T09:52:00.369638+0000","last_clean":"2024-09-19T09:52:00.369638+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:52:00.369638+0000","last_undegraded":"2024-09-19T09:52:00.369638+0000","last_fullsized":"2024-09-19T09:52:00.369638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'7","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:22.479521+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:52:22.479521+0000","last_peered":"2024-09-19T09:52:22.479521+0000","last_clean":"2024-09-19T09:52:22.479521+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:52:22.479521+0000","last_undegraded":"2024-09-19T09:52:22.479521+0000","last_fullsized":"2024-09-19T09:52:22.479521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365299+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:52:00.365299+0000","last_peered":"2024-09-19T09:52:00.365299+0000","last_clean":"2024-09-19T09:52:00.365299+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:52:00.365299+0000","last_undegraded":"2024-09-19T09:52:00.365299+0000","last_fullsized":"2024-09-19T09:52:00.365299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821556+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:51:31.821556+0000","last_peered":"2024-09-19T09:51:31.821556+0000","last_clean":"2024-09-19T09:51:31.821556+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:51:31.821556+0000","last_undegraded":"2024-09-19T09:51:31.821556+0000","last_fullsized":"2024-09-19T09:51:31.821556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359861+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:52:00.359861+0000","last_peered":"2024-09-19T09:52:00.359861+0000","last_clean":"2024-09-19T09:52:00.359861+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:52:00.359861+0000","last_undegraded":"2024-09-19T09:52:00.359861+0000","last_fullsized":"2024-09-19T09:52:00.359861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822551+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:51:31.822551+0000","last_peered":"2024-09-19T09:51:31.822551+0000","last_clean":"2024-09-19T09:51:31.822551+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:51:31.822551+0000","last_undegraded":"2024-09-19T09:51:31.822551+0000","last_fullsized":"2024-09-19T09:51:31.822551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.352459+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:52:00.352459+0000","last_peered":"2024-09-19T09:52:00.352459+0000","last_clean":"2024-09-19T09:52:00.352459+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:52:00.352459+0000","last_undegraded":"2024-09-19T09:52:00.352459+0000","last_fullsized":"2024-09-19T09:52:00.352459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814756+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:51:31.814756+0000","last_peered":"2024-09-19T09:51:31.814756+0000","last_clean":"2024-09-19T09:51:31.814756+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:51:31.814756+0000","last_undegraded":"2024-09-19T09:51:31.814756+0000","last_fullsized":"2024-09-19T09:51:31.814756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.366823+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:52:00.366823+0000","last_peered":"2024-09-19T09:52:00.366823+0000","last_clean":"2024-09-19T09:52:00.366823+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:52:00.366823+0000","last_undegraded":"2024-09-19T09:52:00.366823+0000","last_fullsized":"2024-09-19T09:52:00.366823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815831+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:51:31.815831+0000","last_peered":"2024-09-19T09:51:31.815831+0000","last_clean":"2024-09-19T09:51:31.815831+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:51:31.815831+0000","last_undegraded":"2024-09-19T09:51:31.815831+0000","last_fullsized":"2024-09-19T09:51:31.815831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365646+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:52:00.365646+0000","last_peered":"2024-09-19T09:52:00.365646+0000","last_clean":"2024-09-19T09:52:00.365646+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:52:00.365646+0000","last_undegraded":"2024-09-19T09:52:00.365646+0000","last_fullsized":"2024-09-19T09:52:00.365646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":136,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:25.487573+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:52:25.487573+0000","last_peered":"2024-09-19T09:52:25.487573+0000","last_clean":"2024-09-19T09:52:25.487573+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:52:25.487573+0000","last_undegraded":"2024-09-19T09:52:25.487573+0000","last_fullsized":"2024-09-19T09:52:25.487573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360813+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:52:00.360813+0000","last_peered":"2024-09-19T09:52:00.360813+0000","last_clean":"2024-09-19T09:52:00.360813+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:52:00.360813+0000","last_undegraded":"2024-09-19T09:52:00.360813+0000","last_fullsized":"2024-09-19T09:52:00.360813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414764+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:51:32.414764+0000","last_peered":"2024-09-19T09:51:32.414764+0000","last_clean":"2024-09-19T09:51:32.414764+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:51:32.414764+0000","last_undegraded":"2024-09-19T09:51:32.414764+0000","last_fullsized":"2024-09-19T09:51:32.414764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.169977+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:51:32.169977+0000","last_peered":"2024-09-19T09:51:32.169977+0000","last_clean":"2024-09-19T09:51:32.169977+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:51:32.169977+0000","last_undegraded":"2024-09-19T09:51:32.169977+0000","last_fullsized":"2024-09-19T09:51:32.169977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.348017+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:52:00.348017+0000","last_peered":"2024-09-19T09:52:00.348017+0000","last_clean":"2024-09-19T09:52:00.348017+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:52:00.348017+0000","last_undegraded":"2024-09-19T09:52:00.348017+0000","last_fullsized":"2024-09-19T09:52:00.348017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414691+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:51:32.414691+0000","last_peered":"2024-09-19T09:51:32.414691+0000","last_clean":"2024-09-19T09:51:32.414691+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:51:32.414691+0000","last_undegraded":"2024-09-19T09:51:32.414691+0000","last_fullsized":"2024-09-19T09:51:32.414691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350367+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:52:00.350367+0000","last_peered":"2024-09-19T09:52:00.350367+0000","last_clean":"2024-09-19T09:52:00.350367+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:52:00.350367+0000","last_undegraded":"2024-09-19T09:52:00.350367+0000","last_fullsized":"2024-09-19T09:52:00.350367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:22.478747+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:52:22.478747+0000","last_peered":"2024-09-19T09:52:22.478747+0000","last_clean":"2024-09-19T09:52:22.478747+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:52:22.478747+0000","last_undegraded":"2024-09-19T09:52:22.478747+0000","last_fullsized":"2024-09-19T09:52:22.478747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359314+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:52:00.359314+0000","last_peered":"2024-09-19T09:52:00.359314+0000","last_clean":"2024-09-19T09:52:00.359314+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:52:00.359314+0000","last_undegraded":"2024-09-19T09:52:00.359314+0000","last_fullsized":"2024-09-19T09:52:00.359314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":135,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:22.479412+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:52:22.479412+0000","last_peered":"2024-09-19T09:52:22.479412+0000","last_clean":"2024-09-19T09:52:22.479412+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:52:22.479412+0000","last_undegraded":"2024-09-19T09:52:22.479412+0000","last_fullsized":"2024-09-19T09:52:22.479412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363822+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:52:00.363822+0000","last_peered":"2024-09-19T09:52:00.363822+0000","last_clean":"2024-09-19T09:52:00.363822+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:52:00.363822+0000","last_undegraded":"2024-09-19T09:52:00.363822+0000","last_fullsized":"2024-09-19T09:52:00.363822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824076+0000","last_change":"2024-09-19T09:51:31.824076+0000","last_active":"2024-09-19T09:51:31.824076+0000","last_peered":"2024-09-19T09:51:31.824076+0000","last_clean":"2024-09-19T09:51:31.824076+0000","last_became_active":"2024-09-19T09:51:31.823642+0000","last_became_peered":"2024-09-19T09:51:31.823642+0000","last_unstale":"2024-09-19T09:51:31.824076+0000","last_undegraded":"2024-09-19T09:51:31.824076+0000","last_fullsized":"2024-09-19T09:51:31.824076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:53.035531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361772+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:52:00.361772+0000","last_peered":"2024-09-19T09:52:00.361772+0000","last_clean":"2024-09-19T09:52:00.361772+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:52:00.361772+0000","last_undegraded":"2024-09-19T09:52:00.361772+0000","last_fullsized":"2024-09-19T09:52:00.361772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822947+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:51:31.822947+0000","last_peered":"2024-09-19T09:51:31.822947+0000","last_clean":"2024-09-19T09:51:31.822947+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:51:31.822947+0000","last_undegraded":"2024-09-19T09:51:31.822947+0000","last_fullsized":"2024-09-19T09:51:31.822947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350408+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:52:00.350408+0000","last_peered":"2024-09-19T09:52:00.350408+0000","last_clean":"2024-09-19T09:52:00.350408+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:52:00.350408+0000","last_undegraded":"2024-09-19T09:52:00.350408+0000","last_fullsized":"2024-09-19T09:52:00.350408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'15","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817992+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:51:31.817992+0000","last_peered":"2024-09-19T09:51:31.817992+0000","last_clean":"2024-09-19T09:51:31.817992+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:51:31.817992+0000","last_undegraded":"2024-09-19T09:51:31.817992+0000","last_fullsized":"2024-09-19T09:51:31.817992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360865+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:52:00.360865+0000","last_peered":"2024-09-19T09:52:00.360865+0000","last_clean":"2024-09-19T09:52:00.360865+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:52:00.360865+0000","last_undegraded":"2024-09-19T09:52:00.360865+0000","last_fullsized":"2024-09-19T09:52:00.360865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170286+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:51:32.170286+0000","last_peered":"2024-09-19T09:51:32.170286+0000","last_clean":"2024-09-19T09:51:32.170286+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:51:32.170286+0000","last_undegraded":"2024-09-19T09:51:32.170286+0000","last_fullsized":"2024-09-19T09:51:32.170286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361925+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:52:00.361925+0000","last_peered":"2024-09-19T09:52:00.361925+0000","last_clean":"2024-09-19T09:52:00.361925+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:52:00.361925+0000","last_undegraded":"2024-09-19T09:52:00.361925+0000","last_fullsized":"2024-09-19T09:52:00.361925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964590+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:51:32.964590+0000","last_peered":"2024-09-19T09:51:32.964590+0000","last_clean":"2024-09-19T09:51:32.964590+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:51:32.964590+0000","last_undegraded":"2024-09-19T09:51:32.964590+0000","last_fullsized":"2024-09-19T09:51:32.964590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.320920+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:52:00.320920+0000","last_peered":"2024-09-19T09:52:00.320920+0000","last_clean":"2024-09-19T09:52:00.320920+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.320920+0000","last_undegraded":"2024-09-19T09:52:00.320920+0000","last_fullsized":"2024-09-19T09:52:00.320920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823345+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:51:31.823345+0000","last_peered":"2024-09-19T09:51:31.823345+0000","last_clean":"2024-09-19T09:51:31.823345+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:51:31.823345+0000","last_undegraded":"2024-09-19T09:51:31.823345+0000","last_fullsized":"2024-09-19T09:51:31.823345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353447+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:52:00.353447+0000","last_peered":"2024-09-19T09:52:00.353447+0000","last_clean":"2024-09-19T09:52:00.353447+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:52:00.353447+0000","last_undegraded":"2024-09-19T09:52:00.353447+0000","last_fullsized":"2024-09-19T09:52:00.353447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.830511+0000","last_change":"2024-09-19T09:51:31.830511+0000","last_active":"2024-09-19T09:51:31.830511+0000","last_peered":"2024-09-19T09:51:31.830511+0000","last_clean":"2024-09-19T09:51:31.830511+0000","last_became_active":"2024-09-19T09:51:31.825672+0000","last_became_peered":"2024-09-19T09:51:31.825672+0000","last_unstale":"2024-09-19T09:51:31.830511+0000","last_undegraded":"2024-09-19T09:51:31.830511+0000","last_fullsized":"2024-09-19T09:51:31.830511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.101027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360592+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:52:00.360592+0000","last_peered":"2024-09-19T09:52:00.360592+0000","last_clean":"2024-09-19T09:52:00.360592+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:52:00.360592+0000","last_undegraded":"2024-09-19T09:52:00.360592+0000","last_fullsized":"2024-09-19T09:52:00.360592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821791+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:51:31.821791+0000","last_peered":"2024-09-19T09:51:31.821791+0000","last_clean":"2024-09-19T09:51:31.821791+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:51:31.821791+0000","last_undegraded":"2024-09-19T09:51:31.821791+0000","last_fullsized":"2024-09-19T09:51:31.821791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361855+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:52:00.361855+0000","last_peered":"2024-09-19T09:52:00.361855+0000","last_clean":"2024-09-19T09:52:00.361855+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:52:00.361855+0000","last_undegraded":"2024-09-19T09:52:00.361855+0000","last_fullsized":"2024-09-19T09:52:00.361855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369084+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:52:00.369084+0000","last_peered":"2024-09-19T09:52:00.369084+0000","last_clean":"2024-09-19T09:52:00.369084+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:52:00.369084+0000","last_undegraded":"2024-09-19T09:52:00.369084+0000","last_fullsized":"2024-09-19T09:52:00.369084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822749+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:51:31.822749+0000","last_peered":"2024-09-19T09:51:31.822749+0000","last_clean":"2024-09-19T09:51:31.822749+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:51:31.822749+0000","last_undegraded":"2024-09-19T09:51:31.822749+0000","last_fullsized":"2024-09-19T09:51:31.822749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.371499+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:52:00.371499+0000","last_peered":"2024-09-19T09:52:00.371499+0000","last_clean":"2024-09-19T09:52:00.371499+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:52:00.371499+0000","last_undegraded":"2024-09-19T09:52:00.371499+0000","last_fullsized":"2024-09-19T09:52:00.371499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822889+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:51:31.822889+0000","last_peered":"2024-09-19T09:51:31.822889+0000","last_clean":"2024-09-19T09:51:31.822889+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:51:31.822889+0000","last_undegraded":"2024-09-19T09:51:31.822889+0000","last_fullsized":"2024-09-19T09:51:31.822889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373597+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:52:00.373597+0000","last_peered":"2024-09-19T09:52:00.373597+0000","last_clean":"2024-09-19T09:52:00.373597+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:52:00.373597+0000","last_undegraded":"2024-09-19T09:52:00.373597+0000","last_fullsized":"2024-09-19T09:52:00.373597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823978+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:51:31.823978+0000","last_peered":"2024-09-19T09:51:31.823978+0000","last_clean":"2024-09-19T09:51:31.823978+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:51:31.823978+0000","last_undegraded":"2024-09-19T09:51:31.823978+0000","last_fullsized":"2024-09-19T09:51:31.823978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.349804+0000","last_change":"2024-09-19T09:51:31.824910+0000","last_active":"2024-09-19T09:52:00.349804+0000","last_peered":"2024-09-19T09:52:00.349804+0000","last_clean":"2024-09-19T09:52:00.349804+0000","last_became_active":"2024-09-19T09:51:31.824521+0000","last_became_peered":"2024-09-19T09:51:31.824521+0000","last_unstale":"2024-09-19T09:52:00.349804+0000","last_undegraded":"2024-09-19T09:52:00.349804+0000","last_fullsized":"2024-09-19T09:52:00.349804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:43.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:23.480142+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:52:23.480142+0000","last_peered":"2024-09-19T09:52:23.480142+0000","last_clean":"2024-09-19T09:52:23.480142+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:52:23.480142+0000","last_undegraded":"2024-09-19T09:52:23.480142+0000","last_fullsized":"2024-09-19T09:52:23.480142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68358,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1089,"num_read_kb":618,"num_write":253,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":214318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514533,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":442788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1617920,"data_stored":1095219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906991,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":443096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364856,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1036291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528382,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":442969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1034901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":442830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":509058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40472,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704680,"statfs":{"total":95995035648,"available":95953592320,"internally_reserved":0,"allocated":991232,"data_stored":509372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":443774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:52:29.596 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T09:52:29.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:52:29.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 -- 172.21.15.18:0/3043868493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97c4101c00 msgr2=0x7f97c4102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 --2- 172.21.15.18:0/3043868493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97c4101c00 0x7f97c4102080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009900 tx=0x7f97b802a410 comp rx=0 tx=0).stop 2024-09-19T09:52:29.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 -- 172.21.15.18:0/3043868493 shutdown_connections 2024-09-19T09:52:29.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 --2- 172.21.15.18:0/3043868493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c41025c0 0x7f97c4108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 --2- 172.21.15.18:0/3043868493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97c4101c00 0x7f97c4102080 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 --2- 172.21.15.18:0/3043868493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97c4100a10 0x7f97c4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 -- 172.21.15.18:0/3043868493 >> 172.21.15.18:0/3043868493 conn(0x7f97c40fc170 msgr2=0x7f97c40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:29.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 -- 172.21.15.18:0/3043868493 shutdown_connections 2024-09-19T09:52:29.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 -- 172.21.15.18:0/3043868493 wait complete. 2024-09-19T09:52:29.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 Processor -- start 2024-09-19T09:52:29.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.732+0000 7f97ca274640 1 -- start start 2024-09-19T09:52:29.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97ca274640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97c4100a10 0x7f97c4104950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97ca274640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97c4101c00 0x7f97c4102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97ca274640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c41025c0 0x7f97c4103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97ca274640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f97c410c690 con 0x7f97c4100a10 2024-09-19T09:52:29.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97ca274640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f97c410c510 con 0x7f97c4101c00 2024-09-19T09:52:29.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97ca274640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97c410c810 con 0x7f97c41025c0 2024-09-19T09:52:29.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97c4100a10 0x7f97c4104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97c4100a10 0x7f97c4104950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39576/0 (socket says 172.21.15.18:39576) 2024-09-19T09:52:29.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c3fff640 1 -- 172.21.15.18:0/2278301264 learned_addr learned my addr 172.21.15.18:0/2278301264 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:29.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c37fe640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97c4101c00 0x7f97c4102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c8811640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c41025c0 0x7f97c4103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c3fff640 1 -- 172.21.15.18:0/2278301264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c41025c0 msgr2=0x7f97c4103520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c3fff640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c41025c0 0x7f97c4103520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c3fff640 1 -- 172.21.15.18:0/2278301264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97c4101c00 msgr2=0x7f97c4102fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c3fff640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97c4101c00 0x7f97c4102fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c3fff640 1 -- 172.21.15.18:0/2278301264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c4103de0 con 0x7f97c4100a10 2024-09-19T09:52:29.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c8811640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c41025c0 0x7f97c4103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:29.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c3fff640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97c4100a10 0x7f97c4104950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f97b400e9c0 tx=0x7f97b400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:29.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.733+0000 7f97c17fa640 1 -- 172.21.15.18:0/2278301264 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b400cd80 con 0x7f97c4100a10 2024-09-19T09:52:29.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.734+0000 7f97c17fa640 1 -- 172.21.15.18:0/2278301264 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97b40035f0 con 0x7f97c4100a10 2024-09-19T09:52:29.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.734+0000 7f97ca274640 1 -- 172.21.15.18:0/2278301264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c41a1fd0 con 0x7f97c4100a10 2024-09-19T09:52:29.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.734+0000 7f97c17fa640 1 -- 172.21.15.18:0/2278301264 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4010690 con 0x7f97c4100a10 2024-09-19T09:52:29.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.734+0000 7f97ca274640 1 -- 172.21.15.18:0/2278301264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c41a2440 con 0x7f97c4100a10 2024-09-19T09:52:29.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.735+0000 7f97ca274640 1 -- 172.21.15.18:0/2278301264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c41a26d0 con 0x7f97c4100a10 2024-09-19T09:52:29.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.736+0000 7f97c17fa640 1 -- 172.21.15.18:0/2278301264 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f97b40037a0 con 0x7f97c4100a10 2024-09-19T09:52:29.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.736+0000 7f97c17fa640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f97ac0a32d0 0x7f97ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:29.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.737+0000 7f97c37fe640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f97ac0a32d0 0x7f97ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:29.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.737+0000 7f97c17fa640 1 -- 172.21.15.18:0/2278301264 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f97b40cfdd0 con 0x7f97c4100a10 2024-09-19T09:52:29.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.737+0000 7f97c37fe640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f97ac0a32d0 0x7f97ac0a5790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f97b8000c00 tx=0x7f97b80315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:29.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.740+0000 7f97c17fa640 1 -- 172.21.15.18:0/2278301264 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f97b409cb20 con 0x7f97c4100a10 2024-09-19T09:52:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.916+0000 7f97ca274640 1 -- 172.21.15.18:0/2278301264 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97c4069b00 con 0x7f97ac0a32d0 2024-09-19T09:52:29.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.922+0000 7f97c17fa640 1 -- 172.21.15.18:0/2278301264 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258870 (secure 0 0 0) 0x7f97c4069b00 con 0x7f97ac0a32d0 2024-09-19T09:52:29.928 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:29.929 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:52:29.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 -- 172.21.15.18:0/2278301264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f97ac0a32d0 msgr2=0x7f97ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f97ac0a32d0 0x7f97ac0a5790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f97b8000c00 tx=0x7f97b80315d0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 -- 172.21.15.18:0/2278301264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97c4100a10 msgr2=0x7f97c4104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97c4100a10 0x7f97c4104950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f97b400e9c0 tx=0x7f97b400ee80 comp rx=0 tx=0).stop 2024-09-19T09:52:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 -- 172.21.15.18:0/2278301264 shutdown_connections 2024-09-19T09:52:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f97ac0a32d0 0x7f97ac0a5790 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97c41025c0 0x7f97c4103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97c4101c00 0x7f97c4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 --2- 172.21.15.18:0/2278301264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97c4100a10 0x7f97c4104950 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 -- 172.21.15.18:0/2278301264 >> 172.21.15.18:0/2278301264 conn(0x7f97c40fc170 msgr2=0x7f97c40693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 -- 172.21.15.18:0/2278301264 shutdown_connections 2024-09-19T09:52:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:29.925+0000 7f97ca274640 1 -- 172.21.15.18:0/2278301264 wait complete. 2024-09-19T09:52:29.938 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-19T09:52:28.377769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658960,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1215,"num_read_kb":727,"num_write":436,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374660,"kb_used_data":12932,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567164,"statfs":{"total":1151940427776,"available":1151556775936,"internally_reserved":0,"allocated":13242368,"data_stored":7285276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":50,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003351"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372723+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:52:00.372723+0000","last_peered":"2024-09-19T09:52:00.372723+0000","last_clean":"2024-09-19T09:52:00.372723+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:52:00.372723+0000","last_undegraded":"2024-09-19T09:52:00.372723+0000","last_fullsized":"2024-09-19T09:52:00.372723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360023+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:52:00.360023+0000","last_peered":"2024-09-19T09:52:00.360023+0000","last_clean":"2024-09-19T09:52:00.360023+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:52:00.360023+0000","last_undegraded":"2024-09-19T09:52:00.360023+0000","last_fullsized":"2024-09-19T09:52:00.360023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373218+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:52:00.373218+0000","last_peered":"2024-09-19T09:52:00.373218+0000","last_clean":"2024-09-19T09:52:00.373218+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:52:00.373218+0000","last_undegraded":"2024-09-19T09:52:00.373218+0000","last_fullsized":"2024-09-19T09:52:00.373218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362542+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:52:00.362542+0000","last_peered":"2024-09-19T09:52:00.362542+0000","last_clean":"2024-09-19T09:52:00.362542+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:52:00.362542+0000","last_undegraded":"2024-09-19T09:52:00.362542+0000","last_fullsized":"2024-09-19T09:52:00.362542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.335091+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:52:00.335091+0000","last_peered":"2024-09-19T09:52:00.335091+0000","last_clean":"2024-09-19T09:52:00.335091+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:52:00.335091+0000","last_undegraded":"2024-09-19T09:52:00.335091+0000","last_fullsized":"2024-09-19T09:52:00.335091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359516+0000","last_change":"2024-09-19T09:51:31.818907+0000","last_active":"2024-09-19T09:52:00.359516+0000","last_peered":"2024-09-19T09:52:00.359516+0000","last_clean":"2024-09-19T09:52:00.359516+0000","last_became_active":"2024-09-19T09:51:31.818522+0000","last_became_peered":"2024-09-19T09:51:31.818522+0000","last_unstale":"2024-09-19T09:52:00.359516+0000","last_undegraded":"2024-09-19T09:52:00.359516+0000","last_fullsized":"2024-09-19T09:52:00.359516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:04.062704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365337+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:52:00.365337+0000","last_peered":"2024-09-19T09:52:00.365337+0000","last_clean":"2024-09-19T09:52:00.365337+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:52:00.365337+0000","last_undegraded":"2024-09-19T09:52:00.365337+0000","last_fullsized":"2024-09-19T09:52:00.365337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358908+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:52:00.358908+0000","last_peered":"2024-09-19T09:52:00.358908+0000","last_clean":"2024-09-19T09:52:00.358908+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:52:00.358908+0000","last_undegraded":"2024-09-19T09:52:00.358908+0000","last_fullsized":"2024-09-19T09:52:00.358908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370979+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:52:00.370979+0000","last_peered":"2024-09-19T09:52:00.370979+0000","last_clean":"2024-09-19T09:52:00.370979+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:52:00.370979+0000","last_undegraded":"2024-09-19T09:52:00.370979+0000","last_fullsized":"2024-09-19T09:52:00.370979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364519+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:52:00.364519+0000","last_peered":"2024-09-19T09:52:00.364519+0000","last_clean":"2024-09-19T09:52:00.364519+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:52:00.364519+0000","last_undegraded":"2024-09-19T09:52:00.364519+0000","last_fullsized":"2024-09-19T09:52:00.364519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.368226+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:52:00.368226+0000","last_peered":"2024-09-19T09:52:00.368226+0000","last_clean":"2024-09-19T09:52:00.368226+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:52:00.368226+0000","last_undegraded":"2024-09-19T09:52:00.368226+0000","last_fullsized":"2024-09-19T09:52:00.368226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362431+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:52:00.362431+0000","last_peered":"2024-09-19T09:52:00.362431+0000","last_clean":"2024-09-19T09:52:00.362431+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:52:00.362431+0000","last_undegraded":"2024-09-19T09:52:00.362431+0000","last_fullsized":"2024-09-19T09:52:00.362431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351092+0000","last_change":"2024-09-19T09:51:31.818910+0000","last_active":"2024-09-19T09:52:00.351092+0000","last_peered":"2024-09-19T09:52:00.351092+0000","last_clean":"2024-09-19T09:52:00.351092+0000","last_became_active":"2024-09-19T09:51:31.818581+0000","last_became_peered":"2024-09-19T09:51:31.818581+0000","last_unstale":"2024-09-19T09:52:00.351092+0000","last_undegraded":"2024-09-19T09:52:00.351092+0000","last_fullsized":"2024-09-19T09:52:00.351092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.736835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365871+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:52:00.365871+0000","last_peered":"2024-09-19T09:52:00.365871+0000","last_clean":"2024-09-19T09:52:00.365871+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:52:00.365871+0000","last_undegraded":"2024-09-19T09:52:00.365871+0000","last_fullsized":"2024-09-19T09:52:00.365871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361631+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:52:00.361631+0000","last_peered":"2024-09-19T09:52:00.361631+0000","last_clean":"2024-09-19T09:52:00.361631+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:52:00.361631+0000","last_undegraded":"2024-09-19T09:52:00.361631+0000","last_fullsized":"2024-09-19T09:52:00.361631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372654+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:52:00.372654+0000","last_peered":"2024-09-19T09:52:00.372654+0000","last_clean":"2024-09-19T09:52:00.372654+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:52:00.372654+0000","last_undegraded":"2024-09-19T09:52:00.372654+0000","last_fullsized":"2024-09-19T09:52:00.372654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373008+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:52:00.373008+0000","last_peered":"2024-09-19T09:52:00.373008+0000","last_clean":"2024-09-19T09:52:00.373008+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:52:00.373008+0000","last_undegraded":"2024-09-19T09:52:00.373008+0000","last_fullsized":"2024-09-19T09:52:00.373008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372768+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:52:00.372768+0000","last_peered":"2024-09-19T09:52:00.372768+0000","last_clean":"2024-09-19T09:52:00.372768+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:52:00.372768+0000","last_undegraded":"2024-09-19T09:52:00.372768+0000","last_fullsized":"2024-09-19T09:52:00.372768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.356302+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:52:00.356302+0000","last_peered":"2024-09-19T09:52:00.356302+0000","last_clean":"2024-09-19T09:52:00.356302+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:52:00.356302+0000","last_undegraded":"2024-09-19T09:52:00.356302+0000","last_fullsized":"2024-09-19T09:52:00.356302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351159+0000","last_change":"2024-09-19T09:51:31.823803+0000","last_active":"2024-09-19T09:52:00.351159+0000","last_peered":"2024-09-19T09:52:00.351159+0000","last_clean":"2024-09-19T09:52:00.351159+0000","last_became_active":"2024-09-19T09:51:31.823361+0000","last_became_peered":"2024-09-19T09:51:31.823361+0000","last_unstale":"2024-09-19T09:52:00.351159+0000","last_undegraded":"2024-09-19T09:52:00.351159+0000","last_fullsized":"2024-09-19T09:52:00.351159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:33.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364330+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:52:00.364330+0000","last_peered":"2024-09-19T09:52:00.364330+0000","last_clean":"2024-09-19T09:52:00.364330+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:52:00.364330+0000","last_undegraded":"2024-09-19T09:52:00.364330+0000","last_fullsized":"2024-09-19T09:52:00.364330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370710+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:52:00.370710+0000","last_peered":"2024-09-19T09:52:00.370710+0000","last_clean":"2024-09-19T09:52:00.370710+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:52:00.370710+0000","last_undegraded":"2024-09-19T09:52:00.370710+0000","last_fullsized":"2024-09-19T09:52:00.370710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358193+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:52:00.358193+0000","last_peered":"2024-09-19T09:52:00.358193+0000","last_clean":"2024-09-19T09:52:00.358193+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:52:00.358193+0000","last_undegraded":"2024-09-19T09:52:00.358193+0000","last_fullsized":"2024-09-19T09:52:00.358193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358828+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:52:00.358828+0000","last_peered":"2024-09-19T09:52:00.358828+0000","last_clean":"2024-09-19T09:52:00.358828+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:52:00.358828+0000","last_undegraded":"2024-09-19T09:52:00.358828+0000","last_fullsized":"2024-09-19T09:52:00.358828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.367256+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:52:00.367256+0000","last_peered":"2024-09-19T09:52:00.367256+0000","last_clean":"2024-09-19T09:52:00.367256+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:52:00.367256+0000","last_undegraded":"2024-09-19T09:52:00.367256+0000","last_fullsized":"2024-09-19T09:52:00.367256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.357344+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:52:00.357344+0000","last_peered":"2024-09-19T09:52:00.357344+0000","last_clean":"2024-09-19T09:52:00.357344+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:52:00.357344+0000","last_undegraded":"2024-09-19T09:52:00.357344+0000","last_fullsized":"2024-09-19T09:52:00.357344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351848+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:52:00.351848+0000","last_peered":"2024-09-19T09:52:00.351848+0000","last_clean":"2024-09-19T09:52:00.351848+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:52:00.351848+0000","last_undegraded":"2024-09-19T09:52:00.351848+0000","last_fullsized":"2024-09-19T09:52:00.351848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350260+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:52:00.350260+0000","last_peered":"2024-09-19T09:52:00.350260+0000","last_clean":"2024-09-19T09:52:00.350260+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:52:00.350260+0000","last_undegraded":"2024-09-19T09:52:00.350260+0000","last_fullsized":"2024-09-19T09:52:00.350260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361673+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:52:00.361673+0000","last_peered":"2024-09-19T09:52:00.361673+0000","last_clean":"2024-09-19T09:52:00.361673+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:52:00.361673+0000","last_undegraded":"2024-09-19T09:52:00.361673+0000","last_fullsized":"2024-09-19T09:52:00.361673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355490+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:52:00.355490+0000","last_peered":"2024-09-19T09:52:00.355490+0000","last_clean":"2024-09-19T09:52:00.355490+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:52:00.355490+0000","last_undegraded":"2024-09-19T09:52:00.355490+0000","last_fullsized":"2024-09-19T09:52:00.355490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361354+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:52:00.361354+0000","last_peered":"2024-09-19T09:52:00.361354+0000","last_clean":"2024-09-19T09:52:00.361354+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:52:00.361354+0000","last_undegraded":"2024-09-19T09:52:00.361354+0000","last_fullsized":"2024-09-19T09:52:00.361354+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353327+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:52:00.353327+0000","last_peered":"2024-09-19T09:52:00.353327+0000","last_clean":"2024-09-19T09:52:00.353327+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:52:00.353327+0000","last_undegraded":"2024-09-19T09:52:00.353327+0000","last_fullsized":"2024-09-19T09:52:00.353327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.345044+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:52:00.345044+0000","last_peered":"2024-09-19T09:52:00.345044+0000","last_clean":"2024-09-19T09:52:00.345044+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:52:00.345044+0000","last_undegraded":"2024-09-19T09:52:00.345044+0000","last_fullsized":"2024-09-19T09:52:00.345044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:26.489107+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:52:26.489107+0000","last_peered":"2024-09-19T09:52:26.489107+0000","last_clean":"2024-09-19T09:52:26.489107+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:52:26.489107+0000","last_undegraded":"2024-09-19T09:52:26.489107+0000","last_fullsized":"2024-09-19T09:52:26.489107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359507+0000","last_change":"2024-09-19T09:51:31.825618+0000","last_active":"2024-09-19T09:52:00.359507+0000","last_peered":"2024-09-19T09:52:00.359507+0000","last_clean":"2024-09-19T09:52:00.359507+0000","last_became_active":"2024-09-19T09:51:31.824727+0000","last_became_peered":"2024-09-19T09:51:31.824727+0000","last_unstale":"2024-09-19T09:52:00.359507+0000","last_undegraded":"2024-09-19T09:52:00.359507+0000","last_fullsized":"2024-09-19T09:52:00.359507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:52.094074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816210+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:51:31.816210+0000","last_peered":"2024-09-19T09:51:31.816210+0000","last_clean":"2024-09-19T09:51:31.816210+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:51:31.816210+0000","last_undegraded":"2024-09-19T09:51:31.816210+0000","last_fullsized":"2024-09-19T09:51:31.816210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814498+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:51:31.814498+0000","last_peered":"2024-09-19T09:51:31.814498+0000","last_clean":"2024-09-19T09:51:31.814498+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:51:31.814498+0000","last_undegraded":"2024-09-19T09:51:31.814498+0000","last_fullsized":"2024-09-19T09:51:31.814498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355727+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:52:00.355727+0000","last_peered":"2024-09-19T09:52:00.355727+0000","last_clean":"2024-09-19T09:52:00.355727+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.355727+0000","last_undegraded":"2024-09-19T09:52:00.355727+0000","last_fullsized":"2024-09-19T09:52:00.355727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815599+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:51:31.815599+0000","last_peered":"2024-09-19T09:51:31.815599+0000","last_clean":"2024-09-19T09:51:31.815599+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:51:31.815599+0000","last_undegraded":"2024-09-19T09:51:31.815599+0000","last_fullsized":"2024-09-19T09:51:31.815599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363759+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:52:00.363759+0000","last_peered":"2024-09-19T09:52:00.363759+0000","last_clean":"2024-09-19T09:52:00.363759+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:52:00.363759+0000","last_undegraded":"2024-09-19T09:52:00.363759+0000","last_fullsized":"2024-09-19T09:52:00.363759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":234,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:23.484062+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:52:23.484062+0000","last_peered":"2024-09-19T09:52:23.484062+0000","last_clean":"2024-09-19T09:52:23.484062+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:52:23.484062+0000","last_undegraded":"2024-09-19T09:52:23.484062+0000","last_fullsized":"2024-09-19T09:52:23.484062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373477+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:52:00.373477+0000","last_peered":"2024-09-19T09:52:00.373477+0000","last_clean":"2024-09-19T09:52:00.373477+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:52:00.373477+0000","last_undegraded":"2024-09-19T09:52:00.373477+0000","last_fullsized":"2024-09-19T09:52:00.373477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415018+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:51:32.415018+0000","last_peered":"2024-09-19T09:51:32.415018+0000","last_clean":"2024-09-19T09:51:32.415018+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:51:32.415018+0000","last_undegraded":"2024-09-19T09:51:32.415018+0000","last_fullsized":"2024-09-19T09:51:32.415018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361630+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:52:00.361630+0000","last_peered":"2024-09-19T09:52:00.361630+0000","last_clean":"2024-09-19T09:52:00.361630+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:52:00.361630+0000","last_undegraded":"2024-09-19T09:52:00.361630+0000","last_fullsized":"2024-09-19T09:52:00.361630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815716+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:51:31.815716+0000","last_peered":"2024-09-19T09:51:31.815716+0000","last_clean":"2024-09-19T09:51:31.815716+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:51:31.815716+0000","last_undegraded":"2024-09-19T09:51:31.815716+0000","last_fullsized":"2024-09-19T09:51:31.815716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373858+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:52:00.373858+0000","last_peered":"2024-09-19T09:52:00.373858+0000","last_clean":"2024-09-19T09:52:00.373858+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:52:00.373858+0000","last_undegraded":"2024-09-19T09:52:00.373858+0000","last_fullsized":"2024-09-19T09:52:00.373858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":272,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:23.484057+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:52:23.484057+0000","last_peered":"2024-09-19T09:52:23.484057+0000","last_clean":"2024-09-19T09:52:23.484057+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:52:23.484057+0000","last_undegraded":"2024-09-19T09:52:23.484057+0000","last_fullsized":"2024-09-19T09:52:23.484057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60868,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":217,"num_read_kb":168,"num_write":35,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363505+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:52:00.363505+0000","last_peered":"2024-09-19T09:52:00.363505+0000","last_clean":"2024-09-19T09:52:00.363505+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:52:00.363505+0000","last_undegraded":"2024-09-19T09:52:00.363505+0000","last_fullsized":"2024-09-19T09:52:00.363505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821655+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:51:31.821655+0000","last_peered":"2024-09-19T09:51:31.821655+0000","last_clean":"2024-09-19T09:51:31.821655+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:51:31.821655+0000","last_undegraded":"2024-09-19T09:51:31.821655+0000","last_fullsized":"2024-09-19T09:51:31.821655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363961+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:52:00.363961+0000","last_peered":"2024-09-19T09:52:00.363961+0000","last_clean":"2024-09-19T09:52:00.363961+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:52:00.363961+0000","last_undegraded":"2024-09-19T09:52:00.363961+0000","last_fullsized":"2024-09-19T09:52:00.363961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815497+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:31.815497+0000","last_peered":"2024-09-19T09:51:31.815497+0000","last_clean":"2024-09-19T09:51:31.815497+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:51:31.815497+0000","last_undegraded":"2024-09-19T09:51:31.815497+0000","last_fullsized":"2024-09-19T09:51:31.815497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369638+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:52:00.369638+0000","last_peered":"2024-09-19T09:52:00.369638+0000","last_clean":"2024-09-19T09:52:00.369638+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:52:00.369638+0000","last_undegraded":"2024-09-19T09:52:00.369638+0000","last_fullsized":"2024-09-19T09:52:00.369638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'7","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:22.479521+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:52:22.479521+0000","last_peered":"2024-09-19T09:52:22.479521+0000","last_clean":"2024-09-19T09:52:22.479521+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:52:22.479521+0000","last_undegraded":"2024-09-19T09:52:22.479521+0000","last_fullsized":"2024-09-19T09:52:22.479521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365299+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:52:00.365299+0000","last_peered":"2024-09-19T09:52:00.365299+0000","last_clean":"2024-09-19T09:52:00.365299+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:52:00.365299+0000","last_undegraded":"2024-09-19T09:52:00.365299+0000","last_fullsized":"2024-09-19T09:52:00.365299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821556+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:51:31.821556+0000","last_peered":"2024-09-19T09:51:31.821556+0000","last_clean":"2024-09-19T09:51:31.821556+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:51:31.821556+0000","last_undegraded":"2024-09-19T09:51:31.821556+0000","last_fullsized":"2024-09-19T09:51:31.821556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359861+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:52:00.359861+0000","last_peered":"2024-09-19T09:52:00.359861+0000","last_clean":"2024-09-19T09:52:00.359861+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:52:00.359861+0000","last_undegraded":"2024-09-19T09:52:00.359861+0000","last_fullsized":"2024-09-19T09:52:00.359861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822551+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:51:31.822551+0000","last_peered":"2024-09-19T09:51:31.822551+0000","last_clean":"2024-09-19T09:51:31.822551+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:51:31.822551+0000","last_undegraded":"2024-09-19T09:51:31.822551+0000","last_fullsized":"2024-09-19T09:51:31.822551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.352459+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:52:00.352459+0000","last_peered":"2024-09-19T09:52:00.352459+0000","last_clean":"2024-09-19T09:52:00.352459+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:52:00.352459+0000","last_undegraded":"2024-09-19T09:52:00.352459+0000","last_fullsized":"2024-09-19T09:52:00.352459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814756+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:51:31.814756+0000","last_peered":"2024-09-19T09:51:31.814756+0000","last_clean":"2024-09-19T09:51:31.814756+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:51:31.814756+0000","last_undegraded":"2024-09-19T09:51:31.814756+0000","last_fullsized":"2024-09-19T09:51:31.814756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.366823+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:52:00.366823+0000","last_peered":"2024-09-19T09:52:00.366823+0000","last_clean":"2024-09-19T09:52:00.366823+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:52:00.366823+0000","last_undegraded":"2024-09-19T09:52:00.366823+0000","last_fullsized":"2024-09-19T09:52:00.366823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815831+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:51:31.815831+0000","last_peered":"2024-09-19T09:51:31.815831+0000","last_clean":"2024-09-19T09:51:31.815831+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:51:31.815831+0000","last_undegraded":"2024-09-19T09:51:31.815831+0000","last_fullsized":"2024-09-19T09:51:31.815831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365646+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:52:00.365646+0000","last_peered":"2024-09-19T09:52:00.365646+0000","last_clean":"2024-09-19T09:52:00.365646+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:52:00.365646+0000","last_undegraded":"2024-09-19T09:52:00.365646+0000","last_fullsized":"2024-09-19T09:52:00.365646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":136,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:25.487573+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:52:25.487573+0000","last_peered":"2024-09-19T09:52:25.487573+0000","last_clean":"2024-09-19T09:52:25.487573+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:52:25.487573+0000","last_undegraded":"2024-09-19T09:52:25.487573+0000","last_fullsized":"2024-09-19T09:52:25.487573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360813+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:52:00.360813+0000","last_peered":"2024-09-19T09:52:00.360813+0000","last_clean":"2024-09-19T09:52:00.360813+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:52:00.360813+0000","last_undegraded":"2024-09-19T09:52:00.360813+0000","last_fullsized":"2024-09-19T09:52:00.360813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414764+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:51:32.414764+0000","last_peered":"2024-09-19T09:51:32.414764+0000","last_clean":"2024-09-19T09:51:32.414764+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:51:32.414764+0000","last_undegraded":"2024-09-19T09:51:32.414764+0000","last_fullsized":"2024-09-19T09:51:32.414764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.169977+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:51:32.169977+0000","last_peered":"2024-09-19T09:51:32.169977+0000","last_clean":"2024-09-19T09:51:32.169977+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:51:32.169977+0000","last_undegraded":"2024-09-19T09:51:32.169977+0000","last_fullsized":"2024-09-19T09:51:32.169977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.348017+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:52:00.348017+0000","last_peered":"2024-09-19T09:52:00.348017+0000","last_clean":"2024-09-19T09:52:00.348017+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:52:00.348017+0000","last_undegraded":"2024-09-19T09:52:00.348017+0000","last_fullsized":"2024-09-19T09:52:00.348017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414691+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:51:32.414691+0000","last_peered":"2024-09-19T09:51:32.414691+0000","last_clean":"2024-09-19T09:51:32.414691+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:51:32.414691+0000","last_undegraded":"2024-09-19T09:51:32.414691+0000","last_fullsized":"2024-09-19T09:51:32.414691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350367+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:52:00.350367+0000","last_peered":"2024-09-19T09:52:00.350367+0000","last_clean":"2024-09-19T09:52:00.350367+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:52:00.350367+0000","last_undegraded":"2024-09-19T09:52:00.350367+0000","last_fullsized":"2024-09-19T09:52:00.350367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:22.478747+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:52:22.478747+0000","last_peered":"2024-09-19T09:52:22.478747+0000","last_clean":"2024-09-19T09:52:22.478747+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:52:22.478747+0000","last_undegraded":"2024-09-19T09:52:22.478747+0000","last_fullsized":"2024-09-19T09:52:22.478747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359314+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:52:00.359314+0000","last_peered":"2024-09-19T09:52:00.359314+0000","last_clean":"2024-09-19T09:52:00.359314+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:52:00.359314+0000","last_undegraded":"2024-09-19T09:52:00.359314+0000","last_fullsized":"2024-09-19T09:52:00.359314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":135,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:22.479412+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:52:22.479412+0000","last_peered":"2024-09-19T09:52:22.479412+0000","last_clean":"2024-09-19T09:52:22.479412+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:52:22.479412+0000","last_undegraded":"2024-09-19T09:52:22.479412+0000","last_fullsized":"2024-09-19T09:52:22.479412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363822+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:52:00.363822+0000","last_peered":"2024-09-19T09:52:00.363822+0000","last_clean":"2024-09-19T09:52:00.363822+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:52:00.363822+0000","last_undegraded":"2024-09-19T09:52:00.363822+0000","last_fullsized":"2024-09-19T09:52:00.363822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824076+0000","last_change":"2024-09-19T09:51:31.824076+0000","last_active":"2024-09-19T09:51:31.824076+0000","last_peered":"2024-09-19T09:51:31.824076+0000","last_clean":"2024-09-19T09:51:31.824076+0000","last_became_active":"2024-09-19T09:51:31.823642+0000","last_became_peered":"2024-09-19T09:51:31.823642+0000","last_unstale":"2024-09-19T09:51:31.824076+0000","last_undegraded":"2024-09-19T09:51:31.824076+0000","last_fullsized":"2024-09-19T09:51:31.824076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:53.035531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361772+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:52:00.361772+0000","last_peered":"2024-09-19T09:52:00.361772+0000","last_clean":"2024-09-19T09:52:00.361772+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:52:00.361772+0000","last_undegraded":"2024-09-19T09:52:00.361772+0000","last_fullsized":"2024-09-19T09:52:00.361772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822947+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:51:31.822947+0000","last_peered":"2024-09-19T09:51:31.822947+0000","last_clean":"2024-09-19T09:51:31.822947+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:51:31.822947+0000","last_undegraded":"2024-09-19T09:51:31.822947+0000","last_fullsized":"2024-09-19T09:51:31.822947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350408+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:52:00.350408+0000","last_peered":"2024-09-19T09:52:00.350408+0000","last_clean":"2024-09-19T09:52:00.350408+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:52:00.350408+0000","last_undegraded":"2024-09-19T09:52:00.350408+0000","last_fullsized":"2024-09-19T09:52:00.350408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'15","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.817992+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:51:31.817992+0000","last_peered":"2024-09-19T09:51:31.817992+0000","last_clean":"2024-09-19T09:51:31.817992+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:51:31.817992+0000","last_undegraded":"2024-09-19T09:51:31.817992+0000","last_fullsized":"2024-09-19T09:51:31.817992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360865+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:52:00.360865+0000","last_peered":"2024-09-19T09:52:00.360865+0000","last_clean":"2024-09-19T09:52:00.360865+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:52:00.360865+0000","last_undegraded":"2024-09-19T09:52:00.360865+0000","last_fullsized":"2024-09-19T09:52:00.360865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170286+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:51:32.170286+0000","last_peered":"2024-09-19T09:51:32.170286+0000","last_clean":"2024-09-19T09:51:32.170286+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:51:32.170286+0000","last_undegraded":"2024-09-19T09:51:32.170286+0000","last_fullsized":"2024-09-19T09:51:32.170286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361925+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:52:00.361925+0000","last_peered":"2024-09-19T09:52:00.361925+0000","last_clean":"2024-09-19T09:52:00.361925+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:52:00.361925+0000","last_undegraded":"2024-09-19T09:52:00.361925+0000","last_fullsized":"2024-09-19T09:52:00.361925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964590+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:51:32.964590+0000","last_peered":"2024-09-19T09:51:32.964590+0000","last_clean":"2024-09-19T09:51:32.964590+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:51:32.964590+0000","last_undegraded":"2024-09-19T09:51:32.964590+0000","last_fullsized":"2024-09-19T09:51:32.964590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.320920+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:52:00.320920+0000","last_peered":"2024-09-19T09:52:00.320920+0000","last_clean":"2024-09-19T09:52:00.320920+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.320920+0000","last_undegraded":"2024-09-19T09:52:00.320920+0000","last_fullsized":"2024-09-19T09:52:00.320920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823345+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:51:31.823345+0000","last_peered":"2024-09-19T09:51:31.823345+0000","last_clean":"2024-09-19T09:51:31.823345+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:51:31.823345+0000","last_undegraded":"2024-09-19T09:51:31.823345+0000","last_fullsized":"2024-09-19T09:51:31.823345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353447+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:52:00.353447+0000","last_peered":"2024-09-19T09:52:00.353447+0000","last_clean":"2024-09-19T09:52:00.353447+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:52:00.353447+0000","last_undegraded":"2024-09-19T09:52:00.353447+0000","last_fullsized":"2024-09-19T09:52:00.353447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.830511+0000","last_change":"2024-09-19T09:51:31.830511+0000","last_active":"2024-09-19T09:51:31.830511+0000","last_peered":"2024-09-19T09:51:31.830511+0000","last_clean":"2024-09-19T09:51:31.830511+0000","last_became_active":"2024-09-19T09:51:31.825672+0000","last_became_peered":"2024-09-19T09:51:31.825672+0000","last_unstale":"2024-09-19T09:51:31.830511+0000","last_undegraded":"2024-09-19T09:51:31.830511+0000","last_fullsized":"2024-09-19T09:51:31.830511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.101027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360592+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:52:00.360592+0000","last_peered":"2024-09-19T09:52:00.360592+0000","last_clean":"2024-09-19T09:52:00.360592+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:52:00.360592+0000","last_undegraded":"2024-09-19T09:52:00.360592+0000","last_fullsized":"2024-09-19T09:52:00.360592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821791+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:51:31.821791+0000","last_peered":"2024-09-19T09:51:31.821791+0000","last_clean":"2024-09-19T09:51:31.821791+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:51:31.821791+0000","last_undegraded":"2024-09-19T09:51:31.821791+0000","last_fullsized":"2024-09-19T09:51:31.821791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361855+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:52:00.361855+0000","last_peered":"2024-09-19T09:52:00.361855+0000","last_clean":"2024-09-19T09:52:00.361855+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:52:00.361855+0000","last_undegraded":"2024-09-19T09:52:00.361855+0000","last_fullsized":"2024-09-19T09:52:00.361855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369084+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:52:00.369084+0000","last_peered":"2024-09-19T09:52:00.369084+0000","last_clean":"2024-09-19T09:52:00.369084+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:52:00.369084+0000","last_undegraded":"2024-09-19T09:52:00.369084+0000","last_fullsized":"2024-09-19T09:52:00.369084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822749+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:51:31.822749+0000","last_peered":"2024-09-19T09:51:31.822749+0000","last_clean":"2024-09-19T09:51:31.822749+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:51:31.822749+0000","last_undegraded":"2024-09-19T09:51:31.822749+0000","last_fullsized":"2024-09-19T09:51:31.822749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.371499+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:52:00.371499+0000","last_peered":"2024-09-19T09:52:00.371499+0000","last_clean":"2024-09-19T09:52:00.371499+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:52:00.371499+0000","last_undegraded":"2024-09-19T09:52:00.371499+0000","last_fullsized":"2024-09-19T09:52:00.371499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822889+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:51:31.822889+0000","last_peered":"2024-09-19T09:51:31.822889+0000","last_clean":"2024-09-19T09:51:31.822889+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:51:31.822889+0000","last_undegraded":"2024-09-19T09:51:31.822889+0000","last_fullsized":"2024-09-19T09:51:31.822889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373597+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:52:00.373597+0000","last_peered":"2024-09-19T09:52:00.373597+0000","last_clean":"2024-09-19T09:52:00.373597+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:52:00.373597+0000","last_undegraded":"2024-09-19T09:52:00.373597+0000","last_fullsized":"2024-09-19T09:52:00.373597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823978+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:51:31.823978+0000","last_peered":"2024-09-19T09:51:31.823978+0000","last_clean":"2024-09-19T09:51:31.823978+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:51:31.823978+0000","last_undegraded":"2024-09-19T09:51:31.823978+0000","last_fullsized":"2024-09-19T09:51:31.823978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.349804+0000","last_change":"2024-09-19T09:51:31.824910+0000","last_active":"2024-09-19T09:52:00.349804+0000","last_peered":"2024-09-19T09:52:00.349804+0000","last_clean":"2024-09-19T09:52:00.349804+0000","last_became_active":"2024-09-19T09:51:31.824521+0000","last_became_peered":"2024-09-19T09:51:31.824521+0000","last_unstale":"2024-09-19T09:52:00.349804+0000","last_undegraded":"2024-09-19T09:52:00.349804+0000","last_fullsized":"2024-09-19T09:52:00.349804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:43.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:23.480142+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:52:23.480142+0000","last_peered":"2024-09-19T09:52:23.480142+0000","last_clean":"2024-09-19T09:52:23.480142+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:52:23.480142+0000","last_undegraded":"2024-09-19T09:52:23.480142+0000","last_fullsized":"2024-09-19T09:52:23.480142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68358,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1089,"num_read_kb":618,"num_write":253,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":214318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514533,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":442788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1617920,"data_stored":1095219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906991,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":443096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364856,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1036291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528382,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":442969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1034901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":442830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":509058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40472,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704680,"statfs":{"total":95995035648,"available":95953592320,"internally_reserved":0,"allocated":991232,"data_stored":509372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":443774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:52:29.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:52:30.234 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:30.356 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:29 smithi018 ceph-mon[30956]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T09:52:30.356 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:29 smithi018 ceph-mon[30956]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:30.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:29 smithi049 ceph-mon[34858]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T09:52:30.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:29 smithi049 ceph-mon[34858]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:29 smithi162 ceph-mon[35174]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T09:52:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:29 smithi162 ceph-mon[35174]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.718+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/645804068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c010c170 msgr2=0x7fc9c010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.718+0000 7fc9c4b1f640 1 --2- 172.21.15.18:0/645804068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c010c170 0x7fc9c010e610 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009ca0 tx=0x7fc9b802a950 comp rx=0 tx=0).stop 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.718+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/645804068 shutdown_connections 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.718+0000 7fc9c4b1f640 1 --2- 172.21.15.18:0/645804068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c010c170 0x7fc9c010e610 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.718+0000 7fc9c4b1f640 1 --2- 172.21.15.18:0/645804068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9c0103660 0x7fc9c010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.718+0000 7fc9c4b1f640 1 --2- 172.21.15.18:0/645804068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c0102d40 0x7fc9c0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.718+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/645804068 >> 172.21.15.18:0/645804068 conn(0x7fc9c00fc7a0 msgr2=0x7fc9c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.718+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/645804068 shutdown_connections 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.718+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/645804068 wait complete. 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9c4b1f640 1 Processor -- start 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9c4b1f640 1 -- start start 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9c4b1f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9c0102d40 0x7fc9c0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9c4b1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c0103660 0x7fc9c01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9c4b1f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c010c170 0x7fc9c019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9c4b1f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0111f50 con 0x7fc9c0103660 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9c4b1f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0111dd0 con 0x7fc9c010c170 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9c4b1f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01120d0 con 0x7fc9c0102d40 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9bdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c0103660 0x7fc9c01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9bdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c0103660 0x7fc9c01989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39592/0 (socket says 172.21.15.18:39592) 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.719+0000 7fc9bdd9b640 1 -- 172.21.15.18:0/638937887 learned_addr learned my addr 172.21.15.18:0/638937887 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9bed9d640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c010c170 0x7fc9c019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9be59c640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9c0102d40 0x7fc9c0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9bdd9b640 1 -- 172.21.15.18:0/638937887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9c0102d40 msgr2=0x7fc9c0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9bdd9b640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9c0102d40 0x7fc9c0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9bdd9b640 1 -- 172.21.15.18:0/638937887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c010c170 msgr2=0x7fc9c019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9bdd9b640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c010c170 0x7fc9c019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9bdd9b640 1 -- 172.21.15.18:0/638937887 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c019d410 con 0x7fc9c0103660 2024-09-19T09:52:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9bdd9b640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c0103660 0x7fc9c01989a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800c970 tx=0x7fc9a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9b77fe640 1 -- 172.21.15.18:0/638937887 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8007bb0 con 0x7fc9c0103660 2024-09-19T09:52:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9b77fe640 1 -- 172.21.15.18:0/638937887 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a8007d50 con 0x7fc9c0103660 2024-09-19T09:52:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9b77fe640 1 -- 172.21.15.18:0/638937887 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a800f450 con 0x7fc9c0103660 2024-09-19T09:52:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/638937887 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c019d700 con 0x7fc9c0103660 2024-09-19T09:52:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.720+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/638937887 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c01a4fe0 con 0x7fc9c0103660 2024-09-19T09:52:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.721+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/638937887 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c0103120 con 0x7fc9c0103660 2024-09-19T09:52:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.723+0000 7fc9b77fe640 1 -- 172.21.15.18:0/638937887 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc9a8004f60 con 0x7fc9c0103660 2024-09-19T09:52:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.723+0000 7fc9b77fe640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9ac0a3240 0x7fc9ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.723+0000 7fc9b77fe640 1 -- 172.21.15.18:0/638937887 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc9a80cf540 con 0x7fc9c0103660 2024-09-19T09:52:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.724+0000 7fc9be59c640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9ac0a3240 0x7fc9ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.724+0000 7fc9be59c640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9ac0a3240 0x7fc9ac0a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0005fd0 tx=0x7fc9b000b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.727+0000 7fc9b77fe640 1 -- 172.21.15.18:0/638937887 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9a8014030 con 0x7fc9c0103660 2024-09-19T09:52:30.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.941+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/638937887 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9c0107210 con 0x7fc9c0103660 2024-09-19T09:52:30.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.941+0000 7fc9b77fe640 1 -- 172.21.15.18:0/638937887 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fc9a809c290 con 0x7fc9c0103660 2024-09-19T09:52:30.943 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:30.944 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:52:30.944 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:52:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/638937887 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9ac0a3240 msgr2=0x7fc9ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9ac0a3240 0x7fc9ac0a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0005fd0 tx=0x7fc9b000b590 comp rx=0 tx=0).stop 2024-09-19T09:52:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/638937887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c0103660 msgr2=0x7fc9c01989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c0103660 0x7fc9c01989a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800c970 tx=0x7fc9a800ce30 comp rx=0 tx=0).stop 2024-09-19T09:52:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/638937887 shutdown_connections 2024-09-19T09:52:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9ac0a3240 0x7fc9ac0a5700 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c010c170 0x7fc9c019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c0103660 0x7fc9c01989a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 --2- 172.21.15.18:0/638937887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9c0102d40 0x7fc9c0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/638937887 >> 172.21.15.18:0/638937887 conn(0x7fc9c00fc7a0 msgr2=0x7fc9c00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/638937887 shutdown_connections 2024-09-19T09:52:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:30.944+0000 7fc9c4b1f640 1 -- 172.21.15.18:0/638937887 wait complete. 2024-09-19T09:52:31.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:30 smithi018 ceph-mon[30956]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:31.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:30 smithi018 ceph-mon[30956]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:31.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:30 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/638937887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:31.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:30 smithi049 ceph-mon[34858]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:31.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:30 smithi049 ceph-mon[34858]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:31.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:30 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/638937887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:31.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:30 smithi162 ceph-mon[35174]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:31.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:30 smithi162 ceph-mon[35174]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:31.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:30 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/638937887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:31.699 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:52:31.963 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:32.229 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:31 smithi018 ceph-mon[30956]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:52:32.229 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:52:32.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:31 smithi049 ceph-mon[34858]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:52:32.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:52:32.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:31 smithi162 ceph-mon[35174]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:52:32.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:52:32.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.446+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/3470952898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc10c170 msgr2=0x7f2fcc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:32.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.446+0000 7f2fd2fd8640 1 --2- 172.21.15.18:0/3470952898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc10c170 0x7f2fcc10e610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009be0 tx=0x7f2fc402a750 comp rx=0 tx=0).stop 2024-09-19T09:52:32.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.446+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/3470952898 shutdown_connections 2024-09-19T09:52:32.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.446+0000 7f2fd2fd8640 1 --2- 172.21.15.18:0/3470952898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc10c170 0x7f2fcc10e610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:32.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.446+0000 7f2fd2fd8640 1 --2- 172.21.15.18:0/3470952898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc103660 0x7f2fcc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:32.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.446+0000 7f2fd2fd8640 1 --2- 172.21.15.18:0/3470952898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc102d40 0x7f2fcc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:32.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.446+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/3470952898 >> 172.21.15.18:0/3470952898 conn(0x7f2fcc0fc7a0 msgr2=0x7f2fcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:32.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.446+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/3470952898 shutdown_connections 2024-09-19T09:52:32.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.446+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/3470952898 wait complete. 2024-09-19T09:52:32.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fd2fd8640 1 Processor -- start 2024-09-19T09:52:32.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fd2fd8640 1 -- start start 2024-09-19T09:52:32.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fd2fd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc102d40 0x7f2fcc1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:32.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fd2fd8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc103660 0x7f2fcc100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:32.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fd2fd8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc10c170 0x7f2fcc101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:32.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fd2fd8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc111f00 con 0x7f2fcc103660 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fd2fd8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc111d80 con 0x7f2fcc10c170 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fd2fd8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc112080 con 0x7f2fcc102d40 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fcbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc103660 0x7f2fcc100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fd1575640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc10c170 0x7f2fcc101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fcbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc103660 0x7f2fcc100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39610/0 (socket says 172.21.15.18:39610) 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fcbfff640 1 -- 172.21.15.18:0/4135735926 learned_addr learned my addr 172.21.15.18:0/4135735926 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.447+0000 7f2fd0d74640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc102d40 0x7f2fcc1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fd1575640 1 -- 172.21.15.18:0/4135735926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc102d40 msgr2=0x7f2fcc1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fd1575640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc102d40 0x7f2fcc1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fd1575640 1 -- 172.21.15.18:0/4135735926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc103660 msgr2=0x7f2fcc100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fd1575640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc103660 0x7f2fcc100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fd1575640 1 -- 172.21.15.18:0/4135735926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc1a6890 con 0x7f2fcc10c170 2024-09-19T09:52:32.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fd0d74640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc102d40 0x7f2fcc1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:32.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fcbfff640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc103660 0x7f2fcc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:32.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fd1575640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc10c170 0x7f2fcc101420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4034040 tx=0x7f2fc40305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:32.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fc9ffb640 1 -- 172.21.15.18:0/4135735926 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4041020 con 0x7f2fcc10c170 2024-09-19T09:52:32.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/4135735926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fcc1a6b20 con 0x7f2fcc10c170 2024-09-19T09:52:32.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fc9ffb640 1 -- 172.21.15.18:0/4135735926 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fc4037040 con 0x7f2fcc10c170 2024-09-19T09:52:32.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fc9ffb640 1 -- 172.21.15.18:0/4135735926 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4036070 con 0x7f2fcc10c170 2024-09-19T09:52:32.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.448+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/4135735926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fcc1a7050 con 0x7f2fcc10c170 2024-09-19T09:52:32.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.449+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/4135735926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fcc103120 con 0x7f2fcc10c170 2024-09-19T09:52:32.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.451+0000 7f2fc9ffb640 1 -- 172.21.15.18:0/4135735926 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2fc4044020 con 0x7f2fcc10c170 2024-09-19T09:52:32.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.451+0000 7f2fc9ffb640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fbc0a3240 0x7f2fbc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:32.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.452+0000 7f2fd0d74640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fbc0a3240 0x7f2fbc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:32.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.452+0000 7f2fc9ffb640 1 -- 172.21.15.18:0/4135735926 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2fc40f0690 con 0x7f2fcc10c170 2024-09-19T09:52:32.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.452+0000 7f2fd0d74640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fbc0a3240 0x7f2fbc0a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0005fd0 tx=0x7f2fc0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:32.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.455+0000 7f2fc9ffb640 1 -- 172.21.15.18:0/4135735926 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2fc404b020 con 0x7f2fcc10c170 2024-09-19T09:52:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.650+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/4135735926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fcc02d7c0 con 0x7f2fcc10c170 2024-09-19T09:52:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.652+0000 7f2fc9ffb640 1 -- 172.21.15.18:0/4135735926 <== mon.2 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22571 (secure 0 0 0) 0x7f2fc40bd4a0 con 0x7f2fcc10c170 2024-09-19T09:52:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:32.655 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:51:31.811334+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:52:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.654+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/4135735926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fbc0a3240 msgr2=0x7f2fbc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.654+0000 7f2fd2fd8640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fbc0a3240 0x7f2fbc0a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0005fd0 tx=0x7f2fc0009260 comp rx=0 tx=0).stop 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.654+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/4135735926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc10c170 msgr2=0x7f2fcc101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.654+0000 7f2fd2fd8640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc10c170 0x7f2fcc101420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4034040 tx=0x7f2fc40305d0 comp rx=0 tx=0).stop 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.654+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/4135735926 shutdown_connections 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.654+0000 7f2fd2fd8640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2fbc0a3240 0x7f2fbc0a5700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.654+0000 7f2fd2fd8640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fcc10c170 0x7f2fcc101420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.654+0000 7f2fd2fd8640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fcc103660 0x7f2fcc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.654+0000 7f2fd2fd8640 1 --2- 172.21.15.18:0/4135735926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc102d40 0x7f2fcc1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.654+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/4135735926 >> 172.21.15.18:0/4135735926 conn(0x7f2fcc0fc7a0 msgr2=0x7f2fcc0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.655+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/4135735926 shutdown_connections 2024-09-19T09:52:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:32.655+0000 7f2fd2fd8640 1 -- 172.21.15.18:0/4135735926 wait complete. 2024-09-19T09:52:33.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:32 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/4135735926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:33.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:32 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4135735926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:33.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:32 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/4135735926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:33.424 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T09:52:33.424 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T09:52:33.434 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:52:33.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T09:52:33.435 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T09:52:33.435 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:52:33.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:52:33.438 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T09:52:33.498 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:52:33.498 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:52:33.812 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:33.819 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:34.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:33 smithi018 ceph-mon[30956]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:52:34.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.215 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:33 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:33 smithi049 ceph-mon[34858]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:52:34.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:33 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:33 smithi162 ceph-mon[35174]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:52:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:33 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.515+0000 7f66eb975640 1 -- 172.21.15.18:0/1984574868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66e4101280 msgr2=0x7f66e410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.515+0000 7f66eb975640 1 --2- 172.21.15.18:0/1984574868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66e4101280 0x7f66e410df40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009900 tx=0x7f66d802a410 comp rx=0 tx=0).stop 2024-09-19T09:52:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.515+0000 7f66eb975640 1 -- 172.21.15.18:0/1984574868 shutdown_connections 2024-09-19T09:52:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.515+0000 7f66eb975640 1 --2- 172.21.15.18:0/1984574868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66e410e480 0x7f66e4110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.515+0000 7f66eb975640 1 --2- 172.21.15.18:0/1984574868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66e4101280 0x7f66e410df40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.515+0000 7f66eb975640 1 --2- 172.21.15.18:0/1984574868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66e41008d0 0x7f66e4100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.515+0000 7f66eb975640 1 -- 172.21.15.18:0/1984574868 >> 172.21.15.18:0/1984574868 conn(0x7f66e40fc7a0 msgr2=0x7f66e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.515+0000 7f66eb975640 1 -- 172.21.15.18:0/1984574868 shutdown_connections 2024-09-19T09:52:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.515+0000 7f66eb975640 1 -- 172.21.15.18:0/1984574868 wait complete. 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66eb975640 1 Processor -- start 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66eb975640 1 -- start start 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66eb975640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66e41008d0 0x7f66e41a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66eb975640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66e4101280 0x7f66e41a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66eb975640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66e410e480 0x7f66e419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66eb975640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4114220 con 0x7f66e41008d0 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66eb975640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f66e41140a0 con 0x7f66e410e480 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66eb975640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66e41143a0 con 0x7f66e4101280 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66e9711640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66e41008d0 0x7f66e41a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66e9711640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66e41008d0 0x7f66e41a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39632/0 (socket says 172.21.15.18:39632) 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66e9711640 1 -- 172.21.15.18:0/1428886163 learned_addr learned my addr 172.21.15.18:0/1428886163 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66e9f12640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66e410e480 0x7f66e419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66e8f10640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66e4101280 0x7f66e41a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66e9711640 1 -- 172.21.15.18:0/1428886163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66e4101280 msgr2=0x7f66e41a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66e9711640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66e4101280 0x7f66e41a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66e9711640 1 -- 172.21.15.18:0/1428886163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66e410e480 msgr2=0x7f66e419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.516+0000 7f66e9711640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66e410e480 0x7f66e419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.517+0000 7f66e9711640 1 -- 172.21.15.18:0/1428886163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e419ad00 con 0x7f66e41008d0 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.517+0000 7f66e9711640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66e41008d0 0x7f66e41a0410 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f66d400b4a0 tx=0x7f66d400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.517+0000 7f66e27fc640 1 -- 172.21.15.18:0/1428886163 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4014070 con 0x7f66e41008d0 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.517+0000 7f66e27fc640 1 -- 172.21.15.18:0/1428886163 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66d4010af0 con 0x7f66e41008d0 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.517+0000 7f66eb975640 1 -- 172.21.15.18:0/1428886163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e419aff0 con 0x7f66e41008d0 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.517+0000 7f66e27fc640 1 -- 172.21.15.18:0/1428886163 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4017d10 con 0x7f66e41008d0 2024-09-19T09:52:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.517+0000 7f66eb975640 1 -- 172.21.15.18:0/1428886163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e41a72e0 con 0x7f66e41008d0 2024-09-19T09:52:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.518+0000 7f66eb975640 1 -- 172.21.15.18:0/1428886163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e4100cb0 con 0x7f66e41008d0 2024-09-19T09:52:34.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.519+0000 7f66e27fc640 1 -- 172.21.15.18:0/1428886163 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f66d4017070 con 0x7f66e41008d0 2024-09-19T09:52:34.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.520+0000 7f66e27fc640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66cc0a32c0 0x7f66cc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.520+0000 7f66e27fc640 1 -- 172.21.15.18:0/1428886163 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f66d40cec30 con 0x7f66e41008d0 2024-09-19T09:52:34.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.520+0000 7f66e8f10640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66cc0a32c0 0x7f66cc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.521+0000 7f66e8f10640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66cc0a32c0 0x7f66cc0a5780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f66e419b710 tx=0x7f66d8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:34.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.524+0000 7f66e27fc640 1 -- 172.21.15.18:0/1428886163 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66d409b920 con 0x7f66e41008d0 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.669+0000 7f91ee91d640 1 -- 172.21.15.18:0/601055595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91e81082a0 msgr2=0x7f91e810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.669+0000 7f91ee91d640 1 --2- 172.21.15.18:0/601055595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91e81082a0 0x7f91e810ec40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009cd0 tx=0x7f91e002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.669+0000 7f91ee91d640 1 -- 172.21.15.18:0/601055595 shutdown_connections 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.669+0000 7f91ee91d640 1 --2- 172.21.15.18:0/601055595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91e81082a0 0x7f91e810ec40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.669+0000 7f91ee91d640 1 --2- 172.21.15.18:0/601055595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e81036e0 0x7f91e8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.669+0000 7f91ee91d640 1 --2- 172.21.15.18:0/601055595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e8102d30 0x7f91e8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.669+0000 7f91ee91d640 1 -- 172.21.15.18:0/601055595 >> 172.21.15.18:0/601055595 conn(0x7f91e80fc7d0 msgr2=0x7f91e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.669+0000 7f91ee91d640 1 -- 172.21.15.18:0/601055595 shutdown_connections 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.669+0000 7f91ee91d640 1 -- 172.21.15.18:0/601055595 wait complete. 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.670+0000 7f91ee91d640 1 Processor -- start 2024-09-19T09:52:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.670+0000 7f91ee91d640 1 -- start start 2024-09-19T09:52:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.670+0000 7f91ee91d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91e8102d30 0x7f91e819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.670+0000 7f91ee91d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e81036e0 0x7f91e819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.670+0000 7f91ee91d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e81082a0 0x7f91e819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.670+0000 7f91ee91d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81120a0 con 0x7f91e8102d30 2024-09-19T09:52:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.670+0000 7f91ee91d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8111f20 con 0x7f91e81082a0 2024-09-19T09:52:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.670+0000 7f91ee91d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8112220 con 0x7f91e81036e0 2024-09-19T09:52:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.670+0000 7f91e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91e8102d30 0x7f91e819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e81036e0 0x7f91e819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91e8102d30 0x7f91e819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39650/0 (socket says 172.21.15.18:39650) 2024-09-19T09:52:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e7fff640 1 -- 172.21.15.18:0/1587153190 learned_addr learned my addr 172.21.15.18:0/1587153190 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91eceba640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e81082a0 0x7f91e819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e7fff640 1 -- 172.21.15.18:0/1587153190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e81036e0 msgr2=0x7f91e819ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e7fff640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e81036e0 0x7f91e819ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e7fff640 1 -- 172.21.15.18:0/1587153190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e81082a0 msgr2=0x7f91e819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e7fff640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e81082a0 0x7f91e819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e7fff640 1 -- 172.21.15.18:0/1587153190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e819f6e0 con 0x7f91e8102d30 2024-09-19T09:52:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91eceba640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e81082a0 0x7f91e819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e7fff640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91e8102d30 0x7f91e819a730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f91d800e9f0 tx=0x7f91d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e57fa640 1 -- 172.21.15.18:0/1587153190 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d800cd80 con 0x7f91e8102d30 2024-09-19T09:52:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e57fa640 1 -- 172.21.15.18:0/1587153190 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d8010910 con 0x7f91e8102d30 2024-09-19T09:52:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91ee91d640 1 -- 172.21.15.18:0/1587153190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e819f9d0 con 0x7f91e8102d30 2024-09-19T09:52:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.671+0000 7f91e57fa640 1 -- 172.21.15.18:0/1587153190 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8018990 con 0x7f91e8102d30 2024-09-19T09:52:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.672+0000 7f91ee91d640 1 -- 172.21.15.18:0/1587153190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e81a72b0 con 0x7f91e8102d30 2024-09-19T09:52:34.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91f0cf6740 1 Processor -- start 2024-09-19T09:52:34.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91f0cf6740 1 -- start start 2024-09-19T09:52:34.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91e57fa640 1 -- 172.21.15.18:0/1587153190 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f91d8010ac0 con 0x7f91e8102d30 2024-09-19T09:52:34.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb41cb60 0x55a0cb41cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 0x55a0cb427800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb427d40 0x55a0cb42a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a0cb382280 con 0x55a0cb427d40 2024-09-19T09:52:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a0cb329b10 con 0x55a0cb41d480 2024-09-19T09:52:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a0cb37e240 con 0x55a0cb41cb60 2024-09-19T09:52:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb427d40 0x55a0cb42a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb427d40 0x55a0cb42a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39660/0 (socket says 172.21.15.18:39660) 2024-09-19T09:52:34.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.674+0000 7f91e77fe640 1 -- 172.21.15.18:0/86578326 learned_addr learned my addr 172.21.15.18:0/86578326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:34.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91eceba640 1 --2- 172.21.15.18:0/86578326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb41cb60 0x55a0cb41cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91e7fff640 1 --2- 172.21.15.18:0/86578326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 0x55a0cb427800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91e77fe640 1 -- 172.21.15.18:0/86578326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb41cb60 msgr2=0x55a0cb41cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:34.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91e77fe640 1 --2- 172.21.15.18:0/86578326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb41cb60 0x55a0cb41cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91e77fe640 1 -- 172.21.15.18:0/86578326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 msgr2=0x55a0cb427800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91e77fe640 1 --2- 172.21.15.18:0/86578326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 0x55a0cb427800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91e77fe640 1 -- 172.21.15.18:0/86578326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0cb3361f0 con 0x55a0cb427d40 2024-09-19T09:52:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91e77fe640 1 --2- 172.21.15.18:0/86578326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb427d40 0x55a0cb42a130 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009ba0 tx=0x7f91d0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0a62ceeb90db40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91e57fa640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91d40a3240 0x7f91d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91de7fc640 1 -- 172.21.15.18:0/86578326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0004230 con 0x55a0cb427d40 2024-09-19T09:52:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91eceba640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91d40a3240 0x7f91d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91e57fa640 1 -- 172.21.15.18:0/1587153190 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f91d80cfcc0 con 0x7f91e8102d30 2024-09-19T09:52:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91de7fc640 1 -- 172.21.15.18:0/86578326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d0009e10 con 0x55a0cb427d40 2024-09-19T09:52:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.675+0000 7f91de7fc640 1 -- 172.21.15.18:0/86578326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0004230 con 0x55a0cb427d40 2024-09-19T09:52:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.676+0000 7f91f0cf6740 1 -- 172.21.15.18:0/86578326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb427d40 msgr2=0x55a0cb42a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.676+0000 7f91eceba640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91d40a3240 0x7f91d40a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91e0005e30 tx=0x7f91e0005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.676+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/86578326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb427d40 0x55a0cb42a130 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009ba0 tx=0x7f91d0011810 comp rx=0 tx=0).stop 2024-09-19T09:52:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.676+0000 7f91f0cf6740 1 -- 172.21.15.18:0/86578326 shutdown_connections 2024-09-19T09:52:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.676+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/86578326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb427d40 0x55a0cb42a130 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.676+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/86578326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 0x55a0cb427800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.676+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/86578326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb41cb60 0x55a0cb41cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.676+0000 7f91f0cf6740 1 -- 172.21.15.18:0/86578326 >> 172.21.15.18:0/86578326 conn(0x55a0cb4190f0 msgr2=0x55a0cb4194d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.676+0000 7f91f0cf6740 1 -- 172.21.15.18:0/86578326 shutdown_connections 2024-09-19T09:52:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.676+0000 7f91f0cf6740 1 -- 172.21.15.18:0/86578326 wait complete. 2024-09-19T09:52:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91f0cf6740 1 -- start start 2024-09-19T09:52:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91f0cf6740 1 Processor -- start 2024-09-19T09:52:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb41cb60 0x55a0cb424ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb4250e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb427d40 0x55a0cb425620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a0cb42a910 con 0x55a0cb41d480 2024-09-19T09:52:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a0cb33cf10 con 0x55a0cb427d40 2024-09-19T09:52:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a0cb42aa90 con 0x55a0cb41cb60 2024-09-19T09:52:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91f0cf6740 10 client.0 _ll_register_callbacks cb 0x55a0cb305a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb4250e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb4250e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39668/0 (socket says 172.21.15.18:39668) 2024-09-19T09:52:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91e77fe640 1 -- 172.21.15.18:0/288428559 learned_addr learned my addr 172.21.15.18:0/288428559 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91eceba640 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb427d40 0x55a0cb425620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.677+0000 7f91e7fff640 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb41cb60 0x55a0cb424ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91e77fe640 1 -- 172.21.15.18:0/288428559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb41cb60 msgr2=0x55a0cb424ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91e77fe640 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb41cb60 0x55a0cb424ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91e77fe640 1 -- 172.21.15.18:0/288428559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb427d40 msgr2=0x55a0cb425620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91e77fe640 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb427d40 0x55a0cb425620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91e77fe640 1 -- 172.21.15.18:0/288428559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0cb0f36a0 con 0x55a0cb41d480 2024-09-19T09:52:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91e77fe640 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb4250e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f91d0004910 tx=0x7f91d00052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942ab234ad8ac44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:34.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:34.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91c77fe640 1 -- 172.21.15.18:0/288428559 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0028020 con 0x55a0cb41d480 2024-09-19T09:52:34.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91c77fe640 1 -- 172.21.15.18:0/288428559 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f91d0024670 con 0x55a0cb41d480 2024-09-19T09:52:34.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91f0cf6740 1 -- 172.21.15.18:0/288428559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91d0009e10 con 0x55a0cb41d480 2024-09-19T09:52:34.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91c77fe640 1 -- 172.21.15.18:0/288428559 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91d001e040 con 0x55a0cb41d480 2024-09-19T09:52:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91f0cf6740 10 client.15294 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.678+0000 7f91f0cf6740 1 -- 172.21.15.18:0/288428559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a0cb4364a0 con 0x55a0cb41d480 2024-09-19T09:52:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.679+0000 7f91c77fe640 1 -- 172.21.15.18:0/288428559 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d0009e10 con 0x55a0cb41d480 2024-09-19T09:52:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.679+0000 7f91c77fe640 1 -- 172.21.15.18:0/288428559 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f91d0018070 con 0x55a0cb41d480 2024-09-19T09:52:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.679+0000 7f91f0cf6740 10 client.15294 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.679+0000 7f91f0cf6740 10 client.15294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:52:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.679+0000 7f91f0cf6740 20 client.15294 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.679+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a0cb4378b0 0x55a0cb439ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.679+0000 7f91f0cf6740 4 client.15294 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.679+0000 7f91f0cf6740 1 -- 172.21.15.18:0/288428559 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0cb38f7f0 con 0x55a0cb4378b0 2024-09-19T09:52:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.679+0000 7f91e7fff640 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a0cb4378b0 0x55a0cb439ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.680+0000 7f91e7fff640 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a0cb4378b0 0x55a0cb439ca0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=576ae6ab78f1d057 server_cookie=c2508396de9f64cf in_seq=0 out_seq=0 2024-09-19T09:52:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.680+0000 7f91c77fe640 10 client.15294 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.680+0000 7f91c77fe640 1 -- 172.21.15.18:0/288428559 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0cb38f7f0 con 0x55a0cb4378b0 2024-09-19T09:52:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.680+0000 7f91c77fe640 10 client.15294 handle_command_reply: tid=0 2024-09-19T09:52:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.680+0000 7f91f0cf6740 1 client.15294 shutdown 2024-09-19T09:52:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 1 -- 172.21.15.18:0/288428559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 msgr2=0x55a0cb4250e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb4250e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f91d0004910 tx=0x7f91d00052b0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 1 -- 172.21.15.18:0/288428559 shutdown_connections 2024-09-19T09:52:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a0cb4378b0 0x55a0cb439ca0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91c77fe640 0 client.15294 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb427d40 0x55a0cb425620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb4250e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/288428559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb41cb60 0x55a0cb424ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 1 -- 172.21.15.18:0/288428559 >> 172.21.15.18:0/288428559 conn(0x55a0cb4190f0 msgr2=0x55a0cb41edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 1 -- 172.21.15.18:0/288428559 shutdown_connections 2024-09-19T09:52:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 1 -- 172.21.15.18:0/288428559 wait complete. 2024-09-19T09:52:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.681+0000 7f91f0cf6740 20 client.15294 trim_cache size 0 max 16384 2024-09-19T09:52:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.711+0000 7f91f0cf6740 1 Processor -- start 2024-09-19T09:52:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.711+0000 7f91f0cf6740 1 -- start start 2024-09-19T09:52:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.711+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41cb60 0x55a0cb426a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.711+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb43f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.711+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 0x55a0cb43f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.711+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81af7b0 con 0x55a0cb41d480 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.711+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81b12f0 con 0x55a0cb41cb60 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.711+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81afe80 con 0x55a0cb427d40 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.711+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb43f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.711+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb43f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39674/0 (socket says 172.21.15.18:39674) 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91e77fe640 1 -- 172.21.15.18:0/1545784977 learned_addr learned my addr 172.21.15.18:0/1545784977 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91eceba640 1 --2- 172.21.15.18:0/1545784977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 0x55a0cb43f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91e7fff640 1 --2- 172.21.15.18:0/1545784977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41cb60 0x55a0cb426a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91e77fe640 1 -- 172.21.15.18:0/1545784977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 msgr2=0x55a0cb43f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91e77fe640 1 --2- 172.21.15.18:0/1545784977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 0x55a0cb43f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91e77fe640 1 -- 172.21.15.18:0/1545784977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41cb60 msgr2=0x55a0cb426a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91e77fe640 1 --2- 172.21.15.18:0/1545784977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41cb60 0x55a0cb426a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91e77fe640 1 -- 172.21.15.18:0/1545784977 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0cb418f20 con 0x55a0cb41d480 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91e77fe640 1 --2- 172.21.15.18:0/1545784977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb43f480 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f91d00059f0 tx=0x7f91d0004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ae031ccde62f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91ddffb640 1 -- 172.21.15.18:0/1545784977 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0028040 con 0x55a0cb41d480 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91ddffb640 1 -- 172.21.15.18:0/1545784977 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d0019840 con 0x55a0cb41d480 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.712+0000 7f91ddffb640 1 -- 172.21.15.18:0/1545784977 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0005320 con 0x55a0cb41d480 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.713+0000 7f91f0cf6740 1 -- 172.21.15.18:0/1545784977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 msgr2=0x55a0cb43f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.713+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/1545784977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb43f480 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f91d00059f0 tx=0x7f91d0004940 comp rx=0 tx=0).stop 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.713+0000 7f91f0cf6740 1 -- 172.21.15.18:0/1545784977 shutdown_connections 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.713+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/1545784977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 0x55a0cb43f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.713+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/1545784977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41d480 0x55a0cb43f480 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.713+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/1545784977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41cb60 0x55a0cb426a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.713+0000 7f91f0cf6740 1 -- 172.21.15.18:0/1545784977 >> 172.21.15.18:0/1545784977 conn(0x55a0cb4190f0 msgr2=0x55a0cb4262f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.713+0000 7f91f0cf6740 1 -- 172.21.15.18:0/1545784977 shutdown_connections 2024-09-19T09:52:34.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.713+0000 7f91f0cf6740 1 -- 172.21.15.18:0/1545784977 wait complete. 2024-09-19T09:52:34.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.713+0000 7f91f0cf6740 1 -- start start 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91f0cf6740 1 Processor -- start 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41cb60 0x55a0cb421c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 0x55a0cb422150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91f0cf6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 0x55a0cb422690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81b0c20 con 0x55a0cb41cb60 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81b0550 con 0x55a0cb41d480 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91f0cf6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81ad790 con 0x55a0cb427d40 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41cb60 0x55a0cb421c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91f0cf6740 10 client.0 _ll_register_callbacks cb 0x7f91d0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41cb60 0x55a0cb421c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39678/0 (socket says 172.21.15.18:39678) 2024-09-19T09:52:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91e7fff640 1 -- 172.21.15.18:0/598436023 learned_addr learned my addr 172.21.15.18:0/598436023 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91e77fe640 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 0x55a0cb422150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91e7fff640 1 -- 172.21.15.18:0/598436023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 msgr2=0x55a0cb422690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91eceba640 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 0x55a0cb422690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.714+0000 7f91e7fff640 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 0x55a0cb422690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91e7fff640 1 -- 172.21.15.18:0/598436023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 msgr2=0x55a0cb422150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91e7fff640 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 0x55a0cb422150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91e7fff640 1 -- 172.21.15.18:0/598436023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0cb4a14a0 con 0x55a0cb41cb60 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91eceba640 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 0x55a0cb422690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91e77fe640 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 0x55a0cb422150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91e7fff640 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41cb60 0x55a0cb421c10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f91d8098770 tx=0x7f91d80bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb8b8b109ea6170 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91c77fe640 1 -- 172.21.15.18:0/598436023 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80d1040 con 0x55a0cb41cb60 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91c77fe640 1 -- 172.21.15.18:0/598436023 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f91d809a610 con 0x55a0cb41cb60 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91f0cf6740 1 -- 172.21.15.18:0/598436023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91d0019840 con 0x55a0cb41cb60 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91c77fe640 1 -- 172.21.15.18:0/598436023 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91d80a4f80 con 0x55a0cb41cb60 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91f0cf6740 10 client.15300 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91f0cf6740 1 -- 172.21.15.18:0/598436023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a0cb4a27c0 con 0x55a0cb41cb60 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91c77fe640 1 -- 172.21.15.18:0/598436023 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d0019840 con 0x55a0cb41cb60 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.715+0000 7f91c77fe640 1 -- 172.21.15.18:0/598436023 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f91d809b760 con 0x55a0cb41cb60 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.716+0000 7f91f0cf6740 10 client.15300 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.716+0000 7f91f0cf6740 10 client.15300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.716+0000 7f91f0cf6740 20 client.15300 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.716+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a0cb4378b0 0x55a0cb4a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.716+0000 7f91f0cf6740 4 client.15300 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:52:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.716+0000 7f91f0cf6740 1 -- 172.21.15.18:0/598436023 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a0cb389d00 con 0x55a0cb4378b0 2024-09-19T09:52:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.716+0000 7f91e77fe640 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a0cb4378b0 0x55a0cb4a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.716+0000 7f91e77fe640 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a0cb4378b0 0x55a0cb4a4ed0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=444081f8bd2907f0 server_cookie=5a7c1067a4466d5 in_seq=0 out_seq=0 2024-09-19T09:52:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.716+0000 7f91c77fe640 10 client.15300 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.716+0000 7f66eb975640 1 -- 172.21.15.18:0/1428886163 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66e4062630 con 0x7f66cc0a32c0 2024-09-19T09:52:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91c77fe640 1 -- 172.21.15.18:0/598436023 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a0cb389d00 con 0x55a0cb4378b0 2024-09-19T09:52:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91c77fe640 10 client.15300 handle_command_reply: tid=0 2024-09-19T09:52:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 client.15300 shutdown 2024-09-19T09:52:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 -- 172.21.15.18:0/598436023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41cb60 msgr2=0x55a0cb421c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41cb60 0x55a0cb421c10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f91d8098770 tx=0x7f91d80bc040 comp rx=0 tx=0).stop 2024-09-19T09:52:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 -- 172.21.15.18:0/598436023 shutdown_connections 2024-09-19T09:52:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a0cb4378b0 0x55a0cb4a4ed0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0cb427d40 0x55a0cb422690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91c77fe640 0 client.15300 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0cb41d480 0x55a0cb422150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 --2- 172.21.15.18:0/598436023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a0cb41cb60 0x55a0cb421c10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 -- 172.21.15.18:0/598436023 >> 172.21.15.18:0/598436023 conn(0x55a0cb4190f0 msgr2=0x55a0cb41edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 -- 172.21.15.18:0/598436023 shutdown_connections 2024-09-19T09:52:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 1 -- 172.21.15.18:0/598436023 wait complete. 2024-09-19T09:52:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.718+0000 7f91f0cf6740 20 client.15300 trim_cache size 0 max 16384 2024-09-19T09:52:34.727 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:34.727 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T09:52:34.727 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "afc31030-a1cd-44e1-bae8-7a6699872f2d", 2024-09-19T09:52:34.727 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T09:52:34.727 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 -- 172.21.15.18:0/1587153190 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91d40a3240 msgr2=0x7f91d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91d40a3240 0x7f91d40a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91e0005e30 tx=0x7f91e0005d80 comp rx=0 tx=0).stop 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 -- 172.21.15.18:0/1587153190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91e8102d30 msgr2=0x7f91e819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91e8102d30 0x7f91e819a730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f91d800e9f0 tx=0x7f91d800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 -- 172.21.15.18:0/1587153190 shutdown_connections 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91d40a3240 0x7f91d40a5700 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91e81082a0 0x7f91e819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91e81036e0 0x7f91e819ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 --2- 172.21.15.18:0/1587153190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91e8102d30 0x7f91e819a730 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 -- 172.21.15.18:0/1587153190 >> 172.21.15.18:0/1587153190 conn(0x7f91e80fc7d0 msgr2=0x7f91e81011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 -- 172.21.15.18:0/1587153190 shutdown_connections 2024-09-19T09:52:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.719+0000 7f91ee91d640 1 -- 172.21.15.18:0/1587153190 wait complete. 2024-09-19T09:52:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.723+0000 7f66e27fc640 1 -- 172.21.15.18:0/1428886163 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258874 (secure 0 0 0) 0x7f66e4062630 con 0x7f66cc0a32c0 2024-09-19T09:52:34.731 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:52:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 -- 172.21.15.18:0/1428886163 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66cc0a32c0 msgr2=0x7f66cc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66cc0a32c0 0x7f66cc0a5780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f66e419b710 tx=0x7f66d8005a20 comp rx=0 tx=0).stop 2024-09-19T09:52:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 -- 172.21.15.18:0/1428886163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66e41008d0 msgr2=0x7f66e41a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66e41008d0 0x7f66e41a0410 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f66d400b4a0 tx=0x7f66d400b960 comp rx=0 tx=0).stop 2024-09-19T09:52:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 -- 172.21.15.18:0/1428886163 shutdown_connections 2024-09-19T09:52:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f66cc0a32c0 0x7f66cc0a5780 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66e410e480 0x7f66e419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66e4101280 0x7f66e41a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 --2- 172.21.15.18:0/1428886163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66e41008d0 0x7f66e41a0410 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 -- 172.21.15.18:0/1428886163 >> 172.21.15.18:0/1428886163 conn(0x7f66e40fc7a0 msgr2=0x7f66e40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 -- 172.21.15.18:0/1428886163 shutdown_connections 2024-09-19T09:52:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:34.727+0000 7f66eb975640 1 -- 172.21.15.18:0/1428886163 wait complete. 2024-09-19T09:52:35.240 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:34 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T09:52:35.240 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:34 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:52:35.240 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:34 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T09:52:35.240 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:34 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:52:35.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:34 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T09:52:35.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:34 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:52:35.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:34 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T09:52:35.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:34 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:52:35.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:34 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T09:52:35.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:34 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:52:35.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:34 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T09:52:35.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:34 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:52:35.571 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-09-19T09:52:34.379016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663890,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1303,"num_read_kb":779,"num_write":443,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374664,"kb_used_data":12936,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567160,"statfs":{"total":1151940427776,"available":1151556771840,"internally_reserved":0,"allocated":13246464,"data_stored":7290822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":77,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002870"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372723+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:52:00.372723+0000","last_peered":"2024-09-19T09:52:00.372723+0000","last_clean":"2024-09-19T09:52:00.372723+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:52:00.372723+0000","last_undegraded":"2024-09-19T09:52:00.372723+0000","last_fullsized":"2024-09-19T09:52:00.372723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360023+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:52:00.360023+0000","last_peered":"2024-09-19T09:52:00.360023+0000","last_clean":"2024-09-19T09:52:00.360023+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:52:00.360023+0000","last_undegraded":"2024-09-19T09:52:00.360023+0000","last_fullsized":"2024-09-19T09:52:00.360023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373218+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:52:00.373218+0000","last_peered":"2024-09-19T09:52:00.373218+0000","last_clean":"2024-09-19T09:52:00.373218+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:52:00.373218+0000","last_undegraded":"2024-09-19T09:52:00.373218+0000","last_fullsized":"2024-09-19T09:52:00.373218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362650+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:52:00.362650+0000","last_peered":"2024-09-19T09:52:00.362650+0000","last_clean":"2024-09-19T09:52:00.362650+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:52:00.362650+0000","last_undegraded":"2024-09-19T09:52:00.362650+0000","last_fullsized":"2024-09-19T09:52:00.362650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.335091+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:52:00.335091+0000","last_peered":"2024-09-19T09:52:00.335091+0000","last_clean":"2024-09-19T09:52:00.335091+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:52:00.335091+0000","last_undegraded":"2024-09-19T09:52:00.335091+0000","last_fullsized":"2024-09-19T09:52:00.335091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359516+0000","last_change":"2024-09-19T09:51:31.818907+0000","last_active":"2024-09-19T09:52:00.359516+0000","last_peered":"2024-09-19T09:52:00.359516+0000","last_clean":"2024-09-19T09:52:00.359516+0000","last_became_active":"2024-09-19T09:51:31.818522+0000","last_became_peered":"2024-09-19T09:51:31.818522+0000","last_unstale":"2024-09-19T09:52:00.359516+0000","last_undegraded":"2024-09-19T09:52:00.359516+0000","last_fullsized":"2024-09-19T09:52:00.359516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:04.062704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365337+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:52:00.365337+0000","last_peered":"2024-09-19T09:52:00.365337+0000","last_clean":"2024-09-19T09:52:00.365337+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:52:00.365337+0000","last_undegraded":"2024-09-19T09:52:00.365337+0000","last_fullsized":"2024-09-19T09:52:00.365337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358908+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:52:00.358908+0000","last_peered":"2024-09-19T09:52:00.358908+0000","last_clean":"2024-09-19T09:52:00.358908+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:52:00.358908+0000","last_undegraded":"2024-09-19T09:52:00.358908+0000","last_fullsized":"2024-09-19T09:52:00.358908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370979+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:52:00.370979+0000","last_peered":"2024-09-19T09:52:00.370979+0000","last_clean":"2024-09-19T09:52:00.370979+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:52:00.370979+0000","last_undegraded":"2024-09-19T09:52:00.370979+0000","last_fullsized":"2024-09-19T09:52:00.370979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364519+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:52:00.364519+0000","last_peered":"2024-09-19T09:52:00.364519+0000","last_clean":"2024-09-19T09:52:00.364519+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:52:00.364519+0000","last_undegraded":"2024-09-19T09:52:00.364519+0000","last_fullsized":"2024-09-19T09:52:00.364519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.368226+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:52:00.368226+0000","last_peered":"2024-09-19T09:52:00.368226+0000","last_clean":"2024-09-19T09:52:00.368226+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:52:00.368226+0000","last_undegraded":"2024-09-19T09:52:00.368226+0000","last_fullsized":"2024-09-19T09:52:00.368226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362431+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:52:00.362431+0000","last_peered":"2024-09-19T09:52:00.362431+0000","last_clean":"2024-09-19T09:52:00.362431+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:52:00.362431+0000","last_undegraded":"2024-09-19T09:52:00.362431+0000","last_fullsized":"2024-09-19T09:52:00.362431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351092+0000","last_change":"2024-09-19T09:51:31.818910+0000","last_active":"2024-09-19T09:52:00.351092+0000","last_peered":"2024-09-19T09:52:00.351092+0000","last_clean":"2024-09-19T09:52:00.351092+0000","last_became_active":"2024-09-19T09:51:31.818581+0000","last_became_peered":"2024-09-19T09:51:31.818581+0000","last_unstale":"2024-09-19T09:52:00.351092+0000","last_undegraded":"2024-09-19T09:52:00.351092+0000","last_fullsized":"2024-09-19T09:52:00.351092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.736835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365871+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:52:00.365871+0000","last_peered":"2024-09-19T09:52:00.365871+0000","last_clean":"2024-09-19T09:52:00.365871+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:52:00.365871+0000","last_undegraded":"2024-09-19T09:52:00.365871+0000","last_fullsized":"2024-09-19T09:52:00.365871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361631+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:52:00.361631+0000","last_peered":"2024-09-19T09:52:00.361631+0000","last_clean":"2024-09-19T09:52:00.361631+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:52:00.361631+0000","last_undegraded":"2024-09-19T09:52:00.361631+0000","last_fullsized":"2024-09-19T09:52:00.361631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372654+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:52:00.372654+0000","last_peered":"2024-09-19T09:52:00.372654+0000","last_clean":"2024-09-19T09:52:00.372654+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:52:00.372654+0000","last_undegraded":"2024-09-19T09:52:00.372654+0000","last_fullsized":"2024-09-19T09:52:00.372654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373008+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:52:00.373008+0000","last_peered":"2024-09-19T09:52:00.373008+0000","last_clean":"2024-09-19T09:52:00.373008+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:52:00.373008+0000","last_undegraded":"2024-09-19T09:52:00.373008+0000","last_fullsized":"2024-09-19T09:52:00.373008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372768+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:52:00.372768+0000","last_peered":"2024-09-19T09:52:00.372768+0000","last_clean":"2024-09-19T09:52:00.372768+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:52:00.372768+0000","last_undegraded":"2024-09-19T09:52:00.372768+0000","last_fullsized":"2024-09-19T09:52:00.372768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.356302+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:52:00.356302+0000","last_peered":"2024-09-19T09:52:00.356302+0000","last_clean":"2024-09-19T09:52:00.356302+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:52:00.356302+0000","last_undegraded":"2024-09-19T09:52:00.356302+0000","last_fullsized":"2024-09-19T09:52:00.356302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351159+0000","last_change":"2024-09-19T09:51:31.823803+0000","last_active":"2024-09-19T09:52:00.351159+0000","last_peered":"2024-09-19T09:52:00.351159+0000","last_clean":"2024-09-19T09:52:00.351159+0000","last_became_active":"2024-09-19T09:51:31.823361+0000","last_became_peered":"2024-09-19T09:51:31.823361+0000","last_unstale":"2024-09-19T09:52:00.351159+0000","last_undegraded":"2024-09-19T09:52:00.351159+0000","last_fullsized":"2024-09-19T09:52:00.351159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:33.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364330+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:52:00.364330+0000","last_peered":"2024-09-19T09:52:00.364330+0000","last_clean":"2024-09-19T09:52:00.364330+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:52:00.364330+0000","last_undegraded":"2024-09-19T09:52:00.364330+0000","last_fullsized":"2024-09-19T09:52:00.364330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370710+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:52:00.370710+0000","last_peered":"2024-09-19T09:52:00.370710+0000","last_clean":"2024-09-19T09:52:00.370710+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:52:00.370710+0000","last_undegraded":"2024-09-19T09:52:00.370710+0000","last_fullsized":"2024-09-19T09:52:00.370710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358193+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:52:00.358193+0000","last_peered":"2024-09-19T09:52:00.358193+0000","last_clean":"2024-09-19T09:52:00.358193+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:52:00.358193+0000","last_undegraded":"2024-09-19T09:52:00.358193+0000","last_fullsized":"2024-09-19T09:52:00.358193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358828+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:52:00.358828+0000","last_peered":"2024-09-19T09:52:00.358828+0000","last_clean":"2024-09-19T09:52:00.358828+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:52:00.358828+0000","last_undegraded":"2024-09-19T09:52:00.358828+0000","last_fullsized":"2024-09-19T09:52:00.358828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.367256+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:52:00.367256+0000","last_peered":"2024-09-19T09:52:00.367256+0000","last_clean":"2024-09-19T09:52:00.367256+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:52:00.367256+0000","last_undegraded":"2024-09-19T09:52:00.367256+0000","last_fullsized":"2024-09-19T09:52:00.367256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.357344+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:52:00.357344+0000","last_peered":"2024-09-19T09:52:00.357344+0000","last_clean":"2024-09-19T09:52:00.357344+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:52:00.357344+0000","last_undegraded":"2024-09-19T09:52:00.357344+0000","last_fullsized":"2024-09-19T09:52:00.357344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351848+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:52:00.351848+0000","last_peered":"2024-09-19T09:52:00.351848+0000","last_clean":"2024-09-19T09:52:00.351848+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:52:00.351848+0000","last_undegraded":"2024-09-19T09:52:00.351848+0000","last_fullsized":"2024-09-19T09:52:00.351848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350260+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:52:00.350260+0000","last_peered":"2024-09-19T09:52:00.350260+0000","last_clean":"2024-09-19T09:52:00.350260+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:52:00.350260+0000","last_undegraded":"2024-09-19T09:52:00.350260+0000","last_fullsized":"2024-09-19T09:52:00.350260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361673+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:52:00.361673+0000","last_peered":"2024-09-19T09:52:00.361673+0000","last_clean":"2024-09-19T09:52:00.361673+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:52:00.361673+0000","last_undegraded":"2024-09-19T09:52:00.361673+0000","last_fullsized":"2024-09-19T09:52:00.361673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355490+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:52:00.355490+0000","last_peered":"2024-09-19T09:52:00.355490+0000","last_clean":"2024-09-19T09:52:00.355490+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:52:00.355490+0000","last_undegraded":"2024-09-19T09:52:00.355490+0000","last_fullsized":"2024-09-19T09:52:00.355490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361354+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:52:00.361354+0000","last_peered":"2024-09-19T09:52:00.361354+0000","last_clean":"2024-09-19T09:52:00.361354+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:52:00.361354+0000","last_undegraded":"2024-09-19T09:52:00.361354+0000","last_fullsized":"2024-09-19T09:52:00.361354+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353327+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:52:00.353327+0000","last_peered":"2024-09-19T09:52:00.353327+0000","last_clean":"2024-09-19T09:52:00.353327+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:52:00.353327+0000","last_undegraded":"2024-09-19T09:52:00.353327+0000","last_fullsized":"2024-09-19T09:52:00.353327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.345044+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:52:00.345044+0000","last_peered":"2024-09-19T09:52:00.345044+0000","last_clean":"2024-09-19T09:52:00.345044+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:52:00.345044+0000","last_undegraded":"2024-09-19T09:52:00.345044+0000","last_fullsized":"2024-09-19T09:52:00.345044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:31.496459+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:52:31.496459+0000","last_peered":"2024-09-19T09:52:31.496459+0000","last_clean":"2024-09-19T09:52:31.496459+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:52:31.496459+0000","last_undegraded":"2024-09-19T09:52:31.496459+0000","last_fullsized":"2024-09-19T09:52:31.496459+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359507+0000","last_change":"2024-09-19T09:51:31.825618+0000","last_active":"2024-09-19T09:52:00.359507+0000","last_peered":"2024-09-19T09:52:00.359507+0000","last_clean":"2024-09-19T09:52:00.359507+0000","last_became_active":"2024-09-19T09:51:31.824727+0000","last_became_peered":"2024-09-19T09:51:31.824727+0000","last_unstale":"2024-09-19T09:52:00.359507+0000","last_undegraded":"2024-09-19T09:52:00.359507+0000","last_fullsized":"2024-09-19T09:52:00.359507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:52.094074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816210+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:51:31.816210+0000","last_peered":"2024-09-19T09:51:31.816210+0000","last_clean":"2024-09-19T09:51:31.816210+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:51:31.816210+0000","last_undegraded":"2024-09-19T09:51:31.816210+0000","last_fullsized":"2024-09-19T09:51:31.816210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814498+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:51:31.814498+0000","last_peered":"2024-09-19T09:51:31.814498+0000","last_clean":"2024-09-19T09:51:31.814498+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:51:31.814498+0000","last_undegraded":"2024-09-19T09:51:31.814498+0000","last_fullsized":"2024-09-19T09:51:31.814498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355727+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:52:00.355727+0000","last_peered":"2024-09-19T09:52:00.355727+0000","last_clean":"2024-09-19T09:52:00.355727+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.355727+0000","last_undegraded":"2024-09-19T09:52:00.355727+0000","last_fullsized":"2024-09-19T09:52:00.355727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815599+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:51:31.815599+0000","last_peered":"2024-09-19T09:51:31.815599+0000","last_clean":"2024-09-19T09:51:31.815599+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:51:31.815599+0000","last_undegraded":"2024-09-19T09:51:31.815599+0000","last_fullsized":"2024-09-19T09:51:31.815599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363759+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:52:00.363759+0000","last_peered":"2024-09-19T09:52:00.363759+0000","last_clean":"2024-09-19T09:52:00.363759+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:52:00.363759+0000","last_undegraded":"2024-09-19T09:52:00.363759+0000","last_fullsized":"2024-09-19T09:52:00.363759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.497887+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:52:33.497887+0000","last_peered":"2024-09-19T09:52:33.497887+0000","last_clean":"2024-09-19T09:52:33.497887+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:52:33.497887+0000","last_undegraded":"2024-09-19T09:52:33.497887+0000","last_fullsized":"2024-09-19T09:52:33.497887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373477+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:52:00.373477+0000","last_peered":"2024-09-19T09:52:00.373477+0000","last_clean":"2024-09-19T09:52:00.373477+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:52:00.373477+0000","last_undegraded":"2024-09-19T09:52:00.373477+0000","last_fullsized":"2024-09-19T09:52:00.373477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415018+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:51:32.415018+0000","last_peered":"2024-09-19T09:51:32.415018+0000","last_clean":"2024-09-19T09:51:32.415018+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:51:32.415018+0000","last_undegraded":"2024-09-19T09:51:32.415018+0000","last_fullsized":"2024-09-19T09:51:32.415018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361630+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:52:00.361630+0000","last_peered":"2024-09-19T09:52:00.361630+0000","last_clean":"2024-09-19T09:52:00.361630+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:52:00.361630+0000","last_undegraded":"2024-09-19T09:52:00.361630+0000","last_fullsized":"2024-09-19T09:52:00.361630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815716+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:51:31.815716+0000","last_peered":"2024-09-19T09:51:31.815716+0000","last_clean":"2024-09-19T09:51:31.815716+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:51:31.815716+0000","last_undegraded":"2024-09-19T09:51:31.815716+0000","last_fullsized":"2024-09-19T09:51:31.815716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373858+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:52:00.373858+0000","last_peered":"2024-09-19T09:52:00.373858+0000","last_clean":"2024-09-19T09:52:00.373858+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:52:00.373858+0000","last_undegraded":"2024-09-19T09:52:00.373858+0000","last_fullsized":"2024-09-19T09:52:00.373858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'36","reported_seq":297,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.497880+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:52:33.497880+0000","last_peered":"2024-09-19T09:52:33.497880+0000","last_clean":"2024-09-19T09:52:33.497880+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:52:33.497880+0000","last_undegraded":"2024-09-19T09:52:33.497880+0000","last_fullsized":"2024-09-19T09:52:33.497880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65490,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":239,"num_read_kb":184,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363505+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:52:00.363505+0000","last_peered":"2024-09-19T09:52:00.363505+0000","last_clean":"2024-09-19T09:52:00.363505+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:52:00.363505+0000","last_undegraded":"2024-09-19T09:52:00.363505+0000","last_fullsized":"2024-09-19T09:52:00.363505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821655+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:51:31.821655+0000","last_peered":"2024-09-19T09:51:31.821655+0000","last_clean":"2024-09-19T09:51:31.821655+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:51:31.821655+0000","last_undegraded":"2024-09-19T09:51:31.821655+0000","last_fullsized":"2024-09-19T09:51:31.821655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363961+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:52:00.363961+0000","last_peered":"2024-09-19T09:52:00.363961+0000","last_clean":"2024-09-19T09:52:00.363961+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:52:00.363961+0000","last_undegraded":"2024-09-19T09:52:00.363961+0000","last_fullsized":"2024-09-19T09:52:00.363961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815497+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:31.815497+0000","last_peered":"2024-09-19T09:51:31.815497+0000","last_clean":"2024-09-19T09:51:31.815497+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:51:31.815497+0000","last_undegraded":"2024-09-19T09:51:31.815497+0000","last_fullsized":"2024-09-19T09:51:31.815497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369638+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:52:00.369638+0000","last_peered":"2024-09-19T09:52:00.369638+0000","last_clean":"2024-09-19T09:52:00.369638+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:52:00.369638+0000","last_undegraded":"2024-09-19T09:52:00.369638+0000","last_fullsized":"2024-09-19T09:52:00.369638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:32.492403+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:52:32.492403+0000","last_peered":"2024-09-19T09:52:32.492403+0000","last_clean":"2024-09-19T09:52:32.492403+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:52:32.492403+0000","last_undegraded":"2024-09-19T09:52:32.492403+0000","last_fullsized":"2024-09-19T09:52:32.492403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365299+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:52:00.365299+0000","last_peered":"2024-09-19T09:52:00.365299+0000","last_clean":"2024-09-19T09:52:00.365299+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:52:00.365299+0000","last_undegraded":"2024-09-19T09:52:00.365299+0000","last_fullsized":"2024-09-19T09:52:00.365299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821556+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:51:31.821556+0000","last_peered":"2024-09-19T09:51:31.821556+0000","last_clean":"2024-09-19T09:51:31.821556+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:51:31.821556+0000","last_undegraded":"2024-09-19T09:51:31.821556+0000","last_fullsized":"2024-09-19T09:51:31.821556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359861+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:52:00.359861+0000","last_peered":"2024-09-19T09:52:00.359861+0000","last_clean":"2024-09-19T09:52:00.359861+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:52:00.359861+0000","last_undegraded":"2024-09-19T09:52:00.359861+0000","last_fullsized":"2024-09-19T09:52:00.359861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822551+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:51:31.822551+0000","last_peered":"2024-09-19T09:51:31.822551+0000","last_clean":"2024-09-19T09:51:31.822551+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:51:31.822551+0000","last_undegraded":"2024-09-19T09:51:31.822551+0000","last_fullsized":"2024-09-19T09:51:31.822551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.352459+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:52:00.352459+0000","last_peered":"2024-09-19T09:52:00.352459+0000","last_clean":"2024-09-19T09:52:00.352459+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:52:00.352459+0000","last_undegraded":"2024-09-19T09:52:00.352459+0000","last_fullsized":"2024-09-19T09:52:00.352459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814756+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:51:31.814756+0000","last_peered":"2024-09-19T09:51:31.814756+0000","last_clean":"2024-09-19T09:51:31.814756+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:51:31.814756+0000","last_undegraded":"2024-09-19T09:51:31.814756+0000","last_fullsized":"2024-09-19T09:51:31.814756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.366823+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:52:00.366823+0000","last_peered":"2024-09-19T09:52:00.366823+0000","last_clean":"2024-09-19T09:52:00.366823+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:52:00.366823+0000","last_undegraded":"2024-09-19T09:52:00.366823+0000","last_fullsized":"2024-09-19T09:52:00.366823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815831+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:51:31.815831+0000","last_peered":"2024-09-19T09:51:31.815831+0000","last_clean":"2024-09-19T09:51:31.815831+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:51:31.815831+0000","last_undegraded":"2024-09-19T09:51:31.815831+0000","last_fullsized":"2024-09-19T09:51:31.815831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365646+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:52:00.365646+0000","last_peered":"2024-09-19T09:52:00.365646+0000","last_clean":"2024-09-19T09:52:00.365646+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:52:00.365646+0000","last_undegraded":"2024-09-19T09:52:00.365646+0000","last_fullsized":"2024-09-19T09:52:00.365646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:30.494422+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:52:30.494422+0000","last_peered":"2024-09-19T09:52:30.494422+0000","last_clean":"2024-09-19T09:52:30.494422+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:52:30.494422+0000","last_undegraded":"2024-09-19T09:52:30.494422+0000","last_fullsized":"2024-09-19T09:52:30.494422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360813+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:52:00.360813+0000","last_peered":"2024-09-19T09:52:00.360813+0000","last_clean":"2024-09-19T09:52:00.360813+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:52:00.360813+0000","last_undegraded":"2024-09-19T09:52:00.360813+0000","last_fullsized":"2024-09-19T09:52:00.360813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414764+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:51:32.414764+0000","last_peered":"2024-09-19T09:51:32.414764+0000","last_clean":"2024-09-19T09:51:32.414764+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:51:32.414764+0000","last_undegraded":"2024-09-19T09:51:32.414764+0000","last_fullsized":"2024-09-19T09:51:32.414764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170061+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:51:32.170061+0000","last_peered":"2024-09-19T09:51:32.170061+0000","last_clean":"2024-09-19T09:51:32.170061+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:51:32.170061+0000","last_undegraded":"2024-09-19T09:51:32.170061+0000","last_fullsized":"2024-09-19T09:51:32.170061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.348017+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:52:00.348017+0000","last_peered":"2024-09-19T09:52:00.348017+0000","last_clean":"2024-09-19T09:52:00.348017+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:52:00.348017+0000","last_undegraded":"2024-09-19T09:52:00.348017+0000","last_fullsized":"2024-09-19T09:52:00.348017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414764+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:51:32.414764+0000","last_peered":"2024-09-19T09:51:32.414764+0000","last_clean":"2024-09-19T09:51:32.414764+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:51:32.414764+0000","last_undegraded":"2024-09-19T09:51:32.414764+0000","last_fullsized":"2024-09-19T09:51:32.414764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.352775+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:52:00.352775+0000","last_peered":"2024-09-19T09:52:00.352775+0000","last_clean":"2024-09-19T09:52:00.352775+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:52:00.352775+0000","last_undegraded":"2024-09-19T09:52:00.352775+0000","last_fullsized":"2024-09-19T09:52:00.352775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'7","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.493032+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:52:33.493032+0000","last_peered":"2024-09-19T09:52:33.493032+0000","last_clean":"2024-09-19T09:52:33.493032+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:52:33.493032+0000","last_undegraded":"2024-09-19T09:52:33.493032+0000","last_fullsized":"2024-09-19T09:52:33.493032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359409+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:52:00.359409+0000","last_peered":"2024-09-19T09:52:00.359409+0000","last_clean":"2024-09-19T09:52:00.359409+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:52:00.359409+0000","last_undegraded":"2024-09-19T09:52:00.359409+0000","last_fullsized":"2024-09-19T09:52:00.359409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.493392+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:52:33.493392+0000","last_peered":"2024-09-19T09:52:33.493392+0000","last_clean":"2024-09-19T09:52:33.493392+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:52:33.493392+0000","last_undegraded":"2024-09-19T09:52:33.493392+0000","last_fullsized":"2024-09-19T09:52:33.493392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363943+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:52:00.363943+0000","last_peered":"2024-09-19T09:52:00.363943+0000","last_clean":"2024-09-19T09:52:00.363943+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:52:00.363943+0000","last_undegraded":"2024-09-19T09:52:00.363943+0000","last_fullsized":"2024-09-19T09:52:00.363943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824076+0000","last_change":"2024-09-19T09:51:31.824076+0000","last_active":"2024-09-19T09:51:31.824076+0000","last_peered":"2024-09-19T09:51:31.824076+0000","last_clean":"2024-09-19T09:51:31.824076+0000","last_became_active":"2024-09-19T09:51:31.823642+0000","last_became_peered":"2024-09-19T09:51:31.823642+0000","last_unstale":"2024-09-19T09:51:31.824076+0000","last_undegraded":"2024-09-19T09:51:31.824076+0000","last_fullsized":"2024-09-19T09:51:31.824076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:53.035531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361958+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:52:00.361958+0000","last_peered":"2024-09-19T09:52:00.361958+0000","last_clean":"2024-09-19T09:52:00.361958+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:52:00.361958+0000","last_undegraded":"2024-09-19T09:52:00.361958+0000","last_fullsized":"2024-09-19T09:52:00.361958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822947+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:51:31.822947+0000","last_peered":"2024-09-19T09:51:31.822947+0000","last_clean":"2024-09-19T09:51:31.822947+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:51:31.822947+0000","last_undegraded":"2024-09-19T09:51:31.822947+0000","last_fullsized":"2024-09-19T09:51:31.822947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350847+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:52:00.350847+0000","last_peered":"2024-09-19T09:52:00.350847+0000","last_clean":"2024-09-19T09:52:00.350847+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:52:00.350847+0000","last_undegraded":"2024-09-19T09:52:00.350847+0000","last_fullsized":"2024-09-19T09:52:00.350847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370692+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:52:00.370692+0000","last_peered":"2024-09-19T09:52:00.370692+0000","last_clean":"2024-09-19T09:52:00.370692+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:52:00.370692+0000","last_undegraded":"2024-09-19T09:52:00.370692+0000","last_fullsized":"2024-09-19T09:52:00.370692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360865+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:52:00.360865+0000","last_peered":"2024-09-19T09:52:00.360865+0000","last_clean":"2024-09-19T09:52:00.360865+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:52:00.360865+0000","last_undegraded":"2024-09-19T09:52:00.360865+0000","last_fullsized":"2024-09-19T09:52:00.360865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170286+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:51:32.170286+0000","last_peered":"2024-09-19T09:51:32.170286+0000","last_clean":"2024-09-19T09:51:32.170286+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:51:32.170286+0000","last_undegraded":"2024-09-19T09:51:32.170286+0000","last_fullsized":"2024-09-19T09:51:32.170286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361925+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:52:00.361925+0000","last_peered":"2024-09-19T09:52:00.361925+0000","last_clean":"2024-09-19T09:52:00.361925+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:52:00.361925+0000","last_undegraded":"2024-09-19T09:52:00.361925+0000","last_fullsized":"2024-09-19T09:52:00.361925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964590+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:51:32.964590+0000","last_peered":"2024-09-19T09:51:32.964590+0000","last_clean":"2024-09-19T09:51:32.964590+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:51:32.964590+0000","last_undegraded":"2024-09-19T09:51:32.964590+0000","last_fullsized":"2024-09-19T09:51:32.964590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.320920+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:52:00.320920+0000","last_peered":"2024-09-19T09:52:00.320920+0000","last_clean":"2024-09-19T09:52:00.320920+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.320920+0000","last_undegraded":"2024-09-19T09:52:00.320920+0000","last_fullsized":"2024-09-19T09:52:00.320920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823345+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:51:31.823345+0000","last_peered":"2024-09-19T09:51:31.823345+0000","last_clean":"2024-09-19T09:51:31.823345+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:51:31.823345+0000","last_undegraded":"2024-09-19T09:51:31.823345+0000","last_fullsized":"2024-09-19T09:51:31.823345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353447+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:52:00.353447+0000","last_peered":"2024-09-19T09:52:00.353447+0000","last_clean":"2024-09-19T09:52:00.353447+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:52:00.353447+0000","last_undegraded":"2024-09-19T09:52:00.353447+0000","last_fullsized":"2024-09-19T09:52:00.353447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.830511+0000","last_change":"2024-09-19T09:51:31.830511+0000","last_active":"2024-09-19T09:51:31.830511+0000","last_peered":"2024-09-19T09:51:31.830511+0000","last_clean":"2024-09-19T09:51:31.830511+0000","last_became_active":"2024-09-19T09:51:31.825672+0000","last_became_peered":"2024-09-19T09:51:31.825672+0000","last_unstale":"2024-09-19T09:51:31.830511+0000","last_undegraded":"2024-09-19T09:51:31.830511+0000","last_fullsized":"2024-09-19T09:51:31.830511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.101027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360592+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:52:00.360592+0000","last_peered":"2024-09-19T09:52:00.360592+0000","last_clean":"2024-09-19T09:52:00.360592+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:52:00.360592+0000","last_undegraded":"2024-09-19T09:52:00.360592+0000","last_fullsized":"2024-09-19T09:52:00.360592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821791+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:51:31.821791+0000","last_peered":"2024-09-19T09:51:31.821791+0000","last_clean":"2024-09-19T09:51:31.821791+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:51:31.821791+0000","last_undegraded":"2024-09-19T09:51:31.821791+0000","last_fullsized":"2024-09-19T09:51:31.821791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361855+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:52:00.361855+0000","last_peered":"2024-09-19T09:52:00.361855+0000","last_clean":"2024-09-19T09:52:00.361855+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:52:00.361855+0000","last_undegraded":"2024-09-19T09:52:00.361855+0000","last_fullsized":"2024-09-19T09:52:00.361855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369084+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:52:00.369084+0000","last_peered":"2024-09-19T09:52:00.369084+0000","last_clean":"2024-09-19T09:52:00.369084+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:52:00.369084+0000","last_undegraded":"2024-09-19T09:52:00.369084+0000","last_fullsized":"2024-09-19T09:52:00.369084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822749+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:51:31.822749+0000","last_peered":"2024-09-19T09:51:31.822749+0000","last_clean":"2024-09-19T09:51:31.822749+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:51:31.822749+0000","last_undegraded":"2024-09-19T09:51:31.822749+0000","last_fullsized":"2024-09-19T09:51:31.822749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.371499+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:52:00.371499+0000","last_peered":"2024-09-19T09:52:00.371499+0000","last_clean":"2024-09-19T09:52:00.371499+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:52:00.371499+0000","last_undegraded":"2024-09-19T09:52:00.371499+0000","last_fullsized":"2024-09-19T09:52:00.371499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822889+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:51:31.822889+0000","last_peered":"2024-09-19T09:51:31.822889+0000","last_clean":"2024-09-19T09:51:31.822889+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:51:31.822889+0000","last_undegraded":"2024-09-19T09:51:31.822889+0000","last_fullsized":"2024-09-19T09:51:31.822889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373597+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:52:00.373597+0000","last_peered":"2024-09-19T09:52:00.373597+0000","last_clean":"2024-09-19T09:52:00.373597+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:52:00.373597+0000","last_undegraded":"2024-09-19T09:52:00.373597+0000","last_fullsized":"2024-09-19T09:52:00.373597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823978+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:51:31.823978+0000","last_peered":"2024-09-19T09:51:31.823978+0000","last_clean":"2024-09-19T09:51:31.823978+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:51:31.823978+0000","last_undegraded":"2024-09-19T09:51:31.823978+0000","last_fullsized":"2024-09-19T09:51:31.823978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.349804+0000","last_change":"2024-09-19T09:51:31.824910+0000","last_active":"2024-09-19T09:52:00.349804+0000","last_peered":"2024-09-19T09:52:00.349804+0000","last_clean":"2024-09-19T09:52:00.349804+0000","last_became_active":"2024-09-19T09:51:31.824521+0000","last_became_peered":"2024-09-19T09:51:31.824521+0000","last_unstale":"2024-09-19T09:52:00.349804+0000","last_undegraded":"2024-09-19T09:52:00.349804+0000","last_fullsized":"2024-09-19T09:52:00.349804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:43.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:28.486556+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:52:28.486556+0000","last_peered":"2024-09-19T09:52:28.486556+0000","last_clean":"2024-09-19T09:52:28.486556+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:52:28.486556+0000","last_undegraded":"2024-09-19T09:52:28.486556+0000","last_fullsized":"2024-09-19T09:52:28.486556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73288,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1177,"num_read_kb":670,"num_write":260,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":219864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514534,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":442788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743467,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1100149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":443096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364858,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1036599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528384,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":442969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790020,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1034901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953546,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":443138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":509058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40472,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704680,"statfs":{"total":95995035648,"available":95953592320,"internally_reserved":0,"allocated":991232,"data_stored":509372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":443774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:52:35.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:52:35.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:52:36.031 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:36.231 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:35 smithi018 ceph-mon[30956]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:52:36.231 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:35 smithi018 ceph-mon[30956]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:36.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:35 smithi049 ceph-mon[34858]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:52:36.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:35 smithi049 ceph-mon[34858]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:36.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:35 smithi162 ceph-mon[35174]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:52:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:35 smithi162 ceph-mon[35174]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:36.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.455+0000 7fb172f09640 1 -- 172.21.15.18:0/3522314903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1036e0 msgr2=0x7fb16c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:36.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.455+0000 7fb172f09640 1 --2- 172.21.15.18:0/3522314903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1036e0 0x7fb16c107b90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb158009930 tx=0x7fb15802a420 comp rx=0 tx=0).stop 2024-09-19T09:52:36.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.455+0000 7fb172f09640 1 -- 172.21.15.18:0/3522314903 shutdown_connections 2024-09-19T09:52:36.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.455+0000 7fb172f09640 1 --2- 172.21.15.18:0/3522314903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1082a0 0x7fb16c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.455+0000 7fb172f09640 1 --2- 172.21.15.18:0/3522314903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1036e0 0x7fb16c107b90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.455+0000 7fb172f09640 1 --2- 172.21.15.18:0/3522314903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb16c102d30 0x7fb16c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.455+0000 7fb172f09640 1 -- 172.21.15.18:0/3522314903 >> 172.21.15.18:0/3522314903 conn(0x7fb16c0fc7d0 msgr2=0x7fb16c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.456+0000 7fb172f09640 1 -- 172.21.15.18:0/3522314903 shutdown_connections 2024-09-19T09:52:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.456+0000 7fb172f09640 1 -- 172.21.15.18:0/3522314903 wait complete. 2024-09-19T09:52:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.456+0000 7fb172f09640 1 Processor -- start 2024-09-19T09:52:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.456+0000 7fb172f09640 1 -- start start 2024-09-19T09:52:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb172f09640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb16c102d30 0x7fb16c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb172f09640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1036e0 0x7fb16c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb172f09640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1082a0 0x7fb16c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb172f09640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1120a0 con 0x7fb16c1036e0 2024-09-19T09:52:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb172f09640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c111f20 con 0x7fb16c102d30 2024-09-19T09:52:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb172f09640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c112220 con 0x7fb16c1082a0 2024-09-19T09:52:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb16bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1036e0 0x7fb16c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb16bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1036e0 0x7fb16c198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36094/0 (socket says 172.21.15.18:36094) 2024-09-19T09:52:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb16bfff640 1 -- 172.21.15.18:0/1904530766 learned_addr learned my addr 172.21.15.18:0/1904530766 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb170ca5640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb16c102d30 0x7fb16c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb1714a6640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1082a0 0x7fb16c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb16bfff640 1 -- 172.21.15.18:0/1904530766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1082a0 msgr2=0x7fb16c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb16bfff640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1082a0 0x7fb16c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb16bfff640 1 -- 172.21.15.18:0/1904530766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb16c102d30 msgr2=0x7fb16c198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb16bfff640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb16c102d30 0x7fb16c198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb16bfff640 1 -- 172.21.15.18:0/1904530766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c19d500 con 0x7fb16c1036e0 2024-09-19T09:52:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.457+0000 7fb16bfff640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1036e0 0x7fb16c198a90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb158005940 tx=0x7fb1580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.458+0000 7fb169ffb640 1 -- 172.21.15.18:0/1904530766 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15803f030 con 0x7fb16c1036e0 2024-09-19T09:52:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.458+0000 7fb169ffb640 1 -- 172.21.15.18:0/1904530766 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb158003ce0 con 0x7fb16c1036e0 2024-09-19T09:52:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.458+0000 7fb172f09640 1 -- 172.21.15.18:0/1904530766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c19d790 con 0x7fb16c1036e0 2024-09-19T09:52:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.458+0000 7fb169ffb640 1 -- 172.21.15.18:0/1904530766 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158035070 con 0x7fb16c1036e0 2024-09-19T09:52:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.458+0000 7fb172f09640 1 -- 172.21.15.18:0/1904530766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c1a50d0 con 0x7fb16c1036e0 2024-09-19T09:52:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.459+0000 7fb172f09640 1 -- 172.21.15.18:0/1904530766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c06a850 con 0x7fb16c1036e0 2024-09-19T09:52:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.460+0000 7fb169ffb640 1 -- 172.21.15.18:0/1904530766 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb158042030 con 0x7fb16c1036e0 2024-09-19T09:52:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.461+0000 7fb169ffb640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb15c0a3240 0x7fb15c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.461+0000 7fb169ffb640 1 -- 172.21.15.18:0/1904530766 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb1580eff50 con 0x7fb16c1036e0 2024-09-19T09:52:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.461+0000 7fb170ca5640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb15c0a3240 0x7fb15c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:36.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.461+0000 7fb170ca5640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb15c0a3240 0x7fb15c0a5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb16000bbe0 tx=0x7fb16000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:36.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.464+0000 7fb169ffb640 1 -- 172.21.15.18:0/1904530766 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1580bc650 con 0x7fb16c1036e0 2024-09-19T09:52:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.656+0000 7fb172f09640 1 -- 172.21.15.18:0/1904530766 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb16c062630 con 0x7fb15c0a3240 2024-09-19T09:52:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.668+0000 7fb169ffb640 1 -- 172.21.15.18:0/1904530766 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258874 (secure 0 0 0) 0x7fb16c062630 con 0x7fb15c0a3240 2024-09-19T09:52:36.672 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:52:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 -- 172.21.15.18:0/1904530766 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb15c0a3240 msgr2=0x7fb15c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb15c0a3240 0x7fb15c0a5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb16000bbe0 tx=0x7fb16000b390 comp rx=0 tx=0).stop 2024-09-19T09:52:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 -- 172.21.15.18:0/1904530766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1036e0 msgr2=0x7fb16c198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1036e0 0x7fb16c198a90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb158005940 tx=0x7fb1580042f0 comp rx=0 tx=0).stop 2024-09-19T09:52:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 -- 172.21.15.18:0/1904530766 shutdown_connections 2024-09-19T09:52:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb15c0a3240 0x7fb15c0a5700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c1082a0 0x7fb16c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c1036e0 0x7fb16c198a90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 --2- 172.21.15.18:0/1904530766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb16c102d30 0x7fb16c198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 -- 172.21.15.18:0/1904530766 >> 172.21.15.18:0/1904530766 conn(0x7fb16c0fc7d0 msgr2=0x7fb16c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 -- 172.21.15.18:0/1904530766 shutdown_connections 2024-09-19T09:52:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:36.671+0000 7fb172f09640 1 -- 172.21.15.18:0/1904530766 wait complete. 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.134+0000 7f7a0a595640 1 -- 172.21.15.18:0/3015643640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a04102d40 msgr2=0x7f7a04103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.134+0000 7f7a0a595640 1 --2- 172.21.15.18:0/3015643640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a04102d40 0x7f7a04103120 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009900 tx=0x7f79f402a480 comp rx=0 tx=0).stop 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.134+0000 7f7a0a595640 1 -- 172.21.15.18:0/3015643640 shutdown_connections 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.134+0000 7f7a0a595640 1 --2- 172.21.15.18:0/3015643640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a0410c170 0x7f7a0410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.134+0000 7f7a0a595640 1 --2- 172.21.15.18:0/3015643640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a04103660 0x7f7a0410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.134+0000 7f7a0a595640 1 --2- 172.21.15.18:0/3015643640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a04102d40 0x7f7a04103120 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.134+0000 7f7a0a595640 1 -- 172.21.15.18:0/3015643640 >> 172.21.15.18:0/3015643640 conn(0x7f7a040fc7a0 msgr2=0x7f7a040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.134+0000 7f7a0a595640 1 -- 172.21.15.18:0/3015643640 shutdown_connections 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.134+0000 7f7a0a595640 1 -- 172.21.15.18:0/3015643640 wait complete. 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.134+0000 7f7a0a595640 1 Processor -- start 2024-09-19T09:52:37.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f7a0a595640 1 -- start start 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f7a0a595640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a04102d40 0x7f7a04198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f7a0a595640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a04103660 0x7f7a04198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f7a0a595640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a0410c170 0x7f7a0419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f7a0a595640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a04111f70 con 0x7f7a04103660 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f7a0a595640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7a04111df0 con 0x7f7a04102d40 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f7a0a595640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a041120f0 con 0x7f7a0410c170 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a04103660 0x7f7a04198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a04103660 0x7f7a04198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36112/0 (socket says 172.21.15.18:36112) 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f79fbfff640 1 -- 172.21.15.18:0/2015124658 learned_addr learned my addr 172.21.15.18:0/2015124658 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f7a03fff640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a04102d40 0x7f7a04198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f79fbfff640 1 -- 172.21.15.18:0/2015124658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a0410c170 msgr2=0x7f7a0419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:37.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f7a08b32640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a0410c170 0x7f7a0419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f79fbfff640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a0410c170 0x7f7a0419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f79fbfff640 1 -- 172.21.15.18:0/2015124658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a04102d40 msgr2=0x7f7a04198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f79fbfff640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a04102d40 0x7f7a04198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f79fbfff640 1 -- 172.21.15.18:0/2015124658 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0419d4b0 con 0x7f7a04103660 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f7a03fff640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a04102d40 0x7f7a04198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.135+0000 7f79fbfff640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a04103660 0x7f7a04198a40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00d950 tx=0x7f79ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.136+0000 7f7a01ffb640 1 -- 172.21.15.18:0/2015124658 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec017030 con 0x7f7a04103660 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.136+0000 7f7a01ffb640 1 -- 172.21.15.18:0/2015124658 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ec004020 con 0x7f7a04103660 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.136+0000 7f7a0a595640 1 -- 172.21.15.18:0/2015124658 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0419d7a0 con 0x7f7a04103660 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.136+0000 7f7a01ffb640 1 -- 172.21.15.18:0/2015124658 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0047a0 con 0x7f7a04103660 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.136+0000 7f7a0a595640 1 -- 172.21.15.18:0/2015124658 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a041a5080 con 0x7f7a04103660 2024-09-19T09:52:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.138+0000 7f7a01ffb640 1 -- 172.21.15.18:0/2015124658 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f79ec0041d0 con 0x7f7a04103660 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.138+0000 7f7a0c96e740 1 Processor -- start 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.138+0000 7f7a0c96e740 1 -- start start 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f794a0 0x556c07f79880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f79dc0 0x556c07f84140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 0x556c07f86a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556c07edf2e0 con 0x556c07f794a0 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556c07e86ce0 con 0x556c07f79dc0 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556c07edb2a0 con 0x556c07f84680 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a08b32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f794a0 0x556c07f79880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a08b32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f794a0 0x556c07f79880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36128/0 (socket says 172.21.15.18:36128) 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a08b32640 1 -- 172.21.15.18:0/3367519422 learned_addr learned my addr 172.21.15.18:0/3367519422 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:37.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f79fbfff640 1 --2- 172.21.15.18:0/3367519422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 0x556c07f86a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a01ffb640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79f00a3240 0x7f79f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a03fff640 1 --2- 172.21.15.18:0/3367519422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f79dc0 0x556c07f84140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a08b32640 1 -- 172.21.15.18:0/3367519422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 msgr2=0x556c07f86a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a08b32640 1 --2- 172.21.15.18:0/3367519422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 0x556c07f86a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a08b32640 1 -- 172.21.15.18:0/3367519422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f79dc0 msgr2=0x556c07f84140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a08b32640 1 --2- 172.21.15.18:0/3367519422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f79dc0 0x556c07f84140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a08b32640 1 -- 172.21.15.18:0/3367519422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c07e6b440 con 0x556c07f794a0 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a01ffb640 1 -- 172.21.15.18:0/2015124658 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f79ec0cf310 con 0x7f7a04103660 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a08b32640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79f00a3240 0x7f79f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.139+0000 7f7a08b32640 1 --2- 172.21.15.18:0/3367519422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f794a0 0x556c07f79880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f79fc008e00 tx=0x7f79fc00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5013eadfd6f3dd7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f79fa7fc640 1 -- 172.21.15.18:0/3367519422 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc011dc0 con 0x556c07f794a0 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f79fa7fc640 1 -- 172.21.15.18:0/3367519422 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79fc01adc0 con 0x556c07f794a0 2024-09-19T09:52:37.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f79fa7fc640 1 -- 172.21.15.18:0/3367519422 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc019c80 con 0x556c07f794a0 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f7a0c96e740 1 -- 172.21.15.18:0/3367519422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f794a0 msgr2=0x556c07f79880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f7a08b32640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79f00a3240 0x7f79f00a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79fc01e000 tx=0x7f79fc01f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/3367519422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f794a0 0x556c07f79880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f79fc008e00 tx=0x7f79fc00d710 comp rx=0 tx=0).stop 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f7a0c96e740 1 -- 172.21.15.18:0/3367519422 shutdown_connections 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/3367519422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 0x556c07f86a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/3367519422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f79dc0 0x556c07f84140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/3367519422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f794a0 0x556c07f79880 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f7a0c96e740 1 -- 172.21.15.18:0/3367519422 >> 172.21.15.18:0/3367519422 conn(0x556c07f75a30 msgr2=0x556c07f75e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f7a0c96e740 1 -- 172.21.15.18:0/3367519422 shutdown_connections 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.140+0000 7f7a0c96e740 1 -- 172.21.15.18:0/3367519422 wait complete. 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f7a0c96e740 1 -- start start 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f7a0c96e740 1 Processor -- start 2024-09-19T09:52:37.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 0x556c07f83fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f81250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f84680 0x556c07f81790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556c07f87250 con 0x556c07f79dc0 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556c07e9a050 con 0x556c07f84680 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556c07f873d0 con 0x556c07f794a0 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f7a0c96e740 10 client.0 _ll_register_callbacks cb 0x556c07eda160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f81250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f81250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36138/0 (socket says 172.21.15.18:36138) 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f79fbfff640 1 -- 172.21.15.18:0/1701801677 learned_addr learned my addr 172.21.15.18:0/1701801677 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.141+0000 7f7a08b32640 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f84680 0x556c07f81790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f7a03fff640 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 0x556c07f83fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79fbfff640 1 -- 172.21.15.18:0/1701801677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 msgr2=0x556c07f83fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79fbfff640 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 0x556c07f83fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79fbfff640 1 -- 172.21.15.18:0/1701801677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f84680 msgr2=0x556c07f81790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79fbfff640 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f84680 0x556c07f81790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79fbfff640 1 -- 172.21.15.18:0/1701801677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c07c503c0 con 0x556c07f79dc0 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f7a03fff640 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 0x556c07f83fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79fbfff640 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f81250 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009610 tx=0x7f79ec005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f80bdc93c89cbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79e37fe640 1 -- 172.21.15.18:0/1701801677 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec09c060 con 0x556c07f79dc0 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79e37fe640 1 -- 172.21.15.18:0/1701801677 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f79ec099c60 con 0x556c07f79dc0 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1701801677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79fc01adc0 con 0x556c07f79dc0 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79e37fe640 1 -- 172.21.15.18:0/1701801677 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f79ec09b960 con 0x556c07f79dc0 2024-09-19T09:52:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f7a0c96e740 10 client.15318 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1701801677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c07f92c30 con 0x556c07f79dc0 2024-09-19T09:52:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.142+0000 7f79e37fe640 1 -- 172.21.15.18:0/1701801677 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79fc01adc0 con 0x556c07f79dc0 2024-09-19T09:52:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.143+0000 7f79e37fe640 1 -- 172.21.15.18:0/1701801677 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f79ec0a41d0 con 0x556c07f79dc0 2024-09-19T09:52:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.143+0000 7f7a0c96e740 10 client.15318 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.143+0000 7f7a0c96e740 10 client.15318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:52:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.143+0000 7f7a0c96e740 20 client.15318 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.143+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556c07f94040 0x556c07f96490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.143+0000 7f7a0c96e740 4 client.15318 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:37.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.143+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1701801677 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c07eec850 con 0x556c07f94040 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.143+0000 7f7a03fff640 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556c07f94040 0x556c07f96490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.143+0000 7f7a03fff640 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556c07f94040 0x556c07f96490 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d83f1e0ccead070 server_cookie=a12a412835910011 in_seq=0 out_seq=0 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.143+0000 7f79e37fe640 10 client.15318 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f79e37fe640 1 -- 172.21.15.18:0/1701801677 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c07eec850 con 0x556c07f94040 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f79e37fe640 10 client.15318 handle_command_reply: tid=0 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f7a0c96e740 1 client.15318 shutdown 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1701801677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 msgr2=0x556c07f81250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f81250 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009610 tx=0x7f79ec005780 comp rx=0 tx=0).stop 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1701801677 shutdown_connections 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556c07f94040 0x556c07f96490 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f84680 0x556c07f81790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f81250 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/1701801677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 0x556c07f83fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1701801677 >> 172.21.15.18:0/1701801677 conn(0x556c07f75a30 msgr2=0x556c07f7b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:37.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.144+0000 7f79e37fe640 0 client.15318 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:37.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.145+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1701801677 shutdown_connections 2024-09-19T09:52:37.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.145+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1701801677 wait complete. 2024-09-19T09:52:37.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.145+0000 7f7a0c96e740 20 client.15318 trim_cache size 0 max 16384 2024-09-19T09:52:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f7a0c96e740 1 Processor -- start 2024-09-19T09:52:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f7a0c96e740 1 -- start start 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f794a0 0x556c07f904b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f9bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 0x556c07f9c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a041ad530 con 0x556c07f79dc0 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7a041af070 con 0x556c07f794a0 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a041adc00 con 0x556c07f84680 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f9bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f9bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36148/0 (socket says 172.21.15.18:36148) 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f79fbfff640 1 -- 172.21.15.18:0/1992866844 learned_addr learned my addr 172.21.15.18:0/1992866844 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.162+0000 7f7a03fff640 1 --2- 172.21.15.18:0/1992866844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f794a0 0x556c07f904b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f7a08b32640 1 --2- 172.21.15.18:0/1992866844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 0x556c07f9c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f79fbfff640 1 -- 172.21.15.18:0/1992866844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 msgr2=0x556c07f9c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f79fbfff640 1 --2- 172.21.15.18:0/1992866844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 0x556c07f9c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f79fbfff640 1 -- 172.21.15.18:0/1992866844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f794a0 msgr2=0x556c07f904b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f79fbfff640 1 --2- 172.21.15.18:0/1992866844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f794a0 0x556c07f904b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f79fbfff640 1 -- 172.21.15.18:0/1992866844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c07f792d0 con 0x556c07f79dc0 2024-09-19T09:52:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f7a08b32640 1 --2- 172.21.15.18:0/1992866844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 0x556c07f9c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:37.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f79fbfff640 1 --2- 172.21.15.18:0/1992866844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f9bd60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f79ec005fd0 tx=0x7f79ec0963c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0191053ba9d3b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:37.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f79f9ffb640 1 -- 172.21.15.18:0/1992866844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec09b2c0 con 0x556c07f79dc0 2024-09-19T09:52:37.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f79f9ffb640 1 -- 172.21.15.18:0/1992866844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ec09c060 con 0x556c07f79dc0 2024-09-19T09:52:37.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.163+0000 7f79f9ffb640 1 -- 172.21.15.18:0/1992866844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec097fd0 con 0x556c07f79dc0 2024-09-19T09:52:37.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1992866844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 msgr2=0x556c07f9bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/1992866844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f9bd60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f79ec005fd0 tx=0x7f79ec0963c0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1992866844 shutdown_connections 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/1992866844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f84680 0x556c07f9c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/1992866844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f79dc0 0x556c07f9bd60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/1992866844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f794a0 0x556c07f904b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1992866844 >> 172.21.15.18:0/1992866844 conn(0x556c07f75a30 msgr2=0x556c07f832d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1992866844 shutdown_connections 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 -- 172.21.15.18:0/1992866844 wait complete. 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 -- start start 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.164+0000 7f7a0c96e740 1 Processor -- start 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 0x556c07f89e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f79dc0 0x556c07f8a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a0c96e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f84680 0x556c07ff5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a041ae9a0 con 0x556c07f84680 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7a041ae2d0 con 0x556c07f79dc0 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a0c96e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a041ab510 con 0x556c07f794a0 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a0c96e740 10 client.0 _ll_register_callbacks cb 0x7f79ec0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a08b32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f84680 0x556c07ff5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a08b32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f84680 0x556c07ff5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36158/0 (socket says 172.21.15.18:36158) 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a08b32640 1 -- 172.21.15.18:0/999934062 learned_addr learned my addr 172.21.15.18:0/999934062 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f79fbfff640 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f79dc0 0x556c07f8a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a03fff640 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 0x556c07f89e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a08b32640 1 -- 172.21.15.18:0/999934062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 msgr2=0x556c07f89e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a08b32640 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 0x556c07f89e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a08b32640 1 -- 172.21.15.18:0/999934062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f79dc0 msgr2=0x556c07f8a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a08b32640 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f79dc0 0x556c07f8a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a08b32640 1 -- 172.21.15.18:0/999934062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c07ff6390 con 0x556c07f84680 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a03fff640 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 0x556c07f89e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f7a08b32640 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f84680 0x556c07ff5cf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f79fc008e00 tx=0x7f79fc019ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4417c521d8eabca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f79e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.165+0000 7f79e37fe640 1 -- 172.21.15.18:0/999934062 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc035060 con 0x556c07f84680 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f79e37fe640 1 -- 172.21.15.18:0/999934062 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f79fc01aa70 con 0x556c07f84680 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f7a0c96e740 1 -- 172.21.15.18:0/999934062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79ec09c060 con 0x556c07f84680 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f79e37fe640 1 -- 172.21.15.18:0/999934062 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f79fc008900 con 0x556c07f84680 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f7a0c96e740 10 client.15324 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f7a0c96e740 1 -- 172.21.15.18:0/999934062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c07ffe880 con 0x556c07f84680 2024-09-19T09:52:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f79e37fe640 1 -- 172.21.15.18:0/999934062 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ec09c060 con 0x556c07f84680 2024-09-19T09:52:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f79e37fe640 1 -- 172.21.15.18:0/999934062 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f79fc01ac70 con 0x556c07f84680 2024-09-19T09:52:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f7a0c96e740 10 client.15324 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f7a0c96e740 10 client.15324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:52:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f7a0c96e740 20 client.15324 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556c07ffecd0 0x556c080010f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f7a0c96e740 4 client.15324 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:52:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f7a0c96e740 1 -- 172.21.15.18:0/999934062 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c07f96820 con 0x556c07ffecd0 2024-09-19T09:52:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.166+0000 7f7a03fff640 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556c07ffecd0 0x556c080010f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:37.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f79e37fe640 10 client.15324 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:37.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a03fff640 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556c07ffecd0 0x556c080010f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bd394ccd04e4874 server_cookie=90d5c33440b0aac9 in_seq=0 out_seq=0 2024-09-19T09:52:37.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f79e37fe640 1 -- 172.21.15.18:0/999934062 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556c07f96820 con 0x556c07ffecd0 2024-09-19T09:52:37.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f79e37fe640 10 client.15324 handle_command_reply: tid=0 2024-09-19T09:52:37.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 client.15324 shutdown 2024-09-19T09:52:37.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 -- 172.21.15.18:0/999934062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f84680 msgr2=0x556c07ff5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:37.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f84680 0x556c07ff5cf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f79fc008e00 tx=0x7f79fc019ba0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 -- 172.21.15.18:0/999934062 shutdown_connections 2024-09-19T09:52:37.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556c07ffecd0 0x556c080010f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556c07f84680 0x556c07ff5cf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556c07f79dc0 0x556c07f8a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f79e37fe640 0 client.15324 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 --2- 172.21.15.18:0/999934062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c07f794a0 0x556c07f89e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 -- 172.21.15.18:0/999934062 >> 172.21.15.18:0/999934062 conn(0x556c07f75a30 msgr2=0x556c07f74350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 -- 172.21.15.18:0/999934062 shutdown_connections 2024-09-19T09:52:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.167+0000 7f7a0c96e740 1 -- 172.21.15.18:0/999934062 wait complete. 2024-09-19T09:52:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0c96e740 20 client.15324 trim_cache size 0 max 16384 2024-09-19T09:52:37.186 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:52:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T09:52:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "afc31030-a1cd-44e1-bae8-7a6699872f2d": { 2024-09-19T09:52:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T09:52:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "afc31030-a1cd-44e1-bae8-7a6699872f2d", 2024-09-19T09:52:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T09:52:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:52:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:52:37.187 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:37.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 -- 172.21.15.18:0/2015124658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79f00a3240 msgr2=0x7f79f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:37.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79f00a3240 0x7f79f00a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79fc01e000 tx=0x7f79fc01f000 comp rx=0 tx=0).stop 2024-09-19T09:52:37.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 -- 172.21.15.18:0/2015124658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a04103660 msgr2=0x7f7a04198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:37.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a04103660 0x7f7a04198a40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00d950 tx=0x7f79ec00de10 comp rx=0 tx=0).stop 2024-09-19T09:52:37.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 -- 172.21.15.18:0/2015124658 shutdown_connections 2024-09-19T09:52:37.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79f00a3240 0x7f79f00a5700 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a0410c170 0x7f7a0419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a04103660 0x7f7a04198a40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 --2- 172.21.15.18:0/2015124658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a04102d40 0x7f7a04198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:37.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 -- 172.21.15.18:0/2015124658 >> 172.21.15.18:0/2015124658 conn(0x7f7a040fc7a0 msgr2=0x7f7a040fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:37.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 -- 172.21.15.18:0/2015124658 shutdown_connections 2024-09-19T09:52:37.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:37.168+0000 7f7a0a595640 1 -- 172.21.15.18:0/2015124658 wait complete. 2024-09-19T09:52:37.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:37.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:37.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:52:37.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:52:37.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:37.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:37 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:37.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:37 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:37.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:37 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:52:37.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:37 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:52:37.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:37 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:37.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:37 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:37.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:37 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:37.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:37 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:52:37.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:37 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:52:37.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:37 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:52:37.801 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-09-19T09:52:36.379457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663890,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1309,"num_read_kb":785,"num_write":443,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374668,"kb_used_data":12940,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567156,"statfs":{"total":1151940427776,"available":1151556767744,"internally_reserved":0,"allocated":13250560,"data_stored":7291960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":63,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002676"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372833+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:52:00.372833+0000","last_peered":"2024-09-19T09:52:00.372833+0000","last_clean":"2024-09-19T09:52:00.372833+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:52:00.372833+0000","last_undegraded":"2024-09-19T09:52:00.372833+0000","last_fullsized":"2024-09-19T09:52:00.372833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365913+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:52:00.365913+0000","last_peered":"2024-09-19T09:52:00.365913+0000","last_clean":"2024-09-19T09:52:00.365913+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:52:00.365913+0000","last_undegraded":"2024-09-19T09:52:00.365913+0000","last_fullsized":"2024-09-19T09:52:00.365913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373314+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:52:00.373314+0000","last_peered":"2024-09-19T09:52:00.373314+0000","last_clean":"2024-09-19T09:52:00.373314+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:52:00.373314+0000","last_undegraded":"2024-09-19T09:52:00.373314+0000","last_fullsized":"2024-09-19T09:52:00.373314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362650+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:52:00.362650+0000","last_peered":"2024-09-19T09:52:00.362650+0000","last_clean":"2024-09-19T09:52:00.362650+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:52:00.362650+0000","last_undegraded":"2024-09-19T09:52:00.362650+0000","last_fullsized":"2024-09-19T09:52:00.362650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.335091+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:52:00.335091+0000","last_peered":"2024-09-19T09:52:00.335091+0000","last_clean":"2024-09-19T09:52:00.335091+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:52:00.335091+0000","last_undegraded":"2024-09-19T09:52:00.335091+0000","last_fullsized":"2024-09-19T09:52:00.335091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359516+0000","last_change":"2024-09-19T09:51:31.818907+0000","last_active":"2024-09-19T09:52:00.359516+0000","last_peered":"2024-09-19T09:52:00.359516+0000","last_clean":"2024-09-19T09:52:00.359516+0000","last_became_active":"2024-09-19T09:51:31.818522+0000","last_became_peered":"2024-09-19T09:51:31.818522+0000","last_unstale":"2024-09-19T09:52:00.359516+0000","last_undegraded":"2024-09-19T09:52:00.359516+0000","last_fullsized":"2024-09-19T09:52:00.359516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:04.062704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365337+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:52:00.365337+0000","last_peered":"2024-09-19T09:52:00.365337+0000","last_clean":"2024-09-19T09:52:00.365337+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:52:00.365337+0000","last_undegraded":"2024-09-19T09:52:00.365337+0000","last_fullsized":"2024-09-19T09:52:00.365337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358908+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:52:00.358908+0000","last_peered":"2024-09-19T09:52:00.358908+0000","last_clean":"2024-09-19T09:52:00.358908+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:52:00.358908+0000","last_undegraded":"2024-09-19T09:52:00.358908+0000","last_fullsized":"2024-09-19T09:52:00.358908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370979+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:52:00.370979+0000","last_peered":"2024-09-19T09:52:00.370979+0000","last_clean":"2024-09-19T09:52:00.370979+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:52:00.370979+0000","last_undegraded":"2024-09-19T09:52:00.370979+0000","last_fullsized":"2024-09-19T09:52:00.370979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364519+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:52:00.364519+0000","last_peered":"2024-09-19T09:52:00.364519+0000","last_clean":"2024-09-19T09:52:00.364519+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:52:00.364519+0000","last_undegraded":"2024-09-19T09:52:00.364519+0000","last_fullsized":"2024-09-19T09:52:00.364519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.368226+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:52:00.368226+0000","last_peered":"2024-09-19T09:52:00.368226+0000","last_clean":"2024-09-19T09:52:00.368226+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:52:00.368226+0000","last_undegraded":"2024-09-19T09:52:00.368226+0000","last_fullsized":"2024-09-19T09:52:00.368226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362431+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:52:00.362431+0000","last_peered":"2024-09-19T09:52:00.362431+0000","last_clean":"2024-09-19T09:52:00.362431+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:52:00.362431+0000","last_undegraded":"2024-09-19T09:52:00.362431+0000","last_fullsized":"2024-09-19T09:52:00.362431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351092+0000","last_change":"2024-09-19T09:51:31.818910+0000","last_active":"2024-09-19T09:52:00.351092+0000","last_peered":"2024-09-19T09:52:00.351092+0000","last_clean":"2024-09-19T09:52:00.351092+0000","last_became_active":"2024-09-19T09:51:31.818581+0000","last_became_peered":"2024-09-19T09:51:31.818581+0000","last_unstale":"2024-09-19T09:52:00.351092+0000","last_undegraded":"2024-09-19T09:52:00.351092+0000","last_fullsized":"2024-09-19T09:52:00.351092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.736835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365871+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:52:00.365871+0000","last_peered":"2024-09-19T09:52:00.365871+0000","last_clean":"2024-09-19T09:52:00.365871+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:52:00.365871+0000","last_undegraded":"2024-09-19T09:52:00.365871+0000","last_fullsized":"2024-09-19T09:52:00.365871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361631+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:52:00.361631+0000","last_peered":"2024-09-19T09:52:00.361631+0000","last_clean":"2024-09-19T09:52:00.361631+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:52:00.361631+0000","last_undegraded":"2024-09-19T09:52:00.361631+0000","last_fullsized":"2024-09-19T09:52:00.361631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372654+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:52:00.372654+0000","last_peered":"2024-09-19T09:52:00.372654+0000","last_clean":"2024-09-19T09:52:00.372654+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:52:00.372654+0000","last_undegraded":"2024-09-19T09:52:00.372654+0000","last_fullsized":"2024-09-19T09:52:00.372654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373008+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:52:00.373008+0000","last_peered":"2024-09-19T09:52:00.373008+0000","last_clean":"2024-09-19T09:52:00.373008+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:52:00.373008+0000","last_undegraded":"2024-09-19T09:52:00.373008+0000","last_fullsized":"2024-09-19T09:52:00.373008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372768+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:52:00.372768+0000","last_peered":"2024-09-19T09:52:00.372768+0000","last_clean":"2024-09-19T09:52:00.372768+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:52:00.372768+0000","last_undegraded":"2024-09-19T09:52:00.372768+0000","last_fullsized":"2024-09-19T09:52:00.372768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.356302+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:52:00.356302+0000","last_peered":"2024-09-19T09:52:00.356302+0000","last_clean":"2024-09-19T09:52:00.356302+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:52:00.356302+0000","last_undegraded":"2024-09-19T09:52:00.356302+0000","last_fullsized":"2024-09-19T09:52:00.356302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351159+0000","last_change":"2024-09-19T09:51:31.823803+0000","last_active":"2024-09-19T09:52:00.351159+0000","last_peered":"2024-09-19T09:52:00.351159+0000","last_clean":"2024-09-19T09:52:00.351159+0000","last_became_active":"2024-09-19T09:51:31.823361+0000","last_became_peered":"2024-09-19T09:51:31.823361+0000","last_unstale":"2024-09-19T09:52:00.351159+0000","last_undegraded":"2024-09-19T09:52:00.351159+0000","last_fullsized":"2024-09-19T09:52:00.351159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:33.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364330+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:52:00.364330+0000","last_peered":"2024-09-19T09:52:00.364330+0000","last_clean":"2024-09-19T09:52:00.364330+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:52:00.364330+0000","last_undegraded":"2024-09-19T09:52:00.364330+0000","last_fullsized":"2024-09-19T09:52:00.364330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370710+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:52:00.370710+0000","last_peered":"2024-09-19T09:52:00.370710+0000","last_clean":"2024-09-19T09:52:00.370710+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:52:00.370710+0000","last_undegraded":"2024-09-19T09:52:00.370710+0000","last_fullsized":"2024-09-19T09:52:00.370710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358193+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:52:00.358193+0000","last_peered":"2024-09-19T09:52:00.358193+0000","last_clean":"2024-09-19T09:52:00.358193+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:52:00.358193+0000","last_undegraded":"2024-09-19T09:52:00.358193+0000","last_fullsized":"2024-09-19T09:52:00.358193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358828+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:52:00.358828+0000","last_peered":"2024-09-19T09:52:00.358828+0000","last_clean":"2024-09-19T09:52:00.358828+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:52:00.358828+0000","last_undegraded":"2024-09-19T09:52:00.358828+0000","last_fullsized":"2024-09-19T09:52:00.358828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.367256+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:52:00.367256+0000","last_peered":"2024-09-19T09:52:00.367256+0000","last_clean":"2024-09-19T09:52:00.367256+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:52:00.367256+0000","last_undegraded":"2024-09-19T09:52:00.367256+0000","last_fullsized":"2024-09-19T09:52:00.367256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.357344+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:52:00.357344+0000","last_peered":"2024-09-19T09:52:00.357344+0000","last_clean":"2024-09-19T09:52:00.357344+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:52:00.357344+0000","last_undegraded":"2024-09-19T09:52:00.357344+0000","last_fullsized":"2024-09-19T09:52:00.357344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351848+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:52:00.351848+0000","last_peered":"2024-09-19T09:52:00.351848+0000","last_clean":"2024-09-19T09:52:00.351848+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:52:00.351848+0000","last_undegraded":"2024-09-19T09:52:00.351848+0000","last_fullsized":"2024-09-19T09:52:00.351848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350260+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:52:00.350260+0000","last_peered":"2024-09-19T09:52:00.350260+0000","last_clean":"2024-09-19T09:52:00.350260+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:52:00.350260+0000","last_undegraded":"2024-09-19T09:52:00.350260+0000","last_fullsized":"2024-09-19T09:52:00.350260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361791+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:52:00.361791+0000","last_peered":"2024-09-19T09:52:00.361791+0000","last_clean":"2024-09-19T09:52:00.361791+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:52:00.361791+0000","last_undegraded":"2024-09-19T09:52:00.361791+0000","last_fullsized":"2024-09-19T09:52:00.361791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355490+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:52:00.355490+0000","last_peered":"2024-09-19T09:52:00.355490+0000","last_clean":"2024-09-19T09:52:00.355490+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:52:00.355490+0000","last_undegraded":"2024-09-19T09:52:00.355490+0000","last_fullsized":"2024-09-19T09:52:00.355490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361354+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:52:00.361354+0000","last_peered":"2024-09-19T09:52:00.361354+0000","last_clean":"2024-09-19T09:52:00.361354+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:52:00.361354+0000","last_undegraded":"2024-09-19T09:52:00.361354+0000","last_fullsized":"2024-09-19T09:52:00.361354+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353668+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:52:00.353668+0000","last_peered":"2024-09-19T09:52:00.353668+0000","last_clean":"2024-09-19T09:52:00.353668+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:52:00.353668+0000","last_undegraded":"2024-09-19T09:52:00.353668+0000","last_fullsized":"2024-09-19T09:52:00.353668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.345044+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:52:00.345044+0000","last_peered":"2024-09-19T09:52:00.345044+0000","last_clean":"2024-09-19T09:52:00.345044+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:52:00.345044+0000","last_undegraded":"2024-09-19T09:52:00.345044+0000","last_fullsized":"2024-09-19T09:52:00.345044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:31.496459+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:52:31.496459+0000","last_peered":"2024-09-19T09:52:31.496459+0000","last_clean":"2024-09-19T09:52:31.496459+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:52:31.496459+0000","last_undegraded":"2024-09-19T09:52:31.496459+0000","last_fullsized":"2024-09-19T09:52:31.496459+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359507+0000","last_change":"2024-09-19T09:51:31.825618+0000","last_active":"2024-09-19T09:52:00.359507+0000","last_peered":"2024-09-19T09:52:00.359507+0000","last_clean":"2024-09-19T09:52:00.359507+0000","last_became_active":"2024-09-19T09:51:31.824727+0000","last_became_peered":"2024-09-19T09:51:31.824727+0000","last_unstale":"2024-09-19T09:52:00.359507+0000","last_undegraded":"2024-09-19T09:52:00.359507+0000","last_fullsized":"2024-09-19T09:52:00.359507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:52.094074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816210+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:51:31.816210+0000","last_peered":"2024-09-19T09:51:31.816210+0000","last_clean":"2024-09-19T09:51:31.816210+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:51:31.816210+0000","last_undegraded":"2024-09-19T09:51:31.816210+0000","last_fullsized":"2024-09-19T09:51:31.816210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814498+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:51:31.814498+0000","last_peered":"2024-09-19T09:51:31.814498+0000","last_clean":"2024-09-19T09:51:31.814498+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:51:31.814498+0000","last_undegraded":"2024-09-19T09:51:31.814498+0000","last_fullsized":"2024-09-19T09:51:31.814498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355727+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:52:00.355727+0000","last_peered":"2024-09-19T09:52:00.355727+0000","last_clean":"2024-09-19T09:52:00.355727+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.355727+0000","last_undegraded":"2024-09-19T09:52:00.355727+0000","last_fullsized":"2024-09-19T09:52:00.355727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815599+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:51:31.815599+0000","last_peered":"2024-09-19T09:51:31.815599+0000","last_clean":"2024-09-19T09:51:31.815599+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:51:31.815599+0000","last_undegraded":"2024-09-19T09:51:31.815599+0000","last_fullsized":"2024-09-19T09:51:31.815599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363759+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:52:00.363759+0000","last_peered":"2024-09-19T09:52:00.363759+0000","last_clean":"2024-09-19T09:52:00.363759+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:52:00.363759+0000","last_undegraded":"2024-09-19T09:52:00.363759+0000","last_fullsized":"2024-09-19T09:52:00.363759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.497887+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:52:33.497887+0000","last_peered":"2024-09-19T09:52:33.497887+0000","last_clean":"2024-09-19T09:52:33.497887+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:52:33.497887+0000","last_undegraded":"2024-09-19T09:52:33.497887+0000","last_fullsized":"2024-09-19T09:52:33.497887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373477+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:52:00.373477+0000","last_peered":"2024-09-19T09:52:00.373477+0000","last_clean":"2024-09-19T09:52:00.373477+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:52:00.373477+0000","last_undegraded":"2024-09-19T09:52:00.373477+0000","last_fullsized":"2024-09-19T09:52:00.373477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415018+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:51:32.415018+0000","last_peered":"2024-09-19T09:51:32.415018+0000","last_clean":"2024-09-19T09:51:32.415018+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:51:32.415018+0000","last_undegraded":"2024-09-19T09:51:32.415018+0000","last_fullsized":"2024-09-19T09:51:32.415018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361630+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:52:00.361630+0000","last_peered":"2024-09-19T09:52:00.361630+0000","last_clean":"2024-09-19T09:52:00.361630+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:52:00.361630+0000","last_undegraded":"2024-09-19T09:52:00.361630+0000","last_fullsized":"2024-09-19T09:52:00.361630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815716+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:51:31.815716+0000","last_peered":"2024-09-19T09:51:31.815716+0000","last_clean":"2024-09-19T09:51:31.815716+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:51:31.815716+0000","last_undegraded":"2024-09-19T09:51:31.815716+0000","last_fullsized":"2024-09-19T09:51:31.815716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373858+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:52:00.373858+0000","last_peered":"2024-09-19T09:52:00.373858+0000","last_clean":"2024-09-19T09:52:00.373858+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:52:00.373858+0000","last_undegraded":"2024-09-19T09:52:00.373858+0000","last_fullsized":"2024-09-19T09:52:00.373858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'36","reported_seq":297,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.497880+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:52:33.497880+0000","last_peered":"2024-09-19T09:52:33.497880+0000","last_clean":"2024-09-19T09:52:33.497880+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:52:33.497880+0000","last_undegraded":"2024-09-19T09:52:33.497880+0000","last_fullsized":"2024-09-19T09:52:33.497880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65490,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":239,"num_read_kb":184,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363505+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:52:00.363505+0000","last_peered":"2024-09-19T09:52:00.363505+0000","last_clean":"2024-09-19T09:52:00.363505+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:52:00.363505+0000","last_undegraded":"2024-09-19T09:52:00.363505+0000","last_fullsized":"2024-09-19T09:52:00.363505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821655+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:51:31.821655+0000","last_peered":"2024-09-19T09:51:31.821655+0000","last_clean":"2024-09-19T09:51:31.821655+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:51:31.821655+0000","last_undegraded":"2024-09-19T09:51:31.821655+0000","last_fullsized":"2024-09-19T09:51:31.821655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363961+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:52:00.363961+0000","last_peered":"2024-09-19T09:52:00.363961+0000","last_clean":"2024-09-19T09:52:00.363961+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:52:00.363961+0000","last_undegraded":"2024-09-19T09:52:00.363961+0000","last_fullsized":"2024-09-19T09:52:00.363961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815497+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:31.815497+0000","last_peered":"2024-09-19T09:51:31.815497+0000","last_clean":"2024-09-19T09:51:31.815497+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:51:31.815497+0000","last_undegraded":"2024-09-19T09:51:31.815497+0000","last_fullsized":"2024-09-19T09:51:31.815497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369638+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:52:00.369638+0000","last_peered":"2024-09-19T09:52:00.369638+0000","last_clean":"2024-09-19T09:52:00.369638+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:52:00.369638+0000","last_undegraded":"2024-09-19T09:52:00.369638+0000","last_fullsized":"2024-09-19T09:52:00.369638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:32.492403+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:52:32.492403+0000","last_peered":"2024-09-19T09:52:32.492403+0000","last_clean":"2024-09-19T09:52:32.492403+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:52:32.492403+0000","last_undegraded":"2024-09-19T09:52:32.492403+0000","last_fullsized":"2024-09-19T09:52:32.492403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365299+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:52:00.365299+0000","last_peered":"2024-09-19T09:52:00.365299+0000","last_clean":"2024-09-19T09:52:00.365299+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:52:00.365299+0000","last_undegraded":"2024-09-19T09:52:00.365299+0000","last_fullsized":"2024-09-19T09:52:00.365299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821556+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:51:31.821556+0000","last_peered":"2024-09-19T09:51:31.821556+0000","last_clean":"2024-09-19T09:51:31.821556+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:51:31.821556+0000","last_undegraded":"2024-09-19T09:51:31.821556+0000","last_fullsized":"2024-09-19T09:51:31.821556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359861+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:52:00.359861+0000","last_peered":"2024-09-19T09:52:00.359861+0000","last_clean":"2024-09-19T09:52:00.359861+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:52:00.359861+0000","last_undegraded":"2024-09-19T09:52:00.359861+0000","last_fullsized":"2024-09-19T09:52:00.359861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822551+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:51:31.822551+0000","last_peered":"2024-09-19T09:51:31.822551+0000","last_clean":"2024-09-19T09:51:31.822551+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:51:31.822551+0000","last_undegraded":"2024-09-19T09:51:31.822551+0000","last_fullsized":"2024-09-19T09:51:31.822551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.352459+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:52:00.352459+0000","last_peered":"2024-09-19T09:52:00.352459+0000","last_clean":"2024-09-19T09:52:00.352459+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:52:00.352459+0000","last_undegraded":"2024-09-19T09:52:00.352459+0000","last_fullsized":"2024-09-19T09:52:00.352459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814756+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:51:31.814756+0000","last_peered":"2024-09-19T09:51:31.814756+0000","last_clean":"2024-09-19T09:51:31.814756+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:51:31.814756+0000","last_undegraded":"2024-09-19T09:51:31.814756+0000","last_fullsized":"2024-09-19T09:51:31.814756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.366823+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:52:00.366823+0000","last_peered":"2024-09-19T09:52:00.366823+0000","last_clean":"2024-09-19T09:52:00.366823+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:52:00.366823+0000","last_undegraded":"2024-09-19T09:52:00.366823+0000","last_fullsized":"2024-09-19T09:52:00.366823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815831+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:51:31.815831+0000","last_peered":"2024-09-19T09:51:31.815831+0000","last_clean":"2024-09-19T09:51:31.815831+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:51:31.815831+0000","last_undegraded":"2024-09-19T09:51:31.815831+0000","last_fullsized":"2024-09-19T09:51:31.815831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365646+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:52:00.365646+0000","last_peered":"2024-09-19T09:52:00.365646+0000","last_clean":"2024-09-19T09:52:00.365646+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:52:00.365646+0000","last_undegraded":"2024-09-19T09:52:00.365646+0000","last_fullsized":"2024-09-19T09:52:00.365646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:30.494422+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:52:30.494422+0000","last_peered":"2024-09-19T09:52:30.494422+0000","last_clean":"2024-09-19T09:52:30.494422+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:52:30.494422+0000","last_undegraded":"2024-09-19T09:52:30.494422+0000","last_fullsized":"2024-09-19T09:52:30.494422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360813+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:52:00.360813+0000","last_peered":"2024-09-19T09:52:00.360813+0000","last_clean":"2024-09-19T09:52:00.360813+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:52:00.360813+0000","last_undegraded":"2024-09-19T09:52:00.360813+0000","last_fullsized":"2024-09-19T09:52:00.360813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414764+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:51:32.414764+0000","last_peered":"2024-09-19T09:51:32.414764+0000","last_clean":"2024-09-19T09:51:32.414764+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:51:32.414764+0000","last_undegraded":"2024-09-19T09:51:32.414764+0000","last_fullsized":"2024-09-19T09:51:32.414764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170061+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:51:32.170061+0000","last_peered":"2024-09-19T09:51:32.170061+0000","last_clean":"2024-09-19T09:51:32.170061+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:51:32.170061+0000","last_undegraded":"2024-09-19T09:51:32.170061+0000","last_fullsized":"2024-09-19T09:51:32.170061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.348017+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:52:00.348017+0000","last_peered":"2024-09-19T09:52:00.348017+0000","last_clean":"2024-09-19T09:52:00.348017+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:52:00.348017+0000","last_undegraded":"2024-09-19T09:52:00.348017+0000","last_fullsized":"2024-09-19T09:52:00.348017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414764+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:51:32.414764+0000","last_peered":"2024-09-19T09:51:32.414764+0000","last_clean":"2024-09-19T09:51:32.414764+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:51:32.414764+0000","last_undegraded":"2024-09-19T09:51:32.414764+0000","last_fullsized":"2024-09-19T09:51:32.414764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.352775+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:52:00.352775+0000","last_peered":"2024-09-19T09:52:00.352775+0000","last_clean":"2024-09-19T09:52:00.352775+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:52:00.352775+0000","last_undegraded":"2024-09-19T09:52:00.352775+0000","last_fullsized":"2024-09-19T09:52:00.352775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'7","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.493032+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:52:33.493032+0000","last_peered":"2024-09-19T09:52:33.493032+0000","last_clean":"2024-09-19T09:52:33.493032+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:52:33.493032+0000","last_undegraded":"2024-09-19T09:52:33.493032+0000","last_fullsized":"2024-09-19T09:52:33.493032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359409+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:52:00.359409+0000","last_peered":"2024-09-19T09:52:00.359409+0000","last_clean":"2024-09-19T09:52:00.359409+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:52:00.359409+0000","last_undegraded":"2024-09-19T09:52:00.359409+0000","last_fullsized":"2024-09-19T09:52:00.359409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.493392+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:52:33.493392+0000","last_peered":"2024-09-19T09:52:33.493392+0000","last_clean":"2024-09-19T09:52:33.493392+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:52:33.493392+0000","last_undegraded":"2024-09-19T09:52:33.493392+0000","last_fullsized":"2024-09-19T09:52:33.493392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363943+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:52:00.363943+0000","last_peered":"2024-09-19T09:52:00.363943+0000","last_clean":"2024-09-19T09:52:00.363943+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:52:00.363943+0000","last_undegraded":"2024-09-19T09:52:00.363943+0000","last_fullsized":"2024-09-19T09:52:00.363943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824487+0000","last_change":"2024-09-19T09:51:31.824076+0000","last_active":"2024-09-19T09:51:31.824487+0000","last_peered":"2024-09-19T09:51:31.824487+0000","last_clean":"2024-09-19T09:51:31.824487+0000","last_became_active":"2024-09-19T09:51:31.823642+0000","last_became_peered":"2024-09-19T09:51:31.823642+0000","last_unstale":"2024-09-19T09:51:31.824487+0000","last_undegraded":"2024-09-19T09:51:31.824487+0000","last_fullsized":"2024-09-19T09:51:31.824487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:53.035531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361958+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:52:00.361958+0000","last_peered":"2024-09-19T09:52:00.361958+0000","last_clean":"2024-09-19T09:52:00.361958+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:52:00.361958+0000","last_undegraded":"2024-09-19T09:52:00.361958+0000","last_fullsized":"2024-09-19T09:52:00.361958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823018+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:51:31.823018+0000","last_peered":"2024-09-19T09:51:31.823018+0000","last_clean":"2024-09-19T09:51:31.823018+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:51:31.823018+0000","last_undegraded":"2024-09-19T09:51:31.823018+0000","last_fullsized":"2024-09-19T09:51:31.823018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350847+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:52:00.350847+0000","last_peered":"2024-09-19T09:52:00.350847+0000","last_clean":"2024-09-19T09:52:00.350847+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:52:00.350847+0000","last_undegraded":"2024-09-19T09:52:00.350847+0000","last_fullsized":"2024-09-19T09:52:00.350847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370692+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:52:00.370692+0000","last_peered":"2024-09-19T09:52:00.370692+0000","last_clean":"2024-09-19T09:52:00.370692+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:52:00.370692+0000","last_undegraded":"2024-09-19T09:52:00.370692+0000","last_fullsized":"2024-09-19T09:52:00.370692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360865+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:52:00.360865+0000","last_peered":"2024-09-19T09:52:00.360865+0000","last_clean":"2024-09-19T09:52:00.360865+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:52:00.360865+0000","last_undegraded":"2024-09-19T09:52:00.360865+0000","last_fullsized":"2024-09-19T09:52:00.360865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170286+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:51:32.170286+0000","last_peered":"2024-09-19T09:51:32.170286+0000","last_clean":"2024-09-19T09:51:32.170286+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:51:32.170286+0000","last_undegraded":"2024-09-19T09:51:32.170286+0000","last_fullsized":"2024-09-19T09:51:32.170286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361925+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:52:00.361925+0000","last_peered":"2024-09-19T09:52:00.361925+0000","last_clean":"2024-09-19T09:52:00.361925+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:52:00.361925+0000","last_undegraded":"2024-09-19T09:52:00.361925+0000","last_fullsized":"2024-09-19T09:52:00.361925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964590+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:51:32.964590+0000","last_peered":"2024-09-19T09:51:32.964590+0000","last_clean":"2024-09-19T09:51:32.964590+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:51:32.964590+0000","last_undegraded":"2024-09-19T09:51:32.964590+0000","last_fullsized":"2024-09-19T09:51:32.964590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.320920+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:52:00.320920+0000","last_peered":"2024-09-19T09:52:00.320920+0000","last_clean":"2024-09-19T09:52:00.320920+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.320920+0000","last_undegraded":"2024-09-19T09:52:00.320920+0000","last_fullsized":"2024-09-19T09:52:00.320920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823345+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:51:31.823345+0000","last_peered":"2024-09-19T09:51:31.823345+0000","last_clean":"2024-09-19T09:51:31.823345+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:51:31.823345+0000","last_undegraded":"2024-09-19T09:51:31.823345+0000","last_fullsized":"2024-09-19T09:51:31.823345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353447+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:52:00.353447+0000","last_peered":"2024-09-19T09:52:00.353447+0000","last_clean":"2024-09-19T09:52:00.353447+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:52:00.353447+0000","last_undegraded":"2024-09-19T09:52:00.353447+0000","last_fullsized":"2024-09-19T09:52:00.353447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.830511+0000","last_change":"2024-09-19T09:51:31.830511+0000","last_active":"2024-09-19T09:51:31.830511+0000","last_peered":"2024-09-19T09:51:31.830511+0000","last_clean":"2024-09-19T09:51:31.830511+0000","last_became_active":"2024-09-19T09:51:31.825672+0000","last_became_peered":"2024-09-19T09:51:31.825672+0000","last_unstale":"2024-09-19T09:51:31.830511+0000","last_undegraded":"2024-09-19T09:51:31.830511+0000","last_fullsized":"2024-09-19T09:51:31.830511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.101027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360592+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:52:00.360592+0000","last_peered":"2024-09-19T09:52:00.360592+0000","last_clean":"2024-09-19T09:52:00.360592+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:52:00.360592+0000","last_undegraded":"2024-09-19T09:52:00.360592+0000","last_fullsized":"2024-09-19T09:52:00.360592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821791+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:51:31.821791+0000","last_peered":"2024-09-19T09:51:31.821791+0000","last_clean":"2024-09-19T09:51:31.821791+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:51:31.821791+0000","last_undegraded":"2024-09-19T09:51:31.821791+0000","last_fullsized":"2024-09-19T09:51:31.821791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361855+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:52:00.361855+0000","last_peered":"2024-09-19T09:52:00.361855+0000","last_clean":"2024-09-19T09:52:00.361855+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:52:00.361855+0000","last_undegraded":"2024-09-19T09:52:00.361855+0000","last_fullsized":"2024-09-19T09:52:00.361855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369084+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:52:00.369084+0000","last_peered":"2024-09-19T09:52:00.369084+0000","last_clean":"2024-09-19T09:52:00.369084+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:52:00.369084+0000","last_undegraded":"2024-09-19T09:52:00.369084+0000","last_fullsized":"2024-09-19T09:52:00.369084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822749+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:51:31.822749+0000","last_peered":"2024-09-19T09:51:31.822749+0000","last_clean":"2024-09-19T09:51:31.822749+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:51:31.822749+0000","last_undegraded":"2024-09-19T09:51:31.822749+0000","last_fullsized":"2024-09-19T09:51:31.822749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.371499+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:52:00.371499+0000","last_peered":"2024-09-19T09:52:00.371499+0000","last_clean":"2024-09-19T09:52:00.371499+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:52:00.371499+0000","last_undegraded":"2024-09-19T09:52:00.371499+0000","last_fullsized":"2024-09-19T09:52:00.371499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822889+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:51:31.822889+0000","last_peered":"2024-09-19T09:51:31.822889+0000","last_clean":"2024-09-19T09:51:31.822889+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:51:31.822889+0000","last_undegraded":"2024-09-19T09:51:31.822889+0000","last_fullsized":"2024-09-19T09:51:31.822889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373699+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:52:00.373699+0000","last_peered":"2024-09-19T09:52:00.373699+0000","last_clean":"2024-09-19T09:52:00.373699+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:52:00.373699+0000","last_undegraded":"2024-09-19T09:52:00.373699+0000","last_fullsized":"2024-09-19T09:52:00.373699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823978+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:51:31.823978+0000","last_peered":"2024-09-19T09:51:31.823978+0000","last_clean":"2024-09-19T09:51:31.823978+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:51:31.823978+0000","last_undegraded":"2024-09-19T09:51:31.823978+0000","last_fullsized":"2024-09-19T09:51:31.823978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.349804+0000","last_change":"2024-09-19T09:51:31.824910+0000","last_active":"2024-09-19T09:52:00.349804+0000","last_peered":"2024-09-19T09:52:00.349804+0000","last_clean":"2024-09-19T09:52:00.349804+0000","last_became_active":"2024-09-19T09:51:31.824521+0000","last_became_peered":"2024-09-19T09:51:31.824521+0000","last_unstale":"2024-09-19T09:52:00.349804+0000","last_undegraded":"2024-09-19T09:52:00.349804+0000","last_fullsized":"2024-09-19T09:52:00.349804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:43.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:34.718288+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:52:34.718288+0000","last_peered":"2024-09-19T09:52:34.718288+0000","last_clean":"2024-09-19T09:52:34.718288+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:52:34.718288+0000","last_undegraded":"2024-09-19T09:52:34.718288+0000","last_fullsized":"2024-09-19T09:52:34.718288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73288,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1183,"num_read_kb":676,"num_write":260,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":221002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514535,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":442788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743467,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1100149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":443096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364858,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1036599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528384,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":442969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790020,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1034901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953546,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":443138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":509058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704676,"statfs":{"total":95995035648,"available":95953588224,"internally_reserved":0,"allocated":995328,"data_stored":510510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":443774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:52:37.806 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:52:37.806 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:52:38.262 INFO:tasks.cephfs.filesystem:scrub status for tag:afc31030-a1cd-44e1-bae8-7a6699872f2d - {'path': '/', 'tag': 'afc31030-a1cd-44e1-bae8-7a6699872f2d', 'options': 'recursive,force'} 2024-09-19T09:52:38.396 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:38.518 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:38 smithi018 ceph-mon[30956]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:52:38.518 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:38 smithi018 ceph-mon[30956]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:38.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:38 smithi049 ceph-mon[34858]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:52:38.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:38 smithi049 ceph-mon[34858]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:38 smithi162 ceph-mon[35174]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:52:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:38 smithi162 ceph-mon[35174]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.859+0000 7fe55dd0c640 1 -- 172.21.15.18:0/3787365849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe558100e20 msgr2=0x7fe558101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.859+0000 7fe55dd0c640 1 --2- 172.21.15.18:0/3787365849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe558100e20 0x7fe558101200 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe548009ca0 tx=0x7fe54802a950 comp rx=0 tx=0).stop 2024-09-19T09:52:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.859+0000 7fe55dd0c640 1 -- 172.21.15.18:0/3787365849 shutdown_connections 2024-09-19T09:52:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.859+0000 7fe55dd0c640 1 --2- 172.21.15.18:0/3787365849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe558102ef0 0x7fe55810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.859+0000 7fe55dd0c640 1 --2- 172.21.15.18:0/3787365849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe558102570 0x7fe5581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.859+0000 7fe55dd0c640 1 --2- 172.21.15.18:0/3787365849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe558100e20 0x7fe558101200 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.859+0000 7fe55dd0c640 1 -- 172.21.15.18:0/3787365849 >> 172.21.15.18:0/3787365849 conn(0x7fe5580fc7d0 msgr2=0x7fe5580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.859+0000 7fe55dd0c640 1 -- 172.21.15.18:0/3787365849 shutdown_connections 2024-09-19T09:52:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.859+0000 7fe55dd0c640 1 -- 172.21.15.18:0/3787365849 wait complete. 2024-09-19T09:52:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.859+0000 7fe55dd0c640 1 Processor -- start 2024-09-19T09:52:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe55dd0c640 1 -- start start 2024-09-19T09:52:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe55dd0c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe558100e20 0x7fe558197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe55dd0c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe558102570 0x7fe558197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe55dd0c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe558102ef0 0x7fe55819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe55dd0c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe558110f80 con 0x7fe558100e20 2024-09-19T09:52:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe55dd0c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe558110e00 con 0x7fe558102ef0 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe55dd0c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe558111100 con 0x7fe558102570 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe5577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe558100e20 0x7fe558197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe5577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe558100e20 0x7fe558197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36164/0 (socket says 172.21.15.18:36164) 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe5577fe640 1 -- 172.21.15.18:0/579886590 learned_addr learned my addr 172.21.15.18:0/579886590 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe556ffd640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe558102570 0x7fe558197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.860+0000 7fe557fff640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe558102ef0 0x7fe55819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe5577fe640 1 -- 172.21.15.18:0/579886590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe558102570 msgr2=0x7fe558197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe5577fe640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe558102570 0x7fe558197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe5577fe640 1 -- 172.21.15.18:0/579886590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe558102ef0 msgr2=0x7fe55819bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe5577fe640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe558102ef0 0x7fe55819bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe5577fe640 1 -- 172.21.15.18:0/579886590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55819c3c0 con 0x7fe558100e20 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe5577fe640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe558100e20 0x7fe558197410 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe548005cc0 tx=0x7fe54802f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe554ff9640 1 -- 172.21.15.18:0/579886590 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548034040 con 0x7fe558100e20 2024-09-19T09:52:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe554ff9640 1 -- 172.21.15.18:0/579886590 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe548030920 con 0x7fe558100e20 2024-09-19T09:52:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe55dd0c640 1 -- 172.21.15.18:0/579886590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55819c650 con 0x7fe558100e20 2024-09-19T09:52:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe554ff9640 1 -- 172.21.15.18:0/579886590 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548004830 con 0x7fe558100e20 2024-09-19T09:52:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.861+0000 7fe55dd0c640 1 -- 172.21.15.18:0/579886590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5581a3f90 con 0x7fe558100e20 2024-09-19T09:52:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.862+0000 7fe55dd0c640 1 -- 172.21.15.18:0/579886590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5581021b0 con 0x7fe558100e20 2024-09-19T09:52:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.864+0000 7fe554ff9640 1 -- 172.21.15.18:0/579886590 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe548037020 con 0x7fe558100e20 2024-09-19T09:52:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.864+0000 7fe554ff9640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5440a3240 0x7fe5440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.865+0000 7fe556ffd640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5440a3240 0x7fe5440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.865+0000 7fe554ff9640 1 -- 172.21.15.18:0/579886590 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe5480f0850 con 0x7fe558100e20 2024-09-19T09:52:38.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.865+0000 7fe556ffd640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5440a3240 0x7fe5440a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5580fff70 tx=0x7fe54000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:38.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:38.868+0000 7fe554ff9640 1 -- 172.21.15.18:0/579886590 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5480bd540 con 0x7fe558100e20 2024-09-19T09:52:39.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.041+0000 7fe55dd0c640 1 -- 172.21.15.18:0/579886590 --> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe558062630 con 0x7fe5440a3240 2024-09-19T09:52:39.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.048+0000 7fe554ff9640 1 -- 172.21.15.18:0/579886590 <== mgr.14150 v2:172.21.15.18:6800/817115447 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258874 (secure 0 0 0) 0x7fe558062630 con 0x7fe5440a3240 2024-09-19T09:52:39.052 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:52:39.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.050+0000 7fe55dd0c640 1 -- 172.21.15.18:0/579886590 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5440a3240 msgr2=0x7fe5440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:39.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.050+0000 7fe55dd0c640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5440a3240 0x7fe5440a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5580fff70 tx=0x7fe54000b390 comp rx=0 tx=0).stop 2024-09-19T09:52:39.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.050+0000 7fe55dd0c640 1 -- 172.21.15.18:0/579886590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe558100e20 msgr2=0x7fe558197410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:39.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.050+0000 7fe55dd0c640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe558100e20 0x7fe558197410 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe548005cc0 tx=0x7fe54802f650 comp rx=0 tx=0).stop 2024-09-19T09:52:39.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.051+0000 7fe55dd0c640 1 -- 172.21.15.18:0/579886590 shutdown_connections 2024-09-19T09:52:39.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.051+0000 7fe55dd0c640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5440a3240 0x7fe5440a5700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.051+0000 7fe55dd0c640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe558102ef0 0x7fe55819bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.051+0000 7fe55dd0c640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe558102570 0x7fe558197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.051+0000 7fe55dd0c640 1 --2- 172.21.15.18:0/579886590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe558100e20 0x7fe558197410 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:39.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.051+0000 7fe55dd0c640 1 -- 172.21.15.18:0/579886590 >> 172.21.15.18:0/579886590 conn(0x7fe5580fc7d0 msgr2=0x7fe5580fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:39.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.051+0000 7fe55dd0c640 1 -- 172.21.15.18:0/579886590 shutdown_connections 2024-09-19T09:52:39.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:39.051+0000 7fe55dd0c640 1 -- 172.21.15.18:0/579886590 wait complete. 2024-09-19T09:52:39.663 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-19T09:52:38.379838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663890,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1319,"num_read_kb":785,"num_write":443,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374672,"kb_used_data":12944,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567152,"statfs":{"total":1151940427776,"available":1151556763648,"internally_reserved":0,"allocated":13254656,"data_stored":7293098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":58,"num_write":7,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002498"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372833+0000","last_change":"2024-09-19T09:50:29.357679+0000","last_active":"2024-09-19T09:52:00.372833+0000","last_peered":"2024-09-19T09:52:00.372833+0000","last_clean":"2024-09-19T09:52:00.372833+0000","last_became_active":"2024-09-19T09:50:29.357341+0000","last_became_peered":"2024-09-19T09:50:29.357341+0000","last_unstale":"2024-09-19T09:52:00.372833+0000","last_undegraded":"2024-09-19T09:52:00.372833+0000","last_fullsized":"2024-09-19T09:52:00.372833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:23.663972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365913+0000","last_change":"2024-09-19T09:50:29.361966+0000","last_active":"2024-09-19T09:52:00.365913+0000","last_peered":"2024-09-19T09:52:00.365913+0000","last_clean":"2024-09-19T09:52:00.365913+0000","last_became_active":"2024-09-19T09:50:29.361648+0000","last_became_peered":"2024-09-19T09:50:29.361648+0000","last_unstale":"2024-09-19T09:52:00.365913+0000","last_undegraded":"2024-09-19T09:52:00.365913+0000","last_fullsized":"2024-09-19T09:52:00.365913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:35.461959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373314+0000","last_change":"2024-09-19T09:50:29.365196+0000","last_active":"2024-09-19T09:52:00.373314+0000","last_peered":"2024-09-19T09:52:00.373314+0000","last_clean":"2024-09-19T09:52:00.373314+0000","last_became_active":"2024-09-19T09:50:29.364875+0000","last_became_peered":"2024-09-19T09:50:29.364875+0000","last_unstale":"2024-09-19T09:52:00.373314+0000","last_undegraded":"2024-09-19T09:52:00.373314+0000","last_fullsized":"2024-09-19T09:52:00.373314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:14.089755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362650+0000","last_change":"2024-09-19T09:50:29.367324+0000","last_active":"2024-09-19T09:52:00.362650+0000","last_peered":"2024-09-19T09:52:00.362650+0000","last_clean":"2024-09-19T09:52:00.362650+0000","last_became_active":"2024-09-19T09:50:29.366926+0000","last_became_peered":"2024-09-19T09:50:29.366926+0000","last_unstale":"2024-09-19T09:52:00.362650+0000","last_undegraded":"2024-09-19T09:52:00.362650+0000","last_fullsized":"2024-09-19T09:52:00.362650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:55.386051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.335091+0000","last_change":"2024-09-19T09:50:29.368308+0000","last_active":"2024-09-19T09:52:00.335091+0000","last_peered":"2024-09-19T09:52:00.335091+0000","last_clean":"2024-09-19T09:52:00.335091+0000","last_became_active":"2024-09-19T09:50:29.367958+0000","last_became_peered":"2024-09-19T09:50:29.367958+0000","last_unstale":"2024-09-19T09:52:00.335091+0000","last_undegraded":"2024-09-19T09:52:00.335091+0000","last_fullsized":"2024-09-19T09:52:00.335091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:14.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359516+0000","last_change":"2024-09-19T09:51:31.818907+0000","last_active":"2024-09-19T09:52:00.359516+0000","last_peered":"2024-09-19T09:52:00.359516+0000","last_clean":"2024-09-19T09:52:00.359516+0000","last_became_active":"2024-09-19T09:51:31.818522+0000","last_became_peered":"2024-09-19T09:51:31.818522+0000","last_unstale":"2024-09-19T09:52:00.359516+0000","last_undegraded":"2024-09-19T09:52:00.359516+0000","last_fullsized":"2024-09-19T09:52:00.359516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:04.062704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365337+0000","last_change":"2024-09-19T09:50:29.364109+0000","last_active":"2024-09-19T09:52:00.365337+0000","last_peered":"2024-09-19T09:52:00.365337+0000","last_clean":"2024-09-19T09:52:00.365337+0000","last_became_active":"2024-09-19T09:50:29.363102+0000","last_became_peered":"2024-09-19T09:50:29.363102+0000","last_unstale":"2024-09-19T09:52:00.365337+0000","last_undegraded":"2024-09-19T09:52:00.365337+0000","last_fullsized":"2024-09-19T09:52:00.365337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:37.047449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358908+0000","last_change":"2024-09-19T09:50:29.362673+0000","last_active":"2024-09-19T09:52:00.358908+0000","last_peered":"2024-09-19T09:52:00.358908+0000","last_clean":"2024-09-19T09:52:00.358908+0000","last_became_active":"2024-09-19T09:50:29.362390+0000","last_became_peered":"2024-09-19T09:50:29.362390+0000","last_unstale":"2024-09-19T09:52:00.358908+0000","last_undegraded":"2024-09-19T09:52:00.358908+0000","last_fullsized":"2024-09-19T09:52:00.358908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:27.315904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370979+0000","last_change":"2024-09-19T09:50:29.370465+0000","last_active":"2024-09-19T09:52:00.370979+0000","last_peered":"2024-09-19T09:52:00.370979+0000","last_clean":"2024-09-19T09:52:00.370979+0000","last_became_active":"2024-09-19T09:50:29.370074+0000","last_became_peered":"2024-09-19T09:50:29.370074+0000","last_unstale":"2024-09-19T09:52:00.370979+0000","last_undegraded":"2024-09-19T09:52:00.370979+0000","last_fullsized":"2024-09-19T09:52:00.370979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.017788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364519+0000","last_change":"2024-09-19T09:50:29.358728+0000","last_active":"2024-09-19T09:52:00.364519+0000","last_peered":"2024-09-19T09:52:00.364519+0000","last_clean":"2024-09-19T09:52:00.364519+0000","last_became_active":"2024-09-19T09:50:29.358323+0000","last_became_peered":"2024-09-19T09:50:29.358323+0000","last_unstale":"2024-09-19T09:52:00.364519+0000","last_undegraded":"2024-09-19T09:52:00.364519+0000","last_fullsized":"2024-09-19T09:52:00.364519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.368226+0000","last_change":"2024-09-19T09:50:29.362044+0000","last_active":"2024-09-19T09:52:00.368226+0000","last_peered":"2024-09-19T09:52:00.368226+0000","last_clean":"2024-09-19T09:52:00.368226+0000","last_became_active":"2024-09-19T09:50:29.361700+0000","last_became_peered":"2024-09-19T09:50:29.361700+0000","last_unstale":"2024-09-19T09:52:00.368226+0000","last_undegraded":"2024-09-19T09:52:00.368226+0000","last_fullsized":"2024-09-19T09:52:00.368226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:21.305879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.362431+0000","last_change":"2024-09-19T09:50:29.363146+0000","last_active":"2024-09-19T09:52:00.362431+0000","last_peered":"2024-09-19T09:52:00.362431+0000","last_clean":"2024-09-19T09:52:00.362431+0000","last_became_active":"2024-09-19T09:50:29.362716+0000","last_became_peered":"2024-09-19T09:50:29.362716+0000","last_unstale":"2024-09-19T09:52:00.362431+0000","last_undegraded":"2024-09-19T09:52:00.362431+0000","last_fullsized":"2024-09-19T09:52:00.362431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:55.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351092+0000","last_change":"2024-09-19T09:51:31.818910+0000","last_active":"2024-09-19T09:52:00.351092+0000","last_peered":"2024-09-19T09:52:00.351092+0000","last_clean":"2024-09-19T09:52:00.351092+0000","last_became_active":"2024-09-19T09:51:31.818581+0000","last_became_peered":"2024-09-19T09:51:31.818581+0000","last_unstale":"2024-09-19T09:52:00.351092+0000","last_undegraded":"2024-09-19T09:52:00.351092+0000","last_fullsized":"2024-09-19T09:52:00.351092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.736835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365871+0000","last_change":"2024-09-19T09:50:29.357544+0000","last_active":"2024-09-19T09:52:00.365871+0000","last_peered":"2024-09-19T09:52:00.365871+0000","last_clean":"2024-09-19T09:52:00.365871+0000","last_became_active":"2024-09-19T09:50:29.357233+0000","last_became_peered":"2024-09-19T09:50:29.357233+0000","last_unstale":"2024-09-19T09:52:00.365871+0000","last_undegraded":"2024-09-19T09:52:00.365871+0000","last_fullsized":"2024-09-19T09:52:00.365871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:44.555679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361631+0000","last_change":"2024-09-19T09:50:29.365145+0000","last_active":"2024-09-19T09:52:00.361631+0000","last_peered":"2024-09-19T09:52:00.361631+0000","last_clean":"2024-09-19T09:52:00.361631+0000","last_became_active":"2024-09-19T09:50:29.364828+0000","last_became_peered":"2024-09-19T09:50:29.364828+0000","last_unstale":"2024-09-19T09:52:00.361631+0000","last_undegraded":"2024-09-19T09:52:00.361631+0000","last_fullsized":"2024-09-19T09:52:00.361631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:28.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372654+0000","last_change":"2024-09-19T09:50:29.365806+0000","last_active":"2024-09-19T09:52:00.372654+0000","last_peered":"2024-09-19T09:52:00.372654+0000","last_clean":"2024-09-19T09:52:00.372654+0000","last_became_active":"2024-09-19T09:50:29.365435+0000","last_became_peered":"2024-09-19T09:50:29.365435+0000","last_unstale":"2024-09-19T09:52:00.372654+0000","last_undegraded":"2024-09-19T09:52:00.372654+0000","last_fullsized":"2024-09-19T09:52:00.372654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:00.109310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373008+0000","last_change":"2024-09-19T09:50:29.356714+0000","last_active":"2024-09-19T09:52:00.373008+0000","last_peered":"2024-09-19T09:52:00.373008+0000","last_clean":"2024-09-19T09:52:00.373008+0000","last_became_active":"2024-09-19T09:50:29.356379+0000","last_became_peered":"2024-09-19T09:50:29.356379+0000","last_unstale":"2024-09-19T09:52:00.373008+0000","last_undegraded":"2024-09-19T09:52:00.373008+0000","last_fullsized":"2024-09-19T09:52:00.373008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.925035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.372768+0000","last_change":"2024-09-19T09:50:29.355774+0000","last_active":"2024-09-19T09:52:00.372768+0000","last_peered":"2024-09-19T09:52:00.372768+0000","last_clean":"2024-09-19T09:52:00.372768+0000","last_became_active":"2024-09-19T09:50:29.355465+0000","last_became_peered":"2024-09-19T09:50:29.355465+0000","last_unstale":"2024-09-19T09:52:00.372768+0000","last_undegraded":"2024-09-19T09:52:00.372768+0000","last_fullsized":"2024-09-19T09:52:00.372768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:03.115231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.356302+0000","last_change":"2024-09-19T09:50:29.363949+0000","last_active":"2024-09-19T09:52:00.356302+0000","last_peered":"2024-09-19T09:52:00.356302+0000","last_clean":"2024-09-19T09:52:00.356302+0000","last_became_active":"2024-09-19T09:50:29.363594+0000","last_became_peered":"2024-09-19T09:50:29.363594+0000","last_unstale":"2024-09-19T09:52:00.356302+0000","last_undegraded":"2024-09-19T09:52:00.356302+0000","last_fullsized":"2024-09-19T09:52:00.356302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:38.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351159+0000","last_change":"2024-09-19T09:51:31.823803+0000","last_active":"2024-09-19T09:52:00.351159+0000","last_peered":"2024-09-19T09:52:00.351159+0000","last_clean":"2024-09-19T09:52:00.351159+0000","last_became_active":"2024-09-19T09:51:31.823361+0000","last_became_peered":"2024-09-19T09:51:31.823361+0000","last_unstale":"2024-09-19T09:52:00.351159+0000","last_undegraded":"2024-09-19T09:52:00.351159+0000","last_fullsized":"2024-09-19T09:52:00.351159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:33.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.364330+0000","last_change":"2024-09-19T09:50:29.355985+0000","last_active":"2024-09-19T09:52:00.364330+0000","last_peered":"2024-09-19T09:52:00.364330+0000","last_clean":"2024-09-19T09:52:00.364330+0000","last_became_active":"2024-09-19T09:50:29.355668+0000","last_became_peered":"2024-09-19T09:50:29.355668+0000","last_unstale":"2024-09-19T09:52:00.364330+0000","last_undegraded":"2024-09-19T09:52:00.364330+0000","last_fullsized":"2024-09-19T09:52:00.364330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:54.830263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370710+0000","last_change":"2024-09-19T09:50:29.365485+0000","last_active":"2024-09-19T09:52:00.370710+0000","last_peered":"2024-09-19T09:52:00.370710+0000","last_clean":"2024-09-19T09:52:00.370710+0000","last_became_active":"2024-09-19T09:50:29.365149+0000","last_became_peered":"2024-09-19T09:50:29.365149+0000","last_unstale":"2024-09-19T09:52:00.370710+0000","last_undegraded":"2024-09-19T09:52:00.370710+0000","last_fullsized":"2024-09-19T09:52:00.370710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:15.787325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358193+0000","last_change":"2024-09-19T09:50:29.365316+0000","last_active":"2024-09-19T09:52:00.358193+0000","last_peered":"2024-09-19T09:52:00.358193+0000","last_clean":"2024-09-19T09:52:00.358193+0000","last_became_active":"2024-09-19T09:50:29.365011+0000","last_became_peered":"2024-09-19T09:50:29.365011+0000","last_unstale":"2024-09-19T09:52:00.358193+0000","last_undegraded":"2024-09-19T09:52:00.358193+0000","last_fullsized":"2024-09-19T09:52:00.358193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:58.863001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.358828+0000","last_change":"2024-09-19T09:50:29.361510+0000","last_active":"2024-09-19T09:52:00.358828+0000","last_peered":"2024-09-19T09:52:00.358828+0000","last_clean":"2024-09-19T09:52:00.358828+0000","last_became_active":"2024-09-19T09:50:29.361202+0000","last_became_peered":"2024-09-19T09:50:29.361202+0000","last_unstale":"2024-09-19T09:52:00.358828+0000","last_undegraded":"2024-09-19T09:52:00.358828+0000","last_fullsized":"2024-09-19T09:52:00.358828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:27.275030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.367256+0000","last_change":"2024-09-19T09:50:29.365671+0000","last_active":"2024-09-19T09:52:00.367256+0000","last_peered":"2024-09-19T09:52:00.367256+0000","last_clean":"2024-09-19T09:52:00.367256+0000","last_became_active":"2024-09-19T09:50:29.365386+0000","last_became_peered":"2024-09-19T09:50:29.365386+0000","last_unstale":"2024-09-19T09:52:00.367256+0000","last_undegraded":"2024-09-19T09:52:00.367256+0000","last_fullsized":"2024-09-19T09:52:00.367256+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:52.606812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.357344+0000","last_change":"2024-09-19T09:50:29.362152+0000","last_active":"2024-09-19T09:52:00.357344+0000","last_peered":"2024-09-19T09:52:00.357344+0000","last_clean":"2024-09-19T09:52:00.357344+0000","last_became_active":"2024-09-19T09:50:29.361336+0000","last_became_peered":"2024-09-19T09:50:29.361336+0000","last_unstale":"2024-09-19T09:52:00.357344+0000","last_undegraded":"2024-09-19T09:52:00.357344+0000","last_fullsized":"2024-09-19T09:52:00.357344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:00.900366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.351848+0000","last_change":"2024-09-19T09:50:29.356056+0000","last_active":"2024-09-19T09:52:00.351848+0000","last_peered":"2024-09-19T09:52:00.351848+0000","last_clean":"2024-09-19T09:52:00.351848+0000","last_became_active":"2024-09-19T09:50:29.355459+0000","last_became_peered":"2024-09-19T09:50:29.355459+0000","last_unstale":"2024-09-19T09:52:00.351848+0000","last_undegraded":"2024-09-19T09:52:00.351848+0000","last_fullsized":"2024-09-19T09:52:00.351848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.464187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350260+0000","last_change":"2024-09-19T09:50:29.353954+0000","last_active":"2024-09-19T09:52:00.350260+0000","last_peered":"2024-09-19T09:52:00.350260+0000","last_clean":"2024-09-19T09:52:00.350260+0000","last_became_active":"2024-09-19T09:50:29.353582+0000","last_became_peered":"2024-09-19T09:50:29.353582+0000","last_unstale":"2024-09-19T09:52:00.350260+0000","last_undegraded":"2024-09-19T09:52:00.350260+0000","last_fullsized":"2024-09-19T09:52:00.350260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:56.272584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361791+0000","last_change":"2024-09-19T09:50:29.368634+0000","last_active":"2024-09-19T09:52:00.361791+0000","last_peered":"2024-09-19T09:52:00.361791+0000","last_clean":"2024-09-19T09:52:00.361791+0000","last_became_active":"2024-09-19T09:50:29.368335+0000","last_became_peered":"2024-09-19T09:50:29.368335+0000","last_unstale":"2024-09-19T09:52:00.361791+0000","last_undegraded":"2024-09-19T09:52:00.361791+0000","last_fullsized":"2024-09-19T09:52:00.361791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:40.804491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.357522+0000","last_change":"2024-09-19T09:50:29.363527+0000","last_active":"2024-09-19T09:52:00.357522+0000","last_peered":"2024-09-19T09:52:00.357522+0000","last_clean":"2024-09-19T09:52:00.357522+0000","last_became_active":"2024-09-19T09:50:29.363184+0000","last_became_peered":"2024-09-19T09:50:29.363184+0000","last_unstale":"2024-09-19T09:52:00.357522+0000","last_undegraded":"2024-09-19T09:52:00.357522+0000","last_fullsized":"2024-09-19T09:52:00.357522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:38.298735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361450+0000","last_change":"2024-09-19T09:50:29.359163+0000","last_active":"2024-09-19T09:52:00.361450+0000","last_peered":"2024-09-19T09:52:00.361450+0000","last_clean":"2024-09-19T09:52:00.361450+0000","last_became_active":"2024-09-19T09:50:29.358849+0000","last_became_peered":"2024-09-19T09:50:29.358849+0000","last_unstale":"2024-09-19T09:52:00.361450+0000","last_undegraded":"2024-09-19T09:52:00.361450+0000","last_fullsized":"2024-09-19T09:52:00.361450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:22.209253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353668+0000","last_change":"2024-09-19T09:50:29.360444+0000","last_active":"2024-09-19T09:52:00.353668+0000","last_peered":"2024-09-19T09:52:00.353668+0000","last_clean":"2024-09-19T09:52:00.353668+0000","last_became_active":"2024-09-19T09:50:29.359438+0000","last_became_peered":"2024-09-19T09:50:29.359438+0000","last_unstale":"2024-09-19T09:52:00.353668+0000","last_undegraded":"2024-09-19T09:52:00.353668+0000","last_fullsized":"2024-09-19T09:52:00.353668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:12.787178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.345044+0000","last_change":"2024-09-19T09:50:29.359398+0000","last_active":"2024-09-19T09:52:00.345044+0000","last_peered":"2024-09-19T09:52:00.345044+0000","last_clean":"2024-09-19T09:52:00.345044+0000","last_became_active":"2024-09-19T09:50:29.359077+0000","last_became_peered":"2024-09-19T09:50:29.359077+0000","last_unstale":"2024-09-19T09:52:00.345044+0000","last_undegraded":"2024-09-19T09:52:00.345044+0000","last_fullsized":"2024-09-19T09:52:00.345044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:48.945450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":147,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:36.502966+0000","last_change":"2024-09-19T09:50:27.345985+0000","last_active":"2024-09-19T09:52:36.502966+0000","last_peered":"2024-09-19T09:52:36.502966+0000","last_clean":"2024-09-19T09:52:36.502966+0000","last_became_active":"2024-09-19T09:50:27.345548+0000","last_became_peered":"2024-09-19T09:50:27.345548+0000","last_unstale":"2024-09-19T09:52:36.502966+0000","last_undegraded":"2024-09-19T09:52:36.502966+0000","last_fullsized":"2024-09-19T09:52:36.502966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:31.885931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359507+0000","last_change":"2024-09-19T09:51:31.825618+0000","last_active":"2024-09-19T09:52:00.359507+0000","last_peered":"2024-09-19T09:52:00.359507+0000","last_clean":"2024-09-19T09:52:00.359507+0000","last_became_active":"2024-09-19T09:51:31.824727+0000","last_became_peered":"2024-09-19T09:51:31.824727+0000","last_unstale":"2024-09-19T09:52:00.359507+0000","last_undegraded":"2024-09-19T09:52:00.359507+0000","last_fullsized":"2024-09-19T09:52:00.359507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:52.094074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.816210+0000","last_change":"2024-09-19T09:50:27.343887+0000","last_active":"2024-09-19T09:51:31.816210+0000","last_peered":"2024-09-19T09:51:31.816210+0000","last_clean":"2024-09-19T09:51:31.816210+0000","last_became_active":"2024-09-19T09:50:27.343485+0000","last_became_peered":"2024-09-19T09:50:27.343485+0000","last_unstale":"2024-09-19T09:51:31.816210+0000","last_undegraded":"2024-09-19T09:51:31.816210+0000","last_fullsized":"2024-09-19T09:51:31.816210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:18.757310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814498+0000","last_change":"2024-09-19T09:50:27.339601+0000","last_active":"2024-09-19T09:51:31.814498+0000","last_peered":"2024-09-19T09:51:31.814498+0000","last_clean":"2024-09-19T09:51:31.814498+0000","last_became_active":"2024-09-19T09:50:27.339266+0000","last_became_peered":"2024-09-19T09:50:27.339266+0000","last_unstale":"2024-09-19T09:51:31.814498+0000","last_undegraded":"2024-09-19T09:51:31.814498+0000","last_fullsized":"2024-09-19T09:51:31.814498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:46.437885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.355727+0000","last_change":"2024-09-19T09:50:29.360508+0000","last_active":"2024-09-19T09:52:00.355727+0000","last_peered":"2024-09-19T09:52:00.355727+0000","last_clean":"2024-09-19T09:52:00.355727+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.355727+0000","last_undegraded":"2024-09-19T09:52:00.355727+0000","last_fullsized":"2024-09-19T09:52:00.355727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:47.177580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815599+0000","last_change":"2024-09-19T09:50:27.346003+0000","last_active":"2024-09-19T09:51:31.815599+0000","last_peered":"2024-09-19T09:51:31.815599+0000","last_clean":"2024-09-19T09:51:31.815599+0000","last_became_active":"2024-09-19T09:50:27.345549+0000","last_became_peered":"2024-09-19T09:50:27.345549+0000","last_unstale":"2024-09-19T09:51:31.815599+0000","last_undegraded":"2024-09-19T09:51:31.815599+0000","last_fullsized":"2024-09-19T09:51:31.815599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:11.294691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363759+0000","last_change":"2024-09-19T09:50:29.358826+0000","last_active":"2024-09-19T09:52:00.363759+0000","last_peered":"2024-09-19T09:52:00.363759+0000","last_clean":"2024-09-19T09:52:00.363759+0000","last_became_active":"2024-09-19T09:50:29.358475+0000","last_became_peered":"2024-09-19T09:50:29.358475+0000","last_unstale":"2024-09-19T09:52:00.363759+0000","last_undegraded":"2024-09-19T09:52:00.363759+0000","last_fullsized":"2024-09-19T09:52:00.363759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:18.925957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.497887+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:52:33.497887+0000","last_peered":"2024-09-19T09:52:33.497887+0000","last_clean":"2024-09-19T09:52:33.497887+0000","last_became_active":"2024-09-19T09:50:27.344831+0000","last_became_peered":"2024-09-19T09:50:27.344831+0000","last_unstale":"2024-09-19T09:52:33.497887+0000","last_undegraded":"2024-09-19T09:52:33.497887+0000","last_fullsized":"2024-09-19T09:52:33.497887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:56.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373477+0000","last_change":"2024-09-19T09:50:29.362351+0000","last_active":"2024-09-19T09:52:00.373477+0000","last_peered":"2024-09-19T09:52:00.373477+0000","last_clean":"2024-09-19T09:52:00.373477+0000","last_became_active":"2024-09-19T09:50:29.361677+0000","last_became_peered":"2024-09-19T09:50:29.361677+0000","last_unstale":"2024-09-19T09:52:00.373477+0000","last_undegraded":"2024-09-19T09:52:00.373477+0000","last_fullsized":"2024-09-19T09:52:00.373477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:10.581975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.415018+0000","last_change":"2024-09-19T09:50:27.340095+0000","last_active":"2024-09-19T09:51:32.415018+0000","last_peered":"2024-09-19T09:51:32.415018+0000","last_clean":"2024-09-19T09:51:32.415018+0000","last_became_active":"2024-09-19T09:50:27.339677+0000","last_became_peered":"2024-09-19T09:50:27.339677+0000","last_unstale":"2024-09-19T09:51:32.415018+0000","last_undegraded":"2024-09-19T09:51:32.415018+0000","last_fullsized":"2024-09-19T09:51:32.415018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:56.709614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361630+0000","last_change":"2024-09-19T09:50:29.358140+0000","last_active":"2024-09-19T09:52:00.361630+0000","last_peered":"2024-09-19T09:52:00.361630+0000","last_clean":"2024-09-19T09:52:00.361630+0000","last_became_active":"2024-09-19T09:50:29.357746+0000","last_became_peered":"2024-09-19T09:50:29.357746+0000","last_unstale":"2024-09-19T09:52:00.361630+0000","last_undegraded":"2024-09-19T09:52:00.361630+0000","last_fullsized":"2024-09-19T09:52:00.361630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:45.674275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815716+0000","last_change":"2024-09-19T09:50:27.784602+0000","last_active":"2024-09-19T09:51:31.815716+0000","last_peered":"2024-09-19T09:51:31.815716+0000","last_clean":"2024-09-19T09:51:31.815716+0000","last_became_active":"2024-09-19T09:50:27.784200+0000","last_became_peered":"2024-09-19T09:50:27.784200+0000","last_unstale":"2024-09-19T09:51:31.815716+0000","last_undegraded":"2024-09-19T09:51:31.815716+0000","last_fullsized":"2024-09-19T09:51:31.815716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:43.938347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373858+0000","last_change":"2024-09-19T09:50:29.368420+0000","last_active":"2024-09-19T09:52:00.373858+0000","last_peered":"2024-09-19T09:52:00.373858+0000","last_clean":"2024-09-19T09:52:00.373858+0000","last_became_active":"2024-09-19T09:50:29.368056+0000","last_became_peered":"2024-09-19T09:50:29.368056+0000","last_unstale":"2024-09-19T09:52:00.373858+0000","last_undegraded":"2024-09-19T09:52:00.373858+0000","last_fullsized":"2024-09-19T09:52:00.373858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:04.718950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'36","reported_seq":297,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.497880+0000","last_change":"2024-09-19T09:50:27.345869+0000","last_active":"2024-09-19T09:52:33.497880+0000","last_peered":"2024-09-19T09:52:33.497880+0000","last_clean":"2024-09-19T09:52:33.497880+0000","last_became_active":"2024-09-19T09:50:27.345364+0000","last_became_peered":"2024-09-19T09:50:27.345364+0000","last_unstale":"2024-09-19T09:52:33.497880+0000","last_undegraded":"2024-09-19T09:52:33.497880+0000","last_fullsized":"2024-09-19T09:52:33.497880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:03.069958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65490,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":239,"num_read_kb":184,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363505+0000","last_change":"2024-09-19T09:50:29.356952+0000","last_active":"2024-09-19T09:52:00.363505+0000","last_peered":"2024-09-19T09:52:00.363505+0000","last_clean":"2024-09-19T09:52:00.363505+0000","last_became_active":"2024-09-19T09:50:29.356604+0000","last_became_peered":"2024-09-19T09:50:29.356604+0000","last_unstale":"2024-09-19T09:52:00.363505+0000","last_undegraded":"2024-09-19T09:52:00.363505+0000","last_fullsized":"2024-09-19T09:52:00.363505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:48.235596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821655+0000","last_change":"2024-09-19T09:50:27.342371+0000","last_active":"2024-09-19T09:51:31.821655+0000","last_peered":"2024-09-19T09:51:31.821655+0000","last_clean":"2024-09-19T09:51:31.821655+0000","last_became_active":"2024-09-19T09:50:27.341875+0000","last_became_peered":"2024-09-19T09:50:27.341875+0000","last_unstale":"2024-09-19T09:51:31.821655+0000","last_undegraded":"2024-09-19T09:51:31.821655+0000","last_fullsized":"2024-09-19T09:51:31.821655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:51.148862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363961+0000","last_change":"2024-09-19T09:50:29.356511+0000","last_active":"2024-09-19T09:52:00.363961+0000","last_peered":"2024-09-19T09:52:00.363961+0000","last_clean":"2024-09-19T09:52:00.363961+0000","last_became_active":"2024-09-19T09:50:29.356234+0000","last_became_peered":"2024-09-19T09:50:29.356234+0000","last_unstale":"2024-09-19T09:52:00.363961+0000","last_undegraded":"2024-09-19T09:52:00.363961+0000","last_fullsized":"2024-09-19T09:52:00.363961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:53.365489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815497+0000","last_change":"2024-09-19T09:50:27.345795+0000","last_active":"2024-09-19T09:51:31.815497+0000","last_peered":"2024-09-19T09:51:31.815497+0000","last_clean":"2024-09-19T09:51:31.815497+0000","last_became_active":"2024-09-19T09:50:27.345408+0000","last_became_peered":"2024-09-19T09:50:27.345408+0000","last_unstale":"2024-09-19T09:51:31.815497+0000","last_undegraded":"2024-09-19T09:51:31.815497+0000","last_fullsized":"2024-09-19T09:51:31.815497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:03.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369638+0000","last_change":"2024-09-19T09:50:29.362283+0000","last_active":"2024-09-19T09:52:00.369638+0000","last_peered":"2024-09-19T09:52:00.369638+0000","last_clean":"2024-09-19T09:52:00.369638+0000","last_became_active":"2024-09-19T09:50:29.361805+0000","last_became_peered":"2024-09-19T09:50:29.361805+0000","last_unstale":"2024-09-19T09:52:00.369638+0000","last_undegraded":"2024-09-19T09:52:00.369638+0000","last_fullsized":"2024-09-19T09:52:00.369638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:11.572772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:32.492403+0000","last_change":"2024-09-19T09:50:27.341129+0000","last_active":"2024-09-19T09:52:32.492403+0000","last_peered":"2024-09-19T09:52:32.492403+0000","last_clean":"2024-09-19T09:52:32.492403+0000","last_became_active":"2024-09-19T09:50:27.340757+0000","last_became_peered":"2024-09-19T09:50:27.340757+0000","last_unstale":"2024-09-19T09:52:32.492403+0000","last_undegraded":"2024-09-19T09:52:32.492403+0000","last_fullsized":"2024-09-19T09:52:32.492403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:33.200852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365299+0000","last_change":"2024-09-19T09:50:29.363217+0000","last_active":"2024-09-19T09:52:00.365299+0000","last_peered":"2024-09-19T09:52:00.365299+0000","last_clean":"2024-09-19T09:52:00.365299+0000","last_became_active":"2024-09-19T09:50:29.362833+0000","last_became_peered":"2024-09-19T09:50:29.362833+0000","last_unstale":"2024-09-19T09:52:00.365299+0000","last_undegraded":"2024-09-19T09:52:00.365299+0000","last_fullsized":"2024-09-19T09:52:00.365299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:04.401105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821556+0000","last_change":"2024-09-19T09:50:27.785453+0000","last_active":"2024-09-19T09:51:31.821556+0000","last_peered":"2024-09-19T09:51:31.821556+0000","last_clean":"2024-09-19T09:51:31.821556+0000","last_became_active":"2024-09-19T09:50:27.784799+0000","last_became_peered":"2024-09-19T09:50:27.784799+0000","last_unstale":"2024-09-19T09:51:31.821556+0000","last_undegraded":"2024-09-19T09:51:31.821556+0000","last_fullsized":"2024-09-19T09:51:31.821556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:06.756723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359861+0000","last_change":"2024-09-19T09:50:29.361143+0000","last_active":"2024-09-19T09:52:00.359861+0000","last_peered":"2024-09-19T09:52:00.359861+0000","last_clean":"2024-09-19T09:52:00.359861+0000","last_became_active":"2024-09-19T09:50:29.359697+0000","last_became_peered":"2024-09-19T09:50:29.359697+0000","last_unstale":"2024-09-19T09:52:00.359861+0000","last_undegraded":"2024-09-19T09:52:00.359861+0000","last_fullsized":"2024-09-19T09:52:00.359861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:20.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822551+0000","last_change":"2024-09-19T09:50:27.342649+0000","last_active":"2024-09-19T09:51:31.822551+0000","last_peered":"2024-09-19T09:51:31.822551+0000","last_clean":"2024-09-19T09:51:31.822551+0000","last_became_active":"2024-09-19T09:50:27.342217+0000","last_became_peered":"2024-09-19T09:50:27.342217+0000","last_unstale":"2024-09-19T09:51:31.822551+0000","last_undegraded":"2024-09-19T09:51:31.822551+0000","last_fullsized":"2024-09-19T09:51:31.822551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.753661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.352459+0000","last_change":"2024-09-19T09:50:29.353862+0000","last_active":"2024-09-19T09:52:00.352459+0000","last_peered":"2024-09-19T09:52:00.352459+0000","last_clean":"2024-09-19T09:52:00.352459+0000","last_became_active":"2024-09-19T09:50:29.353338+0000","last_became_peered":"2024-09-19T09:50:29.353338+0000","last_unstale":"2024-09-19T09:52:00.352459+0000","last_undegraded":"2024-09-19T09:52:00.352459+0000","last_fullsized":"2024-09-19T09:52:00.352459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.343557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.814756+0000","last_change":"2024-09-19T09:50:27.341108+0000","last_active":"2024-09-19T09:51:31.814756+0000","last_peered":"2024-09-19T09:51:31.814756+0000","last_clean":"2024-09-19T09:51:31.814756+0000","last_became_active":"2024-09-19T09:50:27.340775+0000","last_became_peered":"2024-09-19T09:50:27.340775+0000","last_unstale":"2024-09-19T09:51:31.814756+0000","last_undegraded":"2024-09-19T09:51:31.814756+0000","last_fullsized":"2024-09-19T09:51:31.814756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.400825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.366823+0000","last_change":"2024-09-19T09:50:29.358108+0000","last_active":"2024-09-19T09:52:00.366823+0000","last_peered":"2024-09-19T09:52:00.366823+0000","last_clean":"2024-09-19T09:52:00.366823+0000","last_became_active":"2024-09-19T09:50:29.357698+0000","last_became_peered":"2024-09-19T09:50:29.357698+0000","last_unstale":"2024-09-19T09:52:00.366823+0000","last_undegraded":"2024-09-19T09:52:00.366823+0000","last_fullsized":"2024-09-19T09:52:00.366823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:01.544465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.815831+0000","last_change":"2024-09-19T09:50:27.342703+0000","last_active":"2024-09-19T09:51:31.815831+0000","last_peered":"2024-09-19T09:51:31.815831+0000","last_clean":"2024-09-19T09:51:31.815831+0000","last_became_active":"2024-09-19T09:50:27.342356+0000","last_became_peered":"2024-09-19T09:50:27.342356+0000","last_unstale":"2024-09-19T09:51:31.815831+0000","last_undegraded":"2024-09-19T09:51:31.815831+0000","last_fullsized":"2024-09-19T09:51:31.815831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:40.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.365646+0000","last_change":"2024-09-19T09:50:29.368683+0000","last_active":"2024-09-19T09:52:00.365646+0000","last_peered":"2024-09-19T09:52:00.365646+0000","last_clean":"2024-09-19T09:52:00.365646+0000","last_became_active":"2024-09-19T09:50:29.368279+0000","last_became_peered":"2024-09-19T09:50:29.368279+0000","last_unstale":"2024-09-19T09:52:00.365646+0000","last_undegraded":"2024-09-19T09:52:00.365646+0000","last_fullsized":"2024-09-19T09:52:00.365646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:01.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:35.501606+0000","last_change":"2024-09-19T09:50:27.785507+0000","last_active":"2024-09-19T09:52:35.501606+0000","last_peered":"2024-09-19T09:52:35.501606+0000","last_clean":"2024-09-19T09:52:35.501606+0000","last_became_active":"2024-09-19T09:50:27.785089+0000","last_became_peered":"2024-09-19T09:50:27.785089+0000","last_unstale":"2024-09-19T09:52:35.501606+0000","last_undegraded":"2024-09-19T09:52:35.501606+0000","last_fullsized":"2024-09-19T09:52:35.501606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:34.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360813+0000","last_change":"2024-09-19T09:50:29.360745+0000","last_active":"2024-09-19T09:52:00.360813+0000","last_peered":"2024-09-19T09:52:00.360813+0000","last_clean":"2024-09-19T09:52:00.360813+0000","last_became_active":"2024-09-19T09:50:29.360233+0000","last_became_peered":"2024-09-19T09:50:29.360233+0000","last_unstale":"2024-09-19T09:52:00.360813+0000","last_undegraded":"2024-09-19T09:52:00.360813+0000","last_fullsized":"2024-09-19T09:52:00.360813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:25.095501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414764+0000","last_change":"2024-09-19T09:49:18.300966+0000","last_active":"2024-09-19T09:51:32.414764+0000","last_peered":"2024-09-19T09:51:32.414764+0000","last_clean":"2024-09-19T09:51:32.414764+0000","last_became_active":"2024-09-19T09:49:18.300336+0000","last_became_peered":"2024-09-19T09:49:18.300336+0000","last_unstale":"2024-09-19T09:51:32.414764+0000","last_undegraded":"2024-09-19T09:51:32.414764+0000","last_fullsized":"2024-09-19T09:51:32.414764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:45:53.242217+0000","last_clean_scrub_stamp":"2024-09-19T09:45:53.242217+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:22.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170061+0000","last_change":"2024-09-19T09:50:27.342349+0000","last_active":"2024-09-19T09:51:32.170061+0000","last_peered":"2024-09-19T09:51:32.170061+0000","last_clean":"2024-09-19T09:51:32.170061+0000","last_became_active":"2024-09-19T09:50:27.341666+0000","last_became_peered":"2024-09-19T09:50:27.341666+0000","last_unstale":"2024-09-19T09:51:32.170061+0000","last_undegraded":"2024-09-19T09:51:32.170061+0000","last_fullsized":"2024-09-19T09:51:32.170061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:27.097274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.357137+0000","last_change":"2024-09-19T09:50:29.360999+0000","last_active":"2024-09-19T09:52:00.357137+0000","last_peered":"2024-09-19T09:52:00.357137+0000","last_clean":"2024-09-19T09:52:00.357137+0000","last_became_active":"2024-09-19T09:50:29.360695+0000","last_became_peered":"2024-09-19T09:50:29.360695+0000","last_unstale":"2024-09-19T09:52:00.357137+0000","last_undegraded":"2024-09-19T09:52:00.357137+0000","last_fullsized":"2024-09-19T09:52:00.357137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:02.194314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.414764+0000","last_change":"2024-09-19T09:50:27.344497+0000","last_active":"2024-09-19T09:51:32.414764+0000","last_peered":"2024-09-19T09:51:32.414764+0000","last_clean":"2024-09-19T09:51:32.414764+0000","last_became_active":"2024-09-19T09:50:27.343933+0000","last_became_peered":"2024-09-19T09:50:27.343933+0000","last_unstale":"2024-09-19T09:51:32.414764+0000","last_undegraded":"2024-09-19T09:51:32.414764+0000","last_fullsized":"2024-09-19T09:51:32.414764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.781356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.352775+0000","last_change":"2024-09-19T09:50:29.364375+0000","last_active":"2024-09-19T09:52:00.352775+0000","last_peered":"2024-09-19T09:52:00.352775+0000","last_clean":"2024-09-19T09:52:00.352775+0000","last_became_active":"2024-09-19T09:50:29.364040+0000","last_became_peered":"2024-09-19T09:50:29.364040+0000","last_unstale":"2024-09-19T09:52:00.352775+0000","last_undegraded":"2024-09-19T09:52:00.352775+0000","last_fullsized":"2024-09-19T09:52:00.352775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:10.790184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'7","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.493032+0000","last_change":"2024-09-19T09:50:27.784358+0000","last_active":"2024-09-19T09:52:33.493032+0000","last_peered":"2024-09-19T09:52:33.493032+0000","last_clean":"2024-09-19T09:52:33.493032+0000","last_became_active":"2024-09-19T09:50:27.783992+0000","last_became_peered":"2024-09-19T09:50:27.783992+0000","last_unstale":"2024-09-19T09:52:33.493032+0000","last_undegraded":"2024-09-19T09:52:33.493032+0000","last_fullsized":"2024-09-19T09:52:33.493032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:26.523657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.359409+0000","last_change":"2024-09-19T09:50:29.358367+0000","last_active":"2024-09-19T09:52:00.359409+0000","last_peered":"2024-09-19T09:52:00.359409+0000","last_clean":"2024-09-19T09:52:00.359409+0000","last_became_active":"2024-09-19T09:50:29.358068+0000","last_became_peered":"2024-09-19T09:50:29.358068+0000","last_unstale":"2024-09-19T09:52:00.359409+0000","last_undegraded":"2024-09-19T09:52:00.359409+0000","last_fullsized":"2024-09-19T09:52:00.359409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:40.806552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:33.493392+0000","last_change":"2024-09-19T09:50:27.345142+0000","last_active":"2024-09-19T09:52:33.493392+0000","last_peered":"2024-09-19T09:52:33.493392+0000","last_clean":"2024-09-19T09:52:33.493392+0000","last_became_active":"2024-09-19T09:50:27.344615+0000","last_became_peered":"2024-09-19T09:50:27.344615+0000","last_unstale":"2024-09-19T09:52:33.493392+0000","last_undegraded":"2024-09-19T09:52:33.493392+0000","last_fullsized":"2024-09-19T09:52:33.493392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:26.722770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.363943+0000","last_change":"2024-09-19T09:50:29.356893+0000","last_active":"2024-09-19T09:52:00.363943+0000","last_peered":"2024-09-19T09:52:00.363943+0000","last_clean":"2024-09-19T09:52:00.363943+0000","last_became_active":"2024-09-19T09:50:29.353571+0000","last_became_peered":"2024-09-19T09:50:29.353571+0000","last_unstale":"2024-09-19T09:52:00.363943+0000","last_undegraded":"2024-09-19T09:52:00.363943+0000","last_fullsized":"2024-09-19T09:52:00.363943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:36.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.824487+0000","last_change":"2024-09-19T09:51:31.824076+0000","last_active":"2024-09-19T09:51:31.824487+0000","last_peered":"2024-09-19T09:51:31.824487+0000","last_clean":"2024-09-19T09:51:31.824487+0000","last_became_active":"2024-09-19T09:51:31.823642+0000","last_became_peered":"2024-09-19T09:51:31.823642+0000","last_unstale":"2024-09-19T09:51:31.824487+0000","last_undegraded":"2024-09-19T09:51:31.824487+0000","last_fullsized":"2024-09-19T09:51:31.824487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:53.035531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361958+0000","last_change":"2024-09-19T09:50:29.354773+0000","last_active":"2024-09-19T09:52:00.361958+0000","last_peered":"2024-09-19T09:52:00.361958+0000","last_clean":"2024-09-19T09:52:00.361958+0000","last_became_active":"2024-09-19T09:50:29.354258+0000","last_became_peered":"2024-09-19T09:50:29.354258+0000","last_unstale":"2024-09-19T09:52:00.361958+0000","last_undegraded":"2024-09-19T09:52:00.361958+0000","last_fullsized":"2024-09-19T09:52:00.361958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:22.264991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823018+0000","last_change":"2024-09-19T09:50:27.784776+0000","last_active":"2024-09-19T09:51:31.823018+0000","last_peered":"2024-09-19T09:51:31.823018+0000","last_clean":"2024-09-19T09:51:31.823018+0000","last_became_active":"2024-09-19T09:50:27.784327+0000","last_became_peered":"2024-09-19T09:50:27.784327+0000","last_unstale":"2024-09-19T09:51:31.823018+0000","last_undegraded":"2024-09-19T09:51:31.823018+0000","last_fullsized":"2024-09-19T09:51:31.823018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:37.502649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.350847+0000","last_change":"2024-09-19T09:50:29.356766+0000","last_active":"2024-09-19T09:52:00.350847+0000","last_peered":"2024-09-19T09:52:00.350847+0000","last_clean":"2024-09-19T09:52:00.350847+0000","last_became_active":"2024-09-19T09:50:29.356425+0000","last_became_peered":"2024-09-19T09:50:29.356425+0000","last_unstale":"2024-09-19T09:52:00.350847+0000","last_undegraded":"2024-09-19T09:52:00.350847+0000","last_fullsized":"2024-09-19T09:52:00.350847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:31.000455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.370692+0000","last_change":"2024-09-19T09:50:27.340727+0000","last_active":"2024-09-19T09:52:00.370692+0000","last_peered":"2024-09-19T09:52:00.370692+0000","last_clean":"2024-09-19T09:52:00.370692+0000","last_became_active":"2024-09-19T09:50:27.340387+0000","last_became_peered":"2024-09-19T09:50:27.340387+0000","last_unstale":"2024-09-19T09:52:00.370692+0000","last_undegraded":"2024-09-19T09:52:00.370692+0000","last_fullsized":"2024-09-19T09:52:00.370692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:44.676965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360865+0000","last_change":"2024-09-19T09:50:29.361264+0000","last_active":"2024-09-19T09:52:00.360865+0000","last_peered":"2024-09-19T09:52:00.360865+0000","last_clean":"2024-09-19T09:52:00.360865+0000","last_became_active":"2024-09-19T09:50:29.360939+0000","last_became_peered":"2024-09-19T09:50:29.360939+0000","last_unstale":"2024-09-19T09:52:00.360865+0000","last_undegraded":"2024-09-19T09:52:00.360865+0000","last_fullsized":"2024-09-19T09:52:00.360865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:45.645248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.170286+0000","last_change":"2024-09-19T09:50:27.400905+0000","last_active":"2024-09-19T09:51:32.170286+0000","last_peered":"2024-09-19T09:51:32.170286+0000","last_clean":"2024-09-19T09:51:32.170286+0000","last_became_active":"2024-09-19T09:50:27.400491+0000","last_became_peered":"2024-09-19T09:50:27.400491+0000","last_unstale":"2024-09-19T09:51:32.170286+0000","last_undegraded":"2024-09-19T09:51:32.170286+0000","last_fullsized":"2024-09-19T09:51:32.170286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:40.873227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361925+0000","last_change":"2024-09-19T09:50:29.368512+0000","last_active":"2024-09-19T09:52:00.361925+0000","last_peered":"2024-09-19T09:52:00.361925+0000","last_clean":"2024-09-19T09:52:00.361925+0000","last_became_active":"2024-09-19T09:50:29.368200+0000","last_became_peered":"2024-09-19T09:50:29.368200+0000","last_unstale":"2024-09-19T09:52:00.361925+0000","last_undegraded":"2024-09-19T09:52:00.361925+0000","last_fullsized":"2024-09-19T09:52:00.361925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.995125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:32.964590+0000","last_change":"2024-09-19T09:50:27.784129+0000","last_active":"2024-09-19T09:51:32.964590+0000","last_peered":"2024-09-19T09:51:32.964590+0000","last_clean":"2024-09-19T09:51:32.964590+0000","last_became_active":"2024-09-19T09:50:27.783822+0000","last_became_peered":"2024-09-19T09:50:27.783822+0000","last_unstale":"2024-09-19T09:51:32.964590+0000","last_undegraded":"2024-09-19T09:51:32.964590+0000","last_fullsized":"2024-09-19T09:51:32.964590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:57.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.320920+0000","last_change":"2024-09-19T09:50:29.360539+0000","last_active":"2024-09-19T09:52:00.320920+0000","last_peered":"2024-09-19T09:52:00.320920+0000","last_clean":"2024-09-19T09:52:00.320920+0000","last_became_active":"2024-09-19T09:50:29.360074+0000","last_became_peered":"2024-09-19T09:50:29.360074+0000","last_unstale":"2024-09-19T09:52:00.320920+0000","last_undegraded":"2024-09-19T09:52:00.320920+0000","last_fullsized":"2024-09-19T09:52:00.320920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:35.801396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823398+0000","last_change":"2024-09-19T09:50:27.340861+0000","last_active":"2024-09-19T09:51:31.823398+0000","last_peered":"2024-09-19T09:51:31.823398+0000","last_clean":"2024-09-19T09:51:31.823398+0000","last_became_active":"2024-09-19T09:50:27.340396+0000","last_became_peered":"2024-09-19T09:50:27.340396+0000","last_unstale":"2024-09-19T09:51:31.823398+0000","last_undegraded":"2024-09-19T09:51:31.823398+0000","last_fullsized":"2024-09-19T09:51:31.823398+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:09.313656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.353447+0000","last_change":"2024-09-19T09:50:29.358654+0000","last_active":"2024-09-19T09:52:00.353447+0000","last_peered":"2024-09-19T09:52:00.353447+0000","last_clean":"2024-09-19T09:52:00.353447+0000","last_became_active":"2024-09-19T09:50:29.357959+0000","last_became_peered":"2024-09-19T09:50:29.357959+0000","last_unstale":"2024-09-19T09:52:00.353447+0000","last_undegraded":"2024-09-19T09:52:00.353447+0000","last_fullsized":"2024-09-19T09:52:00.353447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:36.297143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.830511+0000","last_change":"2024-09-19T09:51:31.830511+0000","last_active":"2024-09-19T09:51:31.830511+0000","last_peered":"2024-09-19T09:51:31.830511+0000","last_clean":"2024-09-19T09:51:31.830511+0000","last_became_active":"2024-09-19T09:51:31.825672+0000","last_became_peered":"2024-09-19T09:51:31.825672+0000","last_unstale":"2024-09-19T09:51:31.830511+0000","last_undegraded":"2024-09-19T09:51:31.830511+0000","last_fullsized":"2024-09-19T09:51:31.830511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:58.101027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.360592+0000","last_change":"2024-09-19T09:50:29.364277+0000","last_active":"2024-09-19T09:52:00.360592+0000","last_peered":"2024-09-19T09:52:00.360592+0000","last_clean":"2024-09-19T09:52:00.360592+0000","last_became_active":"2024-09-19T09:50:29.363952+0000","last_became_peered":"2024-09-19T09:50:29.363952+0000","last_unstale":"2024-09-19T09:52:00.360592+0000","last_undegraded":"2024-09-19T09:52:00.360592+0000","last_fullsized":"2024-09-19T09:52:00.360592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:12.994866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.821791+0000","last_change":"2024-09-19T09:50:27.341082+0000","last_active":"2024-09-19T09:51:31.821791+0000","last_peered":"2024-09-19T09:51:31.821791+0000","last_clean":"2024-09-19T09:51:31.821791+0000","last_became_active":"2024-09-19T09:50:27.340733+0000","last_became_peered":"2024-09-19T09:50:27.340733+0000","last_unstale":"2024-09-19T09:51:31.821791+0000","last_undegraded":"2024-09-19T09:51:31.821791+0000","last_fullsized":"2024-09-19T09:51:31.821791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:19.140942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.361855+0000","last_change":"2024-09-19T09:50:29.363597+0000","last_active":"2024-09-19T09:52:00.361855+0000","last_peered":"2024-09-19T09:52:00.361855+0000","last_clean":"2024-09-19T09:52:00.361855+0000","last_became_active":"2024-09-19T09:50:29.362567+0000","last_became_peered":"2024-09-19T09:50:29.362567+0000","last_unstale":"2024-09-19T09:52:00.361855+0000","last_undegraded":"2024-09-19T09:52:00.361855+0000","last_fullsized":"2024-09-19T09:52:00.361855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:31.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.369084+0000","last_change":"2024-09-19T09:50:29.360638+0000","last_active":"2024-09-19T09:52:00.369084+0000","last_peered":"2024-09-19T09:52:00.369084+0000","last_clean":"2024-09-19T09:52:00.369084+0000","last_became_active":"2024-09-19T09:50:29.360313+0000","last_became_peered":"2024-09-19T09:50:29.360313+0000","last_unstale":"2024-09-19T09:52:00.369084+0000","last_undegraded":"2024-09-19T09:52:00.369084+0000","last_fullsized":"2024-09-19T09:52:00.369084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:06.667732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822749+0000","last_change":"2024-09-19T09:50:27.342059+0000","last_active":"2024-09-19T09:51:31.822749+0000","last_peered":"2024-09-19T09:51:31.822749+0000","last_clean":"2024-09-19T09:51:31.822749+0000","last_became_active":"2024-09-19T09:50:27.341615+0000","last_became_peered":"2024-09-19T09:50:27.341615+0000","last_unstale":"2024-09-19T09:51:31.822749+0000","last_undegraded":"2024-09-19T09:51:31.822749+0000","last_fullsized":"2024-09-19T09:51:31.822749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.371499+0000","last_change":"2024-09-19T09:50:29.361924+0000","last_active":"2024-09-19T09:52:00.371499+0000","last_peered":"2024-09-19T09:52:00.371499+0000","last_clean":"2024-09-19T09:52:00.371499+0000","last_became_active":"2024-09-19T09:50:29.361435+0000","last_became_peered":"2024-09-19T09:50:29.361435+0000","last_unstale":"2024-09-19T09:52:00.371499+0000","last_undegraded":"2024-09-19T09:52:00.371499+0000","last_fullsized":"2024-09-19T09:52:00.371499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:26.078700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.822889+0000","last_change":"2024-09-19T09:50:27.340545+0000","last_active":"2024-09-19T09:51:31.822889+0000","last_peered":"2024-09-19T09:51:31.822889+0000","last_clean":"2024-09-19T09:51:31.822889+0000","last_became_active":"2024-09-19T09:50:27.340196+0000","last_became_peered":"2024-09-19T09:50:27.340196+0000","last_unstale":"2024-09-19T09:51:31.822889+0000","last_undegraded":"2024-09-19T09:51:31.822889+0000","last_fullsized":"2024-09-19T09:51:31.822889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:19.697617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.373699+0000","last_change":"2024-09-19T09:50:29.362342+0000","last_active":"2024-09-19T09:52:00.373699+0000","last_peered":"2024-09-19T09:52:00.373699+0000","last_clean":"2024-09-19T09:52:00.373699+0000","last_became_active":"2024-09-19T09:50:29.362006+0000","last_became_peered":"2024-09-19T09:50:29.362006+0000","last_unstale":"2024-09-19T09:52:00.373699+0000","last_undegraded":"2024-09-19T09:52:00.373699+0000","last_fullsized":"2024-09-19T09:52:00.373699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:29.457871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:51:31.823978+0000","last_change":"2024-09-19T09:50:27.784318+0000","last_active":"2024-09-19T09:51:31.823978+0000","last_peered":"2024-09-19T09:51:31.823978+0000","last_clean":"2024-09-19T09:51:31.823978+0000","last_became_active":"2024-09-19T09:50:27.784008+0000","last_became_peered":"2024-09-19T09:50:27.784008+0000","last_unstale":"2024-09-19T09:51:31.823978+0000","last_undegraded":"2024-09-19T09:51:31.823978+0000","last_fullsized":"2024-09-19T09:51:31.823978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:15.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:00.349804+0000","last_change":"2024-09-19T09:51:31.824910+0000","last_active":"2024-09-19T09:52:00.349804+0000","last_peered":"2024-09-19T09:52:00.349804+0000","last_clean":"2024-09-19T09:52:00.349804+0000","last_became_active":"2024-09-19T09:51:31.824521+0000","last_became_peered":"2024-09-19T09:51:31.824521+0000","last_unstale":"2024-09-19T09:52:00.349804+0000","last_undegraded":"2024-09-19T09:52:00.349804+0000","last_fullsized":"2024-09-19T09:52:00.349804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:28.330329+0000","last_clean_scrub_stamp":"2024-09-19T09:50:28.330329+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:43.351138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:52:34.718288+0000","last_change":"2024-09-19T09:50:27.341651+0000","last_active":"2024-09-19T09:52:34.718288+0000","last_peered":"2024-09-19T09:52:34.718288+0000","last_clean":"2024-09-19T09:52:34.718288+0000","last_became_active":"2024-09-19T09:50:27.341340+0000","last_became_peered":"2024-09-19T09:50:27.341340+0000","last_unstale":"2024-09-19T09:52:34.718288+0000","last_undegraded":"2024-09-19T09:52:34.718288+0000","last_fullsized":"2024-09-19T09:52:34.718288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:50:26.322872+0000","last_clean_scrub_stamp":"2024-09-19T09:50:26.322872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:12.804454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73288,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1193,"num_read_kb":676,"num_write":260,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":222140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514535,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":442788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743467,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1100149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":443096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364858,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1036599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528384,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":442969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1034901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953546,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":443138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":442260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":510196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704676,"statfs":{"total":95995035648,"available":95953588224,"internally_reserved":0,"allocated":995328,"data_stored":510510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":443774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:52:39.668 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:52:39.934 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:40.353 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:40 smithi018 ceph-mon[30956]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:52:40.354 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:40 smithi018 ceph-mon[30956]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.351+0000 7f5887961640 1 -- 172.21.15.18:0/3947358048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5880108300 msgr2=0x7f588010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.351+0000 7f5887961640 1 --2- 172.21.15.18:0/3947358048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5880108300 0x7f588010ec70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5878009930 tx=0x7f587802a440 comp rx=0 tx=0).stop 2024-09-19T09:52:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.351+0000 7f5887961640 1 -- 172.21.15.18:0/3947358048 shutdown_connections 2024-09-19T09:52:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.351+0000 7f5887961640 1 --2- 172.21.15.18:0/3947358048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5880108300 0x7f588010ec70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.351+0000 7f5887961640 1 --2- 172.21.15.18:0/3947358048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5880103780 0x7f5880107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.351+0000 7f5887961640 1 --2- 172.21.15.18:0/3947358048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5880102dd0 0x7f58801031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.351+0000 7f5887961640 1 -- 172.21.15.18:0/3947358048 >> 172.21.15.18:0/3947358048 conn(0x7f58800fc7d0 msgr2=0x7f58800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.351+0000 7f5887961640 1 -- 172.21.15.18:0/3947358048 shutdown_connections 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.351+0000 7f5887961640 1 -- 172.21.15.18:0/3947358048 wait complete. 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.352+0000 7f5887961640 1 Processor -- start 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.352+0000 7f5887961640 1 -- start start 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.352+0000 7f5887961640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5880102dd0 0x7f58801a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.352+0000 7f5887961640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5880103780 0x7f58801a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.352+0000 7f5887961640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5880108300 0x7f588019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.352+0000 7f5887961640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58801120f0 con 0x7f5880108300 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.352+0000 7f5887961640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5880111f70 con 0x7f5880103780 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.352+0000 7f5887961640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5880112270 con 0x7f5880102dd0 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.352+0000 7f5885efe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5880108300 0x7f588019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.352+0000 7f5884efc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5880103780 0x7f58801a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f5884efc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5880103780 0x7f58801a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:42312/0 (socket says 172.21.15.18:42312) 2024-09-19T09:52:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f5884efc640 1 -- 172.21.15.18:0/964678120 learned_addr learned my addr 172.21.15.18:0/964678120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f58856fd640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5880102dd0 0x7f58801a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f5884efc640 1 -- 172.21.15.18:0/964678120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5880102dd0 msgr2=0x7f58801a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f5884efc640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5880102dd0 0x7f58801a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f5884efc640 1 -- 172.21.15.18:0/964678120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5880108300 msgr2=0x7f588019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f5884efc640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5880108300 0x7f588019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f5884efc640 1 -- 172.21.15.18:0/964678120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588019ad10 con 0x7f5880103780 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f5885efe640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5880108300 0x7f588019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f5884efc640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5880103780 0x7f58801a0960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f587c006fd0 tx=0x7f587c00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f58727fc640 1 -- 172.21.15.18:0/964678120 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c011830 con 0x7f5880103780 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f58727fc640 1 -- 172.21.15.18:0/964678120 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f587c016070 con 0x7f5880103780 2024-09-19T09:52:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f5887961640 1 -- 172.21.15.18:0/964678120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588019b000 con 0x7f5880103780 2024-09-19T09:52:40.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.353+0000 7f58727fc640 1 -- 172.21.15.18:0/964678120 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c00f2e0 con 0x7f5880103780 2024-09-19T09:52:40.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.354+0000 7f5887961640 1 -- 172.21.15.18:0/964678120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58801a72f0 con 0x7f5880103780 2024-09-19T09:52:40.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.355+0000 7f5887961640 1 -- 172.21.15.18:0/964678120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58801031b0 con 0x7f5880103780 2024-09-19T09:52:40.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.356+0000 7f58727fc640 1 -- 172.21.15.18:0/964678120 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f587c01b460 con 0x7f5880103780 2024-09-19T09:52:40.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.357+0000 7f58727fc640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f586c0a3240 0x7f586c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:40.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.357+0000 7f58856fd640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f586c0a3240 0x7f586c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:40.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.357+0000 7f58727fc640 1 -- 172.21.15.18:0/964678120 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f587c0cef10 con 0x7f5880103780 2024-09-19T09:52:40.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.358+0000 7f58856fd640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f586c0a3240 0x7f586c0a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5874005fd0 tx=0x7f5874009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:40.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.362+0000 7f58727fc640 1 -- 172.21.15.18:0/964678120 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f587c09bc60 con 0x7f5880103780 2024-09-19T09:52:40.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.575+0000 7f5887961640 1 -- 172.21.15.18:0/964678120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f588010c2a0 con 0x7f5880103780 2024-09-19T09:52:40.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.576+0000 7f58727fc640 1 -- 172.21.15.18:0/964678120 <== mon.2 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f587c09b560 con 0x7f5880103780 2024-09-19T09:52:40.579 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:40.579 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:52:40.580 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:52:40.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 -- 172.21.15.18:0/964678120 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f586c0a3240 msgr2=0x7f586c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:40.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f586c0a3240 0x7f586c0a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5874005fd0 tx=0x7f5874009680 comp rx=0 tx=0).stop 2024-09-19T09:52:40.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 -- 172.21.15.18:0/964678120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5880103780 msgr2=0x7f58801a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:40.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5880103780 0x7f58801a0960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f587c006fd0 tx=0x7f587c00b8e0 comp rx=0 tx=0).stop 2024-09-19T09:52:40.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 -- 172.21.15.18:0/964678120 shutdown_connections 2024-09-19T09:52:40.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f586c0a3240 0x7f586c0a5700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:40.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5880108300 0x7f588019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:40.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5880103780 0x7f58801a0960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:40.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 --2- 172.21.15.18:0/964678120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5880102dd0 0x7f58801a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:40.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 -- 172.21.15.18:0/964678120 >> 172.21.15.18:0/964678120 conn(0x7f58800fc7d0 msgr2=0x7f5880100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:40.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 -- 172.21.15.18:0/964678120 shutdown_connections 2024-09-19T09:52:40.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:40.578+0000 7f5887961640 1 -- 172.21.15.18:0/964678120 wait complete. 2024-09-19T09:52:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:40 smithi049 ceph-mon[34858]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:52:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:40 smithi049 ceph-mon[34858]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:40 smithi162 ceph-mon[35174]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:52:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:40 smithi162 ceph-mon[35174]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:52:41.209 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:52:41.470 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:41.592 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:41 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/964678120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:41.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:41 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/964678120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:41.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:41 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/964678120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:41.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.924+0000 7fd01333e640 1 -- 172.21.15.18:0/2662079454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00c06a370 msgr2=0x7fd00c1009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.924+0000 7fd01333e640 1 --2- 172.21.15.18:0/2662079454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00c06a370 0x7fd00c1009c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd000009900 tx=0x7fd00002a410 comp rx=0 tx=0).stop 2024-09-19T09:52:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.924+0000 7fd01333e640 1 -- 172.21.15.18:0/2662079454 shutdown_connections 2024-09-19T09:52:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.924+0000 7fd01333e640 1 --2- 172.21.15.18:0/2662079454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd00c104e80 0x7fd00c105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.924+0000 7fd01333e640 1 --2- 172.21.15.18:0/2662079454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00c06a370 0x7fd00c1009c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.924+0000 7fd01333e640 1 --2- 172.21.15.18:0/2662079454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd00c069f00 0x7fd00c100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.924+0000 7fd01333e640 1 -- 172.21.15.18:0/2662079454 >> 172.21.15.18:0/2662079454 conn(0x7fd00c077210 msgr2=0x7fd00c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.924+0000 7fd01333e640 1 -- 172.21.15.18:0/2662079454 shutdown_connections 2024-09-19T09:52:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.924+0000 7fd01333e640 1 -- 172.21.15.18:0/2662079454 wait complete. 2024-09-19T09:52:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.925+0000 7fd01333e640 1 Processor -- start 2024-09-19T09:52:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.925+0000 7fd01333e640 1 -- start start 2024-09-19T09:52:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.925+0000 7fd01333e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd00c069f00 0x7fd00c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.925+0000 7fd01333e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd00c06a370 0x7fd00c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.925+0000 7fd01333e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00c104e80 0x7fd00c1a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.925+0000 7fd01333e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c110eb0 con 0x7fd00c104e80 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.925+0000 7fd01333e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c110d30 con 0x7fd00c06a370 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.925+0000 7fd01333e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c111030 con 0x7fd00c069f00 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0118db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00c104e80 0x7fd00c1a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0118db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00c104e80 0x7fd00c1a4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36202/0 (socket says 172.21.15.18:36202) 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0118db640 1 -- 172.21.15.18:0/1610409052 learned_addr learned my addr 172.21.15.18:0/1610409052 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0110da640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd00c069f00 0x7fd00c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0108d9640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd00c06a370 0x7fd00c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0118db640 1 -- 172.21.15.18:0/1610409052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd00c069f00 msgr2=0x7fd00c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0118db640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd00c069f00 0x7fd00c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0118db640 1 -- 172.21.15.18:0/1610409052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd00c06a370 msgr2=0x7fd00c199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:41.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0118db640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd00c06a370 0x7fd00c199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0118db640 1 -- 172.21.15.18:0/1610409052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00c1a4880 con 0x7fd00c104e80 2024-09-19T09:52:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0110da640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd00c069f00 0x7fd00c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd0118db640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00c104e80 0x7fd00c1a4340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd00400d750 tx=0x7fd00400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd00a7fc640 1 -- 172.21.15.18:0/1610409052 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004017070 con 0x7fd00c104e80 2024-09-19T09:52:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd00a7fc640 1 -- 172.21.15.18:0/1610409052 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd004005500 con 0x7fd00c104e80 2024-09-19T09:52:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd01333e640 1 -- 172.21.15.18:0/1610409052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00c1a4a50 con 0x7fd00c104e80 2024-09-19T09:52:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd00a7fc640 1 -- 172.21.15.18:0/1610409052 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004004d90 con 0x7fd00c104e80 2024-09-19T09:52:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.926+0000 7fd01333e640 1 -- 172.21.15.18:0/1610409052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00c1a4f10 con 0x7fd00c104e80 2024-09-19T09:52:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.927+0000 7fd01333e640 1 -- 172.21.15.18:0/1610409052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00c105330 con 0x7fd00c104e80 2024-09-19T09:52:41.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.929+0000 7fd00a7fc640 1 -- 172.21.15.18:0/1610409052 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd004004f30 con 0x7fd00c104e80 2024-09-19T09:52:41.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.929+0000 7fd00a7fc640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcff40a32c0 0x7fcff40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:41.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.930+0000 7fd0110da640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcff40a32c0 0x7fcff40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:41.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.930+0000 7fd00a7fc640 1 -- 172.21.15.18:0/1610409052 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd0040cf4d0 con 0x7fd00c104e80 2024-09-19T09:52:41.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.930+0000 7fd0110da640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcff40a32c0 0x7fcff40a5780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcffc005fd0 tx=0x7fcffc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:41.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:41.933+0000 7fd00a7fc640 1 -- 172.21.15.18:0/1610409052 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd00409bc50 con 0x7fd00c104e80 2024-09-19T09:52:42.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.142+0000 7fd01333e640 1 -- 172.21.15.18:0/1610409052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd00c1a5140 con 0x7fd00c104e80 2024-09-19T09:52:42.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.142+0000 7fd00a7fc640 1 -- 172.21.15.18:0/1610409052 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fd00409ff50 con 0x7fd00c104e80 2024-09-19T09:52:42.145 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:42.145 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:52:42.145 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.144+0000 7fd01333e640 1 -- 172.21.15.18:0/1610409052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcff40a32c0 msgr2=0x7fcff40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.144+0000 7fd01333e640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcff40a32c0 0x7fcff40a5780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcffc005fd0 tx=0x7fcffc009500 comp rx=0 tx=0).stop 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.145+0000 7fd01333e640 1 -- 172.21.15.18:0/1610409052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00c104e80 msgr2=0x7fd00c1a4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.145+0000 7fd01333e640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00c104e80 0x7fd00c1a4340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd00400d750 tx=0x7fd00400dc10 comp rx=0 tx=0).stop 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.145+0000 7fd01333e640 1 -- 172.21.15.18:0/1610409052 shutdown_connections 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.145+0000 7fd01333e640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcff40a32c0 0x7fcff40a5780 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.145+0000 7fd01333e640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00c104e80 0x7fd00c1a4340 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.145+0000 7fd01333e640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd00c06a370 0x7fd00c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.145+0000 7fd01333e640 1 --2- 172.21.15.18:0/1610409052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd00c069f00 0x7fd00c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.145+0000 7fd01333e640 1 -- 172.21.15.18:0/1610409052 >> 172.21.15.18:0/1610409052 conn(0x7fd00c077210 msgr2=0x7fd00c102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.145+0000 7fd01333e640 1 -- 172.21.15.18:0/1610409052 shutdown_connections 2024-09-19T09:52:42.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:42.145+0000 7fd01333e640 1 -- 172.21.15.18:0/1610409052 wait complete. 2024-09-19T09:52:42.463 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:42 smithi018 ceph-mon[30956]: pgmap v349: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:52:42.464 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:42 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1610409052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:42.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:42 smithi049 ceph-mon[34858]: pgmap v349: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:52:42.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:42 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1610409052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:42.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:42 smithi162 ceph-mon[35174]: pgmap v349: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:52:42.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:42 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1610409052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:42.752 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:52:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:43.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.431+0000 7faadf8cb640 1 -- 172.21.15.18:0/1897847647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad8102790 msgr2=0x7faad81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:43.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.431+0000 7faadf8cb640 1 --2- 172.21.15.18:0/1897847647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad8102790 0x7faad81067e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7faac8009900 tx=0x7faac802a410 comp rx=0 tx=0).stop 2024-09-19T09:52:43.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.431+0000 7faadf8cb640 1 -- 172.21.15.18:0/1897847647 shutdown_connections 2024-09-19T09:52:43.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.431+0000 7faadf8cb640 1 --2- 172.21.15.18:0/1897847647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad8106f10 0x7faad810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:43.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.431+0000 7faadf8cb640 1 --2- 172.21.15.18:0/1897847647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad8102790 0x7faad81067e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:43.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.431+0000 7faadf8cb640 1 --2- 172.21.15.18:0/1897847647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad8101de0 0x7faad81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:43.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.431+0000 7faadf8cb640 1 -- 172.21.15.18:0/1897847647 >> 172.21.15.18:0/1897847647 conn(0x7faad80fd8c0 msgr2=0x7faad80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:43.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.431+0000 7faadf8cb640 1 -- 172.21.15.18:0/1897847647 shutdown_connections 2024-09-19T09:52:43.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.431+0000 7faadf8cb640 1 -- 172.21.15.18:0/1897847647 wait complete. 2024-09-19T09:52:43.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadf8cb640 1 Processor -- start 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadf8cb640 1 -- start start 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadf8cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad8101de0 0x7faad81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadf8cb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad8102790 0x7faad8198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadf8cb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad8106f10 0x7faad819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadf8cb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faad8112000 con 0x7faad8101de0 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadf8cb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faad8111e80 con 0x7faad8102790 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadf8cb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faad8112180 con 0x7faad8106f10 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadd667640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad8101de0 0x7faad81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadd667640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad8101de0 0x7faad81984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36218/0 (socket says 172.21.15.18:36218) 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadd667640 1 -- 172.21.15.18:0/595518783 learned_addr learned my addr 172.21.15.18:0/595518783 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadde68640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad8106f10 0x7faad819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.432+0000 7faadce66640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad8102790 0x7faad8198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:43.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faadd667640 1 -- 172.21.15.18:0/595518783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad8106f10 msgr2=0x7faad819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faadd667640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad8106f10 0x7faad819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faadd667640 1 -- 172.21.15.18:0/595518783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad8102790 msgr2=0x7faad8198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faadd667640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad8102790 0x7faad8198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faadd667640 1 -- 172.21.15.18:0/595518783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad819d490 con 0x7faad8101de0 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faadd667640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad8101de0 0x7faad81984e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7faad400b4a0 tx=0x7faad400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faace7fc640 1 -- 172.21.15.18:0/595518783 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4014070 con 0x7faad8101de0 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faace7fc640 1 -- 172.21.15.18:0/595518783 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad4010af0 con 0x7faad8101de0 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faadf8cb640 1 -- 172.21.15.18:0/595518783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad819d780 con 0x7faad8101de0 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faace7fc640 1 -- 172.21.15.18:0/595518783 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4017d10 con 0x7faad8101de0 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.433+0000 7faadf8cb640 1 -- 172.21.15.18:0/595518783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad81a5060 con 0x7faad8101de0 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.434+0000 7faadf8cb640 1 -- 172.21.15.18:0/595518783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad81021c0 con 0x7faad8101de0 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.435+0000 7faace7fc640 1 -- 172.21.15.18:0/595518783 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faad4017070 con 0x7faad8101de0 2024-09-19T09:52:43.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.436+0000 7faace7fc640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faac40a32c0 0x7faac40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:43.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.436+0000 7faadce66640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faac40a32c0 0x7faac40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:43.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.436+0000 7faace7fc640 1 -- 172.21.15.18:0/595518783 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7faad40ceff0 con 0x7faad8101de0 2024-09-19T09:52:43.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.437+0000 7faadce66640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faac40a32c0 0x7faac40a5780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faac8000c00 tx=0x7faac8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:43.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.439+0000 7faace7fc640 1 -- 172.21.15.18:0/595518783 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faad409bd40 con 0x7faad8101de0 2024-09-19T09:52:43.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.616+0000 7faadf8cb640 1 -- 172.21.15.18:0/595518783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faad810a120 con 0x7faad8101de0 2024-09-19T09:52:43.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.618+0000 7faace7fc640 1 -- 172.21.15.18:0/595518783 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22571 (secure 0 0 0) 0x7faad4097070 con 0x7faad8101de0 2024-09-19T09:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:43.620 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:51:31.811334+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:52:43.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 -- 172.21.15.18:0/595518783 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faac40a32c0 msgr2=0x7faac40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:43.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faac40a32c0 0x7faac40a5780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faac8000c00 tx=0x7faac8005a20 comp rx=0 tx=0).stop 2024-09-19T09:52:43.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 -- 172.21.15.18:0/595518783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad8101de0 msgr2=0x7faad81984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:43.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad8101de0 0x7faad81984e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7faad400b4a0 tx=0x7faad400b960 comp rx=0 tx=0).stop 2024-09-19T09:52:43.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 -- 172.21.15.18:0/595518783 shutdown_connections 2024-09-19T09:52:43.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faac40a32c0 0x7faac40a5780 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:43.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad8106f10 0x7faad819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad8102790 0x7faad8198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 --2- 172.21.15.18:0/595518783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad8101de0 0x7faad81984e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 -- 172.21.15.18:0/595518783 >> 172.21.15.18:0/595518783 conn(0x7faad80fd8c0 msgr2=0x7faad80fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 -- 172.21.15.18:0/595518783 shutdown_connections 2024-09-19T09:52:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:43.620+0000 7faadf8cb640 1 -- 172.21.15.18:0/595518783 wait complete. 2024-09-19T09:52:44.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T09:52:44.551 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:44.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:44 smithi018 ceph-mon[30956]: pgmap v350: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T09:52:44.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:44 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/595518783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:44.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:44 smithi049 ceph-mon[34858]: pgmap v350: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T09:52:44.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:44 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/595518783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:44.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:44 smithi162 ceph-mon[35174]: pgmap v350: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T09:52:44.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:44 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/595518783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:52:45.620 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:45 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T09:52:45.648 INFO:teuthology.orchestra.run.smithi018.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T09:52:45.649 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T09:52:45.649 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T09:52:45.649 DEBUG:tasks.quiescer:Yielding 2024-09-19T09:52:45.650 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T09:52:45.667 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:52:45.667 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T09:52:45.667 INFO:tasks.workunit:timeout=3h 2024-09-19T09:52:45.667 INFO:tasks.workunit:cleanup=True 2024-09-19T09:52:45.667 DEBUG:teuthology.orchestra.run.smithi018:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:52:45.668 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:52:45.669 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:45 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T09:52:45.669 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:45 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T09:52:45.685 INFO:teuthology.orchestra.run.smithi018.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T09:52:45.685 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T09:52:45.685 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T09:52:45.685 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:52:45.686 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T09:52:45.686 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 09:50:47.532508488 +0000 2024-09-19T09:52:45.686 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 09:50:47.532508488 +0000 2024-09-19T09:52:45.686 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 09:52:24.424602401 +0000 2024-09-19T09:52:45.686 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 09:50:47.532508488 +0000 2024-09-19T09:52:45.686 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T09:52:45.686 DEBUG:teuthology.orchestra.run.smithi018:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T09:52:45.757 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:52:45.813 INFO:tasks.workunit.client.0.smithi018.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T09:52:45.932 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:46.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.360+0000 7f24586f0640 1 -- 172.21.15.18:0/2148041822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2450102db0 msgr2=0x7f2450103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.360+0000 7f24586f0640 1 --2- 172.21.15.18:0/2148041822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2450102db0 0x7f2450103190 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f244c009930 tx=0x7f244c02a420 comp rx=0 tx=0).stop 2024-09-19T09:52:46.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.360+0000 7f24586f0640 1 -- 172.21.15.18:0/2148041822 shutdown_connections 2024-09-19T09:52:46.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.360+0000 7f24586f0640 1 --2- 172.21.15.18:0/2148041822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24501082e0 0x7f245010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.360+0000 7f24586f0640 1 --2- 172.21.15.18:0/2148041822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2450103760 0x7f2450107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.360+0000 7f24586f0640 1 --2- 172.21.15.18:0/2148041822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2450102db0 0x7f2450103190 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.360+0000 7f24586f0640 1 -- 172.21.15.18:0/2148041822 >> 172.21.15.18:0/2148041822 conn(0x7f24500fc7d0 msgr2=0x7f24500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:46.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.361+0000 7f24586f0640 1 -- 172.21.15.18:0/2148041822 shutdown_connections 2024-09-19T09:52:46.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.361+0000 7f24586f0640 1 -- 172.21.15.18:0/2148041822 wait complete. 2024-09-19T09:52:46.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.361+0000 7f24586f0640 1 Processor -- start 2024-09-19T09:52:46.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.361+0000 7f24586f0640 1 -- start start 2024-09-19T09:52:46.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f24586f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2450102db0 0x7f24501985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f24586f0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2450103760 0x7f2450198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f24586f0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24501082e0 0x7f245019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f24586f0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2450112090 con 0x7f2450102db0 2024-09-19T09:52:46.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f24586f0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2450111f10 con 0x7f24501082e0 2024-09-19T09:52:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f24586f0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2450112210 con 0x7f2450103760 2024-09-19T09:52:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f245648c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2450102db0 0x7f24501985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f245648c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2450102db0 0x7f24501985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36242/0 (socket says 172.21.15.18:36242) 2024-09-19T09:52:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f245648c640 1 -- 172.21.15.18:0/1479740078 learned_addr learned my addr 172.21.15.18:0/1479740078 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f2455c8b640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2450103760 0x7f2450198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f2456c8d640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24501082e0 0x7f245019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f245648c640 1 -- 172.21.15.18:0/1479740078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2450103760 msgr2=0x7f2450198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f245648c640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2450103760 0x7f2450198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f245648c640 1 -- 172.21.15.18:0/1479740078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24501082e0 msgr2=0x7f245019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f245648c640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24501082e0 0x7f245019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f245648c640 1 -- 172.21.15.18:0/1479740078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245019d550 con 0x7f2450102db0 2024-09-19T09:52:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.362+0000 7f245648c640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2450102db0 0x7f24501985a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f244c004770 tx=0x7f244c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.363+0000 7f24477fe640 1 -- 172.21.15.18:0/1479740078 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c03f070 con 0x7f2450102db0 2024-09-19T09:52:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.363+0000 7f24586f0640 1 -- 172.21.15.18:0/1479740078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245019d7e0 con 0x7f2450102db0 2024-09-19T09:52:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.363+0000 7f24477fe640 1 -- 172.21.15.18:0/1479740078 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f244c031c20 con 0x7f2450102db0 2024-09-19T09:52:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.363+0000 7f24586f0640 1 -- 172.21.15.18:0/1479740078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24501a5120 con 0x7f2450102db0 2024-09-19T09:52:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.363+0000 7f24477fe640 1 -- 172.21.15.18:0/1479740078 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c035030 con 0x7f2450102db0 2024-09-19T09:52:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.364+0000 7f24586f0640 1 -- 172.21.15.18:0/1479740078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2450103190 con 0x7f2450102db0 2024-09-19T09:52:46.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.365+0000 7f24477fe640 1 -- 172.21.15.18:0/1479740078 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f244c042070 con 0x7f2450102db0 2024-09-19T09:52:46.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.366+0000 7f24477fe640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f243c0a32c0 0x7f243c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.366+0000 7f2455c8b640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f243c0a32c0 0x7f243c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.366+0000 7f24477fe640 1 -- 172.21.15.18:0/1479740078 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f244c0eff70 con 0x7f2450102db0 2024-09-19T09:52:46.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.367+0000 7f2455c8b640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f243c0a32c0 0x7f243c0a5780 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f24500fee40 tx=0x7f2440005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:46.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.370+0000 7f24477fe640 1 -- 172.21.15.18:0/1479740078 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f244c0bcd60 con 0x7f2450102db0 2024-09-19T09:52:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.571+0000 7f4433423640 1 -- 172.21.15.18:0/1478053407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442c1025d0 msgr2=0x7f442c1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.571+0000 7f4433423640 1 --2- 172.21.15.18:0/1478053407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442c1025d0 0x7f442c1049c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4428009900 tx=0x7f442802a410 comp rx=0 tx=0).stop 2024-09-19T09:52:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.571+0000 7f4433423640 1 -- 172.21.15.18:0/1478053407 shutdown_connections 2024-09-19T09:52:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.571+0000 7f4433423640 1 --2- 172.21.15.18:0/1478053407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c107830 0x7f442c109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.571+0000 7f4433423640 1 --2- 172.21.15.18:0/1478053407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c104f00 0x7f442c1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.571+0000 7f4433423640 1 --2- 172.21.15.18:0/1478053407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442c1025d0 0x7f442c1049c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.571+0000 7f4433423640 1 -- 172.21.15.18:0/1478053407 >> 172.21.15.18:0/1478053407 conn(0x7f442c0fc1b0 msgr2=0x7f442c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.571+0000 7f4433423640 1 -- 172.21.15.18:0/1478053407 shutdown_connections 2024-09-19T09:52:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.571+0000 7f4433423640 1 -- 172.21.15.18:0/1478053407 wait complete. 2024-09-19T09:52:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f4433423640 1 Processor -- start 2024-09-19T09:52:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f4433423640 1 -- start start 2024-09-19T09:52:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f4433423640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c1025d0 0x7f442c197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f4433423640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442c104f00 0x7f442c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f4433423640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c107830 0x7f442c19f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f4433423640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f442c10d840 con 0x7f442c104f00 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f4433423640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f442c10d6c0 con 0x7f442c107830 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f4433423640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f442c10d9c0 con 0x7f442c1025d0 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44309be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442c104f00 0x7f442c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44311bf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c1025d0 0x7f442c197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44309be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442c104f00 0x7f442c198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40902/0 (socket says 172.21.15.18:40902) 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44309be640 1 -- 172.21.15.18:0/658184277 learned_addr learned my addr 172.21.15.18:0/658184277 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44319c0640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c107830 0x7f442c19f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44309be640 1 -- 172.21.15.18:0/658184277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c1025d0 msgr2=0x7f442c197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44309be640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c1025d0 0x7f442c197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44309be640 1 -- 172.21.15.18:0/658184277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c107830 msgr2=0x7f442c19f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44309be640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c107830 0x7f442c19f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44309be640 1 -- 172.21.15.18:0/658184277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c19fa60 con 0x7f442c104f00 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.572+0000 7f44311bf640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c1025d0 0x7f442c197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.573+0000 7f44309be640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442c104f00 0x7f442c198380 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f441c00e9c0 tx=0x7f441c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.573+0000 7f44227fc640 1 -- 172.21.15.18:0/658184277 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c00cd80 con 0x7f442c104f00 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.573+0000 7f44227fc640 1 -- 172.21.15.18:0/658184277 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f441c005500 con 0x7f442c104f00 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.573+0000 7f44227fc640 1 -- 172.21.15.18:0/658184277 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c010690 con 0x7f442c104f00 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.573+0000 7f4433423640 1 -- 172.21.15.18:0/658184277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c19fd50 con 0x7f442c104f00 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.573+0000 7f4433423640 1 -- 172.21.15.18:0/658184277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c1a0240 con 0x7f442c104f00 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44227fc640 1 -- 172.21.15.18:0/658184277 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f441c0046c0 con 0x7f442c104f00 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44361bc740 1 Processor -- start 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44361bc740 1 -- start start 2024-09-19T09:52:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44361bc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a1cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44361bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a21da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44361bc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a22370 0x55e013a24830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44361bc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e0139802f0 con 0x55e013a1c9a0 2024-09-19T09:52:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44361bc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e013928270 con 0x55e013a22370 2024-09-19T09:52:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44361bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e01397c2b0 con 0x55e013a1d2e0 2024-09-19T09:52:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44319c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a1cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44319c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a1cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40916/0 (socket says 172.21.15.18:40916) 2024-09-19T09:52:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44311bf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a21da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44319c0640 1 -- 172.21.15.18:0/1352063205 learned_addr learned my addr 172.21.15.18:0/1352063205 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44309be640 1 --2- 172.21.15.18:0/1352063205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a22370 0x55e013a24830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44311bf640 1 -- 172.21.15.18:0/1352063205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a22370 msgr2=0x55e013a24830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44311bf640 1 --2- 172.21.15.18:0/1352063205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a22370 0x55e013a24830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44227fc640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44180a32f0 0x7f44180a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44311bf640 1 -- 172.21.15.18:0/1352063205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 msgr2=0x55e013a1cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.576+0000 7f44311bf640 1 --2- 172.21.15.18:0/1352063205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a1cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.577+0000 7f44311bf640 1 -- 172.21.15.18:0/1352063205 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e013927340 con 0x55e013a1d2e0 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.577+0000 7f44319c0640 1 --2- 172.21.15.18:0/1352063205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a1cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.577+0000 7f44227fc640 1 -- 172.21.15.18:0/658184277 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f441c0cfd10 con 0x7f442c104f00 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.577+0000 7f44319c0640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44180a32f0 0x7f44180a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.577+0000 7f44311bf640 1 --2- 172.21.15.18:0/1352063205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a21da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4428031440 tx=0x7f4428005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c29a6871c4179d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.577+0000 7f44177fe640 1 -- 172.21.15.18:0/1352063205 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428040070 con 0x55e013a1d2e0 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.577+0000 7f44319c0640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44180a32f0 0x7f44180a57b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4424009fd0 tx=0x7f4424004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.577+0000 7f44177fe640 1 -- 172.21.15.18:0/1352063205 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44280319b0 con 0x55e013a1d2e0 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.577+0000 7f44177fe640 1 -- 172.21.15.18:0/1352063205 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428035040 con 0x55e013a1d2e0 2024-09-19T09:52:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 -- 172.21.15.18:0/1352063205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 msgr2=0x55e013a21da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 --2- 172.21.15.18:0/1352063205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a21da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4428031440 tx=0x7f4428005e50 comp rx=0 tx=0).stop 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 -- 172.21.15.18:0/1352063205 shutdown_connections 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 --2- 172.21.15.18:0/1352063205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a22370 0x55e013a24830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 --2- 172.21.15.18:0/1352063205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a21da0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 --2- 172.21.15.18:0/1352063205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a1cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 -- 172.21.15.18:0/1352063205 >> 172.21.15.18:0/1352063205 conn(0x55e013a18010 msgr2=0x55e013a18410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 -- 172.21.15.18:0/1352063205 shutdown_connections 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 -- 172.21.15.18:0/1352063205 wait complete. 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 -- start start 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.578+0000 7f44361bc740 1 Processor -- start 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44361bc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a26b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44361bc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a1d2e0 0x55e013a270a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44361bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a22370 0x55e013a2e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44361bc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e013a252e0 con 0x55e013a1c9a0 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44361bc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e013909290 con 0x55e013a1d2e0 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44361bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e013a25460 con 0x55e013a22370 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44361bc740 10 client.0 _ll_register_callbacks cb 0x55e01393a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44319c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a22370 0x55e013a2e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44311bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a26b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44319c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a22370 0x55e013a2e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50976/0 (socket says 172.21.15.18:50976) 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44319c0640 1 -- 172.21.15.18:0/3313534768 learned_addr learned my addr 172.21.15.18:0/3313534768 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44309be640 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a1d2e0 0x55e013a270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44319c0640 1 -- 172.21.15.18:0/3313534768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a1d2e0 msgr2=0x55e013a270a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44319c0640 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a1d2e0 0x55e013a270a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44319c0640 1 -- 172.21.15.18:0/3313534768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 msgr2=0x55e013a26b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44319c0640 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a26b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44319c0640 1 -- 172.21.15.18:0/3313534768 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e013693210 con 0x55e013a22370 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.579+0000 7f44311bf640 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a26b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f44319c0640 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a22370 0x55e013a2e0e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4424013d10 tx=0x7f4424004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24a7bec2ef1b9644 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f4414ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f4414ff9640 1 -- 172.21.15.18:0/3313534768 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442401e420 con 0x55e013a22370 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f44361bc740 1 -- 172.21.15.18:0/3313534768 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44280319b0 con 0x55e013a22370 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f4414ff9640 1 -- 172.21.15.18:0/3313534768 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f442401e5c0 con 0x55e013a22370 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f4414ff9640 1 -- 172.21.15.18:0/3313534768 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f442402e020 con 0x55e013a22370 2024-09-19T09:52:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f44361bc740 10 client.25003 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f44361bc740 1 -- 172.21.15.18:0/3313534768 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e01375f620 con 0x55e013a22370 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f4414ff9640 1 -- 172.21.15.18:0/3313534768 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44280319b0 con 0x55e013a22370 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f4414ff9640 1 -- 172.21.15.18:0/3313534768 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f44240288e0 con 0x55e013a22370 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f44361bc740 10 client.25003 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f44361bc740 10 client.25003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f44361bc740 20 client.25003 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f44361bc740 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e013a32830 0x55e013a34c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f44361bc740 4 client.25003 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.580+0000 7f44361bc740 1 -- 172.21.15.18:0/3313534768 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e01398da20 con 0x55e013a32830 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.581+0000 7f44311bf640 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e013a32830 0x55e013a34c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.581+0000 7f4414ff9640 10 client.25003 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.581+0000 7f44311bf640 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e013a32830 0x55e013a34c80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58f9b847817d3d08 server_cookie=1ed44213872bb70f in_seq=0 out_seq=0 2024-09-19T09:52:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f4414ff9640 1 -- 172.21.15.18:0/3313534768 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e01398da20 con 0x55e013a32830 2024-09-19T09:52:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f4414ff9640 10 client.25003 handle_command_reply: tid=0 2024-09-19T09:52:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 client.25003 shutdown 2024-09-19T09:52:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 -- 172.21.15.18:0/3313534768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a22370 msgr2=0x55e013a2e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a22370 0x55e013a2e0e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4424013d10 tx=0x7f4424004ab0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 -- 172.21.15.18:0/3313534768 shutdown_connections 2024-09-19T09:52:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e013a32830 0x55e013a34c80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a22370 0x55e013a2e0e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f4414ff9640 0 client.25003 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a1d2e0 0x55e013a270a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 --2- 172.21.15.18:0/3313534768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a26b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 -- 172.21.15.18:0/3313534768 >> 172.21.15.18:0/3313534768 conn(0x55e013a18010 msgr2=0x55e013a19820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 -- 172.21.15.18:0/3313534768 shutdown_connections 2024-09-19T09:52:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 1 -- 172.21.15.18:0/3313534768 wait complete. 2024-09-19T09:52:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.582+0000 7f44361bc740 20 client.25003 trim_cache size 0 max 16384 2024-09-19T09:52:46.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.590+0000 7f24586f0640 1 -- 172.21.15.18:0/1479740078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f245010a2c0 con 0x7f2450102db0 2024-09-19T09:52:46.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:46 smithi018 ceph-mon[30956]: pgmap v351: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T09:52:46.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.591+0000 7f24477fe640 1 -- 172.21.15.18:0/1479740078 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f244c0bc660 con 0x7f2450102db0 2024-09-19T09:52:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:52:46.596 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:52:46.597 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:52:46.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.593+0000 7f24586f0640 1 -- 172.21.15.18:0/1479740078 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f243c0a32c0 msgr2=0x7f243c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.593+0000 7f24586f0640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f243c0a32c0 0x7f243c0a5780 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f24500fee40 tx=0x7f2440005f90 comp rx=0 tx=0).stop 2024-09-19T09:52:46.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.593+0000 7f24586f0640 1 -- 172.21.15.18:0/1479740078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2450102db0 msgr2=0x7f24501985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.593+0000 7f24586f0640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2450102db0 0x7f24501985a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f244c004770 tx=0x7f244c003b90 comp rx=0 tx=0).stop 2024-09-19T09:52:46.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.593+0000 7f24586f0640 1 -- 172.21.15.18:0/1479740078 shutdown_connections 2024-09-19T09:52:46.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.593+0000 7f24586f0640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f243c0a32c0 0x7f243c0a5780 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.593+0000 7f24586f0640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24501082e0 0x7f245019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.593+0000 7f24586f0640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2450103760 0x7f2450198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.593+0000 7f24586f0640 1 --2- 172.21.15.18:0/1479740078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2450102db0 0x7f24501985a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.593+0000 7f24586f0640 1 -- 172.21.15.18:0/1479740078 >> 172.21.15.18:0/1479740078 conn(0x7f24500fc7d0 msgr2=0x7f2450105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:46.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.594+0000 7f24586f0640 1 -- 172.21.15.18:0/1479740078 shutdown_connections 2024-09-19T09:52:46.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:46.594+0000 7f24586f0640 1 -- 172.21.15.18:0/1479740078 wait complete. 2024-09-19T09:52:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.608+0000 7f44361bc740 1 Processor -- start 2024-09-19T09:52:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.608+0000 7f44361bc740 1 -- start start 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.608+0000 7f44361bc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a1c9a0 0x55e013a170b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.608+0000 7f44361bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a39580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.608+0000 7f44361bc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a22370 0x55e013a39ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.608+0000 7f44361bc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1a8f90 con 0x55e013a22370 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.608+0000 7f44361bc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1aaad0 con 0x55e013a1c9a0 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.608+0000 7f44361bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1a9660 con 0x55e013a1d2e0 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44319c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a22370 0x55e013a39ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44309be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a39580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44309be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a39580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50982/0 (socket says 172.21.15.18:50982) 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44309be640 1 -- 172.21.15.18:0/1194201591 learned_addr learned my addr 172.21.15.18:0/1194201591 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44311bf640 1 --2- 172.21.15.18:0/1194201591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a1c9a0 0x55e013a170b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44309be640 1 -- 172.21.15.18:0/1194201591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a1c9a0 msgr2=0x55e013a170b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44309be640 1 --2- 172.21.15.18:0/1194201591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a1c9a0 0x55e013a170b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44309be640 1 -- 172.21.15.18:0/1194201591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a22370 msgr2=0x55e013a39ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44309be640 1 --2- 172.21.15.18:0/1194201591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a22370 0x55e013a39ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44309be640 1 -- 172.21.15.18:0/1194201591 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e013a17e30 con 0x55e013a1d2e0 2024-09-19T09:52:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f44309be640 1 --2- 172.21.15.18:0/1194201591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a39580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c6a0 tx=0x7f441c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee9809ff45142795 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f4416ffd640 1 -- 172.21.15.18:0/1194201591 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c09bcc0 con 0x55e013a1d2e0 2024-09-19T09:52:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f4416ffd640 1 -- 172.21.15.18:0/1194201591 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f441c09ca60 con 0x55e013a1d2e0 2024-09-19T09:52:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.609+0000 7f4416ffd640 1 -- 172.21.15.18:0/1194201591 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c0a4b40 con 0x55e013a1d2e0 2024-09-19T09:52:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.610+0000 7f44361bc740 1 -- 172.21.15.18:0/1194201591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 msgr2=0x55e013a39580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.610+0000 7f44361bc740 1 --2- 172.21.15.18:0/1194201591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a39580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c6a0 tx=0x7f441c005880 comp rx=0 tx=0).stop 2024-09-19T09:52:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.610+0000 7f44361bc740 1 -- 172.21.15.18:0/1194201591 shutdown_connections 2024-09-19T09:52:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.610+0000 7f44361bc740 1 --2- 172.21.15.18:0/1194201591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a22370 0x55e013a39ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.610+0000 7f44361bc740 1 --2- 172.21.15.18:0/1194201591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a39580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.610+0000 7f44361bc740 1 --2- 172.21.15.18:0/1194201591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a1c9a0 0x55e013a170b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.610+0000 7f44361bc740 1 -- 172.21.15.18:0/1194201591 >> 172.21.15.18:0/1194201591 conn(0x55e013a18010 msgr2=0x55e013a169a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.611+0000 7f44361bc740 1 -- 172.21.15.18:0/1194201591 shutdown_connections 2024-09-19T09:52:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.611+0000 7f44361bc740 1 -- 172.21.15.18:0/1194201591 wait complete. 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.611+0000 7f44361bc740 1 -- start start 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.611+0000 7f44361bc740 1 Processor -- start 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44361bc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a98520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44361bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a98a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44361bc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a22370 0x55e013a9faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44361bc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1aa400 con 0x55e013a1c9a0 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44361bc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1a9d30 con 0x55e013a22370 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44361bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1a6f70 con 0x55e013a1d2e0 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44309be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a98a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44311bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a98520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44309be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a98a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50986/0 (socket says 172.21.15.18:50986) 2024-09-19T09:52:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44309be640 1 -- 172.21.15.18:0/3530761698 learned_addr learned my addr 172.21.15.18:0/3530761698 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44311bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a98520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40940/0 (socket says 172.21.15.18:40940) 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44361bc740 10 client.0 _ll_register_callbacks cb 0x7f4424009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44319c0640 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a22370 0x55e013a9faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44309be640 1 -- 172.21.15.18:0/3530761698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a22370 msgr2=0x55e013a9faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44309be640 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a22370 0x55e013a9faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44309be640 1 -- 172.21.15.18:0/3530761698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 msgr2=0x55e013a98520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44309be640 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a98520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.612+0000 7f44309be640 1 -- 172.21.15.18:0/3530761698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e013aa00b0 con 0x55e013a1d2e0 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f44309be640 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a98a60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f441c0bc010 tx=0x7f441c09a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=548297cf4173c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f4414ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f4414ff9640 1 -- 172.21.15.18:0/3530761698 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c0b4020 con 0x55e013a1d2e0 2024-09-19T09:52:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f4414ff9640 1 -- 172.21.15.18:0/3530761698 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f441c0b5250 con 0x55e013a1d2e0 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f44361bc740 1 -- 172.21.15.18:0/3530761698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f441c09ca60 con 0x55e013a1d2e0 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f4414ff9640 1 -- 172.21.15.18:0/3530761698 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f441c0a0710 con 0x55e013a1d2e0 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f44361bc740 10 client.25009 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f44361bc740 1 -- 172.21.15.18:0/3530761698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e013aa1430 con 0x55e013a1d2e0 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f4414ff9640 1 -- 172.21.15.18:0/3530761698 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f441c09ca60 con 0x55e013a1d2e0 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f4414ff9640 1 -- 172.21.15.18:0/3530761698 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f441c0a0200 con 0x55e013a1d2e0 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f44361bc740 10 client.25009 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f44361bc740 10 client.25009 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f44361bc740 20 client.25009 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f44361bc740 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e013aa1c90 0x55e013aa40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f44361bc740 4 client.25009 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.613+0000 7f44361bc740 1 -- 172.21.15.18:0/3530761698 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e013987d70 con 0x55e013aa1c90 2024-09-19T09:52:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.614+0000 7f44311bf640 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e013aa1c90 0x55e013aa40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.614+0000 7f44311bf640 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e013aa1c90 0x55e013aa40b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d93af47e762ad761 server_cookie=8244b803d2094cad in_seq=0 out_seq=0 2024-09-19T09:52:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.614+0000 7f4414ff9640 10 client.25009 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.625+0000 7f4414ff9640 1 -- 172.21.15.18:0/3530761698 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e013987d70 con 0x55e013aa1c90 2024-09-19T09:52:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.625+0000 7f4414ff9640 10 client.25009 handle_command_reply: tid=0 2024-09-19T09:52:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.625+0000 7f44361bc740 1 client.25009 shutdown 2024-09-19T09:52:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 1 -- 172.21.15.18:0/3530761698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 msgr2=0x55e013a98a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a98a60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f441c0bc010 tx=0x7f441c09a6d0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 1 -- 172.21.15.18:0/3530761698 shutdown_connections 2024-09-19T09:52:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e013aa1c90 0x55e013aa40b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e013a22370 0x55e013a9faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e013a1d2e0 0x55e013a98a60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 1 --2- 172.21.15.18:0/3530761698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e013a1c9a0 0x55e013a98520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 1 -- 172.21.15.18:0/3530761698 >> 172.21.15.18:0/3530761698 conn(0x55e013a18010 msgr2=0x55e013a196e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f4414ff9640 0 client.25009 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 1 -- 172.21.15.18:0/3530761698 shutdown_connections 2024-09-19T09:52:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 1 -- 172.21.15.18:0/3530761698 wait complete. 2024-09-19T09:52:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f44361bc740 20 client.25009 trim_cache size 0 max 16384 2024-09-19T09:52:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:52:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:52:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:52:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:52:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f4433423640 1 -- 172.21.15.18:0/658184277 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44180a32f0 msgr2=0x7f44180a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f4433423640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44180a32f0 0x7f44180a57b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4424009fd0 tx=0x7f4424004a40 comp rx=0 tx=0).stop 2024-09-19T09:52:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f4433423640 1 -- 172.21.15.18:0/658184277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442c104f00 msgr2=0x7f442c198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.626+0000 7f4433423640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442c104f00 0x7f442c198380 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f441c00e9c0 tx=0x7f441c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:52:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.627+0000 7f4433423640 1 -- 172.21.15.18:0/658184277 shutdown_connections 2024-09-19T09:52:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.627+0000 7f4433423640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44180a32f0 0x7f44180a57b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.627+0000 7f4433423640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f442c107830 0x7f442c19f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.627+0000 7f4433423640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442c104f00 0x7f442c198380 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.627+0000 7f4433423640 1 --2- 172.21.15.18:0/658184277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f442c1025d0 0x7f442c197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.627+0000 7f4433423640 1 -- 172.21.15.18:0/658184277 >> 172.21.15.18:0/658184277 conn(0x7f442c0fc1b0 msgr2=0x7f442c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.627+0000 7f4433423640 1 -- 172.21.15.18:0/658184277 shutdown_connections 2024-09-19T09:52:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:46.627+0000 7f4433423640 1 -- 172.21.15.18:0/658184277 wait complete. 2024-09-19T09:52:46.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:46 smithi049 ceph-mon[34858]: pgmap v351: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T09:52:46.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:46 smithi162 ceph-mon[35174]: pgmap v351: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T09:52:47.237 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:50:29.937674+0000', 'modified': '2024-09-19T09:52:25.114893+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24524, 'mds_1': 24488, 'mds_2': 24484, 'mds_3': 24470, 'mds_4': 14592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14580': {'gid': 14580, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6839/2438161705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6838', 'nonce': 2438161705}, {'type': 'v1', 'addr': '172.21.15.18:6839', 'nonce': 2438161705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14592': {'gid': 14592, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.18:6841/1971133018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6840', 'nonce': 1971133018}, {'type': 'v1', 'addr': '172.21.15.18:6841', 'nonce': 1971133018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6833/212444721', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 212444721}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 212444721}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.49:6833/94526458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 94526458}, {'type': 'v1', 'addr': '172.21.15.49:6833', 'nonce': 94526458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/2083709123', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 2083709123}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 2083709123}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6837/3104050334', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 3104050334}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 3104050334}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.49:6835/4145133674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 4145133674}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 4145133674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.162:6839/2783930861', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 2783930861}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 2783930861}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.49:6837/1773266295', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6836', 'nonce': 1773266295}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 1773266295}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24524': {'gid': 24524, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.49:6839/189898808', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6838', 'nonce': 189898808}, {'type': 'v1', 'addr': '172.21.15.49:6839', 'nonce': 189898808}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24524, 'qdb_cluster': [14592, 24524, 24470, 24484, 24488]} 2024-09-19T09:52:47.237 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:52:47.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-19T09:52:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:47.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:47 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1479740078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:47.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:47 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1479740078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:47.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:47 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1479740078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:52:47.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.987+0000 7f1a9f8de640 1 -- 172.21.15.18:0/3108445051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a98106f10 msgr2=0x7f1a9810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:47.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.987+0000 7f1a9f8de640 1 --2- 172.21.15.18:0/3108445051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a98106f10 0x7f1a9810ea90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009ca0 tx=0x7f1a9002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:52:47.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.987+0000 7f1a9f8de640 1 -- 172.21.15.18:0/3108445051 shutdown_connections 2024-09-19T09:52:47.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.987+0000 7f1a9f8de640 1 --2- 172.21.15.18:0/3108445051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a98106f10 0x7f1a9810ea90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.987+0000 7f1a9f8de640 1 --2- 172.21.15.18:0/3108445051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a98102790 0x7f1a981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.987+0000 7f1a9f8de640 1 --2- 172.21.15.18:0/3108445051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a98101de0 0x7f1a981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.987+0000 7f1a9f8de640 1 -- 172.21.15.18:0/3108445051 >> 172.21.15.18:0/3108445051 conn(0x7f1a980fd8c0 msgr2=0x7f1a980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.987+0000 7f1a9f8de640 1 -- 172.21.15.18:0/3108445051 shutdown_connections 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.987+0000 7f1a9f8de640 1 -- 172.21.15.18:0/3108445051 wait complete. 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9f8de640 1 Processor -- start 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9f8de640 1 -- start start 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9f8de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a98101de0 0x7f1a98198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9f8de640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a98102790 0x7f1a981989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9f8de640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a98106f10 0x7f1a9819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9f8de640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a98111fb0 con 0x7f1a98106f10 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9f8de640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1a98111e30 con 0x7f1a98102790 2024-09-19T09:52:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9f8de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a98112130 con 0x7f1a98101de0 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9de7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a98106f10 0x7f1a9819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9de7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a98106f10 0x7f1a9819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40964/0 (socket says 172.21.15.18:40964) 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9de7b640 1 -- 172.21.15.18:0/2093266029 learned_addr learned my addr 172.21.15.18:0/2093266029 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a98101de0 0x7f1a98198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.988+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a98102790 0x7f1a981989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a9de7b640 1 -- 172.21.15.18:0/2093266029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a98101de0 msgr2=0x7f1a98198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a9de7b640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a98101de0 0x7f1a98198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a9de7b640 1 -- 172.21.15.18:0/2093266029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a98102790 msgr2=0x7f1a981989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a9de7b640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a98102790 0x7f1a981989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a9de7b640 1 -- 172.21.15.18:0/2093266029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9819d420 con 0x7f1a98106f10 2024-09-19T09:52:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a98101de0 0x7f1a98198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a98102790 0x7f1a981989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a9de7b640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a98106f10 0x7f1a9819cd40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1a90031a20 tx=0x7f1a90031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a8e7fc640 1 -- 172.21.15.18:0/2093266029 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90003c30 con 0x7f1a98106f10 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a8e7fc640 1 -- 172.21.15.18:0/2093266029 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a90003dd0 con 0x7f1a98106f10 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a9f8de640 1 -- 172.21.15.18:0/2093266029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9819d6b0 con 0x7f1a98106f10 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a8e7fc640 1 -- 172.21.15.18:0/2093266029 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9002fcf0 con 0x7f1a98106f10 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.989+0000 7f1a9f8de640 1 -- 172.21.15.18:0/2093266029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a981a4ff0 con 0x7f1a98106f10 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.991+0000 7f1a8e7fc640 1 -- 172.21.15.18:0/2093266029 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1a90004050 con 0x7f1a98106f10 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1aa1cb7740 1 Processor -- start 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1aa1cb7740 1 -- start start 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8999d0 0x559f3d899db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f3d800090 con 0x559f3d89a2f0 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559f3d7a7a70 con 0x559f3d8a4bb0 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559f3d7fc050 con 0x559f3d8999d0 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1a9d67a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1a9d67a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40970/0 (socket says 172.21.15.18:40970) 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1a9d67a640 1 -- 172.21.15.18:0/390603686 learned_addr learned my addr 172.21.15.18:0/390603686 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.992+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/390603686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8999d0 0x559f3d899db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a8e7fc640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a840a32c0 0x7f1a840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/390603686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a9d67a640 1 -- 172.21.15.18:0/390603686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8999d0 msgr2=0x559f3d899db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/390603686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8999d0 0x559f3d899db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a9d67a640 1 -- 172.21.15.18:0/390603686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8a4bb0 msgr2=0x559f3d8a6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/390603686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a9d67a640 1 -- 172.21.15.18:0/390603686 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f3d7b4130 con 0x559f3d89a2f0 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a9de7b640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a840a32c0 0x7f1a840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/390603686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8999d0 0x559f3d899db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a8e7fc640 1 -- 172.21.15.18:0/2093266029 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1a900f0d10 con 0x7f1a98106f10 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/390603686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a4670 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1a94007850 tx=0x7f1a94007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d922b84d8878d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a837fe640 1 -- 172.21.15.18:0/390603686 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400d950 con 0x559f3d89a2f0 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a837fe640 1 -- 172.21.15.18:0/390603686 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a94018070 con 0x559f3d89a2f0 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.993+0000 7f1a837fe640 1 -- 172.21.15.18:0/390603686 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940123e0 con 0x559f3d89a2f0 2024-09-19T09:52:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/390603686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 msgr2=0x559f3d8a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/390603686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a4670 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1a94007850 tx=0x7f1a94007d10 comp rx=0 tx=0).stop 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1a9de7b640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a840a32c0 0x7f1a840a5780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a900b97f0 tx=0x7f1a9008d120 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/390603686 shutdown_connections 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/390603686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/390603686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a4670 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/390603686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8999d0 0x559f3d899db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/390603686 >> 172.21.15.18:0/390603686 conn(0x559f3d895f60 msgr2=0x559f3d896340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/390603686 shutdown_connections 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/390603686 wait complete. 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 -- start start 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.994+0000 7f1aa1cb7740 1 Processor -- start 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 0x559f3d8a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f3d8a7780 con 0x559f3d89a2f0 2024-09-19T09:52:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559f3d7baf20 con 0x559f3d8999d0 2024-09-19T09:52:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559f3d8a7900 con 0x559f3d8a4bb0 2024-09-19T09:52:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1aa1cb7740 10 client.0 _ll_register_callbacks cb 0x559f3d784030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9d67a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9d67a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40976/0 (socket says 172.21.15.18:40976) 2024-09-19T09:52:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9d67a640 1 -- 172.21.15.18:0/3219908956 learned_addr learned my addr 172.21.15.18:0/3219908956 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 0x559f3d8a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9d67a640 1 -- 172.21.15.18:0/3219908956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8a4bb0 msgr2=0x559f3d8a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9d67a640 1 -- 172.21.15.18:0/3219908956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 msgr2=0x559f3d8a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 0x559f3d8a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9d67a640 1 -- 172.21.15.18:0/3219908956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f3d5712b0 con 0x559f3d89a2f0 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 0x559f3d8a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a1740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1a94007010 tx=0x7f1a940136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cf0ce35f74ef05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.995+0000 7f1a80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.996+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3219908956 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400de20 con 0x559f3d89a2f0 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.996+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3219908956 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1a9401c3f0 con 0x559f3d89a2f0 2024-09-19T09:52:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.996+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3219908956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a94018070 con 0x559f3d89a2f0 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.996+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3219908956 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a9401c5f0 con 0x559f3d89a2f0 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.996+0000 7f1aa1cb7740 10 client.15384 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.996+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3219908956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559f3d8b3040 con 0x559f3d89a2f0 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.996+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3219908956 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a94018070 con 0x559f3d89a2f0 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.996+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3219908956 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1a9402f960 con 0x559f3d89a2f0 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.996+0000 7f1aa1cb7740 10 client.15384 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.997+0000 7f1aa1cb7740 10 client.15384 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.997+0000 7f1aa1cb7740 20 client.15384 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.997+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x559f3d8b5a70 0x559f3d8b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.997+0000 7f1aa1cb7740 4 client.15384 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.997+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3219908956 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f3d80d600 con 0x559f3d8b5a70 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.997+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x559f3d8b5a70 0x559f3d8b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.997+0000 7f1a80ff9640 10 client.15384 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:52:48.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.997+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x559f3d8b5a70 0x559f3d8b6ee0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=db0f8ae14692fae0 server_cookie=68b35cd18c59bcb3 in_seq=0 out_seq=0 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3219908956 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f3d80d600 con 0x559f3d8b5a70 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1a80ff9640 10 client.15384 handle_command_reply: tid=0 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 client.15384 shutdown 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3219908956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 msgr2=0x559f3d8a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a1740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1a94007010 tx=0x7f1a940136b0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3219908956 shutdown_connections 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x559f3d8b5a70 0x559f3d8b6ee0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d89a2f0 0x559f3d8a1740 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3219908956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 0x559f3d8a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1a80ff9640 0 client.15384 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:52:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3219908956 >> 172.21.15.18:0/3219908956 conn(0x559f3d895f60 msgr2=0x559f3d89bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3219908956 shutdown_connections 2024-09-19T09:52:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3219908956 wait complete. 2024-09-19T09:52:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:47.998+0000 7f1aa1cb7740 20 client.15384 trim_cache size 0 max 16384 2024-09-19T09:52:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1aa1cb7740 1 Processor -- start 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1aa1cb7740 1 -- start start 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8999d0 0x559f3d8b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 0x559f3d8b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f3d8b5220 con 0x559f3d8999d0 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559f3d8b58f0 con 0x559f3d8a4bb0 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559f3d8b5fc0 con 0x559f3d89a2f0 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1a9ce79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8999d0 0x559f3d8b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1a9ce79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8999d0 0x559f3d8b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40988/0 (socket says 172.21.15.18:40988) 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1a9ce79640 1 -- 172.21.15.18:0/3920004899 learned_addr learned my addr 172.21.15.18:0/3920004899 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.016+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/3920004899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 0x559f3d8b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.017+0000 7f1a9ce79640 1 -- 172.21.15.18:0/3920004899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 msgr2=0x559f3d8b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.017+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3920004899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 0x559f3d8b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.017+0000 7f1a9ce79640 1 -- 172.21.15.18:0/3920004899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8a4bb0 msgr2=0x559f3d8a35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.017+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3920004899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.017+0000 7f1a9ce79640 1 -- 172.21.15.18:0/3920004899 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f3d89a120 con 0x559f3d8999d0 2024-09-19T09:52:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.017+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3920004899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8999d0 0x559f3d8b6ee0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x559f3d8b7aa0 tx=0x7f1a88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87caee9998c3dbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.017+0000 7f1a82ffd640 1 -- 172.21.15.18:0/3920004899 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8801b4f0 con 0x559f3d8999d0 2024-09-19T09:52:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.017+0000 7f1a82ffd640 1 -- 172.21.15.18:0/3920004899 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a8801f030 con 0x559f3d8999d0 2024-09-19T09:52:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.017+0000 7f1a82ffd640 1 -- 172.21.15.18:0/3920004899 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88023c70 con 0x559f3d8999d0 2024-09-19T09:52:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3920004899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8999d0 msgr2=0x559f3d8b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3920004899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8999d0 0x559f3d8b6ee0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x559f3d8b7aa0 tx=0x7f1a88004730 comp rx=0 tx=0).stop 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3920004899 shutdown_connections 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3920004899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8a4bb0 0x559f3d8a35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3920004899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 0x559f3d8b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3920004899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8999d0 0x559f3d8b6ee0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3920004899 >> 172.21.15.18:0/3920004899 conn(0x559f3d895f60 msgr2=0x559f3d8a2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3920004899 shutdown_connections 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3920004899 wait complete. 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 -- start start 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.018+0000 7f1aa1cb7740 1 Processor -- start 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 0x559f3d8ba770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 0x559f3d8bacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1aa1cb7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8a4bb0 0x559f3d918140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f3d8b6d60 con 0x559f3d8a4bb0 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559f3d8b6690 con 0x559f3d8999d0 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1aa1cb7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559f3d8b7430 con 0x559f3d89a2f0 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1aa1cb7740 10 client.0 _ll_register_callbacks cb 0x7f1a940076d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9ce79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8a4bb0 0x559f3d918140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9ce79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8a4bb0 0x559f3d918140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40998/0 (socket says 172.21.15.18:40998) 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9ce79640 1 -- 172.21.15.18:0/3538494316 learned_addr learned my addr 172.21.15.18:0/3538494316 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 0x559f3d8bacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 0x559f3d8ba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9d67a640 1 -- 172.21.15.18:0/3538494316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 msgr2=0x559f3d8ba770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 0x559f3d8ba770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9d67a640 1 -- 172.21.15.18:0/3538494316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8a4bb0 msgr2=0x559f3d918140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8a4bb0 0x559f3d918140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9d67a640 1 -- 172.21.15.18:0/3538494316 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f3d918780 con 0x559f3d89a2f0 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8a4bb0 0x559f3d918140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a9d67a640 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 0x559f3d8bacb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a94007850 tx=0x7f1a9402ff90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4cead7b268770eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.019+0000 7f1a80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3538494316 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9401c3f0 con 0x559f3d89a2f0 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3538494316 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a8801f030 con 0x559f3d89a2f0 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3538494316 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1a94013930 con 0x559f3d89a2f0 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3538494316 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a94013b30 con 0x559f3d89a2f0 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1aa1cb7740 10 client.25024 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3538494316 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559f3d91faf0 con 0x559f3d89a2f0 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3538494316 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a8801f030 con 0x559f3d89a2f0 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3538494316 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1a94024bd0 con 0x559f3d89a2f0 2024-09-19T09:52:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1aa1cb7740 10 client.25024 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1aa1cb7740 10 client.25024 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1aa1cb7740 20 client.25024 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x559f3d924640 0x559f3d923350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1aa1cb7740 4 client.25024 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.020+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3538494316 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "status"}) -- 0x559f3d807b10 con 0x559f3d924640 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x559f3d924640 0x559f3d923350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1a80ff9640 10 client.25024 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1a9ce79640 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x559f3d924640 0x559f3d923350 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e5309bc69fc7581b server_cookie=ad10e31fab1d8451 in_seq=0 out_seq=0 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1a80ff9640 1 -- 172.21.15.18:0/3538494316 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559f3d807b10 con 0x559f3d924640 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1a80ff9640 10 client.25024 handle_command_reply: tid=0 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 client.25024 shutdown 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3538494316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 msgr2=0x559f3d8bacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 0x559f3d8bacb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a94007850 tx=0x7f1a9402ff90 comp rx=0 tx=0).stop 2024-09-19T09:52:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3538494316 shutdown_connections 2024-09-19T09:52:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x559f3d924640 0x559f3d923350 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f3d8a4bb0 0x559f3d918140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3d89a2f0 0x559f3d8bacb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 --2- 172.21.15.18:0/3538494316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559f3d8999d0 0x559f3d8ba770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3538494316 >> 172.21.15.18:0/3538494316 conn(0x559f3d895f60 msgr2=0x559f3d8a35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1a80ff9640 0 client.25024 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:52:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3538494316 shutdown_connections 2024-09-19T09:52:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 1 -- 172.21.15.18:0/3538494316 wait complete. 2024-09-19T09:52:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.021+0000 7f1aa1cb7740 20 client.25024 trim_cache size 0 max 16384 2024-09-19T09:52:48.028 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 4, 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 14592, 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 127.689961395, 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 28, 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 151.21908479999999 2024-09-19T09:52:48.029 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 -- 172.21.15.18:0/2093266029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a840a32c0 msgr2=0x7f1a840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a840a32c0 0x7f1a840a5780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a900b97f0 tx=0x7f1a9008d120 comp rx=0 tx=0).stop 2024-09-19T09:52:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 -- 172.21.15.18:0/2093266029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a98106f10 msgr2=0x7f1a9819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a98106f10 0x7f1a9819cd40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1a90031a20 tx=0x7f1a90031a50 comp rx=0 tx=0).stop 2024-09-19T09:52:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 -- 172.21.15.18:0/2093266029 shutdown_connections 2024-09-19T09:52:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1a840a32c0 0x7f1a840a5780 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a98106f10 0x7f1a9819cd40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a98102790 0x7f1a981989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 --2- 172.21.15.18:0/2093266029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a98101de0 0x7f1a98198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 -- 172.21.15.18:0/2093266029 >> 172.21.15.18:0/2093266029 conn(0x7f1a980fd8c0 msgr2=0x7f1a980fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 -- 172.21.15.18:0/2093266029 shutdown_connections 2024-09-19T09:52:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:48.022+0000 7f1a9f8de640 1 -- 172.21.15.18:0/2093266029 wait complete. 2024-09-19T09:52:48.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:48 smithi018 ceph-mon[30956]: pgmap v352: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T09:52:48.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:48 smithi049 ceph-mon[34858]: pgmap v352: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T09:52:48.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:48 smithi162 ceph-mon[35174]: pgmap v352: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T09:52:48.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.e status 2024-09-19T09:52:48.967 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:49.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.387+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/348333153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0b0102570 msgr2=0x7fe0b01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:49.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.387+0000 7fe0b4d6c640 1 --2- 172.21.15.18:0/348333153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0b0102570 0x7fe0b01029b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe098009900 tx=0x7fe09802a480 comp rx=0 tx=0).stop 2024-09-19T09:52:49.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.387+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/348333153 shutdown_connections 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.387+0000 7fe0b4d6c640 1 --2- 172.21.15.18:0/348333153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b0102ef0 0x7fe0b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.387+0000 7fe0b4d6c640 1 --2- 172.21.15.18:0/348333153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0b0102570 0x7fe0b01029b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.387+0000 7fe0b4d6c640 1 --2- 172.21.15.18:0/348333153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b0100e20 0x7fe0b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.387+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/348333153 >> 172.21.15.18:0/348333153 conn(0x7fe0b00fc7d0 msgr2=0x7fe0b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.387+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/348333153 shutdown_connections 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.387+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/348333153 wait complete. 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.388+0000 7fe0b4d6c640 1 Processor -- start 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.388+0000 7fe0b4d6c640 1 -- start start 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.388+0000 7fe0b4d6c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0b0100e20 0x7fe0b0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.388+0000 7fe0b4d6c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b0102570 0x7fe0b0198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.388+0000 7fe0b4d6c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b0102ef0 0x7fe0b019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.388+0000 7fe0b4d6c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0110fa0 con 0x7fe0b0100e20 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.388+0000 7fe0b4d6c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0110e20 con 0x7fe0b0102ef0 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.388+0000 7fe0b4d6c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0111120 con 0x7fe0b0102570 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0ae59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0b0100e20 0x7fe0b0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0ae59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0b0100e20 0x7fe0b0198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41018/0 (socket says 172.21.15.18:41018) 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0ae59c640 1 -- 172.21.15.18:0/3228374243 learned_addr learned my addr 172.21.15.18:0/3228374243 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0add9b640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b0102570 0x7fe0b0198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b0102ef0 0x7fe0b019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0ae59c640 1 -- 172.21.15.18:0/3228374243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b0102570 msgr2=0x7fe0b0198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b0102570 0x7fe0b0198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0ae59c640 1 -- 172.21.15.18:0/3228374243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b0102ef0 msgr2=0x7fe0b019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b0102ef0 0x7fe0b019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0ae59c640 1 -- 172.21.15.18:0/3228374243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b019d4e0 con 0x7fe0b0100e20 2024-09-19T09:52:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0b0100e20 0x7fe0b0198530 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000eab0 tx=0x7fe0a000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0a77fe640 1 -- 172.21.15.18:0/3228374243 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000ce40 con 0x7fe0b0100e20 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0a77fe640 1 -- 172.21.15.18:0/3228374243 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0a0011950 con 0x7fe0b0100e20 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0a77fe640 1 -- 172.21.15.18:0/3228374243 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0010ae0 con 0x7fe0b0100e20 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/3228374243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b019d7d0 con 0x7fe0b0100e20 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.389+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/3228374243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b01a50b0 con 0x7fe0b0100e20 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.392+0000 7fe0a77fe640 1 -- 172.21.15.18:0/3228374243 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe0a0011b00 con 0x7fe0b0100e20 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.392+0000 7fe0b7145740 1 Processor -- start 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.392+0000 7fe0b7145740 1 -- start start 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.392+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a3de0 0x55cca72a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.392+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.392+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72aefc0 0x55cca72b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.392+0000 7fe0b7145740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cca7206090 con 0x55cca72a4700 2024-09-19T09:52:49.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.392+0000 7fe0b7145740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cca71ada70 con 0x55cca72a3de0 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.392+0000 7fe0b7145740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cca7202050 con 0x55cca72aefc0 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.392+0000 7fe0ae59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0ae59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41028/0 (socket says 172.21.15.18:41028) 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0ae59c640 1 -- 172.21.15.18:0/3862795088 learned_addr learned my addr 172.21.15.18:0/3862795088 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/3862795088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a3de0 0x55cca72a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0add9b640 1 --2- 172.21.15.18:0/3862795088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72aefc0 0x55cca72b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0a77fe640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe09c0a3240 0x7fe09c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0ae59c640 1 -- 172.21.15.18:0/3862795088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72aefc0 msgr2=0x55cca72b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/3862795088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72aefc0 0x55cca72b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0ae59c640 1 -- 172.21.15.18:0/3862795088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a3de0 msgr2=0x55cca72a41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/3862795088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a3de0 0x55cca72a41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0ae59c640 1 -- 172.21.15.18:0/3862795088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca71ba130 con 0x55cca72a4700 2024-09-19T09:52:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe09c0a3240 0x7fe09c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0a77fe640 1 -- 172.21.15.18:0/3228374243 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe0a00cffd0 con 0x7fe0b0100e20 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/3862795088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72aea80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00cbfc0 tx=0x7fe0a00c73f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f9bbac2d3b9cca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0a4ff9640 1 -- 172.21.15.18:0/3862795088 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a009c3f0 con 0x55cca72a4700 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0a4ff9640 1 -- 172.21.15.18:0/3862795088 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0a00cad10 con 0x55cca72a4700 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0a4ff9640 1 -- 172.21.15.18:0/3862795088 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00a3f90 con 0x55cca72a4700 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.393+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe09c0a3240 0x7fe09c0a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8006fd0 tx=0x7fe0a80047d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.394+0000 7fe0b7145740 1 -- 172.21.15.18:0/3862795088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 msgr2=0x55cca72aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.394+0000 7fe0b7145740 1 --2- 172.21.15.18:0/3862795088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72aea80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00cbfc0 tx=0x7fe0a00c73f0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.394+0000 7fe0b7145740 1 -- 172.21.15.18:0/3862795088 shutdown_connections 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.394+0000 7fe0b7145740 1 --2- 172.21.15.18:0/3862795088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72aefc0 0x55cca72b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.394+0000 7fe0b7145740 1 --2- 172.21.15.18:0/3862795088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72aea80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.394+0000 7fe0b7145740 1 --2- 172.21.15.18:0/3862795088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a3de0 0x55cca72a41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.394+0000 7fe0b7145740 1 -- 172.21.15.18:0/3862795088 >> 172.21.15.18:0/3862795088 conn(0x55cca72a0370 msgr2=0x55cca72a0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.394+0000 7fe0b7145740 1 -- 172.21.15.18:0/3862795088 shutdown_connections 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.394+0000 7fe0b7145740 1 -- 172.21.15.18:0/3862795088 wait complete. 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0b7145740 1 -- start start 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0b7145740 1 Processor -- start 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 0x55cca72ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a4700 0x55cca72abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0b7145740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cca72b1b90 con 0x55cca72aefc0 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0b7145740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cca71c0f20 con 0x55cca72a4700 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0b7145740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cca72b1d10 con 0x55cca72a3de0 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0b7145740 10 client.0 _ll_register_callbacks cb 0x55cca718a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:49.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0aed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0aed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72ac0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41038/0 (socket says 172.21.15.18:41038) 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0aed9d640 1 -- 172.21.15.18:0/1615754828 learned_addr learned my addr 172.21.15.18:0/1615754828 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0add9b640 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a4700 0x55cca72abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.395+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 0x55cca72ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.396+0000 7fe0aed9d640 1 -- 172.21.15.18:0/1615754828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 msgr2=0x55cca72ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.396+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 0x55cca72ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.396+0000 7fe0aed9d640 1 -- 172.21.15.18:0/1615754828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a4700 msgr2=0x55cca72abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.396+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a4700 0x55cca72abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.396+0000 7fe0aed9d640 1 -- 172.21.15.18:0/1615754828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca6f772b0 con 0x55cca72aefc0 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.396+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72ac0c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800b480 tx=0x7fe0a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea73ffc0a16b31c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.396+0000 7fe095ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.396+0000 7fe095ffb640 1 -- 172.21.15.18:0/1615754828 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8024020 con 0x55cca72aefc0 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe095ffb640 1 -- 172.21.15.18:0/1615754828 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe0a8013740 con 0x55cca72aefc0 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe0b7145740 1 -- 172.21.15.18:0/1615754828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cca7213600 con 0x55cca72aefc0 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe095ffb640 1 -- 172.21.15.18:0/1615754828 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0a8013940 con 0x55cca72aefc0 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe0b7145740 10 client.15402 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe0b7145740 1 -- 172.21.15.18:0/1615754828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cca72bd4e0 con 0x55cca72aefc0 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe095ffb640 1 -- 172.21.15.18:0/1615754828 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55cca7213600 con 0x55cca72aefc0 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe095ffb640 1 -- 172.21.15.18:0/1615754828 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0a8020cc0 con 0x55cca72aefc0 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe0b7145740 10 client.15402 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe0b7145740 10 client.15402 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe0b7145740 20 client.15402 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe0b7145740 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55cca72bfb50 0x55cca72c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe0b7145740 4 client.15402 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.397+0000 7fe0b7145740 1 -- 172.21.15.18:0/1615754828 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cca720db10 con 0x55cca72bfb50 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.398+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55cca72bfb50 0x55cca72c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.398+0000 7fe095ffb640 10 client.15402 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.398+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55cca72bfb50 0x55cca72c0fc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eb4118ad50756c74 server_cookie=9c26f9ae950b254e in_seq=0 out_seq=0 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe095ffb640 1 -- 172.21.15.18:0/1615754828 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cca720db10 con 0x55cca72bfb50 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe095ffb640 10 client.15402 handle_command_reply: tid=0 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 client.15402 shutdown 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 -- 172.21.15.18:0/1615754828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 msgr2=0x55cca72ac0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72ac0c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800b480 tx=0x7fe0a8008040 comp rx=0 tx=0).stop 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 -- 172.21.15.18:0/1615754828 shutdown_connections 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55cca72bfb50 0x55cca72c0fc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72ac0c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a4700 0x55cca72abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 --2- 172.21.15.18:0/1615754828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 0x55cca72ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 -- 172.21.15.18:0/1615754828 >> 172.21.15.18:0/1615754828 conn(0x55cca72a0370 msgr2=0x55cca72a6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:49.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe095ffb640 0 client.15402 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:52:49.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 -- 172.21.15.18:0/1615754828 shutdown_connections 2024-09-19T09:52:49.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 1 -- 172.21.15.18:0/1615754828 wait complete. 2024-09-19T09:52:49.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.399+0000 7fe0b7145740 20 client.15402 trim_cache size 0 max 16384 2024-09-19T09:52:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0b7145740 1 Processor -- start 2024-09-19T09:52:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0b7145740 1 -- start start 2024-09-19T09:52:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a3de0 0x55cca72c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a4700 0x55cca72c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0b7145740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cca72bf300 con 0x55cca72aefc0 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0b7145740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cca72bf9d0 con 0x55cca72a3de0 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0b7145740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cca72c00a0 con 0x55cca72a4700 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0aed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0aed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41042/0 (socket says 172.21.15.18:41042) 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.417+0000 7fe0aed9d640 1 -- 172.21.15.18:0/1906771885 learned_addr learned my addr 172.21.15.18:0/1906771885 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/1906771885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a3de0 0x55cca72c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe0add9b640 1 --2- 172.21.15.18:0/1906771885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a4700 0x55cca72c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe0aed9d640 1 -- 172.21.15.18:0/1906771885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a4700 msgr2=0x55cca72c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/1906771885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a4700 0x55cca72c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe0aed9d640 1 -- 172.21.15.18:0/1906771885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a3de0 msgr2=0x55cca72c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/1906771885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a3de0 0x55cca72c0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe0aed9d640 1 -- 172.21.15.18:0/1906771885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca72ae450 con 0x55cca72aefc0 2024-09-19T09:52:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe0add9b640 1 --2- 172.21.15.18:0/1906771885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a4700 0x55cca72c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/1906771885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72c97e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800b450 tx=0x7fe0a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c685ccefda90f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe097fff640 1 -- 172.21.15.18:0/1906771885 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8024070 con 0x55cca72aefc0 2024-09-19T09:52:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe097fff640 1 -- 172.21.15.18:0/1906771885 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0a802b7c0 con 0x55cca72aefc0 2024-09-19T09:52:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.418+0000 7fe097fff640 1 -- 172.21.15.18:0/1906771885 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8013d40 con 0x55cca72aefc0 2024-09-19T09:52:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 -- 172.21.15.18:0/1906771885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 msgr2=0x55cca72c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 --2- 172.21.15.18:0/1906771885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72c97e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800b450 tx=0x7fe0a8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 -- 172.21.15.18:0/1906771885 shutdown_connections 2024-09-19T09:52:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 --2- 172.21.15.18:0/1906771885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72aefc0 0x55cca72c97e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 --2- 172.21.15.18:0/1906771885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a4700 0x55cca72c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 --2- 172.21.15.18:0/1906771885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72a3de0 0x55cca72c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 -- 172.21.15.18:0/1906771885 >> 172.21.15.18:0/1906771885 conn(0x55cca72a0370 msgr2=0x55cca72aa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 -- 172.21.15.18:0/1906771885 shutdown_connections 2024-09-19T09:52:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 -- 172.21.15.18:0/1906771885 wait complete. 2024-09-19T09:52:49.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 -- start start 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.419+0000 7fe0b7145740 1 Processor -- start 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 0x55cca72c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0b7145740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72aefc0 0x55cca72c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0b7145740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cca72c0e40 con 0x55cca72a4700 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0b7145740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cca72c0770 con 0x55cca72aefc0 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0b7145740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cca72c1510 con 0x55cca72a3de0 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0b7145740 10 client.0 _ll_register_callbacks cb 0x7fe0a800b500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0add9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0add9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41058/0 (socket says 172.21.15.18:41058) 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0add9b640 1 -- 172.21.15.18:0/14270459 learned_addr learned my addr 172.21.15.18:0/14270459 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0aed9d640 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72aefc0 0x55cca72c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 0x55cca72c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0add9b640 1 -- 172.21.15.18:0/14270459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 msgr2=0x55cca72c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0add9b640 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 0x55cca72c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0add9b640 1 -- 172.21.15.18:0/14270459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72aefc0 msgr2=0x55cca72c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0add9b640 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72aefc0 0x55cca72c4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0add9b640 1 -- 172.21.15.18:0/14270459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca7328250 con 0x55cca72a4700 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 0x55cca72c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe0add9b640 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72c4520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe09802a9a0 tx=0x7fe098004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39392ed3cd7ec347 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.420+0000 7fe095ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe095ffb640 1 -- 172.21.15.18:0/14270459 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098035070 con 0x55cca72a4700 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe095ffb640 1 -- 172.21.15.18:0/14270459 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe098003940 con 0x55cca72a4700 2024-09-19T09:52:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe0b7145740 1 -- 172.21.15.18:0/14270459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a802b7c0 con 0x55cca72a4700 2024-09-19T09:52:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe095ffb640 1 -- 172.21.15.18:0/14270459 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe09804c070 con 0x55cca72a4700 2024-09-19T09:52:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe0b7145740 10 client.15408 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe0b7145740 1 -- 172.21.15.18:0/14270459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cca73294d0 con 0x55cca72a4700 2024-09-19T09:52:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe095ffb640 1 -- 172.21.15.18:0/14270459 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0a802b7c0 con 0x55cca72a4700 2024-09-19T09:52:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe095ffb640 1 -- 172.21.15.18:0/14270459 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe098045460 con 0x55cca72a4700 2024-09-19T09:52:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe0b7145740 10 client.15408 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe0b7145740 10 client.15408 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe0b7145740 20 client.15408 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe0b7145740 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55cca732e0e0 0x55cca732cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe0b7145740 4 client.15408 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.421+0000 7fe0b7145740 1 -- 172.21.15.18:0/14270459 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "status"}) -- 0x55cca718a0e0 con 0x55cca732e0e0 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.422+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55cca732e0e0 0x55cca732cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.422+0000 7fe0ae59c640 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55cca732e0e0 0x55cca732cdf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=879522fe8206afaf server_cookie=716464282647281e in_seq=0 out_seq=0 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.422+0000 7fe095ffb640 10 client.15408 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.422+0000 7fe095ffb640 1 -- 172.21.15.18:0/14270459 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55cca718a0e0 con 0x55cca732e0e0 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.422+0000 7fe095ffb640 10 client.15408 handle_command_reply: tid=0 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.422+0000 7fe0b7145740 1 client.15408 shutdown 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.422+0000 7fe0b7145740 1 -- 172.21.15.18:0/14270459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 msgr2=0x55cca72c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.422+0000 7fe0b7145740 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72c4520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe09802a9a0 tx=0x7fe098004580 comp rx=0 tx=0).stop 2024-09-19T09:52:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b7145740 1 -- 172.21.15.18:0/14270459 shutdown_connections 2024-09-19T09:52:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b7145740 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55cca732e0e0 0x55cca732cdf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b7145740 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cca72aefc0 0x55cca72c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b7145740 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca72a4700 0x55cca72c4520 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b7145740 1 --2- 172.21.15.18:0/14270459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cca72a3de0 0x55cca72c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b7145740 1 -- 172.21.15.18:0/14270459 >> 172.21.15.18:0/14270459 conn(0x55cca72a0370 msgr2=0x55cca729a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe095ffb640 0 client.15408 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:52:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b7145740 1 -- 172.21.15.18:0/14270459 shutdown_connections 2024-09-19T09:52:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b7145740 1 -- 172.21.15.18:0/14270459 wait complete. 2024-09-19T09:52:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b7145740 20 client.15408 trim_cache size 0 max 16384 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 3, 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24470, 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 130.01797408900001, 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 28, 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:52:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T09:52:49.433 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 168.69352617800001 2024-09-19T09:52:49.433 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:49.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/3228374243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe09c0a3240 msgr2=0x7fe09c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:49.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe09c0a3240 0x7fe09c0a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8006fd0 tx=0x7fe0a80047d0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/3228374243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0b0100e20 msgr2=0x7fe0b0198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:49.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0b0100e20 0x7fe0b0198530 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000eab0 tx=0x7fe0a000ef70 comp rx=0 tx=0).stop 2024-09-19T09:52:49.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/3228374243 shutdown_connections 2024-09-19T09:52:49.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe09c0a3240 0x7fe09c0a5700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0b0102ef0 0x7fe0b019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0b0102570 0x7fe0b0198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 --2- 172.21.15.18:0/3228374243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0b0100e20 0x7fe0b0198530 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:49.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/3228374243 >> 172.21.15.18:0/3228374243 conn(0x7fe0b00fc7d0 msgr2=0x7fe0b006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:49.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/3228374243 shutdown_connections 2024-09-19T09:52:49.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:49.423+0000 7fe0b4d6c640 1 -- 172.21.15.18:0/3228374243 wait complete. 2024-09-19T09:52:50.097 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:52:50.354 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:50.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:50 smithi018 ceph-mon[30956]: pgmap v353: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:52:50.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:50 smithi049 ceph-mon[34858]: pgmap v353: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:52:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:50 smithi162 ceph-mon[35174]: pgmap v353: 97 pgs: 97 active+clean; 649 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:52:50.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.828+0000 7f16a349f640 1 -- 172.21.15.18:0/3594566286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c102d40 msgr2=0x7f169c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:50.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.828+0000 7f16a349f640 1 --2- 172.21.15.18:0/3594566286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c102d40 0x7f169c103120 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f168c009900 tx=0x7f168c02a480 comp rx=0 tx=0).stop 2024-09-19T09:52:50.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.828+0000 7f16a349f640 1 -- 172.21.15.18:0/3594566286 shutdown_connections 2024-09-19T09:52:50.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.828+0000 7f16a349f640 1 --2- 172.21.15.18:0/3594566286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f169c10c170 0x7f169c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.828+0000 7f16a349f640 1 --2- 172.21.15.18:0/3594566286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f169c103660 0x7f169c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.828+0000 7f16a349f640 1 --2- 172.21.15.18:0/3594566286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c102d40 0x7f169c103120 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.828+0000 7f16a349f640 1 -- 172.21.15.18:0/3594566286 >> 172.21.15.18:0/3594566286 conn(0x7f169c0fc7a0 msgr2=0x7f169c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:50.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.828+0000 7f16a349f640 1 -- 172.21.15.18:0/3594566286 shutdown_connections 2024-09-19T09:52:50.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.828+0000 7f16a349f640 1 -- 172.21.15.18:0/3594566286 wait complete. 2024-09-19T09:52:50.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a349f640 1 Processor -- start 2024-09-19T09:52:50.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a349f640 1 -- start start 2024-09-19T09:52:50.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a349f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f169c102d40 0x7f169c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a349f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103660 0x7f169c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a349f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f169c10c170 0x7f169c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a349f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f169c111f70 con 0x7f169c103660 2024-09-19T09:52:50.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a349f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f169c111df0 con 0x7f169c102d40 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a349f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f169c1120f0 con 0x7f169c10c170 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a0a3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103660 0x7f169c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a0a3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103660 0x7f169c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41066/0 (socket says 172.21.15.18:41066) 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a0a3a640 1 -- 172.21.15.18:0/800529101 learned_addr learned my addr 172.21.15.18:0/800529101 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a123b640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f169c102d40 0x7f169c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.829+0000 7f16a1a3c640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f169c10c170 0x7f169c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f16a0a3a640 1 -- 172.21.15.18:0/800529101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f169c10c170 msgr2=0x7f169c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f169c10c170 0x7f169c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f16a0a3a640 1 -- 172.21.15.18:0/800529101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f169c102d40 msgr2=0x7f169c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f169c102d40 0x7f169c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f16a0a3a640 1 -- 172.21.15.18:0/800529101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c1a6930 con 0x7f169c103660 2024-09-19T09:52:50.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f16a1a3c640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f169c10c170 0x7f169c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:50.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103660 0x7f169c100ee0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f169000c940 tx=0x7f169000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:50.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f169a7fc640 1 -- 172.21.15.18:0/800529101 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690004220 con 0x7f169c103660 2024-09-19T09:52:50.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f169a7fc640 1 -- 172.21.15.18:0/800529101 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16900043c0 con 0x7f169c103660 2024-09-19T09:52:50.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f16a349f640 1 -- 172.21.15.18:0/800529101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169c1a6c20 con 0x7f169c103660 2024-09-19T09:52:50.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f169a7fc640 1 -- 172.21.15.18:0/800529101 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690004a00 con 0x7f169c103660 2024-09-19T09:52:50.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.830+0000 7f16a349f640 1 -- 172.21.15.18:0/800529101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169c1a71b0 con 0x7f169c103660 2024-09-19T09:52:50.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.832+0000 7f169a7fc640 1 -- 172.21.15.18:0/800529101 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f16900079b0 con 0x7f169c103660 2024-09-19T09:52:50.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a5878740 1 Processor -- start 2024-09-19T09:52:50.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a5878740 1 -- start start 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a5878740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 0x559d3ee79db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a5878740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee84670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a5878740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee84bb0 0x559d3ee86fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a5878740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d3ede0090 con 0x559d3ee7a2f0 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a5878740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559d3ed87a70 con 0x559d3ee84bb0 2024-09-19T09:52:50.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a5878740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d3eddc050 con 0x559d3ee799d0 2024-09-19T09:52:50.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f169a7fc640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f16840a32c0 0x7f16840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a123b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee84670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a123b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee84670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41074/0 (socket says 172.21.15.18:41074) 2024-09-19T09:52:50.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a123b640 1 -- 172.21.15.18:0/1175322844 learned_addr learned my addr 172.21.15.18:0/1175322844 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:50.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a1a3c640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f16840a32c0 0x7f16840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f169a7fc640 1 -- 172.21.15.18:0/800529101 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f16900cf810 con 0x7f169c103660 2024-09-19T09:52:50.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.833+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/1175322844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee84bb0 0x559d3ee86fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16a1a3c640 1 --2- 172.21.15.18:0/1175322844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 0x559d3ee79db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16a123b640 1 -- 172.21.15.18:0/1175322844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 msgr2=0x559d3ee79db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:50.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16a123b640 1 --2- 172.21.15.18:0/1175322844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 0x559d3ee79db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16a123b640 1 -- 172.21.15.18:0/1175322844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee84bb0 msgr2=0x559d3ee86fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:50.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16a123b640 1 --2- 172.21.15.18:0/1175322844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee84bb0 0x559d3ee86fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16a123b640 1 -- 172.21.15.18:0/1175322844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d3ed94130 con 0x559d3ee7a2f0 2024-09-19T09:52:50.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16a1a3c640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f16840a32c0 0x7f16840a5780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1694013ab0 tx=0x7f169400ac90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:50.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16a123b640 1 --2- 172.21.15.18:0/1175322844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee84670 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f168c009900 tx=0x7f168c0316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492bd6b9958e4fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:50.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16837fe640 1 -- 172.21.15.18:0/1175322844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c040070 con 0x559d3ee7a2f0 2024-09-19T09:52:50.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16837fe640 1 -- 172.21.15.18:0/1175322844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f168c005020 con 0x559d3ee7a2f0 2024-09-19T09:52:50.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.834+0000 7f16837fe640 1 -- 172.21.15.18:0/1175322844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c035040 con 0x559d3ee7a2f0 2024-09-19T09:52:50.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.835+0000 7f16a5878740 1 -- 172.21.15.18:0/1175322844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 msgr2=0x559d3ee84670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:50.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.835+0000 7f16a5878740 1 --2- 172.21.15.18:0/1175322844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee84670 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f168c009900 tx=0x7f168c0316e0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.835+0000 7f16a5878740 1 -- 172.21.15.18:0/1175322844 shutdown_connections 2024-09-19T09:52:50.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.835+0000 7f16a5878740 1 --2- 172.21.15.18:0/1175322844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee84bb0 0x559d3ee86fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.835+0000 7f16a5878740 1 --2- 172.21.15.18:0/1175322844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee84670 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.835+0000 7f16a5878740 1 --2- 172.21.15.18:0/1175322844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 0x559d3ee79db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.835+0000 7f16a5878740 1 -- 172.21.15.18:0/1175322844 >> 172.21.15.18:0/1175322844 conn(0x559d3ee75f60 msgr2=0x559d3ee76340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:50.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.835+0000 7f16a5878740 1 -- 172.21.15.18:0/1175322844 shutdown_connections 2024-09-19T09:52:50.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.835+0000 7f16a5878740 1 -- 172.21.15.18:0/1175322844 wait complete. 2024-09-19T09:52:50.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a5878740 1 -- start start 2024-09-19T09:52:50.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a5878740 1 Processor -- start 2024-09-19T09:52:50.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a5878740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee799d0 0x559d3ee84320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a5878740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee81670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a5878740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee84bb0 0x559d3ee81bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a5878740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d3ee87780 con 0x559d3ee7a2f0 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a5878740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559d3ed9af20 con 0x559d3ee799d0 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a5878740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d3ee87900 con 0x559d3ee84bb0 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a5878740 10 client.0 _ll_register_callbacks cb 0x559d3ed64030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a0a3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee81670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a0a3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee81670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41076/0 (socket says 172.21.15.18:41076) 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a0a3a640 1 -- 172.21.15.18:0/3533315545 learned_addr learned my addr 172.21.15.18:0/3533315545 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.836+0000 7f16a123b640 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee799d0 0x559d3ee84320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f16a1a3c640 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee84bb0 0x559d3ee81bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f16a0a3a640 1 -- 172.21.15.18:0/3533315545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee84bb0 msgr2=0x559d3ee81bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee84bb0 0x559d3ee81bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f16a0a3a640 1 -- 172.21.15.18:0/3533315545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee799d0 msgr2=0x559d3ee84320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee799d0 0x559d3ee84320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f16a0a3a640 1 -- 172.21.15.18:0/3533315545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d3eb512b0 con 0x559d3ee7a2f0 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee81670 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1690004770 tx=0x7f169009ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00ec9657558f037 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f1680ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f1680ff9640 1 -- 172.21.15.18:0/3533315545 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169001d040 con 0x559d3ee7a2f0 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f1680ff9640 1 -- 172.21.15.18:0/3533315545 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f16900a4640 con 0x559d3ee7a2f0 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f16a5878740 1 -- 172.21.15.18:0/3533315545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f168c005020 con 0x559d3ee7a2f0 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f1680ff9640 1 -- 172.21.15.18:0/3533315545 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f169009be60 con 0x559d3ee7a2f0 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f16a5878740 10 client.15420 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f16a5878740 1 -- 172.21.15.18:0/3533315545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d3ee92ff0 con 0x559d3ee7a2f0 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.837+0000 7f1680ff9640 1 -- 172.21.15.18:0/3533315545 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f168c005020 con 0x559d3ee7a2f0 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.838+0000 7f1680ff9640 1 -- 172.21.15.18:0/3533315545 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f169009ad20 con 0x559d3ee7a2f0 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.838+0000 7f16a5878740 10 client.15420 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.838+0000 7f16a5878740 10 client.15420 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.838+0000 7f16a5878740 20 client.15420 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.838+0000 7f16a5878740 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559d3ee955a0 0x559d3ee96a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.838+0000 7f16a5878740 4 client.15420 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.838+0000 7f16a5878740 1 -- 172.21.15.18:0/3533315545 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d3eded600 con 0x559d3ee955a0 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.838+0000 7f16a123b640 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559d3ee955a0 0x559d3ee96a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f16a123b640 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559d3ee955a0 0x559d3ee96a10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5985ef916a5016fc server_cookie=29b81851c3a96a26 in_seq=0 out_seq=0 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f1680ff9640 10 client.15420 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:52:50.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f1680ff9640 1 -- 172.21.15.18:0/3533315545 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d3eded600 con 0x559d3ee955a0 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f1680ff9640 10 client.15420 handle_command_reply: tid=0 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f16a5878740 1 client.15420 shutdown 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f16a5878740 1 -- 172.21.15.18:0/3533315545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 msgr2=0x559d3ee81670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f16a5878740 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee81670 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1690004770 tx=0x7f169009ba60 comp rx=0 tx=0).stop 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f16a5878740 1 -- 172.21.15.18:0/3533315545 shutdown_connections 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f16a5878740 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559d3ee955a0 0x559d3ee96a10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f16a5878740 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee84bb0 0x559d3ee81bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f16a5878740 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee81670 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f16a5878740 1 --2- 172.21.15.18:0/3533315545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee799d0 0x559d3ee84320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.839+0000 7f16a5878740 1 -- 172.21.15.18:0/3533315545 >> 172.21.15.18:0/3533315545 conn(0x559d3ee75f60 msgr2=0x559d3ee7bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.840+0000 7f1680ff9640 0 client.15420 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:52:50.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.840+0000 7f16a5878740 1 -- 172.21.15.18:0/3533315545 shutdown_connections 2024-09-19T09:52:50.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.840+0000 7f16a5878740 1 -- 172.21.15.18:0/3533315545 wait complete. 2024-09-19T09:52:50.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.840+0000 7f16a5878740 20 client.15420 trim_cache size 0 max 16384 2024-09-19T09:52:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.857+0000 7f16a5878740 1 Processor -- start 2024-09-19T09:52:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.857+0000 7f16a5878740 1 -- start start 2024-09-19T09:52:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a5878740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 0x559d3ee94ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a5878740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee96a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a5878740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee84bb0 0x559d3ee70d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a5878740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d3ee94d50 con 0x559d3ee7a2f0 2024-09-19T09:52:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a5878740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559d3ee95420 con 0x559d3ee84bb0 2024-09-19T09:52:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a5878740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d3ee95af0 con 0x559d3ee799d0 2024-09-19T09:52:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a0a3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee96a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a0a3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee96a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41086/0 (socket says 172.21.15.18:41086) 2024-09-19T09:52:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a0a3a640 1 -- 172.21.15.18:0/1137368457 learned_addr learned my addr 172.21.15.18:0/1137368457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a123b640 1 --2- 172.21.15.18:0/1137368457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 0x559d3ee94ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a0a3a640 1 -- 172.21.15.18:0/1137368457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 msgr2=0x559d3ee94ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a1a3c640 1 --2- 172.21.15.18:0/1137368457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee84bb0 0x559d3ee70d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/1137368457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 0x559d3ee94ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a0a3a640 1 -- 172.21.15.18:0/1137368457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee84bb0 msgr2=0x559d3ee70d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/1137368457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee84bb0 0x559d3ee70d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a0a3a640 1 -- 172.21.15.18:0/1137368457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d3ee7a120 con 0x559d3ee7a2f0 2024-09-19T09:52:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a123b640 1 --2- 172.21.15.18:0/1137368457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 0x559d3ee94ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/1137368457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee96a10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f169009a110 tx=0x7f169009a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42490a3689891cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f1682ffd640 1 -- 172.21.15.18:0/1137368457 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169001d040 con 0x559d3ee7a2f0 2024-09-19T09:52:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.858+0000 7f1682ffd640 1 -- 172.21.15.18:0/1137368457 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16900a4ad0 con 0x559d3ee7a2f0 2024-09-19T09:52:50.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f1682ffd640 1 -- 172.21.15.18:0/1137368457 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169009b510 con 0x559d3ee7a2f0 2024-09-19T09:52:50.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f16a5878740 1 -- 172.21.15.18:0/1137368457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 msgr2=0x559d3ee96a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:50.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f16a5878740 1 --2- 172.21.15.18:0/1137368457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee96a10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f169009a110 tx=0x7f169009a370 comp rx=0 tx=0).stop 2024-09-19T09:52:50.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f16a5878740 1 -- 172.21.15.18:0/1137368457 shutdown_connections 2024-09-19T09:52:50.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f16a5878740 1 --2- 172.21.15.18:0/1137368457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee84bb0 0x559d3ee70d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f16a5878740 1 --2- 172.21.15.18:0/1137368457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee96a10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f16a5878740 1 --2- 172.21.15.18:0/1137368457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee799d0 0x559d3ee94ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f16a5878740 1 -- 172.21.15.18:0/1137368457 >> 172.21.15.18:0/1137368457 conn(0x559d3ee75f60 msgr2=0x559d3ee76340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f16a5878740 1 -- 172.21.15.18:0/1137368457 shutdown_connections 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f16a5878740 1 -- 172.21.15.18:0/1137368457 wait complete. 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.859+0000 7f16a5878740 1 -- start start 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a5878740 1 Processor -- start 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a5878740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee799d0 0x559d3ee99e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a5878740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee9a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a5878740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee84bb0 0x559d3eefdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a5878740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d3ee96890 con 0x559d3ee7a2f0 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a5878740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559d3ee961c0 con 0x559d3ee799d0 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a5878740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d3ee96f60 con 0x559d3ee84bb0 2024-09-19T09:52:50.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a5878740 10 client.0 _ll_register_callbacks cb 0x7f16900bc050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a0a3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee9a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a0a3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee9a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41098/0 (socket says 172.21.15.18:41098) 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a0a3a640 1 -- 172.21.15.18:0/482571688 learned_addr learned my addr 172.21.15.18:0/482571688 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a1a3c640 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee84bb0 0x559d3eefdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a123b640 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee799d0 0x559d3ee99e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a0a3a640 1 -- 172.21.15.18:0/482571688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee84bb0 msgr2=0x559d3eefdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee84bb0 0x559d3eefdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a0a3a640 1 -- 172.21.15.18:0/482571688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee799d0 msgr2=0x559d3ee99e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.860+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee799d0 0x559d3ee99e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a0a3a640 1 -- 172.21.15.18:0/482571688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d3ee9abf0 con 0x559d3ee7a2f0 2024-09-19T09:52:50.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a0a3a640 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee9a340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f16900cd6b0 tx=0x7f16900a0330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ccf89a1e77f395 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f1680ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f1680ff9640 1 -- 172.21.15.18:0/482571688 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169001d040 con 0x559d3ee7a2f0 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f1680ff9640 1 -- 172.21.15.18:0/482571688 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1690097bb0 con 0x559d3ee7a2f0 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a5878740 1 -- 172.21.15.18:0/482571688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16900a4ad0 con 0x559d3ee7a2f0 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f1680ff9640 1 -- 172.21.15.18:0/482571688 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1690098100 con 0x559d3ee7a2f0 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a5878740 10 client.15426 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a5878740 1 -- 172.21.15.18:0/482571688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d3ee9abf0 con 0x559d3ee7a2f0 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f1680ff9640 1 -- 172.21.15.18:0/482571688 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16900a4ad0 con 0x559d3ee7a2f0 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f1680ff9640 1 -- 172.21.15.18:0/482571688 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f16900a13a0 con 0x559d3ee7a2f0 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a5878740 10 client.15426 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a5878740 10 client.15426 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:52:50.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a5878740 20 client.15426 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:50.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a5878740 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559d3ef03630 0x559d3ef02340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:50.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a5878740 4 client.15426 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:52:50.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.861+0000 7f16a5878740 1 -- 172.21.15.18:0/482571688 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "status"}) -- 0x559d3ede7b10 con 0x559d3ef03630 2024-09-19T09:52:50.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.862+0000 7f16a123b640 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559d3ef03630 0x559d3ef02340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:50.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.862+0000 7f16a123b640 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559d3ef03630 0x559d3ef02340 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f594980f86c7b105 server_cookie=f0e3d492b7a63313 in_seq=0 out_seq=0 2024-09-19T09:52:50.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.862+0000 7f1680ff9640 10 client.15426 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:52:50.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.862+0000 7f1680ff9640 1 -- 172.21.15.18:0/482571688 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559d3ede7b10 con 0x559d3ef03630 2024-09-19T09:52:50.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.862+0000 7f1680ff9640 10 client.15426 handle_command_reply: tid=0 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.862+0000 7f16a5878740 1 client.15426 shutdown 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 1 -- 172.21.15.18:0/482571688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 msgr2=0x559d3ee9a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee9a340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f16900cd6b0 tx=0x7f16900a0330 comp rx=0 tx=0).stop 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 1 -- 172.21.15.18:0/482571688 shutdown_connections 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559d3ef03630 0x559d3ef02340 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d3ee84bb0 0x559d3eefdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d3ee7a2f0 0x559d3ee9a340 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 1 --2- 172.21.15.18:0/482571688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d3ee799d0 0x559d3ee99e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 1 -- 172.21.15.18:0/482571688 >> 172.21.15.18:0/482571688 conn(0x559d3ee75f60 msgr2=0x559d3ee70d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f1680ff9640 0 client.15426 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:52:50.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 1 -- 172.21.15.18:0/482571688 shutdown_connections 2024-09-19T09:52:50.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 1 -- 172.21.15.18:0/482571688 wait complete. 2024-09-19T09:52:50.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.863+0000 7f16a5878740 20 client.15426 trim_cache size 0 max 16384 2024-09-19T09:52:50.872 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:52:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 2, 2024-09-19T09:52:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24484, 2024-09-19T09:52:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:52:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:52:50.872 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:52:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 132.46057284099999, 2024-09-19T09:52:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 28, 2024-09-19T09:52:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:52:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T09:52:50.873 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 159.89183269899999 2024-09-19T09:52:50.873 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 -- 172.21.15.18:0/800529101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f16840a32c0 msgr2=0x7f16840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f16840a32c0 0x7f16840a5780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1694013ab0 tx=0x7f169400ac90 comp rx=0 tx=0).stop 2024-09-19T09:52:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 -- 172.21.15.18:0/800529101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103660 msgr2=0x7f169c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103660 0x7f169c100ee0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f169000c940 tx=0x7f169000ce00 comp rx=0 tx=0).stop 2024-09-19T09:52:50.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 -- 172.21.15.18:0/800529101 shutdown_connections 2024-09-19T09:52:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f16840a32c0 0x7f16840a5780 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f169c10c170 0x7f169c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c103660 0x7f169c100ee0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 --2- 172.21.15.18:0/800529101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f169c102d40 0x7f169c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 -- 172.21.15.18:0/800529101 >> 172.21.15.18:0/800529101 conn(0x7f169c0fc7a0 msgr2=0x7f169c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 -- 172.21.15.18:0/800529101 shutdown_connections 2024-09-19T09:52:50.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:50.864+0000 7f16a349f640 1 -- 172.21.15.18:0/800529101 wait complete. 2024-09-19T09:52:51.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:52:51.747 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:52.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.203+0000 7f1e301c3640 1 -- 172.21.15.18:0/1967769835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e28103ff0 msgr2=0x7f1e281043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.203+0000 7f1e301c3640 1 --2- 172.21.15.18:0/1967769835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e28103ff0 0x7f1e281043d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009900 tx=0x7f1e2402a410 comp rx=0 tx=0).stop 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.203+0000 7f1e301c3640 1 -- 172.21.15.18:0/1967769835 shutdown_connections 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.203+0000 7f1e301c3640 1 --2- 172.21.15.18:0/1967769835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e28109120 0x7f1e28110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.203+0000 7f1e301c3640 1 --2- 172.21.15.18:0/1967769835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e281049a0 0x7f1e281089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.203+0000 7f1e301c3640 1 --2- 172.21.15.18:0/1967769835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e28103ff0 0x7f1e281043d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.203+0000 7f1e301c3640 1 -- 172.21.15.18:0/1967769835 >> 172.21.15.18:0/1967769835 conn(0x7f1e280ffa90 msgr2=0x7f1e28101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.203+0000 7f1e301c3640 1 -- 172.21.15.18:0/1967769835 shutdown_connections 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.203+0000 7f1e301c3640 1 -- 172.21.15.18:0/1967769835 wait complete. 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e301c3640 1 Processor -- start 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e301c3640 1 -- start start 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e301c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e301c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e281049a0 0x7f1e2819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e301c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e28109120 0x7f1e2819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e301c3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281141c0 con 0x7f1e28103ff0 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e301c3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28114040 con 0x7f1e28109120 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e301c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28114340 con 0x7f1e281049a0 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2df5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2df5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41108/0 (socket says 172.21.15.18:41108) 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2df5f640 1 -- 172.21.15.18:0/4110340407 learned_addr learned my addr 172.21.15.18:0/4110340407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2d75e640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e281049a0 0x7f1e2819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2e760640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e28109120 0x7f1e2819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2df5f640 1 -- 172.21.15.18:0/4110340407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e281049a0 msgr2=0x7f1e2819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e281049a0 0x7f1e2819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2df5f640 1 -- 172.21.15.18:0/4110340407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e28109120 msgr2=0x7f1e2819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e28109120 0x7f1e2819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2df5f640 1 -- 172.21.15.18:0/4110340407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2819f650 con 0x7f1e28103ff0 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.204+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a6a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1e24006010 tx=0x7f1e240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.205+0000 7f1e1effd640 1 -- 172.21.15.18:0/4110340407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2403f030 con 0x7f1e28103ff0 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.205+0000 7f1e1effd640 1 -- 172.21.15.18:0/4110340407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e24003ce0 con 0x7f1e28103ff0 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.205+0000 7f1e1effd640 1 -- 172.21.15.18:0/4110340407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24035070 con 0x7f1e28103ff0 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.205+0000 7f1e301c3640 1 -- 172.21.15.18:0/4110340407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2819f8e0 con 0x7f1e28103ff0 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.205+0000 7f1e301c3640 1 -- 172.21.15.18:0/4110340407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e281a7220 con 0x7f1e28103ff0 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.207+0000 7f1e1effd640 1 -- 172.21.15.18:0/4110340407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1e24042030 con 0x7f1e28103ff0 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.207+0000 7f1e3259c740 1 Processor -- start 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e3259c740 1 -- start start 2024-09-19T09:52:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0defa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e3259c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56316c038090 con 0x56316c0dcbb0 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e3259c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56316bfdfa70 con 0x56316c0d22f0 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e3259c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56316c034050 con 0x56316c0d19d0 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2d75e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0defa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2d75e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0defa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41122/0 (socket says 172.21.15.18:41122) 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2d75e640 1 -- 172.21.15.18:0/2150740159 learned_addr learned my addr 172.21.15.18:0/2150740159 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e1effd640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e140a3240 0x7f1e140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2e760640 1 --2- 172.21.15.18:0/2150740159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/2150740159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2e760640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e140a3240 0x7f1e140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2d75e640 1 -- 172.21.15.18:0/2150740159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 msgr2=0x56316c0d1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2d75e640 1 --2- 172.21.15.18:0/2150740159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0d1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2d75e640 1 -- 172.21.15.18:0/2150740159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 msgr2=0x56316c0dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2d75e640 1 --2- 172.21.15.18:0/2150740159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0dc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.208+0000 7f1e2d75e640 1 -- 172.21.15.18:0/2150740159 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316bfec130 con 0x56316c0dcbb0 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.209+0000 7f1e1effd640 1 -- 172.21.15.18:0/4110340407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1e240f00b0 con 0x7f1e28103ff0 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.209+0000 7f1e2d75e640 1 --2- 172.21.15.18:0/2150740159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0defa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800bc90 tx=0x7f1e1800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7963cbf528395a3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.209+0000 7f1e2e760640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e140a3240 0x7f1e140a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1e200070b0 tx=0x7f1e200093d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.209+0000 7f1e13fff640 1 -- 172.21.15.18:0/2150740159 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18015070 con 0x56316c0dcbb0 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.209+0000 7f1e13fff640 1 -- 172.21.15.18:0/2150740159 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e1801a940 con 0x56316c0dcbb0 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.209+0000 7f1e13fff640 1 -- 172.21.15.18:0/2150740159 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180118c0 con 0x56316c0dcbb0 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 -- 172.21.15.18:0/2150740159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 msgr2=0x56316c0defa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 --2- 172.21.15.18:0/2150740159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0defa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800bc90 tx=0x7f1e1800f730 comp rx=0 tx=0).stop 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 -- 172.21.15.18:0/2150740159 shutdown_connections 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 --2- 172.21.15.18:0/2150740159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0defa0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 --2- 172.21.15.18:0/2150740159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0dc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 --2- 172.21.15.18:0/2150740159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0d1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 -- 172.21.15.18:0/2150740159 >> 172.21.15.18:0/2150740159 conn(0x56316c0cdf60 msgr2=0x56316c0ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 -- 172.21.15.18:0/2150740159 shutdown_connections 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 -- 172.21.15.18:0/2150740159 wait complete. 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 -- start start 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.210+0000 7f1e3259c740 1 Processor -- start 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0dc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d22f0 0x56316c0d9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0dcbb0 0x56316c0d9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e3259c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56316c0df780 con 0x56316c0d22f0 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e3259c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56316bff2f20 con 0x56316c0dcbb0 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e3259c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56316c0df900 con 0x56316c0d19d0 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e3259c740 10 client.0 _ll_register_callbacks cb 0x56316bfbc030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2d75e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d22f0 0x56316c0d9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2d75e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d22f0 0x56316c0d9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41130/0 (socket says 172.21.15.18:41130) 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2d75e640 1 -- 172.21.15.18:0/1954920983 learned_addr learned my addr 172.21.15.18:0/1954920983 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0dc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2e760640 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0dcbb0 0x56316c0d9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2d75e640 1 -- 172.21.15.18:0/1954920983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 msgr2=0x56316c0dc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2d75e640 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0dc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2d75e640 1 -- 172.21.15.18:0/1954920983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0dcbb0 msgr2=0x56316c0d9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2d75e640 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0dcbb0 0x56316c0d9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2d75e640 1 -- 172.21.15.18:0/1954920983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56316bda92b0 con 0x56316c0d22f0 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e2d75e640 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d22f0 0x56316c0d9790 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1e18006010 tx=0x7f1e1800b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768a8d272a49c5c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e117fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.211+0000 7f1e117fa640 1 -- 172.21.15.18:0/1954920983 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18028060 con 0x56316c0d22f0 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e117fa640 1 -- 172.21.15.18:0/1954920983 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1e1801aaf0 con 0x56316c0d22f0 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e3259c740 1 -- 172.21.15.18:0/1954920983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e1801a940 con 0x56316c0d22f0 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e117fa640 1 -- 172.21.15.18:0/1954920983 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e18015070 con 0x56316c0d22f0 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e3259c740 10 client.15438 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e3259c740 1 -- 172.21.15.18:0/1954920983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56316c0eb090 con 0x56316c0d22f0 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e117fa640 1 -- 172.21.15.18:0/1954920983 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e1801a940 con 0x56316c0d22f0 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e117fa640 1 -- 172.21.15.18:0/1954920983 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1e18004a20 con 0x56316c0d22f0 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e3259c740 10 client.15438 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e3259c740 10 client.15438 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:52:52.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e3259c740 20 client.15438 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:52.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e3259c740 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x56316c0ed350 0x56316c0ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e3259c740 4 client.15438 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:52.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.212+0000 7f1e3259c740 1 -- 172.21.15.18:0/1954920983 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56316c045600 con 0x56316c0ed350 2024-09-19T09:52:52.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.213+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x56316c0ed350 0x56316c0ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.213+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x56316c0ed350 0x56316c0ee7c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b0322f629ce052e server_cookie=ff88a969cc360ee4 in_seq=0 out_seq=0 2024-09-19T09:52:52.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.213+0000 7f1e117fa640 10 client.15438 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:52:52.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e117fa640 1 -- 172.21.15.18:0/1954920983 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56316c045600 con 0x56316c0ed350 2024-09-19T09:52:52.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e117fa640 10 client.15438 handle_command_reply: tid=0 2024-09-19T09:52:52.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 client.15438 shutdown 2024-09-19T09:52:52.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 -- 172.21.15.18:0/1954920983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d22f0 msgr2=0x56316c0d9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d22f0 0x56316c0d9790 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1e18006010 tx=0x7f1e1800b9d0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 -- 172.21.15.18:0/1954920983 shutdown_connections 2024-09-19T09:52:52.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x56316c0ed350 0x56316c0ee7c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0dcbb0 0x56316c0d9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d22f0 0x56316c0d9790 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e117fa640 0 client.15438 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:52:52.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 --2- 172.21.15.18:0/1954920983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0dc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 -- 172.21.15.18:0/1954920983 >> 172.21.15.18:0/1954920983 conn(0x56316c0cdf60 msgr2=0x56316c0d3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:52.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 -- 172.21.15.18:0/1954920983 shutdown_connections 2024-09-19T09:52:52.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 1 -- 172.21.15.18:0/1954920983 wait complete. 2024-09-19T09:52:52.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.214+0000 7f1e3259c740 20 client.15438 trim_cache size 0 max 16384 2024-09-19T09:52:52.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e3259c740 1 Processor -- start 2024-09-19T09:52:52.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e3259c740 1 -- start start 2024-09-19T09:52:52.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d19d0 0x56316c0d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0d6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0dcbb0 0x56316c0daee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e3259c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56316c0ecb00 con 0x56316c0d19d0 2024-09-19T09:52:52.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e3259c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56316c0ed1d0 con 0x56316c0d22f0 2024-09-19T09:52:52.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e3259c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56316c0ed8a0 con 0x56316c0dcbb0 2024-09-19T09:52:52.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e2df5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d19d0 0x56316c0d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e2df5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d19d0 0x56316c0d6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41140/0 (socket says 172.21.15.18:41140) 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.232+0000 7f1e2df5f640 1 -- 172.21.15.18:0/3460782898 learned_addr learned my addr 172.21.15.18:0/3460782898 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e2d75e640 1 --2- 172.21.15.18:0/3460782898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0d6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e2e760640 1 --2- 172.21.15.18:0/3460782898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0dcbb0 0x56316c0daee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e2df5f640 1 -- 172.21.15.18:0/3460782898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0dcbb0 msgr2=0x56316c0daee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/3460782898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0dcbb0 0x56316c0daee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e2df5f640 1 -- 172.21.15.18:0/3460782898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 msgr2=0x56316c0d6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/3460782898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0d6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e2df5f640 1 -- 172.21.15.18:0/3460782898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316c0da550 con 0x56316c0d19d0 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e2d75e640 1 --2- 172.21.15.18:0/3460782898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0d6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/3460782898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d19d0 0x56316c0d6a10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1e240bc6f0 tx=0x7f1e2408f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f00a2946961aff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:52.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e137fe640 1 -- 172.21.15.18:0/3460782898 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24049040 con 0x56316c0d19d0 2024-09-19T09:52:52.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e137fe640 1 -- 172.21.15.18:0/3460782898 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e2409be50 con 0x56316c0d19d0 2024-09-19T09:52:52.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.233+0000 7f1e137fe640 1 -- 172.21.15.18:0/3460782898 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e240bc760 con 0x56316c0d19d0 2024-09-19T09:52:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 -- 172.21.15.18:0/3460782898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d19d0 msgr2=0x56316c0d6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 --2- 172.21.15.18:0/3460782898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d19d0 0x56316c0d6a10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1e240bc6f0 tx=0x7f1e2408f6a0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 -- 172.21.15.18:0/3460782898 shutdown_connections 2024-09-19T09:52:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 --2- 172.21.15.18:0/3460782898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0dcbb0 0x56316c0daee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 --2- 172.21.15.18:0/3460782898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0d6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 --2- 172.21.15.18:0/3460782898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0d19d0 0x56316c0d6a10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 -- 172.21.15.18:0/3460782898 >> 172.21.15.18:0/3460782898 conn(0x56316c0cdf60 msgr2=0x56316c0d8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 -- 172.21.15.18:0/3460782898 shutdown_connections 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 -- 172.21.15.18:0/3460782898 wait complete. 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 -- start start 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.234+0000 7f1e3259c740 1 Processor -- start 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0f2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e3259c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0f2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e3259c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56316c0ee640 con 0x56316c0dcbb0 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e3259c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56316c0edf70 con 0x56316c0d22f0 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e3259c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56316c0eed10 con 0x56316c0d19d0 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e3259c740 10 client.0 _ll_register_callbacks cb 0x7f1e20009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2e760640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2e760640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41156/0 (socket says 172.21.15.18:41156) 2024-09-19T09:52:52.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2e760640 1 -- 172.21.15.18:0/336551234 learned_addr learned my addr 172.21.15.18:0/336551234 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2d75e640 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2e760640 1 -- 172.21.15.18:0/336551234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 msgr2=0x56316c0f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2e760640 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2e760640 1 -- 172.21.15.18:0/336551234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 msgr2=0x56316c0f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2e760640 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2e760640 1 -- 172.21.15.18:0/336551234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56316c0f2ca0 con 0x56316c0dcbb0 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e2e760640 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0f2760 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009d70 tx=0x7f1e20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17597f4f8c04d515 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e117fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.235+0000 7f1e117fa640 1 -- 172.21.15.18:0/336551234 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2002a060 con 0x56316c0dcbb0 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e117fa640 1 -- 172.21.15.18:0/336551234 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1e20019c40 con 0x56316c0dcbb0 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e3259c740 1 -- 172.21.15.18:0/336551234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e2409be50 con 0x56316c0dcbb0 2024-09-19T09:52:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e117fa640 1 -- 172.21.15.18:0/336551234 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e20013040 con 0x56316c0dcbb0 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e3259c740 10 client.15444 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e3259c740 1 -- 172.21.15.18:0/336551234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56316c1577d0 con 0x56316c0dcbb0 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e117fa640 1 -- 172.21.15.18:0/336551234 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e2409be50 con 0x56316c0dcbb0 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e117fa640 1 -- 172.21.15.18:0/336551234 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1e200303b0 con 0x56316c0dcbb0 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e3259c740 10 client.15444 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e3259c740 10 client.15444 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e3259c740 20 client.15444 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e3259c740 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x56316c15c3e0 0x56316c15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e3259c740 4 client.15444 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e3259c740 1 -- 172.21.15.18:0/336551234 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "status"}) -- 0x56316c03fb10 con 0x56316c15c3e0 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.236+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x56316c15c3e0 0x56316c15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e2df5f640 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x56316c15c3e0 0x56316c15b0f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36bdfbb98abb6b92 server_cookie=1c78370abeeae909 in_seq=0 out_seq=0 2024-09-19T09:52:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e117fa640 10 client.15444 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e117fa640 1 -- 172.21.15.18:0/336551234 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56316c03fb10 con 0x56316c15c3e0 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e117fa640 10 client.15444 handle_command_reply: tid=0 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 client.15444 shutdown 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 -- 172.21.15.18:0/336551234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 msgr2=0x56316c0f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0f2760 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009d70 tx=0x7f1e20004a40 comp rx=0 tx=0).stop 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 -- 172.21.15.18:0/336551234 shutdown_connections 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x56316c15c3e0 0x56316c15b0f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56316c0dcbb0 0x56316c0f2760 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56316c0d22f0 0x56316c0f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e117fa640 0 client.15444 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 --2- 172.21.15.18:0/336551234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56316c0d19d0 0x56316c0f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 -- 172.21.15.18:0/336551234 >> 172.21.15.18:0/336551234 conn(0x56316c0cdf60 msgr2=0x56316c0cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 -- 172.21.15.18:0/336551234 shutdown_connections 2024-09-19T09:52:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.237+0000 7f1e3259c740 1 -- 172.21.15.18:0/336551234 wait complete. 2024-09-19T09:52:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e3259c740 20 client.15444 trim_cache size 0 max 16384 2024-09-19T09:52:52.245 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:52.245 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:52:52.245 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 1, 2024-09-19T09:52:52.245 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24488, 2024-09-19T09:52:52.245 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:52:52.245 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:52:52.245 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:52:52.245 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 134.849516811, 2024-09-19T09:52:52.246 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 28, 2024-09-19T09:52:52.246 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:52:52.246 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T09:52:52.246 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 163.68805785500001 2024-09-19T09:52:52.246 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:52.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 -- 172.21.15.18:0/4110340407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e140a3240 msgr2=0x7f1e140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e140a3240 0x7f1e140a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1e200070b0 tx=0x7f1e200093d0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 -- 172.21.15.18:0/4110340407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e28103ff0 msgr2=0x7f1e2819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a6a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1e24006010 tx=0x7f1e240042f0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 -- 172.21.15.18:0/4110340407 shutdown_connections 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e140a3240 0x7f1e140a5700 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e28109120 0x7f1e2819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e281049a0 0x7f1e2819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 --2- 172.21.15.18:0/4110340407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a6a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 -- 172.21.15.18:0/4110340407 >> 172.21.15.18:0/4110340407 conn(0x7f1e280ffa90 msgr2=0x7f1e28100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 -- 172.21.15.18:0/4110340407 shutdown_connections 2024-09-19T09:52:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:52.238+0000 7f1e301c3640 1 -- 172.21.15.18:0/4110340407 wait complete. 2024-09-19T09:52:52.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:52 smithi018 ceph-mon[30956]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-09-19T09:52:52.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:52 smithi049 ceph-mon[34858]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-09-19T09:52:52.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:52 smithi162 ceph-mon[35174]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-09-19T09:52:52.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:52:53.107 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:52:53.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.584+0000 7f5a8b3af640 1 -- 172.21.15.18:0/3767362865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a84101280 msgr2=0x7f5a8410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.584+0000 7f5a8b3af640 1 --2- 172.21.15.18:0/3767362865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a84101280 0x7f5a8410df40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009900 tx=0x7f5a7402a410 comp rx=0 tx=0).stop 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.584+0000 7f5a8b3af640 1 -- 172.21.15.18:0/3767362865 shutdown_connections 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.584+0000 7f5a8b3af640 1 --2- 172.21.15.18:0/3767362865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a8410e480 0x7f5a84110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.584+0000 7f5a8b3af640 1 --2- 172.21.15.18:0/3767362865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a84101280 0x7f5a8410df40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.584+0000 7f5a8b3af640 1 --2- 172.21.15.18:0/3767362865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a841008d0 0x7f5a84100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.584+0000 7f5a8b3af640 1 -- 172.21.15.18:0/3767362865 >> 172.21.15.18:0/3767362865 conn(0x7f5a840fc7a0 msgr2=0x7f5a840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.585+0000 7f5a8b3af640 1 -- 172.21.15.18:0/3767362865 shutdown_connections 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.585+0000 7f5a8b3af640 1 -- 172.21.15.18:0/3767362865 wait complete. 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.585+0000 7f5a8b3af640 1 Processor -- start 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.585+0000 7f5a8b3af640 1 -- start start 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8b3af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a841008d0 0x7f5a8419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8b3af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a84101280 0x7f5a8419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8b3af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a8410e480 0x7f5a8419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8b3af640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a84114190 con 0x7f5a841008d0 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8b3af640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5a84114010 con 0x7f5a8410e480 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8b3af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a84114310 con 0x7f5a84101280 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8914b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a841008d0 0x7f5a8419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8914b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a841008d0 0x7f5a8419a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41162/0 (socket says 172.21.15.18:41162) 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8914b640 1 -- 172.21.15.18:0/214423319 learned_addr learned my addr 172.21.15.18:0/214423319 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8894a640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a84101280 0x7f5a8419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8914b640 1 -- 172.21.15.18:0/214423319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a84101280 msgr2=0x7f5a8419ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8914b640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a84101280 0x7f5a8419ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8914b640 1 -- 172.21.15.18:0/214423319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a8410e480 msgr2=0x7f5a8419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8914b640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a8410e480 0x7f5a8419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8914b640 1 -- 172.21.15.18:0/214423319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8419f6e0 con 0x7f5a841008d0 2024-09-19T09:52:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8914b640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a841008d0 0x7f5a8419a730 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000d950 tx=0x7f5a8000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a7a7fc640 1 -- 172.21.15.18:0/214423319 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80017070 con 0x7f5a841008d0 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a7a7fc640 1 -- 172.21.15.18:0/214423319 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a80009c30 con 0x7f5a841008d0 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a8b3af640 1 -- 172.21.15.18:0/214423319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8419f9d0 con 0x7f5a841008d0 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.586+0000 7f5a7a7fc640 1 -- 172.21.15.18:0/214423319 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8000f6b0 con 0x7f5a841008d0 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.587+0000 7f5a8b3af640 1 -- 172.21.15.18:0/214423319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a841a72b0 con 0x7f5a841008d0 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.589+0000 7f5a7a7fc640 1 -- 172.21.15.18:0/214423319 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5a800109d0 con 0x7f5a841008d0 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.589+0000 7f5a8d788740 1 Processor -- start 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.589+0000 7f5a8d788740 1 -- start start 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.589+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 0x55fffb6a2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a32f0 0x55fffb6ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 0x55fffb6affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8d788740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fffb609090 con 0x55fffb6a32f0 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8d788740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fffb5b0a70 con 0x55fffb6adbb0 2024-09-19T09:52:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8d788740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fffb605050 con 0x55fffb6a29d0 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8914b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a32f0 0x55fffb6ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8914b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a32f0 0x55fffb6ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41174/0 (socket says 172.21.15.18:41174) 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8914b640 1 -- 172.21.15.18:0/3966826321 learned_addr learned my addr 172.21.15.18:0/3966826321 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8994c640 1 --2- 172.21.15.18:0/3966826321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 0x55fffb6a2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8894a640 1 --2- 172.21.15.18:0/3966826321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 0x55fffb6affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a7a7fc640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a700a32c0 0x7f5a700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8994c640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a700a32c0 0x7f5a700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a7a7fc640 1 -- 172.21.15.18:0/214423319 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5a800cf580 con 0x7f5a841008d0 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8914b640 1 -- 172.21.15.18:0/3966826321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 msgr2=0x55fffb6a2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8914b640 1 --2- 172.21.15.18:0/3966826321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 0x55fffb6a2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8914b640 1 -- 172.21.15.18:0/3966826321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 msgr2=0x55fffb6affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8914b640 1 --2- 172.21.15.18:0/3966826321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 0x55fffb6affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8914b640 1 -- 172.21.15.18:0/3966826321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fffb5bd130 con 0x55fffb6a32f0 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8894a640 1 --2- 172.21.15.18:0/3966826321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 0x55fffb6affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.590+0000 7f5a8914b640 1 --2- 172.21.15.18:0/3966826321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a32f0 0x55fffb6ad670 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5a80098030 tx=0x7f5a80097fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e4ff1c6abf1904 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.591+0000 7f5a6f7fe640 1 -- 172.21.15.18:0/3966826321 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80020030 con 0x55fffb6a32f0 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.591+0000 7f5a8994c640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a700a32c0 0x7f5a700a5780 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00afd0 tx=0x7f5a7c005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.591+0000 7f5a6f7fe640 1 -- 172.21.15.18:0/3966826321 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a80009de0 con 0x55fffb6a32f0 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.591+0000 7f5a6f7fe640 1 -- 172.21.15.18:0/3966826321 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80098240 con 0x55fffb6a32f0 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.591+0000 7f5a8d788740 1 -- 172.21.15.18:0/3966826321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a32f0 msgr2=0x55fffb6ad670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.591+0000 7f5a8d788740 1 --2- 172.21.15.18:0/3966826321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a32f0 0x55fffb6ad670 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5a80098030 tx=0x7f5a80097fa0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.591+0000 7f5a8d788740 1 -- 172.21.15.18:0/3966826321 shutdown_connections 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.591+0000 7f5a8d788740 1 --2- 172.21.15.18:0/3966826321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 0x55fffb6affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.591+0000 7f5a8d788740 1 --2- 172.21.15.18:0/3966826321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a32f0 0x55fffb6ad670 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 --2- 172.21.15.18:0/3966826321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 0x55fffb6a2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 -- 172.21.15.18:0/3966826321 >> 172.21.15.18:0/3966826321 conn(0x55fffb69ef60 msgr2=0x55fffb69f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 -- 172.21.15.18:0/3966826321 shutdown_connections 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 -- 172.21.15.18:0/3966826321 wait complete. 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 -- start start 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 Processor -- start 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 0x55fffb6ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a32f0 0x55fffb6aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fffb6b0780 con 0x55fffb6adbb0 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fffb5c3f20 con 0x55fffb6a32f0 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fffb6b0900 con 0x55fffb6a29d0 2024-09-19T09:52:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8d788740 10 client.0 _ll_register_callbacks cb 0x55fffb58d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.592+0000 7f5a8994c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8994c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41186/0 (socket says 172.21.15.18:41186) 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8994c640 1 -- 172.21.15.18:0/2799630270 learned_addr learned my addr 172.21.15.18:0/2799630270 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8894a640 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a32f0 0x55fffb6aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8914b640 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 0x55fffb6ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8994c640 1 -- 172.21.15.18:0/2799630270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 msgr2=0x55fffb6ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8994c640 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 0x55fffb6ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8994c640 1 -- 172.21.15.18:0/2799630270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a32f0 msgr2=0x55fffb6aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8994c640 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a32f0 0x55fffb6aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8994c640 1 -- 172.21.15.18:0/2799630270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fffb37a2b0 con 0x55fffb6adbb0 2024-09-19T09:52:53.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8914b640 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 0x55fffb6ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:53.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8994c640 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0137d0 tx=0x7f5a7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a035ac5bc6cf22a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:53.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a6cff9640 1 -- 172.21.15.18:0/2799630270 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c024060 con 0x55fffb6adbb0 2024-09-19T09:52:53.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a6cff9640 1 -- 172.21.15.18:0/2799630270 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5a7c00db80 con 0x55fffb6adbb0 2024-09-19T09:52:53.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8d788740 1 -- 172.21.15.18:0/2799630270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a80009de0 con 0x55fffb6adbb0 2024-09-19T09:52:53.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a6cff9640 1 -- 172.21.15.18:0/2799630270 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a7c00dd80 con 0x55fffb6adbb0 2024-09-19T09:52:53.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8d788740 10 client.15456 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.593+0000 7f5a8d788740 1 -- 172.21.15.18:0/2799630270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fffb6bc0c0 con 0x55fffb6adbb0 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.594+0000 7f5a6cff9640 1 -- 172.21.15.18:0/2799630270 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a80009de0 con 0x55fffb6adbb0 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.594+0000 7f5a6cff9640 1 -- 172.21.15.18:0/2799630270 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5a7c00f040 con 0x55fffb6adbb0 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.594+0000 7f5a8d788740 10 client.15456 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.594+0000 7f5a8d788740 10 client.15456 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.594+0000 7f5a8d788740 20 client.15456 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.594+0000 7f5a8d788740 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fffb6be700 0x55fffb6bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.594+0000 7f5a8d788740 4 client.15456 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.594+0000 7f5a8d788740 1 -- 172.21.15.18:0/2799630270 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fffb616600 con 0x55fffb6be700 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.594+0000 7f5a8914b640 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fffb6be700 0x55fffb6bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.595+0000 7f5a6cff9640 10 client.15456 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.595+0000 7f5a8914b640 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fffb6be700 0x55fffb6bfb70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89c8be998d91fdbf server_cookie=27542a1befe12bbc in_seq=0 out_seq=0 2024-09-19T09:52:53.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.595+0000 7f5a6cff9640 1 -- 172.21.15.18:0/2799630270 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fffb616600 con 0x55fffb6be700 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.595+0000 7f5a6cff9640 10 client.15456 handle_command_reply: tid=0 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.595+0000 7f5a8d788740 1 client.15456 shutdown 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 1 -- 172.21.15.18:0/2799630270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 msgr2=0x55fffb6aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0137d0 tx=0x7f5a7c004a40 comp rx=0 tx=0).stop 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 1 -- 172.21.15.18:0/2799630270 shutdown_connections 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fffb6be700 0x55fffb6bfb70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a32f0 0x55fffb6aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 1 --2- 172.21.15.18:0/2799630270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a29d0 0x55fffb6ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 1 -- 172.21.15.18:0/2799630270 >> 172.21.15.18:0/2799630270 conn(0x55fffb69ef60 msgr2=0x55fffb6a4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a6cff9640 0 client.15456 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 1 -- 172.21.15.18:0/2799630270 shutdown_connections 2024-09-19T09:52:53.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 1 -- 172.21.15.18:0/2799630270 wait complete. 2024-09-19T09:52:53.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.596+0000 7f5a8d788740 20 client.15456 trim_cache size 0 max 16384 2024-09-19T09:52:53.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8d788740 1 Processor -- start 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8d788740 1 -- start start 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a29d0 0x55fffb6be700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 0x55fffb6aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8d788740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fffb6bdeb0 con 0x55fffb6a29d0 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8d788740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fffb6be580 con 0x55fffb6adbb0 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8d788740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fffb6bec50 con 0x55fffb6a32f0 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8914b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a29d0 0x55fffb6be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8914b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a29d0 0x55fffb6be700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41202/0 (socket says 172.21.15.18:41202) 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8914b640 1 -- 172.21.15.18:0/4130688890 learned_addr learned my addr 172.21.15.18:0/4130688890 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8894a640 1 --2- 172.21.15.18:0/4130688890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 0x55fffb6aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8994c640 1 --2- 172.21.15.18:0/4130688890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8914b640 1 -- 172.21.15.18:0/4130688890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 msgr2=0x55fffb6aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8914b640 1 --2- 172.21.15.18:0/4130688890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 0x55fffb6aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8914b640 1 -- 172.21.15.18:0/4130688890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 msgr2=0x55fffb6aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8914b640 1 --2- 172.21.15.18:0/4130688890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.614+0000 7f5a8914b640 1 -- 172.21.15.18:0/4130688890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fffb6ad720 con 0x55fffb6a29d0 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.615+0000 7f5a8994c640 1 --2- 172.21.15.18:0/4130688890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.615+0000 7f5a8914b640 1 --2- 172.21.15.18:0/4130688890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a29d0 0x55fffb6be700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5a800cd420 tx=0x7f5a8000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ffe73dad510100 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.615+0000 7f5a6effd640 1 -- 172.21.15.18:0/4130688890 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80020040 con 0x55fffb6a29d0 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.615+0000 7f5a6effd640 1 -- 172.21.15.18:0/4130688890 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a800a4840 con 0x55fffb6a29d0 2024-09-19T09:52:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.615+0000 7f5a6effd640 1 -- 172.21.15.18:0/4130688890 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a800cf0d0 con 0x55fffb6a29d0 2024-09-19T09:52:53.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.615+0000 7f5a8d788740 1 -- 172.21.15.18:0/4130688890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a29d0 msgr2=0x55fffb6be700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.615+0000 7f5a8d788740 1 --2- 172.21.15.18:0/4130688890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a29d0 0x55fffb6be700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5a800cd420 tx=0x7f5a8000bf60 comp rx=0 tx=0).stop 2024-09-19T09:52:53.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 -- 172.21.15.18:0/4130688890 shutdown_connections 2024-09-19T09:52:53.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 --2- 172.21.15.18:0/4130688890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6adbb0 0x55fffb6aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 --2- 172.21.15.18:0/4130688890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 0x55fffb6aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 --2- 172.21.15.18:0/4130688890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6a29d0 0x55fffb6be700 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 -- 172.21.15.18:0/4130688890 >> 172.21.15.18:0/4130688890 conn(0x55fffb69ef60 msgr2=0x55fffb6a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 -- 172.21.15.18:0/4130688890 shutdown_connections 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 -- 172.21.15.18:0/4130688890 wait complete. 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 -- start start 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 Processor -- start 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a29d0 0x55fffb6c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 0x55fffb6c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6c1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fffb6bf9f0 con 0x55fffb6adbb0 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fffb6bf320 con 0x55fffb6a29d0 2024-09-19T09:52:53.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fffb6c00c0 con 0x55fffb6a32f0 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.616+0000 7f5a8d788740 10 client.0 _ll_register_callbacks cb 0x7f5a7c016040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8994c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8994c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6c1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41216/0 (socket says 172.21.15.18:41216) 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8994c640 1 -- 172.21.15.18:0/605191683 learned_addr learned my addr 172.21.15.18:0/605191683 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8894a640 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 0x55fffb6c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8914b640 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a29d0 0x55fffb6c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8994c640 1 -- 172.21.15.18:0/605191683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 msgr2=0x55fffb6c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8994c640 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 0x55fffb6c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8994c640 1 -- 172.21.15.18:0/605191683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a29d0 msgr2=0x55fffb6c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8994c640 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a29d0 0x55fffb6c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8994c640 1 -- 172.21.15.18:0/605191683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fffb6c1750 con 0x55fffb6adbb0 2024-09-19T09:52:53.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8894a640 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 0x55fffb6c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8914b640 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a29d0 0x55fffb6c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8994c640 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6c1010 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c01e5a0 tx=0x7f5a7c00a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252ca1e095c0ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a6cff9640 1 -- 172.21.15.18:0/605191683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c02f040 con 0x55fffb6adbb0 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a8d788740 1 -- 172.21.15.18:0/605191683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a800a4840 con 0x55fffb6adbb0 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a6cff9640 1 -- 172.21.15.18:0/605191683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5a7c00d9d0 con 0x55fffb6adbb0 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.617+0000 7f5a6cff9640 1 -- 172.21.15.18:0/605191683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a7c00dbd0 con 0x55fffb6adbb0 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a8d788740 10 client.15462 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a8d788740 1 -- 172.21.15.18:0/605191683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fffb727c90 con 0x55fffb6adbb0 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a6cff9640 1 -- 172.21.15.18:0/605191683 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a800a4840 con 0x55fffb6adbb0 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a6cff9640 1 -- 172.21.15.18:0/605191683 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5a7c03b030 con 0x55fffb6adbb0 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a8d788740 10 client.15462 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a8d788740 10 client.15462 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a8d788740 20 client.15462 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a8d788740 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fffb72c8b0 0x55fffb72b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a8d788740 4 client.15462 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a8d788740 1 -- 172.21.15.18:0/605191683 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "status"}) -- 0x55fffb610b10 con 0x55fffb72c8b0 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.618+0000 7f5a8914b640 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fffb72c8b0 0x55fffb72b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8914b640 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fffb72c8b0 0x55fffb72b5c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5285c1d84d0800a server_cookie=bb15bd95344f1acf in_seq=0 out_seq=0 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a6cff9640 10 client.15462 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a6cff9640 1 -- 172.21.15.18:0/605191683 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fffb610b10 con 0x55fffb72c8b0 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a6cff9640 10 client.15462 handle_command_reply: tid=0 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 client.15462 shutdown 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 -- 172.21.15.18:0/605191683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 msgr2=0x55fffb6c1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6c1010 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c01e5a0 tx=0x7f5a7c00a8a0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 -- 172.21.15.18:0/605191683 shutdown_connections 2024-09-19T09:52:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fffb72c8b0 0x55fffb72b5c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fffb6adbb0 0x55fffb6c1010 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fffb6a32f0 0x55fffb6c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 --2- 172.21.15.18:0/605191683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fffb6a29d0 0x55fffb6c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 -- 172.21.15.18:0/605191683 >> 172.21.15.18:0/605191683 conn(0x55fffb69ef60 msgr2=0x55fffb6a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a6cff9640 0 client.15462 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 -- 172.21.15.18:0/605191683 shutdown_connections 2024-09-19T09:52:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.619+0000 7f5a8d788740 1 -- 172.21.15.18:0/605191683 wait complete. 2024-09-19T09:52:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8d788740 20 client.15462 trim_cache size 0 max 16384 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "5b174660-766b-11ef-bceb-c7b262605968", 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24524, 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 143.26609617599999, 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 28, 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 84, 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 153.898488087 2024-09-19T09:52:53.628 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:52:53.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 -- 172.21.15.18:0/214423319 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a700a32c0 msgr2=0x7f5a700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a700a32c0 0x7f5a700a5780 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00afd0 tx=0x7f5a7c005bf0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 -- 172.21.15.18:0/214423319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a841008d0 msgr2=0x7f5a8419a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a841008d0 0x7f5a8419a730 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000d950 tx=0x7f5a8000de10 comp rx=0 tx=0).stop 2024-09-19T09:52:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 -- 172.21.15.18:0/214423319 shutdown_connections 2024-09-19T09:52:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a700a32c0 0x7f5a700a5780 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a8410e480 0x7f5a8419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a84101280 0x7f5a8419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 --2- 172.21.15.18:0/214423319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a841008d0 0x7f5a8419a730 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 -- 172.21.15.18:0/214423319 >> 172.21.15.18:0/214423319 conn(0x7f5a840fc7a0 msgr2=0x7f5a840feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 -- 172.21.15.18:0/214423319 shutdown_connections 2024-09-19T09:52:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:52:53.620+0000 7f5a8b3af640 1 -- 172.21.15.18:0/214423319 wait complete. 2024-09-19T09:52:54.356 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T09:52:54.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:54 smithi018 ceph-mon[30956]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-09-19T09:52:54.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:54 smithi049 ceph-mon[34858]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-09-19T09:52:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:54 smithi162 ceph-mon[35174]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-09-19T09:52:56.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:56 smithi018 ceph-mon[30956]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-19T09:52:56.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:56 smithi049 ceph-mon[34858]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-19T09:52:56.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:56 smithi162 ceph-mon[35174]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-19T09:52:57.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:57 smithi018 ceph-mon[30956]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-09-19T09:52:57.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:57 smithi049 ceph-mon[34858]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-09-19T09:52:57.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:57 smithi162 ceph-mon[35174]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-09-19T09:52:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.717+0000 7f33fd8a5640 1 -- 172.21.15.18:0/225220799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33f8107840 msgr2=0x7f33f8109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:59.721 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.717+0000 7f33fd8a5640 1 --2- 172.21.15.18:0/225220799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33f8107840 0x7f33f8109cb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009ca0 tx=0x7f33f002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.717+0000 7f33fd8a5640 1 -- 172.21.15.18:0/225220799 shutdown_connections 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.717+0000 7f33fd8a5640 1 --2- 172.21.15.18:0/225220799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33f8107840 0x7f33f8109cb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.717+0000 7f33fd8a5640 1 --2- 172.21.15.18:0/225220799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8104f10 0x7f33f8107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.717+0000 7f33fd8a5640 1 --2- 172.21.15.18:0/225220799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33f81025e0 0x7f33f81049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.717+0000 7f33fd8a5640 1 -- 172.21.15.18:0/225220799 >> 172.21.15.18:0/225220799 conn(0x7f33f80fc1e0 msgr2=0x7f33f80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.717+0000 7f33fd8a5640 1 -- 172.21.15.18:0/225220799 shutdown_connections 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.717+0000 7f33fd8a5640 1 -- 172.21.15.18:0/225220799 wait complete. 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33fd8a5640 1 Processor -- start 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33fd8a5640 1 -- start start 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33fd8a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33f81025e0 0x7f33f8101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33fd8a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33f8104f10 0x7f33f8100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33fd8a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8107840 0x7f33f8100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33fd8a5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33f810d800 con 0x7f33f8104f10 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33fd8a5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f33f810d680 con 0x7f33f81025e0 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33fd8a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33f810d980 con 0x7f33f8107840 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33f67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33f8104f10 0x7f33f8100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33f67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33f8104f10 0x7f33f8100590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45440/0 (socket says 172.21.15.18:45440) 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33f67fc640 1 -- 172.21.15.18:0/1321542566 learned_addr learned my addr 172.21.15.18:0/1321542566 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.718+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33f81025e0 0x7f33f8101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33f77fe640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8107840 0x7f33f8100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33f67fc640 1 -- 172.21.15.18:0/1321542566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8107840 msgr2=0x7f33f8100ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33f67fc640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8107840 0x7f33f8100ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33f67fc640 1 -- 172.21.15.18:0/1321542566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33f81025e0 msgr2=0x7f33f8101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33f67fc640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33f81025e0 0x7f33f8101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33f67fc640 1 -- 172.21.15.18:0/1321542566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f8101360 con 0x7f33f8104f10 2024-09-19T09:52:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33f77fe640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8107840 0x7f33f8100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33f67fc640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33f8104f10 0x7f33f8100590 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f33ec005fd0 tx=0x7f33ec00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33fc8a3640 1 -- 172.21.15.18:0/1321542566 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec017070 con 0x7f33f8104f10 2024-09-19T09:52:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33fc8a3640 1 -- 172.21.15.18:0/1321542566 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ec009c30 con 0x7f33f8104f10 2024-09-19T09:52:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33fd8a5640 1 -- 172.21.15.18:0/1321542566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f81a1ef0 con 0x7f33f8104f10 2024-09-19T09:52:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33fc8a3640 1 -- 172.21.15.18:0/1321542566 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec010460 con 0x7f33f8104f10 2024-09-19T09:52:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.719+0000 7f33fd8a5640 1 -- 172.21.15.18:0/1321542566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f81a2350 con 0x7f33f8104f10 2024-09-19T09:52:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.721+0000 7f33fc8a3640 1 -- 172.21.15.18:0/1321542566 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f33ec003e70 con 0x7f33f8104f10 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.722+0000 7f33fc8a3640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33e00a32f0 0x7f33e00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.722+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33e00a32f0 0x7f33e00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.722+0000 7f33fc8a3640 1 -- 172.21.15.18:0/1321542566 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f33ec0cf550 con 0x7f33f8104f10 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f3400643740 1 Processor -- start 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f3400643740 1 -- start start 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f3400643740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794da9a0 0x55e6794dada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f3400643740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 0x55e6794dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f3400643740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794e2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f3400643740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e67943e2f0 con 0x55e6794e0370 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f3400643740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e6793e6270 con 0x55e6794db2e0 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f3400643740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e67943a2b0 con 0x55e6794da9a0 2024-09-19T09:52:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33e00a32f0 0x7f33e00a57b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009bd0 tx=0x7f33e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794e2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794e2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45452/0 (socket says 172.21.15.18:45452) 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f77fe640 1 -- 172.21.15.18:0/645627012 learned_addr learned my addr 172.21.15.18:0/645627012 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/645627012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794da9a0 0x55e6794dada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f67fc640 1 --2- 172.21.15.18:0/645627012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 0x55e6794dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f77fe640 1 -- 172.21.15.18:0/645627012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794da9a0 msgr2=0x55e6794dada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f77fe640 1 --2- 172.21.15.18:0/645627012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794da9a0 0x55e6794dada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f77fe640 1 -- 172.21.15.18:0/645627012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 msgr2=0x55e6794dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f77fe640 1 --2- 172.21.15.18:0/645627012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 0x55e6794dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f77fe640 1 -- 172.21.15.18:0/645627012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6793e5340 con 0x55e6794e0370 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.723+0000 7f33f67fc640 1 --2- 172.21.15.18:0/645627012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 0x55e6794dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.724+0000 7f33f77fe640 1 --2- 172.21.15.18:0/645627012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794e2830 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f33f0005cc0 tx=0x7f33f0005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d71e271aa01715 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.724+0000 7f33ddffb640 1 -- 172.21.15.18:0/645627012 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0031450 con 0x55e6794e0370 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.724+0000 7f33ddffb640 1 -- 172.21.15.18:0/645627012 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33f0036070 con 0x55e6794e0370 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.724+0000 7f33ddffb640 1 -- 172.21.15.18:0/645627012 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0004460 con 0x55e6794e0370 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.724+0000 7f3400643740 1 -- 172.21.15.18:0/645627012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 msgr2=0x55e6794e2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.724+0000 7f3400643740 1 --2- 172.21.15.18:0/645627012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794e2830 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f33f0005cc0 tx=0x7f33f0005f70 comp rx=0 tx=0).stop 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 -- 172.21.15.18:0/645627012 shutdown_connections 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 --2- 172.21.15.18:0/645627012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794e2830 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 --2- 172.21.15.18:0/645627012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 0x55e6794dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 --2- 172.21.15.18:0/645627012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794da9a0 0x55e6794dada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 -- 172.21.15.18:0/645627012 >> 172.21.15.18:0/645627012 conn(0x55e6794d6010 msgr2=0x55e6794d6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 -- 172.21.15.18:0/645627012 shutdown_connections 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 -- 172.21.15.18:0/645627012 wait complete. 2024-09-19T09:52:59.732 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 -- start start 2024-09-19T09:52:59.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 Processor -- start 2024-09-19T09:52:59.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 0x55e6794e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794db2e0 0x55e6794e5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794ec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e6794e32e0 con 0x55e6794e0370 2024-09-19T09:52:59.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e6793c7290 con 0x55e6794da9a0 2024-09-19T09:52:59.733 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e6794e3460 con 0x55e6794db2e0 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.725+0000 7f3400643740 10 client.0 _ll_register_callbacks cb 0x55e6793f8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794ec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794ec0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45456/0 (socket says 172.21.15.18:45456) 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f77fe640 1 -- 172.21.15.18:0/3954810352 learned_addr learned my addr 172.21.15.18:0/3954810352 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f67fc640 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794db2e0 0x55e6794e5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 0x55e6794e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f77fe640 1 -- 172.21.15.18:0/3954810352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794db2e0 msgr2=0x55e6794e5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f77fe640 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794db2e0 0x55e6794e5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f77fe640 1 -- 172.21.15.18:0/3954810352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 msgr2=0x55e6794e4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f77fe640 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 0x55e6794e4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f77fe640 1 -- 172.21.15.18:0/3954810352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e679151210 con 0x55e6794e0370 2024-09-19T09:52:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 0x55e6794e4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33f77fe640 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794ec0b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f33f002a900 tx=0x7f33f0032db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b637ed8f4ac6588 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33d6ffd640 1 -- 172.21.15.18:0/3954810352 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0031660 con 0x55e6794e0370 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33d6ffd640 1 -- 172.21.15.18:0/3954810352 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f33f0003970 con 0x55e6794e0370 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f3400643740 1 -- 172.21.15.18:0/3954810352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33f0036070 con 0x55e6794e0370 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f33d6ffd640 1 -- 172.21.15.18:0/3954810352 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f33f0003b70 con 0x55e6794e0370 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f3400643740 10 client.15474 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.726+0000 7f3400643740 1 -- 172.21.15.18:0/3954810352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e67921d620 con 0x55e6794e0370 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.727+0000 7f33d6ffd640 1 -- 172.21.15.18:0/3954810352 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33f0036070 con 0x55e6794e0370 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.727+0000 7f33d6ffd640 1 -- 172.21.15.18:0/3954810352 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f33f002f870 con 0x55e6794e0370 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.727+0000 7f3400643740 10 client.15474 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.727+0000 7f3400643740 10 client.15474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:52:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.727+0000 7f3400643740 20 client.15474 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.727+0000 7f3400643740 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e6794f0320 0x55e6794f2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.727+0000 7f3400643740 4 client.15474 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:52:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.727+0000 7f3400643740 1 -- 172.21.15.18:0/3954810352 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e67944ba20 con 0x55e6794f0320 2024-09-19T09:52:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.727+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e6794f0320 0x55e6794f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.728+0000 7f33d6ffd640 10 client.15474 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.728+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e6794f0320 0x55e6794f2710 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4118a34decb12645 server_cookie=bfa0b9b1237e5390 in_seq=0 out_seq=0 2024-09-19T09:52:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f33d6ffd640 1 -- 172.21.15.18:0/3954810352 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e67944ba20 con 0x55e6794f0320 2024-09-19T09:52:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f33d6ffd640 10 client.15474 handle_command_reply: tid=0 2024-09-19T09:52:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 client.15474 shutdown 2024-09-19T09:52:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 -- 172.21.15.18:0/3954810352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 msgr2=0x55e6794ec0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794ec0b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f33f002a900 tx=0x7f33f0032db0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 -- 172.21.15.18:0/3954810352 shutdown_connections 2024-09-19T09:52:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e6794f0320 0x55e6794f2710 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794ec0b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794db2e0 0x55e6794e5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f33d6ffd640 0 client.15474 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 --2- 172.21.15.18:0/3954810352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 0x55e6794e4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 -- 172.21.15.18:0/3954810352 >> 172.21.15.18:0/3954810352 conn(0x55e6794d6010 msgr2=0x55e6794d7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 -- 172.21.15.18:0/3954810352 shutdown_connections 2024-09-19T09:52:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 1 -- 172.21.15.18:0/3954810352 wait complete. 2024-09-19T09:52:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.729+0000 7f3400643740 20 client.15474 trim_cache size 0 max 16384 2024-09-19T09:52:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.743+0000 7f3400643740 1 Processor -- start 2024-09-19T09:52:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.743+0000 7f3400643740 1 -- start start 2024-09-19T09:52:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.743+0000 7f3400643740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 0x55e6794dad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.743+0000 7f3400643740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794db2e0 0x55e6794ebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f3400643740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794e0370 0x55e6794d50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f3400643740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33f81ab110 con 0x55e6794db2e0 2024-09-19T09:52:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f3400643740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f33f81acc50 con 0x55e6794da9a0 2024-09-19T09:52:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f3400643740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33f81ab7e0 con 0x55e6794e0370 2024-09-19T09:52:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794db2e0 0x55e6794ebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794db2e0 0x55e6794ebfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45462/0 (socket says 172.21.15.18:45462) 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f67fc640 1 -- 172.21.15.18:0/429094567 learned_addr learned my addr 172.21.15.18:0/429094567 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/429094567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 0x55e6794dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f77fe640 1 --2- 172.21.15.18:0/429094567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794e0370 0x55e6794d50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f67fc640 1 -- 172.21.15.18:0/429094567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794e0370 msgr2=0x55e6794d50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f67fc640 1 --2- 172.21.15.18:0/429094567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794e0370 0x55e6794d50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f67fc640 1 -- 172.21.15.18:0/429094567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 msgr2=0x55e6794dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f67fc640 1 --2- 172.21.15.18:0/429094567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 0x55e6794dad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f67fc640 1 -- 172.21.15.18:0/429094567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6794db7c0 con 0x55e6794db2e0 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33f67fc640 1 --2- 172.21.15.18:0/429094567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794db2e0 0x55e6794ebfd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0038c0 tx=0x7f33ec003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63ae6e0f12f3bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33dd7fa640 1 -- 172.21.15.18:0/429094567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0a47b0 con 0x55e6794db2e0 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33dd7fa640 1 -- 172.21.15.18:0/429094567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ec0035f0 con 0x55e6794db2e0 2024-09-19T09:52:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.744+0000 7f33dd7fa640 1 -- 172.21.15.18:0/429094567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0860b0 con 0x55e6794db2e0 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 -- 172.21.15.18:0/429094567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794db2e0 msgr2=0x55e6794ebfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 --2- 172.21.15.18:0/429094567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794db2e0 0x55e6794ebfd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0038c0 tx=0x7f33ec003910 comp rx=0 tx=0).stop 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 -- 172.21.15.18:0/429094567 shutdown_connections 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 --2- 172.21.15.18:0/429094567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794e0370 0x55e6794d50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 --2- 172.21.15.18:0/429094567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794db2e0 0x55e6794ebfd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 --2- 172.21.15.18:0/429094567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794da9a0 0x55e6794dad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 -- 172.21.15.18:0/429094567 >> 172.21.15.18:0/429094567 conn(0x55e6794d6010 msgr2=0x55e6794d49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 -- 172.21.15.18:0/429094567 shutdown_connections 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 -- 172.21.15.18:0/429094567 wait complete. 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 -- start start 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.745+0000 7f3400643740 1 Processor -- start 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f3400643740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794da9a0 0x55e6794e9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f3400643740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 0x55e6794e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f3400643740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794eaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f3400643740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33f81ac580 con 0x55e6794e0370 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f3400643740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f33f81abeb0 con 0x55e6794db2e0 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f3400643740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33f81a90f0 con 0x55e6794da9a0 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f3400643740 10 client.0 _ll_register_callbacks cb 0x7f33e80099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794eaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794eaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45472/0 (socket says 172.21.15.18:45472) 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f77fe640 1 -- 172.21.15.18:0/1830853360 learned_addr learned my addr 172.21.15.18:0/1830853360 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794da9a0 0x55e6794e9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f67fc640 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 0x55e6794e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f77fe640 1 -- 172.21.15.18:0/1830853360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794da9a0 msgr2=0x55e6794e9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f77fe640 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794da9a0 0x55e6794e9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f77fe640 1 -- 172.21.15.18:0/1830853360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 msgr2=0x55e6794e9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f77fe640 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 0x55e6794e9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f77fe640 1 -- 172.21.15.18:0/1830853360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6794eb2b0 con 0x55e6794e0370 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33f77fe640 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794eaca0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f33f0002230 tx=0x7f33f0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5cd4db5fc5ace5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.746+0000 7f33d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f33d6ffd640 1 -- 172.21.15.18:0/1830853360 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0003970 con 0x55e6794e0370 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f33d6ffd640 1 -- 172.21.15.18:0/1830853360 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f33f0031870 con 0x55e6794e0370 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f3400643740 1 -- 172.21.15.18:0/1830853360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33ec0035f0 con 0x55e6794e0370 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f33d6ffd640 1 -- 172.21.15.18:0/1830853360 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f33f002f610 con 0x55e6794e0370 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f3400643740 10 client.15480 fetch_fsmap learned FSMap version 28 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f3400643740 1 -- 172.21.15.18:0/1830853360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e67955afc0 con 0x55e6794e0370 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f33d6ffd640 1 -- 172.21.15.18:0/1830853360 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ec0035f0 con 0x55e6794e0370 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f33d6ffd640 1 -- 172.21.15.18:0/1830853360 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f33f00305c0 con 0x55e6794e0370 2024-09-19T09:52:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f3400643740 10 client.15480 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f3400643740 10 client.15480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f3400643740 20 client.15480 populate_metadata read hostname 'smithi018' 2024-09-19T09:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f3400643740 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e67955b860 0x55e67955dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f3400643740 4 client.15480 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f3400643740 1 -- 172.21.15.18:0/1830853360 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e679445d70 con 0x55e67955b860 2024-09-19T09:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.747+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e67955b860 0x55e67955dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.748+0000 7f33f6ffd640 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e67955b860 0x55e67955dc50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea6f2939a63e19ba server_cookie=c12eb8f3402925e3 in_seq=0 out_seq=0 2024-09-19T09:52:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.748+0000 7f33d6ffd640 10 client.15480 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.751+0000 7f33d6ffd640 1 -- 172.21.15.18:0/1830853360 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e679445d70 con 0x55e67955b860 2024-09-19T09:52:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.751+0000 7f33d6ffd640 10 client.15480 handle_command_reply: tid=0 2024-09-19T09:52:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.751+0000 7f3400643740 1 client.15480 shutdown 2024-09-19T09:52:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 1 -- 172.21.15.18:0/1830853360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 msgr2=0x55e6794eaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794eaca0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f33f0002230 tx=0x7f33f0005ef0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 1 -- 172.21.15.18:0/1830853360 shutdown_connections 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e67955b860 0x55e67955dc50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6794e0370 0x55e6794eaca0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e6794db2e0 0x55e6794e9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 1 --2- 172.21.15.18:0/1830853360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e6794da9a0 0x55e6794e9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 1 -- 172.21.15.18:0/1830853360 >> 172.21.15.18:0/1830853360 conn(0x55e6794d6010 msgr2=0x55e6794d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33d6ffd640 0 client.15480 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 1 -- 172.21.15.18:0/1830853360 shutdown_connections 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 1 -- 172.21.15.18:0/1830853360 wait complete. 2024-09-19T09:52:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f3400643740 20 client.15480 trim_cache size 0 max 16384 2024-09-19T09:52:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:52:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:52:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:52:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:52:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33fd8a5640 1 -- 172.21.15.18:0/1321542566 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33e00a32f0 msgr2=0x7f33e00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33fd8a5640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33e00a32f0 0x7f33e00a57b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009bd0 tx=0x7f33e8005f90 comp rx=0 tx=0).stop 2024-09-19T09:52:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33fd8a5640 1 -- 172.21.15.18:0/1321542566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33f8104f10 msgr2=0x7f33f8100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:52:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33fd8a5640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33f8104f10 0x7f33f8100590 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f33ec005fd0 tx=0x7f33ec00dde0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33fd8a5640 1 -- 172.21.15.18:0/1321542566 shutdown_connections 2024-09-19T09:52:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33fd8a5640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33e00a32f0 0x7f33e00a57b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33fd8a5640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8107840 0x7f33f8100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33fd8a5640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33f8104f10 0x7f33f8100590 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33fd8a5640 1 --2- 172.21.15.18:0/1321542566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33f81025e0 0x7f33f8101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:52:59.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.752+0000 7f33fd8a5640 1 -- 172.21.15.18:0/1321542566 >> 172.21.15.18:0/1321542566 conn(0x7f33f80fc1e0 msgr2=0x7f33f8102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:52:59.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.753+0000 7f33fd8a5640 1 -- 172.21.15.18:0/1321542566 shutdown_connections 2024-09-19T09:52:59.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:52:59.753+0000 7f33fd8a5640 1 -- 172.21.15.18:0/1321542566 wait complete. 2024-09-19T09:52:59.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:52:59 smithi018 ceph-mon[30956]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-19T09:52:59.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:52:59 smithi049 ceph-mon[34858]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-19T09:52:59.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:52:59 smithi162 ceph-mon[35174]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-19T09:53:01.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:01 smithi018 ceph-mon[30956]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 KiB/s wr, 15 op/s 2024-09-19T09:53:01.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:01 smithi049 ceph-mon[34858]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 KiB/s wr, 15 op/s 2024-09-19T09:53:01.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:01 smithi162 ceph-mon[35174]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 KiB/s wr, 15 op/s 2024-09-19T09:53:03.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:03 smithi018 ceph-mon[30956]: pgmap v360: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-19T09:53:03.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:03 smithi049 ceph-mon[34858]: pgmap v360: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-19T09:53:03.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:03 smithi162 ceph-mon[35174]: pgmap v360: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-19T09:53:05.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:05 smithi018 ceph-mon[30956]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T09:53:05.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:05 smithi049 ceph-mon[34858]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T09:53:05.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:05 smithi162 ceph-mon[35174]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T09:53:07.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:07 smithi018 ceph-mon[30956]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:07.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:07 smithi049 ceph-mon[34858]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:07.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:07 smithi162 ceph-mon[35174]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:08.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:53:08.528 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:09.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.021+0000 7f0b4af0a640 1 -- 172.21.15.18:0/3579608873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b44102570 msgr2=0x7f0b441029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:09.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.021+0000 7f0b4af0a640 1 --2- 172.21.15.18:0/3579608873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b44102570 0x7f0b441029b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009900 tx=0x7f0b3002a480 comp rx=0 tx=0).stop 2024-09-19T09:53:09.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.021+0000 7f0b4af0a640 1 -- 172.21.15.18:0/3579608873 shutdown_connections 2024-09-19T09:53:09.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.021+0000 7f0b4af0a640 1 --2- 172.21.15.18:0/3579608873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b44102ef0 0x7f0b4410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.021+0000 7f0b4af0a640 1 --2- 172.21.15.18:0/3579608873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b44102570 0x7f0b441029b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.021+0000 7f0b4af0a640 1 --2- 172.21.15.18:0/3579608873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44100e20 0x7f0b44101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.021+0000 7f0b4af0a640 1 -- 172.21.15.18:0/3579608873 >> 172.21.15.18:0/3579608873 conn(0x7f0b440fc7d0 msgr2=0x7f0b440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:09.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.021+0000 7f0b4af0a640 1 -- 172.21.15.18:0/3579608873 shutdown_connections 2024-09-19T09:53:09.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.021+0000 7f0b4af0a640 1 -- 172.21.15.18:0/3579608873 wait complete. 2024-09-19T09:53:09.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.022+0000 7f0b4af0a640 1 Processor -- start 2024-09-19T09:53:09.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.022+0000 7f0b4af0a640 1 -- start start 2024-09-19T09:53:09.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.022+0000 7f0b4af0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b44100e20 0x7f0b44197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.022+0000 7f0b4af0a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b44102570 0x7f0b44197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.022+0000 7f0b4af0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44102ef0 0x7f0b44197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.022+0000 7f0b4af0a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0b44110fd0 con 0x7f0b44100e20 2024-09-19T09:53:09.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.022+0000 7f0b4af0a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b44110e50 con 0x7f0b44102570 2024-09-19T09:53:09.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.022+0000 7f0b4af0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b44111150 con 0x7f0b44102ef0 2024-09-19T09:53:09.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b48ca6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b44100e20 0x7f0b44197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b48ca6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b44100e20 0x7f0b44197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43754/0 (socket says 172.21.15.18:43754) 2024-09-19T09:53:09.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b48ca6640 1 -- 172.21.15.18:0/1129850253 learned_addr learned my addr 172.21.15.18:0/1129850253 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:09.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b43fff640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b44102570 0x7f0b44197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b494a7640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44102ef0 0x7f0b44197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b48ca6640 1 -- 172.21.15.18:0/1129850253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44102ef0 msgr2=0x7f0b44197bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:09.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44102ef0 0x7f0b44197bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b48ca6640 1 -- 172.21.15.18:0/1129850253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b44102570 msgr2=0x7f0b44197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:09.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b44102570 0x7f0b44197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b48ca6640 1 -- 172.21.15.18:0/1129850253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b441a69c0 con 0x7f0b44100e20 2024-09-19T09:53:09.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b44100e20 0x7f0b44197150 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800d770 tx=0x7f0b3800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:09.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b41ffb640 1 -- 172.21.15.18:0/1129850253 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38017070 con 0x7f0b44100e20 2024-09-19T09:53:09.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b41ffb640 1 -- 172.21.15.18:0/1129850253 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b38005500 con 0x7f0b44100e20 2024-09-19T09:53:09.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b4af0a640 1 -- 172.21.15.18:0/1129850253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b441a6cb0 con 0x7f0b44100e20 2024-09-19T09:53:09.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.023+0000 7f0b41ffb640 1 -- 172.21.15.18:0/1129850253 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38004e00 con 0x7f0b44100e20 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.024+0000 7f0b4af0a640 1 -- 172.21.15.18:0/1129850253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b441a71c0 con 0x7f0b44100e20 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.026+0000 7f0b41ffb640 1 -- 172.21.15.18:0/1129850253 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0b38004fa0 con 0x7f0b44100e20 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.026+0000 7f0b4d2e3740 1 Processor -- start 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b4d2e3740 1 -- start start 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae444a0 0x56124ae44880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae44dc0 0x56124ae4f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae51a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56124adaa2e0 con 0x56124ae4f680 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56124ad51ce0 con 0x56124ae44dc0 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56124ada62a0 con 0x56124ae444a0 2024-09-19T09:53:09.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae51a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae51a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43764/0 (socket says 172.21.15.18:43764) 2024-09-19T09:53:09.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b43fff640 1 -- 172.21.15.18:0/282371312 learned_addr learned my addr 172.21.15.18:0/282371312 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:09.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b494a7640 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae444a0 0x56124ae44880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae44dc0 0x56124ae4f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b41ffb640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0b340a32c0 0x7f0b340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b43fff640 1 -- 172.21.15.18:0/282371312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae444a0 msgr2=0x56124ae44880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:09.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b43fff640 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae444a0 0x56124ae44880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b43fff640 1 -- 172.21.15.18:0/282371312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae44dc0 msgr2=0x56124ae4f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:09.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b43fff640 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae44dc0 0x56124ae4f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b43fff640 1 -- 172.21.15.18:0/282371312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56124ad36440 con 0x56124ae4f680 2024-09-19T09:53:09.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.027+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae44dc0 0x56124ae4f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:09.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.028+0000 7f0b494a7640 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae444a0 0x56124ae44880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:09.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.028+0000 7f0b494a7640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0b340a32c0 0x7f0b340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.028+0000 7f0b41ffb640 1 -- 172.21.15.18:0/1129850253 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0b380cf2f0 con 0x7f0b44100e20 2024-09-19T09:53:09.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.028+0000 7f0b43fff640 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae51a70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009230 tx=0x7f0b30004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374bef66d775a4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:09.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.028+0000 7f0b2effd640 1 -- 172.21.15.18:0/282371312 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30035040 con 0x56124ae4f680 2024-09-19T09:53:09.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.028+0000 7f0b2effd640 1 -- 172.21.15.18:0/282371312 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b30005520 con 0x56124ae4f680 2024-09-19T09:53:09.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.028+0000 7f0b2effd640 1 -- 172.21.15.18:0/282371312 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30003850 con 0x56124ae4f680 2024-09-19T09:53:09.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/282371312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 msgr2=0x56124ae51a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:09.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae51a70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009230 tx=0x7f0b30004040 comp rx=0 tx=0).stop 2024-09-19T09:53:09.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b494a7640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0b340a32c0 0x7f0b340a5780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c005fd0 tx=0x7f0b3c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:09.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/282371312 shutdown_connections 2024-09-19T09:53:09.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae51a70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae44dc0 0x56124ae4f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/282371312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae444a0 0x56124ae44880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/282371312 >> 172.21.15.18:0/282371312 conn(0x56124ae40a30 msgr2=0x56124ae40e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:09.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/282371312 shutdown_connections 2024-09-19T09:53:09.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/282371312 wait complete. 2024-09-19T09:53:09.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 -- start start 2024-09-19T09:53:09.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.029+0000 7f0b4d2e3740 1 Processor -- start 2024-09-19T09:53:09.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 0x56124ae4efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae44dc0 0x56124ae4c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae4f680 0x56124ae4c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56124ae52250 con 0x56124ae44dc0 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56124ad65050 con 0x56124ae444a0 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56124ae523d0 con 0x56124ae4f680 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b4d2e3740 10 client.0 _ll_register_callbacks cb 0x56124ada5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae44dc0 0x56124ae4c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae44dc0 0x56124ae4c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43776/0 (socket says 172.21.15.18:43776) 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b43fff640 1 -- 172.21.15.18:0/2967707199 learned_addr learned my addr 172.21.15.18:0/2967707199 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b494a7640 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae4f680 0x56124ae4c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 0x56124ae4efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b43fff640 1 -- 172.21.15.18:0/2967707199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae4f680 msgr2=0x56124ae4c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b43fff640 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae4f680 0x56124ae4c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b43fff640 1 -- 172.21.15.18:0/2967707199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 msgr2=0x56124ae4efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:09.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b43fff640 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 0x56124ae4efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b43fff640 1 -- 172.21.15.18:0/2967707199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56124ab1b3c0 con 0x56124ae44dc0 2024-09-19T09:53:09.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 0x56124ae4efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:09.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b43fff640 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae44dc0 0x56124ae4c290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0b3002a9a0 tx=0x7f0b30009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bd2baab60a9c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:09.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.030+0000 7f0b23fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:09.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b23fff640 1 -- 172.21.15.18:0/2967707199 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30053060 con 0x56124ae44dc0 2024-09-19T09:53:09.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b23fff640 1 -- 172.21.15.18:0/2967707199 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0b30004e80 con 0x56124ae44dc0 2024-09-19T09:53:09.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/2967707199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b30005520 con 0x56124ae44dc0 2024-09-19T09:53:09.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b23fff640 1 -- 172.21.15.18:0/2967707199 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0b30035050 con 0x56124ae44dc0 2024-09-19T09:53:09.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b4d2e3740 10 client.15492 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:09.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/2967707199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56124ae5dc50 con 0x56124ae44dc0 2024-09-19T09:53:09.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b23fff640 1 -- 172.21.15.18:0/2967707199 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b30005520 con 0x56124ae44dc0 2024-09-19T09:53:09.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b23fff640 1 -- 172.21.15.18:0/2967707199 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0b30003bd0 con 0x56124ae44dc0 2024-09-19T09:53:09.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b4d2e3740 10 client.15492 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:09.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b4d2e3740 10 client.15492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:09.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b4d2e3740 20 client.15492 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:09.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56124ae5efa0 0x56124ae61390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b4d2e3740 4 client.15492 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:09.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.031+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/2967707199 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56124adb7850 con 0x56124ae5efa0 2024-09-19T09:53:09.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.032+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56124ae5efa0 0x56124ae61390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.032+0000 7f0b23fff640 10 client.15492 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:09.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.032+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56124ae5efa0 0x56124ae61390 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c47e7a8b88fec8 server_cookie=f021aa96a40a1b74 in_seq=0 out_seq=0 2024-09-19T09:53:09.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b23fff640 1 -- 172.21.15.18:0/2967707199 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56124adb7850 con 0x56124ae5efa0 2024-09-19T09:53:09.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b23fff640 10 client.15492 handle_command_reply: tid=0 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b4d2e3740 1 client.15492 shutdown 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/2967707199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae44dc0 msgr2=0x56124ae4c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae44dc0 0x56124ae4c290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0b3002a9a0 tx=0x7f0b30009260 comp rx=0 tx=0).stop 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/2967707199 shutdown_connections 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56124ae5efa0 0x56124ae61390 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b23fff640 0 client.15492 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae4f680 0x56124ae4c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae44dc0 0x56124ae4c290 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/2967707199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 0x56124ae4efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.033+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/2967707199 >> 172.21.15.18:0/2967707199 conn(0x56124ae40a30 msgr2=0x56124ae46710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:09.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.034+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/2967707199 shutdown_connections 2024-09-19T09:53:09.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.034+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/2967707199 wait complete. 2024-09-19T09:53:09.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.034+0000 7f0b4d2e3740 20 client.15492 trim_cache size 0 max 16384 2024-09-19T09:53:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b4d2e3740 1 Processor -- start 2024-09-19T09:53:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b4d2e3740 1 -- start start 2024-09-19T09:53:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae444a0 0x56124ae494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 0x56124ae49a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae4f680 0x56124ae4daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441af560 con 0x56124ae444a0 2024-09-19T09:53:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441b10a0 con 0x56124ae4f680 2024-09-19T09:53:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441afc30 con 0x56124ae44dc0 2024-09-19T09:53:09.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b48ca6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae444a0 0x56124ae494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b48ca6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae444a0 0x56124ae494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43788/0 (socket says 172.21.15.18:43788) 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.051+0000 7f0b48ca6640 1 -- 172.21.15.18:0/3752260940 learned_addr learned my addr 172.21.15.18:0/3752260940 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b494a7640 1 --2- 172.21.15.18:0/3752260940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae4f680 0x56124ae4daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b43fff640 1 --2- 172.21.15.18:0/3752260940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 0x56124ae49a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b48ca6640 1 -- 172.21.15.18:0/3752260940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 msgr2=0x56124ae49a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/3752260940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 0x56124ae49a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b48ca6640 1 -- 172.21.15.18:0/3752260940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae4f680 msgr2=0x56124ae4daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/3752260940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae4f680 0x56124ae4daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b48ca6640 1 -- 172.21.15.18:0/3752260940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56124ae4cb60 con 0x56124ae444a0 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b494a7640 1 --2- 172.21.15.18:0/3752260940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae4f680 0x56124ae4daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:09.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/3752260940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae444a0 0x56124ae494f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009610 tx=0x7f0b38086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efb390262cd206e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:09.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b2e7fc640 1 -- 172.21.15.18:0/3752260940 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38020040 con 0x56124ae444a0 2024-09-19T09:53:09.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b2e7fc640 1 -- 172.21.15.18:0/3752260940 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b380860b0 con 0x56124ae444a0 2024-09-19T09:53:09.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.052+0000 7f0b2e7fc640 1 -- 172.21.15.18:0/3752260940 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38099be0 con 0x56124ae444a0 2024-09-19T09:53:09.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.053+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/3752260940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae444a0 msgr2=0x56124ae494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:09.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.053+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/3752260940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae444a0 0x56124ae494f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009610 tx=0x7f0b38086040 comp rx=0 tx=0).stop 2024-09-19T09:53:09.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.053+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/3752260940 shutdown_connections 2024-09-19T09:53:09.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.053+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/3752260940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae4f680 0x56124ae4daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.053+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/3752260940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 0x56124ae49a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.053+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/3752260940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae444a0 0x56124ae494f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.053+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/3752260940 >> 172.21.15.18:0/3752260940 conn(0x56124ae40a30 msgr2=0x56124ae4b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.053+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/3752260940 shutdown_connections 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.053+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/3752260940 wait complete. 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.053+0000 7f0b4d2e3740 1 -- start start 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b4d2e3740 1 Processor -- start 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 0x56124ae649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 0x56124ae61cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b4d2e3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae62230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441b09d0 con 0x56124ae4f680 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441b0300 con 0x56124ae444a0 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b4d2e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441ad540 con 0x56124ae44dc0 2024-09-19T09:53:09.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b4d2e3740 10 client.0 _ll_register_callbacks cb 0x7f0b30005e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 0x56124ae61cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b494a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae62230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b48ca6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 0x56124ae649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 0x56124ae61cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:35180/0 (socket says 172.21.15.18:35180) 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.054+0000 7f0b43fff640 1 -- 172.21.15.18:0/513894957 learned_addr learned my addr 172.21.15.18:0/513894957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b494a7640 1 -- 172.21.15.18:0/513894957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 msgr2=0x56124ae61cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b494a7640 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 0x56124ae61cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b494a7640 1 -- 172.21.15.18:0/513894957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 msgr2=0x56124ae649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b494a7640 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 0x56124ae649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b494a7640 1 -- 172.21.15.18:0/513894957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56124ae628d0 con 0x56124ae4f680 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 0x56124ae649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:09.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b494a7640 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae62230 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x56124ae3c5a0 tx=0x7f0b3c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8def142d5e717ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b23fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b23fff640 1 -- 172.21.15.18:0/513894957 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c02d060 con 0x56124ae4f680 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b23fff640 1 -- 172.21.15.18:0/513894957 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0b3c01b620 con 0x56124ae4f680 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/513894957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b380860b0 con 0x56124ae4f680 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b23fff640 1 -- 172.21.15.18:0/513894957 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0b3c01ee30 con 0x56124ae4f680 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b4d2e3740 10 client.15498 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.055+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/513894957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56124aec97e0 con 0x56124ae4f680 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.056+0000 7f0b23fff640 1 -- 172.21.15.18:0/513894957 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b380860b0 con 0x56124ae4f680 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.056+0000 7f0b23fff640 1 -- 172.21.15.18:0/513894957 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0b3c027070 con 0x56124ae4f680 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.056+0000 7f0b4d2e3740 10 client.15498 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.056+0000 7f0b4d2e3740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:09.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.056+0000 7f0b4d2e3740 20 client.15498 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.056+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56124ae5efa0 0x56124aecbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.056+0000 7f0b4d2e3740 4 client.15498 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.056+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/513894957 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56124adb1d60 con 0x56124ae5efa0 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.056+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56124ae5efa0 0x56124aecbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b48ca6640 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56124ae5efa0 0x56124aecbf50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b26ce13b4b39b2 server_cookie=d6204291e7676055 in_seq=0 out_seq=0 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b23fff640 10 client.15498 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b23fff640 1 -- 172.21.15.18:0/513894957 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56124adb1d60 con 0x56124ae5efa0 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b23fff640 10 client.15498 handle_command_reply: tid=0 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 client.15498 shutdown 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/513894957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 msgr2=0x56124ae62230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae62230 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x56124ae3c5a0 tx=0x7f0b3c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/513894957 shutdown_connections 2024-09-19T09:53:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56124ae5efa0 0x56124aecbf50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b23fff640 0 client.15498 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56124ae4f680 0x56124ae62230 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56124ae44dc0 0x56124ae61cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 --2- 172.21.15.18:0/513894957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56124ae444a0 0x56124ae649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/513894957 >> 172.21.15.18:0/513894957 conn(0x56124ae40a30 msgr2=0x56124ae4daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/513894957 shutdown_connections 2024-09-19T09:53:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 1 -- 172.21.15.18:0/513894957 wait complete. 2024-09-19T09:53:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.057+0000 7f0b4d2e3740 20 client.15498 trim_cache size 0 max 16384 2024-09-19T09:53:09.064 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:53:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T09:53:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T09:53:09.065 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:53:09.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 -- 172.21.15.18:0/1129850253 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0b340a32c0 msgr2=0x7f0b340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0b340a32c0 0x7f0b340a5780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c005fd0 tx=0x7f0b3c004a40 comp rx=0 tx=0).stop 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 -- 172.21.15.18:0/1129850253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b44100e20 msgr2=0x7f0b44197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b44100e20 0x7f0b44197150 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800d770 tx=0x7f0b3800dc30 comp rx=0 tx=0).stop 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 -- 172.21.15.18:0/1129850253 shutdown_connections 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0b340a32c0 0x7f0b340a5780 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44102ef0 0x7f0b44197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b44102570 0x7f0b44197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 --2- 172.21.15.18:0/1129850253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b44100e20 0x7f0b44197150 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 -- 172.21.15.18:0/1129850253 >> 172.21.15.18:0/1129850253 conn(0x7f0b440fc7d0 msgr2=0x7f0b440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 -- 172.21.15.18:0/1129850253 shutdown_connections 2024-09-19T09:53:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:09.058+0000 7f0b4af0a640 1 -- 172.21.15.18:0/1129850253 wait complete. 2024-09-19T09:53:09.360 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T09:53:09.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:53:09.670 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:09 smithi018 ceph-mon[30956]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:09.836 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:53:09.837 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:53:09.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:09 smithi049 ceph-mon[34858]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:09.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:09 smithi162 ceph-mon[35174]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.475+0000 7f057220f640 1 -- 172.21.15.18:0/1360428319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c106f10 msgr2=0x7f056c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.475+0000 7f057220f640 1 --2- 172.21.15.18:0/1360428319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c106f10 0x7f056c10ea90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0564009ca0 tx=0x7f056402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.475+0000 7f057220f640 1 -- 172.21.15.18:0/1360428319 shutdown_connections 2024-09-19T09:53:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.475+0000 7f057220f640 1 --2- 172.21.15.18:0/1360428319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c106f10 0x7f056c10ea90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.475+0000 7f057220f640 1 --2- 172.21.15.18:0/1360428319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c102790 0x7f056c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.475+0000 7f057220f640 1 --2- 172.21.15.18:0/1360428319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c101de0 0x7f056c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.475+0000 7f057220f640 1 -- 172.21.15.18:0/1360428319 >> 172.21.15.18:0/1360428319 conn(0x7f056c0fd8e0 msgr2=0x7f056c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.475+0000 7f057220f640 1 -- 172.21.15.18:0/1360428319 shutdown_connections 2024-09-19T09:53:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.476+0000 7f057220f640 1 -- 172.21.15.18:0/1360428319 wait complete. 2024-09-19T09:53:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.476+0000 7f057220f640 1 Processor -- start 2024-09-19T09:53:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.476+0000 7f057220f640 1 -- start start 2024-09-19T09:53:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.476+0000 7f057220f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c101de0 0x7f056c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.476+0000 7f057220f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c102790 0x7f056c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.476+0000 7f057220f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c106f10 0x7f056c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.476+0000 7f057220f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f056c111fc0 con 0x7f056c101de0 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.476+0000 7f057220f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f056c111e40 con 0x7f056c106f10 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.476+0000 7f057220f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f056c112140 con 0x7f056c102790 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f056b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c101de0 0x7f056c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f056b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c101de0 0x7f056c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43810/0 (socket says 172.21.15.18:43810) 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f056b7fe640 1 -- 172.21.15.18:0/1648431033 learned_addr learned my addr 172.21.15.18:0/1648431033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f0563fff640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c102790 0x7f056c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f056b7fe640 1 -- 172.21.15.18:0/1648431033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c102790 msgr2=0x7f056c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f056bfff640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c106f10 0x7f056c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f056b7fe640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c102790 0x7f056c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f056b7fe640 1 -- 172.21.15.18:0/1648431033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c106f10 msgr2=0x7f056c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f056b7fe640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c106f10 0x7f056c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f056b7fe640 1 -- 172.21.15.18:0/1648431033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056c1a6900 con 0x7f056c101de0 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f0563fff640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c102790 0x7f056c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f056b7fe640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c101de0 0x7f056c0744f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f055c00d770 tx=0x7f055c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f05697fa640 1 -- 172.21.15.18:0/1648431033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c017070 con 0x7f056c101de0 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f05697fa640 1 -- 172.21.15.18:0/1648431033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f055c005500 con 0x7f056c101de0 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f05697fa640 1 -- 172.21.15.18:0/1648431033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c004e00 con 0x7f056c101de0 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f057220f640 1 -- 172.21.15.18:0/1648431033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056c1a6bf0 con 0x7f056c101de0 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.477+0000 7f057220f640 1 -- 172.21.15.18:0/1648431033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056c1a70e0 con 0x7f056c101de0 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.478+0000 7f057220f640 1 -- 172.21.15.18:0/1648431033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f056c1021c0 con 0x7f056c101de0 2024-09-19T09:53:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.480+0000 7f05697fa640 1 -- 172.21.15.18:0/1648431033 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f055c004fa0 con 0x7f056c101de0 2024-09-19T09:53:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.480+0000 7f05697fa640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05580a32c0 0x7f05580a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.481+0000 7f0563fff640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05580a32c0 0x7f05580a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.481+0000 7f05697fa640 1 -- 172.21.15.18:0/1648431033 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f055c0cf790 con 0x7f056c101de0 2024-09-19T09:53:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.481+0000 7f0563fff640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05580a32c0 0x7f05580a5780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0554005fd0 tx=0x7f05540094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.488+0000 7f05697fa640 1 -- 172.21.15.18:0/1648431033 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f055c09c560 con 0x7f056c101de0 2024-09-19T09:53:10.552 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:10.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.722+0000 7f057220f640 1 -- 172.21.15.18:0/1648431033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f056c1a7380 con 0x7f056c101de0 2024-09-19T09:53:10.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.723+0000 7f05697fa640 1 -- 172.21.15.18:0/1648431033 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f055c09be60 con 0x7f056c101de0 2024-09-19T09:53:10.726 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:53:10.726 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:53:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.725+0000 7f057220f640 1 -- 172.21.15.18:0/1648431033 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05580a32c0 msgr2=0x7f05580a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.725+0000 7f057220f640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05580a32c0 0x7f05580a5780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0554005fd0 tx=0x7f05540094d0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.725+0000 7f057220f640 1 -- 172.21.15.18:0/1648431033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c101de0 msgr2=0x7f056c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.725+0000 7f057220f640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c101de0 0x7f056c0744f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f055c00d770 tx=0x7f055c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.725+0000 7f057220f640 1 -- 172.21.15.18:0/1648431033 shutdown_connections 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.725+0000 7f057220f640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05580a32c0 0x7f05580a5780 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.725+0000 7f057220f640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c106f10 0x7f056c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.725+0000 7f057220f640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056c102790 0x7f056c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.725+0000 7f057220f640 1 --2- 172.21.15.18:0/1648431033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c101de0 0x7f056c0744f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.725+0000 7f057220f640 1 -- 172.21.15.18:0/1648431033 >> 172.21.15.18:0/1648431033 conn(0x7f056c0fd8e0 msgr2=0x7f056c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.726+0000 7f057220f640 1 -- 172.21.15.18:0/1648431033 shutdown_connections 2024-09-19T09:53:10.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:10.726+0000 7f057220f640 1 -- 172.21.15.18:0/1648431033 wait complete. 2024-09-19T09:53:11.433 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T09:53:11.434 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T09:53:11.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:11 smithi018 ceph-mon[30956]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T09:53:11.693 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:11 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1648431033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:11.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.689+0000 7f3cd44ad640 1 -- 172.21.15.18:0/861931595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ccc102570 msgr2=0x7f3ccc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:11.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.689+0000 7f3cd44ad640 1 --2- 172.21.15.18:0/861931595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ccc102570 0x7f3ccc1029b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009900 tx=0x7f3cbc02a480 comp rx=0 tx=0).stop 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.690+0000 7f3cd44ad640 1 -- 172.21.15.18:0/861931595 shutdown_connections 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.690+0000 7f3cd44ad640 1 --2- 172.21.15.18:0/861931595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc102ef0 0x7f3ccc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.690+0000 7f3cd44ad640 1 --2- 172.21.15.18:0/861931595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ccc102570 0x7f3ccc1029b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.690+0000 7f3cd44ad640 1 --2- 172.21.15.18:0/861931595 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc100e20 0x7f3ccc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.690+0000 7f3cd44ad640 1 -- 172.21.15.18:0/861931595 >> 172.21.15.18:0/861931595 conn(0x7f3ccc0fc7d0 msgr2=0x7f3ccc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.690+0000 7f3cd44ad640 1 -- 172.21.15.18:0/861931595 shutdown_connections 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.690+0000 7f3cd44ad640 1 -- 172.21.15.18:0/861931595 wait complete. 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.690+0000 7f3cd44ad640 1 Processor -- start 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.690+0000 7f3cd44ad640 1 -- start start 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd44ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ccc100e20 0x7f3ccc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd44ad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc102570 0x7f3ccc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd44ad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc102ef0 0x7f3ccc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd44ad640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc110f80 con 0x7f3ccc100e20 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd44ad640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc110e00 con 0x7f3ccc102570 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd44ad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc111100 con 0x7f3ccc102ef0 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd2249640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ccc100e20 0x7f3ccc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd2249640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ccc100e20 0x7f3ccc0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43832/0 (socket says 172.21.15.18:43832) 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd2249640 1 -- 172.21.15.18:0/4282083831 learned_addr learned my addr 172.21.15.18:0/4282083831 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd1a48640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc102570 0x7f3ccc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd2a4a640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc102ef0 0x7f3ccc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd2249640 1 -- 172.21.15.18:0/4282083831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc102ef0 msgr2=0x7f3ccc0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd2249640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc102ef0 0x7f3ccc0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd2249640 1 -- 172.21.15.18:0/4282083831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc102570 msgr2=0x7f3ccc0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd2249640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc102570 0x7f3ccc0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd2249640 1 -- 172.21.15.18:0/4282083831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc1a69c0 con 0x7f3ccc100e20 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.691+0000 7f3cd2a4a640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc102ef0 0x7f3ccc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.692+0000 7f3cd2249640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ccc100e20 0x7f3ccc0fcc80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800d950 tx=0x7f3cc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.692+0000 7f3cc37fe640 1 -- 172.21.15.18:0/4282083831 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8017070 con 0x7f3ccc100e20 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.692+0000 7f3cd44ad640 1 -- 172.21.15.18:0/4282083831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ccc1a6cb0 con 0x7f3ccc100e20 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.692+0000 7f3cc37fe640 1 -- 172.21.15.18:0/4282083831 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cc8009c30 con 0x7f3ccc100e20 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.692+0000 7f3cc37fe640 1 -- 172.21.15.18:0/4282083831 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc800f6b0 con 0x7f3ccc100e20 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.692+0000 7f3cd44ad640 1 -- 172.21.15.18:0/4282083831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ccc1a71c0 con 0x7f3ccc100e20 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.693+0000 7f3cd44ad640 1 -- 172.21.15.18:0/4282083831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ccc101200 con 0x7f3ccc100e20 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.694+0000 7f3cc37fe640 1 -- 172.21.15.18:0/4282083831 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3cc80109d0 con 0x7f3ccc100e20 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.695+0000 7f3cc37fe640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cb80a3240 0x7f3cb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.695+0000 7f3cd1a48640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cb80a3240 0x7f3cb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.695+0000 7f3cc37fe640 1 -- 172.21.15.18:0/4282083831 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3cc80cf4f0 con 0x7f3ccc100e20 2024-09-19T09:53:11.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.695+0000 7f3cd1a48640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cb80a3240 0x7f3cb80a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009230 tx=0x7f3cbc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:11.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.698+0000 7f3cc37fe640 1 -- 172.21.15.18:0/4282083831 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3cc8009de0 con 0x7f3ccc100e20 2024-09-19T09:53:11.887 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:11.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:11 smithi049 ceph-mon[34858]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T09:53:11.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:11 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1648431033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:11.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:11 smithi162 ceph-mon[35174]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T09:53:11.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:11 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1648431033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.938+0000 7f3cd44ad640 1 -- 172.21.15.18:0/4282083831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ccc10a0a0 con 0x7f3ccc100e20 2024-09-19T09:53:11.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.939+0000 7f3cc37fe640 1 -- 172.21.15.18:0/4282083831 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f3cc809c240 con 0x7f3ccc100e20 2024-09-19T09:53:11.942 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:53:11.942 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:53:11.943 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:53:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.941+0000 7f3cd44ad640 1 -- 172.21.15.18:0/4282083831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cb80a3240 msgr2=0x7f3cb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.941+0000 7f3cd44ad640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cb80a3240 0x7f3cb80a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009230 tx=0x7f3cbc0058d0 comp rx=0 tx=0).stop 2024-09-19T09:53:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.941+0000 7f3cd44ad640 1 -- 172.21.15.18:0/4282083831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ccc100e20 msgr2=0x7f3ccc0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.941+0000 7f3cd44ad640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ccc100e20 0x7f3ccc0fcc80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800d950 tx=0x7f3cc800de10 comp rx=0 tx=0).stop 2024-09-19T09:53:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.941+0000 7f3cd44ad640 1 -- 172.21.15.18:0/4282083831 shutdown_connections 2024-09-19T09:53:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.941+0000 7f3cd44ad640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cb80a3240 0x7f3cb80a5700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.941+0000 7f3cd44ad640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc102ef0 0x7f3ccc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.941+0000 7f3cd44ad640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ccc102570 0x7f3ccc0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.941+0000 7f3cd44ad640 1 --2- 172.21.15.18:0/4282083831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ccc100e20 0x7f3ccc0fcc80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.941+0000 7f3cd44ad640 1 -- 172.21.15.18:0/4282083831 >> 172.21.15.18:0/4282083831 conn(0x7f3ccc0fc7d0 msgr2=0x7f3ccc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:11.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.942+0000 7f3cd44ad640 1 -- 172.21.15.18:0/4282083831 shutdown_connections 2024-09-19T09:53:11.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:11.942+0000 7f3cd44ad640 1 -- 172.21.15.18:0/4282083831 wait complete. 2024-09-19T09:53:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 -- 172.21.15.18:0/3153896020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445c102630 msgr2=0x7f445c104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 --2- 172.21.15.18:0/3153896020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445c102630 0x7f445c104a20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f444c009900 tx=0x7f444c02a410 comp rx=0 tx=0).stop 2024-09-19T09:53:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 -- 172.21.15.18:0/3153896020 shutdown_connections 2024-09-19T09:53:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 --2- 172.21.15.18:0/3153896020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f445c107890 0x7f445c109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 --2- 172.21.15.18:0/3153896020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f445c104f60 0x7f445c107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 --2- 172.21.15.18:0/3153896020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445c102630 0x7f445c104a20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 -- 172.21.15.18:0/3153896020 >> 172.21.15.18:0/3153896020 conn(0x7f445c0fc1b0 msgr2=0x7f445c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 -- 172.21.15.18:0/3153896020 shutdown_connections 2024-09-19T09:53:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 -- 172.21.15.18:0/3153896020 wait complete. 2024-09-19T09:53:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 Processor -- start 2024-09-19T09:53:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.846+0000 7f446279a640 1 -- start start 2024-09-19T09:53:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f446279a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f445c102630 0x7f445c197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f446279a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445c104f60 0x7f445c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f446279a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f445c107890 0x7f445c19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f446279a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f445c10d880 con 0x7f445c104f60 2024-09-19T09:53:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f446279a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f445c10d700 con 0x7f445c107890 2024-09-19T09:53:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f446279a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f445c10da00 con 0x7f445c102630 2024-09-19T09:53:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f445b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445c104f60 0x7f445c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f445b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445c104f60 0x7f445c198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43848/0 (socket says 172.21.15.18:43848) 2024-09-19T09:53:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f445b7fe640 1 -- 172.21.15.18:0/3425453605 learned_addr learned my addr 172.21.15.18:0/3425453605 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f445bfff640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f445c102630 0x7f445c197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f4460d37640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f445c107890 0x7f445c19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f445b7fe640 1 -- 172.21.15.18:0/3425453605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f445c102630 msgr2=0x7f445c197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f445b7fe640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f445c102630 0x7f445c197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f445b7fe640 1 -- 172.21.15.18:0/3425453605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f445c107890 msgr2=0x7f445c19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f445b7fe640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f445c107890 0x7f445c19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f445b7fe640 1 -- 172.21.15.18:0/3425453605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c19fa00 con 0x7f445c104f60 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f4460d37640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f445c107890 0x7f445c19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f445b7fe640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445c104f60 0x7f445c198320 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f445000e9c0 tx=0x7f445000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.847+0000 7f44597fa640 1 -- 172.21.15.18:0/3425453605 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445000cd80 con 0x7f445c104f60 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.848+0000 7f44597fa640 1 -- 172.21.15.18:0/3425453605 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4450005500 con 0x7f445c104f60 2024-09-19T09:53:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.848+0000 7f446279a640 1 -- 172.21.15.18:0/3425453605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c19fcf0 con 0x7f445c104f60 2024-09-19T09:53:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.848+0000 7f44597fa640 1 -- 172.21.15.18:0/3425453605 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450010690 con 0x7f445c104f60 2024-09-19T09:53:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.848+0000 7f446279a640 1 -- 172.21.15.18:0/3425453605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c1a01e0 con 0x7f445c104f60 2024-09-19T09:53:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.850+0000 7f44597fa640 1 -- 172.21.15.18:0/3425453605 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f44500046c0 con 0x7f445c104f60 2024-09-19T09:53:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.850+0000 7f446560e740 1 Processor -- start 2024-09-19T09:53:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.850+0000 7f446560e740 1 -- start start 2024-09-19T09:53:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.850+0000 7f446560e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d6981b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.850+0000 7f446560e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 0x56326d69d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f446560e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d69fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f446560e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56326d5f72f0 con 0x56326d69d780 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f446560e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56326d59f270 con 0x56326d697db0 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f446560e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56326d5f32b0 con 0x56326d6986f0 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d69fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d69fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43854/0 (socket says 172.21.15.18:43854) 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445b7fe640 1 -- 172.21.15.18:0/1397323942 learned_addr learned my addr 172.21.15.18:0/1397323942 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f4460d37640 1 --2- 172.21.15.18:0/1397323942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d6981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445bfff640 1 --2- 172.21.15.18:0/1397323942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 0x56326d69d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f44597fa640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44440a32f0 0x7f44440a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f4460d37640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44440a32f0 0x7f44440a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445bfff640 1 -- 172.21.15.18:0/1397323942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 msgr2=0x56326d6981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445bfff640 1 --2- 172.21.15.18:0/1397323942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d6981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445bfff640 1 -- 172.21.15.18:0/1397323942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 msgr2=0x56326d69fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445bfff640 1 --2- 172.21.15.18:0/1397323942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d69fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f44597fa640 1 -- 172.21.15.18:0/3425453605 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f44500cfdd0 con 0x7f445c104f60 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445bfff640 1 -- 172.21.15.18:0/1397323942 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56326d59e340 con 0x56326d6986f0 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445b7fe640 1 --2- 172.21.15.18:0/1397323942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d69fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.851+0000 7f445bfff640 1 --2- 172.21.15.18:0/1397323942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 0x56326d69d1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f444c02a930 tx=0x7f444c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=546941c84317faa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.852+0000 7f4460d37640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44440a32f0 0x7f44440a57b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f445c06b380 tx=0x7f4454004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.852+0000 7f44427fc640 1 -- 172.21.15.18:0/1397323942 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c035030 con 0x56326d6986f0 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.852+0000 7f44427fc640 1 -- 172.21.15.18:0/1397323942 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f444c005520 con 0x56326d6986f0 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.852+0000 7f44427fc640 1 -- 172.21.15.18:0/1397323942 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c0316b0 con 0x56326d6986f0 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 -- 172.21.15.18:0/1397323942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 msgr2=0x56326d69d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 --2- 172.21.15.18:0/1397323942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 0x56326d69d1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f444c02a930 tx=0x7f444c004040 comp rx=0 tx=0).stop 2024-09-19T09:53:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 -- 172.21.15.18:0/1397323942 shutdown_connections 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 --2- 172.21.15.18:0/1397323942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d69fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 --2- 172.21.15.18:0/1397323942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 0x56326d69d1b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 --2- 172.21.15.18:0/1397323942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d6981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 -- 172.21.15.18:0/1397323942 >> 172.21.15.18:0/1397323942 conn(0x56326d68f010 msgr2=0x56326d68f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 -- 172.21.15.18:0/1397323942 shutdown_connections 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 -- 172.21.15.18:0/1397323942 wait complete. 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 -- start start 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 Processor -- start 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d6a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 0x56326d6a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d6a9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56326d6a06f0 con 0x56326d69d780 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56326d580290 con 0x56326d697db0 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.853+0000 7f446560e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56326d6a0870 con 0x56326d6986f0 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f446560e740 10 client.0 _ll_register_callbacks cb 0x56326d5b1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f4460d37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d6a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f445b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 0x56326d6a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f4460d37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d6a9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43866/0 (socket says 172.21.15.18:43866) 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f4460d37640 1 -- 172.21.15.18:0/1299863324 learned_addr learned my addr 172.21.15.18:0/1299863324 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f445bfff640 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d6a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f4460d37640 1 -- 172.21.15.18:0/1299863324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 msgr2=0x56326d6a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f4460d37640 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 0x56326d6a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f4460d37640 1 -- 172.21.15.18:0/1299863324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 msgr2=0x56326d6a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f4460d37640 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d6a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f4460d37640 1 -- 172.21.15.18:0/1299863324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56326d30a210 con 0x56326d69d780 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f4460d37640 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d6a9530 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4454011b60 tx=0x7f4454004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5c553b08502e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f443b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f443b7fe640 1 -- 172.21.15.18:0/1299863324 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454024070 con 0x56326d69d780 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f443b7fe640 1 -- 172.21.15.18:0/1299863324 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4454010b50 con 0x56326d69d780 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.854+0000 7f446560e740 1 -- 172.21.15.18:0/1299863324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f444c005520 con 0x56326d69d780 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f443b7fe640 1 -- 172.21.15.18:0/1299863324 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4454030050 con 0x56326d69d780 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f446560e740 10 client.15522 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f446560e740 1 -- 172.21.15.18:0/1299863324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56326d3d6620 con 0x56326d69d780 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f443b7fe640 1 -- 172.21.15.18:0/1299863324 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f444c005520 con 0x56326d69d780 2024-09-19T09:53:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f443b7fe640 1 -- 172.21.15.18:0/1299863324 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f445401c3f0 con 0x56326d69d780 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f446560e740 10 client.15522 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f446560e740 10 client.15522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f446560e740 20 client.15522 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f446560e740 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56326d6adca0 0x56326d6b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f446560e740 4 client.15522 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f446560e740 1 -- 172.21.15.18:0/1299863324 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56326d604a20 con 0x56326d6adca0 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.855+0000 7f445bfff640 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56326d6adca0 0x56326d6b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.856+0000 7f443b7fe640 10 client.15522 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.856+0000 7f445bfff640 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56326d6adca0 0x56326d6b00b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d77c62c7f0845356 server_cookie=89d25b327b7b8d03 in_seq=0 out_seq=0 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f443b7fe640 1 -- 172.21.15.18:0/1299863324 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56326d604a20 con 0x56326d6adca0 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f443b7fe640 10 client.15522 handle_command_reply: tid=0 2024-09-19T09:53:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 client.15522 shutdown 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 -- 172.21.15.18:0/1299863324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 msgr2=0x56326d6a9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d6a9530 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4454011b60 tx=0x7f4454004a40 comp rx=0 tx=0).stop 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 -- 172.21.15.18:0/1299863324 shutdown_connections 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56326d6adca0 0x56326d6b00b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d69d780 0x56326d6a9530 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d6986f0 0x56326d6a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f443b7fe640 0 client.15522 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 --2- 172.21.15.18:0/1299863324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d6a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 -- 172.21.15.18:0/1299863324 >> 172.21.15.18:0/1299863324 conn(0x56326d68f010 msgr2=0x56326d690820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 -- 172.21.15.18:0/1299863324 shutdown_connections 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 1 -- 172.21.15.18:0/1299863324 wait complete. 2024-09-19T09:53:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.857+0000 7f446560e740 20 client.15522 trim_cache size 0 max 16384 2024-09-19T09:53:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.876+0000 7f446560e740 1 Processor -- start 2024-09-19T09:53:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.876+0000 7f446560e740 1 -- start start 2024-09-19T09:53:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f446560e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d68fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f446560e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d6986f0 0x56326d6a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f446560e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d69d780 0x56326d690400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f446560e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f445c1a6cc0 con 0x56326d6986f0 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f446560e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f445c1a8800 con 0x56326d697db0 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f446560e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f445c1a7390 con 0x56326d69d780 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f445b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d6986f0 0x56326d6a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f445b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d6986f0 0x56326d6a94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43880/0 (socket says 172.21.15.18:43880) 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f445b7fe640 1 -- 172.21.15.18:0/3020322012 learned_addr learned my addr 172.21.15.18:0/3020322012 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f445bfff640 1 --2- 172.21.15.18:0/3020322012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d68fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f4460d37640 1 --2- 172.21.15.18:0/3020322012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d69d780 0x56326d690400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f445b7fe640 1 -- 172.21.15.18:0/3020322012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d69d780 msgr2=0x56326d690400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f445b7fe640 1 --2- 172.21.15.18:0/3020322012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d69d780 0x56326d690400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f445b7fe640 1 -- 172.21.15.18:0/3020322012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 msgr2=0x56326d68fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f445b7fe640 1 --2- 172.21.15.18:0/3020322012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d68fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f445b7fe640 1 -- 172.21.15.18:0/3020322012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56326d6ac5f0 con 0x56326d6986f0 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f4460d37640 1 --2- 172.21.15.18:0/3020322012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d69d780 0x56326d690400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f445b7fe640 1 --2- 172.21.15.18:0/3020322012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d6986f0 0x56326d6a94f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4450098df0 tx=0x7f445000efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca6dd71cb8ecf00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.877+0000 7f4441ffb640 1 -- 172.21.15.18:0/3020322012 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44500b5070 con 0x56326d6986f0 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f4441ffb640 1 -- 172.21.15.18:0/3020322012 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f445009c420 con 0x56326d6986f0 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f4441ffb640 1 -- 172.21.15.18:0/3020322012 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44500b5210 con 0x56326d6986f0 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f446560e740 1 -- 172.21.15.18:0/3020322012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d6986f0 msgr2=0x56326d6a94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f446560e740 1 --2- 172.21.15.18:0/3020322012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d6986f0 0x56326d6a94f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4450098df0 tx=0x7f445000efb0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f446560e740 1 -- 172.21.15.18:0/3020322012 shutdown_connections 2024-09-19T09:53:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f446560e740 1 --2- 172.21.15.18:0/3020322012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d69d780 0x56326d690400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f446560e740 1 --2- 172.21.15.18:0/3020322012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d6986f0 0x56326d6a94f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f446560e740 1 --2- 172.21.15.18:0/3020322012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d697db0 0x56326d68fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f446560e740 1 -- 172.21.15.18:0/3020322012 >> 172.21.15.18:0/3020322012 conn(0x56326d68f010 msgr2=0x56326d6a1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f446560e740 1 -- 172.21.15.18:0/3020322012 shutdown_connections 2024-09-19T09:53:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.878+0000 7f446560e740 1 -- 172.21.15.18:0/3020322012 wait complete. 2024-09-19T09:53:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f446560e740 1 -- start start 2024-09-19T09:53:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f446560e740 1 Processor -- start 2024-09-19T09:53:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f446560e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d697db0 0x56326d6a6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f446560e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d6986f0 0x56326d6a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f446560e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d69d780 0x56326d6a8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f446560e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f445c1a8130 con 0x56326d697db0 2024-09-19T09:53:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f446560e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f445c1a7a60 con 0x56326d6986f0 2024-09-19T09:53:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f446560e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f445c1a4cc0 con 0x56326d69d780 2024-09-19T09:53:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f446560e740 10 client.0 _ll_register_callbacks cb 0x7f4454013eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f445bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d697db0 0x56326d6a6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f445bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d697db0 0x56326d6a6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43888/0 (socket says 172.21.15.18:43888) 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.879+0000 7f445bfff640 1 -- 172.21.15.18:0/3170499946 learned_addr learned my addr 172.21.15.18:0/3170499946 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f445b7fe640 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d6986f0 0x56326d6a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f445bfff640 1 -- 172.21.15.18:0/3170499946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d69d780 msgr2=0x56326d6a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f445bfff640 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d69d780 0x56326d6a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f445bfff640 1 -- 172.21.15.18:0/3170499946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d6986f0 msgr2=0x56326d6a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f445bfff640 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d6986f0 0x56326d6a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f445bfff640 1 -- 172.21.15.18:0/3170499946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56326d6a8a90 con 0x56326d697db0 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f445b7fe640 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d6986f0 0x56326d6a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f445bfff640 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d697db0 0x56326d6a6f80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f444c009900 tx=0x7f444c005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c609caca441ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f443b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f443b7fe640 1 -- 172.21.15.18:0/3170499946 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c035040 con 0x56326d697db0 2024-09-19T09:53:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f443b7fe640 1 -- 172.21.15.18:0/3170499946 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f444c031ac0 con 0x56326d697db0 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f446560e740 1 -- 172.21.15.18:0/3170499946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56326d5fed70 con 0x56326d697db0 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f443b7fe640 1 -- 172.21.15.18:0/3170499946 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f444c031cc0 con 0x56326d697db0 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f446560e740 10 client.15528 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f446560e740 1 -- 172.21.15.18:0/3170499946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56326d718c70 con 0x56326d697db0 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.880+0000 7f443b7fe640 1 -- 172.21.15.18:0/3170499946 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56326d5fed70 con 0x56326d697db0 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.881+0000 7f443b7fe640 1 -- 172.21.15.18:0/3170499946 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f444c04e040 con 0x56326d697db0 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.881+0000 7f446560e740 10 client.15528 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.881+0000 7f446560e740 10 client.15528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.881+0000 7f446560e740 20 client.15528 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.881+0000 7f446560e740 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56326d7191e0 0x56326d71b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.881+0000 7f446560e740 4 client.15528 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.881+0000 7f446560e740 1 -- 172.21.15.18:0/3170499946 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56326d57b900 con 0x56326d7191e0 2024-09-19T09:53:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.881+0000 7f445b7fe640 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56326d7191e0 0x56326d71b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.882+0000 7f443b7fe640 10 client.15528 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.882+0000 7f445b7fe640 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56326d7191e0 0x56326d71b5d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1640b6b40c334482 server_cookie=44552207d106f95b in_seq=0 out_seq=0 2024-09-19T09:53:12.890 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:12 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4282083831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.885+0000 7f443b7fe640 1 -- 172.21.15.18:0/3170499946 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56326d57b900 con 0x56326d7191e0 2024-09-19T09:53:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.885+0000 7f443b7fe640 10 client.15528 handle_command_reply: tid=0 2024-09-19T09:53:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.885+0000 7f446560e740 1 client.15528 shutdown 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 1 -- 172.21.15.18:0/3170499946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d697db0 msgr2=0x56326d6a6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d697db0 0x56326d6a6f80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f444c009900 tx=0x7f444c005750 comp rx=0 tx=0).stop 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 1 -- 172.21.15.18:0/3170499946 shutdown_connections 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56326d7191e0 0x56326d71b5d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56326d69d780 0x56326d6a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56326d6986f0 0x56326d6a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f443b7fe640 0 client.15528 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 1 --2- 172.21.15.18:0/3170499946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56326d697db0 0x56326d6a6f80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 1 -- 172.21.15.18:0/3170499946 >> 172.21.15.18:0/3170499946 conn(0x56326d68f010 msgr2=0x56326d68d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 1 -- 172.21.15.18:0/3170499946 shutdown_connections 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 1 -- 172.21.15.18:0/3170499946 wait complete. 2024-09-19T09:53:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446560e740 20 client.15528 trim_cache size 0 max 16384 2024-09-19T09:53:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:53:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:53:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:53:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:53:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446279a640 1 -- 172.21.15.18:0/3425453605 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44440a32f0 msgr2=0x7f44440a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446279a640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44440a32f0 0x7f44440a57b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f445c06b380 tx=0x7f4454004ab0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446279a640 1 -- 172.21.15.18:0/3425453605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445c104f60 msgr2=0x7f445c198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.886+0000 7f446279a640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445c104f60 0x7f445c198320 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f445000e9c0 tx=0x7f445000ee80 comp rx=0 tx=0).stop 2024-09-19T09:53:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.887+0000 7f446279a640 1 -- 172.21.15.18:0/3425453605 shutdown_connections 2024-09-19T09:53:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.887+0000 7f446279a640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44440a32f0 0x7f44440a57b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.887+0000 7f446279a640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f445c107890 0x7f445c19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.887+0000 7f446279a640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445c104f60 0x7f445c198320 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.887+0000 7f446279a640 1 --2- 172.21.15.18:0/3425453605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f445c102630 0x7f445c197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.887+0000 7f446279a640 1 -- 172.21.15.18:0/3425453605 >> 172.21.15.18:0/3425453605 conn(0x7f445c0fc1b0 msgr2=0x7f445c102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.887+0000 7f446279a640 1 -- 172.21.15.18:0/3425453605 shutdown_connections 2024-09-19T09:53:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:12.887+0000 7f446279a640 1 -- 172.21.15.18:0/3425453605 wait complete. 2024-09-19T09:53:12.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:12 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/4282083831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:12.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:12 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/4282083831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:13.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:13 smithi018 ceph-mon[30956]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:13.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:13 smithi049 ceph-mon[34858]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:13.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:13 smithi162 ceph-mon[35174]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:15.715 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:15 smithi162 ceph-mon[35174]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T09:53:15.720 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:15 smithi049 ceph-mon[34858]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T09:53:15.826 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:15 smithi018 ceph-mon[30956]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T09:53:16.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.529+0000 7f34c0531640 1 -- 172.21.15.18:0/372447031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8102d40 msgr2=0x7f34b8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.529+0000 7f34c0531640 1 --2- 172.21.15.18:0/372447031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8102d40 0x7f34b8103120 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009900 tx=0x7f34b402a480 comp rx=0 tx=0).stop 2024-09-19T09:53:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.530+0000 7f34c0531640 1 -- 172.21.15.18:0/372447031 shutdown_connections 2024-09-19T09:53:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.530+0000 7f34c0531640 1 --2- 172.21.15.18:0/372447031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b810c170 0x7f34b810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.530+0000 7f34c0531640 1 --2- 172.21.15.18:0/372447031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34b8103660 0x7f34b810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.530+0000 7f34c0531640 1 --2- 172.21.15.18:0/372447031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8102d40 0x7f34b8103120 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.530+0000 7f34c0531640 1 -- 172.21.15.18:0/372447031 >> 172.21.15.18:0/372447031 conn(0x7f34b80fc780 msgr2=0x7f34b80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.530+0000 7f34c0531640 1 -- 172.21.15.18:0/372447031 shutdown_connections 2024-09-19T09:53:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.530+0000 7f34c0531640 1 -- 172.21.15.18:0/372447031 wait complete. 2024-09-19T09:53:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.530+0000 7f34c0531640 1 Processor -- start 2024-09-19T09:53:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.530+0000 7f34c0531640 1 -- start start 2024-09-19T09:53:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34c0531640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34b8102d40 0x7f34b81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34c0531640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8103660 0x7f34b8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34c0531640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b810c170 0x7f34b8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34bdacc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8103660 0x7f34b8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34c0531640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34b8111f70 con 0x7f34b8103660 2024-09-19T09:53:16.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34be2cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34b8102d40 0x7f34b81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34c0531640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f34b8111df0 con 0x7f34b8102d40 2024-09-19T09:53:16.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34c0531640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81120f0 con 0x7f34b810c170 2024-09-19T09:53:16.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34be2cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34b8102d40 0x7f34b81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:56004/0 (socket says 172.21.15.18:56004) 2024-09-19T09:53:16.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34be2cd640 1 -- 172.21.15.18:0/699449592 learned_addr learned my addr 172.21.15.18:0/699449592 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:16.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34beace640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b810c170 0x7f34b8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34be2cd640 1 -- 172.21.15.18:0/699449592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b810c170 msgr2=0x7f34b8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:16.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34be2cd640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b810c170 0x7f34b8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34be2cd640 1 -- 172.21.15.18:0/699449592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8103660 msgr2=0x7f34b8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:16.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34be2cd640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8103660 0x7f34b8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34be2cd640 1 -- 172.21.15.18:0/699449592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b81aae20 con 0x7f34b8102d40 2024-09-19T09:53:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.531+0000 7f34beace640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b810c170 0x7f34b8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.532+0000 7f34bdacc640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8103660 0x7f34b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.532+0000 7f34be2cd640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34b8102d40 0x7f34b81009a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f34b4006010 tx=0x7f34b40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.532+0000 7f34af7fe640 1 -- 172.21.15.18:0/699449592 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b403f030 con 0x7f34b8102d40 2024-09-19T09:53:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.532+0000 7f34af7fe640 1 -- 172.21.15.18:0/699449592 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b4003ce0 con 0x7f34b8102d40 2024-09-19T09:53:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.532+0000 7f34c0531640 1 -- 172.21.15.18:0/699449592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b81aaff0 con 0x7f34b8102d40 2024-09-19T09:53:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.532+0000 7f34af7fe640 1 -- 172.21.15.18:0/699449592 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4035070 con 0x7f34b8102d40 2024-09-19T09:53:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.532+0000 7f34c0531640 1 -- 172.21.15.18:0/699449592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b81ab440 con 0x7f34b8102d40 2024-09-19T09:53:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.534+0000 7f34af7fe640 1 -- 172.21.15.18:0/699449592 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f34b4042030 con 0x7f34b8102d40 2024-09-19T09:53:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.535+0000 7f34af7fe640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34a40a32c0 0x7f34a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.535+0000 7f34c290a740 1 Processor -- start 2024-09-19T09:53:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.535+0000 7f34bdacc640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34a40a32c0 0x7f34a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.535+0000 7f34c290a740 1 -- start start 2024-09-19T09:53:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.535+0000 7f34af7fe640 1 -- 172.21.15.18:0/699449592 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f34b40efd80 con 0x7f34b8102d40 2024-09-19T09:53:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34c290a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dd95b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34c290a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 0x559c6dda0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34c290a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dda0940 0x559c6dda2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34c290a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559c6dcfb2a0 con 0x559c6dd95760 2024-09-19T09:53:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34c290a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559c6dca2b10 con 0x559c6dda0940 2024-09-19T09:53:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34c290a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559c6dcf7260 con 0x559c6dd96080 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34be2cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dd95b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34be2cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dd95b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56534/0 (socket says 172.21.15.18:56534) 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34be2cd640 1 -- 172.21.15.18:0/1363711510 learned_addr learned my addr 172.21.15.18:0/1363711510 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34beace640 1 --2- 172.21.15.18:0/1363711510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dda0940 0x559c6dda2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34bdacc640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34a40a32c0 0x7f34a40a5780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f34b8102160 tx=0x7f34a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34bdacc640 1 --2- 172.21.15.18:0/1363711510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 0x559c6dda0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34be2cd640 1 -- 172.21.15.18:0/1363711510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 msgr2=0x559c6dda0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34be2cd640 1 --2- 172.21.15.18:0/1363711510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 0x559c6dda0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34be2cd640 1 -- 172.21.15.18:0/1363711510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dda0940 msgr2=0x559c6dda2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34be2cd640 1 --2- 172.21.15.18:0/1363711510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dda0940 0x559c6dda2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.536+0000 7f34be2cd640 1 -- 172.21.15.18:0/1363711510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c6da6cb90 con 0x559c6dd95760 2024-09-19T09:53:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.537+0000 7f34bdacc640 1 --2- 172.21.15.18:0/1363711510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 0x559c6dda0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:16.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.537+0000 7f34be2cd640 1 --2- 172.21.15.18:0/1363711510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dd95b40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f34b40ed7c0 tx=0x7f34b4031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0deb07974afa02d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:16.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.537+0000 7f34acff9640 1 -- 172.21.15.18:0/1363711510 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4049050 con 0x559c6dd95760 2024-09-19T09:53:16.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.537+0000 7f34acff9640 1 -- 172.21.15.18:0/1363711510 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b40bcb30 con 0x559c6dd95760 2024-09-19T09:53:16.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.537+0000 7f34acff9640 1 -- 172.21.15.18:0/1363711510 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40c50a0 con 0x559c6dd95760 2024-09-19T09:53:16.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.538+0000 7f34c290a740 1 -- 172.21.15.18:0/1363711510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 msgr2=0x559c6dd95b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:16.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.538+0000 7f34c290a740 1 --2- 172.21.15.18:0/1363711510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dd95b40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f34b40ed7c0 tx=0x7f34b4031a60 comp rx=0 tx=0).stop 2024-09-19T09:53:16.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.538+0000 7f34c290a740 1 -- 172.21.15.18:0/1363711510 shutdown_connections 2024-09-19T09:53:16.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.538+0000 7f34c290a740 1 --2- 172.21.15.18:0/1363711510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dda0940 0x559c6dda2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.538+0000 7f34c290a740 1 --2- 172.21.15.18:0/1363711510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 0x559c6dda0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.538+0000 7f34c290a740 1 --2- 172.21.15.18:0/1363711510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dd95b40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.538+0000 7f34c290a740 1 -- 172.21.15.18:0/1363711510 >> 172.21.15.18:0/1363711510 conn(0x559c6dd91cf0 msgr2=0x559c6dd920d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:16.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.539+0000 7f34c290a740 1 -- 172.21.15.18:0/1363711510 shutdown_connections 2024-09-19T09:53:16.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.539+0000 7f34c290a740 1 -- 172.21.15.18:0/1363711510 wait complete. 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.539+0000 7f34c290a740 1 -- start start 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.539+0000 7f34c290a740 1 Processor -- start 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34c290a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd95760 0x559c6dd9d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34c290a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 0x559c6dd9dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34c290a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 0x559c6dd9e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34be2cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd95760 0x559c6dd9d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34be2cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd95760 0x559c6dd9d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:56034/0 (socket says 172.21.15.18:56034) 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34beace640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 0x559c6dd9e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34beace640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 0x559c6dd9e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56542/0 (socket says 172.21.15.18:56542) 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34be2cd640 1 -- 172.21.15.18:0/4186386592 learned_addr learned my addr 172.21.15.18:0/4186386592 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559c6dda32d0 con 0x559c6dda0940 2024-09-19T09:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559c6dc836e0 con 0x559c6dd95760 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559c6dda3450 con 0x559c6dd96080 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34bdacc640 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 0x559c6dd9dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34be2cd640 1 -- 172.21.15.18:0/4186386592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 msgr2=0x559c6dd9dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34be2cd640 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 0x559c6dd9dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34be2cd640 1 -- 172.21.15.18:0/4186386592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 msgr2=0x559c6dd9e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34be2cd640 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 0x559c6dd9e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34be2cd640 1 -- 172.21.15.18:0/4186386592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c6ddac7b0 con 0x559c6dd95760 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.540+0000 7f34beace640 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 0x559c6dd9e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34c290a740 10 client.0 _ll_register_callbacks cb 0x559c6dca7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34b40bcb30 con 0x559c6dd95760 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34be2cd640 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd95760 0x559c6dd9d860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34b40bc3c0 tx=0x7f34b40b8cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c26ba7a449eab952 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34a1ffb640 10 client.25214 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34a1ffb640 1 -- 172.21.15.18:0/4186386592 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40da060 con 0x559c6dd95760 2024-09-19T09:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34a1ffb640 1 -- 172.21.15.18:0/4186386592 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f34b40c4e20 con 0x559c6dd95760 2024-09-19T09:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34a1ffb640 1 -- 172.21.15.18:0/4186386592 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34b40c50a0 con 0x559c6dd95760 2024-09-19T09:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34c290a740 10 client.25214 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559c6ddaebf0 con 0x559c6dd95760 2024-09-19T09:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34a1ffb640 1 -- 172.21.15.18:0/4186386592 <== mon.2 v2:172.21.15.49:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34b403bbb0 con 0x559c6dd95760 2024-09-19T09:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34c290a740 10 client.25214 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34c290a740 10 client.25214 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.541+0000 7f34c290a740 20 client.25214 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.542+0000 7f34c290a740 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559c6ddafe10 0x559c6ddb2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.542+0000 7f34c290a740 4 client.25214 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.542+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c6dd089d0 con 0x559c6ddafe10 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.542+0000 7f34bdacc640 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559c6ddafe10 0x559c6ddb2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.542+0000 7f34bdacc640 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559c6ddafe10 0x559c6ddb2240 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a9f2761a329ebe2 server_cookie=f774a38a376af580 in_seq=0 out_seq=0 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.542+0000 7f34a1ffb640 10 client.25214 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34a1ffb640 1 -- 172.21.15.18:0/4186386592 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c6dd089d0 con 0x559c6ddafe10 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34a1ffb640 10 client.25214 handle_command_reply: tid=0 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34c290a740 1 client.25214 shutdown 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd95760 msgr2=0x559c6dd9d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34c290a740 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd95760 0x559c6dd9d860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34b40bc3c0 tx=0x7f34b40b8cd0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 shutdown_connections 2024-09-19T09:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34c290a740 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559c6ddafe10 0x559c6ddb2240 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34a1ffb640 0 client.25214 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34c290a740 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 0x559c6dd9e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34c290a740 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd96080 0x559c6dd9dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34c290a740 1 --2- 172.21.15.18:0/4186386592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd95760 0x559c6dd9d860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.543+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 >> 172.21.15.18:0/4186386592 conn(0x559c6dd91cf0 msgr2=0x559c6dd979d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.544+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 shutdown_connections 2024-09-19T09:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.544+0000 7f34c290a740 1 -- 172.21.15.18:0/4186386592 wait complete. 2024-09-19T09:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.544+0000 7f34c290a740 20 client.25214 trim_cache size 0 max 16384 2024-09-19T09:53:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34c290a740 1 Processor -- start 2024-09-19T09:53:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34c290a740 1 -- start start 2024-09-19T09:53:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34c290a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd95760 0x559c6dd981c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34c290a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6ddabc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34c290a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 0x559c6ddac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34c290a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81b3ac0 con 0x559c6dda0940 2024-09-19T09:53:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34c290a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81b5600 con 0x559c6dd96080 2024-09-19T09:53:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34c290a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81b4190 con 0x559c6dd95760 2024-09-19T09:53:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34bdacc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6ddabc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34beace640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 0x559c6ddac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34bdacc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6ddabc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:56048/0 (socket says 172.21.15.18:56048) 2024-09-19T09:53:16.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.577+0000 7f34bdacc640 1 -- 172.21.15.18:0/489877655 learned_addr learned my addr 172.21.15.18:0/489877655 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:16.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.578+0000 7f34be2cd640 1 --2- 172.21.15.18:0/489877655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd95760 0x559c6dd981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.578+0000 7f34bdacc640 1 -- 172.21.15.18:0/489877655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd95760 msgr2=0x559c6dd981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:16.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.578+0000 7f34bdacc640 1 --2- 172.21.15.18:0/489877655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd95760 0x559c6dd981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.578+0000 7f34bdacc640 1 -- 172.21.15.18:0/489877655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 msgr2=0x559c6ddac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:16.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.578+0000 7f34bdacc640 1 --2- 172.21.15.18:0/489877655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 0x559c6ddac170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.578+0000 7f34bdacc640 1 -- 172.21.15.18:0/489877655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c6dd8d260 con 0x559c6dd96080 2024-09-19T09:53:16.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.578+0000 7f34bdacc640 1 --2- 172.21.15.18:0/489877655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6ddabc30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f34b81021f0 tx=0x7f34a8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=441199162e6dcec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:16.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.578+0000 7f34a3fff640 1 -- 172.21.15.18:0/489877655 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a802d070 con 0x559c6dd96080 2024-09-19T09:53:16.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.578+0000 7f34a3fff640 1 -- 172.21.15.18:0/489877655 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34a8027370 con 0x559c6dd96080 2024-09-19T09:53:16.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.578+0000 7f34a3fff640 1 -- 172.21.15.18:0/489877655 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a800f6e0 con 0x559c6dd96080 2024-09-19T09:53:16.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.579+0000 7f34c290a740 1 -- 172.21.15.18:0/489877655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 msgr2=0x559c6ddabc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:16.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.579+0000 7f34c290a740 1 --2- 172.21.15.18:0/489877655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6ddabc30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f34b81021f0 tx=0x7f34a8014000 comp rx=0 tx=0).stop 2024-09-19T09:53:16.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.579+0000 7f34c290a740 1 -- 172.21.15.18:0/489877655 shutdown_connections 2024-09-19T09:53:16.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.579+0000 7f34c290a740 1 --2- 172.21.15.18:0/489877655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dda0940 0x559c6ddac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.579+0000 7f34c290a740 1 --2- 172.21.15.18:0/489877655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6ddabc30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.579+0000 7f34c290a740 1 --2- 172.21.15.18:0/489877655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dd95760 0x559c6dd981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.579+0000 7f34c290a740 1 -- 172.21.15.18:0/489877655 >> 172.21.15.18:0/489877655 conn(0x559c6dd91cf0 msgr2=0x559c6ddab520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.579+0000 7f34c290a740 1 -- 172.21.15.18:0/489877655 shutdown_connections 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.579+0000 7f34c290a740 1 -- 172.21.15.18:0/489877655 wait complete. 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34c290a740 1 -- start start 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34c290a740 1 Processor -- start 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34c290a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dda4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34c290a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6dda5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34c290a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dda0940 0x559c6de12ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34c290a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81b4f30 con 0x559c6dd95760 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34c290a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81b4860 con 0x559c6dd96080 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34c290a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81b1aa0 con 0x559c6dda0940 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34c290a740 10 client.0 _ll_register_callbacks cb 0x7f34b40bbf90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34be2cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dda4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34be2cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dda4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56560/0 (socket says 172.21.15.18:56560) 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34be2cd640 1 -- 172.21.15.18:0/1640565451 learned_addr learned my addr 172.21.15.18:0/1640565451 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.580+0000 7f34bdacc640 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6dda5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34beace640 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dda0940 0x559c6de12ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34be2cd640 1 -- 172.21.15.18:0/1640565451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dda0940 msgr2=0x559c6de12ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34be2cd640 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dda0940 0x559c6de12ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34be2cd640 1 -- 172.21.15.18:0/1640565451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 msgr2=0x559c6dda5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34be2cd640 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6dda5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34be2cd640 1 -- 172.21.15.18:0/1640565451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c6de132e0 con 0x559c6dd95760 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34bdacc640 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6dda5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34be2cd640 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dda4ff0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f34b40ed850 tx=0x7f34b40dc070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678d6ccbcd8f47c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34a1ffb640 1 -- 172.21.15.18:0/1640565451 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4049070 con 0x559c6dd95760 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34a1ffb640 1 -- 172.21.15.18:0/1640565451 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f34b40bba80 con 0x559c6dd95760 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.581+0000 7f34c290a740 1 -- 172.21.15.18:0/1640565451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34a8027370 con 0x559c6dd95760 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34a1ffb640 1 -- 172.21.15.18:0/1640565451 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34b40b6050 con 0x559c6dd95760 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34c290a740 10 client.15546 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34c290a740 1 -- 172.21.15.18:0/1640565451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559c6de132e0 con 0x559c6dd95760 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34a1ffb640 1 -- 172.21.15.18:0/1640565451 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34a8027370 con 0x559c6dd95760 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34a1ffb640 1 -- 172.21.15.18:0/1640565451 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34b40c6070 con 0x559c6dd95760 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34c290a740 10 client.15546 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34c290a740 10 client.15546 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34c290a740 20 client.15546 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34c290a740 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559c6ddafe10 0x559c6de1db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:16.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34c290a740 4 client.15546 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T09:53:16.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34c290a740 1 -- 172.21.15.18:0/1640565451 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x559c6dd02d20 con 0x559c6ddafe10 2024-09-19T09:53:16.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.582+0000 7f34bdacc640 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559c6ddafe10 0x559c6de1db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:16.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.583+0000 7f34a1ffb640 10 client.15546 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:16.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.583+0000 7f34bdacc640 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559c6ddafe10 0x559c6de1db00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=695dc53af109e861 server_cookie=1c8d136f71ba0bab in_seq=0 out_seq=0 2024-09-19T09:53:16.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34a1ffb640 1 -- 172.21.15.18:0/1640565451 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559c6dd02d20 con 0x559c6ddafe10 2024-09-19T09:53:16.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34a1ffb640 10 client.15546 handle_command_reply: tid=0 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34c290a740 1 client.15546 shutdown 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34c290a740 1 -- 172.21.15.18:0/1640565451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 msgr2=0x559c6dda4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34c290a740 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dda4ff0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f34b40ed850 tx=0x7f34b40dc070 comp rx=0 tx=0).stop 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34c290a740 1 -- 172.21.15.18:0/1640565451 shutdown_connections 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34c290a740 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559c6ddafe10 0x559c6de1db00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34a1ffb640 0 client.15546 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34c290a740 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c6dda0940 0x559c6de12ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34c290a740 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559c6dd96080 0x559c6dda5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34c290a740 1 --2- 172.21.15.18:0/1640565451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c6dd95760 0x559c6dda4ff0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.597+0000 7f34c290a740 1 -- 172.21.15.18:0/1640565451 >> 172.21.15.18:0/1640565451 conn(0x559c6dd91cf0 msgr2=0x559c6ddabd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c290a740 1 -- 172.21.15.18:0/1640565451 shutdown_connections 2024-09-19T09:53:16.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c290a740 1 -- 172.21.15.18:0/1640565451 wait complete. 2024-09-19T09:53:16.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c290a740 20 client.15546 trim_cache size 0 max 16384 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 2, 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "d90a2605": { 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 2, 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:53:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 131.2, 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:16.605 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:53:16.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 -- 172.21.15.18:0/699449592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34a40a32c0 msgr2=0x7f34a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:16.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34a40a32c0 0x7f34a40a5780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f34b8102160 tx=0x7f34a8005f90 comp rx=0 tx=0).stop 2024-09-19T09:53:16.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 -- 172.21.15.18:0/699449592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34b8102d40 msgr2=0x7f34b81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:16.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34b8102d40 0x7f34b81009a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f34b4006010 tx=0x7f34b40042f0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 -- 172.21.15.18:0/699449592 shutdown_connections 2024-09-19T09:53:16.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34a40a32c0 0x7f34a40a5780 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b810c170 0x7f34b8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8103660 0x7f34b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 --2- 172.21.15.18:0/699449592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34b8102d40 0x7f34b81009a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:16.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 -- 172.21.15.18:0/699449592 >> 172.21.15.18:0/699449592 conn(0x7f34b80fc780 msgr2=0x7f34b80fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:16.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.598+0000 7f34c0531640 1 -- 172.21.15.18:0/699449592 shutdown_connections 2024-09-19T09:53:16.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:16.599+0000 7f34c0531640 1 -- 172.21.15.18:0/699449592 wait complete. 2024-09-19T09:53:17.285 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd90a2605', quiesce took 7.9 seconds. Will release after: 3.299999999999999 2024-09-19T09:53:17.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:17 smithi018 ceph-mon[30956]: pgmap v367: 97 pgs: 97 active+clean; 658 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:17.747 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:53:17.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:17 smithi049 ceph-mon[34858]: pgmap v367: 97 pgs: 97 active+clean; 658 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:17.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:17 smithi162 ceph-mon[35174]: pgmap v367: 97 pgs: 97 active+clean; 658 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:18.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.607+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2565649208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e8102570 msgr2=0x7fe8e81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:18.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.607+0000 7fe8ef0a0640 1 --2- 172.21.15.18:0/2565649208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e8102570 0x7fe8e81029b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009900 tx=0x7fe8d402a480 comp rx=0 tx=0).stop 2024-09-19T09:53:18.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.607+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2565649208 shutdown_connections 2024-09-19T09:53:18.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.607+0000 7fe8ef0a0640 1 --2- 172.21.15.18:0/2565649208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e8102ef0 0x7fe8e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.607+0000 7fe8ef0a0640 1 --2- 172.21.15.18:0/2565649208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e8102570 0x7fe8e81029b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.607+0000 7fe8ef0a0640 1 --2- 172.21.15.18:0/2565649208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e8100e20 0x7fe8e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.607+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2565649208 >> 172.21.15.18:0/2565649208 conn(0x7fe8e80fc7d0 msgr2=0x7fe8e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.607+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2565649208 shutdown_connections 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.607+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2565649208 wait complete. 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.608+0000 7fe8ef0a0640 1 Processor -- start 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.608+0000 7fe8ef0a0640 1 -- start start 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ef0a0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e8100e20 0x7fe8e80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ef0a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e8102570 0x7fe8e80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ef0a0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e8102ef0 0x7fe8e80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ef0a0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8110fa0 con 0x7fe8e8100e20 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ef0a0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8110e20 con 0x7fe8e8102570 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ef0a0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8111120 con 0x7fe8e8102ef0 2024-09-19T09:53:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ece3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e8100e20 0x7fe8e80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ece3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e8100e20 0x7fe8e80fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56574/0 (socket says 172.21.15.18:56574) 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ece3c640 1 -- 172.21.15.18:0/2541452105 learned_addr learned my addr 172.21.15.18:0/2541452105 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e8102ef0 0x7fe8e80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8e7fff640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e8102570 0x7fe8e80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ece3c640 1 -- 172.21.15.18:0/2541452105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e8102ef0 msgr2=0x7fe8e80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e8102ef0 0x7fe8e80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ece3c640 1 -- 172.21.15.18:0/2541452105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e8102570 msgr2=0x7fe8e80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e8102570 0x7fe8e80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ece3c640 1 -- 172.21.15.18:0/2541452105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e81a6980 con 0x7fe8e8100e20 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8e7fff640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e8102570 0x7fe8e80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.609+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e8102ef0 0x7fe8e80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:18.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.610+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e8100e20 0x7fe8e80fcc80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00c920 tx=0x7fe8dc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:18.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.610+0000 7fe8e5ffb640 1 -- 172.21.15.18:0/2541452105 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc007c70 con 0x7fe8e8100e20 2024-09-19T09:53:18.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.610+0000 7fe8e5ffb640 1 -- 172.21.15.18:0/2541452105 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8dc007e10 con 0x7fe8e8100e20 2024-09-19T09:53:18.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.610+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2541452105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e81a6c70 con 0x7fe8e8100e20 2024-09-19T09:53:18.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.610+0000 7fe8e5ffb640 1 -- 172.21.15.18:0/2541452105 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc018890 con 0x7fe8e8100e20 2024-09-19T09:53:18.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.610+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2541452105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e81a7160 con 0x7fe8e8100e20 2024-09-19T09:53:18.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.613+0000 7fe8f1479740 1 Processor -- start 2024-09-19T09:53:18.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.613+0000 7fe8f1479740 1 -- start start 2024-09-19T09:53:18.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.613+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 0x5619279b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.613+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 0x5619279b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279bc370 0x5619279be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8f1479740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5619279172f0 con 0x5619279b15d0 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8f1479740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5619278becf0 con 0x5619279b2b40 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8f1479740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5619279132b0 con 0x5619279bc370 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8ed63d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 0x5619279b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8ed63d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 0x5619279b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:56096/0 (socket says 172.21.15.18:56096) 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8ed63d640 1 -- 172.21.15.18:0/1357531050 learned_addr learned my addr 172.21.15.18:0/1357531050 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8e7fff640 1 --2- 172.21.15.18:0/1357531050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279bc370 0x5619279be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8ed63d640 1 -- 172.21.15.18:0/1357531050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279bc370 msgr2=0x5619279be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/1357531050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279bc370 0x5619279be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8ed63d640 1 -- 172.21.15.18:0/1357531050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 msgr2=0x5619279b1a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:18.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/1357531050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 0x5619279b1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.614+0000 7fe8ed63d640 1 -- 172.21.15.18:0/1357531050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619278a33a0 con 0x5619279b2b40 2024-09-19T09:53:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.615+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/1357531050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 0x5619279b1090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009fd0 tx=0x7fe8e0010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8a9c14a3efdc9a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.615+0000 7fe8d2ffd640 1 -- 172.21.15.18:0/1357531050 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0011700 con 0x5619279b2b40 2024-09-19T09:53:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.615+0000 7fe8e5ffb640 1 -- 172.21.15.18:0/2541452105 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe8dc018a70 con 0x7fe8e8100e20 2024-09-19T09:53:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.615+0000 7fe8d2ffd640 1 -- 172.21.15.18:0/1357531050 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e0011d80 con 0x5619279b2b40 2024-09-19T09:53:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.615+0000 7fe8d2ffd640 1 -- 172.21.15.18:0/1357531050 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e000e3c0 con 0x5619279b2b40 2024-09-19T09:53:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8f1479740 1 -- 172.21.15.18:0/1357531050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 msgr2=0x5619279b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1357531050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 0x5619279b1090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009fd0 tx=0x7fe8e0010860 comp rx=0 tx=0).stop 2024-09-19T09:53:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8f1479740 1 -- 172.21.15.18:0/1357531050 shutdown_connections 2024-09-19T09:53:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1357531050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279bc370 0x5619279be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1357531050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 0x5619279b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1357531050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 0x5619279b1090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8f1479740 1 -- 172.21.15.18:0/1357531050 >> 172.21.15.18:0/1357531050 conn(0x56192797a310 msgr2=0x5619279adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8f1479740 1 -- 172.21.15.18:0/1357531050 shutdown_connections 2024-09-19T09:53:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8f1479740 1 -- 172.21.15.18:0/1357531050 wait complete. 2024-09-19T09:53:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8e5ffb640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8d80a3160 0x7fe8d80a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.616+0000 7fe8f1479740 1 -- start start 2024-09-19T09:53:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.617+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8d80a3160 0x7fe8d80a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.617+0000 7fe8e5ffb640 1 -- 172.21.15.18:0/2541452105 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe8dc0cfae0 con 0x7fe8e8100e20 2024-09-19T09:53:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.617+0000 7fe8f1479740 1 Processor -- start 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.617+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8d80a3160 0x7fe8d80a5620 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0005bf0 tx=0x7fe8e0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 0x5619279bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b2b40 0x5619279b9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279bc370 0x5619279b9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8f1479740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5619279bf070 con 0x5619279b15d0 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8f1479740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5619278d2060 con 0x5619279bc370 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8f1479740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5619279bf1f0 con 0x5619279b2b40 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8ece3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 0x5619279bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8ece3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 0x5619279bbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56578/0 (socket says 172.21.15.18:56578) 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8ece3c640 1 -- 172.21.15.18:0/2342758488 learned_addr learned my addr 172.21.15.18:0/2342758488 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8e7fff640 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b2b40 0x5619279b9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279bc370 0x5619279b9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8ece3c640 1 -- 172.21.15.18:0/2342758488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b2b40 msgr2=0x5619279b9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b2b40 0x5619279b9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8ece3c640 1 -- 172.21.15.18:0/2342758488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279bc370 msgr2=0x5619279b9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279bc370 0x5619279b9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8ece3c640 1 -- 172.21.15.18:0/2342758488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619276883c0 con 0x5619279b15d0 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279bc370 0x5619279b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8f1479740 10 client.0 _ll_register_callbacks cb 0x5619276258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.618+0000 7fe8f1479740 1 -- 172.21.15.18:0/2342758488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e0011d80 con 0x5619279b15d0 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 0x5619279bbd90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc09c0c0 tx=0x7fe8dc00dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b2a8ae7bf97aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8c7fff640 10 client.15555 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:18.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8c7fff640 1 -- 172.21.15.18:0/2342758488 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0a04e0 con 0x5619279b15d0 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8c7fff640 1 -- 172.21.15.18:0/2342758488 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe8dc00fb30 con 0x5619279b15d0 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8c7fff640 1 -- 172.21.15.18:0/2342758488 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe8dc0a4da0 con 0x5619279b15d0 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8f1479740 10 client.15555 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8f1479740 1 -- 172.21.15.18:0/2342758488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5619279c3de0 con 0x5619279b15d0 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8c7fff640 1 -- 172.21.15.18:0/2342758488 <== mon.0 v2:172.21.15.18:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe8dc0bc070 con 0x5619279b15d0 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8f1479740 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8f1479740 10 client.15555 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8f1479740 20 client.15555 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.619+0000 7fe8f1479740 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5619279c5190 0x5619279c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.620+0000 7fe8e7fff640 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5619279c5190 0x5619279c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.620+0000 7fe8f1479740 4 client.15555 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.620+0000 7fe8f1479740 1 -- 172.21.15.18:0/2342758488 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561927924860 con 0x5619279c5190 2024-09-19T09:53:18.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.620+0000 7fe8e7fff640 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5619279c5190 0x5619279c75e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a6830d163196c259 server_cookie=fd11e5444f822906 in_seq=0 out_seq=0 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.620+0000 7fe8c7fff640 10 client.15555 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8c7fff640 1 -- 172.21.15.18:0/2342758488 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561927924860 con 0x5619279c5190 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8c7fff640 10 client.15555 handle_command_reply: tid=0 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8f1479740 1 client.15555 shutdown 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8f1479740 1 -- 172.21.15.18:0/2342758488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 msgr2=0x5619279bbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8f1479740 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 0x5619279bbd90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc09c0c0 tx=0x7fe8dc00dee0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8f1479740 1 -- 172.21.15.18:0/2342758488 shutdown_connections 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8f1479740 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5619279c5190 0x5619279c75e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8f1479740 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279bc370 0x5619279b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8f1479740 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b2b40 0x5619279b9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8f1479740 1 --2- 172.21.15.18:0/2342758488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279b15d0 0x5619279bbd90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8f1479740 1 -- 172.21.15.18:0/2342758488 >> 172.21.15.18:0/2342758488 conn(0x56192797a310 msgr2=0x5619279b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:18.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.621+0000 7fe8c7fff640 0 client.15555 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:18.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.622+0000 7fe8f1479740 1 -- 172.21.15.18:0/2342758488 shutdown_connections 2024-09-19T09:53:18.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.622+0000 7fe8f1479740 1 -- 172.21.15.18:0/2342758488 wait complete. 2024-09-19T09:53:18.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.622+0000 7fe8f1479740 20 client.15555 trim_cache size 0 max 16384 2024-09-19T09:53:18.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.647+0000 7fe8f1479740 1 Processor -- start 2024-09-19T09:53:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.647+0000 7fe8f1479740 1 -- start start 2024-09-19T09:53:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.647+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b15d0 0x5619279b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.647+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 0x5619279e7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.647+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279e7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.647+0000 7fe8f1479740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e806fbd0 con 0x5619279bc370 2024-09-19T09:53:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.647+0000 7fe8f1479740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8071710 con 0x5619279b2b40 2024-09-19T09:53:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.647+0000 7fe8f1479740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e80702a0 con 0x5619279b15d0 2024-09-19T09:53:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ed63d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279e7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ed63d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279e7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56582/0 (socket says 172.21.15.18:56582) 2024-09-19T09:53:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ed63d640 1 -- 172.21.15.18:0/1801159700 learned_addr learned my addr 172.21.15.18:0/1801159700 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8e7fff640 1 --2- 172.21.15.18:0/1801159700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 0x5619279e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/1801159700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b15d0 0x5619279b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ed63d640 1 -- 172.21.15.18:0/1801159700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b15d0 msgr2=0x5619279b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/1801159700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b15d0 0x5619279b9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ed63d640 1 -- 172.21.15.18:0/1801159700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 msgr2=0x5619279e7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/1801159700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 0x5619279e7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ed63d640 1 -- 172.21.15.18:0/1801159700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619279b8010 con 0x5619279bc370 2024-09-19T09:53:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/1801159700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b15d0 0x5619279b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.648+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/1801159700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279e7ed0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001bb60 tx=0x7fe8e0010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9981e42f5752ad3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.649+0000 7fe8d27fc640 1 -- 172.21.15.18:0/1801159700 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0022070 con 0x5619279bc370 2024-09-19T09:53:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.649+0000 7fe8d27fc640 1 -- 172.21.15.18:0/1801159700 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e00119e0 con 0x5619279bc370 2024-09-19T09:53:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.649+0000 7fe8d27fc640 1 -- 172.21.15.18:0/1801159700 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0005810 con 0x5619279bc370 2024-09-19T09:53:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 -- 172.21.15.18:0/1801159700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 msgr2=0x5619279e7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1801159700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279e7ed0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001bb60 tx=0x7fe8e0010860 comp rx=0 tx=0).stop 2024-09-19T09:53:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 -- 172.21.15.18:0/1801159700 shutdown_connections 2024-09-19T09:53:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1801159700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279e7ed0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1801159700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b2b40 0x5619279e7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1801159700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b15d0 0x5619279b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 -- 172.21.15.18:0/1801159700 >> 172.21.15.18:0/1801159700 conn(0x56192797a310 msgr2=0x5619279b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 -- 172.21.15.18:0/1801159700 shutdown_connections 2024-09-19T09:53:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 -- 172.21.15.18:0/1801159700 wait complete. 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 -- start start 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.650+0000 7fe8f1479740 1 Processor -- start 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b15d0 0x5619279b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b2b40 0x5619279cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8f1479740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8f1479740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8071040 con 0x5619279bc370 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8f1479740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8070970 con 0x5619279b15d0 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8f1479740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e806dbb0 con 0x5619279b2b40 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8f1479740 10 client.0 _ll_register_callbacks cb 0x7fe8dc09bd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8ed63d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8ed63d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56592/0 (socket says 172.21.15.18:56592) 2024-09-19T09:53:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8ed63d640 1 -- 172.21.15.18:0/1905153364 learned_addr learned my addr 172.21.15.18:0/1905153364 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:18.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b15d0 0x5619279b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.651+0000 7fe8e7fff640 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b2b40 0x5619279cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8ece3c640 1 -- 172.21.15.18:0/1905153364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b2b40 msgr2=0x5619279cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:18.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b2b40 0x5619279cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8ece3c640 1 -- 172.21.15.18:0/1905153364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 msgr2=0x5619279cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:18.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8ece3c640 1 -- 172.21.15.18:0/1905153364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619279b52d0 con 0x5619279b15d0 2024-09-19T09:53:18.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8ed63d640 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:18.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8ece3c640 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b15d0 0x5619279b6bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0cd660 tx=0x7fe8dc00ff30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4743b7404094801 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:18.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:18.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8c7fff640 1 -- 172.21.15.18:0/1905153364 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc066070 con 0x5619279b15d0 2024-09-19T09:53:18.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8c7fff640 1 -- 172.21.15.18:0/1905153364 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe8dc0a4b10 con 0x5619279b15d0 2024-09-19T09:53:18.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8f1479740 1 -- 172.21.15.18:0/1905153364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e00119e0 con 0x5619279b15d0 2024-09-19T09:53:18.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8c7fff640 1 -- 172.21.15.18:0/1905153364 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe8dc080020 con 0x5619279b15d0 2024-09-19T09:53:18.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.652+0000 7fe8f1479740 10 client.25232 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:18.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.653+0000 7fe8f1479740 1 -- 172.21.15.18:0/1905153364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561927a47b10 con 0x5619279b15d0 2024-09-19T09:53:18.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.653+0000 7fe8c7fff640 1 -- 172.21.15.18:0/1905153364 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e00119e0 con 0x5619279b15d0 2024-09-19T09:53:18.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.653+0000 7fe8c7fff640 1 -- 172.21.15.18:0/1905153364 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe8dc09b5a0 con 0x5619279b15d0 2024-09-19T09:53:18.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.653+0000 7fe8f1479740 10 client.25232 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:18.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.653+0000 7fe8f1479740 10 client.25232 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:53:18.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.653+0000 7fe8f1479740 20 client.25232 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:18.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.653+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561927a481e0 0x561927a4a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:18.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.653+0000 7fe8f1479740 4 client.25232 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:18.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.653+0000 7fe8f1479740 1 -- 172.21.15.18:0/1905153364 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56192791ed70 con 0x561927a481e0 2024-09-19T09:53:18.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.653+0000 7fe8e7fff640 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561927a481e0 0x561927a4a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:18.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.654+0000 7fe8c7fff640 10 client.25232 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:18.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.654+0000 7fe8e7fff640 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561927a481e0 0x561927a4a5d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=97669865c3a6a654 server_cookie=dffc2307c4d2ae8e in_seq=0 out_seq=0 2024-09-19T09:53:18.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.654+0000 7fe8c7fff640 1 -- 172.21.15.18:0/1905153364 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56192791ed70 con 0x561927a481e0 2024-09-19T09:53:18.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.654+0000 7fe8c7fff640 10 client.25232 handle_command_reply: tid=0 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.654+0000 7fe8f1479740 1 client.25232 shutdown 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.654+0000 7fe8f1479740 1 -- 172.21.15.18:0/1905153364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b15d0 msgr2=0x5619279b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.654+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b15d0 0x5619279b6bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0cd660 tx=0x7fe8dc00ff30 comp rx=0 tx=0).stop 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.654+0000 7fe8f1479740 1 -- 172.21.15.18:0/1905153364 shutdown_connections 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.654+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561927a481e0 0x561927a4a5d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.655+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5619279bc370 0x5619279cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.655+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619279b2b40 0x5619279cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.655+0000 7fe8f1479740 1 --2- 172.21.15.18:0/1905153364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5619279b15d0 0x5619279b6bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.655+0000 7fe8f1479740 1 -- 172.21.15.18:0/1905153364 >> 172.21.15.18:0/1905153364 conn(0x56192797a310 msgr2=0x5619279c1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.655+0000 7fe8c7fff640 0 client.25232 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.655+0000 7fe8f1479740 1 -- 172.21.15.18:0/1905153364 shutdown_connections 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.655+0000 7fe8f1479740 1 -- 172.21.15.18:0/1905153364 wait complete. 2024-09-19T09:53:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.655+0000 7fe8f1479740 20 client.25232 trim_cache size 0 max 16384 2024-09-19T09:53:18.666 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:18.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2541452105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8d80a3160 msgr2=0x7fe8d80a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:18.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8d80a3160 0x7fe8d80a5620 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0005bf0 tx=0x7fe8e0005fd0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2541452105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e8100e20 msgr2=0x7fe8e80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:18.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e8100e20 0x7fe8e80fcc80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00c920 tx=0x7fe8dc00cde0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2541452105 shutdown_connections 2024-09-19T09:53:18.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8d80a3160 0x7fe8d80a5620 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e8102ef0 0x7fe8e80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e8102570 0x7fe8e80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 --2- 172.21.15.18:0/2541452105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e8100e20 0x7fe8e80fcc80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:18.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2541452105 >> 172.21.15.18:0/2541452105 conn(0x7fe8e80fc7d0 msgr2=0x7fe8e806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:18.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2541452105 shutdown_connections 2024-09-19T09:53:18.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:18.656+0000 7fe8ef0a0640 1 -- 172.21.15.18:0/2541452105 wait complete. 2024-09-19T09:53:19.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:53:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:19.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:19 smithi018 ceph-mon[30956]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:19.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:19 smithi049 ceph-mon[34858]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:19.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:19 smithi162 ceph-mon[35174]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.115+0000 7ff4c4a88640 1 -- 172.21.15.18:0/3920073127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c0101df0 msgr2=0x7ff4c01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.115+0000 7ff4c4a88640 1 --2- 172.21.15.18:0/3920073127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c0101df0 0x7ff4c01021d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009900 tx=0x7ff4b002a410 comp rx=0 tx=0).stop 2024-09-19T09:53:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.116+0000 7ff4c4a88640 1 -- 172.21.15.18:0/3920073127 shutdown_connections 2024-09-19T09:53:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.116+0000 7ff4c4a88640 1 --2- 172.21.15.18:0/3920073127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c0106f20 0x7ff4c010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.116+0000 7ff4c4a88640 1 --2- 172.21.15.18:0/3920073127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c01027a0 0x7ff4c01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.116+0000 7ff4c4a88640 1 --2- 172.21.15.18:0/3920073127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c0101df0 0x7ff4c01021d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.116+0000 7ff4c4a88640 1 -- 172.21.15.18:0/3920073127 >> 172.21.15.18:0/3920073127 conn(0x7ff4c00fd8f0 msgr2=0x7ff4c00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.116+0000 7ff4c4a88640 1 -- 172.21.15.18:0/3920073127 shutdown_connections 2024-09-19T09:53:20.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.116+0000 7ff4c4a88640 1 -- 172.21.15.18:0/3920073127 wait complete. 2024-09-19T09:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4c4a88640 1 Processor -- start 2024-09-19T09:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4c4a88640 1 -- start start 2024-09-19T09:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4c4a88640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c0101df0 0x7ff4c00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4c4a88640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c01027a0 0x7ff4c0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4c4a88640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c0106f20 0x7ff4c0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4c4a88640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0111f80 con 0x7ff4c0101df0 2024-09-19T09:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4c4a88640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0111e00 con 0x7ff4c0106f20 2024-09-19T09:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4c4a88640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0112100 con 0x7ff4c01027a0 2024-09-19T09:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4be59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c0101df0 0x7ff4c00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4be59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c0101df0 0x7ff4c00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56602/0 (socket says 172.21.15.18:56602) 2024-09-19T09:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4be59c640 1 -- 172.21.15.18:0/4054686309 learned_addr learned my addr 172.21.15.18:0/4054686309 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c01027a0 0x7ff4c0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.117+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c0106f20 0x7ff4c0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.118+0000 7ff4be59c640 1 -- 172.21.15.18:0/4054686309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c01027a0 msgr2=0x7ff4c0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.118+0000 7ff4be59c640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c01027a0 0x7ff4c0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.118+0000 7ff4be59c640 1 -- 172.21.15.18:0/4054686309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c0106f20 msgr2=0x7ff4c0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.118+0000 7ff4be59c640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c0106f20 0x7ff4c0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.118+0000 7ff4be59c640 1 -- 172.21.15.18:0/4054686309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c01a6880 con 0x7ff4c0101df0 2024-09-19T09:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.118+0000 7ff4be59c640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c0101df0 0x7ff4c00744f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0006010 tx=0x7ff4b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.118+0000 7ff4af7fe640 1 -- 172.21.15.18:0/4054686309 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b003f030 con 0x7ff4c0101df0 2024-09-19T09:53:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.118+0000 7ff4af7fe640 1 -- 172.21.15.18:0/4054686309 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4b0003ce0 con 0x7ff4c0101df0 2024-09-19T09:53:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.119+0000 7ff4c4a88640 1 -- 172.21.15.18:0/4054686309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c01a6b10 con 0x7ff4c0101df0 2024-09-19T09:53:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.119+0000 7ff4af7fe640 1 -- 172.21.15.18:0/4054686309 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0035070 con 0x7ff4c0101df0 2024-09-19T09:53:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.119+0000 7ff4c4a88640 1 -- 172.21.15.18:0/4054686309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c01a7040 con 0x7ff4c0101df0 2024-09-19T09:53:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.122+0000 7ff4c6e61740 1 Processor -- start 2024-09-19T09:53:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.122+0000 7ff4c6e61740 1 -- start start 2024-09-19T09:53:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.122+0000 7ff4af7fe640 1 -- 172.21.15.18:0/4054686309 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff4b0042030 con 0x7ff4c0101df0 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.122+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565380090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.122+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5645653805d0 0x564565380a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.122+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56456538b370 0x56456538d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.122+0000 7ff4c6e61740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5645652e62f0 con 0x564565381b40 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.122+0000 7ff4c6e61740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56456528dcf0 con 0x5645653805d0 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.122+0000 7ff4c6e61740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5645652e22b0 con 0x56456538b370 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4bed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565380090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4bed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565380090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56618/0 (socket says 172.21.15.18:56618) 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4bed9d640 1 -- 172.21.15.18:0/1784063627 learned_addr learned my addr 172.21.15.18:0/1784063627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/1784063627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56456538b370 0x56456538d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4bed9d640 1 -- 172.21.15.18:0/1784063627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56456538b370 msgr2=0x56456538d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/1784063627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56456538b370 0x56456538d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4bed9d640 1 -- 172.21.15.18:0/1784063627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5645653805d0 msgr2=0x564565380a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/1784063627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5645653805d0 0x564565380a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4bed9d640 1 -- 172.21.15.18:0/1784063627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645652723a0 con 0x564565381b40 2024-09-19T09:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/1784063627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565380090 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009fc0 tx=0x7ff4b8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6fe1d7d8eb2c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.123+0000 7ff4af7fe640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff4a80a32c0 0x7ff4a80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.124+0000 7ff4af7fe640 1 -- 172.21.15.18:0/4054686309 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff4b00efa50 con 0x7ff4c0101df0 2024-09-19T09:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.124+0000 7ff4be59c640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff4a80a32c0 0x7ff4a80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.124+0000 7ff4acff9640 1 -- 172.21.15.18:0/1784063627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8016070 con 0x564565381b40 2024-09-19T09:53:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.124+0000 7ff4acff9640 1 -- 172.21.15.18:0/1784063627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4b8004d20 con 0x564565381b40 2024-09-19T09:53:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.124+0000 7ff4acff9640 1 -- 172.21.15.18:0/1784063627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b80054e0 con 0x564565381b40 2024-09-19T09:53:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.125+0000 7ff4c6e61740 1 -- 172.21.15.18:0/1784063627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 msgr2=0x564565380090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.125+0000 7ff4be59c640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff4a80a32c0 0x7ff4a80a5780 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00efdb0 tx=0x7ff4b0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.125+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/1784063627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565380090 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009fc0 tx=0x7ff4b8010800 comp rx=0 tx=0).stop 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.125+0000 7ff4c6e61740 1 -- 172.21.15.18:0/1784063627 shutdown_connections 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.125+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/1784063627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56456538b370 0x56456538d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.125+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/1784063627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5645653805d0 0x564565380a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.125+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/1784063627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565380090 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.125+0000 7ff4c6e61740 1 -- 172.21.15.18:0/1784063627 >> 172.21.15.18:0/1784063627 conn(0x564565349310 msgr2=0x56456537cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.126+0000 7ff4c6e61740 1 -- 172.21.15.18:0/1784063627 shutdown_connections 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.126+0000 7ff4c6e61740 1 -- 172.21.15.18:0/1784063627 wait complete. 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.126+0000 7ff4c6e61740 1 -- start start 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.126+0000 7ff4c6e61740 1 Processor -- start 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.126+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 0x56456538ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.126+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565388050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56456538b370 0x5645653887e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565388050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4c6e61740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56456538e070 con 0x564565381b40 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565388050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56630/0 (socket says 172.21.15.18:56630) 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bdd9b640 1 -- 172.21.15.18:0/251899987 learned_addr learned my addr 172.21.15.18:0/251899987 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4c6e61740 1 -- 172.21.15.18:0/251899987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5645652a1060 con 0x56456538b370 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4c6e61740 1 -- 172.21.15.18:0/251899987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56456538e1f0 con 0x5645653805d0 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 0x56456538ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56456538b370 0x5645653887e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bed9d640 1 -- 172.21.15.18:0/251899987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56456538b370 msgr2=0x5645653887e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56456538b370 0x5645653887e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bed9d640 1 -- 172.21.15.18:0/251899987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 msgr2=0x564565388050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565388050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bed9d640 1 -- 172.21.15.18:0/251899987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645650573c0 con 0x5645653805d0 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565388050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4c6e61740 10 client.0 _ll_register_callbacks cb 0x564564ff48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4c6e61740 1 -- 172.21.15.18:0/251899987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4b8004d20 con 0x5645653805d0 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 0x56456538ada0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80051c0 tx=0x7ff4b8005c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a25d279e9cdf1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.127+0000 7ff4a5ffb640 10 client.25183 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.128+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/251899987 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8016070 con 0x5645653805d0 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.128+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/251899987 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff4b8012510 con 0x5645653805d0 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.128+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/251899987 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4b8012770 con 0x5645653805d0 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.128+0000 7ff4c6e61740 10 client.25183 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.128+0000 7ff4c6e61740 1 -- 172.21.15.18:0/251899987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5645653999a0 con 0x5645653805d0 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.128+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/251899987 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4b8028020 con 0x5645653805d0 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.128+0000 7ff4c6e61740 10 client.25183 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.128+0000 7ff4c6e61740 10 client.25183 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:53:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.128+0000 7ff4c6e61740 20 client.25183 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.128+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56456539b230 0x56456539d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.129+0000 7ff4c6e61740 4 client.25183 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.129+0000 7ff4c6e61740 1 -- 172.21.15.18:0/251899987 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645652f3860 con 0x56456539b230 2024-09-19T09:53:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.129+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56456539b230 0x56456539d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.129+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56456539b230 0x56456539d6d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cc19c455aeede30f server_cookie=f174f7c6269dbb0b in_seq=0 out_seq=0 2024-09-19T09:53:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.129+0000 7ff4a5ffb640 10 client.25183 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:20.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/251899987 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5645652f3860 con 0x56456539b230 2024-09-19T09:53:20.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4a5ffb640 10 client.25183 handle_command_reply: tid=0 2024-09-19T09:53:20.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 client.25183 shutdown 2024-09-19T09:53:20.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 -- 172.21.15.18:0/251899987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 msgr2=0x56456538ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 0x56456538ada0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80051c0 tx=0x7ff4b8005c50 comp rx=0 tx=0).stop 2024-09-19T09:53:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 -- 172.21.15.18:0/251899987 shutdown_connections 2024-09-19T09:53:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56456539b230 0x56456539d6d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56456538b370 0x5645653887e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4a5ffb640 0 client.25183 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x564565388050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/251899987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 0x56456538ada0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 -- 172.21.15.18:0/251899987 >> 172.21.15.18:0/251899987 conn(0x564565349310 msgr2=0x564565382930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 -- 172.21.15.18:0/251899987 shutdown_connections 2024-09-19T09:53:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.130+0000 7ff4c6e61740 1 -- 172.21.15.18:0/251899987 wait complete. 2024-09-19T09:53:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.131+0000 7ff4c6e61740 20 client.25183 trim_cache size 0 max 16384 2024-09-19T09:53:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.156+0000 7ff4c6e61740 1 Processor -- start 2024-09-19T09:53:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.156+0000 7ff4c6e61740 1 -- start start 2024-09-19T09:53:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.156+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 0x56456538ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.156+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564565381b40 0x564565383120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.156+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456538b370 0x564565383660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.156+0000 7ff4c6e61740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01af5c0 con 0x56456538b370 2024-09-19T09:53:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.156+0000 7ff4c6e61740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01b1100 con 0x564565381b40 2024-09-19T09:53:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.156+0000 7ff4c6e61740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01afc90 con 0x5645653805d0 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.156+0000 7ff4bed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456538b370 0x564565383660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4bed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456538b370 0x564565383660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56636/0 (socket says 172.21.15.18:56636) 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4bed9d640 1 -- 172.21.15.18:0/2276403695 learned_addr learned my addr 172.21.15.18:0/2276403695 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/2276403695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564565381b40 0x564565383120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/2276403695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 0x56456538ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4bdd9b640 1 -- 172.21.15.18:0/2276403695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 msgr2=0x56456538ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/2276403695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 0x56456538ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4bdd9b640 1 -- 172.21.15.18:0/2276403695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456538b370 msgr2=0x564565383660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/2276403695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456538b370 0x564565383660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4bdd9b640 1 -- 172.21.15.18:0/2276403695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564565397820 con 0x564565381b40 2024-09-19T09:53:20.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/2276403695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564565381b40 0x564565383120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x56456539df20 tx=0x7ff4b40041a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=922608b3b574bfd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.157+0000 7ff4a7fff640 1 -- 172.21.15.18:0/2276403695 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4003de0 con 0x564565381b40 2024-09-19T09:53:20.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.158+0000 7ff4a7fff640 1 -- 172.21.15.18:0/2276403695 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4b401d950 con 0x564565381b40 2024-09-19T09:53:20.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.158+0000 7ff4a7fff640 1 -- 172.21.15.18:0/2276403695 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4011c30 con 0x564565381b40 2024-09-19T09:53:20.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.159+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2276403695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564565381b40 msgr2=0x564565383120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.159+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/2276403695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564565381b40 0x564565383120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x56456539df20 tx=0x7ff4b40041a0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.159+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2276403695 shutdown_connections 2024-09-19T09:53:20.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.159+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/2276403695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456538b370 0x564565383660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.159+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/2276403695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564565381b40 0x564565383120 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.159+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/2276403695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645653805d0 0x56456538ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.159+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2276403695 >> 172.21.15.18:0/2276403695 conn(0x564565349310 msgr2=0x564565377a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.159+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2276403695 shutdown_connections 2024-09-19T09:53:20.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.159+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2276403695 wait complete. 2024-09-19T09:53:20.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.160+0000 7ff4c6e61740 1 -- start start 2024-09-19T09:53:20.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.160+0000 7ff4c6e61740 1 Processor -- start 2024-09-19T09:53:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5645653805d0 0x56456538ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x56456538ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4c6e61740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56456538b370 0x564565403fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4bdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x56456538ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4bdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x56456538ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56650/0 (socket says 172.21.15.18:56650) 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4bdd9b640 1 -- 172.21.15.18:0/2351023449 learned_addr learned my addr 172.21.15.18:0/2351023449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5645653805d0 0x56456538ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01b0a30 con 0x564565381b40 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01b0360 con 0x5645653805d0 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01ad5a0 con 0x56456538b370 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4c6e61740 10 client.0 _ll_register_callbacks cb 0x7ff4b400d3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56456538b370 0x564565403fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4bed9d640 1 -- 172.21.15.18:0/2351023449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56456538b370 msgr2=0x564565403fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56456538b370 0x564565403fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4bed9d640 1 -- 172.21.15.18:0/2351023449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 msgr2=0x56456538ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x56456538ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.161+0000 7ff4bed9d640 1 -- 172.21.15.18:0/2351023449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645654044e0 con 0x5645653805d0 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.162+0000 7ff4bed9d640 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5645653805d0 0x56456538ea10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8005090 tx=0x7ff4b8023000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51f3e5457f10f7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.162+0000 7ff4a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.162+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/2351023449 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8009b20 con 0x5645653805d0 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.162+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/2351023449 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff4b8003cc0 con 0x5645653805d0 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.162+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4b401d950 con 0x5645653805d0 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.162+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/2351023449 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4b801b440 con 0x5645653805d0 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.162+0000 7ff4c6e61740 10 client.25247 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.162+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5645654056a0 con 0x5645653805d0 2024-09-19T09:53:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.163+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/2351023449 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4b401d950 con 0x5645653805d0 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.163+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/2351023449 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4b8041070 con 0x5645653805d0 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.163+0000 7ff4c6e61740 10 client.25247 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.163+0000 7ff4c6e61740 10 client.25247 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.163+0000 7ff4c6e61740 20 client.25247 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.163+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56456539b230 0x564565407cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.163+0000 7ff4c6e61740 4 client.25247 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.163+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5645652edd70 con 0x56456539b230 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.163+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56456539b230 0x564565407cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4bdd9b640 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56456539b230 0x564565407cc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=80f525ddb93f9a59 server_cookie=2b8d7aa0fca68583 in_seq=0 out_seq=0 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4a5ffb640 10 client.25247 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4a5ffb640 1 -- 172.21.15.18:0/2351023449 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5645652edd70 con 0x56456539b230 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4a5ffb640 10 client.25247 handle_command_reply: tid=0 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 client.25247 shutdown 2024-09-19T09:53:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5645653805d0 msgr2=0x56456538ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5645653805d0 0x56456538ea10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8005090 tx=0x7ff4b8023000 comp rx=0 tx=0).stop 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 shutdown_connections 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56456539b230 0x564565407cc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4a5ffb640 0 client.25247 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56456538b370 0x564565403fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564565381b40 0x56456538ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 --2- 172.21.15.18:0/2351023449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5645653805d0 0x56456538ea10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 >> 172.21.15.18:0/2351023449 conn(0x564565349310 msgr2=0x564565396b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 shutdown_connections 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 1 -- 172.21.15.18:0/2351023449 wait complete. 2024-09-19T09:53:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.164+0000 7ff4c6e61740 20 client.25247 trim_cache size 0 max 16384 2024-09-19T09:53:20.172 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 -- 172.21.15.18:0/4054686309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff4a80a32c0 msgr2=0x7ff4a80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff4a80a32c0 0x7ff4a80a5780 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00efdb0 tx=0x7ff4b0005b50 comp rx=0 tx=0).stop 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 -- 172.21.15.18:0/4054686309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c0101df0 msgr2=0x7ff4c00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c0101df0 0x7ff4c00744f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0006010 tx=0x7ff4b00042f0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 -- 172.21.15.18:0/4054686309 shutdown_connections 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff4a80a32c0 0x7ff4a80a5780 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4c0106f20 0x7ff4c0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c01027a0 0x7ff4c0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 --2- 172.21.15.18:0/4054686309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c0101df0 0x7ff4c00744f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 -- 172.21.15.18:0/4054686309 >> 172.21.15.18:0/4054686309 conn(0x7ff4c00fd8f0 msgr2=0x7ff4c00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.165+0000 7ff4c4a88640 1 -- 172.21.15.18:0/4054686309 shutdown_connections 2024-09-19T09:53:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:20.166+0000 7ff4c4a88640 1 -- 172.21.15.18:0/4054686309 wait complete. 2024-09-19T09:53:20.587 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:53:20.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:53:20.987 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:21.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.494+0000 7f4048104640 1 -- 172.21.15.18:0/770422928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4040106f50 msgr2=0x7f404010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:21.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.494+0000 7f4048104640 1 --2- 172.21.15.18:0/770422928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4040106f50 0x7f404010eaf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4038009cd0 tx=0x7f403802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.495+0000 7f4048104640 1 -- 172.21.15.18:0/770422928 shutdown_connections 2024-09-19T09:53:21.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.495+0000 7f4048104640 1 --2- 172.21.15.18:0/770422928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4040106f50 0x7f404010eaf0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.495+0000 7f4048104640 1 --2- 172.21.15.18:0/770422928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4040100ca0 0x7f4040106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.495+0000 7f4048104640 1 --2- 172.21.15.18:0/770422928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40401002f0 0x7f40401006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.495+0000 7f4048104640 1 -- 172.21.15.18:0/770422928 >> 172.21.15.18:0/770422928 conn(0x7f4040077210 msgr2=0x7f40400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.495+0000 7f4048104640 1 -- 172.21.15.18:0/770422928 shutdown_connections 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.495+0000 7f4048104640 1 -- 172.21.15.18:0/770422928 wait complete. 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4048104640 1 Processor -- start 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4048104640 1 -- start start 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4048104640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40401002f0 0x7f404019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4048104640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4040100ca0 0x7f404019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4048104640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4040106f50 0x7f404019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4048104640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4040111ff0 con 0x7f40401002f0 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4048104640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4040111e70 con 0x7f4040106f50 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4048104640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4040112170 con 0x7f4040100ca0 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4045ea0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40401002f0 0x7f404019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4045ea0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40401002f0 0x7f404019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56666/0 (socket says 172.21.15.18:56666) 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f4045ea0640 1 -- 172.21.15.18:0/4112456307 learned_addr learned my addr 172.21.15.18:0/4112456307 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.496+0000 7f40466a1640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4040106f50 0x7f404019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f404569f640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4040100ca0 0x7f404019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f4045ea0640 1 -- 172.21.15.18:0/4112456307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4040100ca0 msgr2=0x7f404019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f4045ea0640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4040100ca0 0x7f404019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f4045ea0640 1 -- 172.21.15.18:0/4112456307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4040106f50 msgr2=0x7f404019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f4045ea0640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4040106f50 0x7f404019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f4045ea0640 1 -- 172.21.15.18:0/4112456307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404019f610 con 0x7f40401002f0 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f4045ea0640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40401002f0 0x7f404019a660 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f403c00d950 tx=0x7f403c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f4036ffd640 1 -- 172.21.15.18:0/4112456307 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c017070 con 0x7f40401002f0 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f4036ffd640 1 -- 172.21.15.18:0/4112456307 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f403c009c30 con 0x7f40401002f0 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f4048104640 1 -- 172.21.15.18:0/4112456307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404019f900 con 0x7f40401002f0 2024-09-19T09:53:21.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.497+0000 7f4036ffd640 1 -- 172.21.15.18:0/4112456307 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c00f6b0 con 0x7f40401002f0 2024-09-19T09:53:21.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.498+0000 7f4048104640 1 -- 172.21.15.18:0/4112456307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40401a71e0 con 0x7f40401002f0 2024-09-19T09:53:21.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.499+0000 7f4048104640 1 -- 172.21.15.18:0/4112456307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40401006d0 con 0x7f40401002f0 2024-09-19T09:53:21.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.500+0000 7f4036ffd640 1 -- 172.21.15.18:0/4112456307 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f403c0109d0 con 0x7f40401002f0 2024-09-19T09:53:21.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.501+0000 7f4036ffd640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f402c0a32c0 0x7f402c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:21.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.501+0000 7f4036ffd640 1 -- 172.21.15.18:0/4112456307 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f403c0cf4d0 con 0x7f40401002f0 2024-09-19T09:53:21.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.501+0000 7f404569f640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f402c0a32c0 0x7f402c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:21.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.501+0000 7f404569f640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f402c0a32c0 0x7f402c0a5780 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4040106ab0 tx=0x7f4030005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:21.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.505+0000 7f4036ffd640 1 -- 172.21.15.18:0/4112456307 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f403c009de0 con 0x7f40401002f0 2024-09-19T09:53:21.576 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:21.701 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:21 smithi018 ceph-mon[30956]: pgmap v369: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:53:21.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.795+0000 7f4048104640 1 -- 172.21.15.18:0/4112456307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40401a7440 con 0x7f40401002f0 2024-09-19T09:53:21.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.796+0000 7f4036ffd640 1 -- 172.21.15.18:0/4112456307 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f403c09c220 con 0x7f40401002f0 2024-09-19T09:53:21.799 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:53:21.799 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:53:21.799 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:53:21.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.798+0000 7f4048104640 1 -- 172.21.15.18:0/4112456307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f402c0a32c0 msgr2=0x7f402c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:21.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.798+0000 7f4048104640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f402c0a32c0 0x7f402c0a5780 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4040106ab0 tx=0x7f4030005f90 comp rx=0 tx=0).stop 2024-09-19T09:53:21.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.798+0000 7f4048104640 1 -- 172.21.15.18:0/4112456307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40401002f0 msgr2=0x7f404019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:21.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.798+0000 7f4048104640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40401002f0 0x7f404019a660 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f403c00d950 tx=0x7f403c00de10 comp rx=0 tx=0).stop 2024-09-19T09:53:21.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.798+0000 7f4048104640 1 -- 172.21.15.18:0/4112456307 shutdown_connections 2024-09-19T09:53:21.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.798+0000 7f4048104640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f402c0a32c0 0x7f402c0a5780 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.798+0000 7f4048104640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4040106f50 0x7f404019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.798+0000 7f4048104640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4040100ca0 0x7f404019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.798+0000 7f4048104640 1 --2- 172.21.15.18:0/4112456307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40401002f0 0x7f404019a660 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.798+0000 7f4048104640 1 -- 172.21.15.18:0/4112456307 >> 172.21.15.18:0/4112456307 conn(0x7f4040077210 msgr2=0x7f40401056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.799+0000 7f4048104640 1 -- 172.21.15.18:0/4112456307 shutdown_connections 2024-09-19T09:53:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:21.799+0000 7f4048104640 1 -- 172.21.15.18:0/4112456307 wait complete. 2024-09-19T09:53:21.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:21 smithi049 ceph-mon[34858]: pgmap v369: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:53:21.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:21 smithi162 ceph-mon[35174]: pgmap v369: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:53:22.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.240+0000 7fc43fb59640 1 -- 172.21.15.18:0/3946446278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc438100100 msgr2=0x7fc438100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:22.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.240+0000 7fc43fb59640 1 --2- 172.21.15.18:0/3946446278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc438100100 0x7fc438100560 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc428009900 tx=0x7fc42802a410 comp rx=0 tx=0).stop 2024-09-19T09:53:22.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.240+0000 7fc43fb59640 1 -- 172.21.15.18:0/3946446278 shutdown_connections 2024-09-19T09:53:22.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.240+0000 7fc43fb59640 1 --2- 172.21.15.18:0/3946446278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc438100aa0 0x7fc43810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.240+0000 7fc43fb59640 1 --2- 172.21.15.18:0/3946446278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc438100100 0x7fc438100560 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.240+0000 7fc43fb59640 1 --2- 172.21.15.18:0/3946446278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438106b80 0x7fc438106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.240+0000 7fc43fb59640 1 -- 172.21.15.18:0/3946446278 >> 172.21.15.18:0/3946446278 conn(0x7fc438077230 msgr2=0x7fc4380fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:22.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.241+0000 7fc43fb59640 1 -- 172.21.15.18:0/3946446278 shutdown_connections 2024-09-19T09:53:22.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.241+0000 7fc43fb59640 1 -- 172.21.15.18:0/3946446278 wait complete. 2024-09-19T09:53:22.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.241+0000 7fc43fb59640 1 Processor -- start 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.241+0000 7fc43fb59640 1 -- start start 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.242+0000 7fc43fb59640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc438100100 0x7fc4381984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.242+0000 7fc43fb59640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438100aa0 0x7fc438198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.242+0000 7fc43fb59640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc438106b80 0x7fc43819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.242+0000 7fc43fb59640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc438112010 con 0x7fc438106b80 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.242+0000 7fc43fb59640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc438111e90 con 0x7fc438100100 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.242+0000 7fc43fb59640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc438112190 con 0x7fc438100aa0 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.242+0000 7fc43e0f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc438106b80 0x7fc43819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.242+0000 7fc43e0f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc438106b80 0x7fc43819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56686/0 (socket says 172.21.15.18:56686) 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.242+0000 7fc43e0f6640 1 -- 172.21.15.18:0/4283217612 learned_addr learned my addr 172.21.15.18:0/4283217612 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.242+0000 7fc43d8f5640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc438100100 0x7fc4381984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438100aa0 0x7fc438198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc43e0f6640 1 -- 172.21.15.18:0/4283217612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438100aa0 msgr2=0x7fc438198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc43e0f6640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438100aa0 0x7fc438198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc43e0f6640 1 -- 172.21.15.18:0/4283217612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc438100100 msgr2=0x7fc4381984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc43e0f6640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc438100100 0x7fc4381984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc43e0f6640 1 -- 172.21.15.18:0/4283217612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43819d4a0 con 0x7fc438106b80 2024-09-19T09:53:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438100aa0 0x7fc438198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc43e0f6640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc438106b80 0x7fc43819cdc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e9d0 tx=0x7fc43000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc42effd640 1 -- 172.21.15.18:0/4283217612 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43000cd80 con 0x7fc438106b80 2024-09-19T09:53:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc42effd640 1 -- 172.21.15.18:0/4283217612 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc430005020 con 0x7fc438106b80 2024-09-19T09:53:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc42effd640 1 -- 172.21.15.18:0/4283217612 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4300116d0 con 0x7fc438106b80 2024-09-19T09:53:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc43fb59640 1 -- 172.21.15.18:0/4283217612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43819d790 con 0x7fc438106b80 2024-09-19T09:53:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.243+0000 7fc43fb59640 1 -- 172.21.15.18:0/4283217612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc438101210 con 0x7fc438106b80 2024-09-19T09:53:22.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.246+0000 7fc441f32740 1 Processor -- start 2024-09-19T09:53:22.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.247+0000 7fc42effd640 1 -- 172.21.15.18:0/4283217612 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc430005560 con 0x7fc438106b80 2024-09-19T09:53:22.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.247+0000 7fc441f32740 1 -- start start 2024-09-19T09:53:22.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.247+0000 7fc441f32740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 0x5605646fb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.247+0000 7fc441f32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x5605646fba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc441f32740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x560564708760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc441f32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5605646612f0 con 0x5605646fb5d0 2024-09-19T09:53:22.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc441f32740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560564608cf0 con 0x560564706370 2024-09-19T09:53:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc441f32740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56056465d2b0 con 0x5605646fcb40 2024-09-19T09:53:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d8f5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x5605646fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d0f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 0x5605646fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d0f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 0x5605646fb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50974/0 (socket says 172.21.15.18:50974) 2024-09-19T09:53:22.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d8f5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x5605646fba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56702/0 (socket says 172.21.15.18:56702) 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d0f4640 1 -- 172.21.15.18:0/1371378883 learned_addr learned my addr 172.21.15.18:0/1371378883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/1371378883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x560564708760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d8f5640 1 -- 172.21.15.18:0/1371378883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 msgr2=0x5605646fb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d8f5640 1 --2- 172.21.15.18:0/1371378883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 0x5605646fb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc42effd640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc4240a32c0 0x7fc4240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d8f5640 1 -- 172.21.15.18:0/1371378883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 msgr2=0x560564708760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d8f5640 1 --2- 172.21.15.18:0/1371378883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x560564708760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.248+0000 7fc43d8f5640 1 -- 172.21.15.18:0/1371378883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605645ed3a0 con 0x5605646fb5d0 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.249+0000 7fc42effd640 1 -- 172.21.15.18:0/4283217612 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc4300cfab0 con 0x7fc438106b80 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.249+0000 7fc43d8f5640 1 --2- 172.21.15.18:0/1371378883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x5605646fba10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc434005fd0 tx=0x7fc4340107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f70e894dda9a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.249+0000 7fc43e0f6640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc4240a32c0 0x7fc4240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.249+0000 7fc423fff640 1 -- 172.21.15.18:0/1371378883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434004020 con 0x5605646fb5d0 2024-09-19T09:53:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.249+0000 7fc423fff640 1 -- 172.21.15.18:0/1371378883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4340041c0 con 0x5605646fb5d0 2024-09-19T09:53:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.249+0000 7fc423fff640 1 -- 172.21.15.18:0/1371378883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434022780 con 0x5605646fb5d0 2024-09-19T09:53:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.249+0000 7fc43e0f6640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc4240a32c0 0x7fc4240a5780 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc43009be00 tx=0x7fc43000c7f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.250+0000 7fc441f32740 1 -- 172.21.15.18:0/1371378883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 msgr2=0x5605646fba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.250+0000 7fc441f32740 1 --2- 172.21.15.18:0/1371378883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x5605646fba10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc434005fd0 tx=0x7fc4340107a0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.251+0000 7fc441f32740 1 -- 172.21.15.18:0/1371378883 shutdown_connections 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.251+0000 7fc441f32740 1 --2- 172.21.15.18:0/1371378883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x560564708760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.251+0000 7fc441f32740 1 --2- 172.21.15.18:0/1371378883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x5605646fba10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.251+0000 7fc441f32740 1 --2- 172.21.15.18:0/1371378883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 0x5605646fb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.251+0000 7fc441f32740 1 -- 172.21.15.18:0/1371378883 >> 172.21.15.18:0/1371378883 conn(0x5605646c4310 msgr2=0x5605646f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.251+0000 7fc441f32740 1 -- 172.21.15.18:0/1371378883 shutdown_connections 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.251+0000 7fc441f32740 1 -- 172.21.15.18:0/1371378883 wait complete. 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.251+0000 7fc441f32740 1 -- start start 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.251+0000 7fc441f32740 1 Processor -- start 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.252+0000 7fc441f32740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fb5d0 0x560564705de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.252+0000 7fc441f32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x560564703090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.252+0000 7fc43d0f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fb5d0 0x560564705de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.252+0000 7fc43d0f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fb5d0 0x560564705de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50988/0 (socket says 172.21.15.18:50988) 2024-09-19T09:53:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.252+0000 7fc43d8f5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x560564703090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.252+0000 7fc43d8f5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x560564703090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56704/0 (socket says 172.21.15.18:56704) 2024-09-19T09:53:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.252+0000 7fc43d0f4640 1 -- 172.21.15.18:0/396482506 learned_addr learned my addr 172.21.15.18:0/396482506 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc441f32740 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x5605647037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560564709070 con 0x5605646fcb40 2024-09-19T09:53:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56056461c060 con 0x560564706370 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5605647091f0 con 0x5605646fb5d0 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc441f32740 10 client.0 _ll_register_callbacks cb 0x56056436f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x5605647037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc43d8f5640 1 -- 172.21.15.18:0/396482506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fb5d0 msgr2=0x560564705de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc43d8f5640 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fb5d0 0x560564705de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc43d8f5640 1 -- 172.21.15.18:0/396482506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 msgr2=0x5605647037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc43d8f5640 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x5605647037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.253+0000 7fc43d8f5640 1 -- 172.21.15.18:0/396482506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605643d23c0 con 0x5605646fcb40 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.254+0000 7fc43d8f5640 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x560564703090 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc434005d00 tx=0x7fc434003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9371d273ddd75b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.254+0000 7fc4217fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.254+0000 7fc4217fa640 1 -- 172.21.15.18:0/396482506 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43400bd20 con 0x5605646fcb40 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.254+0000 7fc4217fa640 1 -- 172.21.15.18:0/396482506 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc4340035f0 con 0x5605646fcb40 2024-09-19T09:53:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.254+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4340041c0 con 0x5605646fcb40 2024-09-19T09:53:22.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.254+0000 7fc4217fa640 1 -- 172.21.15.18:0/396482506 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc4340037f0 con 0x5605646fcb40 2024-09-19T09:53:22.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.254+0000 7fc441f32740 10 client.15597 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:22.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.254+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560564714ba0 con 0x5605646fcb40 2024-09-19T09:53:22.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.255+0000 7fc4217fa640 1 -- 172.21.15.18:0/396482506 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc434003990 con 0x5605646fcb40 2024-09-19T09:53:22.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.256+0000 7fc4217fa640 1 -- 172.21.15.18:0/396482506 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc434004a40 con 0x5605646fcb40 2024-09-19T09:53:22.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.256+0000 7fc441f32740 10 client.15597 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:22.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.256+0000 7fc441f32740 10 client.15597 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:53:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.256+0000 7fc441f32740 20 client.15597 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.256+0000 7fc441f32740 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x560564715fa0 0x560564718390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.256+0000 7fc441f32740 4 client.15597 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.256+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc4340041c0 con 0x560564715fa0 2024-09-19T09:53:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.257+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x560564715fa0 0x560564718390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.258+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x560564715fa0 0x560564718390 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a5008de8fadcf0d server_cookie=821936af0247ac94 in_seq=0 out_seq=0 2024-09-19T09:53:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.258+0000 7fc4217fa640 10 client.15597 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:22.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc4217fa640 1 -- 172.21.15.18:0/396482506 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc4340041c0 con 0x560564715fa0 2024-09-19T09:53:22.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc4217fa640 10 client.15597 handle_command_reply: tid=0 2024-09-19T09:53:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 client.15597 shutdown 2024-09-19T09:53:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 msgr2=0x560564703090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x560564703090 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc434005d00 tx=0x7fc434003d60 comp rx=0 tx=0).stop 2024-09-19T09:53:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 shutdown_connections 2024-09-19T09:53:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x560564715fa0 0x560564718390 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x5605647037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x560564703090 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 --2- 172.21.15.18:0/396482506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fb5d0 0x560564705de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc4217fa640 0 client.15597 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 >> 172.21.15.18:0/396482506 conn(0x5605646c4310 msgr2=0x5605646fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 shutdown_connections 2024-09-19T09:53:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 1 -- 172.21.15.18:0/396482506 wait complete. 2024-09-19T09:53:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.259+0000 7fc441f32740 20 client.15597 trim_cache size 0 max 16384 2024-09-19T09:53:22.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc441f32740 1 Processor -- start 2024-09-19T09:53:22.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc441f32740 1 -- start start 2024-09-19T09:53:22.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc441f32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x560564712310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc441f32740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 0x560564701f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc441f32740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x56056471da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc441f32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc4381ab330 con 0x5605646fb5d0 2024-09-19T09:53:22.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc441f32740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc4381ace70 con 0x560564706370 2024-09-19T09:53:22.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc441f32740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4381aba00 con 0x5605646fcb40 2024-09-19T09:53:22.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc43d0f4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x560564712310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc43d0f4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x560564712310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56706/0 (socket says 172.21.15.18:56706) 2024-09-19T09:53:22.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.273+0000 7fc43d0f4640 1 -- 172.21.15.18:0/2874061838 learned_addr learned my addr 172.21.15.18:0/2874061838 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:22.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.274+0000 7fc43d8f5640 1 --2- 172.21.15.18:0/2874061838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 0x560564701f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.274+0000 7fc43d0f4640 1 -- 172.21.15.18:0/2874061838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 msgr2=0x560564701f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:22.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.274+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/2874061838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 0x560564701f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.274+0000 7fc43d0f4640 1 -- 172.21.15.18:0/2874061838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 msgr2=0x56056471da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:22.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.274+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/2874061838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x56056471da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.274+0000 7fc43d0f4640 1 -- 172.21.15.18:0/2874061838 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605646f8960 con 0x5605646fb5d0 2024-09-19T09:53:22.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.274+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/2874061838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x560564712310 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x5605647189f0 tx=0x7fc42802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1f747063ae8fba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:22.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.274+0000 7fc4237fe640 1 -- 172.21.15.18:0/2874061838 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428035040 con 0x5605646fb5d0 2024-09-19T09:53:22.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.274+0000 7fc4237fe640 1 -- 172.21.15.18:0/2874061838 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc428004480 con 0x5605646fb5d0 2024-09-19T09:53:22.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.274+0000 7fc4237fe640 1 -- 172.21.15.18:0/2874061838 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428003a80 con 0x5605646fb5d0 2024-09-19T09:53:22.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.275+0000 7fc441f32740 1 -- 172.21.15.18:0/2874061838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 msgr2=0x560564712310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:22.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.275+0000 7fc441f32740 1 --2- 172.21.15.18:0/2874061838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x560564712310 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x5605647189f0 tx=0x7fc42802a410 comp rx=0 tx=0).stop 2024-09-19T09:53:22.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.275+0000 7fc441f32740 1 -- 172.21.15.18:0/2874061838 shutdown_connections 2024-09-19T09:53:22.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.275+0000 7fc441f32740 1 --2- 172.21.15.18:0/2874061838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560564706370 0x56056471da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.275+0000 7fc441f32740 1 --2- 172.21.15.18:0/2874061838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605646fcb40 0x560564701f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.275+0000 7fc441f32740 1 --2- 172.21.15.18:0/2874061838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fb5d0 0x560564712310 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.275+0000 7fc441f32740 1 -- 172.21.15.18:0/2874061838 >> 172.21.15.18:0/2874061838 conn(0x5605646c4310 msgr2=0x560564701830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:22.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.276+0000 7fc441f32740 1 -- 172.21.15.18:0/2874061838 shutdown_connections 2024-09-19T09:53:22.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.276+0000 7fc441f32740 1 -- 172.21.15.18:0/2874061838 wait complete. 2024-09-19T09:53:22.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.276+0000 7fc441f32740 1 -- start start 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.276+0000 7fc441f32740 1 Processor -- start 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc441f32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x5605646fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc441f32740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560564706370 0x560564700480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc441f32740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5605647009c0 0x56056477fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc441f32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc4381ac7a0 con 0x5605646fcb40 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc441f32740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc4381ac0d0 con 0x5605647009c0 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc441f32740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4381a9310 con 0x560564706370 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc441f32740 10 client.0 _ll_register_callbacks cb 0x7fc428032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc43d0f4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x5605646fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc43d0f4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x5605646fff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56722/0 (socket says 172.21.15.18:56722) 2024-09-19T09:53:22.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc43d0f4640 1 -- 172.21.15.18:0/1763518165 learned_addr learned my addr 172.21.15.18:0/1763518165 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc43d0f4640 1 -- 172.21.15.18:0/1763518165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560564706370 msgr2=0x560564700480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560564706370 0x560564700480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc43d0f4640 1 -- 172.21.15.18:0/1763518165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5605647009c0 msgr2=0x56056477fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5605647009c0 0x56056477fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.277+0000 7fc43d0f4640 1 -- 172.21.15.18:0/1763518165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56056470f110 con 0x5605646fcb40 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.278+0000 7fc43d0f4640 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x5605646fff40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc428000c00 tx=0x7fc4280043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4e7d380ec437d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.278+0000 7fc4217fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.278+0000 7fc4217fa640 1 -- 172.21.15.18:0/1763518165 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428055070 con 0x5605646fcb40 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.278+0000 7fc4217fa640 1 -- 172.21.15.18:0/1763518165 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc428005460 con 0x5605646fcb40 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.278+0000 7fc441f32740 1 -- 172.21.15.18:0/1763518165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc428004480 con 0x5605646fcb40 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.278+0000 7fc4217fa640 1 -- 172.21.15.18:0/1763518165 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc428061050 con 0x5605646fcb40 2024-09-19T09:53:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.278+0000 7fc441f32740 10 client.15603 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.278+0000 7fc441f32740 1 -- 172.21.15.18:0/1763518165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560564781030 con 0x5605646fcb40 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.278+0000 7fc4217fa640 1 -- 172.21.15.18:0/1763518165 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc428004480 con 0x5605646fcb40 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.279+0000 7fc4217fa640 1 -- 172.21.15.18:0/1763518165 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc42804f070 con 0x5605646fcb40 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.279+0000 7fc441f32740 10 client.15603 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.279+0000 7fc441f32740 10 client.15603 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.279+0000 7fc441f32740 20 client.15603 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.279+0000 7fc441f32740 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5605647815b0 0x5605647839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.279+0000 7fc441f32740 4 client.15603 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.279+0000 7fc441f32740 1 -- 172.21.15.18:0/1763518165 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56056466e860 con 0x5605647815b0 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.279+0000 7fc43d8f5640 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5605647815b0 0x5605647839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc43d8f5640 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5605647815b0 0x5605647839d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fecbea54ffdf1310 server_cookie=a406640aaf0cfff9 in_seq=0 out_seq=0 2024-09-19T09:53:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc4217fa640 10 client.15603 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:22.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc4217fa640 1 -- 172.21.15.18:0/1763518165 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56056466e860 con 0x5605647815b0 2024-09-19T09:53:22.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc4217fa640 10 client.15603 handle_command_reply: tid=0 2024-09-19T09:53:22.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc441f32740 1 client.15603 shutdown 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc441f32740 1 -- 172.21.15.18:0/1763518165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 msgr2=0x5605646fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc441f32740 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x5605646fff40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc428000c00 tx=0x7fc4280043e0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc441f32740 1 -- 172.21.15.18:0/1763518165 shutdown_connections 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc441f32740 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5605647815b0 0x5605647839d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc4217fa640 0 client.15603 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc441f32740 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5605647009c0 0x56056477fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc441f32740 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560564706370 0x560564700480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc441f32740 1 --2- 172.21.15.18:0/1763518165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605646fcb40 0x5605646fff40 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.280+0000 7fc441f32740 1 -- 172.21.15.18:0/1763518165 >> 172.21.15.18:0/1763518165 conn(0x5605646c4310 msgr2=0x560564702050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.281+0000 7fc441f32740 1 -- 172.21.15.18:0/1763518165 shutdown_connections 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.281+0000 7fc441f32740 1 -- 172.21.15.18:0/1763518165 wait complete. 2024-09-19T09:53:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.281+0000 7fc441f32740 20 client.15603 trim_cache size 0 max 16384 2024-09-19T09:53:22.287 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 -- 172.21.15.18:0/4283217612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc4240a32c0 msgr2=0x7fc4240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc4240a32c0 0x7fc4240a5780 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc43009be00 tx=0x7fc43000c7f0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 -- 172.21.15.18:0/4283217612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc438106b80 msgr2=0x7fc43819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:22.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc438106b80 0x7fc43819cdc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e9d0 tx=0x7fc43000ee90 comp rx=0 tx=0).stop 2024-09-19T09:53:22.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 -- 172.21.15.18:0/4283217612 shutdown_connections 2024-09-19T09:53:22.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc4240a32c0 0x7fc4240a5780 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc438106b80 0x7fc43819cdc0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438100aa0 0x7fc438198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 --2- 172.21.15.18:0/4283217612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc438100100 0x7fc4381984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:22.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 -- 172.21.15.18:0/4283217612 >> 172.21.15.18:0/4283217612 conn(0x7fc438077230 msgr2=0x7fc438104c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:22.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 -- 172.21.15.18:0/4283217612 shutdown_connections 2024-09-19T09:53:22.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:22.282+0000 7fc43fb59640 1 -- 172.21.15.18:0/4283217612 wait complete. 2024-09-19T09:53:22.781 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:22 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4112456307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:22.826 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --set-id d90a2605 --release --await' 2024-09-19T09:53:22.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --set-id d90a2605 --release --await 2024-09-19T09:53:22.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:22 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/4112456307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:22.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:22 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/4112456307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:23.498 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:53:23.501 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:23.765 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:23 smithi018 ceph-mon[30956]: pgmap v370: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:53:23.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:23 smithi049 ceph-mon[34858]: pgmap v370: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:53:23.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:23 smithi162 ceph-mon[35174]: pgmap v370: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:53:24.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.010+0000 7f51b51d4640 1 -- 172.21.15.18:0/1736060613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0108300 msgr2=0x7f51b010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.010+0000 7f51b51d4640 1 --2- 172.21.15.18:0/1736060613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0108300 0x7f51b010ec70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009cd0 tx=0x7f51a802a8d0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.010+0000 7f51b51d4640 1 -- 172.21.15.18:0/1736060613 shutdown_connections 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.010+0000 7f51b51d4640 1 --2- 172.21.15.18:0/1736060613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0108300 0x7f51b010ec70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.010+0000 7f51b51d4640 1 --2- 172.21.15.18:0/1736060613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51b0103780 0x7f51b0107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.010+0000 7f51b51d4640 1 --2- 172.21.15.18:0/1736060613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51b0102dd0 0x7f51b01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.010+0000 7f51b51d4640 1 -- 172.21.15.18:0/1736060613 >> 172.21.15.18:0/1736060613 conn(0x7f51b00fc7d0 msgr2=0x7f51b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.010+0000 7f51b51d4640 1 -- 172.21.15.18:0/1736060613 shutdown_connections 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.010+0000 7f51b51d4640 1 -- 172.21.15.18:0/1736060613 wait complete. 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.012+0000 7f51b51d4640 1 Processor -- start 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.012+0000 7f51b51d4640 1 -- start start 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51b51d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102dd0 0x7f51b0198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51b51d4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51b0103780 0x7f51b0198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51b51d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51b0108300 0x7f51b019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51b51d4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51b01120d0 con 0x7f51b0102dd0 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51b51d4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0111f50 con 0x7f51b0108300 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51b51d4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0112250 con 0x7f51b0103780 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51ae59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51b0103780 0x7f51b0198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51ae59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51b0103780 0x7f51b0198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51044/0 (socket says 172.21.15.18:51044) 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51ae59c640 1 -- 172.21.15.18:0/1222253049 learned_addr learned my addr 172.21.15.18:0/1222253049 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51af59e640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51b0108300 0x7f51b019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51aed9d640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102dd0 0x7f51b0198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51ae59c640 1 -- 172.21.15.18:0/1222253049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51b0108300 msgr2=0x7f51b019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.013+0000 7f51ae59c640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51b0108300 0x7f51b019ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.014+0000 7f51ae59c640 1 -- 172.21.15.18:0/1222253049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102dd0 msgr2=0x7f51b0198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.014+0000 7f51ae59c640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102dd0 0x7f51b0198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.014+0000 7f51ae59c640 1 -- 172.21.15.18:0/1222253049 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b019d520 con 0x7f51b0103780 2024-09-19T09:53:24.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.014+0000 7f51ae59c640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51b0103780 0x7f51b0198ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f51a400d950 tx=0x7f51a400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.014+0000 7f5197fff640 1 -- 172.21.15.18:0/1222253049 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4017070 con 0x7f51b0103780 2024-09-19T09:53:24.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.014+0000 7f51b51d4640 1 -- 172.21.15.18:0/1222253049 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b019d810 con 0x7f51b0103780 2024-09-19T09:53:24.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.014+0000 7f51b51d4640 1 -- 172.21.15.18:0/1222253049 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b01a50f0 con 0x7f51b0103780 2024-09-19T09:53:24.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.014+0000 7f5197fff640 1 -- 172.21.15.18:0/1222253049 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51a4009c30 con 0x7f51b0103780 2024-09-19T09:53:24.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.014+0000 7f5197fff640 1 -- 172.21.15.18:0/1222253049 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a40047a0 con 0x7f51b0103780 2024-09-19T09:53:24.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.018+0000 7f51b75ad740 1 Processor -- start 2024-09-19T09:53:24.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.018+0000 7f51b75ad740 1 -- start start 2024-09-19T09:53:24.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.018+0000 7f5197fff640 1 -- 172.21.15.18:0/1222253049 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f51a4004940 con 0x7f51b0103780 2024-09-19T09:53:24.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.019+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 0x5599911cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.019+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.019+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 0x5599911c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.019+0000 7f51b75ad740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559991123620 con 0x5599911c8260 2024-09-19T09:53:24.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.019+0000 7f51b75ad740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5599910cae50 con 0x5599911cdbc0 2024-09-19T09:53:24.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.019+0000 7f51b75ad740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55999111f5e0 con 0x5599911cd2a0 2024-09-19T09:53:24.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.019+0000 7f5197fff640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f51980a3340 0x7f51980a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.019+0000 7f5197fff640 1 -- 172.21.15.18:0/1222253049 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f51a40cf340 con 0x7f51b0103780 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.020+0000 7f51aed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.020+0000 7f51af59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 0x5599911cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.020+0000 7f51af59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 0x5599911cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51060/0 (socket says 172.21.15.18:51060) 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.020+0000 7f51af59e640 1 -- 172.21.15.18:0/2293328721 learned_addr learned my addr 172.21.15.18:0/2293328721 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.021+0000 7f51af59e640 1 -- 172.21.15.18:0/2293328721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 msgr2=0x5599911c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.021+0000 7f51af59e640 1 --2- 172.21.15.18:0/2293328721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.021+0000 7f51af59e640 1 -- 172.21.15.18:0/2293328721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 msgr2=0x5599911c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.021+0000 7f51ae59c640 1 --2- 172.21.15.18:0/2293328721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 0x5599911c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.021+0000 7f51af59e640 1 --2- 172.21.15.18:0/2293328721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 0x5599911c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.021+0000 7f51af59e640 1 -- 172.21.15.18:0/2293328721 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599910bbd40 con 0x5599911cd2a0 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.021+0000 7f51ae59c640 1 --2- 172.21.15.18:0/2293328721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 0x5599911c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.021+0000 7f51af59e640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f51980a3340 0x7f51980a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.022+0000 7f51af59e640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f51980a3340 0x7f51980a5800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f51a802f4d0 tx=0x7f51a8042000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.023+0000 7f51af59e640 1 --2- 172.21.15.18:0/2293328721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 0x5599911cd680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51a802adf0 tx=0x7f51a8009940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9786cfd4495437e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.023+0000 7f51957fa640 1 -- 172.21.15.18:0/2293328721 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8032cc0 con 0x5599911cd2a0 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.023+0000 7f51957fa640 1 -- 172.21.15.18:0/2293328721 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51a8036040 con 0x5599911cd2a0 2024-09-19T09:53:24.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.023+0000 7f51957fa640 1 -- 172.21.15.18:0/2293328721 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a802f630 con 0x5599911cd2a0 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.024+0000 7f51b75ad740 1 -- 172.21.15.18:0/2293328721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 msgr2=0x5599911cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.024+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2293328721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 0x5599911cd680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51a802adf0 tx=0x7f51a8009940 comp rx=0 tx=0).stop 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.024+0000 7f51b75ad740 1 -- 172.21.15.18:0/2293328721 shutdown_connections 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.024+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2293328721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 0x5599911c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.024+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2293328721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.024+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2293328721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 0x5599911cd680 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.024+0000 7f51b75ad740 1 -- 172.21.15.18:0/2293328721 >> 172.21.15.18:0/2293328721 conn(0x5599911ba0a0 msgr2=0x5599911ba480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.024+0000 7f51b75ad740 1 -- 172.21.15.18:0/2293328721 shutdown_connections 2024-09-19T09:53:24.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.024+0000 7f51b75ad740 1 -- 172.21.15.18:0/2293328721 wait complete. 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.025+0000 7f51b75ad740 1 -- start start 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.025+0000 7f51b75ad740 1 Processor -- start 2024-09-19T09:53:24.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.026+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911c8260 0x5599911d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.026+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 0x5599911d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.026+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.026+0000 7f51aed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911c8260 0x5599911d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.026+0000 7f51aed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911c8260 0x5599911d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51074/0 (socket says 172.21.15.18:51074) 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.026+0000 7f51aed9d640 1 -- 172.21.15.18:0/3905563922 learned_addr learned my addr 172.21.15.18:0/3905563922 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.026+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5599911d4580 con 0x5599911cd2a0 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.026+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5599910abf10 con 0x5599911cdbc0 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.026+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5599911d4700 con 0x5599911c8260 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.026+0000 7f51af59e640 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f51aed9d640 1 -- 172.21.15.18:0/3905563922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 msgr2=0x5599911d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f51aed9d640 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f51aed9d640 1 -- 172.21.15.18:0/3905563922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 msgr2=0x5599911d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f51aed9d640 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 0x5599911d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f51aed9d640 1 -- 172.21.15.18:0/3905563922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559990e32580 con 0x5599911c8260 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f51b75ad740 10 client.0 _ll_register_callbacks cb 0x5599910cfdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f51aed9d640 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911c8260 0x5599911d1110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f51a000be10 tx=0x7f51a00117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90d52356eee82af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f5192ff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51a8036040 con 0x5599911c8260 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f5192ff5640 1 -- 172.21.15.18:0/3905563922 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0012860 con 0x5599911c8260 2024-09-19T09:53:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.027+0000 7f5192ff5640 1 -- 172.21.15.18:0/3905563922 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f51a0012a00 con 0x5599911c8260 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.028+0000 7f5192ff5640 1 -- 172.21.15.18:0/3905563922 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f51a0012c00 con 0x5599911c8260 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.028+0000 7f51b75ad740 10 client.25216 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.028+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559990efc960 con 0x5599911c8260 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.028+0000 7f5192ff5640 1 -- 172.21.15.18:0/3905563922 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f51a001d480 con 0x5599911c8260 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.028+0000 7f51b75ad740 10 client.25216 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.028+0000 7f51b75ad740 10 client.25216 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:53:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.028+0000 7f51b75ad740 20 client.25216 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.028+0000 7f51b75ad740 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5599911e1470 0x5599911e3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.028+0000 7f51b75ad740 4 client.25216 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.028+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f51a8036040 con 0x5599911e1470 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.029+0000 7f51ae59c640 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5599911e1470 0x5599911e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.029+0000 7f51ae59c640 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5599911e1470 0x5599911e3910 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52928502d86c572a server_cookie=b74780be918f7bc1 in_seq=0 out_seq=0 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.029+0000 7f5192ff5640 10 client.25216 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f5192ff5640 1 -- 172.21.15.18:0/3905563922 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f51a8036040 con 0x5599911e1470 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f5192ff5640 10 client.25216 handle_command_reply: tid=0 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 client.25216 shutdown 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911c8260 msgr2=0x5599911d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911c8260 0x5599911d1110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f51a000be10 tx=0x7f51a00117b0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 shutdown_connections 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5599911e1470 0x5599911e3910 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f5192ff5640 0 client.25216 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 0x5599911d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 --2- 172.21.15.18:0/3905563922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911c8260 0x5599911d1110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 >> 172.21.15.18:0/3905563922 conn(0x5599911ba0a0 msgr2=0x5599911b9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 shutdown_connections 2024-09-19T09:53:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 1 -- 172.21.15.18:0/3905563922 wait complete. 2024-09-19T09:53:24.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.030+0000 7f51b75ad740 20 client.25216 trim_cache size 0 max 16384 2024-09-19T09:53:24.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.064+0000 7f51b75ad740 1 Processor -- start 2024-09-19T09:53:24.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51b75ad740 1 -- start start 2024-09-19T09:53:24.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 0x5599911c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 0x5599911c7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51b75ad740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f519c00e360 con 0x5599911c8260 2024-09-19T09:53:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51b75ad740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f519c00fea0 con 0x5599911cdbc0 2024-09-19T09:53:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51b75ad740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f519c00ea30 con 0x5599911cd2a0 2024-09-19T09:53:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51aed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 0x5599911c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51aed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 0x5599911c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56770/0 (socket says 172.21.15.18:56770) 2024-09-19T09:53:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51ae59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 0x5599911c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51aed9d640 1 -- 172.21.15.18:0/2844232741 learned_addr learned my addr 172.21.15.18:0/2844232741 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.065+0000 7f51af59e640 1 --2- 172.21.15.18:0/2844232741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.066+0000 7f51af59e640 1 -- 172.21.15.18:0/2844232741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 msgr2=0x5599911c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.066+0000 7f51af59e640 1 --2- 172.21.15.18:0/2844232741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 0x5599911c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.066+0000 7f51af59e640 1 -- 172.21.15.18:0/2844232741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 msgr2=0x5599911c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.066+0000 7f51af59e640 1 --2- 172.21.15.18:0/2844232741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 0x5599911c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.066+0000 7f51af59e640 1 -- 172.21.15.18:0/2844232741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599911bb690 con 0x5599911cdbc0 2024-09-19T09:53:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.067+0000 7f51af59e640 1 --2- 172.21.15.18:0/2844232741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911c7660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f51a8005e30 tx=0x7f51a80095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3220039f5f1c6152 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.067+0000 7f5194ff9640 1 -- 172.21.15.18:0/2844232741 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8004750 con 0x5599911cdbc0 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.067+0000 7f5194ff9640 1 -- 172.21.15.18:0/2844232741 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51a8036050 con 0x5599911cdbc0 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.067+0000 7f5194ff9640 1 -- 172.21.15.18:0/2844232741 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a802f630 con 0x5599911cdbc0 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.068+0000 7f51b75ad740 1 -- 172.21.15.18:0/2844232741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 msgr2=0x5599911c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.068+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2844232741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911c7660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f51a8005e30 tx=0x7f51a80095c0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.068+0000 7f51b75ad740 1 -- 172.21.15.18:0/2844232741 shutdown_connections 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.069+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2844232741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911cdbc0 0x5599911c7660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.069+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2844232741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cd2a0 0x5599911c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.069+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2844232741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911c8260 0x5599911c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.069+0000 7f51b75ad740 1 -- 172.21.15.18:0/2844232741 >> 172.21.15.18:0/2844232741 conn(0x5599911ba0a0 msgr2=0x5599911cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.069+0000 7f51b75ad740 1 -- 172.21.15.18:0/2844232741 shutdown_connections 2024-09-19T09:53:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.069+0000 7f51b75ad740 1 -- 172.21.15.18:0/2844232741 wait complete. 2024-09-19T09:53:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.069+0000 7f51b75ad740 1 -- start start 2024-09-19T09:53:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.069+0000 7f51b75ad740 1 Processor -- start 2024-09-19T09:53:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911c8260 0x5599911d9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51b75ad740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 0x5599911da1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51ae59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 0x5599911da1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51ae59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 0x5599911da1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56786/0 (socket says 172.21.15.18:56786) 2024-09-19T09:53:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51ae59c640 1 -- 172.21.15.18:0/2694178783 learned_addr learned my addr 172.21.15.18:0/2694178783 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51aed9d640 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911c8260 0x5599911d9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cdbc0 0x5599911d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f519c00f7d0 con 0x5599911cd2a0 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f519c00f100 con 0x5599911c8260 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f519c00c340 con 0x5599911cdbc0 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.070+0000 7f51af59e640 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cdbc0 0x5599911d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f51aed9d640 1 -- 172.21.15.18:0/2694178783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cdbc0 msgr2=0x5599911d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f51aed9d640 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cdbc0 0x5599911d6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f51aed9d640 1 -- 172.21.15.18:0/2694178783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 msgr2=0x5599911da1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f51aed9d640 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 0x5599911da1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f51aed9d640 1 -- 172.21.15.18:0/2694178783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599911d7240 con 0x5599911c8260 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f51ae59c640 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 0x5599911da1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f51aed9d640 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911c8260 0x5599911d9cb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51a000bb30 tx=0x7f51a00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdafaf8f5ba29174 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f51b75ad740 10 client.0 _ll_register_callbacks cb 0x7f51a000b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f5192ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51a8036050 con 0x5599911c8260 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.071+0000 7f5192ff5640 1 -- 172.21.15.18:0/2694178783 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0012660 con 0x5599911c8260 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.072+0000 7f5192ff5640 1 -- 172.21.15.18:0/2694178783 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f51a002e040 con 0x5599911c8260 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.072+0000 7f5192ff5640 1 -- 172.21.15.18:0/2694178783 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f51a0012800 con 0x5599911c8260 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.072+0000 7f51b75ad740 10 client.25280 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.072+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55999124ca10 con 0x5599911c8260 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.072+0000 7f5192ff5640 1 -- 172.21.15.18:0/2694178783 <== mon.2 v2:172.21.15.49:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f51a0004020 con 0x5599911c8260 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.072+0000 7f51b75ad740 10 client.25280 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.073+0000 7f51b75ad740 10 client.25280 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.073+0000 7f51b75ad740 20 client.25280 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.073+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5599911e1470 0x55999124f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.073+0000 7f51b75ad740 4 client.25280 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d90a2605", "release": true, "await": true}] 2024-09-19T09:53:24.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.073+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d90a2605", "release": true, "await": true}) -- 0x559991130b90 con 0x5599911e1470 2024-09-19T09:53:24.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.073+0000 7f51ae59c640 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5599911e1470 0x55999124f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.074+0000 7f51ae59c640 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5599911e1470 0x55999124f220 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee9794b689120df server_cookie=aba4f325061cf4f3 in_seq=0 out_seq=0 2024-09-19T09:53:24.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.074+0000 7f5192ff5640 10 client.25280 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:24.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.075+0000 7f5192ff5640 1 -- 172.21.15.18:0/2694178783 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559991130b90 con 0x5599911e1470 2024-09-19T09:53:24.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.075+0000 7f5192ff5640 10 client.25280 handle_command_reply: tid=0 2024-09-19T09:53:24.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.075+0000 7f51b75ad740 1 client.25280 shutdown 2024-09-19T09:53:24.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.076+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911c8260 msgr2=0x5599911d9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.076+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911c8260 0x5599911d9cb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51a000bb30 tx=0x7f51a00046c0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.083 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:24.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.080+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 shutdown_connections 2024-09-19T09:53:24.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.080+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5599911e1470 0x55999124f220 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.080+0000 7f5192ff5640 0 client.25280 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:24.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.080+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599911cdbc0 0x5599911d6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.080+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599911cd2a0 0x5599911da1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.080+0000 7f51b75ad740 1 --2- 172.21.15.18:0/2694178783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599911c8260 0x5599911d9cb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.080+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 >> 172.21.15.18:0/2694178783 conn(0x5599911ba0a0 msgr2=0x5599911b8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.080+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 shutdown_connections 2024-09-19T09:53:24.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.080+0000 7f51b75ad740 1 -- 172.21.15.18:0/2694178783 wait complete. 2024-09-19T09:53:24.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.081+0000 7f51b75ad740 20 client.25280 trim_cache size 0 max 16384 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 4, 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: "d90a2605": { 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 4, 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:53:24.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:53:24.087 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:53:24.087 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 131.2, 2024-09-19T09:53:24.087 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:53:24.087 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:53:24.087 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:53:24.087 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:53:24.087 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:53:24.087 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:53:24.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:24.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:24.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:24.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:24.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:24.088 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:53:24.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.082+0000 7f51b51d4640 1 -- 172.21.15.18:0/1222253049 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f51980a3340 msgr2=0x7f51980a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.082+0000 7f51b51d4640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f51980a3340 0x7f51980a5800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f51a802f4d0 tx=0x7f51a8042000 comp rx=0 tx=0).stop 2024-09-19T09:53:24.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.082+0000 7f51b51d4640 1 -- 172.21.15.18:0/1222253049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51b0103780 msgr2=0x7f51b0198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.082+0000 7f51b51d4640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51b0103780 0x7f51b0198ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f51a400d950 tx=0x7f51a400de10 comp rx=0 tx=0).stop 2024-09-19T09:53:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.082+0000 7f51b51d4640 1 -- 172.21.15.18:0/1222253049 shutdown_connections 2024-09-19T09:53:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.082+0000 7f51b51d4640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f51980a3340 0x7f51980a5800 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.082+0000 7f51b51d4640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51b0108300 0x7f51b019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.082+0000 7f51b51d4640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51b0103780 0x7f51b0198ab0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f51a400d950 tx=0x7f51a400de10 comp rx=0 tx=0).stop 2024-09-19T09:53:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.082+0000 7f51b51d4640 1 --2- 172.21.15.18:0/1222253049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102dd0 0x7f51b0198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.082+0000 7f51b51d4640 1 -- 172.21.15.18:0/1222253049 >> 172.21.15.18:0/1222253049 conn(0x7f51b00fc7d0 msgr2=0x7f51b0105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.083+0000 7f51b51d4640 1 -- 172.21.15.18:0/1222253049 shutdown_connections 2024-09-19T09:53:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.083+0000 7f51b51d4640 1 -- 172.21.15.18:0/1222253049 wait complete. 2024-09-19T09:53:24.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.818+0000 7f9912d2f640 1 -- 172.21.15.18:0/4214373479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f990c10a560 msgr2=0x7f990c10a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.818+0000 7f9912d2f640 1 --2- 172.21.15.18:0/4214373479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f990c10a560 0x7f990c10a940 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9908009900 tx=0x7f990802a410 comp rx=0 tx=0).stop 2024-09-19T09:53:24.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.818+0000 7f9912d2f640 1 -- 172.21.15.18:0/4214373479 shutdown_connections 2024-09-19T09:53:24.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.818+0000 7f9912d2f640 1 --2- 172.21.15.18:0/4214373479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1139e0 0x7f990c115e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.818+0000 7f9912d2f640 1 --2- 172.21.15.18:0/4214373479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c10ae80 0x7f990c113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.818+0000 7f9912d2f640 1 --2- 172.21.15.18:0/4214373479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f990c10a560 0x7f990c10a940 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.818+0000 7f9912d2f640 1 -- 172.21.15.18:0/4214373479 >> 172.21.15.18:0/4214373479 conn(0x7f990c06e2d0 msgr2=0x7f990c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.818+0000 7f9912d2f640 1 -- 172.21.15.18:0/4214373479 shutdown_connections 2024-09-19T09:53:24.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.818+0000 7f9912d2f640 1 -- 172.21.15.18:0/4214373479 wait complete. 2024-09-19T09:53:24.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9912d2f640 1 Processor -- start 2024-09-19T09:53:24.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9912d2f640 1 -- start start 2024-09-19T09:53:24.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9912d2f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c10a560 0x7f990c1a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9912d2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f990c10ae80 0x7f990c1a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9903fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f990c10ae80 0x7f990c1a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9903fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f990c10ae80 0x7f990c1a6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56796/0 (socket says 172.21.15.18:56796) 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9912d2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1139e0 0x7f990c1a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9903fff640 1 -- 172.21.15.18:0/2492714939 learned_addr learned my addr 172.21.15.18:0/2492714939 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f990c11a830 con 0x7f990c10ae80 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f990c11a6b0 con 0x7f990c1139e0 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9910acb640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c10a560 0x7f990c1a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.819+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f990c11a9b0 con 0x7f990c10a560 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.820+0000 7f99112cc640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1139e0 0x7f990c1a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.820+0000 7f9903fff640 1 -- 172.21.15.18:0/2492714939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c10a560 msgr2=0x7f990c1a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.820+0000 7f9903fff640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c10a560 0x7f990c1a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.820+0000 7f9903fff640 1 -- 172.21.15.18:0/2492714939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1139e0 msgr2=0x7f990c1a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.820+0000 7f9903fff640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1139e0 0x7f990c1a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.820+0000 7f9903fff640 1 -- 172.21.15.18:0/2492714939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c1a1230 con 0x7f990c10ae80 2024-09-19T09:53:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.820+0000 7f9903fff640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f990c10ae80 0x7f990c1a6e80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00e940 tx=0x7f98fc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.820+0000 7f9901ffb640 1 -- 172.21.15.18:0/2492714939 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00cd80 con 0x7f990c10ae80 2024-09-19T09:53:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.820+0000 7f9901ffb640 1 -- 172.21.15.18:0/2492714939 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98fc0137d0 con 0x7f990c10ae80 2024-09-19T09:53:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.820+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990c1a1520 con 0x7f990c10ae80 2024-09-19T09:53:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.821+0000 7f9901ffb640 1 -- 172.21.15.18:0/2492714939 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0038e0 con 0x7f990c10ae80 2024-09-19T09:53:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.821+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990c116ac0 con 0x7f990c10ae80 2024-09-19T09:53:24.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.824+0000 7f9901ffb640 1 -- 172.21.15.18:0/2492714939 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f98fc003aa0 con 0x7f990c10ae80 2024-09-19T09:53:24.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.825+0000 7f9915108740 1 Processor -- start 2024-09-19T09:53:24.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.825+0000 7f9915108740 1 -- start start 2024-09-19T09:53:24.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.825+0000 7f9901ffb640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98f40a3340 0x7f98f40a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.825+0000 7f9915108740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3219b40 0x55b0d3218090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.825+0000 7f9915108740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d32185d0 0x55b0d3218a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.825+0000 7f9915108740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 0x55b0d3225760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.825+0000 7f9915108740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b0d317e2f0 con 0x55b0d32185d0 2024-09-19T09:53:24.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.825+0000 7f9915108740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b0d3125cf0 con 0x55b0d3219b40 2024-09-19T09:53:24.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.825+0000 7f9915108740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b0d317a2b0 con 0x55b0d3223370 2024-09-19T09:53:24.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f9903fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d32185d0 0x55b0d3218a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f99112cc640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98f40a3340 0x7f98f40a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f9903fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d32185d0 0x55b0d3218a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56812/0 (socket says 172.21.15.18:56812) 2024-09-19T09:53:24.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f9903fff640 1 -- 172.21.15.18:0/3370059301 learned_addr learned my addr 172.21.15.18:0/3370059301 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:24.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f99112cc640 1 --2- 172.21.15.18:0/3370059301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 0x55b0d3225760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f9901ffb640 1 -- 172.21.15.18:0/2492714939 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f98fc0d3df0 con 0x7f990c10ae80 2024-09-19T09:53:24.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f9910acb640 1 --2- 172.21.15.18:0/3370059301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3219b40 0x55b0d3218090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f99112cc640 1 -- 172.21.15.18:0/3370059301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3219b40 msgr2=0x55b0d3218090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f99112cc640 1 --2- 172.21.15.18:0/3370059301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3219b40 0x55b0d3218090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f99112cc640 1 -- 172.21.15.18:0/3370059301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d32185d0 msgr2=0x55b0d3218a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f99112cc640 1 --2- 172.21.15.18:0/3370059301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d32185d0 0x55b0d3218a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f99112cc640 1 -- 172.21.15.18:0/3370059301 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0d310a3a0 con 0x55b0d3223370 2024-09-19T09:53:24.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.826+0000 7f9910acb640 1 --2- 172.21.15.18:0/3370059301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3219b40 0x55b0d3218090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:24.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.827+0000 7f99112cc640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98f40a3340 0x7f98f40a5800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9904005c40 tx=0x7f9904012b10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.827+0000 7f99112cc640 1 --2- 172.21.15.18:0/3370059301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 0x55b0d3225760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9904012fa0 tx=0x7f990401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50ec8b716fbcbcea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.827+0000 7f98f2ffd640 1 -- 172.21.15.18:0/3370059301 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9904023070 con 0x55b0d3223370 2024-09-19T09:53:24.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.827+0000 7f98f2ffd640 1 -- 172.21.15.18:0/3370059301 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f990401dda0 con 0x55b0d3223370 2024-09-19T09:53:24.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.827+0000 7f98f2ffd640 1 -- 172.21.15.18:0/3370059301 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990401fde0 con 0x55b0d3223370 2024-09-19T09:53:24.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.828+0000 7f9915108740 1 -- 172.21.15.18:0/3370059301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 msgr2=0x55b0d3225760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.828+0000 7f9915108740 1 --2- 172.21.15.18:0/3370059301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 0x55b0d3225760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9904012fa0 tx=0x7f990401a000 comp rx=0 tx=0).stop 2024-09-19T09:53:24.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.828+0000 7f9915108740 1 -- 172.21.15.18:0/3370059301 shutdown_connections 2024-09-19T09:53:24.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.828+0000 7f9915108740 1 --2- 172.21.15.18:0/3370059301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 0x55b0d3225760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.828+0000 7f9915108740 1 --2- 172.21.15.18:0/3370059301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d32185d0 0x55b0d3218a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.828+0000 7f9915108740 1 --2- 172.21.15.18:0/3370059301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3219b40 0x55b0d3218090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.828+0000 7f9915108740 1 -- 172.21.15.18:0/3370059301 >> 172.21.15.18:0/3370059301 conn(0x55b0d31e1310 msgr2=0x55b0d3214c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.829+0000 7f9915108740 1 -- 172.21.15.18:0/3370059301 shutdown_connections 2024-09-19T09:53:24.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.829+0000 7f9915108740 1 -- 172.21.15.18:0/3370059301 wait complete. 2024-09-19T09:53:24.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.829+0000 7f9915108740 1 -- start start 2024-09-19T09:53:24.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.829+0000 7f9915108740 1 Processor -- start 2024-09-19T09:53:24.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9915108740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d32185d0 0x55b0d3222d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9915108740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3219b40 0x55b0d3220030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9915108740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 0x55b0d3220640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9915108740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b0d322e820 con 0x55b0d3219b40 2024-09-19T09:53:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9915108740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b0d3139060 con 0x55b0d32185d0 2024-09-19T09:53:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9915108740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b0d322e9a0 con 0x55b0d3223370 2024-09-19T09:53:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9915108740 10 client.0 _ll_register_callbacks cb 0x55b0d2e8c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9903fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3219b40 0x55b0d3220030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9903fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3219b40 0x55b0d3220030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56822/0 (socket says 172.21.15.18:56822) 2024-09-19T09:53:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9903fff640 1 -- 172.21.15.18:0/1367549639 learned_addr learned my addr 172.21.15.18:0/1367549639 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9910acb640 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d32185d0 0x55b0d3222d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f9903fff640 1 -- 172.21.15.18:0/1367549639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 msgr2=0x55b0d3220640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.830+0000 7f99112cc640 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 0x55b0d3220640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f9903fff640 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 0x55b0d3220640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f9903fff640 1 -- 172.21.15.18:0/1367549639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d32185d0 msgr2=0x55b0d3222d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f9903fff640 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d32185d0 0x55b0d3222d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f9903fff640 1 -- 172.21.15.18:0/1367549639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0d2eef3c0 con 0x55b0d3219b40 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f99112cc640 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 0x55b0d3220640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f9910acb640 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d32185d0 0x55b0d3222d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f9903fff640 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3219b40 0x55b0d3220030 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0058c0 tx=0x7f98fc09ffe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60542f82eca72e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f98ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f98ebfff640 1 -- 172.21.15.18:0/1367549639 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0a4790 con 0x55b0d3219b40 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f98ebfff640 1 -- 172.21.15.18:0/1367549639 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f98fc013cf0 con 0x55b0d3219b40 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.831+0000 7f9915108740 1 -- 172.21.15.18:0/1367549639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f990401dda0 con 0x55b0d3219b40 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f98ebfff640 1 -- 172.21.15.18:0/1367549639 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f98fc0a9050 con 0x55b0d3219b40 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f9915108740 10 client.15627 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f9915108740 1 -- 172.21.15.18:0/1367549639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b0d323a2e0 con 0x55b0d3219b40 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f98ebfff640 1 -- 172.21.15.18:0/1367549639 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f990401dda0 con 0x55b0d3219b40 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f98ebfff640 1 -- 172.21.15.18:0/1367549639 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f98fc09f830 con 0x55b0d3219b40 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f9915108740 10 client.15627 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f9915108740 10 client.15627 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f9915108740 20 client.15627 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f9915108740 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55b0d323b6f0 0x55b0d323db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f9915108740 4 client.15627 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.832+0000 7f9915108740 1 -- 172.21.15.18:0/1367549639 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0d318b860 con 0x55b0d323b6f0 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.833+0000 7f9910acb640 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55b0d323b6f0 0x55b0d323db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.833+0000 7f9910acb640 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55b0d323b6f0 0x55b0d323db00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=617b16fe2a5a0b server_cookie=259de657ac8405ad in_seq=0 out_seq=0 2024-09-19T09:53:24.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.833+0000 7f98ebfff640 10 client.15627 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:24.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f98ebfff640 1 -- 172.21.15.18:0/1367549639 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0d318b860 con 0x55b0d323b6f0 2024-09-19T09:53:24.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f98ebfff640 10 client.15627 handle_command_reply: tid=0 2024-09-19T09:53:24.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 client.15627 shutdown 2024-09-19T09:53:24.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 -- 172.21.15.18:0/1367549639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3219b40 msgr2=0x55b0d3220030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3219b40 0x55b0d3220030 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0058c0 tx=0x7f98fc09ffe0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 -- 172.21.15.18:0/1367549639 shutdown_connections 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55b0d323b6f0 0x55b0d323db00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d3223370 0x55b0d3220640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3219b40 0x55b0d3220030 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 --2- 172.21.15.18:0/1367549639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d32185d0 0x55b0d3222d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 -- 172.21.15.18:0/1367549639 >> 172.21.15.18:0/1367549639 conn(0x55b0d31e1310 msgr2=0x55b0d321a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f98ebfff640 0 client.15627 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 -- 172.21.15.18:0/1367549639 shutdown_connections 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.834+0000 7f9915108740 1 -- 172.21.15.18:0/1367549639 wait complete. 2024-09-19T09:53:24.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.835+0000 7f9915108740 20 client.15627 trim_cache size 0 max 16384 2024-09-19T09:53:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.860+0000 7f9915108740 1 Processor -- start 2024-09-19T09:53:24.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9915108740 1 -- start start 2024-09-19T09:53:24.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9915108740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 0x55b0d321ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9915108740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3223370 0x55b0d3221fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9915108740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3214f20 0x55b0d321b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9915108740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1b3a60 con 0x55b0d3223370 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9915108740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1b55a0 con 0x55b0d3214f20 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9915108740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1b4130 con 0x55b0d32185d0 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9910acb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 0x55b0d321ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9910acb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 0x55b0d321ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51166/0 (socket says 172.21.15.18:51166) 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9910acb640 1 -- 172.21.15.18:0/2181460850 learned_addr learned my addr 172.21.15.18:0/2181460850 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f9903fff640 1 --2- 172.21.15.18:0/2181460850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3223370 0x55b0d3221fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.861+0000 7f99112cc640 1 --2- 172.21.15.18:0/2181460850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3214f20 0x55b0d321b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.862+0000 7f9903fff640 1 -- 172.21.15.18:0/2181460850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 msgr2=0x55b0d321ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.862+0000 7f9903fff640 1 --2- 172.21.15.18:0/2181460850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 0x55b0d321ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.862+0000 7f9903fff640 1 -- 172.21.15.18:0/2181460850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3214f20 msgr2=0x55b0d321b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.862+0000 7f9903fff640 1 --2- 172.21.15.18:0/2181460850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3214f20 0x55b0d321b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.862+0000 7f9903fff640 1 -- 172.21.15.18:0/2181460850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0d321e580 con 0x55b0d3223370 2024-09-19T09:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.862+0000 7f99112cc640 1 --2- 172.21.15.18:0/2181460850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3214f20 0x55b0d321b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.862+0000 7f9903fff640 1 --2- 172.21.15.18:0/2181460850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3223370 0x55b0d3221fa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55b0d3221120 tx=0x7f98fc09e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a90c104809dd82c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.862+0000 7f98f27fc640 1 -- 172.21.15.18:0/2181460850 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0a4790 con 0x55b0d3223370 2024-09-19T09:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.862+0000 7f98f27fc640 1 -- 172.21.15.18:0/2181460850 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98fc013cf0 con 0x55b0d3223370 2024-09-19T09:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.862+0000 7f98f27fc640 1 -- 172.21.15.18:0/2181460850 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0b9100 con 0x55b0d3223370 2024-09-19T09:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.863+0000 7f9915108740 1 -- 172.21.15.18:0/2181460850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3223370 msgr2=0x55b0d3221fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.863+0000 7f9915108740 1 --2- 172.21.15.18:0/2181460850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3223370 0x55b0d3221fa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55b0d3221120 tx=0x7f98fc09e8f0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.863+0000 7f9915108740 1 -- 172.21.15.18:0/2181460850 shutdown_connections 2024-09-19T09:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.863+0000 7f9915108740 1 --2- 172.21.15.18:0/2181460850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3214f20 0x55b0d321b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.863+0000 7f9915108740 1 --2- 172.21.15.18:0/2181460850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3223370 0x55b0d3221fa0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.863+0000 7f9915108740 1 --2- 172.21.15.18:0/2181460850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 0x55b0d321ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.863+0000 7f9915108740 1 -- 172.21.15.18:0/2181460850 >> 172.21.15.18:0/2181460850 conn(0x55b0d31e1310 msgr2=0x55b0d3221890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.864+0000 7f9915108740 1 -- 172.21.15.18:0/2181460850 shutdown_connections 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.864+0000 7f9915108740 1 -- 172.21.15.18:0/2181460850 wait complete. 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.864+0000 7f9915108740 1 -- start start 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.864+0000 7f9915108740 1 Processor -- start 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9915108740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3214f20 0x55b0d321cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9915108740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 0x55b0d321d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9915108740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3223370 0x55b0d321da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9915108740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1b4ed0 con 0x55b0d3214f20 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9915108740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1b4800 con 0x55b0d3223370 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9915108740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1b1a60 con 0x55b0d32185d0 2024-09-19T09:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9915108740 10 client.0 _ll_register_callbacks cb 0x7f98fc09af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:24.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9910acb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3214f20 0x55b0d321cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9910acb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3214f20 0x55b0d321cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56838/0 (socket says 172.21.15.18:56838) 2024-09-19T09:53:24.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9910acb640 1 -- 172.21.15.18:0/4249871764 learned_addr learned my addr 172.21.15.18:0/4249871764 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:24.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f99112cc640 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3223370 0x55b0d321da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.865+0000 7f9903fff640 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 0x55b0d321d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f99112cc640 1 -- 172.21.15.18:0/4249871764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 msgr2=0x55b0d321d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f99112cc640 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 0x55b0d321d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f99112cc640 1 -- 172.21.15.18:0/4249871764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3214f20 msgr2=0x55b0d321cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:24.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f99112cc640 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3214f20 0x55b0d321cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f99112cc640 1 -- 172.21.15.18:0/4249871764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0d32a5370 con 0x55b0d3223370 2024-09-19T09:53:24.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f9910acb640 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3214f20 0x55b0d321cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f99112cc640 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3223370 0x55b0d321da40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9904012fd0 tx=0x7f990401d8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5b53711c192e8c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f98ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f98ebfff640 1 -- 172.21.15.18:0/4249871764 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9904023040 con 0x55b0d3223370 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f9915108740 1 -- 172.21.15.18:0/4249871764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98fc013cf0 con 0x55b0d3223370 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f98ebfff640 1 -- 172.21.15.18:0/4249871764 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9904005040 con 0x55b0d3223370 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f98ebfff640 1 -- 172.21.15.18:0/4249871764 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9904005240 con 0x55b0d3223370 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f9915108740 10 client.25295 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.866+0000 7f9915108740 1 -- 172.21.15.18:0/4249871764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b0d32a65b0 con 0x55b0d3223370 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.867+0000 7f98ebfff640 1 -- 172.21.15.18:0/4249871764 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98fc013cf0 con 0x55b0d3223370 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.867+0000 7f98ebfff640 1 -- 172.21.15.18:0/4249871764 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f990401e070 con 0x55b0d3223370 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.867+0000 7f9915108740 10 client.25295 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.867+0000 7f9915108740 10 client.25295 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:53:24.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.867+0000 7f9915108740 20 client.25295 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.867+0000 7f9915108740 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55b0d32a6a00 0x55b0d32a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.867+0000 7f9915108740 4 client.25295 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.867+0000 7f9915108740 1 -- 172.21.15.18:0/4249871764 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b0d3185d70 con 0x55b0d32a6a00 2024-09-19T09:53:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.867+0000 7f9910acb640 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55b0d32a6a00 0x55b0d32a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.868+0000 7f98ebfff640 10 client.25295 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.868+0000 7f9910acb640 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55b0d32a6a00 0x55b0d32a8e20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3599181bd598065f server_cookie=2f4b9e50dddfea3a in_seq=0 out_seq=0 2024-09-19T09:53:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.868+0000 7f98ebfff640 1 -- 172.21.15.18:0/4249871764 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b0d3185d70 con 0x55b0d32a6a00 2024-09-19T09:53:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.868+0000 7f98ebfff640 10 client.25295 handle_command_reply: tid=0 2024-09-19T09:53:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.868+0000 7f9915108740 1 client.25295 shutdown 2024-09-19T09:53:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.869+0000 7f9915108740 1 -- 172.21.15.18:0/4249871764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3223370 msgr2=0x55b0d321da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.869+0000 7f9915108740 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3223370 0x55b0d321da40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9904012fd0 tx=0x7f990401d8f0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.869+0000 7f9915108740 1 -- 172.21.15.18:0/4249871764 shutdown_connections 2024-09-19T09:53:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.869+0000 7f9915108740 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55b0d32a6a00 0x55b0d32a8e20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.869+0000 7f9915108740 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b0d3223370 0x55b0d321da40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.869+0000 7f9915108740 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d32185d0 0x55b0d321d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.869+0000 7f9915108740 1 --2- 172.21.15.18:0/4249871764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0d3214f20 0x55b0d321cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.869+0000 7f9915108740 1 -- 172.21.15.18:0/4249871764 >> 172.21.15.18:0/4249871764 conn(0x55b0d31e1310 msgr2=0x55b0d32220b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.869+0000 7f98ebfff640 0 client.25295 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.870+0000 7f9915108740 1 -- 172.21.15.18:0/4249871764 shutdown_connections 2024-09-19T09:53:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.870+0000 7f9915108740 1 -- 172.21.15.18:0/4249871764 wait complete. 2024-09-19T09:53:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.870+0000 7f9915108740 20 client.25295 trim_cache size 0 max 16384 2024-09-19T09:53:24.875 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98f40a3340 msgr2=0x7f98f40a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98f40a3340 0x7f98f40a5800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9904005c40 tx=0x7f9904012b10 comp rx=0 tx=0).stop 2024-09-19T09:53:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f990c10ae80 msgr2=0x7f990c1a6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f990c10ae80 0x7f990c1a6e80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00e940 tx=0x7f98fc00ee00 comp rx=0 tx=0).stop 2024-09-19T09:53:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 shutdown_connections 2024-09-19T09:53:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98f40a3340 0x7f98f40a5800 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f990c1139e0 0x7f990c1a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f990c10ae80 0x7f990c1a6e80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 --2- 172.21.15.18:0/2492714939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c10a560 0x7f990c1a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 >> 172.21.15.18:0/2492714939 conn(0x7f990c06e2d0 msgr2=0x7f990c070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 shutdown_connections 2024-09-19T09:53:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:24.871+0000 7f9912d2f640 1 -- 172.21.15.18:0/2492714939 wait complete. 2024-09-19T09:53:25.459 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd90a2605', total seconds elapsed: 16.1 2024-09-19T09:53:25.785 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:25 smithi018 ceph-mon[30956]: pgmap v371: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:53:25.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:25 smithi049 ceph-mon[34858]: pgmap v371: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:53:25.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:25 smithi162 ceph-mon[35174]: pgmap v371: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:53:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.014+0000 7f051a29b640 1 -- 172.21.15.18:0/4215460551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514107820 msgr2=0x7f0514109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.014+0000 7f051a29b640 1 --2- 172.21.15.18:0/4215460551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514107820 0x7f0514109c90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f050c009ca0 tx=0x7f050c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.014+0000 7f051a29b640 1 -- 172.21.15.18:0/4215460551 shutdown_connections 2024-09-19T09:53:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.014+0000 7f051a29b640 1 --2- 172.21.15.18:0/4215460551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514107820 0x7f0514109c90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.014+0000 7f051a29b640 1 --2- 172.21.15.18:0/4215460551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514104ef0 0x7f05141072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.014+0000 7f051a29b640 1 --2- 172.21.15.18:0/4215460551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05141025c0 0x7f05141049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.014+0000 7f051a29b640 1 -- 172.21.15.18:0/4215460551 >> 172.21.15.18:0/4215460551 conn(0x7f05140fc1e0 msgr2=0x7f05140fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.014+0000 7f051a29b640 1 -- 172.21.15.18:0/4215460551 shutdown_connections 2024-09-19T09:53:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.014+0000 7f051a29b640 1 -- 172.21.15.18:0/4215460551 wait complete. 2024-09-19T09:53:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.015+0000 7f051a29b640 1 Processor -- start 2024-09-19T09:53:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.015+0000 7f051a29b640 1 -- start start 2024-09-19T09:53:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f051a29b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05141025c0 0x7f0514197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f051a29b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514104ef0 0x7f05141983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f051a29b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514107820 0x7f051419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f051a29b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f051410d870 con 0x7f05141025c0 2024-09-19T09:53:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f051a29b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f051410d6f0 con 0x7f0514104ef0 2024-09-19T09:53:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f051a29b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f051410d9f0 con 0x7f0514107820 2024-09-19T09:53:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05141025c0 0x7f0514197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f05137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514104ef0 0x7f05141983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05141025c0 0x7f0514197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56852/0 (socket says 172.21.15.18:56852) 2024-09-19T09:53:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f0513fff640 1 -- 172.21.15.18:0/3829057477 learned_addr learned my addr 172.21.15.18:0/3829057477 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f0518838640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514107820 0x7f051419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f0513fff640 1 -- 172.21.15.18:0/3829057477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514107820 msgr2=0x7f051419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f0513fff640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514107820 0x7f051419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f0513fff640 1 -- 172.21.15.18:0/3829057477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514104ef0 msgr2=0x7f05141983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f0513fff640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514104ef0 0x7f05141983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f0513fff640 1 -- 172.21.15.18:0/3829057477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051419fa80 con 0x7f05141025c0 2024-09-19T09:53:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.016+0000 7f05137fe640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514104ef0 0x7f05141983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.017+0000 7f0513fff640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05141025c0 0x7f0514197e60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f050400e9f0 tx=0x7f050400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.017+0000 7f05117fa640 1 -- 172.21.15.18:0/3829057477 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050400cd80 con 0x7f05141025c0 2024-09-19T09:53:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.017+0000 7f05117fa640 1 -- 172.21.15.18:0/3829057477 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0504005500 con 0x7f05141025c0 2024-09-19T09:53:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.017+0000 7f05117fa640 1 -- 172.21.15.18:0/3829057477 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504010690 con 0x7f05141025c0 2024-09-19T09:53:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.017+0000 7f051a29b640 1 -- 172.21.15.18:0/3829057477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0514100410 con 0x7f05141025c0 2024-09-19T09:53:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.017+0000 7f051a29b640 1 -- 172.21.15.18:0/3829057477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0514100910 con 0x7f05141025c0 2024-09-19T09:53:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f051d035740 1 Processor -- start 2024-09-19T09:53:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f05117fa640 1 -- 172.21.15.18:0/3829057477 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f05040046c0 con 0x7f05141025c0 2024-09-19T09:53:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f051d035740 1 -- start start 2024-09-19T09:53:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f051d035740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 0x55c069377da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f051d035740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c06937cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f051d035740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c06937d370 0x55c06937f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f051d035740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c0692db2f0 con 0x55c0693782e0 2024-09-19T09:53:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f051d035740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c069283270 con 0x55c06937d370 2024-09-19T09:53:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f051d035740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c0692d72b0 con 0x55c0693779a0 2024-09-19T09:53:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f0518838640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 0x55c069377da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c06937cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f0518838640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 0x55c069377da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51198/0 (socket says 172.21.15.18:51198) 2024-09-19T09:53:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f0518838640 1 -- 172.21.15.18:0/4139716620 learned_addr learned my addr 172.21.15.18:0/4139716620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.020+0000 7f05137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c06937d370 0x55c06937f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f05137fe640 1 -- 172.21.15.18:0/4139716620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 msgr2=0x55c069377da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f05137fe640 1 --2- 172.21.15.18:0/4139716620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 0x55c069377da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f05137fe640 1 -- 172.21.15.18:0/4139716620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 msgr2=0x55c06937cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f05117fa640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3370 0x7f04fc0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f05117fa640 1 -- 172.21.15.18:0/3829057477 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f05040cfcc0 con 0x7f05141025c0 2024-09-19T09:53:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f05137fe640 1 --2- 172.21.15.18:0/4139716620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c06937cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f05137fe640 1 -- 172.21.15.18:0/4139716620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c069282340 con 0x55c06937d370 2024-09-19T09:53:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f0513fff640 1 --2- 172.21.15.18:0/4139716620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c06937cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f0518838640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3370 0x7f04fc0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f05137fe640 1 --2- 172.21.15.18:0/4139716620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c06937d370 0x55c06937f830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f051406a400 tx=0x7f0508005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48369dcd528ad4ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.021+0000 7f04fa7fc640 1 -- 172.21.15.18:0/4139716620 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508004310 con 0x55c06937d370 2024-09-19T09:53:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f04fa7fc640 1 -- 172.21.15.18:0/4139716620 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f050801f070 con 0x55c06937d370 2024-09-19T09:53:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f04fa7fc640 1 -- 172.21.15.18:0/4139716620 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050800b930 con 0x55c06937d370 2024-09-19T09:53:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f051d035740 1 -- 172.21.15.18:0/4139716620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c06937d370 msgr2=0x55c06937f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f051d035740 1 --2- 172.21.15.18:0/4139716620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c06937d370 0x55c06937f830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f051406a400 tx=0x7f0508005f90 comp rx=0 tx=0).stop 2024-09-19T09:53:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f0518838640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3370 0x7f04fc0a5830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f050c005e30 tx=0x7f050c031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f051d035740 1 -- 172.21.15.18:0/4139716620 shutdown_connections 2024-09-19T09:53:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f051d035740 1 --2- 172.21.15.18:0/4139716620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c06937d370 0x55c06937f830 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f051d035740 1 --2- 172.21.15.18:0/4139716620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c06937cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f051d035740 1 --2- 172.21.15.18:0/4139716620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 0x55c069377da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f051d035740 1 -- 172.21.15.18:0/4139716620 >> 172.21.15.18:0/4139716620 conn(0x55c069373010 msgr2=0x55c069373410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f051d035740 1 -- 172.21.15.18:0/4139716620 shutdown_connections 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.022+0000 7f051d035740 1 -- 172.21.15.18:0/4139716620 wait complete. 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f051d035740 1 -- start start 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f051d035740 1 Processor -- start 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f051d035740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 0x55c069381b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f051d035740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c0693820a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f0513fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 0x55c069381b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f05137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c0693820a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f0513fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 0x55c069381b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:56390/0 (socket says 172.21.15.18:56390) 2024-09-19T09:53:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f05137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c0693820a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56870/0 (socket says 172.21.15.18:56870) 2024-09-19T09:53:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f0513fff640 1 -- 172.21.15.18:0/347885224 learned_addr learned my addr 172.21.15.18:0/347885224 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f051d035740 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06937d370 0x55c0693890e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.023+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c069380340 con 0x55c0693782e0 2024-09-19T09:53:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c069264290 con 0x55c0693779a0 2024-09-19T09:53:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c0693804c0 con 0x55c06937d370 2024-09-19T09:53:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f0513fff640 1 -- 172.21.15.18:0/347885224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06937d370 msgr2=0x55c0693890e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f0513fff640 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06937d370 0x55c0693890e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f0513fff640 1 -- 172.21.15.18:0/347885224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 msgr2=0x55c0693820a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f0513fff640 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c0693820a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f0513fff640 1 -- 172.21.15.18:0/347885224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c068fee210 con 0x55c0693779a0 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f05137fe640 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c0693820a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f051d035740 10 client.0 _ll_register_callbacks cb 0x55c069295140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f050801f070 con 0x55c0693779a0 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f0513fff640 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 0x55c069381b60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f050409c010 tx=0x7f0504009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=584c35750563b3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f04f37fe640 10 client.25307 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f04f37fe640 1 -- 172.21.15.18:0/347885224 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05040d1070 con 0x55c0693779a0 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f04f37fe640 1 -- 172.21.15.18:0/347885224 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f050409b960 con 0x55c0693779a0 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f04f37fe640 1 -- 172.21.15.18:0/347885224 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05040985b0 con 0x55c0693779a0 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f051d035740 10 client.25307 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.024+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c0690ba620 con 0x55c0693779a0 2024-09-19T09:53:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.025+0000 7f04f37fe640 1 -- 172.21.15.18:0/347885224 <== mon.2 v2:172.21.15.49:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f05040bc0c0 con 0x55c0693779a0 2024-09-19T09:53:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.025+0000 7f051d035740 10 client.25307 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.025+0000 7f051d035740 10 client.25307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.025+0000 7f051d035740 20 client.25307 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.025+0000 7f051d035740 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c06938d6d0 0x55c06938fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.025+0000 7f051d035740 4 client.25307 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.025+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0692e8a20 con 0x55c06938d6d0 2024-09-19T09:53:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.025+0000 7f05137fe640 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c06938d6d0 0x55c06938fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.026+0000 7f04f37fe640 10 client.25307 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.026+0000 7f05137fe640 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c06938d6d0 0x55c06938fb40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6edc3bb8be7561f server_cookie=8632adb8b98df607 in_seq=0 out_seq=0 2024-09-19T09:53:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.026+0000 7f04f37fe640 1 -- 172.21.15.18:0/347885224 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c0692e8a20 con 0x55c06938d6d0 2024-09-19T09:53:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.026+0000 7f04f37fe640 10 client.25307 handle_command_reply: tid=0 2024-09-19T09:53:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.026+0000 7f051d035740 1 client.25307 shutdown 2024-09-19T09:53:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.026+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 msgr2=0x55c069381b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.026+0000 7f051d035740 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 0x55c069381b60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f050409c010 tx=0x7f0504009310 comp rx=0 tx=0).stop 2024-09-19T09:53:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.026+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 shutdown_connections 2024-09-19T09:53:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.026+0000 7f051d035740 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c06938d6d0 0x55c06938fb40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.027+0000 7f051d035740 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06937d370 0x55c0693890e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.027+0000 7f051d035740 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0693782e0 0x55c0693820a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.027+0000 7f051d035740 1 --2- 172.21.15.18:0/347885224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 0x55c069381b60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.027+0000 7f04f37fe640 0 client.25307 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.027+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 >> 172.21.15.18:0/347885224 conn(0x55c069373010 msgr2=0x55c069374820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.027+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 shutdown_connections 2024-09-19T09:53:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.027+0000 7f051d035740 1 -- 172.21.15.18:0/347885224 wait complete. 2024-09-19T09:53:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.027+0000 7f051d035740 20 client.25307 trim_cache size 0 max 16384 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.041+0000 7f051d035740 1 Processor -- start 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f051d035740 1 -- start start 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f051d035740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 0x55c069381910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f051d035740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693782e0 0x55c0693890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f051d035740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 0x55c069381e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f051d035740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05141a6d00 con 0x55c06937d370 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f051d035740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05141a8840 con 0x55c0693782e0 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f051d035740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05141a73d0 con 0x55c0693779a0 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f0513fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 0x55c069381910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f0513fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 0x55c069381910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51224/0 (socket says 172.21.15.18:51224) 2024-09-19T09:53:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f0513fff640 1 -- 172.21.15.18:0/2601371679 learned_addr learned my addr 172.21.15.18:0/2601371679 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f05137fe640 1 --2- 172.21.15.18:0/2601371679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693782e0 0x55c0693890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f0518838640 1 --2- 172.21.15.18:0/2601371679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 0x55c069381e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f05137fe640 1 -- 172.21.15.18:0/2601371679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 msgr2=0x55c069381910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f05137fe640 1 --2- 172.21.15.18:0/2601371679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 0x55c069381910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f05137fe640 1 -- 172.21.15.18:0/2601371679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 msgr2=0x55c069381e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f05137fe640 1 --2- 172.21.15.18:0/2601371679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 0x55c069381e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.042+0000 7f05137fe640 1 -- 172.21.15.18:0/2601371679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0693787c0 con 0x55c0693782e0 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.043+0000 7f0518838640 1 --2- 172.21.15.18:0/2601371679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 0x55c069381e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.043+0000 7f05137fe640 1 --2- 172.21.15.18:0/2601371679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693782e0 0x55c0693890a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55c0693903c0 tx=0x7f0508010850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b0a84ca13001a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.043+0000 7f04f9ffb640 1 -- 172.21.15.18:0/2601371679 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508010d60 con 0x55c0693782e0 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.043+0000 7f04f9ffb640 1 -- 172.21.15.18:0/2601371679 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0508003da0 con 0x55c0693782e0 2024-09-19T09:53:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.043+0000 7f04f9ffb640 1 -- 172.21.15.18:0/2601371679 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508031ce0 con 0x55c0693782e0 2024-09-19T09:53:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.044+0000 7f051d035740 1 -- 172.21.15.18:0/2601371679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693782e0 msgr2=0x55c0693890a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.044+0000 7f051d035740 1 --2- 172.21.15.18:0/2601371679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693782e0 0x55c0693890a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55c0693903c0 tx=0x7f0508010850 comp rx=0 tx=0).stop 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.044+0000 7f051d035740 1 -- 172.21.15.18:0/2601371679 shutdown_connections 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.044+0000 7f051d035740 1 --2- 172.21.15.18:0/2601371679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 0x55c069381e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.044+0000 7f051d035740 1 --2- 172.21.15.18:0/2601371679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693782e0 0x55c0693890a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.044+0000 7f051d035740 1 --2- 172.21.15.18:0/2601371679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693779a0 0x55c069381910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.044+0000 7f051d035740 1 -- 172.21.15.18:0/2601371679 >> 172.21.15.18:0/2601371679 conn(0x55c069373010 msgr2=0x55c069379480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.044+0000 7f051d035740 1 -- 172.21.15.18:0/2601371679 shutdown_connections 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.044+0000 7f051d035740 1 -- 172.21.15.18:0/2601371679 wait complete. 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.044+0000 7f051d035740 1 -- start start 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f051d035740 1 Processor -- start 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f051d035740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 0x55c069389070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f051d035740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693782e0 0x55c069385b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f051d035740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 0x55c069386190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f051d035740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05141a8170 con 0x55c06937d370 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f051d035740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05141a7aa0 con 0x55c0693779a0 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f051d035740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05141a4ce0 con 0x55c0693782e0 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f051d035740 10 client.0 _ll_register_callbacks cb 0x7f05040baf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f0518838640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 0x55c069386190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f05137fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693782e0 0x55c069385b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f05137fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693782e0 0x55c069385b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51240/0 (socket says 172.21.15.18:51240) 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f05137fe640 1 -- 172.21.15.18:0/843990262 learned_addr learned my addr 172.21.15.18:0/843990262 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.045+0000 7f0513fff640 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 0x55c069389070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.046+0000 7f0518838640 1 -- 172.21.15.18:0/843990262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693782e0 msgr2=0x55c069385b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.046+0000 7f0518838640 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693782e0 0x55c069385b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.046+0000 7f0518838640 1 -- 172.21.15.18:0/843990262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 msgr2=0x55c069389070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.046+0000 7f0518838640 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 0x55c069389070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.046+0000 7f0518838640 1 -- 172.21.15.18:0/843990262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0693f64b0 con 0x55c06937d370 2024-09-19T09:53:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.046+0000 7f0518838640 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 0x55c069386190 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f050c031ae0 tx=0x7f050c0093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab22f83c5d46052 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.046+0000 7f04f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.046+0000 7f04f37fe640 1 -- 172.21.15.18:0/843990262 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c003e80 con 0x55c06937d370 2024-09-19T09:53:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.046+0000 7f04f37fe640 1 -- 172.21.15.18:0/843990262 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f050c042030 con 0x55c06937d370 2024-09-19T09:53:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.046+0000 7f051d035740 1 -- 172.21.15.18:0/843990262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0508003da0 con 0x55c06937d370 2024-09-19T09:53:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f04f37fe640 1 -- 172.21.15.18:0/843990262 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f050c004250 con 0x55c06937d370 2024-09-19T09:53:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f051d035740 10 client.15648 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f051d035740 1 -- 172.21.15.18:0/843990262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c0693f77a0 con 0x55c06937d370 2024-09-19T09:53:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f04f37fe640 1 -- 172.21.15.18:0/843990262 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0508003da0 con 0x55c06937d370 2024-09-19T09:53:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f04f37fe640 1 -- 172.21.15.18:0/843990262 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f050c0305c0 con 0x55c06937d370 2024-09-19T09:53:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f051d035740 10 client.15648 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f051d035740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f051d035740 20 client.15648 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f051d035740 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c0693f80f0 0x55c0693fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f051d035740 4 client.15648 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:53:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.047+0000 7f051d035740 1 -- 172.21.15.18:0/843990262 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c0692e2d70 con 0x55c0693f80f0 2024-09-19T09:53:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.048+0000 7f0513fff640 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c0693f80f0 0x55c0693fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.048+0000 7f04f37fe640 10 client.15648 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.048+0000 7f0513fff640 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c0693f80f0 0x55c0693fa4e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79308124da1d0840 server_cookie=a47a28508df38eac in_seq=0 out_seq=0 2024-09-19T09:53:26.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f04f37fe640 1 -- 172.21.15.18:0/843990262 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c0692e2d70 con 0x55c0693f80f0 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f04f37fe640 10 client.15648 handle_command_reply: tid=0 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 client.15648 shutdown 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 -- 172.21.15.18:0/843990262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 msgr2=0x55c069386190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 0x55c069386190 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f050c031ae0 tx=0x7f050c0093a0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 -- 172.21.15.18:0/843990262 shutdown_connections 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c0693f80f0 0x55c0693fa4e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f04f37fe640 0 client.15648 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c06937d370 0x55c069386190 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c0693782e0 0x55c069385b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 --2- 172.21.15.18:0/843990262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c0693779a0 0x55c069389070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 -- 172.21.15.18:0/843990262 >> 172.21.15.18:0/843990262 conn(0x55c069373010 msgr2=0x55c0693719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 -- 172.21.15.18:0/843990262 shutdown_connections 2024-09-19T09:53:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.057+0000 7f051d035740 1 -- 172.21.15.18:0/843990262 wait complete. 2024-09-19T09:53:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.058+0000 7f051d035740 20 client.15648 trim_cache size 0 max 16384 2024-09-19T09:53:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:53:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:53:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:53:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:53:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.058+0000 7f051a29b640 1 -- 172.21.15.18:0/3829057477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3370 msgr2=0x7f04fc0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.058+0000 7f051a29b640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3370 0x7f04fc0a5830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f050c005e30 tx=0x7f050c031bb0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.058+0000 7f051a29b640 1 -- 172.21.15.18:0/3829057477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05141025c0 msgr2=0x7f0514197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.058+0000 7f051a29b640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05141025c0 0x7f0514197e60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f050400e9f0 tx=0x7f050400edf0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.058+0000 7f051a29b640 1 -- 172.21.15.18:0/3829057477 shutdown_connections 2024-09-19T09:53:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.059+0000 7f051a29b640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3370 0x7f04fc0a5830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.059+0000 7f051a29b640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514107820 0x7f051419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.059+0000 7f051a29b640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514104ef0 0x7f05141983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.059+0000 7f051a29b640 1 --2- 172.21.15.18:0/3829057477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05141025c0 0x7f0514197e60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.059+0000 7f051a29b640 1 -- 172.21.15.18:0/3829057477 >> 172.21.15.18:0/3829057477 conn(0x7f05140fc1e0 msgr2=0x7f0514102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.059+0000 7f051a29b640 1 -- 172.21.15.18:0/3829057477 shutdown_connections 2024-09-19T09:53:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:26.059+0000 7f051a29b640 1 -- 172.21.15.18:0/3829057477 wait complete. 2024-09-19T09:53:26.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:53:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.890+0000 7fefa589c640 1 -- 172.21.15.18:0/1769849612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefa0102570 msgr2=0x7fefa01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.890+0000 7fefa589c640 1 --2- 172.21.15.18:0/1769849612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefa0102570 0x7fefa01029b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fef94009900 tx=0x7fef9402a480 comp rx=0 tx=0).stop 2024-09-19T09:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.890+0000 7fefa589c640 1 -- 172.21.15.18:0/1769849612 shutdown_connections 2024-09-19T09:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.890+0000 7fefa589c640 1 --2- 172.21.15.18:0/1769849612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa0102ef0 0x7fefa010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.890+0000 7fefa589c640 1 --2- 172.21.15.18:0/1769849612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefa0102570 0x7fefa01029b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.890+0000 7fefa589c640 1 --2- 172.21.15.18:0/1769849612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa0100e20 0x7fefa0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.890+0000 7fefa589c640 1 -- 172.21.15.18:0/1769849612 >> 172.21.15.18:0/1769849612 conn(0x7fefa00fc7d0 msgr2=0x7fefa00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.890+0000 7fefa589c640 1 -- 172.21.15.18:0/1769849612 shutdown_connections 2024-09-19T09:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.890+0000 7fefa589c640 1 -- 172.21.15.18:0/1769849612 wait complete. 2024-09-19T09:53:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.891+0000 7fefa589c640 1 Processor -- start 2024-09-19T09:53:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.891+0000 7fefa589c640 1 -- start start 2024-09-19T09:53:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fefa589c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefa0100e20 0x7fefa0197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fefa589c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa0102570 0x7fefa01979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fefa589c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa0102ef0 0x7fefa019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fefa589c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fefa0110f80 con 0x7fefa0100e20 2024-09-19T09:53:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fefa589c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fefa0110e00 con 0x7fefa0102570 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fefa589c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefa0111100 con 0x7fefa0102ef0 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fef9effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefa0100e20 0x7fefa0197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fef9effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefa0100e20 0x7fefa0197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36844/0 (socket says 172.21.15.18:36844) 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fef9effd640 1 -- 172.21.15.18:0/1483629716 learned_addr learned my addr 172.21.15.18:0/1483629716 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa0102570 0x7fefa01979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.892+0000 7fef9f7fe640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa0102ef0 0x7fefa019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.893+0000 7fef9f7fe640 1 -- 172.21.15.18:0/1483629716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa0102570 msgr2=0x7fefa01979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.893+0000 7fef9f7fe640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa0102570 0x7fefa01979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.893+0000 7fef9f7fe640 1 -- 172.21.15.18:0/1483629716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefa0100e20 msgr2=0x7fefa0197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.893+0000 7fef9f7fe640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefa0100e20 0x7fefa0197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.893+0000 7fef9f7fe640 1 -- 172.21.15.18:0/1483629716 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa019c410 con 0x7fefa0102ef0 2024-09-19T09:53:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.893+0000 7fef9f7fe640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa0102ef0 0x7fefa019bd30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef98009fd0 tx=0x7fef9800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.893+0000 7fefa489a640 1 -- 172.21.15.18:0/1483629716 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9800dc30 con 0x7fefa0102ef0 2024-09-19T09:53:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.893+0000 7fefa489a640 1 -- 172.21.15.18:0/1483629716 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef9800ddd0 con 0x7fefa0102ef0 2024-09-19T09:53:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.894+0000 7fefa489a640 1 -- 172.21.15.18:0/1483629716 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98005280 con 0x7fefa0102ef0 2024-09-19T09:53:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.894+0000 7fefa589c640 1 -- 172.21.15.18:0/1483629716 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa019c700 con 0x7fefa0102ef0 2024-09-19T09:53:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.894+0000 7fefa589c640 1 -- 172.21.15.18:0/1483629716 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa0069f70 con 0x7fefa0102ef0 2024-09-19T09:53:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.897+0000 7fefa7c75740 1 Processor -- start 2024-09-19T09:53:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.897+0000 7fefa489a640 1 -- 172.21.15.18:0/1483629716 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fef98004a40 con 0x7fefa0102ef0 2024-09-19T09:53:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fefa7c75740 1 -- start start 2024-09-19T09:53:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a01f350 0x55c57a01d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a01e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a028b80 0x55c57a02af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fefa7c75740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c579f7b2f0 con 0x55c57a01f350 2024-09-19T09:53:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fefa7c75740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c579f22cf0 con 0x55c57a01dde0 2024-09-19T09:53:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fefa7c75740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c579f772b0 con 0x55c57a028b80 2024-09-19T09:53:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fef9e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a01f350 0x55c57a01d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fef9effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a01e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fef9effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a01e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37044/0 (socket says 172.21.15.18:37044) 2024-09-19T09:53:26.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.898+0000 7fef9effd640 1 -- 172.21.15.18:0/2368051463 learned_addr learned my addr 172.21.15.18:0/2368051463 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:26.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.899+0000 7fef9effd640 1 -- 172.21.15.18:0/2368051463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a028b80 msgr2=0x55c57a02af70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:26.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.899+0000 7fef9effd640 1 --2- 172.21.15.18:0/2368051463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a028b80 0x55c57a02af70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.899+0000 7fef9effd640 1 -- 172.21.15.18:0/2368051463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a01f350 msgr2=0x55c57a01d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.899+0000 7fef9effd640 1 --2- 172.21.15.18:0/2368051463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a01f350 0x55c57a01d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.899+0000 7fef9effd640 1 -- 172.21.15.18:0/2368051463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c579f073a0 con 0x55c57a01dde0 2024-09-19T09:53:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.899+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/2368051463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a01f350 0x55c57a01d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.899+0000 7fef9effd640 1 --2- 172.21.15.18:0/2368051463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a01e220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fef90009d60 tx=0x7fef900117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3282114b287317c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.900+0000 7fefa489a640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fef880a32c0 0x7fef880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.900+0000 7fef85ffb640 1 -- 172.21.15.18:0/2368051463 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef90012650 con 0x55c57a01dde0 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.900+0000 7fef85ffb640 1 -- 172.21.15.18:0/2368051463 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef90009e50 con 0x55c57a01dde0 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.900+0000 7fef85ffb640 1 -- 172.21.15.18:0/2368051463 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9000fd30 con 0x55c57a01dde0 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.900+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fef880a32c0 0x7fef880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.900+0000 7fefa489a640 1 -- 172.21.15.18:0/1483629716 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fef980cf570 con 0x7fefa0102ef0 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fefa7c75740 1 -- 172.21.15.18:0/2368051463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 msgr2=0x55c57a01e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fefa7c75740 1 --2- 172.21.15.18:0/2368051463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a01e220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fef90009d60 tx=0x7fef900117b0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fef880a32c0 0x7fef880a5780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fef94009230 tx=0x7fef940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fefa7c75740 1 -- 172.21.15.18:0/2368051463 shutdown_connections 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fefa7c75740 1 --2- 172.21.15.18:0/2368051463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a028b80 0x55c57a02af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fefa7c75740 1 --2- 172.21.15.18:0/2368051463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a01e220 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fefa7c75740 1 --2- 172.21.15.18:0/2368051463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a01f350 0x55c57a01d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fefa7c75740 1 -- 172.21.15.18:0/2368051463 >> 172.21.15.18:0/2368051463 conn(0x55c579fde310 msgr2=0x55c57a01a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fefa7c75740 1 -- 172.21.15.18:0/2368051463 shutdown_connections 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fefa7c75740 1 -- 172.21.15.18:0/2368051463 wait complete. 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.901+0000 7fefa7c75740 1 -- start start 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fefa7c75740 1 Processor -- start 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a0285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01f350 0x55c57a025850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a025e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fefa7c75740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c57a02b880 con 0x55c57a028b80 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fefa7c75740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c579f36060 con 0x55c57a01dde0 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fefa7c75740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c57a02ba00 con 0x55c57a01f350 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fefa7c75740 10 client.0 _ll_register_callbacks cb 0x55c579c898c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fef9effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a0285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fef9e7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01f350 0x55c57a025850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a025e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fef9e7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01f350 0x55c57a025850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53252/0 (socket says 172.21.15.18:53252) 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.902+0000 7fef9e7fc640 1 -- 172.21.15.18:0/2926754485 learned_addr learned my addr 172.21.15.18:0/2926754485 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef9e7fc640 1 -- 172.21.15.18:0/2926754485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 msgr2=0x55c57a0285a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a0285a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef9e7fc640 1 -- 172.21.15.18:0/2926754485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 msgr2=0x55c57a025e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a025e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef9e7fc640 1 -- 172.21.15.18:0/2926754485 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c579cec3c0 con 0x55c57a01f350 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef9effd640 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a0285a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef9f7fe640 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a025e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01f350 0x55c57a025850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef94009900 tx=0x7fef9402a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9918400e29cc5846 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef7effd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef7effd640 1 -- 172.21.15.18:0/2926754485 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94035050 con 0x55c57a01f350 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.903+0000 7fef7effd640 1 -- 172.21.15.18:0/2926754485 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fef94031d60 con 0x55c57a01f350 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fefa7c75740 1 -- 172.21.15.18:0/2926754485 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef90009e50 con 0x55c57a01f350 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fef7effd640 1 -- 172.21.15.18:0/2926754485 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef940035f0 con 0x55c57a01f350 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fefa7c75740 10 client.25261 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fefa7c75740 1 -- 172.21.15.18:0/2926754485 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c57a019b00 con 0x55c57a01f350 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fef7effd640 1 -- 172.21.15.18:0/2926754485 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef9405d070 con 0x55c57a01f350 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fef7effd640 1 -- 172.21.15.18:0/2926754485 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fef94062770 con 0x55c57a01f350 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fefa7c75740 10 client.25261 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fefa7c75740 10 client.25261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fefa7c75740 20 client.25261 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fefa7c75740 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c57a041040 0x55c57a043480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fefa7c75740 4 client.25261 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.904+0000 7fefa7c75740 1 -- 172.21.15.18:0/2926754485 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fef90009e50 con 0x55c57a041040 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.905+0000 7fef9effd640 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c57a041040 0x55c57a043480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.905+0000 7fef7effd640 10 client.25261 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.905+0000 7fef9effd640 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c57a041040 0x55c57a043480 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=375dc08cfaa28bd9 server_cookie=7f54189dd6e9c286 in_seq=0 out_seq=0 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fef7effd640 1 -- 172.21.15.18:0/2926754485 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fef90009e50 con 0x55c57a041040 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fef7effd640 10 client.25261 handle_command_reply: tid=0 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fefa7c75740 1 client.25261 shutdown 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fefa7c75740 1 -- 172.21.15.18:0/2926754485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01f350 msgr2=0x55c57a025850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fefa7c75740 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01f350 0x55c57a025850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef94009900 tx=0x7fef9402a480 comp rx=0 tx=0).stop 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fefa7c75740 1 -- 172.21.15.18:0/2926754485 shutdown_connections 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fefa7c75740 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c57a041040 0x55c57a043480 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fefa7c75740 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a025e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fefa7c75740 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01f350 0x55c57a025850 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fefa7c75740 1 --2- 172.21.15.18:0/2926754485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01dde0 0x55c57a0285a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fef7effd640 0 client.25261 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fefa7c75740 1 -- 172.21.15.18:0/2926754485 >> 172.21.15.18:0/2926754485 conn(0x55c579fde310 msgr2=0x55c57a020170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.906+0000 7fefa7c75740 1 -- 172.21.15.18:0/2926754485 shutdown_connections 2024-09-19T09:53:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.907+0000 7fefa7c75740 1 -- 172.21.15.18:0/2926754485 wait complete. 2024-09-19T09:53:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.907+0000 7fefa7c75740 20 client.25261 trim_cache size 0 max 16384 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.933+0000 7fefa7c75740 1 Processor -- start 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.933+0000 7fefa7c75740 1 -- start start 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.933+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a024830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.933+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 0x55c57a029f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.933+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a02a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.933+0000 7fef9effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a024830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.933+0000 7fef9effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a024830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53266/0 (socket says 172.21.15.18:53266) 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.933+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a02a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.933+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a02a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36856/0 (socket says 172.21.15.18:36856) 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.933+0000 7fef9effd640 1 -- 172.21.15.18:0/873514231 learned_addr learned my addr 172.21.15.18:0/873514231 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fefa7c75740 1 -- 172.21.15.18:0/873514231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fefa0072f00 con 0x55c57a028b80 2024-09-19T09:53:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fefa7c75740 1 -- 172.21.15.18:0/873514231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fefa01a4610 con 0x55c57a01f350 2024-09-19T09:53:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fefa7c75740 1 -- 172.21.15.18:0/873514231 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefa00735d0 con 0x55c57a01dde0 2024-09-19T09:53:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/873514231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 0x55c57a029f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fef9effd640 1 -- 172.21.15.18:0/873514231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 msgr2=0x55c57a029f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fef9effd640 1 --2- 172.21.15.18:0/873514231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 0x55c57a029f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fef9effd640 1 -- 172.21.15.18:0/873514231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 msgr2=0x55c57a02a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fef9effd640 1 --2- 172.21.15.18:0/873514231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a02a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fef9effd640 1 -- 172.21.15.18:0/873514231 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c57a018960 con 0x55c57a01dde0 2024-09-19T09:53:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fef9f7fe640 1 --2- 172.21.15.18:0/873514231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a02a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:26.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.934+0000 7fef9effd640 1 --2- 172.21.15.18:0/873514231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a024830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef90000c00 tx=0x7fef9000f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53661a4ddafae0b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.935+0000 7fef857fa640 1 -- 172.21.15.18:0/873514231 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef90033070 con 0x55c57a01dde0 2024-09-19T09:53:26.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.935+0000 7fef857fa640 1 -- 172.21.15.18:0/873514231 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef90009e50 con 0x55c57a01dde0 2024-09-19T09:53:26.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.935+0000 7fef857fa640 1 -- 172.21.15.18:0/873514231 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef900054d0 con 0x55c57a01dde0 2024-09-19T09:53:26.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 -- 172.21.15.18:0/873514231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 msgr2=0x55c57a024830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 --2- 172.21.15.18:0/873514231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a024830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef90000c00 tx=0x7fef9000f9d0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 -- 172.21.15.18:0/873514231 shutdown_connections 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 --2- 172.21.15.18:0/873514231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a02a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 --2- 172.21.15.18:0/873514231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 0x55c57a029f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 --2- 172.21.15.18:0/873514231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a024830 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 -- 172.21.15.18:0/873514231 >> 172.21.15.18:0/873514231 conn(0x55c579fde310 msgr2=0x55c57a024120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 -- 172.21.15.18:0/873514231 shutdown_connections 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 -- 172.21.15.18:0/873514231 wait complete. 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 -- start start 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.936+0000 7fefa7c75740 1 Processor -- start 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a015800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 0x55c57a015d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fefa7c75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a010bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fef9effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a015800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a010bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fef9e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 0x55c57a015d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fef9e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 0x55c57a015d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37078/0 (socket says 172.21.15.18:37078) 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fef9effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a015800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53274/0 (socket says 172.21.15.18:53274) 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a010bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36870/0 (socket says 172.21.15.18:36870) 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fef9e7fc640 1 -- 172.21.15.18:0/3207228184 learned_addr learned my addr 172.21.15.18:0/3207228184 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fefa01a3fe0 con 0x55c57a028b80 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fefa0073ca0 con 0x55c57a01f350 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.937+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefa0070ee0 con 0x55c57a01dde0 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef9e7fc640 1 -- 172.21.15.18:0/3207228184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 msgr2=0x55c57a015800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a015800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef9e7fc640 1 -- 172.21.15.18:0/3207228184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 msgr2=0x55c57a010bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a010bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef9e7fc640 1 -- 172.21.15.18:0/3207228184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c57a0113f0 con 0x55c57a01f350 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef9f7fe640 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a010bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fefa7c75740 10 client.0 _ll_register_callbacks cb 0x7fef94009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef90009e50 con 0x55c57a01f350 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef9e7fc640 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 0x55c57a015d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef940314e0 tx=0x7fef94058800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db72e2dcb9501c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef7effd640 10 client.25331 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef7effd640 1 -- 172.21.15.18:0/3207228184 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9407b050 con 0x55c57a01f350 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef7effd640 1 -- 172.21.15.18:0/3207228184 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fef94062d80 con 0x55c57a01f350 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fef7effd640 1 -- 172.21.15.18:0/3207228184 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef94071070 con 0x55c57a01f350 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fefa7c75740 10 client.25331 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.938+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c57a0ab6f0 con 0x55c57a01f350 2024-09-19T09:53:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.939+0000 7fef7effd640 1 -- 172.21.15.18:0/3207228184 <== mon.2 v2:172.21.15.49:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fef94076440 con 0x55c57a01f350 2024-09-19T09:53:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.939+0000 7fefa7c75740 10 client.25331 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.939+0000 7fefa7c75740 10 client.25331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.939+0000 7fefa7c75740 20 client.25331 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.939+0000 7fefa7c75740 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c57a041040 0x55c57a0add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.939+0000 7fefa7c75740 4 client.25331 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.939+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c579f88860 con 0x55c57a041040 2024-09-19T09:53:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.939+0000 7fef9effd640 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c57a041040 0x55c57a0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:26.950 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fef9effd640 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c57a041040 0x55c57a0add40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d96e4e1dcbdf5e31 server_cookie=99c5feacc4908e49 in_seq=0 out_seq=0 2024-09-19T09:53:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fef7effd640 10 client.25331 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fef7effd640 1 -- 172.21.15.18:0/3207228184 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c579f88860 con 0x55c57a041040 2024-09-19T09:53:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fef7effd640 10 client.25331 handle_command_reply: tid=0 2024-09-19T09:53:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 client.25331 shutdown 2024-09-19T09:53:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 msgr2=0x55c57a015d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 0x55c57a015d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef940314e0 tx=0x7fef94058800 comp rx=0 tx=0).stop 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 shutdown_connections 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c57a041040 0x55c57a0add40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c57a028b80 0x55c57a010bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c57a01f350 0x55c57a015d40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 --2- 172.21.15.18:0/3207228184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c57a01dde0 0x55c57a015800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fef7effd640 0 client.25331 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 >> 172.21.15.18:0/3207228184 conn(0x55c579fde310 msgr2=0x55c57a024940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 shutdown_connections 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.940+0000 7fefa7c75740 1 -- 172.21.15.18:0/3207228184 wait complete. 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.941+0000 7fefa7c75740 20 client.25331 trim_cache size 0 max 16384 2024-09-19T09:53:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.941+0000 7fefa589c640 1 -- 172.21.15.18:0/1483629716 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fef880a32c0 msgr2=0x7fef880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.941+0000 7fefa589c640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fef880a32c0 0x7fef880a5780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fef94009230 tx=0x7fef940058d0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.941+0000 7fefa589c640 1 -- 172.21.15.18:0/1483629716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa0102ef0 msgr2=0x7fefa019bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.941+0000 7fefa589c640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa0102ef0 0x7fefa019bd30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef98009fd0 tx=0x7fef9800ef10 comp rx=0 tx=0).stop 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.942+0000 7fefa589c640 1 -- 172.21.15.18:0/1483629716 shutdown_connections 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.942+0000 7fefa589c640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fef880a32c0 0x7fef880a5780 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.942+0000 7fefa589c640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefa0102ef0 0x7fefa019bd30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.942+0000 7fefa589c640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa0102570 0x7fefa01979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.942+0000 7fefa589c640 1 --2- 172.21.15.18:0/1483629716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fefa0100e20 0x7fefa0197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.942+0000 7fefa589c640 1 -- 172.21.15.18:0/1483629716 >> 172.21.15.18:0/1483629716 conn(0x7fefa00fc7d0 msgr2=0x7fefa00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.942+0000 7fefa589c640 1 -- 172.21.15.18:0/1483629716 shutdown_connections 2024-09-19T09:53:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:26.942+0000 7fefa589c640 1 -- 172.21.15.18:0/1483629716 wait complete. 2024-09-19T09:53:27.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:27 smithi018 ceph-mon[30956]: pgmap v372: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:53:27.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:27 smithi049 ceph-mon[34858]: pgmap v372: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:53:27.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:27 smithi162 ceph-mon[35174]: pgmap v372: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:53:28.600 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:53:28.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:53:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:29.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.405+0000 7f5dd097a640 1 -- 172.21.15.18:0/1379593553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc102ef0 msgr2=0x7f5dcc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:29.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.406+0000 7f5dd097a640 1 --2- 172.21.15.18:0/1379593553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc102ef0 0x7f5dcc10da40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009ca0 tx=0x7f5dc402a950 comp rx=0 tx=0).stop 2024-09-19T09:53:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.406+0000 7f5dd097a640 1 -- 172.21.15.18:0/1379593553 shutdown_connections 2024-09-19T09:53:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.406+0000 7f5dd097a640 1 --2- 172.21.15.18:0/1379593553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc102ef0 0x7f5dcc10da40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.406+0000 7f5dd097a640 1 --2- 172.21.15.18:0/1379593553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc102570 0x7f5dcc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.406+0000 7f5dd097a640 1 --2- 172.21.15.18:0/1379593553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dcc100e20 0x7f5dcc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.406+0000 7f5dd097a640 1 -- 172.21.15.18:0/1379593553 >> 172.21.15.18:0/1379593553 conn(0x7f5dcc0fc7d0 msgr2=0x7f5dcc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.407+0000 7f5dd097a640 1 -- 172.21.15.18:0/1379593553 shutdown_connections 2024-09-19T09:53:29.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.407+0000 7f5dd097a640 1 -- 172.21.15.18:0/1379593553 wait complete. 2024-09-19T09:53:29.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.408+0000 7f5dd097a640 1 Processor -- start 2024-09-19T09:53:29.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.408+0000 7f5dd097a640 1 -- start start 2024-09-19T09:53:29.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.408+0000 7f5dd097a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc100e20 0x7f5dcc109a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.408+0000 7f5dd097a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc102570 0x7f5dcc109fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.409+0000 7f5dd097a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dcc102ef0 0x7f5dcc10a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.409+0000 7f5dc9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc102570 0x7f5dcc109fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.409+0000 7f5dc9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc102570 0x7f5dcc109fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53290/0 (socket says 172.21.15.18:53290) 2024-09-19T09:53:29.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.409+0000 7f5dc9d9b640 1 -- 172.21.15.18:0/2818159434 learned_addr learned my addr 172.21.15.18:0/2818159434 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:29.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.409+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc110f80 con 0x7f5dcc100e20 2024-09-19T09:53:29.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.409+0000 7f5dca59c640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc100e20 0x7f5dcc109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.409+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dcc102ef0 0x7f5dcc10a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.410+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc110e00 con 0x7f5dcc102ef0 2024-09-19T09:53:29.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.410+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc111100 con 0x7f5dcc102570 2024-09-19T09:53:29.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.410+0000 7f5dcad9d640 1 -- 172.21.15.18:0/2818159434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc102570 msgr2=0x7f5dcc109fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.410+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc102570 0x7f5dcc109fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.410+0000 7f5dcad9d640 1 -- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc100e20 msgr2=0x7f5dcc109a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.410+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc100e20 0x7f5dcc109a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.410+0000 7f5dcad9d640 1 -- 172.21.15.18:0/2818159434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc1aacf0 con 0x7f5dcc102ef0 2024-09-19T09:53:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.410+0000 7f5dca59c640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc100e20 0x7f5dcc109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.410+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dcc102ef0 0x7f5dcc10a4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4035000 tx=0x7f5dc4030850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.411+0000 7f5dbb7fe640 1 -- 172.21.15.18:0/2818159434 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4034020 con 0x7f5dcc102ef0 2024-09-19T09:53:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.411+0000 7f5dbb7fe640 1 -- 172.21.15.18:0/2818159434 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc4003e50 con 0x7f5dcc102ef0 2024-09-19T09:53:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.411+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc1aaf80 con 0x7f5dcc102ef0 2024-09-19T09:53:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.411+0000 7f5dbb7fe640 1 -- 172.21.15.18:0/2818159434 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc402c040 con 0x7f5dcc102ef0 2024-09-19T09:53:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.412+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc1ab3c0 con 0x7f5dcc102ef0 2024-09-19T09:53:29.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.414+0000 7f5dbb7fe640 1 -- 172.21.15.18:0/2818159434 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5dc4037020 con 0x7f5dcc102ef0 2024-09-19T09:53:29.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.415+0000 7f5dd2d53740 1 Processor -- start 2024-09-19T09:53:29.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dd2d53740 1 -- start start 2024-09-19T09:53:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dbb7fe640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5db40a3340 0x7f5db40a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd31f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd32480 0x55dd7bd3c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dd2d53740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dd7bc97280 con 0x55dd7bd31b60 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dd2d53740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55dd7bc3eb10 con 0x55dd7bd3cd40 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dd2d53740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dd7bc93240 con 0x55dd7bd32480 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dbb7fe640 1 -- 172.21.15.18:0/2818159434 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5dc40f05b0 con 0x7f5dcc102ef0 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dcad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dcad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37116/0 (socket says 172.21.15.18:37116) 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.416+0000 7f5dcad9d640 1 -- 172.21.15.18:0/4148425982 learned_addr learned my addr 172.21.15.18:0/4148425982 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.417+0000 7f5dcad9d640 1 -- 172.21.15.18:0/4148425982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd32480 msgr2=0x55dd7bd3c800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.417+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/4148425982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd32480 0x55dd7bd3c800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.417+0000 7f5dcad9d640 1 -- 172.21.15.18:0/4148425982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 msgr2=0x55dd7bd31f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.417+0000 7f5dc9d9b640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5db40a3340 0x7f5db40a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.418+0000 7f5dca59c640 1 --2- 172.21.15.18:0/4148425982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd31f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.418+0000 7f5dc9d9b640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5db40a3340 0x7f5db40a5800 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55dd7bd2ef50 tx=0x7f5dbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.418+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/4148425982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd31f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.418+0000 7f5dcad9d640 1 -- 172.21.15.18:0/4148425982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd7bc4b1f0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.418+0000 7f5dca59c640 1 --2- 172.21.15.18:0/4148425982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd31f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:29.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.419+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/4148425982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3f130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40bc8a0 tx=0x7f5dc402f9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aed5e2c3fcf623b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:29.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.419+0000 7f5db8ff9640 1 -- 172.21.15.18:0/4148425982 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40bc500 con 0x55dd7bd3cd40 2024-09-19T09:53:29.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.419+0000 7f5db8ff9640 1 -- 172.21.15.18:0/4148425982 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc40bd2a0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.419+0000 7f5db8ff9640 1 -- 172.21.15.18:0/4148425982 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc402f5b0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.420+0000 7f5dd2d53740 1 -- 172.21.15.18:0/4148425982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 msgr2=0x55dd7bd3f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:29.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.420+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/4148425982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3f130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40bc8a0 tx=0x7f5dc402f9b0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.420+0000 7f5dd2d53740 1 -- 172.21.15.18:0/4148425982 shutdown_connections 2024-09-19T09:53:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.420+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/4148425982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3f130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.420+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/4148425982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd32480 0x55dd7bd3c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.420+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/4148425982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd31f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.420+0000 7f5dd2d53740 1 -- 172.21.15.18:0/4148425982 >> 172.21.15.18:0/4148425982 conn(0x55dd7bd2e0f0 msgr2=0x55dd7bd2e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.421+0000 7f5dd2d53740 1 -- 172.21.15.18:0/4148425982 shutdown_connections 2024-09-19T09:53:29.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.421+0000 7f5dd2d53740 1 -- 172.21.15.18:0/4148425982 wait complete. 2024-09-19T09:53:29.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.421+0000 7f5dd2d53740 1 -- start start 2024-09-19T09:53:29.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.421+0000 7f5dd2d53740 1 Processor -- start 2024-09-19T09:53:29.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd39c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd32480 0x55dd7bd3a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dd2d53740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dd7bc3eb10 con 0x55dd7bd31b60 2024-09-19T09:53:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dd2d53740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55dd7bc51f10 con 0x55dd7bd3cd40 2024-09-19T09:53:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dd2d53740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dd7bd3f6d0 con 0x55dd7bd32480 2024-09-19T09:53:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dd2d53740 10 client.0 _ll_register_callbacks cb 0x55dd7bc1aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dca59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd39c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dc9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd32480 0x55dd7bd3a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dcad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dc9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd32480 0x55dd7bd3a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53298/0 (socket says 172.21.15.18:53298) 2024-09-19T09:53:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dc9d9b640 1 -- 172.21.15.18:0/2530950423 learned_addr learned my addr 172.21.15.18:0/2530950423 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.422+0000 7f5dcad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37128/0 (socket says 172.21.15.18:37128) 2024-09-19T09:53:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5dcad9d640 1 -- 172.21.15.18:0/2530950423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd32480 msgr2=0x55dd7bd3a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd32480 0x55dd7bd3a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5dcad9d640 1 -- 172.21.15.18:0/2530950423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 msgr2=0x55dd7bd39c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd39c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5dcad9d640 1 -- 172.21.15.18:0/2530950423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd7ba086a0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5dca59c640 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd39c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3a690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40bcd60 tx=0x7f5dc40edf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caa4f8727ed5c8f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5db1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2530950423 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40c0f50 con 0x55dd7bd3cd40 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2530950423 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5dc40046a0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.423+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2530950423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc40bd2a0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.424+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2530950423 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5dc40098b0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.424+0000 7f5dd2d53740 10 client.25343 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.424+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2530950423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd7bd4b030 con 0x55dd7bd3cd40 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.424+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2530950423 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc40bd2a0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.425+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2530950423 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5dc4042070 con 0x55dd7bd3cd40 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.425+0000 7f5dd2d53740 10 client.25343 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.425+0000 7f5dd2d53740 10 client.25343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.425+0000 7f5dd2d53740 20 client.25343 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.425+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55dd7bd4c440 0x55dd7bd4e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.425+0000 7f5dd2d53740 4 client.25343 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.425+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2530950423 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd7bca47f0 con 0x55dd7bd4c440 2024-09-19T09:53:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.425+0000 7f5dca59c640 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55dd7bd4c440 0x55dd7bd4e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.425+0000 7f5dca59c640 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55dd7bd4c440 0x55dd7bd4e860 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04c573026b2199d server_cookie=94502155e03b0889 in_seq=0 out_seq=0 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.425+0000 7f5db1ffb640 10 client.25343 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2530950423 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd7bca47f0 con 0x55dd7bd4c440 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5db1ffb640 10 client.25343 handle_command_reply: tid=0 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5dd2d53740 1 client.25343 shutdown 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2530950423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 msgr2=0x55dd7bd3a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3a690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40bcd60 tx=0x7f5dc40edf70 comp rx=0 tx=0).stop 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2530950423 shutdown_connections 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55dd7bd4c440 0x55dd7bd4e860 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd3a690 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd32480 0x55dd7bd3a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2530950423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd39c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2530950423 >> 172.21.15.18:0/2530950423 conn(0x55dd7bd2e0f0 msgr2=0x55dd7bd33e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:29.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.428+0000 7f5db1ffb640 0 client.25343 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:29.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.429+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2530950423 shutdown_connections 2024-09-19T09:53:29.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.429+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2530950423 wait complete. 2024-09-19T09:53:29.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.429+0000 7f5dd2d53740 20 client.25343 trim_cache size 0 max 16384 2024-09-19T09:53:29.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.467+0000 7f5dd2d53740 1 Processor -- start 2024-09-19T09:53:29.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.467+0000 7f5dd2d53740 1 -- start start 2024-09-19T09:53:29.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.467+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd31b60 0x55dd7bd3a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.467+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd32480 0x55dd7bd3ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.467+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.467+0000 7f5dd2d53740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1ad4a0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.467+0000 7f5dd2d53740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1a27d0 con 0x55dd7bd32480 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.467+0000 7f5dd2d53740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1acdd0 con 0x55dd7bd31b60 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.467+0000 7f5dca59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd31b60 0x55dd7bd3a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dca59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd31b60 0x55dd7bd3a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53312/0 (socket says 172.21.15.18:53312) 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dca59c640 1 -- 172.21.15.18:0/541372310 learned_addr learned my addr 172.21.15.18:0/541372310 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dc9d9b640 1 --2- 172.21.15.18:0/541372310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd32480 0x55dd7bd3ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/541372310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dca59c640 1 -- 172.21.15.18:0/541372310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd32480 msgr2=0x55dd7bd3ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dca59c640 1 --2- 172.21.15.18:0/541372310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd32480 0x55dd7bd3ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dca59c640 1 -- 172.21.15.18:0/541372310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd3cd40 msgr2=0x55dd7bd540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dca59c640 1 --2- 172.21.15.18:0/541372310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dca59c640 1 -- 172.21.15.18:0/541372310 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd7bd322b0 con 0x55dd7bd31b60 2024-09-19T09:53:29.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/541372310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:29.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5dca59c640 1 --2- 172.21.15.18:0/541372310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd31b60 0x55dd7bd3a4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0005e00 tx=0x7f5dc0005990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf4042b8aabac5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:29.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.468+0000 7f5db3fff640 1 -- 172.21.15.18:0/541372310 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0015190 con 0x55dd7bd31b60 2024-09-19T09:53:29.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.469+0000 7f5db3fff640 1 -- 172.21.15.18:0/541372310 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc0013c50 con 0x55dd7bd31b60 2024-09-19T09:53:29.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.469+0000 7f5db3fff640 1 -- 172.21.15.18:0/541372310 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0003e20 con 0x55dd7bd31b60 2024-09-19T09:53:29.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.470+0000 7f5dd2d53740 1 -- 172.21.15.18:0/541372310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd31b60 msgr2=0x55dd7bd3a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:29.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.470+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/541372310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd31b60 0x55dd7bd3a4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0005e00 tx=0x7f5dc0005990 comp rx=0 tx=0).stop 2024-09-19T09:53:29.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.470+0000 7f5dd2d53740 1 -- 172.21.15.18:0/541372310 shutdown_connections 2024-09-19T09:53:29.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.470+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/541372310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.470+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/541372310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd32480 0x55dd7bd3ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.470+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/541372310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd31b60 0x55dd7bd3a4e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.470+0000 7f5dd2d53740 1 -- 172.21.15.18:0/541372310 >> 172.21.15.18:0/541372310 conn(0x55dd7bd2e0f0 msgr2=0x55dd7bd3b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.470+0000 7f5dd2d53740 1 -- 172.21.15.18:0/541372310 shutdown_connections 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.470+0000 7f5dd2d53740 1 -- 172.21.15.18:0/541372310 wait complete. 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.470+0000 7f5dd2d53740 1 -- start start 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.471+0000 7f5dd2d53740 1 Processor -- start 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.471+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd44d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.471+0000 7f5dca59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd44d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.471+0000 7f5dca59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd44d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36918/0 (socket says 172.21.15.18:36918) 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.471+0000 7f5dd2d53740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd32480 0x55dd7bd40030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.471+0000 7f5dca59c640 1 -- 172.21.15.18:0/2558485131 learned_addr learned my addr 172.21.15.18:0/2558485131 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:29.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd40570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1ac030 con 0x55dd7bd31b60 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1ab960 con 0x55dd7bd32480 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dc9d9b640 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd32480 0x55dd7bd40030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1ac700 con 0x55dd7bd3cd40 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd40570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dcad9d640 1 -- 172.21.15.18:0/2558485131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd32480 msgr2=0x55dd7bd40030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd32480 0x55dd7bd40030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dcad9d640 1 -- 172.21.15.18:0/2558485131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 msgr2=0x55dd7bd44d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd44d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dcad9d640 1 -- 172.21.15.18:0/2558485131 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd7bd40ab0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.472+0000 7f5dca59c640 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd44d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.473+0000 7f5dd2d53740 10 client.0 _ll_register_callbacks cb 0x7f5dc40bc520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.473+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc0013c50 con 0x55dd7bd3cd40 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.473+0000 7f5dcad9d640 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd40570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009ca0 tx=0x7f5dc402a950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5da3d0cce534a8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.473+0000 7f5db1ffb640 10 client.25282 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.473+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2558485131 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40ee060 con 0x55dd7bd3cd40 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.473+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2558485131 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5dc4004b40 con 0x55dd7bd3cd40 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.473+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2558485131 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5dc4004d40 con 0x55dd7bd3cd40 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.473+0000 7f5dd2d53740 10 client.25282 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.473+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dd7bd40ab0 con 0x55dd7bd3cd40 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.474+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2558485131 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5dc4042070 con 0x55dd7bd3cd40 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.474+0000 7f5dd2d53740 10 client.25282 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:29.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.474+0000 7f5dd2d53740 10 client.25282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:29.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.474+0000 7f5dd2d53740 20 client.25282 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:29.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.474+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55dd7bdc7e20 0x55dd7bdca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:29.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.474+0000 7f5dd2d53740 4 client.25282 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:53:29.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.474+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dd7bc9ed00 con 0x55dd7bdc7e20 2024-09-19T09:53:29.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.475+0000 7f5dca59c640 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55dd7bdc7e20 0x55dd7bdca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:29.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.475+0000 7f5dca59c640 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55dd7bdc7e20 0x55dd7bdca2e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c95762226a7d647d server_cookie=655fd2b55687378c in_seq=0 out_seq=0 2024-09-19T09:53:29.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.475+0000 7f5db1ffb640 10 client.25282 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:29.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.476+0000 7f5db1ffb640 1 -- 172.21.15.18:0/2558485131 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dd7bc9ed00 con 0x55dd7bdc7e20 2024-09-19T09:53:29.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.476+0000 7f5db1ffb640 10 client.25282 handle_command_reply: tid=0 2024-09-19T09:53:29.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.476+0000 7f5dd2d53740 1 client.25282 shutdown 2024-09-19T09:53:29.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.477+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd3cd40 msgr2=0x55dd7bd40570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:29.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.477+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd40570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009ca0 tx=0x7f5dc402a950 comp rx=0 tx=0).stop 2024-09-19T09:53:29.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.477+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 shutdown_connections 2024-09-19T09:53:29.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.477+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55dd7bdc7e20 0x55dd7bdca2e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.477+0000 7f5db1ffb640 0 client.25282 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:29.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.477+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dd7bd3cd40 0x55dd7bd40570 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.477+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dd7bd32480 0x55dd7bd40030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.477+0000 7f5dd2d53740 1 --2- 172.21.15.18:0/2558485131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dd7bd31b60 0x55dd7bd44d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.477+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 >> 172.21.15.18:0/2558485131 conn(0x55dd7bd2e0f0 msgr2=0x55dd7bd3baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:29.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.478+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 shutdown_connections 2024-09-19T09:53:29.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.478+0000 7f5dd2d53740 1 -- 172.21.15.18:0/2558485131 wait complete. 2024-09-19T09:53:29.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.478+0000 7f5dd2d53740 20 client.25282 trim_cache size 0 max 16384 2024-09-19T09:53:29.481 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:53:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T09:53:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "f1b7953a-18cd-4ed6-8ab6-fd398d9b6ca8", 2024-09-19T09:53:29.482 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T09:53:29.482 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:53:29.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.479+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5db40a3340 msgr2=0x7f5db40a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:29.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.479+0000 7f5dd097a640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5db40a3340 0x7f5db40a5800 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55dd7bd2ef50 tx=0x7f5dbc005f90 comp rx=0 tx=0).stop 2024-09-19T09:53:29.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.479+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dcc102ef0 msgr2=0x7f5dcc10a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:29.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.479+0000 7f5dd097a640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dcc102ef0 0x7f5dcc10a4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4035000 tx=0x7f5dc4030850 comp rx=0 tx=0).stop 2024-09-19T09:53:29.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.479+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 shutdown_connections 2024-09-19T09:53:29.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.479+0000 7f5dd097a640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5db40a3340 0x7f5db40a5800 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.479+0000 7f5dd097a640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dcc102ef0 0x7f5dcc10a4f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.479+0000 7f5dd097a640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dcc102570 0x7f5dcc109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.479+0000 7f5dd097a640 1 --2- 172.21.15.18:0/2818159434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dcc100e20 0x7f5dcc109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:29.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.479+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 >> 172.21.15.18:0/2818159434 conn(0x7f5dcc0fc7d0 msgr2=0x7f5dcc069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:29.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.480+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 shutdown_connections 2024-09-19T09:53:29.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:29.480+0000 7f5dd097a640 1 -- 172.21.15.18:0/2818159434 wait complete. 2024-09-19T09:53:29.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:29 smithi018 ceph-mon[30956]: pgmap v373: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T09:53:29.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:29 smithi049 ceph-mon[34858]: pgmap v373: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T09:53:29.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:29 smithi162 ceph-mon[35174]: pgmap v373: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T09:53:30.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:53:30.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:30 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T09:53:30.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:30 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:30.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:30 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T09:53:30.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:30 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:30.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:30 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T09:53:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:30.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:30 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T09:53:30.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:30 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:30.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:30 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T09:53:30.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:30 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:30.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:30 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T09:53:30.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:30 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T09:53:30.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:30 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:30.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:30 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T09:53:30.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:30 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:30.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:30 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T09:53:31.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.220+0000 7fac75978640 1 -- 172.21.15.18:0/2532784401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70100a70 msgr2=0x7fac70100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:31.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.221+0000 7fac75978640 1 --2- 172.21.15.18:0/2532784401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70100a70 0x7fac70100ed0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fac640099b0 tx=0x7fac6402e850 comp rx=0 tx=0).stop 2024-09-19T09:53:31.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.221+0000 7fac75978640 1 -- 172.21.15.18:0/2532784401 shutdown_connections 2024-09-19T09:53:31.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.221+0000 7fac75978640 1 --2- 172.21.15.18:0/2532784401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70101410 0x7fac7010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.221+0000 7fac75978640 1 --2- 172.21.15.18:0/2532784401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70100a70 0x7fac70100ed0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.221+0000 7fac75978640 1 --2- 172.21.15.18:0/2532784401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac70106a70 0x7fac70106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.221+0000 7fac75978640 1 -- 172.21.15.18:0/2532784401 >> 172.21.15.18:0/2532784401 conn(0x7fac700fc790 msgr2=0x7fac700febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:31.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.221+0000 7fac75978640 1 -- 172.21.15.18:0/2532784401 shutdown_connections 2024-09-19T09:53:31.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.221+0000 7fac75978640 1 -- 172.21.15.18:0/2532784401 wait complete. 2024-09-19T09:53:31.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac75978640 1 Processor -- start 2024-09-19T09:53:31.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac75978640 1 -- start start 2024-09-19T09:53:31.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac75978640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70100a70 0x7fac7019d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac75978640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac70101410 0x7fac70196100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac75978640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70106a70 0x7fac70196640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac75978640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac7010fdc0 con 0x7fac70106a70 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac75978640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fac7010fc40 con 0x7fac70101410 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac75978640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac7010ff40 con 0x7fac70100a70 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac6effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70100a70 0x7fac7019d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac6effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70100a70 0x7fac7019d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53324/0 (socket says 172.21.15.18:53324) 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.222+0000 7fac6effd640 1 -- 172.21.15.18:0/1185486454 learned_addr learned my addr 172.21.15.18:0/1185486454 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac70101410 0x7fac70196100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac6effd640 1 -- 172.21.15.18:0/1185486454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac70101410 msgr2=0x7fac70196100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac6effd640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac70101410 0x7fac70196100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac6effd640 1 -- 172.21.15.18:0/1185486454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70106a70 msgr2=0x7fac70196640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:31.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac6effd640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70106a70 0x7fac70196640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac6effd640 1 -- 172.21.15.18:0/1185486454 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac70196c00 con 0x7fac70100a70 2024-09-19T09:53:31.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac70101410 0x7fac70196100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:31.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac6effd640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70100a70 0x7fac7019d020 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fac6000a980 tx=0x7fac6000ae40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:31.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac74976640 1 -- 172.21.15.18:0/1185486454 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60007a70 con 0x7fac70100a70 2024-09-19T09:53:31.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac74976640 1 -- 172.21.15.18:0/1185486454 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac60007c10 con 0x7fac70100a70 2024-09-19T09:53:31.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.223+0000 7fac75978640 1 -- 172.21.15.18:0/1185486454 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac70196ef0 con 0x7fac70100a70 2024-09-19T09:53:31.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.224+0000 7fac74976640 1 -- 172.21.15.18:0/1185486454 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60014410 con 0x7fac70100a70 2024-09-19T09:53:31.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.225+0000 7fac75978640 1 -- 172.21.15.18:0/1185486454 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7019add0 con 0x7fac70100a70 2024-09-19T09:53:31.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.227+0000 7fac74976640 1 -- 172.21.15.18:0/1185486454 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fac6001b020 con 0x7fac70100a70 2024-09-19T09:53:31.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.228+0000 7fac74976640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac580a32c0 0x7fac580a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.228+0000 7fac74976640 1 -- 172.21.15.18:0/1185486454 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fac600cebd0 con 0x7fac70100a70 2024-09-19T09:53:31.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.228+0000 7fac77d51740 1 Processor -- start 2024-09-19T09:53:31.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac580a32c0 0x7fac580a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac77d51740 1 -- start start 2024-09-19T09:53:31.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac77d51740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e214a0 0x559211e21880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac77d51740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e21dc0 0x559211e2c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac77d51740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 0x559211e2ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac77d51740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559211d872e0 con 0x559211e214a0 2024-09-19T09:53:31.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac77d51740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559211d2ece0 con 0x559211e2c680 2024-09-19T09:53:31.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac77d51740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559211d832a0 con 0x559211e21dc0 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac6f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 0x559211e2ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac6f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 0x559211e2ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37174/0 (socket says 172.21.15.18:37174) 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac580a32c0 0x7fac580a5780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fac64005ab0 tx=0x7fac64005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.229+0000 7fac6f7fe640 1 -- 172.21.15.18:0/3617882499 learned_addr learned my addr 172.21.15.18:0/3617882499 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.230+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/3617882499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e21dc0 0x559211e2c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.230+0000 7fac6effd640 1 --2- 172.21.15.18:0/3617882499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e214a0 0x559211e21880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.230+0000 7fac6f7fe640 1 -- 172.21.15.18:0/3617882499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e21dc0 msgr2=0x559211e2c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.230+0000 7fac6f7fe640 1 --2- 172.21.15.18:0/3617882499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e21dc0 0x559211e2c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.230+0000 7fac6f7fe640 1 -- 172.21.15.18:0/3617882499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e214a0 msgr2=0x559211e21880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.230+0000 7fac6f7fe640 1 --2- 172.21.15.18:0/3617882499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e214a0 0x559211e21880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.230+0000 7fac6f7fe640 1 -- 172.21.15.18:0/3617882499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559211d13440 con 0x559211e2c680 2024-09-19T09:53:31.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.230+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/3617882499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e21dc0 0x559211e2c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:31.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.230+0000 7fac6f7fe640 1 --2- 172.21.15.18:0/3617882499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 0x559211e2ea70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac68009de0 tx=0x7fac6800d6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad2c7549cf087ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:31.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.231+0000 7fac55ffb640 1 -- 172.21.15.18:0/3617882499 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68003970 con 0x559211e2c680 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.231+0000 7fac55ffb640 1 -- 172.21.15.18:0/3617882499 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac68004020 con 0x559211e2c680 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.231+0000 7fac55ffb640 1 -- 172.21.15.18:0/3617882499 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68010900 con 0x559211e2c680 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.232+0000 7fac77d51740 1 -- 172.21.15.18:0/3617882499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 msgr2=0x559211e2ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.232+0000 7fac77d51740 1 --2- 172.21.15.18:0/3617882499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 0x559211e2ea70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac68009de0 tx=0x7fac6800d6b0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.232+0000 7fac77d51740 1 -- 172.21.15.18:0/3617882499 shutdown_connections 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.232+0000 7fac77d51740 1 --2- 172.21.15.18:0/3617882499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 0x559211e2ea70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.232+0000 7fac77d51740 1 --2- 172.21.15.18:0/3617882499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e21dc0 0x559211e2c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.232+0000 7fac77d51740 1 --2- 172.21.15.18:0/3617882499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e214a0 0x559211e21880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.232+0000 7fac77d51740 1 -- 172.21.15.18:0/3617882499 >> 172.21.15.18:0/3617882499 conn(0x559211e1da30 msgr2=0x559211e1de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.232+0000 7fac77d51740 1 -- 172.21.15.18:0/3617882499 shutdown_connections 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.232+0000 7fac77d51740 1 -- 172.21.15.18:0/3617882499 wait complete. 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.233+0000 7fac77d51740 1 -- start start 2024-09-19T09:53:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.233+0000 7fac77d51740 1 Processor -- start 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.234+0000 7fac77d51740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e2bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.234+0000 7fac77d51740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e21dc0 0x559211e291f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.234+0000 7fac77d51740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e2c680 0x559211e29730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.234+0000 7fac6effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e2bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.234+0000 7fac77d51740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559211e2f250 con 0x559211e2c680 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac77d51740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559211d42050 con 0x559211e21dc0 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac77d51740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559211e2f3d0 con 0x559211e214a0 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac77d51740 10 client.0 _ll_register_callbacks cb 0x559211d82160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac6e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e21dc0 0x559211e291f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.234+0000 7fac6effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e2bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53344/0 (socket says 172.21.15.18:53344) 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac6effd640 1 -- 172.21.15.18:0/3741329839 learned_addr learned my addr 172.21.15.18:0/3741329839 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac6f7fe640 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e2c680 0x559211e29730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac6effd640 1 -- 172.21.15.18:0/3741329839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e21dc0 msgr2=0x559211e291f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:31.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac6effd640 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e21dc0 0x559211e291f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac6effd640 1 -- 172.21.15.18:0/3741329839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e2c680 msgr2=0x559211e29730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:31.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac6effd640 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e2c680 0x559211e29730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.235+0000 7fac6effd640 1 -- 172.21.15.18:0/3741329839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559211af83c0 con 0x559211e214a0 2024-09-19T09:53:31.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.236+0000 7fac6f7fe640 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e2c680 0x559211e29730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:31.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.236+0000 7fac6effd640 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e2bf40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fac6009aec0 tx=0x7fac6009ba00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c9f431ac563680 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:31.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.236+0000 7fac4effd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:53:31.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.236+0000 7fac4effd640 1 -- 172.21.15.18:0/3741329839 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600b4060 con 0x559211e214a0 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.236+0000 7fac4effd640 1 -- 172.21.15.18:0/3741329839 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fac600994c0 con 0x559211e214a0 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.236+0000 7fac77d51740 1 -- 172.21.15.18:0/3741329839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac68004020 con 0x559211e214a0 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.236+0000 7fac4effd640 1 -- 172.21.15.18:0/3741329839 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fac60003680 con 0x559211e214a0 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.236+0000 7fac77d51740 10 client.25294 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.236+0000 7fac77d51740 1 -- 172.21.15.18:0/3741329839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559211e3ac00 con 0x559211e214a0 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.237+0000 7fac4effd640 1 -- 172.21.15.18:0/3741329839 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac68004020 con 0x559211e214a0 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.238+0000 7fac4effd640 1 -- 172.21.15.18:0/3741329839 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fac600bb100 con 0x559211e214a0 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.238+0000 7fac77d51740 10 client.25294 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.238+0000 7fac77d51740 10 client.25294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.238+0000 7fac77d51740 20 client.25294 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.238+0000 7fac77d51740 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559211e3c010 0x559211e3e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.238+0000 7fac77d51740 4 client.25294 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.238+0000 7fac77d51740 1 -- 172.21.15.18:0/3741329839 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559211d94850 con 0x559211e3c010 2024-09-19T09:53:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.238+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559211e3c010 0x559211e3e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.239+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559211e3c010 0x559211e3e440 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afd7f913d8e5fd58 server_cookie=4d92bd77035fff91 in_seq=0 out_seq=0 2024-09-19T09:53:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.239+0000 7fac4effd640 10 client.25294 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac4effd640 1 -- 172.21.15.18:0/3741329839 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559211d94850 con 0x559211e3c010 2024-09-19T09:53:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac4effd640 10 client.25294 handle_command_reply: tid=0 2024-09-19T09:53:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac77d51740 1 client.25294 shutdown 2024-09-19T09:53:31.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac77d51740 1 -- 172.21.15.18:0/3741329839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 msgr2=0x559211e2bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:31.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac77d51740 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e2bf40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fac6009aec0 tx=0x7fac6009ba00 comp rx=0 tx=0).stop 2024-09-19T09:53:31.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac77d51740 1 -- 172.21.15.18:0/3741329839 shutdown_connections 2024-09-19T09:53:31.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac77d51740 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559211e3c010 0x559211e3e440 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac77d51740 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e2c680 0x559211e29730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac77d51740 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e21dc0 0x559211e291f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac4effd640 0 client.25294 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:31.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.240+0000 7fac77d51740 1 --2- 172.21.15.18:0/3741329839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e2bf40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.241+0000 7fac77d51740 1 -- 172.21.15.18:0/3741329839 >> 172.21.15.18:0/3741329839 conn(0x559211e1da30 msgr2=0x559211e23760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:31.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.241+0000 7fac77d51740 1 -- 172.21.15.18:0/3741329839 shutdown_connections 2024-09-19T09:53:31.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.241+0000 7fac77d51740 1 -- 172.21.15.18:0/3741329839 wait complete. 2024-09-19T09:53:31.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.241+0000 7fac77d51740 20 client.25294 trim_cache size 0 max 16384 2024-09-19T09:53:31.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.275+0000 7fac77d51740 1 Processor -- start 2024-09-19T09:53:31.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.276+0000 7fac77d51740 1 -- start start 2024-09-19T09:53:31.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.276+0000 7fac77d51740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e1da30 0x559211e384b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.276+0000 7fac77d51740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e214a0 0x559211e43cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.276+0000 7fac77d51740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e21dc0 0x559211e441f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.276+0000 7fac77d51740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac701bc3d0 con 0x559211e1da30 2024-09-19T09:53:31.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.276+0000 7fac77d51740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fac701bdf10 con 0x559211e214a0 2024-09-19T09:53:31.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.276+0000 7fac77d51740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac701bcaa0 con 0x559211e21dc0 2024-09-19T09:53:31.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.276+0000 7fac6effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e1da30 0x559211e384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.276+0000 7fac6effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e1da30 0x559211e384b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36976/0 (socket says 172.21.15.18:36976) 2024-09-19T09:53:31.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.276+0000 7fac6effd640 1 -- 172.21.15.18:0/314068490 learned_addr learned my addr 172.21.15.18:0/314068490 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:31.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.277+0000 7fac6effd640 1 -- 172.21.15.18:0/314068490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e21dc0 msgr2=0x559211e441f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:53:31.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.277+0000 7fac6effd640 1 --2- 172.21.15.18:0/314068490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e21dc0 0x559211e441f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.277+0000 7fac6effd640 1 -- 172.21.15.18:0/314068490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e214a0 msgr2=0x559211e43cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:31.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.277+0000 7fac6effd640 1 --2- 172.21.15.18:0/314068490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e214a0 0x559211e43cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.277+0000 7fac6effd640 1 -- 172.21.15.18:0/314068490 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559211e2f2a0 con 0x559211e1da30 2024-09-19T09:53:31.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.277+0000 7fac6effd640 1 --2- 172.21.15.18:0/314068490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e1da30 0x559211e384b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fac60099470 tx=0x7fac600035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bd8724d2f15285 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:31.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.277+0000 7fac557fa640 1 -- 172.21.15.18:0/314068490 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600994c0 con 0x559211e1da30 2024-09-19T09:53:31.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.277+0000 7fac557fa640 1 -- 172.21.15.18:0/314068490 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac6009f170 con 0x559211e1da30 2024-09-19T09:53:31.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.277+0000 7fac557fa640 1 -- 172.21.15.18:0/314068490 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6009a610 con 0x559211e1da30 2024-09-19T09:53:31.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.278+0000 7fac77d51740 1 -- 172.21.15.18:0/314068490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e1da30 msgr2=0x559211e384b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:31.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.278+0000 7fac77d51740 1 --2- 172.21.15.18:0/314068490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e1da30 0x559211e384b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fac60099470 tx=0x7fac600035f0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.278+0000 7fac77d51740 1 -- 172.21.15.18:0/314068490 shutdown_connections 2024-09-19T09:53:31.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.278+0000 7fac77d51740 1 --2- 172.21.15.18:0/314068490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e21dc0 0x559211e441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.278+0000 7fac77d51740 1 --2- 172.21.15.18:0/314068490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e214a0 0x559211e43cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.278+0000 7fac77d51740 1 --2- 172.21.15.18:0/314068490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e1da30 0x559211e384b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.278+0000 7fac77d51740 1 -- 172.21.15.18:0/314068490 >> 172.21.15.18:0/314068490 conn(0x559211e29890 msgr2=0x559211e27ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:31.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.278+0000 7fac77d51740 1 -- 172.21.15.18:0/314068490 shutdown_connections 2024-09-19T09:53:31.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.279+0000 7fac77d51740 1 -- 172.21.15.18:0/314068490 wait complete. 2024-09-19T09:53:31.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.279+0000 7fac77d51740 1 -- start start 2024-09-19T09:53:31.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.279+0000 7fac77d51740 1 Processor -- start 2024-09-19T09:53:31.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.280+0000 7fac77d51740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e30980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.280+0000 7fac77d51740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e21dc0 0x559211e30ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.280+0000 7fac6e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e21dc0 0x559211e30ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.280+0000 7fac6e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e21dc0 0x559211e30ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36992/0 (socket says 172.21.15.18:36992) 2024-09-19T09:53:31.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.280+0000 7fac6e7fc640 1 -- 172.21.15.18:0/3864892813 learned_addr learned my addr 172.21.15.18:0/3864892813 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:31.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.280+0000 7fac77d51740 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 0x559211ea5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.280+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac701bd840 con 0x559211e21dc0 2024-09-19T09:53:31.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.280+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fac701bd170 con 0x559211e2c680 2024-09-19T09:53:31.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.280+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac701ba3b0 con 0x559211e214a0 2024-09-19T09:53:31.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.280+0000 7fac6effd640 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e30980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac6f7fe640 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 0x559211ea5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac77d51740 10 client.0 _ll_register_callbacks cb 0x7fac600056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac6effd640 1 -- 172.21.15.18:0/3864892813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 msgr2=0x559211ea5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac6effd640 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 0x559211ea5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac6effd640 1 -- 172.21.15.18:0/3864892813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e21dc0 msgr2=0x559211e30ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac6effd640 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e21dc0 0x559211e30ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac6effd640 1 -- 172.21.15.18:0/3864892813 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559211ea61c0 con 0x559211e214a0 2024-09-19T09:53:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e21dc0 0x559211e30ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac6009f170 con 0x559211e214a0 2024-09-19T09:53:31.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac6effd640 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e30980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fac600cd000 tx=0x7fac6009aa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b2df59060064b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:31.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac4effd640 10 client.25297 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:53:31.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.281+0000 7fac4effd640 1 -- 172.21.15.18:0/3864892813 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600b4040 con 0x559211e214a0 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac4effd640 1 -- 172.21.15.18:0/3864892813 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fac600bb0f0 con 0x559211e214a0 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac4effd640 1 -- 172.21.15.18:0/3864892813 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fac6009ad00 con 0x559211e214a0 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac77d51740 10 client.25297 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559211ea7310 con 0x559211e214a0 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac4effd640 1 -- 172.21.15.18:0/3864892813 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fac600840c0 con 0x559211e214a0 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac77d51740 10 client.25297 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac77d51740 10 client.25297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac77d51740 20 client.25297 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac77d51740 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559211e3c010 0x559211ea9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac77d51740 4 client.25297 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.282+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559211d8ed60 con 0x559211e3c010 2024-09-19T09:53:31.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.283+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559211e3c010 0x559211ea9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:31.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.283+0000 7fac4effd640 10 client.25297 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:31.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.283+0000 7fac6e7fc640 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559211e3c010 0x559211ea9610 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7e9b3e6a09fad8e server_cookie=24cc4636aafad84c in_seq=0 out_seq=0 2024-09-19T09:53:31.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.283+0000 7fac4effd640 1 -- 172.21.15.18:0/3864892813 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559211d8ed60 con 0x559211e3c010 2024-09-19T09:53:31.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.283+0000 7fac4effd640 10 client.25297 handle_command_reply: tid=0 2024-09-19T09:53:31.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.283+0000 7fac77d51740 1 client.25297 shutdown 2024-09-19T09:53:31.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.283+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 msgr2=0x559211e30980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:31.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.283+0000 7fac77d51740 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e30980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fac600cd000 tx=0x7fac6009aa70 comp rx=0 tx=0).stop 2024-09-19T09:53:31.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.284+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 shutdown_connections 2024-09-19T09:53:31.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.284+0000 7fac77d51740 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559211e3c010 0x559211ea9610 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.284+0000 7fac4effd640 0 client.25297 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:31.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.284+0000 7fac77d51740 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559211e2c680 0x559211ea5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.284+0000 7fac77d51740 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559211e21dc0 0x559211e30ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.284+0000 7fac77d51740 1 --2- 172.21.15.18:0/3864892813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559211e214a0 0x559211e30980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.284+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 >> 172.21.15.18:0/3864892813 conn(0x559211e29890 msgr2=0x559211e1cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:31.288 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:53:31.288 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T09:53:31.288 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T09:53:31.288 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:53:31.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.284+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 shutdown_connections 2024-09-19T09:53:31.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.284+0000 7fac77d51740 1 -- 172.21.15.18:0/3864892813 wait complete. 2024-09-19T09:53:31.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.284+0000 7fac77d51740 20 client.25297 trim_cache size 0 max 16384 2024-09-19T09:53:31.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 -- 172.21.15.18:0/1185486454 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac580a32c0 msgr2=0x7fac580a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:31.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac580a32c0 0x7fac580a5780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fac64005ab0 tx=0x7fac64005a40 comp rx=0 tx=0).stop 2024-09-19T09:53:31.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 -- 172.21.15.18:0/1185486454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70100a70 msgr2=0x7fac7019d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:31.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70100a70 0x7fac7019d020 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fac6000a980 tx=0x7fac6000ae40 comp rx=0 tx=0).stop 2024-09-19T09:53:31.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 -- 172.21.15.18:0/1185486454 shutdown_connections 2024-09-19T09:53:31.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fac580a32c0 0x7fac580a5780 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac70106a70 0x7fac70196640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac70101410 0x7fac70196100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 --2- 172.21.15.18:0/1185486454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac70100a70 0x7fac7019d020 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:31.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 -- 172.21.15.18:0/1185486454 >> 172.21.15.18:0/1185486454 conn(0x7fac700fc790 msgr2=0x7fac700fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:31.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 -- 172.21.15.18:0/1185486454 shutdown_connections 2024-09-19T09:53:31.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:31.285+0000 7fac75978640 1 -- 172.21.15.18:0/1185486454 wait complete. 2024-09-19T09:53:31.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:31 smithi018 ceph-mon[30956]: pgmap v374: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T09:53:31.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:31 smithi049 ceph-mon[34858]: pgmap v374: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T09:53:31.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:31 smithi162 ceph-mon[35174]: pgmap v374: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T09:53:32.048 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:53:32.048 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:53:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.889+0000 7f54642f5640 1 -- 172.21.15.18:0/2352038927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f545c074620 msgr2=0x7f545c074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.889+0000 7f54642f5640 1 --2- 172.21.15.18:0/2352038927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f545c074620 0x7f545c074a00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5458009900 tx=0x7f545802a480 comp rx=0 tx=0).stop 2024-09-19T09:53:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.890+0000 7f54642f5640 1 -- 172.21.15.18:0/2352038927 shutdown_connections 2024-09-19T09:53:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.890+0000 7f54642f5640 1 --2- 172.21.15.18:0/2352038927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c10e3c0 0x7f545c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.890+0000 7f54642f5640 1 --2- 172.21.15.18:0/2352038927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f545c074f40 0x7f545c10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.890+0000 7f54642f5640 1 --2- 172.21.15.18:0/2352038927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f545c074620 0x7f545c074a00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.890+0000 7f54642f5640 1 -- 172.21.15.18:0/2352038927 >> 172.21.15.18:0/2352038927 conn(0x7f545c0fd8c0 msgr2=0x7f545c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.890+0000 7f54642f5640 1 -- 172.21.15.18:0/2352038927 shutdown_connections 2024-09-19T09:53:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.890+0000 7f54642f5640 1 -- 172.21.15.18:0/2352038927 wait complete. 2024-09-19T09:53:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.890+0000 7f54642f5640 1 Processor -- start 2024-09-19T09:53:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.890+0000 7f54642f5640 1 -- start start 2024-09-19T09:53:32.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f54642f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f545c074620 0x7f545c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:32.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f54642f5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f545c074f40 0x7f545c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:32.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f54642f5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c10e3c0 0x7f545c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:32.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f54642f5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1141a0 con 0x7f545c074f40 2024-09-19T09:53:32.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f5461890640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f545c074f40 0x7f545c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f5461890640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f545c074f40 0x7f545c19abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37010/0 (socket says 172.21.15.18:37010) 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f5461890640 1 -- 172.21.15.18:0/3357017612 learned_addr learned my addr 172.21.15.18:0/3357017612 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f545c114020 con 0x7f545c10e3c0 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f545c114320 con 0x7f545c074620 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f5462091640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f545c074620 0x7f545c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f5462892640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c10e3c0 0x7f545c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f5461890640 1 -- 172.21.15.18:0/3357017612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f545c074620 msgr2=0x7f545c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f5461890640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f545c074620 0x7f545c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f5461890640 1 -- 172.21.15.18:0/3357017612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c10e3c0 msgr2=0x7f545c19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f5461890640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c10e3c0 0x7f545c19ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.891+0000 7f5461890640 1 -- 172.21.15.18:0/3357017612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c19f630 con 0x7f545c074f40 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.892+0000 7f5461890640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f545c074f40 0x7f545c19abc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f544c00e9f0 tx=0x7f544c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.892+0000 7f54537fe640 1 -- 172.21.15.18:0/3357017612 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c00cd80 con 0x7f545c074f40 2024-09-19T09:53:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.892+0000 7f54537fe640 1 -- 172.21.15.18:0/3357017612 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f544c010910 con 0x7f545c074f40 2024-09-19T09:53:32.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.892+0000 7f54537fe640 1 -- 172.21.15.18:0/3357017612 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c018990 con 0x7f545c074f40 2024-09-19T09:53:32.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.892+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c19f920 con 0x7f545c074f40 2024-09-19T09:53:32.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.893+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c1a7200 con 0x7f545c074f40 2024-09-19T09:53:32.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.894+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c074a00 con 0x7f545c074f40 2024-09-19T09:53:32.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.895+0000 7f54537fe640 1 -- 172.21.15.18:0/3357017612 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f544c010ac0 con 0x7f545c074f40 2024-09-19T09:53:32.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.896+0000 7f54537fe640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54480a32c0 0x7f54480a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:32.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.897+0000 7f54537fe640 1 -- 172.21.15.18:0/3357017612 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f544c0cfba0 con 0x7f545c074f40 2024-09-19T09:53:32.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.897+0000 7f5462091640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54480a32c0 0x7f54480a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:32.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.897+0000 7f5462091640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54480a32c0 0x7f54480a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5458000c00 tx=0x7f5458005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:32.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:32.901+0000 7f54537fe640 1 -- 172.21.15.18:0/3357017612 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f544c09c240 con 0x7f545c074f40 2024-09-19T09:53:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.127+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f545c1a73d0 con 0x7f545c074f40 2024-09-19T09:53:33.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.127+0000 7f54537fe640 1 -- 172.21.15.18:0/3357017612 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f544c0a0540 con 0x7f545c074f40 2024-09-19T09:53:33.130 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:53:33.130 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:53:33.130 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:53:33.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54480a32c0 msgr2=0x7f54480a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54480a32c0 0x7f54480a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5458000c00 tx=0x7f5458005b50 comp rx=0 tx=0).stop 2024-09-19T09:53:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f545c074f40 msgr2=0x7f545c19abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f545c074f40 0x7f545c19abc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f544c00e9f0 tx=0x7f544c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:53:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 shutdown_connections 2024-09-19T09:53:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54480a32c0 0x7f54480a5780 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c10e3c0 0x7f545c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f545c074f40 0x7f545c19abc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:33.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 --2- 172.21.15.18:0/3357017612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f545c074620 0x7f545c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 >> 172.21.15.18:0/3357017612 conn(0x7f545c0fd8c0 msgr2=0x7f545c0fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 shutdown_connections 2024-09-19T09:53:33.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:33.130+0000 7f54642f5640 1 -- 172.21.15.18:0/3357017612 wait complete. 2024-09-19T09:53:33.821 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:33 smithi018 ceph-mon[30956]: pgmap v375: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:53:33.821 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:33 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3357017612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:33.860 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:53:33.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:33 smithi049 ceph-mon[34858]: pgmap v375: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:53:33.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:33 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3357017612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:33 smithi162 ceph-mon[35174]: pgmap v375: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:53:33.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:33 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3357017612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:34.256 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:34.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.767+0000 7f756e5b9640 1 -- 172.21.15.18:0/4074022865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75681036e0 msgr2=0x7f7568107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.767+0000 7f756e5b9640 1 --2- 172.21.15.18:0/4074022865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75681036e0 0x7f7568107b90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f755c009930 tx=0x7f755c02a420 comp rx=0 tx=0).stop 2024-09-19T09:53:34.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.767+0000 7f756e5b9640 1 -- 172.21.15.18:0/4074022865 shutdown_connections 2024-09-19T09:53:34.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.767+0000 7f756e5b9640 1 --2- 172.21.15.18:0/4074022865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75681082a0 0x7f756810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.767+0000 7f756e5b9640 1 --2- 172.21.15.18:0/4074022865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75681036e0 0x7f7568107b90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.767+0000 7f756e5b9640 1 --2- 172.21.15.18:0/4074022865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7568102d30 0x7f7568103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.767+0000 7f756e5b9640 1 -- 172.21.15.18:0/4074022865 >> 172.21.15.18:0/4074022865 conn(0x7f75680fc7d0 msgr2=0x7f75680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:34.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.767+0000 7f756e5b9640 1 -- 172.21.15.18:0/4074022865 shutdown_connections 2024-09-19T09:53:34.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.768+0000 7f756e5b9640 1 -- 172.21.15.18:0/4074022865 wait complete. 2024-09-19T09:53:34.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.768+0000 7f756e5b9640 1 Processor -- start 2024-09-19T09:53:34.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.768+0000 7f756e5b9640 1 -- start start 2024-09-19T09:53:34.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.769+0000 7f756e5b9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7568102d30 0x7f75681985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.769+0000 7f756e5b9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75681036e0 0x7f7568198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.769+0000 7f756e5b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75681082a0 0x7f756819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.769+0000 7f756e5b9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7568112060 con 0x7f75681082a0 2024-09-19T09:53:34.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.769+0000 7f756e5b9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7568111ee0 con 0x7f7568102d30 2024-09-19T09:53:34.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.769+0000 7f756e5b9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75681121e0 con 0x7f75681036e0 2024-09-19T09:53:34.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.769+0000 7f756cb56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75681082a0 0x7f756819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.769+0000 7f756cb56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75681082a0 0x7f756819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37040/0 (socket says 172.21.15.18:37040) 2024-09-19T09:53:34.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.769+0000 7f756cb56640 1 -- 172.21.15.18:0/3110785118 learned_addr learned my addr 172.21.15.18:0/3110785118 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:34.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.769+0000 7f75677fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75681036e0 0x7f7568198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.770+0000 7f75677fe640 1 -- 172.21.15.18:0/3110785118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7568102d30 msgr2=0x7f75681985a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:53:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.770+0000 7f75677fe640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7568102d30 0x7f75681985a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.770+0000 7f75677fe640 1 -- 172.21.15.18:0/3110785118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75681082a0 msgr2=0x7f756819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.770+0000 7f75677fe640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75681082a0 0x7f756819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.770+0000 7f75677fe640 1 -- 172.21.15.18:0/3110785118 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756819d550 con 0x7f75681036e0 2024-09-19T09:53:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.770+0000 7f756cb56640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75681082a0 0x7f756819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.770+0000 7f75677fe640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75681036e0 0x7f7568198ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f755c02a940 tx=0x7f755c0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.771+0000 7f75657fa640 1 -- 172.21.15.18:0/3110785118 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c03f070 con 0x7f75681036e0 2024-09-19T09:53:34.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.771+0000 7f756e5b9640 1 -- 172.21.15.18:0/3110785118 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756819d7e0 con 0x7f75681036e0 2024-09-19T09:53:34.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.771+0000 7f756e5b9640 1 -- 172.21.15.18:0/3110785118 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75681008c0 con 0x7f75681036e0 2024-09-19T09:53:34.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.771+0000 7f75657fa640 1 -- 172.21.15.18:0/3110785118 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f755c0044c0 con 0x7f75681036e0 2024-09-19T09:53:34.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.771+0000 7f75657fa640 1 -- 172.21.15.18:0/3110785118 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c035070 con 0x7f75681036e0 2024-09-19T09:53:34.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.773+0000 7f7570992740 1 Processor -- start 2024-09-19T09:53:34.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f7570992740 1 -- start start 2024-09-19T09:53:34.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f7570992740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919bb40 0x561b6919a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f7570992740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b6919aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f7570992740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 0x561b691a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f7570992740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561b691002f0 con 0x561b691a5370 2024-09-19T09:53:34.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f7570992740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561b690a7cf0 con 0x561b6919bb40 2024-09-19T09:53:34.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f7570992740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561b690fc2b0 con 0x561b6919a5d0 2024-09-19T09:53:34.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f756cb56640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919bb40 0x561b6919a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f756cb56640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919bb40 0x561b6919a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37248/0 (socket says 172.21.15.18:37248) 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f756cb56640 1 -- 172.21.15.18:0/1097955208 learned_addr learned my addr 172.21.15.18:0/1097955208 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.774+0000 7f75657fa640 1 -- 172.21.15.18:0/3110785118 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f755c03b460 con 0x7f75681036e0 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f756cb56640 1 -- 172.21.15.18:0/1097955208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 msgr2=0x561b6919aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f756cb56640 1 --2- 172.21.15.18:0/1097955208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b6919aa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f756cb56640 1 -- 172.21.15.18:0/1097955208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 msgr2=0x561b691a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f75677fe640 1 --2- 172.21.15.18:0/1097955208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 0x561b691a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f756cb56640 1 --2- 172.21.15.18:0/1097955208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 0x561b691a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f756cb56640 1 -- 172.21.15.18:0/1097955208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6908c3a0 con 0x561b6919bb40 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f75677fe640 1 --2- 172.21.15.18:0/1097955208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 0x561b691a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f756cb56640 1 --2- 172.21.15.18:0/1097955208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919bb40 0x561b6919a090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7560014f10 tx=0x7f7560009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90cace8ea25500c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f75657fa640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75500a3240 0x7f75500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f754e7fc640 1 -- 172.21.15.18:0/1097955208 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560022020 con 0x561b6919bb40 2024-09-19T09:53:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f75657fa640 1 -- 172.21.15.18:0/3110785118 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f755c0efd90 con 0x7f75681036e0 2024-09-19T09:53:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.775+0000 7f7567fff640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75500a3240 0x7f75500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.776+0000 7f7567fff640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75500a3240 0x7f75500a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x561b69197ac0 tx=0x7f755800b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.777+0000 7f754e7fc640 1 -- 172.21.15.18:0/1097955208 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f756001e8e0 con 0x561b6919bb40 2024-09-19T09:53:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.777+0000 7f754e7fc640 1 -- 172.21.15.18:0/1097955208 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756001d8f0 con 0x561b6919bb40 2024-09-19T09:53:34.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.778+0000 7f7570992740 1 -- 172.21.15.18:0/1097955208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919bb40 msgr2=0x561b6919a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.778+0000 7f7570992740 1 --2- 172.21.15.18:0/1097955208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919bb40 0x561b6919a090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7560014f10 tx=0x7f7560009500 comp rx=0 tx=0).stop 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.778+0000 7f7570992740 1 -- 172.21.15.18:0/1097955208 shutdown_connections 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.778+0000 7f7570992740 1 --2- 172.21.15.18:0/1097955208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 0x561b691a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.778+0000 7f7570992740 1 --2- 172.21.15.18:0/1097955208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b6919aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.778+0000 7f7570992740 1 --2- 172.21.15.18:0/1097955208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919bb40 0x561b6919a090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.778+0000 7f7570992740 1 -- 172.21.15.18:0/1097955208 >> 172.21.15.18:0/1097955208 conn(0x561b69163310 msgr2=0x561b69196c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.778+0000 7f7570992740 1 -- 172.21.15.18:0/1097955208 shutdown_connections 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.778+0000 7f7570992740 1 -- 172.21.15.18:0/1097955208 wait complete. 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.778+0000 7f7570992740 1 -- start start 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f7570992740 1 Processor -- start 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f7570992740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b691a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f7570992740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 0x561b691a2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f7570992740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b691a2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f7570992740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561b691a7e80 con 0x561b6919bb40 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f7570992740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561b690bb060 con 0x561b691a5370 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f7570992740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561b691a8000 con 0x561b6919a5d0 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f7570992740 10 client.0 _ll_register_callbacks cb 0x561b68e0e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f756cb56640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b691a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f756cb56640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b691a2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37254/0 (socket says 172.21.15.18:37254) 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.779+0000 7f756cb56640 1 -- 172.21.15.18:0/2497357686 learned_addr learned my addr 172.21.15.18:0/2497357686 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.780+0000 7f7567fff640 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b691a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.780+0000 7f756cb56640 1 -- 172.21.15.18:0/2497357686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 msgr2=0x561b691a4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.780+0000 7f756cb56640 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b691a4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.780+0000 7f756cb56640 1 -- 172.21.15.18:0/2497357686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 msgr2=0x561b691a2020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.780+0000 7f756cb56640 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 0x561b691a2020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.780+0000 7f756cb56640 1 -- 172.21.15.18:0/2497357686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b68e713c0 con 0x561b691a5370 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.780+0000 7f756cb56640 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b691a2610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7560014c70 tx=0x7f756001ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8179d43944d2d3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.780+0000 7f75477fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.780+0000 7f75477fe640 1 -- 172.21.15.18:0/2497357686 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560022050 con 0x561b691a5370 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.781+0000 7f7570992740 1 -- 172.21.15.18:0/2497357686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f756001e8e0 con 0x561b691a5370 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.781+0000 7f75477fe640 1 -- 172.21.15.18:0/2497357686 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f756001d690 con 0x561b691a5370 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.781+0000 7f75477fe640 1 -- 172.21.15.18:0/2497357686 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7560004e50 con 0x561b691a5370 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.781+0000 7f7570992740 10 client.25376 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.781+0000 7f7570992740 1 -- 172.21.15.18:0/2497357686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b691b3810 con 0x561b691a5370 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.781+0000 7f75477fe640 1 -- 172.21.15.18:0/2497357686 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f756001dd70 con 0x561b691a5370 2024-09-19T09:53:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.781+0000 7f75477fe640 1 -- 172.21.15.18:0/2497357686 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f756002f070 con 0x561b691a5370 2024-09-19T09:53:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.781+0000 7f7570992740 10 client.25376 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.781+0000 7f7570992740 10 client.25376 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:53:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.782+0000 7f7570992740 20 client.25376 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.782+0000 7f7570992740 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561b691b4bc0 0x561b691b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.782+0000 7f7570992740 4 client.25376 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.782+0000 7f7570992740 1 -- 172.21.15.18:0/2497357686 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f756001e8e0 con 0x561b691b4bc0 2024-09-19T09:53:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.782+0000 7f7567fff640 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561b691b4bc0 0x561b691b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.782+0000 7f75477fe640 10 client.25376 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.782+0000 7f7567fff640 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561b691b4bc0 0x561b691b6fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=88946539eab44868 server_cookie=dbea09d654b30d92 in_seq=0 out_seq=0 2024-09-19T09:53:34.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.783+0000 7f75477fe640 1 -- 172.21.15.18:0/2497357686 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f756001e8e0 con 0x561b691b4bc0 2024-09-19T09:53:34.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.783+0000 7f75477fe640 10 client.25376 handle_command_reply: tid=0 2024-09-19T09:53:34.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.783+0000 7f7570992740 1 client.25376 shutdown 2024-09-19T09:53:34.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 1 -- 172.21.15.18:0/2497357686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 msgr2=0x561b691a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b691a2610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7560014c70 tx=0x7f756001ed40 comp rx=0 tx=0).stop 2024-09-19T09:53:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 1 -- 172.21.15.18:0/2497357686 shutdown_connections 2024-09-19T09:53:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561b691b4bc0 0x561b691b6fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b691a2610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f75477fe640 0 client.25376 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 0x561b691a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 1 --2- 172.21.15.18:0/2497357686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b691a4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 1 -- 172.21.15.18:0/2497357686 >> 172.21.15.18:0/2497357686 conn(0x561b69163310 msgr2=0x561b6919c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 1 -- 172.21.15.18:0/2497357686 shutdown_connections 2024-09-19T09:53:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 1 -- 172.21.15.18:0/2497357686 wait complete. 2024-09-19T09:53:34.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.784+0000 7f7570992740 20 client.25376 trim_cache size 0 max 16384 2024-09-19T09:53:34.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.810+0000 7f7570992740 1 Processor -- start 2024-09-19T09:53:34.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.810+0000 7f7570992740 1 -- start start 2024-09-19T09:53:34.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.811+0000 7f7570992740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b691b8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.811+0000 7f7570992740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 0x561b691a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.811+0000 7f7570992740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b6919d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.811+0000 7f7570992740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7568071db0 con 0x561b6919bb40 2024-09-19T09:53:34.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.811+0000 7f7570992740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75680738f0 con 0x561b691a5370 2024-09-19T09:53:34.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.811+0000 7f7570992740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7568072480 con 0x561b6919a5d0 2024-09-19T09:53:34.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.811+0000 7f75677fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 0x561b691a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.811+0000 7f75677fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 0x561b691a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37066/0 (socket says 172.21.15.18:37066) 2024-09-19T09:53:34.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.811+0000 7f75677fe640 1 -- 172.21.15.18:0/729774961 learned_addr learned my addr 172.21.15.18:0/729774961 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:34.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.811+0000 7f756cb56640 1 --2- 172.21.15.18:0/729774961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b6919d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.812+0000 7f7567fff640 1 --2- 172.21.15.18:0/729774961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b691b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.812+0000 7f756cb56640 1 -- 172.21.15.18:0/729774961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 msgr2=0x561b691b8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:34.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.812+0000 7f756cb56640 1 --2- 172.21.15.18:0/729774961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b691b8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.812+0000 7f756cb56640 1 -- 172.21.15.18:0/729774961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 msgr2=0x561b691a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:34.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.812+0000 7f756cb56640 1 --2- 172.21.15.18:0/729774961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 0x561b691a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.812+0000 7f756cb56640 1 -- 172.21.15.18:0/729774961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b691a0570 con 0x561b691a5370 2024-09-19T09:53:34.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.812+0000 7f75677fe640 1 --2- 172.21.15.18:0/729774961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 0x561b691a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:34.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.812+0000 7f756cb56640 1 --2- 172.21.15.18:0/729774961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b6919d120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7560005730 tx=0x7f7560009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59ade9b26add47af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.813+0000 7f754dffb640 1 -- 172.21.15.18:0/729774961 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560040030 con 0x561b691a5370 2024-09-19T09:53:34.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.813+0000 7f754dffb640 1 -- 172.21.15.18:0/729774961 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f756000be90 con 0x561b691a5370 2024-09-19T09:53:34.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.813+0000 7f754dffb640 1 -- 172.21.15.18:0/729774961 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560004eb0 con 0x561b691a5370 2024-09-19T09:53:34.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.814+0000 7f7570992740 1 -- 172.21.15.18:0/729774961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 msgr2=0x561b6919d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.814+0000 7f7570992740 1 --2- 172.21.15.18:0/729774961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b6919d120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7560005730 tx=0x7f7560009c90 comp rx=0 tx=0).stop 2024-09-19T09:53:34.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.814+0000 7f7570992740 1 -- 172.21.15.18:0/729774961 shutdown_connections 2024-09-19T09:53:34.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.814+0000 7f7570992740 1 --2- 172.21.15.18:0/729774961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b691a5370 0x561b6919d120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.814+0000 7f7570992740 1 --2- 172.21.15.18:0/729774961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b6919bb40 0x561b691a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.814+0000 7f7570992740 1 --2- 172.21.15.18:0/729774961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919a5d0 0x561b691b8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.814+0000 7f7570992740 1 -- 172.21.15.18:0/729774961 >> 172.21.15.18:0/729774961 conn(0x561b69163310 msgr2=0x561b691a07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:34.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.815+0000 7f7570992740 1 -- 172.21.15.18:0/729774961 shutdown_connections 2024-09-19T09:53:34.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.815+0000 7f7570992740 1 -- 172.21.15.18:0/729774961 wait complete. 2024-09-19T09:53:34.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.815+0000 7f7570992740 1 -- start start 2024-09-19T09:53:34.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.815+0000 7f7570992740 1 Processor -- start 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f7570992740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919a5d0 0x561b691ba520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f7570992740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919bb40 0x561b691baa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f7570992740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 0x561b691bdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f7570992740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7568073220 con 0x561b691a5370 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f7570992740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7568072b50 con 0x561b6919a5d0 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f7570992740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f756806fd90 con 0x561b6919bb40 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f7570992740 10 client.0 _ll_register_callbacks cb 0x7f756001d360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f756cb56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 0x561b691bdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f75677fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919bb40 0x561b691baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f75677fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919bb40 0x561b691baa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53448/0 (socket says 172.21.15.18:53448) 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f75677fe640 1 -- 172.21.15.18:0/2056856183 learned_addr learned my addr 172.21.15.18:0/2056856183 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f756cb56640 1 -- 172.21.15.18:0/2056856183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919bb40 msgr2=0x561b691baa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:34.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f756cb56640 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919bb40 0x561b691baa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f756cb56640 1 -- 172.21.15.18:0/2056856183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919a5d0 msgr2=0x561b691ba520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:34.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f7567fff640 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919a5d0 0x561b691ba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.816+0000 7f756cb56640 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919a5d0 0x561b691ba520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.817+0000 7f756cb56640 1 -- 172.21.15.18:0/2056856183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b691be1c0 con 0x561b691a5370 2024-09-19T09:53:34.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.817+0000 7f756cb56640 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 0x561b691bdb20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f756001e7d0 tx=0x7f756003ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61d0abaa0e5e51d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.817+0000 7f75477fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.818+0000 7f75477fe640 1 -- 172.21.15.18:0/2056856183 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560049060 con 0x561b691a5370 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.818+0000 7f75477fe640 1 -- 172.21.15.18:0/2056856183 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7560004c50 con 0x561b691a5370 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.818+0000 7f7570992740 1 -- 172.21.15.18:0/2056856183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f756000be90 con 0x561b691a5370 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.818+0000 7f75477fe640 1 -- 172.21.15.18:0/2056856183 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7560040070 con 0x561b691a5370 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.818+0000 7f7570992740 10 client.15714 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.818+0000 7f7570992740 1 -- 172.21.15.18:0/2056856183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b6921f890 con 0x561b691a5370 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.818+0000 7f75477fe640 1 -- 172.21.15.18:0/2056856183 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f756000be90 con 0x561b691a5370 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.819+0000 7f75477fe640 1 -- 172.21.15.18:0/2056856183 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f756002f050 con 0x561b691a5370 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.819+0000 7f7570992740 10 client.15714 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.819+0000 7f7570992740 10 client.15714 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:53:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.819+0000 7f7570992740 20 client.15714 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.819+0000 7f7570992740 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561b691b4bc0 0x561b69221e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.819+0000 7f7570992740 4 client.15714 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.819+0000 7f7570992740 1 -- 172.21.15.18:0/2056856183 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b6910d860 con 0x561b691b4bc0 2024-09-19T09:53:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.819+0000 7f7567fff640 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561b691b4bc0 0x561b69221e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.819+0000 7f75477fe640 10 client.15714 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.820+0000 7f7567fff640 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561b691b4bc0 0x561b69221e50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=af43c21c55ed72b5 server_cookie=aa156e01a17f4c96 in_seq=0 out_seq=0 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.820+0000 7f75477fe640 1 -- 172.21.15.18:0/2056856183 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7558016040 con 0x561b691b4bc0 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.820+0000 7f75477fe640 10 client.15714 handle_command_reply: tid=0 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.820+0000 7f7570992740 1 client.15714 shutdown 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.820+0000 7f7570992740 1 -- 172.21.15.18:0/2056856183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 msgr2=0x561b691bdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.820+0000 7f7570992740 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 0x561b691bdb20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f756001e7d0 tx=0x7f756003ce20 comp rx=0 tx=0).stop 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.820+0000 7f7570992740 1 -- 172.21.15.18:0/2056856183 shutdown_connections 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.821+0000 7f7570992740 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x561b691b4bc0 0x561b69221e50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.821+0000 7f75477fe640 0 client.15714 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.821+0000 7f7570992740 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561b691a5370 0x561b691bdb20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.821+0000 7f7570992740 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b6919bb40 0x561b691baa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.821+0000 7f7570992740 1 --2- 172.21.15.18:0/2056856183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561b6919a5d0 0x561b691ba520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.821+0000 7f7570992740 1 -- 172.21.15.18:0/2056856183 >> 172.21.15.18:0/2056856183 conn(0x561b69163310 msgr2=0x561b691a0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:34.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.821+0000 7f7570992740 1 -- 172.21.15.18:0/2056856183 shutdown_connections 2024-09-19T09:53:34.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.821+0000 7f7570992740 1 -- 172.21.15.18:0/2056856183 wait complete. 2024-09-19T09:53:34.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.821+0000 7f7570992740 20 client.15714 trim_cache size 0 max 16384 2024-09-19T09:53:34.826 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 -- 172.21.15.18:0/3110785118 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75500a3240 msgr2=0x7f75500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75500a3240 0x7f75500a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x561b69197ac0 tx=0x7f755800b370 comp rx=0 tx=0).stop 2024-09-19T09:53:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 -- 172.21.15.18:0/3110785118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75681036e0 msgr2=0x7f7568198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75681036e0 0x7f7568198ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f755c02a940 tx=0x7f755c0040c0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 -- 172.21.15.18:0/3110785118 shutdown_connections 2024-09-19T09:53:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75500a3240 0x7f75500a5700 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75681082a0 0x7f756819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75681036e0 0x7f7568198ae0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 --2- 172.21.15.18:0/3110785118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7568102d30 0x7f75681985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:34.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 -- 172.21.15.18:0/3110785118 >> 172.21.15.18:0/3110785118 conn(0x7f75680fc7d0 msgr2=0x7f7568105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:34.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.822+0000 7f756e5b9640 1 -- 172.21.15.18:0/3110785118 shutdown_connections 2024-09-19T09:53:34.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:34.823+0000 7f756e5b9640 1 -- 172.21.15.18:0/3110785118 wait complete. 2024-09-19T09:53:35.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:53:35.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:35 smithi018 ceph-mon[30956]: pgmap v376: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 14 op/s 2024-09-19T09:53:35.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:35 smithi049 ceph-mon[34858]: pgmap v376: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 14 op/s 2024-09-19T09:53:35.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:35 smithi162 ceph-mon[35174]: pgmap v376: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 14 op/s 2024-09-19T09:53:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.435+0000 7ff0877a4640 1 -- 172.21.15.18:0/775777589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0801036e0 msgr2=0x7ff080107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.435+0000 7ff0877a4640 1 --2- 172.21.15.18:0/775777589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0801036e0 0x7ff080107b90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff070009930 tx=0x7ff07002a420 comp rx=0 tx=0).stop 2024-09-19T09:53:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.435+0000 7ff0877a4640 1 -- 172.21.15.18:0/775777589 shutdown_connections 2024-09-19T09:53:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.435+0000 7ff0877a4640 1 --2- 172.21.15.18:0/775777589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0801082a0 0x7ff08010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.435+0000 7ff0877a4640 1 --2- 172.21.15.18:0/775777589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0801036e0 0x7ff080107b90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.435+0000 7ff0877a4640 1 --2- 172.21.15.18:0/775777589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff080102d30 0x7ff080103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.435+0000 7ff0877a4640 1 -- 172.21.15.18:0/775777589 >> 172.21.15.18:0/775777589 conn(0x7ff0800fc7d0 msgr2=0x7ff0800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.435+0000 7ff0877a4640 1 -- 172.21.15.18:0/775777589 shutdown_connections 2024-09-19T09:53:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.435+0000 7ff0877a4640 1 -- 172.21.15.18:0/775777589 wait complete. 2024-09-19T09:53:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.436+0000 7ff0877a4640 1 Processor -- start 2024-09-19T09:53:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.436+0000 7ff0877a4640 1 -- start start 2024-09-19T09:53:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.436+0000 7ff0877a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff080102d30 0x7ff0801a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.436+0000 7ff0877a4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0801036e0 0x7ff0801a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.436+0000 7ff085540640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff080102d30 0x7ff0801a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.436+0000 7ff085540640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff080102d30 0x7ff0801a37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55250/0 (socket says 172.21.15.18:55250) 2024-09-19T09:53:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.436+0000 7ff085540640 1 -- 172.21.15.18:0/1028777639 learned_addr learned my addr 172.21.15.18:0/1028777639 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff084d3f640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0801036e0 0x7ff0801a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff0877a4640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0801082a0 0x7ff08010de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0801120a0 con 0x7ff080102d30 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff080111f20 con 0x7ff0801036e0 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff080112220 con 0x7ff0801082a0 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff085d41640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0801082a0 0x7ff08010de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff085d41640 1 -- 172.21.15.18:0/1028777639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0801036e0 msgr2=0x7ff0801a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff085d41640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0801036e0 0x7ff0801a3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff085d41640 1 -- 172.21.15.18:0/1028777639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff080102d30 msgr2=0x7ff0801a37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff085d41640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff080102d30 0x7ff0801a37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff085d41640 1 -- 172.21.15.18:0/1028777639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08010e590 con 0x7ff0801082a0 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.437+0000 7ff085540640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff080102d30 0x7ff0801a37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.438+0000 7ff085d41640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0801082a0 0x7ff08010de40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff07800da10 tx=0x7ff07800ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.438+0000 7ff0767fc640 1 -- 172.21.15.18:0/1028777639 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07800bd70 con 0x7ff0801082a0 2024-09-19T09:53:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.438+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08010e880 con 0x7ff0801082a0 2024-09-19T09:53:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.438+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0801ab700 con 0x7ff0801082a0 2024-09-19T09:53:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.438+0000 7ff0767fc640 1 -- 172.21.15.18:0/1028777639 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff078003e50 con 0x7ff0801082a0 2024-09-19T09:53:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.438+0000 7ff0767fc640 1 -- 172.21.15.18:0/1028777639 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0780106a0 con 0x7ff0801082a0 2024-09-19T09:53:36.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.441+0000 7ff089b7d740 1 Processor -- start 2024-09-19T09:53:36.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.442+0000 7ff0767fc640 1 -- 172.21.15.18:0/1028777639 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff078003970 con 0x7ff0801082a0 2024-09-19T09:53:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.442+0000 7ff089b7d740 1 -- start start 2024-09-19T09:53:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.442+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddc3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.442+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddc35d0 0x564d9ddc3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.442+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddce370 0x564d9ddd0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.442+0000 7ff089b7d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564d9dd292f0 con 0x564d9ddce370 2024-09-19T09:53:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.442+0000 7ff089b7d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564d9dcd0cf0 con 0x564d9ddc4b40 2024-09-19T09:53:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.442+0000 7ff089b7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564d9dd252b0 con 0x564d9ddc35d0 2024-09-19T09:53:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.442+0000 7ff085540640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddc35d0 0x564d9ddc3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.443+0000 7ff085540640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddc35d0 0x564d9ddc3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54654/0 (socket says 172.21.15.18:54654) 2024-09-19T09:53:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.443+0000 7ff085540640 1 -- 172.21.15.18:0/3029926496 learned_addr learned my addr 172.21.15.18:0/3029926496 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.443+0000 7ff084d3f640 1 --2- 172.21.15.18:0/3029926496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddce370 0x564d9ddd0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.443+0000 7ff085540640 1 -- 172.21.15.18:0/3029926496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 msgr2=0x564d9ddc3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.443+0000 7ff084d3f640 1 --2- 172.21.15.18:0/3029926496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddc3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.443+0000 7ff085540640 1 --2- 172.21.15.18:0/3029926496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddc3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.443+0000 7ff085540640 1 -- 172.21.15.18:0/3029926496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddce370 msgr2=0x564d9ddd0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.443+0000 7ff085540640 1 --2- 172.21.15.18:0/3029926496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddce370 0x564d9ddd0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.443+0000 7ff085540640 1 -- 172.21.15.18:0/3029926496 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d9dcb53a0 con 0x564d9ddc35d0 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.443+0000 7ff0767fc640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff06c0a32c0 0x7ff06c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.444+0000 7ff084d3f640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff06c0a32c0 0x7ff06c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.444+0000 7ff0767fc640 1 -- 172.21.15.18:0/1028777639 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff0780cfbe0 con 0x7ff0801082a0 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.444+0000 7ff085540640 1 --2- 172.21.15.18:0/3029926496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddc35d0 0x564d9ddc3a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff07c010580 tx=0x7ff07c010a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7756414ba25b4ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.444+0000 7ff084d3f640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff06c0a32c0 0x7ff06c0a5780 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff070005940 tx=0x7ff070005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.444+0000 7ff06b7fe640 1 -- 172.21.15.18:0/3029926496 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c00e890 con 0x564d9ddc35d0 2024-09-19T09:53:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.445+0000 7ff06b7fe640 1 -- 172.21.15.18:0/3029926496 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff07c01c480 con 0x564d9ddc35d0 2024-09-19T09:53:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.445+0000 7ff06b7fe640 1 -- 172.21.15.18:0/3029926496 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c011640 con 0x564d9ddc35d0 2024-09-19T09:53:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.445+0000 7ff089b7d740 1 -- 172.21.15.18:0/3029926496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddc35d0 msgr2=0x564d9ddc3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.445+0000 7ff089b7d740 1 --2- 172.21.15.18:0/3029926496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddc35d0 0x564d9ddc3a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff07c010580 tx=0x7ff07c010a40 comp rx=0 tx=0).stop 2024-09-19T09:53:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.446+0000 7ff089b7d740 1 -- 172.21.15.18:0/3029926496 shutdown_connections 2024-09-19T09:53:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.446+0000 7ff089b7d740 1 --2- 172.21.15.18:0/3029926496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddce370 0x564d9ddd0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.446+0000 7ff089b7d740 1 --2- 172.21.15.18:0/3029926496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddc35d0 0x564d9ddc3a10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.446+0000 7ff089b7d740 1 --2- 172.21.15.18:0/3029926496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddc3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.446+0000 7ff089b7d740 1 -- 172.21.15.18:0/3029926496 >> 172.21.15.18:0/3029926496 conn(0x564d9dd8c310 msgr2=0x564d9ddbfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.446+0000 7ff089b7d740 1 -- 172.21.15.18:0/3029926496 shutdown_connections 2024-09-19T09:53:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.446+0000 7ff089b7d740 1 -- 172.21.15.18:0/3029926496 wait complete. 2024-09-19T09:53:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.446+0000 7ff089b7d740 1 -- start start 2024-09-19T09:53:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.446+0000 7ff089b7d740 1 Processor -- start 2024-09-19T09:53:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddcb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddcb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff089b7d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564d9ddd10c0 con 0x564d9ddcbc90 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff089b7d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564d9dce4060 con 0x564d9ddc4b40 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff089b7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564d9ddd1240 con 0x564d9ddce370 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff085d41640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff089b7d740 10 client.0 _ll_register_callbacks cb 0x564d9da378c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff085d41640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55278/0 (socket says 172.21.15.18:55278) 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff085d41640 1 -- 172.21.15.18:0/3801732233 learned_addr learned my addr 172.21.15.18:0/3801732233 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff084d3f640 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddcb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff085540640 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddcb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff085d41640 1 -- 172.21.15.18:0/3801732233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 msgr2=0x564d9ddcb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff085d41640 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddcb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.447+0000 7ff085d41640 1 -- 172.21.15.18:0/3801732233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 msgr2=0x564d9ddcb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.448+0000 7ff085d41640 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddcb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.448+0000 7ff085d41640 1 -- 172.21.15.18:0/3801732233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d9da9a3c0 con 0x564d9ddcbc90 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.448+0000 7ff085d41640 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda570 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff07809bed0 tx=0x7ff07809c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996a838dda1e19f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.448+0000 7ff068ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.448+0000 7ff068ff9640 1 -- 172.21.15.18:0/3801732233 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0780a0580 con 0x564d9ddcbc90 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.448+0000 7ff089b7d740 1 -- 172.21.15.18:0/3801732233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff07c01c480 con 0x564d9ddcbc90 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.448+0000 7ff068ff9640 1 -- 172.21.15.18:0/3801732233 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff0780b5160 con 0x564d9ddcbc90 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff068ff9640 1 -- 172.21.15.18:0/3801732233 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff0780a4e40 con 0x564d9ddcbc90 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff089b7d740 10 client.15726 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff089b7d740 1 -- 172.21.15.18:0/3801732233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564d9dddd180 con 0x564d9ddcbc90 2024-09-19T09:53:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff068ff9640 1 -- 172.21.15.18:0/3801732233 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff07c01c480 con 0x564d9ddcbc90 2024-09-19T09:53:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff068ff9640 1 -- 172.21.15.18:0/3801732233 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff078024060 con 0x564d9ddcbc90 2024-09-19T09:53:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff089b7d740 10 client.15726 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff089b7d740 10 client.15726 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:53:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff089b7d740 20 client.15726 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff089b7d740 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564d9dddea60 0x564d9dde0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff089b7d740 4 client.15726 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.449+0000 7ff089b7d740 1 -- 172.21.15.18:0/3801732233 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d9dd36860 con 0x564d9dddea60 2024-09-19T09:53:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.450+0000 7ff085540640 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564d9dddea60 0x564d9dde0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.451+0000 7ff068ff9640 10 client.15726 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.451+0000 7ff085540640 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564d9dddea60 0x564d9dde0ef0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6265b0c0fad987f7 server_cookie=18b82802e1b574e0 in_seq=0 out_seq=0 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff068ff9640 1 -- 172.21.15.18:0/3801732233 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d9dd36860 con 0x564d9dddea60 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff068ff9640 10 client.15726 handle_command_reply: tid=0 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 client.15726 shutdown 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 -- 172.21.15.18:0/3801732233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 msgr2=0x564d9ddda570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda570 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff07809bed0 tx=0x7ff07809c8d0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 -- 172.21.15.18:0/3801732233 shutdown_connections 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564d9dddea60 0x564d9dde0ef0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda570 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddcb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 --2- 172.21.15.18:0/3801732233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddcb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 -- 172.21.15.18:0/3801732233 >> 172.21.15.18:0/3801732233 conn(0x564d9dd8c310 msgr2=0x564d9ddc5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff068ff9640 0 client.15726 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:36.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 -- 172.21.15.18:0/3801732233 shutdown_connections 2024-09-19T09:53:36.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 1 -- 172.21.15.18:0/3801732233 wait complete. 2024-09-19T09:53:36.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.452+0000 7ff089b7d740 20 client.15726 trim_cache size 0 max 16384 2024-09-19T09:53:36.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.478+0000 7ff089b7d740 1 Processor -- start 2024-09-19T09:53:36.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.478+0000 7ff089b7d740 1 -- start start 2024-09-19T09:53:36.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.478+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddbfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.478+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddda8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff089b7d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0801b3a90 con 0x564d9ddcbc90 2024-09-19T09:53:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff089b7d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff0801b55d0 con 0x564d9ddc4b40 2024-09-19T09:53:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff089b7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0801b4160 con 0x564d9ddce370 2024-09-19T09:53:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff084d3f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff084d3f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55290/0 (socket says 172.21.15.18:55290) 2024-09-19T09:53:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff084d3f640 1 -- 172.21.15.18:0/2501171360 learned_addr learned my addr 172.21.15.18:0/2501171360 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff085540640 1 --2- 172.21.15.18:0/2501171360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddbfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff085d41640 1 --2- 172.21.15.18:0/2501171360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddda8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff084d3f640 1 -- 172.21.15.18:0/2501171360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 msgr2=0x564d9ddda8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff084d3f640 1 --2- 172.21.15.18:0/2501171360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddda8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff084d3f640 1 -- 172.21.15.18:0/2501171360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 msgr2=0x564d9ddbfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff084d3f640 1 --2- 172.21.15.18:0/2501171360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddbfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff084d3f640 1 -- 172.21.15.18:0/2501171360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d9dddade0 con 0x564d9ddcbc90 2024-09-19T09:53:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.479+0000 7ff084d3f640 1 --2- 172.21.15.18:0/2501171360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda360 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff0800697d0 tx=0x7ff070040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960a94efc94842d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.480+0000 7ff06affd640 1 -- 172.21.15.18:0/2501171360 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070035040 con 0x564d9ddcbc90 2024-09-19T09:53:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.480+0000 7ff06affd640 1 -- 172.21.15.18:0/2501171360 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff070050070 con 0x564d9ddcbc90 2024-09-19T09:53:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.480+0000 7ff06affd640 1 -- 172.21.15.18:0/2501171360 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070055c90 con 0x564d9ddcbc90 2024-09-19T09:53:36.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.480+0000 7ff089b7d740 1 -- 172.21.15.18:0/2501171360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 msgr2=0x564d9ddda360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.480+0000 7ff089b7d740 1 --2- 172.21.15.18:0/2501171360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda360 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff0800697d0 tx=0x7ff070040040 comp rx=0 tx=0).stop 2024-09-19T09:53:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.481+0000 7ff089b7d740 1 -- 172.21.15.18:0/2501171360 shutdown_connections 2024-09-19T09:53:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.481+0000 7ff089b7d740 1 --2- 172.21.15.18:0/2501171360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddda8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.481+0000 7ff089b7d740 1 --2- 172.21.15.18:0/2501171360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddcbc90 0x564d9ddda360 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.481+0000 7ff089b7d740 1 --2- 172.21.15.18:0/2501171360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddc4b40 0x564d9ddbfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.481+0000 7ff089b7d740 1 -- 172.21.15.18:0/2501171360 >> 172.21.15.18:0/2501171360 conn(0x564d9dd8c310 msgr2=0x564d9ddbf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.481+0000 7ff089b7d740 1 -- 172.21.15.18:0/2501171360 shutdown_connections 2024-09-19T09:53:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.481+0000 7ff089b7d740 1 -- 172.21.15.18:0/2501171360 wait complete. 2024-09-19T09:53:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.481+0000 7ff089b7d740 1 -- start start 2024-09-19T09:53:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.481+0000 7ff089b7d740 1 Processor -- start 2024-09-19T09:53:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddc4b40 0x564d9ddd64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddcbc90 0x564d9ddd6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff089b7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddc84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff085540640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddc4b40 0x564d9ddd64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff089b7d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0801b4f00 con 0x564d9ddc4b40 2024-09-19T09:53:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff089b7d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff0801b4830 con 0x564d9ddcbc90 2024-09-19T09:53:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff089b7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0801b1a90 con 0x564d9ddce370 2024-09-19T09:53:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff085540640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddc4b40 0x564d9ddd64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55304/0 (socket says 172.21.15.18:55304) 2024-09-19T09:53:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff085540640 1 -- 172.21.15.18:0/1678765756 learned_addr learned my addr 172.21.15.18:0/1678765756 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff089b7d740 10 client.0 _ll_register_callbacks cb 0x7ff078004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff085d41640 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddc84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff084d3f640 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddcbc90 0x564d9ddd6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff085540640 1 -- 172.21.15.18:0/1678765756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 msgr2=0x564d9ddc84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff085540640 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddc84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff085540640 1 -- 172.21.15.18:0/1678765756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddcbc90 msgr2=0x564d9ddd6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff085540640 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddcbc90 0x564d9ddd6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff085540640 1 -- 172.21.15.18:0/1678765756 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d9ddc8b10 con 0x564d9ddc4b40 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.482+0000 7ff085d41640 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddc84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.483+0000 7ff085540640 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddc4b40 0x564d9ddd64d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff07c010f40 tx=0x7ff07c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90fd8b77a7d4626 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.483+0000 7ff068ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.483+0000 7ff068ff9640 1 -- 172.21.15.18:0/1678765756 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c005630 con 0x564d9ddc4b40 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.483+0000 7ff068ff9640 1 -- 172.21.15.18:0/1678765756 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff07c00e690 con 0x564d9ddc4b40 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.483+0000 7ff089b7d740 1 -- 172.21.15.18:0/1678765756 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff070050070 con 0x564d9ddc4b40 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.483+0000 7ff068ff9640 1 -- 172.21.15.18:0/1678765756 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff07c00e890 con 0x564d9ddc4b40 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.483+0000 7ff089b7d740 10 client.15732 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.483+0000 7ff089b7d740 1 -- 172.21.15.18:0/1678765756 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564d9ddcf430 con 0x564d9ddc4b40 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.484+0000 7ff068ff9640 1 -- 172.21.15.18:0/1678765756 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff07c01c480 con 0x564d9ddc4b40 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.484+0000 7ff068ff9640 1 -- 172.21.15.18:0/1678765756 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff07c0035f0 con 0x564d9ddc4b40 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.484+0000 7ff089b7d740 10 client.15732 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.484+0000 7ff089b7d740 10 client.15732 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.484+0000 7ff089b7d740 20 client.15732 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.484+0000 7ff089b7d740 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564d9de497d0 0x564d9de4bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.484+0000 7ff089b7d740 4 client.15732 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.484+0000 7ff089b7d740 1 -- 172.21.15.18:0/1678765756 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff070050070 con 0x564d9de497d0 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.484+0000 7ff084d3f640 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564d9de497d0 0x564d9de4bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff068ff9640 10 client.15732 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff084d3f640 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564d9de497d0 0x564d9de4bbc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=82651a6d6dc1bbcd server_cookie=ec2a5b9d7123d869 in_seq=0 out_seq=0 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff068ff9640 1 -- 172.21.15.18:0/1678765756 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff070050070 con 0x564d9de497d0 2024-09-19T09:53:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff068ff9640 10 client.15732 handle_command_reply: tid=0 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff089b7d740 1 client.15732 shutdown 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff089b7d740 1 -- 172.21.15.18:0/1678765756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddc4b40 msgr2=0x564d9ddd64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff089b7d740 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddc4b40 0x564d9ddd64d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff07c010f40 tx=0x7ff07c00b700 comp rx=0 tx=0).stop 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff089b7d740 1 -- 172.21.15.18:0/1678765756 shutdown_connections 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff089b7d740 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564d9de497d0 0x564d9de4bbc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff089b7d740 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d9ddce370 0x564d9ddc84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff089b7d740 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d9ddcbc90 0x564d9ddd6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff068ff9640 0 client.15732 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff089b7d740 1 --2- 172.21.15.18:0/1678765756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d9ddc4b40 0x564d9ddd64d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.485+0000 7ff089b7d740 1 -- 172.21.15.18:0/1678765756 >> 172.21.15.18:0/1678765756 conn(0x564d9dd8c310 msgr2=0x564d9ddbf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.486+0000 7ff089b7d740 1 -- 172.21.15.18:0/1678765756 shutdown_connections 2024-09-19T09:53:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.486+0000 7ff089b7d740 1 -- 172.21.15.18:0/1678765756 wait complete. 2024-09-19T09:53:36.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.486+0000 7ff089b7d740 20 client.15732 trim_cache size 0 max 16384 2024-09-19T09:53:36.492 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:36.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff06c0a32c0 msgr2=0x7ff06c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff06c0a32c0 0x7ff06c0a5780 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff070005940 tx=0x7ff070005780 comp rx=0 tx=0).stop 2024-09-19T09:53:36.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0801082a0 msgr2=0x7ff08010de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0801082a0 0x7ff08010de40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff07800da10 tx=0x7ff07800ded0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 shutdown_connections 2024-09-19T09:53:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff06c0a32c0 0x7ff06c0a5780 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0801082a0 0x7ff08010de40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0801036e0 0x7ff0801a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 --2- 172.21.15.18:0/1028777639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff080102d30 0x7ff0801a37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 >> 172.21.15.18:0/1028777639 conn(0x7ff0800fc7d0 msgr2=0x7ff080100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 shutdown_connections 2024-09-19T09:53:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:36.487+0000 7ff0877a4640 1 -- 172.21.15.18:0/1028777639 wait complete. 2024-09-19T09:53:37.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:53:37.744 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:37.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:37 smithi018 ceph-mon[30956]: pgmap v377: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T09:53:37.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:53:37.878 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:53:37.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:37 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:53:37.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:37 smithi049 ceph-mon[34858]: pgmap v377: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T09:53:37.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:37 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:53:37.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:37 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:53:37.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:37 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:53:37.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:37 smithi162 ceph-mon[35174]: pgmap v377: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T09:53:37.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:37 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:53:37.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:37 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:53:37.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:37 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:53:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.230+0000 7f953f1c4640 1 -- 172.21.15.18:0/680845660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953810c150 msgr2=0x7f953810e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.230+0000 7f953f1c4640 1 --2- 172.21.15.18:0/680845660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953810c150 0x7f953810e5f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9530009ca0 tx=0x7f953002a950 comp rx=0 tx=0).stop 2024-09-19T09:53:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.230+0000 7f953f1c4640 1 -- 172.21.15.18:0/680845660 shutdown_connections 2024-09-19T09:53:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.230+0000 7f953f1c4640 1 --2- 172.21.15.18:0/680845660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953810c150 0x7f953810e5f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.230+0000 7f953f1c4640 1 --2- 172.21.15.18:0/680845660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9538103640 0x7f953810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.230+0000 7f953f1c4640 1 --2- 172.21.15.18:0/680845660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9538102d20 0x7f9538103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.230+0000 7f953f1c4640 1 -- 172.21.15.18:0/680845660 >> 172.21.15.18:0/680845660 conn(0x7f95380fc780 msgr2=0x7f95380feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.230+0000 7f953f1c4640 1 -- 172.21.15.18:0/680845660 shutdown_connections 2024-09-19T09:53:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.230+0000 7f953f1c4640 1 -- 172.21.15.18:0/680845660 wait complete. 2024-09-19T09:53:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.231+0000 7f953f1c4640 1 Processor -- start 2024-09-19T09:53:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.232+0000 7f953f1c4640 1 -- start start 2024-09-19T09:53:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.232+0000 7f953f1c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9538102d20 0x7f9538198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.232+0000 7f953f1c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9538103640 0x7f9538198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.232+0000 7f953f1c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953810c150 0x7f953819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953d761640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953810c150 0x7f953819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f9537fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9538103640 0x7f9538198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f9537fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9538103640 0x7f9538198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41330/0 (socket says 172.21.15.18:41330) 2024-09-19T09:53:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953d761640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953810c150 0x7f953819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55314/0 (socket says 172.21.15.18:55314) 2024-09-19T09:53:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953cf60640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9538102d20 0x7f9538198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953cf60640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9538102d20 0x7f9538198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54718/0 (socket says 172.21.15.18:54718) 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f9537fff640 1 -- 172.21.15.18:0/3770461852 learned_addr learned my addr 172.21.15.18:0/3770461852 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9538111f30 con 0x7f953810c150 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9538111db0 con 0x7f9538103640 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f95381120b0 con 0x7f9538102d20 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953d761640 1 -- 172.21.15.18:0/3770461852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9538102d20 msgr2=0x7f9538198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953d761640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9538102d20 0x7f9538198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953d761640 1 -- 172.21.15.18:0/3770461852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9538103640 msgr2=0x7f9538198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953d761640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9538103640 0x7f9538198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953d761640 1 -- 172.21.15.18:0/3770461852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953819d3e0 con 0x7f953810c150 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f9537fff640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9538103640 0x7f9538198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.233+0000 7f953cf60640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9538102d20 0x7f9538198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:38.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.234+0000 7f953d761640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953810c150 0x7f953819cd00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9530005cc0 tx=0x7f953002f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.234+0000 7f9535ffb640 1 -- 172.21.15.18:0/3770461852 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530034040 con 0x7f953810c150 2024-09-19T09:53:38.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.234+0000 7f9535ffb640 1 -- 172.21.15.18:0/3770461852 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9530030920 con 0x7f953810c150 2024-09-19T09:53:38.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.234+0000 7f9535ffb640 1 -- 172.21.15.18:0/3770461852 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530004750 con 0x7f953810c150 2024-09-19T09:53:38.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.234+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953819d670 con 0x7f953810c150 2024-09-19T09:53:38.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.235+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f953819dad0 con 0x7f953810c150 2024-09-19T09:53:38.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.238+0000 7f9535ffb640 1 -- 172.21.15.18:0/3770461852 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9530037020 con 0x7f953810c150 2024-09-19T09:53:38.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.239+0000 7f954159d740 1 Processor -- start 2024-09-19T09:53:38.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.239+0000 7f954159d740 1 -- start start 2024-09-19T09:53:38.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.239+0000 7f954159d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d3586b40 0x5574d3585090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.239+0000 7f954159d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d35855d0 0x5574d3585a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.239+0000 7f954159d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3592760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.239+0000 7f954159d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5574d34eb2f0 con 0x5574d3590370 2024-09-19T09:53:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.239+0000 7f954159d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5574d3492cf0 con 0x5574d35855d0 2024-09-19T09:53:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.239+0000 7f954159d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5574d34e72b0 con 0x5574d3586b40 2024-09-19T09:53:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.240+0000 7f9537fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d3586b40 0x5574d3585090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.240+0000 7f9537fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d3586b40 0x5574d3585090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54724/0 (socket says 172.21.15.18:54724) 2024-09-19T09:53:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.240+0000 7f9537fff640 1 -- 172.21.15.18:0/1437810932 learned_addr learned my addr 172.21.15.18:0/1437810932 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.240+0000 7f9535ffb640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95280a3340 0x7f95280a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.240+0000 7f9537fff640 1 --2- 172.21.15.18:0/1437810932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3592760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.240+0000 7f953cf60640 1 --2- 172.21.15.18:0/1437810932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d35855d0 0x5574d3585a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.240+0000 7f953cf60640 1 -- 172.21.15.18:0/1437810932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d3586b40 msgr2=0x5574d3585090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.240+0000 7f953cf60640 1 --2- 172.21.15.18:0/1437810932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d3586b40 0x5574d3585090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.240+0000 7f953cf60640 1 -- 172.21.15.18:0/1437810932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 msgr2=0x5574d3592760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.240+0000 7f953cf60640 1 --2- 172.21.15.18:0/1437810932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3592760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.241+0000 7f953cf60640 1 -- 172.21.15.18:0/1437810932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574d34773a0 con 0x5574d35855d0 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.241+0000 7f9537fff640 1 --2- 172.21.15.18:0/1437810932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3592760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.241+0000 7f9535ffb640 1 -- 172.21.15.18:0/3770461852 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f95300f0840 con 0x7f953810c150 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.241+0000 7f953d761640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95280a3340 0x7f95280a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.241+0000 7f953cf60640 1 --2- 172.21.15.18:0/1437810932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d35855d0 0x5574d3585a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f952c009b90 tx=0x7f952c00e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a4e449367b912d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.241+0000 7f9522ffd640 1 -- 172.21.15.18:0/1437810932 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c016070 con 0x5574d35855d0 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.241+0000 7f9522ffd640 1 -- 172.21.15.18:0/1437810932 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f952c005500 con 0x5574d35855d0 2024-09-19T09:53:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.241+0000 7f9522ffd640 1 -- 172.21.15.18:0/1437810932 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c011470 con 0x5574d35855d0 2024-09-19T09:53:38.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.242+0000 7f954159d740 1 -- 172.21.15.18:0/1437810932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d35855d0 msgr2=0x5574d3585a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.242+0000 7f954159d740 1 --2- 172.21.15.18:0/1437810932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d35855d0 0x5574d3585a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f952c009b90 tx=0x7f952c00e6c0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.242+0000 7f953d761640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95280a3340 0x7f95280a5800 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f953002ae70 tx=0x7f9530005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.242+0000 7f954159d740 1 -- 172.21.15.18:0/1437810932 shutdown_connections 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.242+0000 7f954159d740 1 --2- 172.21.15.18:0/1437810932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3592760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.242+0000 7f954159d740 1 --2- 172.21.15.18:0/1437810932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d35855d0 0x5574d3585a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.242+0000 7f954159d740 1 --2- 172.21.15.18:0/1437810932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d3586b40 0x5574d3585090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.242+0000 7f954159d740 1 -- 172.21.15.18:0/1437810932 >> 172.21.15.18:0/1437810932 conn(0x5574d354e310 msgr2=0x5574d3581c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.242+0000 7f954159d740 1 -- 172.21.15.18:0/1437810932 shutdown_connections 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.242+0000 7f954159d740 1 -- 172.21.15.18:0/1437810932 wait complete. 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.243+0000 7f954159d740 1 -- start start 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.243+0000 7f954159d740 1 Processor -- start 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.243+0000 7f954159d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d358fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.243+0000 7f954159d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.243+0000 7f954159d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 0x5574d358d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f953cf60640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f953cf60640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55338/0 (socket says 172.21.15.18:55338) 2024-09-19T09:53:38.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f953cf60640 1 -- 172.21.15.18:0/2138397820 learned_addr learned my addr 172.21.15.18:0/2138397820 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:38.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5574d3593070 con 0x5574d3586b40 2024-09-19T09:53:38.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5574d34a6060 con 0x5574d3590370 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5574d35931f0 con 0x5574d35855d0 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f9537fff640 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d358fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f9537fff640 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 0x5574d358d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f953cf60640 1 -- 172.21.15.18:0/2138397820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 msgr2=0x5574d358fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f953cf60640 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d358fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f953cf60640 1 -- 172.21.15.18:0/2138397820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 msgr2=0x5574d358d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f953cf60640 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 0x5574d358d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f953cf60640 1 -- 172.21.15.18:0/2138397820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574d325c3c0 con 0x5574d3586b40 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f953cf60640 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358cfb0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f952c004b70 tx=0x7f952c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d8fce832242705 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f9517fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f954159d740 10 client.0 _ll_register_callbacks cb 0x5574d31f98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.244+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f952c005500 con 0x5574d3586b40 2024-09-19T09:53:38.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.245+0000 7f9517fff640 1 -- 172.21.15.18:0/2138397820 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c016040 con 0x5574d3586b40 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.245+0000 7f9517fff640 1 -- 172.21.15.18:0/2138397820 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f952c004020 con 0x5574d3586b40 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.245+0000 7f9517fff640 1 -- 172.21.15.18:0/2138397820 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f952c004280 con 0x5574d3586b40 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.245+0000 7f954159d740 10 client.15744 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.245+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5574d359e9a0 con 0x5574d3586b40 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.245+0000 7f9517fff640 1 -- 172.21.15.18:0/2138397820 <== mon.0 v2:172.21.15.18:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f952c00f040 con 0x5574d3586b40 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.245+0000 7f954159d740 10 client.15744 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.245+0000 7f954159d740 10 client.15744 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.246+0000 7f954159d740 20 client.15744 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.246+0000 7f954159d740 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5574d359fcf0 0x5574d35a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.246+0000 7f954159d740 4 client.15744 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.246+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574d34f8860 con 0x5574d359fcf0 2024-09-19T09:53:38.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.246+0000 7f9537fff640 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5574d359fcf0 0x5574d35a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.247+0000 7f9537fff640 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5574d359fcf0 0x5574d35a20e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db2943eaf7b25439 server_cookie=34eec79dfd2c4744 in_seq=0 out_seq=0 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.247+0000 7f9517fff640 10 client.15744 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.247+0000 7f9517fff640 1 -- 172.21.15.18:0/2138397820 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5574d34f8860 con 0x5574d359fcf0 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.247+0000 7f9517fff640 10 client.15744 handle_command_reply: tid=0 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.247+0000 7f954159d740 1 client.15744 shutdown 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.248+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 msgr2=0x5574d358cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.248+0000 7f954159d740 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358cfb0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f952c004b70 tx=0x7f952c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.248+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 shutdown_connections 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.248+0000 7f954159d740 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5574d359fcf0 0x5574d35a20e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.248+0000 7f954159d740 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 0x5574d358d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.248+0000 7f954159d740 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358cfb0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.248+0000 7f9517fff640 0 client.15744 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:38.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.248+0000 7f954159d740 1 --2- 172.21.15.18:0/2138397820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d358fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.248+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 >> 172.21.15.18:0/2138397820 conn(0x5574d354e310 msgr2=0x5574d3587960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.249+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 shutdown_connections 2024-09-19T09:53:38.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.249+0000 7f954159d740 1 -- 172.21.15.18:0/2138397820 wait complete. 2024-09-19T09:53:38.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.249+0000 7f954159d740 20 client.15744 trim_cache size 0 max 16384 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.274+0000 7f954159d740 1 Processor -- start 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.274+0000 7f954159d740 1 -- start start 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.275+0000 7f954159d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d3580bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.275+0000 7f954159d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3586b40 0x5574d3588120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.275+0000 7f954159d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3588660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.275+0000 7f954159d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95381ab270 con 0x5574d3590370 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.275+0000 7f954159d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f95381acdb0 con 0x5574d3586b40 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.275+0000 7f954159d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f95381ab940 con 0x5574d35855d0 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.275+0000 7f9537fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3588660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.276+0000 7f9537fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3588660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55340/0 (socket says 172.21.15.18:55340) 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.276+0000 7f9537fff640 1 -- 172.21.15.18:0/406229813 learned_addr learned my addr 172.21.15.18:0/406229813 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.276+0000 7f953cf60640 1 --2- 172.21.15.18:0/406229813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3586b40 0x5574d3588120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.276+0000 7f9537fff640 1 -- 172.21.15.18:0/406229813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 msgr2=0x5574d3580bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.276+0000 7f9537fff640 1 --2- 172.21.15.18:0/406229813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d3580bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.276+0000 7f9537fff640 1 -- 172.21.15.18:0/406229813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3586b40 msgr2=0x5574d3588120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.276+0000 7f9537fff640 1 --2- 172.21.15.18:0/406229813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3586b40 0x5574d3588120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.276+0000 7f9537fff640 1 -- 172.21.15.18:0/406229813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574d35931e0 con 0x5574d3590370 2024-09-19T09:53:38.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.276+0000 7f9537fff640 1 --2- 172.21.15.18:0/406229813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3588660 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f952400bd20 tx=0x7f9524005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b436e38a2ef02f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.276+0000 7f95227fc640 1 -- 172.21.15.18:0/406229813 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952401b040 con 0x5574d3590370 2024-09-19T09:53:38.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.277+0000 7f95227fc640 1 -- 172.21.15.18:0/406229813 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9524012be0 con 0x5574d3590370 2024-09-19T09:53:38.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.277+0000 7f95227fc640 1 -- 172.21.15.18:0/406229813 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524010670 con 0x5574d3590370 2024-09-19T09:53:38.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 -- 172.21.15.18:0/406229813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 msgr2=0x5574d3588660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 --2- 172.21.15.18:0/406229813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3588660 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f952400bd20 tx=0x7f9524005850 comp rx=0 tx=0).stop 2024-09-19T09:53:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 -- 172.21.15.18:0/406229813 shutdown_connections 2024-09-19T09:53:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 --2- 172.21.15.18:0/406229813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3590370 0x5574d3588660 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 --2- 172.21.15.18:0/406229813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3586b40 0x5574d3588120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 --2- 172.21.15.18:0/406229813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d3580bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 -- 172.21.15.18:0/406229813 >> 172.21.15.18:0/406229813 conn(0x5574d354e310 msgr2=0x5574d35804e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 -- 172.21.15.18:0/406229813 shutdown_connections 2024-09-19T09:53:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 -- 172.21.15.18:0/406229813 wait complete. 2024-09-19T09:53:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 -- start start 2024-09-19T09:53:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.278+0000 7f954159d740 1 Processor -- start 2024-09-19T09:53:38.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f954159d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d358a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f954159d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f954159d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 0x5574d358aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f954159d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95381ac6e0 con 0x5574d3586b40 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f954159d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f95381ac010 con 0x5574d3590370 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f954159d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f95381a9250 con 0x5574d35855d0 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f954159d740 10 client.0 _ll_register_callbacks cb 0x7f952c0099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f953cf60640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f953cf60640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55352/0 (socket says 172.21.15.18:55352) 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f953cf60640 1 -- 172.21.15.18:0/2488114483 learned_addr learned my addr 172.21.15.18:0/2488114483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f9537fff640 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 0x5574d358aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.279+0000 7f9537fff640 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d358a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f9537fff640 1 -- 172.21.15.18:0/2488114483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 msgr2=0x5574d358a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f9537fff640 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d358a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f9537fff640 1 -- 172.21.15.18:0/2488114483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 msgr2=0x5574d358a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f9537fff640 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f9537fff640 1 -- 172.21.15.18:0/2488114483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574d3609760 con 0x5574d3590370 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f953cf60640 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f9537fff640 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 0x5574d358aa90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f952400bd50 tx=0x7f9524025ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=756c8e35fe287e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f9517fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f9517fff640 1 -- 172.21.15.18:0/2488114483 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95240253f0 con 0x5574d3590370 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f954159d740 1 -- 172.21.15.18:0/2488114483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9524012be0 con 0x5574d3590370 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f9517fff640 1 -- 172.21.15.18:0/2488114483 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9524025590 con 0x5574d3590370 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f9517fff640 1 -- 172.21.15.18:0/2488114483 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9524025790 con 0x5574d3590370 2024-09-19T09:53:38.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f954159d740 10 client.25412 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:38.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.280+0000 7f954159d740 1 -- 172.21.15.18:0/2488114483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574d360aa40 con 0x5574d3590370 2024-09-19T09:53:38.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.281+0000 7f9517fff640 1 -- 172.21.15.18:0/2488114483 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9524012be0 con 0x5574d3590370 2024-09-19T09:53:38.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.281+0000 7f9517fff640 1 -- 172.21.15.18:0/2488114483 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f952401c890 con 0x5574d3590370 2024-09-19T09:53:38.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.281+0000 7f954159d740 10 client.25412 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:38.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.281+0000 7f954159d740 10 client.25412 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:53:38.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.281+0000 7f954159d740 20 client.25412 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:38.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.281+0000 7f954159d740 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5574d359fcf0 0x5574d360d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:38.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.281+0000 7f954159d740 4 client.25412 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.281+0000 7f954159d740 1 -- 172.21.15.18:0/2488114483 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5574d34f2d70 con 0x5574d359fcf0 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.281+0000 7f953cf60640 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5574d359fcf0 0x5574d360d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f9517fff640 10 client.25412 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f953cf60640 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5574d359fcf0 0x5574d360d0d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2536d67bd1da2c4 server_cookie=72e145a27bc3908 in_seq=0 out_seq=0 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f9517fff640 1 -- 172.21.15.18:0/2488114483 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5574d34f2d70 con 0x5574d359fcf0 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f9517fff640 10 client.25412 handle_command_reply: tid=0 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f954159d740 1 client.25412 shutdown 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f954159d740 1 -- 172.21.15.18:0/2488114483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 msgr2=0x5574d358aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f954159d740 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 0x5574d358aa90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f952400bd50 tx=0x7f9524025ba0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f954159d740 1 -- 172.21.15.18:0/2488114483 shutdown_connections 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f954159d740 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5574d359fcf0 0x5574d360d0d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f954159d740 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574d3590370 0x5574d358aa90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f954159d740 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574d3586b40 0x5574d358a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f954159d740 1 --2- 172.21.15.18:0/2488114483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574d35855d0 0x5574d358a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f954159d740 1 -- 172.21.15.18:0/2488114483 >> 172.21.15.18:0/2488114483 conn(0x5574d354e310 msgr2=0x5574d358f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f9517fff640 0 client.25412 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:38.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.282+0000 7f954159d740 1 -- 172.21.15.18:0/2488114483 shutdown_connections 2024-09-19T09:53:38.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.283+0000 7f954159d740 1 -- 172.21.15.18:0/2488114483 wait complete. 2024-09-19T09:53:38.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.283+0000 7f954159d740 20 client.25412 trim_cache size 0 max 16384 2024-09-19T09:53:38.289 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:38.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.283+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95280a3340 msgr2=0x7f95280a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.283+0000 7f953f1c4640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95280a3340 0x7f95280a5800 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f953002ae70 tx=0x7f9530005d80 comp rx=0 tx=0).stop 2024-09-19T09:53:38.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.283+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953810c150 msgr2=0x7f953819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:38.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.283+0000 7f953f1c4640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953810c150 0x7f953819cd00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9530005cc0 tx=0x7f953002f790 comp rx=0 tx=0).stop 2024-09-19T09:53:38.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.284+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 shutdown_connections 2024-09-19T09:53:38.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.284+0000 7f953f1c4640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95280a3340 0x7f95280a5800 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.284+0000 7f953f1c4640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953810c150 0x7f953819cd00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.284+0000 7f953f1c4640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9538103640 0x7f9538198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.284+0000 7f953f1c4640 1 --2- 172.21.15.18:0/3770461852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9538102d20 0x7f9538198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:38.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.284+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 >> 172.21.15.18:0/3770461852 conn(0x7f95380fc780 msgr2=0x7f95380fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:38.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.284+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 shutdown_connections 2024-09-19T09:53:38.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:38.284+0000 7f953f1c4640 1 -- 172.21.15.18:0/3770461852 wait complete. 2024-09-19T09:53:38.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:53:38.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:53:38.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:53:38.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:38 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:53:38.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:38 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:53:38.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:38 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:53:38.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:38 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:53:38.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:38 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:53:38.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:38 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:53:38.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:53:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.205+0000 7f070edc4640 1 -- 172.21.15.18:0/1244287226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07081001e0 msgr2=0x7f07081005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.205+0000 7f070edc4640 1 --2- 172.21.15.18:0/1244287226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07081001e0 0x7f07081005e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00aa10 tx=0x7f06fc02b720 comp rx=0 tx=0).stop 2024-09-19T09:53:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.205+0000 7f070edc4640 1 -- 172.21.15.18:0/1244287226 shutdown_connections 2024-09-19T09:53:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.205+0000 7f070edc4640 1 --2- 172.21.15.18:0/1244287226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0708101d90 0x7f0708108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.205+0000 7f070edc4640 1 --2- 172.21.15.18:0/1244287226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07081013d0 0x7f0708101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.205+0000 7f070edc4640 1 --2- 172.21.15.18:0/1244287226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07081001e0 0x7f07081005e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.205+0000 7f070edc4640 1 -- 172.21.15.18:0/1244287226 >> 172.21.15.18:0/1244287226 conn(0x7f07080fb940 msgr2=0x7f07080fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.205+0000 7f070edc4640 1 -- 172.21.15.18:0/1244287226 shutdown_connections 2024-09-19T09:53:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.205+0000 7f070edc4640 1 -- 172.21.15.18:0/1244287226 wait complete. 2024-09-19T09:53:39.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.206+0000 7f070edc4640 1 Processor -- start 2024-09-19T09:53:39.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.206+0000 7f070edc4640 1 -- start start 2024-09-19T09:53:39.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.206+0000 7f070edc4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07081001e0 0x7f0708197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070edc4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07081013d0 0x7f0708198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070edc4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0708101d90 0x7f070819f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070edc4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f070810b660 con 0x7f0708101d90 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070edc4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f070810b4e0 con 0x7f07081013d0 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070edc4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f070810b7e0 con 0x7f07081001e0 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070cb60640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07081001e0 0x7f0708197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070cb60640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07081001e0 0x7f0708197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54774/0 (socket says 172.21.15.18:54774) 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070cb60640 1 -- 172.21.15.18:0/2132957178 learned_addr learned my addr 172.21.15.18:0/2132957178 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070d361640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0708101d90 0x7f070819f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f0707fff640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07081013d0 0x7f0708198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070cb60640 1 -- 172.21.15.18:0/2132957178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07081013d0 msgr2=0x7f0708198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070cb60640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07081013d0 0x7f0708198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070cb60640 1 -- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0708101d90 msgr2=0x7f070819f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070cb60640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0708101d90 0x7f070819f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070cb60640 1 -- 172.21.15.18:0/2132957178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07081025f0 con 0x7f07081001e0 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070d361640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0708101d90 0x7f070819f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.207+0000 7f070cb60640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07081001e0 0x7f0708197bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00a960 tx=0x7f06fc005d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.208+0000 7f0705ffb640 1 -- 172.21.15.18:0/2132957178 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc03f070 con 0x7f07081001e0 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.208+0000 7f0705ffb640 1 -- 172.21.15.18:0/2132957178 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06fc032400 con 0x7f07081001e0 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.208+0000 7f0705ffb640 1 -- 172.21.15.18:0/2132957178 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc036040 con 0x7f07081001e0 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.208+0000 7f070edc4640 1 -- 172.21.15.18:0/2132957178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0708102880 con 0x7f07081001e0 2024-09-19T09:53:39.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.208+0000 7f070edc4640 1 -- 172.21.15.18:0/2132957178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0708102d20 con 0x7f07081001e0 2024-09-19T09:53:39.213 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.211+0000 7f0711c3a740 1 Processor -- start 2024-09-19T09:53:39.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f0711c3a740 1 -- start start 2024-09-19T09:53:39.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b09a0 0x55ca375b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b6370 0x55ca375b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f0711c3a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ca375142f0 con 0x55ca375b12e0 2024-09-19T09:53:39.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f0711c3a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ca374bc270 con 0x55ca375b6370 2024-09-19T09:53:39.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f0711c3a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ca375102b0 con 0x55ca375b09a0 2024-09-19T09:53:39.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f0705ffb640 1 -- 172.21.15.18:0/2132957178 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f06fc042070 con 0x7f07081001e0 2024-09-19T09:53:39.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f070d361640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b09a0 0x55ca375b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f070d361640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b09a0 0x55ca375b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54788/0 (socket says 172.21.15.18:54788) 2024-09-19T09:53:39.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f070d361640 1 -- 172.21.15.18:0/2129586067 learned_addr learned my addr 172.21.15.18:0/2129586067 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:39.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f070cb60640 1 --2- 172.21.15.18:0/2129586067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.212+0000 7f0707fff640 1 --2- 172.21.15.18:0/2129586067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b6370 0x55ca375b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.213+0000 7f070d361640 1 -- 172.21.15.18:0/2129586067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b6370 msgr2=0x55ca375b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.216 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.213+0000 7f070d361640 1 --2- 172.21.15.18:0/2129586067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b6370 0x55ca375b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.213+0000 7f070d361640 1 -- 172.21.15.18:0/2129586067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 msgr2=0x55ca375b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.213+0000 7f070d361640 1 --2- 172.21.15.18:0/2129586067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.213+0000 7f070d361640 1 -- 172.21.15.18:0/2129586067 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca374bb340 con 0x55ca375b09a0 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.213+0000 7f070cb60640 1 --2- 172.21.15.18:0/2129586067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.213+0000 7f0705ffb640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f06f80a3370 0x7f06f80a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.213+0000 7f070d361640 1 --2- 172.21.15.18:0/2129586067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b09a0 0x55ca375b0da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0700009fd0 tx=0x7f07000108e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=675dd3d564872e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.213+0000 7f0705ffb640 1 -- 172.21.15.18:0/2132957178 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f06fc0f0290 con 0x7f07081001e0 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.213+0000 7f070cb60640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f06f80a3370 0x7f06f80a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.214+0000 7f06f2ffd640 1 -- 172.21.15.18:0/2129586067 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700011760 con 0x55ca375b09a0 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.214+0000 7f06f2ffd640 1 -- 172.21.15.18:0/2129586067 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0700011de0 con 0x55ca375b09a0 2024-09-19T09:53:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.214+0000 7f06f2ffd640 1 -- 172.21.15.18:0/2129586067 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070000e3c0 con 0x55ca375b09a0 2024-09-19T09:53:39.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 -- 172.21.15.18:0/2129586067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b09a0 msgr2=0x55ca375b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f070cb60640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f06f80a3370 0x7f06f80a5830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0b8d70 tx=0x7f06fc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 --2- 172.21.15.18:0/2129586067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b09a0 0x55ca375b0da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0700009fd0 tx=0x7f07000108e0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 -- 172.21.15.18:0/2129586067 shutdown_connections 2024-09-19T09:53:39.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 --2- 172.21.15.18:0/2129586067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b6370 0x55ca375b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 --2- 172.21.15.18:0/2129586067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 --2- 172.21.15.18:0/2129586067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b09a0 0x55ca375b0da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 -- 172.21.15.18:0/2129586067 >> 172.21.15.18:0/2129586067 conn(0x55ca375ac010 msgr2=0x55ca375ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 -- 172.21.15.18:0/2129586067 shutdown_connections 2024-09-19T09:53:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 -- 172.21.15.18:0/2129586067 wait complete. 2024-09-19T09:53:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 -- start start 2024-09-19T09:53:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.215+0000 7f0711c3a740 1 Processor -- start 2024-09-19T09:53:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b09a0 0x55ca375bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b12e0 0x55ca375bb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b6370 0x55ca375c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0711c3a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ca375b9390 con 0x55ca375b6370 2024-09-19T09:53:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0711c3a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ca3749d290 con 0x55ca375b09a0 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0711c3a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ca375b9510 con 0x55ca375b12e0 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0711c3a740 10 client.0 _ll_register_callbacks cb 0x55ca374ce140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f070d361640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b6370 0x55ca375c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f070d361640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b6370 0x55ca375c21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55386/0 (socket says 172.21.15.18:55386) 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f070d361640 1 -- 172.21.15.18:0/3691769439 learned_addr learned my addr 172.21.15.18:0/3691769439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0707fff640 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b12e0 0x55ca375bb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0707fff640 1 -- 172.21.15.18:0/3691769439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b09a0 msgr2=0x55ca375bac60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0707fff640 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b09a0 0x55ca375bac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0707fff640 1 -- 172.21.15.18:0/3691769439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b6370 msgr2=0x55ca375c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0707fff640 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b6370 0x55ca375c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f0707fff640 1 -- 172.21.15.18:0/3691769439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca37227210 con 0x55ca375b12e0 2024-09-19T09:53:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.216+0000 7f070d361640 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b6370 0x55ca375c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.217+0000 7f0707fff640 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b12e0 0x55ca375bb1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0708199100 tx=0x7f06f4012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc2f28a1276f8378 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.217+0000 7f06e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:53:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.217+0000 7f06e7fff640 1 -- 172.21.15.18:0/3691769439 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4004320 con 0x55ca375b12e0 2024-09-19T09:53:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.217+0000 7f06e7fff640 1 -- 172.21.15.18:0/3691769439 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f06f40119a0 con 0x55ca375b12e0 2024-09-19T09:53:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.217+0000 7f0711c3a740 1 -- 172.21.15.18:0/3691769439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0700011de0 con 0x55ca375b12e0 2024-09-19T09:53:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.217+0000 7f06e7fff640 1 -- 172.21.15.18:0/3691769439 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06f4023070 con 0x55ca375b12e0 2024-09-19T09:53:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.217+0000 7f0711c3a740 10 client.25357 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.217+0000 7f0711c3a740 1 -- 172.21.15.18:0/3691769439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca372f3620 con 0x55ca375b12e0 2024-09-19T09:53:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.217+0000 7f06e7fff640 1 -- 172.21.15.18:0/3691769439 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0700011de0 con 0x55ca375b12e0 2024-09-19T09:53:39.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.219+0000 7f06e7fff640 1 -- 172.21.15.18:0/3691769439 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06f4011cc0 con 0x55ca375b12e0 2024-09-19T09:53:39.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.219+0000 7f0711c3a740 10 client.25357 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:39.225 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.219+0000 7f0711c3a740 10 client.25357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.219+0000 7f0711c3a740 20 client.25357 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.219+0000 7f0711c3a740 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ca375cf140 0x55ca375d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.219+0000 7f0711c3a740 4 client.25357 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.219+0000 7f0711c3a740 1 -- 172.21.15.18:0/3691769439 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca37521a20 con 0x55ca375cf140 2024-09-19T09:53:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.219+0000 7f070d361640 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ca375cf140 0x55ca375d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.220+0000 7f070d361640 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ca375cf140 0x55ca375d1590 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121eab90eea91f27 server_cookie=8dcf516e149b30cd in_seq=0 out_seq=0 2024-09-19T09:53:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.220+0000 7f06e7fff640 10 client.25357 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.220+0000 7f06e7fff640 1 -- 172.21.15.18:0/3691769439 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca37521a20 con 0x55ca375cf140 2024-09-19T09:53:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.220+0000 7f06e7fff640 10 client.25357 handle_command_reply: tid=0 2024-09-19T09:53:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.220+0000 7f0711c3a740 1 client.25357 shutdown 2024-09-19T09:53:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 1 -- 172.21.15.18:0/3691769439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b12e0 msgr2=0x55ca375bb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b12e0 0x55ca375bb1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0708199100 tx=0x7f06f4012b60 comp rx=0 tx=0).stop 2024-09-19T09:53:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 1 -- 172.21.15.18:0/3691769439 shutdown_connections 2024-09-19T09:53:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ca375cf140 0x55ca375d1590 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b6370 0x55ca375c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b12e0 0x55ca375bb1a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 1 --2- 172.21.15.18:0/3691769439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b09a0 0x55ca375bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 1 -- 172.21.15.18:0/3691769439 >> 172.21.15.18:0/3691769439 conn(0x55ca375ac010 msgr2=0x55ca375ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f06e7fff640 0 client.25357 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 1 -- 172.21.15.18:0/3691769439 shutdown_connections 2024-09-19T09:53:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 1 -- 172.21.15.18:0/3691769439 wait complete. 2024-09-19T09:53:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.221+0000 7f0711c3a740 20 client.25357 trim_cache size 0 max 16384 2024-09-19T09:53:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.240+0000 7f0711c3a740 1 Processor -- start 2024-09-19T09:53:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.240+0000 7f0711c3a740 1 -- start start 2024-09-19T09:53:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.240+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b09a0 0x55ca375bb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b12e0 0x55ca375c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b6370 0x55ca375ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0711c3a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f07081a6a40 con 0x55ca375b09a0 2024-09-19T09:53:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0711c3a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f07081a8580 con 0x55ca375b12e0 2024-09-19T09:53:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0711c3a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07081a7110 con 0x55ca375b6370 2024-09-19T09:53:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f070d361640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b09a0 0x55ca375bb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f070d361640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b09a0 0x55ca375bb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55402/0 (socket says 172.21.15.18:55402) 2024-09-19T09:53:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f070d361640 1 -- 172.21.15.18:0/817180858 learned_addr learned my addr 172.21.15.18:0/817180858 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0707fff640 1 --2- 172.21.15.18:0/817180858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b12e0 0x55ca375c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0707fff640 1 -- 172.21.15.18:0/817180858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b6370 msgr2=0x55ca375ab0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0707fff640 1 --2- 172.21.15.18:0/817180858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b6370 0x55ca375ab0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0707fff640 1 -- 172.21.15.18:0/817180858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b09a0 msgr2=0x55ca375bb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0707fff640 1 --2- 172.21.15.18:0/817180858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b09a0 0x55ca375bb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f0707fff640 1 -- 172.21.15.18:0/817180858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca375abe30 con 0x55ca375b12e0 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.241+0000 7f070d361640 1 --2- 172.21.15.18:0/817180858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b09a0 0x55ca375bb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.242+0000 7f0707fff640 1 --2- 172.21.15.18:0/817180858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b12e0 0x55ca375c21a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f06f4000c00 tx=0x7f06f4009d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f60e5dc27a257040 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.242+0000 7f06f27fc640 1 -- 172.21.15.18:0/817180858 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f40119a0 con 0x55ca375b12e0 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.242+0000 7f06f27fc640 1 -- 172.21.15.18:0/817180858 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f4005520 con 0x55ca375b12e0 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.242+0000 7f06f27fc640 1 -- 172.21.15.18:0/817180858 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f40049b0 con 0x55ca375b12e0 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 -- 172.21.15.18:0/817180858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b12e0 msgr2=0x55ca375c21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 --2- 172.21.15.18:0/817180858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b12e0 0x55ca375c21a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f06f4000c00 tx=0x7f06f4009d90 comp rx=0 tx=0).stop 2024-09-19T09:53:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 -- 172.21.15.18:0/817180858 shutdown_connections 2024-09-19T09:53:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 --2- 172.21.15.18:0/817180858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b6370 0x55ca375ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 --2- 172.21.15.18:0/817180858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b12e0 0x55ca375c21a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 --2- 172.21.15.18:0/817180858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b09a0 0x55ca375bb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 -- 172.21.15.18:0/817180858 >> 172.21.15.18:0/817180858 conn(0x55ca375ac010 msgr2=0x55ca375aa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 -- 172.21.15.18:0/817180858 shutdown_connections 2024-09-19T09:53:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 -- 172.21.15.18:0/817180858 wait complete. 2024-09-19T09:53:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 -- start start 2024-09-19T09:53:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.243+0000 7f0711c3a740 1 Processor -- start 2024-09-19T09:53:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b09a0 0x55ca375bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0711c3a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b6370 0x55ca375c0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0711c3a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f07081a7eb0 con 0x55ca375b12e0 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0711c3a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f07081a77e0 con 0x55ca375b09a0 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0711c3a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07081a4a20 con 0x55ca375b6370 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0707fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0707fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375bf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55404/0 (socket says 172.21.15.18:55404) 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0707fff640 1 -- 172.21.15.18:0/1551937233 learned_addr learned my addr 172.21.15.18:0/1551937233 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f070d361640 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b09a0 0x55ca375bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0711c3a740 10 client.0 _ll_register_callbacks cb 0x7f06f40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0707fff640 1 -- 172.21.15.18:0/1551937233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b6370 msgr2=0x55ca375c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0707fff640 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b6370 0x55ca375c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0707fff640 1 -- 172.21.15.18:0/1551937233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b09a0 msgr2=0x55ca375bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0707fff640 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b09a0 0x55ca375bf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.244+0000 7f0707fff640 1 -- 172.21.15.18:0/1551937233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca375c0d10 con 0x55ca375b12e0 2024-09-19T09:53:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.245+0000 7f0707fff640 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375bf6f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f06f40044e0 tx=0x7f06f4005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa5e5fdcaa7409a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.245+0000 7f06e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.245+0000 7f06e7fff640 1 -- 172.21.15.18:0/1551937233 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f40119a0 con 0x55ca375b12e0 2024-09-19T09:53:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.245+0000 7f06e7fff640 1 -- 172.21.15.18:0/1551937233 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f06f402f070 con 0x55ca375b12e0 2024-09-19T09:53:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.245+0000 7f0711c3a740 1 -- 172.21.15.18:0/1551937233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f4005520 con 0x55ca375b12e0 2024-09-19T09:53:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.245+0000 7f06e7fff640 1 -- 172.21.15.18:0/1551937233 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06f4042050 con 0x55ca375b12e0 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.245+0000 7f0711c3a740 10 client.15768 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.245+0000 7f0711c3a740 1 -- 172.21.15.18:0/1551937233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca375c1fe0 con 0x55ca375b12e0 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.245+0000 7f06e7fff640 1 -- 172.21.15.18:0/1551937233 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f40035f0 con 0x55ca375b12e0 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.246+0000 7f06e7fff640 1 -- 172.21.15.18:0/1551937233 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06f4028480 con 0x55ca375b12e0 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.246+0000 7f0711c3a740 10 client.15768 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.246+0000 7f0711c3a740 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.246+0000 7f0711c3a740 20 client.15768 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.246+0000 7f0711c3a740 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ca3763a0f0 0x55ca3763c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.246+0000 7f0711c3a740 4 client.15768 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.246+0000 7f0711c3a740 1 -- 172.21.15.18:0/1551937233 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f06f4005520 con 0x55ca3763a0f0 2024-09-19T09:53:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.246+0000 7f070d361640 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ca3763a0f0 0x55ca3763c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.246+0000 7f06e7fff640 10 client.15768 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.246+0000 7f070d361640 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ca3763a0f0 0x55ca3763c510 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=170832f05a70244c server_cookie=3ec6361192f79ae5 in_seq=0 out_seq=0 2024-09-19T09:53:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.250+0000 7f06e7fff640 1 -- 172.21.15.18:0/1551937233 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f06f4005520 con 0x55ca3763a0f0 2024-09-19T09:53:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.250+0000 7f06e7fff640 10 client.15768 handle_command_reply: tid=0 2024-09-19T09:53:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.250+0000 7f0711c3a740 1 client.15768 shutdown 2024-09-19T09:53:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.250+0000 7f0711c3a740 1 -- 172.21.15.18:0/1551937233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 msgr2=0x55ca375bf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f0711c3a740 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375bf6f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f06f40044e0 tx=0x7f06f4005270 comp rx=0 tx=0).stop 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f0711c3a740 1 -- 172.21.15.18:0/1551937233 shutdown_connections 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f0711c3a740 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ca3763a0f0 0x55ca3763c510 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f0711c3a740 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca375b6370 0x55ca375c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f0711c3a740 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ca375b12e0 0x55ca375bf6f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f0711c3a740 1 --2- 172.21.15.18:0/1551937233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ca375b09a0 0x55ca375bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f06e7fff640 0 client.15768 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f0711c3a740 1 -- 172.21.15.18:0/1551937233 >> 172.21.15.18:0/1551937233 conn(0x55ca375ac010 msgr2=0x55ca375ab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f0711c3a740 1 -- 172.21.15.18:0/1551937233 shutdown_connections 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f0711c3a740 1 -- 172.21.15.18:0/1551937233 wait complete. 2024-09-19T09:53:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.251+0000 7f0711c3a740 20 client.15768 trim_cache size 0 max 16384 2024-09-19T09:53:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:53:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:53:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:53:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:53:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 -- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f06f80a3370 msgr2=0x7f06f80a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f06f80a3370 0x7f06f80a5830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0b8d70 tx=0x7f06fc005fd0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 -- 172.21.15.18:0/2132957178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07081001e0 msgr2=0x7f0708197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07081001e0 0x7f0708197bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00a960 tx=0x7f06fc005d70 comp rx=0 tx=0).stop 2024-09-19T09:53:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 -- 172.21.15.18:0/2132957178 shutdown_connections 2024-09-19T09:53:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f06f80a3370 0x7f06f80a5830 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0708101d90 0x7f070819f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07081013d0 0x7f0708198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 --2- 172.21.15.18:0/2132957178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07081001e0 0x7f0708197bf0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00a960 tx=0x7f06fc005d70 comp rx=0 tx=0).stop 2024-09-19T09:53:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 -- 172.21.15.18:0/2132957178 >> 172.21.15.18:0/2132957178 conn(0x7f07080fb940 msgr2=0x7f07080fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 -- 172.21.15.18:0/2132957178 shutdown_connections 2024-09-19T09:53:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:39.252+0000 7f070edc4640 1 -- 172.21.15.18:0/2132957178 wait complete. 2024-09-19T09:53:39.356 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:39.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.795+0000 7f4701d83640 1 -- 172.21.15.18:0/2546549152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46fc100e20 msgr2=0x7f46fc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.795+0000 7f4701d83640 1 --2- 172.21.15.18:0/2546549152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46fc100e20 0x7f46fc101200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009890 tx=0x7f46ec02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.795+0000 7f4701d83640 1 -- 172.21.15.18:0/2546549152 shutdown_connections 2024-09-19T09:53:39.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.795+0000 7f4701d83640 1 --2- 172.21.15.18:0/2546549152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46fc102ef0 0x7f46fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.795+0000 7f4701d83640 1 --2- 172.21.15.18:0/2546549152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46fc102570 0x7f46fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.795+0000 7f4701d83640 1 --2- 172.21.15.18:0/2546549152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46fc100e20 0x7f46fc101200 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.795+0000 7f4701d83640 1 -- 172.21.15.18:0/2546549152 >> 172.21.15.18:0/2546549152 conn(0x7f46fc0fc7d0 msgr2=0x7f46fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.795+0000 7f4701d83640 1 -- 172.21.15.18:0/2546549152 shutdown_connections 2024-09-19T09:53:39.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.795+0000 7f4701d83640 1 -- 172.21.15.18:0/2546549152 wait complete. 2024-09-19T09:53:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.797+0000 7f4701d83640 1 Processor -- start 2024-09-19T09:53:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.797+0000 7f4701d83640 1 -- start start 2024-09-19T09:53:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.797+0000 7f4701d83640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46fc100e20 0x7f46fc10e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.797+0000 7f4701d83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46fc102570 0x7f46fc10e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.797+0000 7f4701d83640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46fc102ef0 0x7f46fc10edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.797+0000 7f4701d83640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc112050 con 0x7f46fc102570 2024-09-19T09:53:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.797+0000 7f4701d83640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc111ed0 con 0x7f46fc100e20 2024-09-19T09:53:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.797+0000 7f4701d83640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc1121d0 con 0x7f46fc102ef0 2024-09-19T09:53:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46faffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46fc102570 0x7f46fc10e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46faffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46fc102570 0x7f46fc10e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55430/0 (socket says 172.21.15.18:55430) 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46faffd640 1 -- 172.21.15.18:0/4233201371 learned_addr learned my addr 172.21.15.18:0/4233201371 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46fbfff640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46fc102ef0 0x7f46fc10edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46fc100e20 0x7f46fc10e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46faffd640 1 -- 172.21.15.18:0/4233201371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46fc102ef0 msgr2=0x7f46fc10edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46faffd640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46fc102ef0 0x7f46fc10edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46faffd640 1 -- 172.21.15.18:0/4233201371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46fc100e20 msgr2=0x7f46fc10e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46faffd640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46fc100e20 0x7f46fc10e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46faffd640 1 -- 172.21.15.18:0/4233201371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46fc1a6a30 con 0x7f46fc102570 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.798+0000 7f46faffd640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46fc102570 0x7f46fc10e890 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f46f000d950 tx=0x7f46f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.799+0000 7f46f8ff9640 1 -- 172.21.15.18:0/4233201371 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0017070 con 0x7f46fc102570 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.799+0000 7f46f8ff9640 1 -- 172.21.15.18:0/4233201371 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f0009c30 con 0x7f46fc102570 2024-09-19T09:53:39.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.799+0000 7f4701d83640 1 -- 172.21.15.18:0/4233201371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46fc1a6d20 con 0x7f46fc102570 2024-09-19T09:53:39.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.800+0000 7f46f8ff9640 1 -- 172.21.15.18:0/4233201371 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f000f6b0 con 0x7f46fc102570 2024-09-19T09:53:39.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.800+0000 7f4701d83640 1 -- 172.21.15.18:0/4233201371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46fc1a7250 con 0x7f46fc102570 2024-09-19T09:53:39.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.803+0000 7f46f8ff9640 1 -- 172.21.15.18:0/4233201371 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f46f00109d0 con 0x7f46fc102570 2024-09-19T09:53:39.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f470415c740 1 Processor -- start 2024-09-19T09:53:39.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f470415c740 1 -- start start 2024-09-19T09:53:39.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f470415c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 0x559bd4f61090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f470415c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f61a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f470415c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4f6e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f470415c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559bd4ec72f0 con 0x559bd4f615d0 2024-09-19T09:53:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f470415c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559bd4e6ecf0 con 0x559bd4f62b40 2024-09-19T09:53:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f470415c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559bd4ec32b0 con 0x559bd4f6c370 2024-09-19T09:53:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f46f8ff9640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46e40a32c0 0x7f46e40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f46fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f61a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f46f8ff9640 1 -- 172.21.15.18:0/4233201371 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f46f00cf180 con 0x7f46fc102570 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f46fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f61a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55446/0 (socket says 172.21.15.18:55446) 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.804+0000 7f46fb7fe640 1 -- 172.21.15.18:0/3275721852 learned_addr learned my addr 172.21.15.18:0/3275721852 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.805+0000 7f46fbfff640 1 --2- 172.21.15.18:0/3275721852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 0x559bd4f61090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.805+0000 7f46fbfff640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46e40a32c0 0x7f46e40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.805+0000 7f46fb7fe640 1 -- 172.21.15.18:0/3275721852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 msgr2=0x559bd4f6e760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.805+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/3275721852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4f6e760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.805+0000 7f46fb7fe640 1 -- 172.21.15.18:0/3275721852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 msgr2=0x559bd4f61090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.805+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/3275721852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 0x559bd4f61090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.805+0000 7f46fb7fe640 1 -- 172.21.15.18:0/3275721852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bd4e533a0 con 0x559bd4f615d0 2024-09-19T09:53:39.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.805+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/3275721852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f61a10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009890 tx=0x7f46ec005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158af90d579e3e27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.806+0000 7f46e1ffb640 1 -- 172.21.15.18:0/3275721852 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec037040 con 0x559bd4f615d0 2024-09-19T09:53:39.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.806+0000 7f46e1ffb640 1 -- 172.21.15.18:0/3275721852 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46ec004230 con 0x559bd4f615d0 2024-09-19T09:53:39.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.806+0000 7f46e1ffb640 1 -- 172.21.15.18:0/3275721852 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0308f0 con 0x559bd4f615d0 2024-09-19T09:53:39.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.807+0000 7f470415c740 1 -- 172.21.15.18:0/3275721852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 msgr2=0x559bd4f61a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.807+0000 7f46fbfff640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46e40a32c0 0x7f46e40a5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009590 tx=0x7f46f4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.807+0000 7f470415c740 1 --2- 172.21.15.18:0/3275721852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f61a10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009890 tx=0x7f46ec005b20 comp rx=0 tx=0).stop 2024-09-19T09:53:39.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.807+0000 7f470415c740 1 -- 172.21.15.18:0/3275721852 shutdown_connections 2024-09-19T09:53:39.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.807+0000 7f470415c740 1 --2- 172.21.15.18:0/3275721852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4f6e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.807+0000 7f470415c740 1 --2- 172.21.15.18:0/3275721852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f61a10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.807+0000 7f470415c740 1 --2- 172.21.15.18:0/3275721852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 0x559bd4f61090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.807+0000 7f470415c740 1 -- 172.21.15.18:0/3275721852 >> 172.21.15.18:0/3275721852 conn(0x559bd4f2a310 msgr2=0x559bd4f5dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.807+0000 7f470415c740 1 -- 172.21.15.18:0/3275721852 shutdown_connections 2024-09-19T09:53:39.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.807+0000 7f470415c740 1 -- 172.21.15.18:0/3275721852 wait complete. 2024-09-19T09:53:39.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f470415c740 1 -- start start 2024-09-19T09:53:39.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f470415c740 1 Processor -- start 2024-09-19T09:53:39.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f470415c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f6bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f470415c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f62b40 0x559bd4f69090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f470415c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f6c370 0x559bd4f697d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f470415c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559bd4f6f010 con 0x559bd4f615d0 2024-09-19T09:53:39.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f46fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f6bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f46fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f6bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55460/0 (socket says 172.21.15.18:55460) 2024-09-19T09:53:39.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f46fb7fe640 1 -- 172.21.15.18:0/2962130848 learned_addr learned my addr 172.21.15.18:0/2962130848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:39.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f470415c740 1 -- 172.21.15.18:0/2962130848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559bd4e82060 con 0x559bd4f6c370 2024-09-19T09:53:39.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.808+0000 7f470415c740 1 -- 172.21.15.18:0/2962130848 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559bd4f6f190 con 0x559bd4f62b40 2024-09-19T09:53:39.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f470415c740 10 client.0 _ll_register_callbacks cb 0x559bd4bd58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:39.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46faffd640 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f62b40 0x559bd4f69090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46fbfff640 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f6c370 0x559bd4f697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46fb7fe640 1 -- 172.21.15.18:0/2962130848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f62b40 msgr2=0x559bd4f69090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f62b40 0x559bd4f69090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46fb7fe640 1 -- 172.21.15.18:0/2962130848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f6c370 msgr2=0x559bd4f697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f6c370 0x559bd4f697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46fb7fe640 1 -- 172.21.15.18:0/2962130848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bd4c383c0 con 0x559bd4f615d0 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46faffd640 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f62b40 0x559bd4f69090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f6bde0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f46ec000c00 tx=0x7f46ec005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cbef873086a451 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46daffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f46daffd640 1 -- 172.21.15.18:0/2962130848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec037050 con 0x559bd4f615d0 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.809+0000 7f470415c740 1 -- 172.21.15.18:0/2962130848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46ec004230 con 0x559bd4f615d0 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f46daffd640 1 -- 172.21.15.18:0/2962130848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f46ec0037f0 con 0x559bd4f615d0 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f46daffd640 1 -- 172.21.15.18:0/2962130848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f46ec0039f0 con 0x559bd4f615d0 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f470415c740 10 client.15780 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f470415c740 1 -- 172.21.15.18:0/2962130848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559bd4f7ab80 con 0x559bd4f615d0 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f46daffd640 1 -- 172.21.15.18:0/2962130848 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46ec030b10 con 0x559bd4f615d0 2024-09-19T09:53:39.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f46daffd640 1 -- 172.21.15.18:0/2962130848 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f46ec0325b0 con 0x559bd4f615d0 2024-09-19T09:53:39.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f470415c740 10 client.15780 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:39.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f470415c740 10 client.15780 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:53:39.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f470415c740 20 client.15780 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:39.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f470415c740 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559bd4f7bed0 0x559bd4f7e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f470415c740 4 client.15780 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:39.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.810+0000 7f470415c740 1 -- 172.21.15.18:0/2962130848 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f46ec004230 con 0x559bd4f7bed0 2024-09-19T09:53:39.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.811+0000 7f46faffd640 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559bd4f7bed0 0x559bd4f7e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.811+0000 7f46faffd640 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559bd4f7bed0 0x559bd4f7e2c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6ec4365cec8b07bf server_cookie=f5d2e03277b27463 in_seq=0 out_seq=0 2024-09-19T09:53:39.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.811+0000 7f46daffd640 10 client.15780 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:39.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f46daffd640 1 -- 172.21.15.18:0/2962130848 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f46ec004230 con 0x559bd4f7bed0 2024-09-19T09:53:39.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f46daffd640 10 client.15780 handle_command_reply: tid=0 2024-09-19T09:53:39.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f470415c740 1 client.15780 shutdown 2024-09-19T09:53:39.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f470415c740 1 -- 172.21.15.18:0/2962130848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 msgr2=0x559bd4f6bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f470415c740 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f6bde0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f46ec000c00 tx=0x7f46ec005fd0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f470415c740 1 -- 172.21.15.18:0/2962130848 shutdown_connections 2024-09-19T09:53:39.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f470415c740 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559bd4f7bed0 0x559bd4f7e2c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f46daffd640 0 client.15780 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:39.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f470415c740 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f6c370 0x559bd4f697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f470415c740 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f62b40 0x559bd4f69090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f470415c740 1 --2- 172.21.15.18:0/2962130848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f6bde0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.812+0000 7f470415c740 1 -- 172.21.15.18:0/2962130848 >> 172.21.15.18:0/2962130848 conn(0x559bd4f2a310 msgr2=0x559bd4f63930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.813+0000 7f470415c740 1 -- 172.21.15.18:0/2962130848 shutdown_connections 2024-09-19T09:53:39.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.813+0000 7f470415c740 1 -- 172.21.15.18:0/2962130848 wait complete. 2024-09-19T09:53:39.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.813+0000 7f470415c740 20 client.15780 trim_cache size 0 max 16384 2024-09-19T09:53:39.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.839+0000 7f470415c740 1 Processor -- start 2024-09-19T09:53:39.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.839+0000 7f470415c740 1 -- start start 2024-09-19T09:53:39.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.839+0000 7f470415c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f78490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.839+0000 7f470415c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 0x559bd4f68970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.839+0000 7f470415c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4f6d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.839+0000 7f470415c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc1af6e0 con 0x559bd4f615d0 2024-09-19T09:53:39.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.839+0000 7f470415c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc1b1220 con 0x559bd4f62b40 2024-09-19T09:53:39.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.839+0000 7f470415c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc1afdb0 con 0x559bd4f6c370 2024-09-19T09:53:39.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46faffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 0x559bd4f68970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f78490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46faffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 0x559bd4f68970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41454/0 (socket says 172.21.15.18:41454) 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46faffd640 1 -- 172.21.15.18:0/1020545339 learned_addr learned my addr 172.21.15.18:0/1020545339 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46fbfff640 1 --2- 172.21.15.18:0/1020545339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4f6d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46faffd640 1 -- 172.21.15.18:0/1020545339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 msgr2=0x559bd4f6d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46faffd640 1 --2- 172.21.15.18:0/1020545339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4f6d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46faffd640 1 -- 172.21.15.18:0/1020545339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 msgr2=0x559bd4f78490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46faffd640 1 --2- 172.21.15.18:0/1020545339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f78490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46faffd640 1 -- 172.21.15.18:0/1020545339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bd4f675e0 con 0x559bd4f62b40 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/1020545339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f78490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46faffd640 1 --2- 172.21.15.18:0/1020545339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 0x559bd4f68970 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f46f009b2a0 tx=0x7f46f00ccb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9036d673bf99b901 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46e17fa640 1 -- 172.21.15.18:0/1020545339 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00ce040 con 0x559bd4f62b40 2024-09-19T09:53:39.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46e17fa640 1 -- 172.21.15.18:0/1020545339 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f0015030 con 0x559bd4f62b40 2024-09-19T09:53:39.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.840+0000 7f46e17fa640 1 -- 172.21.15.18:0/1020545339 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0020040 con 0x559bd4f62b40 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.841+0000 7f470415c740 1 -- 172.21.15.18:0/1020545339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 msgr2=0x559bd4f68970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.841+0000 7f470415c740 1 --2- 172.21.15.18:0/1020545339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 0x559bd4f68970 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f46f009b2a0 tx=0x7f46f00ccb80 comp rx=0 tx=0).stop 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.842+0000 7f470415c740 1 -- 172.21.15.18:0/1020545339 shutdown_connections 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.842+0000 7f470415c740 1 --2- 172.21.15.18:0/1020545339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4f6d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.842+0000 7f470415c740 1 --2- 172.21.15.18:0/1020545339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f62b40 0x559bd4f68970 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.842+0000 7f470415c740 1 --2- 172.21.15.18:0/1020545339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f615d0 0x559bd4f78490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.842+0000 7f470415c740 1 -- 172.21.15.18:0/1020545339 >> 172.21.15.18:0/1020545339 conn(0x559bd4f2a310 msgr2=0x559bd4f63930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.842+0000 7f470415c740 1 -- 172.21.15.18:0/1020545339 shutdown_connections 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.842+0000 7f470415c740 1 -- 172.21.15.18:0/1020545339 wait complete. 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.842+0000 7f470415c740 1 -- start start 2024-09-19T09:53:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.842+0000 7f470415c740 1 Processor -- start 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f470415c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f615d0 0x559bd4f7d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f470415c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f62b40 0x559bd4f7dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f470415c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4fe5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f46faffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f62b40 0x559bd4f7dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f46faffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f62b40 0x559bd4f7dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55482/0 (socket says 172.21.15.18:55482) 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f470415c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc1b0b50 con 0x559bd4f62b40 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f470415c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc1b0480 con 0x559bd4f615d0 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f470415c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc1ad6e0 con 0x559bd4f6c370 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f470415c740 10 client.0 _ll_register_callbacks cb 0x7f46ec0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f46fb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f615d0 0x559bd4f7d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f46fb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f615d0 0x559bd4f7d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41462/0 (socket says 172.21.15.18:41462) 2024-09-19T09:53:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f46fb7fe640 1 -- 172.21.15.18:0/4009062539 learned_addr learned my addr 172.21.15.18:0/4009062539 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:39.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.843+0000 7f46fbfff640 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4fe5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.844+0000 7f46fb7fe640 1 -- 172.21.15.18:0/4009062539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 msgr2=0x559bd4fe5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.844+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4fe5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.844+0000 7f46fb7fe640 1 -- 172.21.15.18:0/4009062539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f62b40 msgr2=0x559bd4f7dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:39.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.844+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f62b40 0x559bd4f7dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.844+0000 7f46fb7fe640 1 -- 172.21.15.18:0/4009062539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bd4fe5d40 con 0x559bd4f615d0 2024-09-19T09:53:39.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.844+0000 7f46fb7fe640 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f615d0 0x559bd4f7d6c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009780 tx=0x7f46ec003da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9886112eb18e6c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:39.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.844+0000 7f46daffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.844+0000 7f46daffd640 1 -- 172.21.15.18:0/4009062539 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec05e060 con 0x559bd4f615d0 2024-09-19T09:53:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.844+0000 7f46daffd640 1 -- 172.21.15.18:0/4009062539 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f46ec0037f0 con 0x559bd4f615d0 2024-09-19T09:53:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.844+0000 7f470415c740 1 -- 172.21.15.18:0/4009062539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46f0015030 con 0x559bd4f615d0 2024-09-19T09:53:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.845+0000 7f46daffd640 1 -- 172.21.15.18:0/4009062539 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f46ec037050 con 0x559bd4f615d0 2024-09-19T09:53:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.845+0000 7f470415c740 10 client.25445 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.845+0000 7f470415c740 1 -- 172.21.15.18:0/4009062539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559bd4fe6f40 con 0x559bd4f615d0 2024-09-19T09:53:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.845+0000 7f46daffd640 1 -- 172.21.15.18:0/4009062539 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f0015030 con 0x559bd4f615d0 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.846+0000 7f46daffd640 1 -- 172.21.15.18:0/4009062539 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f46ec030cf0 con 0x559bd4f615d0 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.846+0000 7f470415c740 10 client.25445 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.846+0000 7f470415c740 10 client.25445 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.846+0000 7f470415c740 20 client.25445 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.846+0000 7f470415c740 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559bd4f7bed0 0x559bd4fe9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.846+0000 7f470415c740 4 client.25445 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.846+0000 7f470415c740 1 -- 172.21.15.18:0/4009062539 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559bd4ed4860 con 0x559bd4f7bed0 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.846+0000 7f46faffd640 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559bd4f7bed0 0x559bd4fe9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.846+0000 7f46daffd640 10 client.25445 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.846+0000 7f46faffd640 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559bd4f7bed0 0x559bd4fe9520 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15da0856634b0492 server_cookie=102c97137e32f861 in_seq=0 out_seq=0 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f46daffd640 1 -- 172.21.15.18:0/4009062539 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559bd4ed4860 con 0x559bd4f7bed0 2024-09-19T09:53:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f46daffd640 10 client.25445 handle_command_reply: tid=0 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 client.25445 shutdown 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 -- 172.21.15.18:0/4009062539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f615d0 msgr2=0x559bd4f7d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f615d0 0x559bd4f7d6c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009780 tx=0x7f46ec003da0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 -- 172.21.15.18:0/4009062539 shutdown_connections 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559bd4f7bed0 0x559bd4fe9520 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559bd4f6c370 0x559bd4fe5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559bd4f62b40 0x559bd4f7dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f46daffd640 0 client.25445 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 --2- 172.21.15.18:0/4009062539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bd4f615d0 0x559bd4f7d6c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 -- 172.21.15.18:0/4009062539 >> 172.21.15.18:0/4009062539 conn(0x559bd4f2a310 msgr2=0x559bd4f63110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 -- 172.21.15.18:0/4009062539 shutdown_connections 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 1 -- 172.21.15.18:0/4009062539 wait complete. 2024-09-19T09:53:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.847+0000 7f470415c740 20 client.25445 trim_cache size 0 max 16384 2024-09-19T09:53:39.853 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:39.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.848+0000 7f4701d83640 1 -- 172.21.15.18:0/4233201371 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46e40a32c0 msgr2=0x7f46e40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.848+0000 7f4701d83640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46e40a32c0 0x7f46e40a5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009590 tx=0x7f46f4004ab0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.848+0000 7f4701d83640 1 -- 172.21.15.18:0/4233201371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46fc102570 msgr2=0x7f46fc10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:39.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.848+0000 7f4701d83640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46fc102570 0x7f46fc10e890 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f46f000d950 tx=0x7f46f000de10 comp rx=0 tx=0).stop 2024-09-19T09:53:39.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.848+0000 7f4701d83640 1 -- 172.21.15.18:0/4233201371 shutdown_connections 2024-09-19T09:53:39.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.848+0000 7f4701d83640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46e40a32c0 0x7f46e40a5780 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.848+0000 7f4701d83640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46fc102ef0 0x7f46fc10edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.848+0000 7f4701d83640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46fc102570 0x7f46fc10e890 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.848+0000 7f4701d83640 1 --2- 172.21.15.18:0/4233201371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46fc100e20 0x7f46fc10e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:39.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.848+0000 7f4701d83640 1 -- 172.21.15.18:0/4233201371 >> 172.21.15.18:0/4233201371 conn(0x7f46fc0fc7d0 msgr2=0x7f46fc1048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:39.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.849+0000 7f4701d83640 1 -- 172.21.15.18:0/4233201371 shutdown_connections 2024-09-19T09:53:39.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:39.849+0000 7f4701d83640 1 -- 172.21.15.18:0/4233201371 wait complete. 2024-09-19T09:53:40.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:39 smithi018 ceph-mon[30956]: pgmap v378: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:53:40.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:39 smithi049 ceph-mon[34858]: pgmap v378: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:53:40.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:39 smithi162 ceph-mon[35174]: pgmap v378: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:53:40.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:53:40.969 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.383+0000 7f98bd3f8640 1 -- 172.21.15.18:0/3268359056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b8106f10 msgr2=0x7f98b810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.383+0000 7f98bd3f8640 1 --2- 172.21.15.18:0/3268359056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b8106f10 0x7f98b810ea90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009ca0 tx=0x7f98b002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.383+0000 7f98bd3f8640 1 -- 172.21.15.18:0/3268359056 shutdown_connections 2024-09-19T09:53:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.383+0000 7f98bd3f8640 1 --2- 172.21.15.18:0/3268359056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b8106f10 0x7f98b810ea90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.383+0000 7f98bd3f8640 1 --2- 172.21.15.18:0/3268359056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98b8102790 0x7f98b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.383+0000 7f98bd3f8640 1 --2- 172.21.15.18:0/3268359056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98b8101de0 0x7f98b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.383+0000 7f98bd3f8640 1 -- 172.21.15.18:0/3268359056 >> 172.21.15.18:0/3268359056 conn(0x7f98b80fd880 msgr2=0x7f98b80ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.383+0000 7f98bd3f8640 1 -- 172.21.15.18:0/3268359056 shutdown_connections 2024-09-19T09:53:41.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.383+0000 7f98bd3f8640 1 -- 172.21.15.18:0/3268359056 wait complete. 2024-09-19T09:53:41.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.384+0000 7f98bd3f8640 1 Processor -- start 2024-09-19T09:53:41.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.384+0000 7f98bd3f8640 1 -- start start 2024-09-19T09:53:41.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98bd3f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98b8101de0 0x7f98b81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98bd3f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b8102790 0x7f98b81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98bd3f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98b8106f10 0x7f98b819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98bd3f8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98b8111fc0 con 0x7f98b8102790 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98bd3f8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f98b8111e40 con 0x7f98b8101de0 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98bd3f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98b8112140 con 0x7f98b8106f10 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98b8101de0 0x7f98b81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b8102790 0x7f98b81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b8102790 0x7f98b81988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55498/0 (socket says 172.21.15.18:55498) 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b67fc640 1 -- 172.21.15.18:0/2724506903 learned_addr learned my addr 172.21.15.18:0/2724506903 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98b8101de0 0x7f98b81983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41478/0 (socket says 172.21.15.18:41478) 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b77fe640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98b8106f10 0x7f98b819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b6ffd640 1 -- 172.21.15.18:0/2724506903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98b8106f10 msgr2=0x7f98b819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b6ffd640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98b8106f10 0x7f98b819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b6ffd640 1 -- 172.21.15.18:0/2724506903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b8102790 msgr2=0x7f98b81988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b6ffd640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b8102790 0x7f98b81988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.385+0000 7f98b6ffd640 1 -- 172.21.15.18:0/2724506903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b819d350 con 0x7f98b8101de0 2024-09-19T09:53:41.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.386+0000 7f98b6ffd640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98b8101de0 0x7f98b81983a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98a800d6d0 tx=0x7f98a800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.386+0000 7f989ffff640 1 -- 172.21.15.18:0/2724506903 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8017070 con 0x7f98b8101de0 2024-09-19T09:53:41.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.386+0000 7f98bd3f8640 1 -- 172.21.15.18:0/2724506903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b819d640 con 0x7f98b8101de0 2024-09-19T09:53:41.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.386+0000 7f989ffff640 1 -- 172.21.15.18:0/2724506903 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a8009820 con 0x7f98b8101de0 2024-09-19T09:53:41.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.386+0000 7f98bd3f8640 1 -- 172.21.15.18:0/2724506903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b8074420 con 0x7f98b8101de0 2024-09-19T09:53:41.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.387+0000 7f989ffff640 1 -- 172.21.15.18:0/2724506903 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8004cd0 con 0x7f98b8101de0 2024-09-19T09:53:41.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.389+0000 7f98bf7d1740 1 Processor -- start 2024-09-19T09:53:41.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.389+0000 7f98bf7d1740 1 -- start start 2024-09-19T09:53:41.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.389+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d2944b40 0x55c8d2943090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.389+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d29435d0 0x55c8d2943a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.389+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 0x55c8d2950760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.389+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c8d28a92f0 con 0x55c8d29435d0 2024-09-19T09:53:41.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.389+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c8d2850cf0 con 0x55c8d294e370 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.389+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c8d28a52b0 con 0x55c8d2944b40 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d2944b40 0x55c8d2943090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d2944b40 0x55c8d2943090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54872/0 (socket says 172.21.15.18:54872) 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b77fe640 1 -- 172.21.15.18:0/1915380923 learned_addr learned my addr 172.21.15.18:0/1915380923 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f989ffff640 1 -- 172.21.15.18:0/2724506903 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f98a80099d0 con 0x7f98b8101de0 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b6ffd640 1 --2- 172.21.15.18:0/1915380923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d29435d0 0x55c8d2943a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b67fc640 1 --2- 172.21.15.18:0/1915380923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 0x55c8d2950760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b77fe640 1 -- 172.21.15.18:0/1915380923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 msgr2=0x55c8d2950760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b77fe640 1 --2- 172.21.15.18:0/1915380923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 0x55c8d2950760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b77fe640 1 -- 172.21.15.18:0/1915380923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d29435d0 msgr2=0x55c8d2943a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b77fe640 1 --2- 172.21.15.18:0/1915380923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d29435d0 0x55c8d2943a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b77fe640 1 -- 172.21.15.18:0/1915380923 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8d28353a0 con 0x55c8d2944b40 2024-09-19T09:53:41.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.390+0000 7f98b6ffd640 1 --2- 172.21.15.18:0/1915380923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d29435d0 0x55c8d2943a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:41.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.391+0000 7f98b77fe640 1 --2- 172.21.15.18:0/1915380923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d2944b40 0x55c8d2943090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98b002aeb0 tx=0x7f98b002f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b41bd0becbdeda26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.391+0000 7f989ffff640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98a00a34c0 0x7f98a00a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.391+0000 7f989d7fa640 1 -- 172.21.15.18:0/1915380923 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b0003970 con 0x55c8d2944b40 2024-09-19T09:53:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.391+0000 7f989ffff640 1 -- 172.21.15.18:0/2724506903 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f98a8004a70 con 0x7f98b8101de0 2024-09-19T09:53:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.391+0000 7f989d7fa640 1 -- 172.21.15.18:0/1915380923 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98b0036030 con 0x55c8d2944b40 2024-09-19T09:53:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.391+0000 7f98b6ffd640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98a00a34c0 0x7f98a00a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.392+0000 7f989d7fa640 1 -- 172.21.15.18:0/1915380923 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b0004460 con 0x55c8d2944b40 2024-09-19T09:53:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.392+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1915380923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d2944b40 msgr2=0x55c8d2943090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.392+0000 7f98b6ffd640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98a00a34c0 0x7f98a00a5980 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f98a8097b70 tx=0x7f98a80057f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.392+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/1915380923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d2944b40 0x55c8d2943090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98b002aeb0 tx=0x7f98b002f3c0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.392+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1915380923 shutdown_connections 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.392+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/1915380923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 0x55c8d2950760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.392+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/1915380923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d29435d0 0x55c8d2943a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.392+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/1915380923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d2944b40 0x55c8d2943090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.392+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1915380923 >> 172.21.15.18:0/1915380923 conn(0x55c8d290c310 msgr2=0x55c8d293fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.392+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1915380923 shutdown_connections 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.393+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1915380923 wait complete. 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.393+0000 7f98bf7d1740 1 -- start start 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.393+0000 7f98bf7d1740 1 Processor -- start 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.393+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d29435d0 0x55c8d294dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.393+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 0x55c8d294afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.393+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 0x55c8d294b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.393+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c8d29596a0 con 0x55c8d2944b40 2024-09-19T09:53:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.393+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c8d2864060 con 0x55c8d294e370 2024-09-19T09:53:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.393+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c8d2959820 con 0x55c8d29435d0 2024-09-19T09:53:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.393+0000 7f98bf7d1740 10 client.0 _ll_register_callbacks cb 0x55c8d25b78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 0x55c8d294b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d29435d0 0x55c8d294dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 0x55c8d294b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41492/0 (socket says 172.21.15.18:41492) 2024-09-19T09:53:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b77fe640 1 -- 172.21.15.18:0/1967101885 learned_addr learned my addr 172.21.15.18:0/1967101885 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b67fc640 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 0x55c8d294afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b77fe640 1 -- 172.21.15.18:0/1967101885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d29435d0 msgr2=0x55c8d294dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b77fe640 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d29435d0 0x55c8d294dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b77fe640 1 -- 172.21.15.18:0/1967101885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 msgr2=0x55c8d294afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b77fe640 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 0x55c8d294afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b77fe640 1 -- 172.21.15.18:0/1967101885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8d261a3c0 con 0x55c8d294e370 2024-09-19T09:53:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f98b77fe640 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 0x55c8d294b520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98b002ade0 tx=0x7f98b0004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a3f48da58accfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f989aff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f989aff5640 1 -- 172.21.15.18:0/1967101885 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b004a040 con 0x55c8d294e370 2024-09-19T09:53:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.394+0000 7f989aff5640 1 -- 172.21.15.18:0/1967101885 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f98b00041e0 con 0x55c8d294e370 2024-09-19T09:53:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1967101885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98b0036030 con 0x55c8d294e370 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f989aff5640 1 -- 172.21.15.18:0/1967101885 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f98b0003e40 con 0x55c8d294e370 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f98bf7d1740 10 client.25454 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1967101885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8d29596a0 con 0x55c8d294e370 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f989aff5640 1 -- 172.21.15.18:0/1967101885 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98b0036030 con 0x55c8d294e370 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f989aff5640 1 -- 172.21.15.18:0/1967101885 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f98b0043070 con 0x55c8d294e370 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f98bf7d1740 10 client.25454 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f98bf7d1740 10 client.25454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f98bf7d1740 20 client.25454 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c8d2966260 0x55c8d2968650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f98bf7d1740 4 client.25454 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.395+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1967101885 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8d28b6860 con 0x55c8d2966260 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.396+0000 7f98b67fc640 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c8d2966260 0x55c8d2968650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.396+0000 7f989aff5640 10 client.25454 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.396+0000 7f98b67fc640 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c8d2966260 0x55c8d2968650 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1000a03072277196 server_cookie=d95c56c9151d608c in_seq=0 out_seq=0 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f989aff5640 1 -- 172.21.15.18:0/1967101885 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8d28b6860 con 0x55c8d2966260 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f989aff5640 10 client.25454 handle_command_reply: tid=0 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f98bf7d1740 1 client.25454 shutdown 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1967101885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 msgr2=0x55c8d294b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 0x55c8d294b520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98b002ade0 tx=0x7f98b0004040 comp rx=0 tx=0).stop 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1967101885 shutdown_connections 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c8d2966260 0x55c8d2968650 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d294e370 0x55c8d294b520 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 0x55c8d294afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/1967101885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d29435d0 0x55c8d294dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1967101885 >> 172.21.15.18:0/1967101885 conn(0x55c8d290c310 msgr2=0x55c8d2945960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.397+0000 7f989aff5640 0 client.25454 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:41.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.398+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1967101885 shutdown_connections 2024-09-19T09:53:41.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.398+0000 7f98bf7d1740 1 -- 172.21.15.18:0/1967101885 wait complete. 2024-09-19T09:53:41.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.398+0000 7f98bf7d1740 20 client.25454 trim_cache size 0 max 16384 2024-09-19T09:53:41.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.411+0000 7f98bf7d1740 1 Processor -- start 2024-09-19T09:53:41.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.411+0000 7f98bf7d1740 1 -- start start 2024-09-19T09:53:41.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.411+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d29435d0 0x55c8d29629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.411+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 0x55c8d293f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.411+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d294e370 0x55c8d293fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.411+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98b81ab2c0 con 0x55c8d2944b40 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.411+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f98b81ace00 con 0x55c8d29435d0 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.411+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98b81ab990 con 0x55c8d294e370 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d29435d0 0x55c8d29629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 0x55c8d293f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d294e370 0x55c8d293fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 0x55c8d293f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55528/0 (socket says 172.21.15.18:55528) 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b67fc640 1 -- 172.21.15.18:0/203305625 learned_addr learned my addr 172.21.15.18:0/203305625 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b67fc640 1 -- 172.21.15.18:0/203305625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d294e370 msgr2=0x55c8d293fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b67fc640 1 --2- 172.21.15.18:0/203305625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d294e370 0x55c8d293fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b67fc640 1 -- 172.21.15.18:0/203305625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d29435d0 msgr2=0x55c8d29629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b67fc640 1 --2- 172.21.15.18:0/203305625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d29435d0 0x55c8d29629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b67fc640 1 -- 172.21.15.18:0/203305625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8d294b870 con 0x55c8d2944b40 2024-09-19T09:53:41.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.412+0000 7f98b67fc640 1 --2- 172.21.15.18:0/203305625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 0x55c8d293f4f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f98b8106820 tx=0x7f98ac00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298ddeb31bf8a6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.413+0000 7f989cff9640 1 -- 172.21.15.18:0/203305625 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac004b60 con 0x55c8d2944b40 2024-09-19T09:53:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.413+0000 7f989cff9640 1 -- 172.21.15.18:0/203305625 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98ac01f020 con 0x55c8d2944b40 2024-09-19T09:53:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.413+0000 7f989cff9640 1 -- 172.21.15.18:0/203305625 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac003d30 con 0x55c8d2944b40 2024-09-19T09:53:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.413+0000 7f98bf7d1740 1 -- 172.21.15.18:0/203305625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 msgr2=0x55c8d293f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.413+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/203305625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 0x55c8d293f4f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f98b8106820 tx=0x7f98ac00b480 comp rx=0 tx=0).stop 2024-09-19T09:53:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.414+0000 7f98bf7d1740 1 -- 172.21.15.18:0/203305625 shutdown_connections 2024-09-19T09:53:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.414+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/203305625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d294e370 0x55c8d293fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.414+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/203305625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d2944b40 0x55c8d293f4f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.414+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/203305625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d29435d0 0x55c8d29629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.414+0000 7f98bf7d1740 1 -- 172.21.15.18:0/203305625 >> 172.21.15.18:0/203305625 conn(0x55c8d290c310 msgr2=0x55c8d294d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.414+0000 7f98bf7d1740 1 -- 172.21.15.18:0/203305625 shutdown_connections 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.414+0000 7f98bf7d1740 1 -- 172.21.15.18:0/203305625 wait complete. 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.414+0000 7f98bf7d1740 1 -- start start 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.414+0000 7f98bf7d1740 1 Processor -- start 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d29435d0 0x55c8d295f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d2944b40 0x55c8d295a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98bf7d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d294e370 0x55c8d295acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98b81ac730 con 0x55c8d294e370 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f98b81ac060 con 0x55c8d2944b40 2024-09-19T09:53:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98bf7d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98b81a92c0 con 0x55c8d29435d0 2024-09-19T09:53:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98bf7d1740 10 client.0 _ll_register_callbacks cb 0x7f98b002f310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98b77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d294e370 0x55c8d295acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98b67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d2944b40 0x55c8d295a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98b67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d2944b40 0x55c8d295a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41512/0 (socket says 172.21.15.18:41512) 2024-09-19T09:53:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98b67fc640 1 -- 172.21.15.18:0/3706845366 learned_addr learned my addr 172.21.15.18:0/3706845366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98b77fe640 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d29435d0 0x55c8d295f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98b67fc640 1 -- 172.21.15.18:0/3706845366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d29435d0 msgr2=0x55c8d295f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98b67fc640 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d29435d0 0x55c8d295f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98b67fc640 1 -- 172.21.15.18:0/3706845366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d294e370 msgr2=0x55c8d295acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98b67fc640 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d294e370 0x55c8d295acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.415+0000 7f98b67fc640 1 -- 172.21.15.18:0/3706845366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8d295b4b0 con 0x55c8d2944b40 2024-09-19T09:53:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.416+0000 7f98b77fe640 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d294e370 0x55c8d295acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.416+0000 7f98b67fc640 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d2944b40 0x55c8d295a6c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00bcd0 tx=0x7f98ac005c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37cc8702ca364c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.416+0000 7f989aff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:53:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.416+0000 7f989aff5640 1 -- 172.21.15.18:0/3706845366 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac004d60 con 0x55c8d2944b40 2024-09-19T09:53:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.416+0000 7f98bf7d1740 1 -- 172.21.15.18:0/3706845366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98ac01f020 con 0x55c8d2944b40 2024-09-19T09:53:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.416+0000 7f989aff5640 1 -- 172.21.15.18:0/3706845366 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f98ac012450 con 0x55c8d2944b40 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.417+0000 7f989aff5640 1 -- 172.21.15.18:0/3706845366 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f98ac012650 con 0x55c8d2944b40 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.417+0000 7f98bf7d1740 10 client.25460 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.417+0000 7f98bf7d1740 1 -- 172.21.15.18:0/3706845366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8d29d0f80 con 0x55c8d2944b40 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.417+0000 7f989aff5640 1 -- 172.21.15.18:0/3706845366 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98ac01f020 con 0x55c8d2944b40 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.417+0000 7f989aff5640 1 -- 172.21.15.18:0/3706845366 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f98ac024a00 con 0x55c8d2944b40 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.417+0000 7f98bf7d1740 10 client.25460 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.417+0000 7f98bf7d1740 10 client.25460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.417+0000 7f98bf7d1740 20 client.25460 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.417+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c8d29d16d0 0x55c8d29d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.418+0000 7f98bf7d1740 4 client.25460 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.418+0000 7f98bf7d1740 1 -- 172.21.15.18:0/3706845366 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8d28b0d70 con 0x55c8d29d16d0 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.418+0000 7f98b77fe640 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c8d29d16d0 0x55c8d29d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.418+0000 7f989aff5640 10 client.25460 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.418+0000 7f98b77fe640 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c8d29d16d0 0x55c8d29d3af0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=535334d9aa19ef70 server_cookie=7b17253eecc1c7b7 in_seq=0 out_seq=0 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f989aff5640 1 -- 172.21.15.18:0/3706845366 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8d28b0d70 con 0x55c8d29d16d0 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f989aff5640 10 client.25460 handle_command_reply: tid=0 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f98bf7d1740 1 client.25460 shutdown 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f98bf7d1740 1 -- 172.21.15.18:0/3706845366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d2944b40 msgr2=0x55c8d295a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d2944b40 0x55c8d295a6c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00bcd0 tx=0x7f98ac005c20 comp rx=0 tx=0).stop 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f98bf7d1740 1 -- 172.21.15.18:0/3706845366 shutdown_connections 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c8d29d16d0 0x55c8d29d3af0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8d294e370 0x55c8d295acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c8d2944b40 0x55c8d295a6c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f989aff5640 0 client.25460 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f98bf7d1740 1 --2- 172.21.15.18:0/3706845366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c8d29435d0 0x55c8d295f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.419+0000 7f98bf7d1740 1 -- 172.21.15.18:0/3706845366 >> 172.21.15.18:0/3706845366 conn(0x55c8d290c310 msgr2=0x55c8d294a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.420+0000 7f98bf7d1740 1 -- 172.21.15.18:0/3706845366 shutdown_connections 2024-09-19T09:53:41.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.420+0000 7f98bf7d1740 1 -- 172.21.15.18:0/3706845366 wait complete. 2024-09-19T09:53:41.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.420+0000 7f98bf7d1740 20 client.25460 trim_cache size 0 max 16384 2024-09-19T09:53:41.425 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 -- 172.21.15.18:0/2724506903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98a00a34c0 msgr2=0x7f98a00a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98a00a34c0 0x7f98a00a5980 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f98a8097b70 tx=0x7f98a80057f0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 -- 172.21.15.18:0/2724506903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98b8101de0 msgr2=0x7f98b81983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98b8101de0 0x7f98b81983a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98a800d6d0 tx=0x7f98a800db90 comp rx=0 tx=0).stop 2024-09-19T09:53:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 -- 172.21.15.18:0/2724506903 shutdown_connections 2024-09-19T09:53:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98a00a34c0 0x7f98a00a5980 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98b8106f10 0x7f98b819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b8102790 0x7f98b81988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 --2- 172.21.15.18:0/2724506903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98b8101de0 0x7f98b81983a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 -- 172.21.15.18:0/2724506903 >> 172.21.15.18:0/2724506903 conn(0x7f98b80fd880 msgr2=0x7f98b80fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 -- 172.21.15.18:0/2724506903 shutdown_connections 2024-09-19T09:53:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:41.421+0000 7f98bd3f8640 1 -- 172.21.15.18:0/2724506903 wait complete. 2024-09-19T09:53:42.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:41 smithi018 ceph-mon[30956]: pgmap v379: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 767 B/s wr, 14 op/s 2024-09-19T09:53:42.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:41 smithi049 ceph-mon[34858]: pgmap v379: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 767 B/s wr, 14 op/s 2024-09-19T09:53:42.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:41 smithi162 ceph-mon[35174]: pgmap v379: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 767 B/s wr, 14 op/s 2024-09-19T09:53:43.336 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:53:43.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:53:43.622 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:44.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:43 smithi018 ceph-mon[30956]: pgmap v380: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T09:53:44.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.068+0000 7f9c69b45640 1 -- 172.21.15.18:0/509255298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641082e0 msgr2=0x7f9c6410ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.068+0000 7f9c69b45640 1 --2- 172.21.15.18:0/509255298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641082e0 0x7f9c6410ec50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009cd0 tx=0x7f9c5c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.068+0000 7f9c69b45640 1 -- 172.21.15.18:0/509255298 shutdown_connections 2024-09-19T09:53:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.068+0000 7f9c69b45640 1 --2- 172.21.15.18:0/509255298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641082e0 0x7f9c6410ec50 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.068+0000 7f9c69b45640 1 --2- 172.21.15.18:0/509255298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64103760 0x7f9c64107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.068+0000 7f9c69b45640 1 --2- 172.21.15.18:0/509255298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64102db0 0x7f9c64103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.068+0000 7f9c69b45640 1 -- 172.21.15.18:0/509255298 >> 172.21.15.18:0/509255298 conn(0x7f9c640fc7d0 msgr2=0x7f9c640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.069+0000 7f9c69b45640 1 -- 172.21.15.18:0/509255298 shutdown_connections 2024-09-19T09:53:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.069+0000 7f9c69b45640 1 -- 172.21.15.18:0/509255298 wait complete. 2024-09-19T09:53:44.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.069+0000 7f9c69b45640 1 Processor -- start 2024-09-19T09:53:44.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c69b45640 1 -- start start 2024-09-19T09:53:44.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c69b45640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64102db0 0x7f9c64100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c69b45640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64103760 0x7f9c64100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c69b45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641082e0 0x7f9c64101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c62ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64103760 0x7f9c64100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c63fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641082e0 0x7f9c64101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c62ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64103760 0x7f9c64100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41524/0 (socket says 172.21.15.18:41524) 2024-09-19T09:53:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c63fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641082e0 0x7f9c64101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55564/0 (socket says 172.21.15.18:55564) 2024-09-19T09:53:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c62ffd640 1 -- 172.21.15.18:0/1555572225 learned_addr learned my addr 172.21.15.18:0/1555572225 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641120b0 con 0x7f9c641082e0 2024-09-19T09:53:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64111f30 con 0x7f9c64103760 2024-09-19T09:53:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.070+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64112230 con 0x7f9c64102db0 2024-09-19T09:53:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.071+0000 7f9c63fff640 1 -- 172.21.15.18:0/1555572225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64102db0 msgr2=0x7f9c64100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.071+0000 7f9c63fff640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64102db0 0x7f9c64100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.071+0000 7f9c63fff640 1 -- 172.21.15.18:0/1555572225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64103760 msgr2=0x7f9c64100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:44.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.071+0000 7f9c63fff640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64103760 0x7f9c64100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.071+0000 7f9c63fff640 1 -- 172.21.15.18:0/1555572225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c641a6a00 con 0x7f9c641082e0 2024-09-19T09:53:44.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.071+0000 7f9c63fff640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641082e0 0x7f9c64101490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c02ae00 tx=0x7f9c5c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:44.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.072+0000 7f9c60ff9640 1 -- 172.21.15.18:0/1555572225 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c004040 con 0x7f9c641082e0 2024-09-19T09:53:44.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.072+0000 7f9c60ff9640 1 -- 172.21.15.18:0/1555572225 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c5c0046c0 con 0x7f9c641082e0 2024-09-19T09:53:44.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.072+0000 7f9c60ff9640 1 -- 172.21.15.18:0/1555572225 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c030ea0 con 0x7f9c641082e0 2024-09-19T09:53:44.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.072+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c641a6c90 con 0x7f9c641082e0 2024-09-19T09:53:44.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.072+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c641a7160 con 0x7f9c641082e0 2024-09-19T09:53:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.075+0000 7f9c6bf1e740 1 Processor -- start 2024-09-19T09:53:44.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.075+0000 7f9c60ff9640 1 -- 172.21.15.18:0/1555572225 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9c5c0305a0 con 0x7f9c641082e0 2024-09-19T09:53:44.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.076+0000 7f9c6bf1e740 1 -- start start 2024-09-19T09:53:44.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.076+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x563434729750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.076+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x563434734010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.076+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434734550 0x563434736940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.076+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563434686280 con 0x563434729c90 2024-09-19T09:53:44.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.076+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56343462db10 con 0x563434729370 2024-09-19T09:53:44.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.076+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563434682240 con 0x563434734550 2024-09-19T09:53:44.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x563434734010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x563434734010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55570/0 (socket says 172.21.15.18:55570) 2024-09-19T09:53:44.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c637fe640 1 -- 172.21.15.18:0/1824510974 learned_addr learned my addr 172.21.15.18:0/1824510974 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:44.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c60ff9640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 0x7f9c4c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/1824510974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x563434729750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c60ff9640 1 -- 172.21.15.18:0/1555572225 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9c5c02e030 con 0x7f9c641082e0 2024-09-19T09:53:44.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c637fe640 1 -- 172.21.15.18:0/1824510974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434734550 msgr2=0x563434736940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:53:44.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c637fe640 1 --2- 172.21.15.18:0/1824510974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434734550 0x563434736940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c637fe640 1 -- 172.21.15.18:0/1824510974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 msgr2=0x563434729750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c637fe640 1 --2- 172.21.15.18:0/1824510974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x563434729750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c637fe640 1 -- 172.21.15.18:0/1824510974 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56343463a1f0 con 0x563434729c90 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c63fff640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 0x7f9c4c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/1824510974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x563434729750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.077+0000 7f9c637fe640 1 --2- 172.21.15.18:0/1824510974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x563434734010 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009c40 tx=0x7f9c5400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921a3fd72a43da8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.078+0000 7f9c49ffb640 1 -- 172.21.15.18:0/1824510974 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54005020 con 0x563434729c90 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.078+0000 7f9c63fff640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 0x7f9c4c0a5780 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0c5630 tx=0x7f9c5c02a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.078+0000 7f9c49ffb640 1 -- 172.21.15.18:0/1824510974 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c540047a0 con 0x563434729c90 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.078+0000 7f9c49ffb640 1 -- 172.21.15.18:0/1824510974 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54010720 con 0x563434729c90 2024-09-19T09:53:44.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.079+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/1824510974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 msgr2=0x563434734010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.079+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/1824510974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x563434734010 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009c40 tx=0x7f9c5400e720 comp rx=0 tx=0).stop 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.079+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/1824510974 shutdown_connections 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.079+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/1824510974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434734550 0x563434736940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.079+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/1824510974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x563434734010 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.079+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/1824510974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x563434729750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.079+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/1824510974 >> 172.21.15.18:0/1824510974 conn(0x563434725900 msgr2=0x563434725ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.079+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/1824510974 shutdown_connections 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.079+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/1824510974 wait complete. 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.079+0000 7f9c6bf1e740 1 -- start start 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c6bf1e740 1 Processor -- start 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729370 0x563434731470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434729c90 0x5634347319b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434734550 0x563434731ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563434737120 con 0x563434729370 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563434640f10 con 0x563434734550 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5634347372a0 con 0x563434729c90 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c62ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729370 0x563434731470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c62ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729370 0x563434731470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55584/0 (socket says 172.21.15.18:55584) 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c62ffd640 1 -- 172.21.15.18:0/4234576053 learned_addr learned my addr 172.21.15.18:0/4234576053 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434734550 0x563434731ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c6bf1e740 10 client.0 _ll_register_callbacks cb 0x563434609a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c62ffd640 1 -- 172.21.15.18:0/4234576053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434729c90 msgr2=0x5634347319b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434729c90 0x5634347319b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c62ffd640 1 -- 172.21.15.18:0/4234576053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434734550 msgr2=0x563434731ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.080+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434734550 0x563434731ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.081+0000 7f9c62ffd640 1 -- 172.21.15.18:0/4234576053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634343f76a0 con 0x563434729370 2024-09-19T09:53:44.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.081+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729370 0x563434731470 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800bdf0 tx=0x7f9c58005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190a8be722a442c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:44.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.081+0000 7f9c42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:44.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.081+0000 7f9c42ffd640 1 -- 172.21.15.18:0/4234576053 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c580107e0 con 0x563434729370 2024-09-19T09:53:44.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.081+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/4234576053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c540047a0 con 0x563434729370 2024-09-19T09:53:44.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.081+0000 7f9c42ffd640 1 -- 172.21.15.18:0/4234576053 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9c58010980 con 0x563434729370 2024-09-19T09:53:44.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.081+0000 7f9c42ffd640 1 -- 172.21.15.18:0/4234576053 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9c58010b80 con 0x563434729370 2024-09-19T09:53:44.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.081+0000 7f9c6bf1e740 10 client.15813 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.082+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/4234576053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563434742d10 con 0x563434729370 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.082+0000 7f9c42ffd640 1 -- 172.21.15.18:0/4234576053 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c540047a0 con 0x563434729370 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.082+0000 7f9c42ffd640 1 -- 172.21.15.18:0/4234576053 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9c5801f430 con 0x563434729370 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.082+0000 7f9c6bf1e740 10 client.15813 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.082+0000 7f9c6bf1e740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.082+0000 7f9c6bf1e740 20 client.15813 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.082+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5634347445e0 0x563434746a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.082+0000 7f9c6bf1e740 4 client.15813 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.082+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/4234576053 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634346937f0 con 0x5634347445e0 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.083+0000 7f9c637fe640 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5634347445e0 0x563434746a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.083+0000 7f9c637fe640 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5634347445e0 0x563434746a20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ebdc4e9bea073e4 server_cookie=f27b13bf12b23d12 in_seq=0 out_seq=0 2024-09-19T09:53:44.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.083+0000 7f9c42ffd640 10 client.15813 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c42ffd640 1 -- 172.21.15.18:0/4234576053 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634346937f0 con 0x5634347445e0 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c42ffd640 10 client.15813 handle_command_reply: tid=0 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 client.15813 shutdown 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/4234576053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729370 msgr2=0x563434731470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729370 0x563434731470 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800bdf0 tx=0x7f9c58005850 comp rx=0 tx=0).stop 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/4234576053 shutdown_connections 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5634347445e0 0x563434746a20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434734550 0x563434731ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434729c90 0x5634347319b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/4234576053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729370 0x563434731470 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c42ffd640 0 client.15813 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/4234576053 >> 172.21.15.18:0/4234576053 conn(0x563434725900 msgr2=0x56343471c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/4234576053 shutdown_connections 2024-09-19T09:53:44.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/4234576053 wait complete. 2024-09-19T09:53:44.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.084+0000 7f9c6bf1e740 20 client.15813 trim_cache size 0 max 16384 2024-09-19T09:53:44.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c6bf1e740 1 Processor -- start 2024-09-19T09:53:44.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c6bf1e740 1 -- start start 2024-09-19T09:53:44.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x56343471c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x56343474c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434734550 0x56343474c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641ab300 con 0x563434729c90 2024-09-19T09:53:44.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641ace40 con 0x563434729370 2024-09-19T09:53:44.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641ab9d0 con 0x563434734550 2024-09-19T09:53:44.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x56343474c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x56343474c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55586/0 (socket says 172.21.15.18:55586) 2024-09-19T09:53:44.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c637fe640 1 -- 172.21.15.18:0/1711011776 learned_addr learned my addr 172.21.15.18:0/1711011776 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:44.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/1711011776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x56343471c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.102+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/1711011776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434734550 0x56343474c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.103+0000 7f9c637fe640 1 -- 172.21.15.18:0/1711011776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434734550 msgr2=0x56343474c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:44.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.103+0000 7f9c637fe640 1 --2- 172.21.15.18:0/1711011776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434734550 0x56343474c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.103+0000 7f9c637fe640 1 -- 172.21.15.18:0/1711011776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 msgr2=0x56343471c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:44.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.103+0000 7f9c637fe640 1 --2- 172.21.15.18:0/1711011776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x56343471c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.103+0000 7f9c637fe640 1 -- 172.21.15.18:0/1711011776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563434730420 con 0x563434729c90 2024-09-19T09:53:44.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.103+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/1711011776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434734550 0x56343474c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:44.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.103+0000 7f9c637fe640 1 --2- 172.21.15.18:0/1711011776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x56343474c330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9c540058c0 tx=0x7f9c54009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353e8a5ce4e24fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:44.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.103+0000 7f9c497fa640 1 -- 172.21.15.18:0/1711011776 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54027070 con 0x563434729c90 2024-09-19T09:53:44.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.103+0000 7f9c497fa640 1 -- 172.21.15.18:0/1711011776 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c54004520 con 0x563434729c90 2024-09-19T09:53:44.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.103+0000 7f9c497fa640 1 -- 172.21.15.18:0/1711011776 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5401d040 con 0x563434729c90 2024-09-19T09:53:44.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.104+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/1711011776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 msgr2=0x56343474c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:44.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.104+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/1711011776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x56343474c330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9c540058c0 tx=0x7f9c54009590 comp rx=0 tx=0).stop 2024-09-19T09:53:44.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.104+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/1711011776 shutdown_connections 2024-09-19T09:53:44.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.104+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/1711011776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434734550 0x56343474c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.104+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/1711011776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434729c90 0x56343474c330 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.104+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/1711011776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x56343471c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.104+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/1711011776 >> 172.21.15.18:0/1711011776 conn(0x563434725900 msgr2=0x56343471ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.104+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/1711011776 shutdown_connections 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.104+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/1711011776 wait complete. 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.104+0000 7f9c6bf1e740 1 -- start start 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c6bf1e740 1 Processor -- start 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x56343473cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434729c90 0x563434738030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c6bf1e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434734550 0x563434738590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641ac770 con 0x563434734550 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641ac0a0 con 0x563434729370 2024-09-19T09:53:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c6bf1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641a9300 con 0x563434729c90 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c6bf1e740 10 client.0 _ll_register_callbacks cb 0x7f9c58004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c62ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434734550 0x563434738590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c62ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434734550 0x563434738590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55588/0 (socket says 172.21.15.18:55588) 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c62ffd640 1 -- 172.21.15.18:0/892006987 learned_addr learned my addr 172.21.15.18:0/892006987 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x56343473cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.105+0000 7f9c637fe640 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434729c90 0x563434738030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c62ffd640 1 -- 172.21.15.18:0/892006987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434729c90 msgr2=0x563434738030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434729c90 0x563434738030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c62ffd640 1 -- 172.21.15.18:0/892006987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 msgr2=0x56343473cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x56343473cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c62ffd640 1 -- 172.21.15.18:0/892006987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563434729ac0 con 0x563434734550 2024-09-19T09:53:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434734550 0x563434738590 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9c5801fa90 tx=0x7f9c5800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18df46f871dc087f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c42ffd640 1 -- 172.21.15.18:0/892006987 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58035020 con 0x563434734550 2024-09-19T09:53:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c42ffd640 1 -- 172.21.15.18:0/892006987 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9c580105e0 con 0x563434734550 2024-09-19T09:53:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/892006987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c54004520 con 0x563434734550 2024-09-19T09:53:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c42ffd640 1 -- 172.21.15.18:0/892006987 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9c58010e80 con 0x563434734550 2024-09-19T09:53:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c6bf1e740 10 client.15819 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.106+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/892006987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5634347af1f0 con 0x563434734550 2024-09-19T09:53:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.107+0000 7f9c42ffd640 1 -- 172.21.15.18:0/892006987 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c54004520 con 0x563434734550 2024-09-19T09:53:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.107+0000 7f9c42ffd640 1 -- 172.21.15.18:0/892006987 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9c5802fbd0 con 0x563434734550 2024-09-19T09:53:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.107+0000 7f9c6bf1e740 10 client.15819 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.107+0000 7f9c6bf1e740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.107+0000 7f9c6bf1e740 20 client.15819 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.107+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5634347af850 0x5634347b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.107+0000 7f9c6bf1e740 4 client.15819 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:53:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.107+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/892006987 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56343468dd00 con 0x5634347af850 2024-09-19T09:53:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.107+0000 7f9c637fe640 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5634347af850 0x5634347b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.108+0000 7f9c637fe640 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5634347af850 0x5634347b1c40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b867c0bf65a28033 server_cookie=444b89c9e5593d65 in_seq=0 out_seq=0 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.108+0000 7f9c42ffd640 10 client.15819 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c42ffd640 1 -- 172.21.15.18:0/892006987 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56343468dd00 con 0x5634347af850 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c42ffd640 10 client.15819 handle_command_reply: tid=0 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c6bf1e740 1 client.15819 shutdown 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/892006987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434734550 msgr2=0x563434738590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434734550 0x563434738590 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9c5801fa90 tx=0x7f9c5800b820 comp rx=0 tx=0).stop 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/892006987 shutdown_connections 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5634347af850 0x5634347b1c40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563434734550 0x563434738590 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563434729c90 0x563434738030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c6bf1e740 1 --2- 172.21.15.18:0/892006987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563434729370 0x56343473cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/892006987 >> 172.21.15.18:0/892006987 conn(0x563434725900 msgr2=0x56343471c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:44.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.109+0000 7f9c42ffd640 0 client.15819 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:44.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.110+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/892006987 shutdown_connections 2024-09-19T09:53:44.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.110+0000 7f9c6bf1e740 1 -- 172.21.15.18:0/892006987 wait complete. 2024-09-19T09:53:44.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.110+0000 7f9c6bf1e740 20 client.15819 trim_cache size 0 max 16384 2024-09-19T09:53:44.116 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:53:44.116 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T09:53:44.116 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "9208b737-f795-4bdc-99b7-81e7fdd6dd2c", 2024-09-19T09:53:44.116 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T09:53:44.116 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:53:44.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.111+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 msgr2=0x7f9c4c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:44.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.111+0000 7f9c69b45640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 0x7f9c4c0a5780 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0c5630 tx=0x7f9c5c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.111+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641082e0 msgr2=0x7f9c64101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:44.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.111+0000 7f9c69b45640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641082e0 0x7f9c64101490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c02ae00 tx=0x7f9c5c003ba0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.111+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 shutdown_connections 2024-09-19T09:53:44.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.111+0000 7f9c69b45640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 0x7f9c4c0a5780 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.111+0000 7f9c69b45640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641082e0 0x7f9c64101490 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.111+0000 7f9c69b45640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64103760 0x7f9c64100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.111+0000 7f9c69b45640 1 --2- 172.21.15.18:0/1555572225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64102db0 0x7f9c64100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:44.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.111+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 >> 172.21.15.18:0/1555572225 conn(0x7f9c640fc7d0 msgr2=0x7f9c64105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:44.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.112+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 shutdown_connections 2024-09-19T09:53:44.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:44.112+0000 7f9c69b45640 1 -- 172.21.15.18:0/1555572225 wait complete. 2024-09-19T09:53:44.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:43 smithi049 ceph-mon[34858]: pgmap v380: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T09:53:44.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:43 smithi162 ceph-mon[35174]: pgmap v380: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T09:53:44.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:53:45.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:44 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T09:53:45.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:44 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:45.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:44 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T09:53:45.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:44 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:45.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:44 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T09:53:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:44 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T09:53:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:44 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:44 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T09:53:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:44 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:44 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T09:53:45.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:44 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T09:53:45.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:44 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:45.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:44 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T09:53:45.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:44 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:53:45.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:44 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T09:53:45.340 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:45.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.841+0000 7fdc76d11640 1 -- 172.21.15.18:0/3729986540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc70102ef0 msgr2=0x7fdc7010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.841+0000 7fdc76d11640 1 --2- 172.21.15.18:0/3729986540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc70102ef0 0x7fdc7010da40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009ca0 tx=0x7fdc6802a950 comp rx=0 tx=0).stop 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.841+0000 7fdc76d11640 1 -- 172.21.15.18:0/3729986540 shutdown_connections 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.841+0000 7fdc76d11640 1 --2- 172.21.15.18:0/3729986540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc70102ef0 0x7fdc7010da40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.841+0000 7fdc76d11640 1 --2- 172.21.15.18:0/3729986540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc70102570 0x7fdc701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.841+0000 7fdc76d11640 1 --2- 172.21.15.18:0/3729986540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc70100e20 0x7fdc70101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.841+0000 7fdc76d11640 1 -- 172.21.15.18:0/3729986540 >> 172.21.15.18:0/3729986540 conn(0x7fdc700fc7d0 msgr2=0x7fdc700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.841+0000 7fdc76d11640 1 -- 172.21.15.18:0/3729986540 shutdown_connections 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.841+0000 7fdc76d11640 1 -- 172.21.15.18:0/3729986540 wait complete. 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc76d11640 1 Processor -- start 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc76d11640 1 -- start start 2024-09-19T09:53:45.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc76d11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc70100e20 0x7fdc70199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc76d11640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc70102570 0x7fdc701998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc76d11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc70102ef0 0x7fdc701a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc76d11640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc70110f80 con 0x7fdc70102ef0 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc76d11640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdc70110e00 con 0x7fdc70102570 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc76d11640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc70111100 con 0x7fdc70100e20 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc752ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc70102ef0 0x7fdc701a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc752ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc70102ef0 0x7fdc701a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55604/0 (socket says 172.21.15.18:55604) 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc752ae640 1 -- 172.21.15.18:0/1937188986 learned_addr learned my addr 172.21.15.18:0/1937188986 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc70102570 0x7fdc701998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.842+0000 7fdc74aad640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc70100e20 0x7fdc70199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc752ae640 1 -- 172.21.15.18:0/1937188986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc70100e20 msgr2=0x7fdc70199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:45.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc752ae640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc70100e20 0x7fdc70199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc752ae640 1 -- 172.21.15.18:0/1937188986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc70102570 msgr2=0x7fdc701998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:45.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc752ae640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc70102570 0x7fdc701998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc752ae640 1 -- 172.21.15.18:0/1937188986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc701a4950 con 0x7fdc70102ef0 2024-09-19T09:53:45.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc70102570 0x7fdc701998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:45.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc752ae640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc70102ef0 0x7fdc701a4410 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdc6802ae70 tx=0x7fdc6802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:45.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc6dffb640 1 -- 172.21.15.18:0/1937188986 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68034040 con 0x7fdc70102ef0 2024-09-19T09:53:45.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc76d11640 1 -- 172.21.15.18:0/1937188986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc701a4b20 con 0x7fdc70102ef0 2024-09-19T09:53:45.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc6dffb640 1 -- 172.21.15.18:0/1937188986 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc68030920 con 0x7fdc70102ef0 2024-09-19T09:53:45.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc6dffb640 1 -- 172.21.15.18:0/1937188986 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68045480 con 0x7fdc70102ef0 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.843+0000 7fdc76d11640 1 -- 172.21.15.18:0/1937188986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc701a4f80 con 0x7fdc70102ef0 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc6dffb640 1 -- 172.21.15.18:0/1937188986 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdc68037020 con 0x7fdc70102ef0 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc790ea740 1 Processor -- start 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc790ea740 1 -- start start 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f36880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f41140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f43a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc790ea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564ab2e9c2e0 con 0x564ab2f41680 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc790ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564ab2e43ce0 con 0x564ab2f364a0 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc790ea740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564ab2e982a0 con 0x564ab2f36dc0 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc6ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f43a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc6ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f43a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55608/0 (socket says 172.21.15.18:55608) 2024-09-19T09:53:45.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc6ffff640 1 -- 172.21.15.18:0/3632251738 learned_addr learned my addr 172.21.15.18:0/3632251738 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/3632251738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f36880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc74aad640 1 --2- 172.21.15.18:0/3632251738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f41140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.846+0000 7fdc6dffb640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdc580a32c0 0x7fdc580a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc6ffff640 1 -- 172.21.15.18:0/3632251738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 msgr2=0x564ab2f41140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/3632251738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f41140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc6ffff640 1 -- 172.21.15.18:0/3632251738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 msgr2=0x564ab2f36880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/3632251738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f36880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc6ffff640 1 -- 172.21.15.18:0/3632251738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ab2e28440 con 0x564ab2f41680 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc752ae640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdc580a32c0 0x7fdc580a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/3632251738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f43a70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdc64012ae0 tx=0x7fdc6400bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f212a70384e9a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc56ffd640 1 -- 172.21.15.18:0/3632251738 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64004020 con 0x564ab2f41680 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc6dffb640 1 -- 172.21.15.18:0/1937188986 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdc680f0620 con 0x7fdc70102ef0 2024-09-19T09:53:45.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc56ffd640 1 -- 172.21.15.18:0/3632251738 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc64005500 con 0x564ab2f41680 2024-09-19T09:53:45.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.847+0000 7fdc56ffd640 1 -- 172.21.15.18:0/3632251738 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64010e20 con 0x564ab2f41680 2024-09-19T09:53:45.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc790ea740 1 -- 172.21.15.18:0/3632251738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 msgr2=0x564ab2f43a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:45.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc790ea740 1 --2- 172.21.15.18:0/3632251738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f43a70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdc64012ae0 tx=0x7fdc6400bb30 comp rx=0 tx=0).stop 2024-09-19T09:53:45.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc752ae640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdc580a32c0 0x7fdc580a5780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc680b9640 tx=0x7fdc680b7630 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:45.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc790ea740 1 -- 172.21.15.18:0/3632251738 shutdown_connections 2024-09-19T09:53:45.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc790ea740 1 --2- 172.21.15.18:0/3632251738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f43a70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc790ea740 1 --2- 172.21.15.18:0/3632251738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f41140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc790ea740 1 --2- 172.21.15.18:0/3632251738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f36880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc790ea740 1 -- 172.21.15.18:0/3632251738 >> 172.21.15.18:0/3632251738 conn(0x564ab2f32a30 msgr2=0x564ab2f32e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc790ea740 1 -- 172.21.15.18:0/3632251738 shutdown_connections 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc790ea740 1 -- 172.21.15.18:0/3632251738 wait complete. 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.848+0000 7fdc790ea740 1 -- start start 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc790ea740 1 Processor -- start 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f41090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f3e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f3e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc790ea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564ab2f44250 con 0x564ab2f41680 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc790ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564ab2e57050 con 0x564ab2f364a0 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc790ea740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564ab2f443d0 con 0x564ab2f36dc0 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc790ea740 10 client.0 _ll_register_callbacks cb 0x564ab2e97160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc6ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f3e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc6ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f3e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55618/0 (socket says 172.21.15.18:55618) 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc6ffff640 1 -- 172.21.15.18:0/1016405889 learned_addr learned my addr 172.21.15.18:0/1016405889 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc74aad640 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f3e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.849+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f41090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc6ffff640 1 -- 172.21.15.18:0/1016405889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 msgr2=0x564ab2f3e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f3e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc6ffff640 1 -- 172.21.15.18:0/1016405889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 msgr2=0x564ab2f41090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f41090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc6ffff640 1 -- 172.21.15.18:0/1016405889 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ab2c0d3c0 con 0x564ab2f41680 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f3e950 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdc64004580 tx=0x7fdc64014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6897263b9475766 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1016405889 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64010e90 con 0x564ab2f41680 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1016405889 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdc6401d580 con 0x564ab2f41680 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc790ea740 1 -- 172.21.15.18:0/1016405889 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc64005500 con 0x564ab2f41680 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1016405889 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdc64010800 con 0x564ab2f41680 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc790ea740 10 client.15831 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.850+0000 7fdc790ea740 1 -- 172.21.15.18:0/1016405889 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564ab2f4fce0 con 0x564ab2f41680 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.851+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1016405889 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc64005500 con 0x564ab2f41680 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.851+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1016405889 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdc6401f840 con 0x564ab2f41680 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.851+0000 7fdc790ea740 10 client.15831 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.851+0000 7fdc790ea740 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.851+0000 7fdc790ea740 20 client.15831 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.851+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564ab2f51030 0x564ab2f53420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.851+0000 7fdc790ea740 4 client.15831 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.851+0000 7fdc790ea740 1 -- 172.21.15.18:0/1016405889 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ab2ea9850 con 0x564ab2f51030 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.851+0000 7fdc74aad640 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564ab2f51030 0x564ab2f53420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.852+0000 7fdc74aad640 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564ab2f51030 0x564ab2f53420 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25f1698000c5a938 server_cookie=68afaf0da95e3607 in_seq=0 out_seq=0 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.852+0000 7fdc4ffff640 10 client.15831 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.852+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1016405889 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ab2ea9850 con 0x564ab2f51030 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.852+0000 7fdc4ffff640 10 client.15831 handle_command_reply: tid=0 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.852+0000 7fdc790ea740 1 client.15831 shutdown 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 1 -- 172.21.15.18:0/1016405889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 msgr2=0x564ab2f3e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f3e950 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdc64004580 tx=0x7fdc64014040 comp rx=0 tx=0).stop 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 1 -- 172.21.15.18:0/1016405889 shutdown_connections 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564ab2f51030 0x564ab2f53420 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f41680 0x564ab2f3e950 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f3e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1016405889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f41090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc4ffff640 0 client.15831 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:45.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 1 -- 172.21.15.18:0/1016405889 >> 172.21.15.18:0/1016405889 conn(0x564ab2f32a30 msgr2=0x564ab2f38710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:45.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 1 -- 172.21.15.18:0/1016405889 shutdown_connections 2024-09-19T09:53:45.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 1 -- 172.21.15.18:0/1016405889 wait complete. 2024-09-19T09:53:45.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.853+0000 7fdc790ea740 20 client.15831 trim_cache size 0 max 16384 2024-09-19T09:53:45.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.870+0000 7fdc790ea740 1 Processor -- start 2024-09-19T09:53:45.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.870+0000 7fdc790ea740 1 -- start start 2024-09-19T09:53:45.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.870+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f364a0 0x564ab2f4d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.870+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f39090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.870+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f41680 0x564ab2f58c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.870+0000 7fdc790ea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc701ad420 con 0x564ab2f364a0 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc790ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdc701aef60 con 0x564ab2f41680 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc790ea740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc701adaf0 con 0x564ab2f36dc0 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc6ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f364a0 0x564ab2f4d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc6ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f364a0 0x564ab2f4d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55630/0 (socket says 172.21.15.18:55630) 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc6ffff640 1 -- 172.21.15.18:0/2672151588 learned_addr learned my addr 172.21.15.18:0/2672151588 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc74aad640 1 --2- 172.21.15.18:0/2672151588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f39090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc6ffff640 1 -- 172.21.15.18:0/2672151588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 msgr2=0x564ab2f39090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/2672151588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f39090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc6ffff640 1 -- 172.21.15.18:0/2672151588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f41680 msgr2=0x564ab2f58c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/2672151588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f41680 0x564ab2f58c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc6ffff640 1 -- 172.21.15.18:0/2672151588 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ab2f39f40 con 0x564ab2f364a0 2024-09-19T09:53:45.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/2672151588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f364a0 0x564ab2f4d4b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdc6401fc60 tx=0x7fdc6400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeba116fb8b7d925 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:45.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc567fc640 1 -- 172.21.15.18:0/2672151588 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400bae0 con 0x564ab2f364a0 2024-09-19T09:53:45.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc567fc640 1 -- 172.21.15.18:0/2672151588 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc64024070 con 0x564ab2f364a0 2024-09-19T09:53:45.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.871+0000 7fdc567fc640 1 -- 172.21.15.18:0/2672151588 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400bea0 con 0x564ab2f364a0 2024-09-19T09:53:45.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.872+0000 7fdc790ea740 1 -- 172.21.15.18:0/2672151588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f364a0 msgr2=0x564ab2f4d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:45.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.872+0000 7fdc790ea740 1 --2- 172.21.15.18:0/2672151588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f364a0 0x564ab2f4d4b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdc6401fc60 tx=0x7fdc6400be00 comp rx=0 tx=0).stop 2024-09-19T09:53:45.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.872+0000 7fdc790ea740 1 -- 172.21.15.18:0/2672151588 shutdown_connections 2024-09-19T09:53:45.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.872+0000 7fdc790ea740 1 --2- 172.21.15.18:0/2672151588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f41680 0x564ab2f58c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.872+0000 7fdc790ea740 1 --2- 172.21.15.18:0/2672151588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f36dc0 0x564ab2f39090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.872+0000 7fdc790ea740 1 --2- 172.21.15.18:0/2672151588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f364a0 0x564ab2f4d4b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.872+0000 7fdc790ea740 1 -- 172.21.15.18:0/2672151588 >> 172.21.15.18:0/2672151588 conn(0x564ab2f32a30 msgr2=0x564ab2f403c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.872+0000 7fdc790ea740 1 -- 172.21.15.18:0/2672151588 shutdown_connections 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.872+0000 7fdc790ea740 1 -- 172.21.15.18:0/2672151588 wait complete. 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc790ea740 1 -- start start 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc790ea740 1 Processor -- start 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f49d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f36dc0 0x564ab2f450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc790ea740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f41680 0x564ab2f455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc790ea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc701ae890 con 0x564ab2f36dc0 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc790ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdc701ae1c0 con 0x564ab2f364a0 2024-09-19T09:53:45.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc790ea740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc701ab420 con 0x564ab2f41680 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc790ea740 10 client.0 _ll_register_callbacks cb 0x7fdc640125d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc74aad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f36dc0 0x564ab2f450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc74aad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f36dc0 0x564ab2f450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55642/0 (socket says 172.21.15.18:55642) 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc74aad640 1 -- 172.21.15.18:0/1060411180 learned_addr learned my addr 172.21.15.18:0/1060411180 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.873+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f49d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f41680 0x564ab2f455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc74aad640 1 -- 172.21.15.18:0/1060411180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f41680 msgr2=0x564ab2f455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc74aad640 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f41680 0x564ab2f455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc74aad640 1 -- 172.21.15.18:0/1060411180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 msgr2=0x564ab2f49d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc74aad640 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f49d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc74aad640 1 -- 172.21.15.18:0/1060411180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ab2f45dc0 con 0x564ab2f36dc0 2024-09-19T09:53:45.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f41680 0x564ab2f455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc74aad640 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f36dc0 0x564ab2f450a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x564ab2f3dbd0 tx=0x7fdc60011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c71e02afec9b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1060411180 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6002b060 con 0x564ab2f36dc0 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1060411180 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdc60026660 con 0x564ab2f36dc0 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc790ea740 1 -- 172.21.15.18:0/1060411180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc64024070 con 0x564ab2f36dc0 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1060411180 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdc60011e30 con 0x564ab2f36dc0 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc790ea740 10 client.15837 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.874+0000 7fdc790ea740 1 -- 172.21.15.18:0/1060411180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564ab2fbbc20 con 0x564ab2f36dc0 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.875+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1060411180 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc64024070 con 0x564ab2f36dc0 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.875+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1060411180 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdc60003c90 con 0x564ab2f36dc0 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.875+0000 7fdc790ea740 10 client.15837 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.875+0000 7fdc790ea740 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:45.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.875+0000 7fdc790ea740 20 client.15837 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.875+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564ab2fbc3d0 0x564ab2fbe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.875+0000 7fdc790ea740 4 client.15837 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.875+0000 7fdc790ea740 1 -- 172.21.15.18:0/1060411180 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564ab2ea3d60 con 0x564ab2fbc3d0 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.875+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564ab2fbc3d0 0x564ab2fbe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc6ffff640 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564ab2fbc3d0 0x564ab2fbe7f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5310c6759890168 server_cookie=3a1420651665cb11 in_seq=0 out_seq=0 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc4ffff640 10 client.15837 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc4ffff640 1 -- 172.21.15.18:0/1060411180 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564ab2ea3d60 con 0x564ab2fbc3d0 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc4ffff640 10 client.15837 handle_command_reply: tid=0 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 client.15837 shutdown 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 -- 172.21.15.18:0/1060411180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f36dc0 msgr2=0x564ab2f450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f36dc0 0x564ab2f450a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x564ab2f3dbd0 tx=0x7fdc60011440 comp rx=0 tx=0).stop 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 -- 172.21.15.18:0/1060411180 shutdown_connections 2024-09-19T09:53:45.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564ab2fbc3d0 0x564ab2fbe7f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ab2f41680 0x564ab2f455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc4ffff640 0 client.15837 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:45.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564ab2f36dc0 0x564ab2f450a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 --2- 172.21.15.18:0/1060411180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ab2f364a0 0x564ab2f49d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 -- 172.21.15.18:0/1060411180 >> 172.21.15.18:0/1060411180 conn(0x564ab2f32a30 msgr2=0x564ab2f31350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:45.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 -- 172.21.15.18:0/1060411180 shutdown_connections 2024-09-19T09:53:45.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 1 -- 172.21.15.18:0/1060411180 wait complete. 2024-09-19T09:53:45.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.876+0000 7fdc790ea740 20 client.15837 trim_cache size 0 max 16384 2024-09-19T09:53:45.883 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:53:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T09:53:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T09:53:45.884 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:53:45.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 -- 172.21.15.18:0/1937188986 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdc580a32c0 msgr2=0x7fdc580a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:45.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdc580a32c0 0x7fdc580a5780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc680b9640 tx=0x7fdc680b7630 comp rx=0 tx=0).stop 2024-09-19T09:53:45.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 -- 172.21.15.18:0/1937188986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc70102ef0 msgr2=0x7fdc701a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:45.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc70102ef0 0x7fdc701a4410 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdc6802ae70 tx=0x7fdc6802f5d0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 -- 172.21.15.18:0/1937188986 shutdown_connections 2024-09-19T09:53:45.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdc580a32c0 0x7fdc580a5780 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc70102ef0 0x7fdc701a4410 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc70102570 0x7fdc701998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 --2- 172.21.15.18:0/1937188986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc70100e20 0x7fdc70199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:45.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 -- 172.21.15.18:0/1937188986 >> 172.21.15.18:0/1937188986 conn(0x7fdc700fc7d0 msgr2=0x7fdc701068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:45.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 -- 172.21.15.18:0/1937188986 shutdown_connections 2024-09-19T09:53:45.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:45.877+0000 7fdc76d11640 1 -- 172.21.15.18:0/1937188986 wait complete. 2024-09-19T09:53:46.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:45 smithi018 ceph-mon[30956]: pgmap v381: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 255 B/s wr, 13 op/s 2024-09-19T09:53:46.259 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:53:46.260 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:53:46.260 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:53:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:45 smithi049 ceph-mon[34858]: pgmap v381: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 255 B/s wr, 13 op/s 2024-09-19T09:53:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:45 smithi162 ceph-mon[35174]: pgmap v381: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 255 B/s wr, 13 op/s 2024-09-19T09:53:46.830 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:53:46.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:53:46.968 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:47.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.523+0000 7fad9f343640 1 -- 172.21.15.18:0/2514703862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad981036e0 msgr2=0x7fad98107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:47.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.523+0000 7fad9f343640 1 --2- 172.21.15.18:0/2514703862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad981036e0 0x7fad98107b90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fad88009930 tx=0x7fad8802a420 comp rx=0 tx=0).stop 2024-09-19T09:53:47.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.523+0000 7fad9f343640 1 -- 172.21.15.18:0/2514703862 shutdown_connections 2024-09-19T09:53:47.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.523+0000 7fad9f343640 1 --2- 172.21.15.18:0/2514703862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad981082a0 0x7fad9810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.523+0000 7fad9f343640 1 --2- 172.21.15.18:0/2514703862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad981036e0 0x7fad98107b90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.523+0000 7fad9f343640 1 --2- 172.21.15.18:0/2514703862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98102d30 0x7fad98103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.523+0000 7fad9f343640 1 -- 172.21.15.18:0/2514703862 >> 172.21.15.18:0/2514703862 conn(0x7fad980fc7d0 msgr2=0x7fad980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:47.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.523+0000 7fad9f343640 1 -- 172.21.15.18:0/2514703862 shutdown_connections 2024-09-19T09:53:47.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.523+0000 7fad9f343640 1 -- 172.21.15.18:0/2514703862 wait complete. 2024-09-19T09:53:47.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.524+0000 7fad9f343640 1 Processor -- start 2024-09-19T09:53:47.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.524+0000 7fad9f343640 1 -- start start 2024-09-19T09:53:47.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.524+0000 7fad9f343640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad98102d30 0x7fad981985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:47.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.524+0000 7fad9f343640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad981036e0 0x7fad98198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:47.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.524+0000 7fad9f343640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad981082a0 0x7fad9819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:47.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.524+0000 7fad9f343640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad981120c0 con 0x7fad98102d30 2024-09-19T09:53:47.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.524+0000 7fad9f343640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fad98111f40 con 0x7fad981036e0 2024-09-19T09:53:47.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.524+0000 7fad9f343640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad98112240 con 0x7fad981082a0 2024-09-19T09:53:47.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.524+0000 7fad9d0df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad98102d30 0x7fad981985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:47.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9d0df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad98102d30 0x7fad981985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53318/0 (socket says 172.21.15.18:53318) 2024-09-19T09:53:47.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9d0df640 1 -- 172.21.15.18:0/2166191456 learned_addr learned my addr 172.21.15.18:0/2166191456 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:47.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9c8de640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad981036e0 0x7fad98198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:47.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9d8e0640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad981082a0 0x7fad9819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:47.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9d0df640 1 -- 172.21.15.18:0/2166191456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad981082a0 msgr2=0x7fad9819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:47.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9d0df640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad981082a0 0x7fad9819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9d0df640 1 -- 172.21.15.18:0/2166191456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad981036e0 msgr2=0x7fad98198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:47.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9d0df640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad981036e0 0x7fad98198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9d0df640 1 -- 172.21.15.18:0/2166191456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9819d570 con 0x7fad98102d30 2024-09-19T09:53:47.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9d8e0640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad981082a0 0x7fad9819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:47.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9d0df640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad98102d30 0x7fad981985c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fad9400c920 tx=0x7fad9400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:47.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad8e7fc640 1 -- 172.21.15.18:0/2166191456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad94007c70 con 0x7fad98102d30 2024-09-19T09:53:47.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9f343640 1 -- 172.21.15.18:0/2166191456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9819d860 con 0x7fad98102d30 2024-09-19T09:53:47.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad8e7fc640 1 -- 172.21.15.18:0/2166191456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad94007e10 con 0x7fad98102d30 2024-09-19T09:53:47.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad8e7fc640 1 -- 172.21.15.18:0/2166191456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad94018890 con 0x7fad98102d30 2024-09-19T09:53:47.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.525+0000 7fad9f343640 1 -- 172.21.15.18:0/2166191456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad981a5140 con 0x7fad98102d30 2024-09-19T09:53:47.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.527+0000 7fad9f343640 1 -- 172.21.15.18:0/2166191456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad98103110 con 0x7fad98102d30 2024-09-19T09:53:47.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.528+0000 7fad8e7fc640 1 -- 172.21.15.18:0/2166191456 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fad94018a50 con 0x7fad98102d30 2024-09-19T09:53:47.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.529+0000 7fad8e7fc640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fad840a3240 0x7fad840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:47.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.529+0000 7fad9c8de640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fad840a3240 0x7fad840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:47.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.529+0000 7fad8e7fc640 1 -- 172.21.15.18:0/2166191456 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fad940cfd20 con 0x7fad98102d30 2024-09-19T09:53:47.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.529+0000 7fad9c8de640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fad840a3240 0x7fad840a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fad88005940 tx=0x7fad880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:47.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.532+0000 7fad8e7fc640 1 -- 172.21.15.18:0/2166191456 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad94014030 con 0x7fad98102d30 2024-09-19T09:53:47.738 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:47.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.752+0000 7fad9f343640 1 -- 172.21.15.18:0/2166191456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad9810a2b0 con 0x7fad98102d30 2024-09-19T09:53:47.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.753+0000 7fad8e7fc640 1 -- 172.21.15.18:0/2166191456 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fad9409caa0 con 0x7fad98102d30 2024-09-19T09:53:47.755 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:53:47.755 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:53:47.756 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.755+0000 7fad9f343640 1 -- 172.21.15.18:0/2166191456 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fad840a3240 msgr2=0x7fad840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fad840a3240 0x7fad840a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fad88005940 tx=0x7fad880058d0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 -- 172.21.15.18:0/2166191456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad98102d30 msgr2=0x7fad981985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad98102d30 0x7fad981985c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fad9400c920 tx=0x7fad9400cde0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 -- 172.21.15.18:0/2166191456 shutdown_connections 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fad840a3240 0x7fad840a5700 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad981082a0 0x7fad9819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad981036e0 0x7fad98198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 --2- 172.21.15.18:0/2166191456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad98102d30 0x7fad981985c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 -- 172.21.15.18:0/2166191456 >> 172.21.15.18:0/2166191456 conn(0x7fad980fc7d0 msgr2=0x7fad98106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 -- 172.21.15.18:0/2166191456 shutdown_connections 2024-09-19T09:53:47.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:47.756+0000 7fad9f343640 1 -- 172.21.15.18:0/2166191456 wait complete. 2024-09-19T09:53:48.073 INFO:tasks.workunit.client.0.smithi018.stderr:Updating files: 88% (11451/12896) Updating files: 89% (11478/12896) Updating files: 90% (11607/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T09:53:48.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:47 smithi018 ceph-mon[30956]: pgmap v382: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:48.121 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:47 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2166191456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:47 smithi049 ceph-mon[34858]: pgmap v382: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:47 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2166191456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:48.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:47 smithi162 ceph-mon[35174]: pgmap v382: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:53:48.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:47 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2166191456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:48.492 INFO:tasks.workunit.client.0.smithi018.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:53:48.492 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T09:53:48.492 INFO:tasks.workunit.client.0.smithi018.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:53:48.492 INFO:tasks.workunit.client.0.smithi018.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:53:48.492 INFO:tasks.workunit.client.0.smithi018.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:53:48.492 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T09:53:48.492 INFO:tasks.workunit.client.0.smithi018.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr: git switch -c 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr:Or undo this operation with: 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr: git switch - 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T09:53:48.493 INFO:tasks.workunit.client.0.smithi018.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:53:48.498 DEBUG:teuthology.orchestra.run.smithi018:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T09:53:48.571 INFO:tasks.workunit.client.0.smithi018.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:53:48.573 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:53:48.573 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:53:48.858 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:53:48.859 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.114+0000 7f46f498d640 1 -- 172.21.15.18:0/690855761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46f0100aa0 msgr2=0x7f46f010ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.114+0000 7f46f498d640 1 --2- 172.21.15.18:0/690855761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46f0100aa0 0x7f46f010ea20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009ca0 tx=0x7f46e802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.114+0000 7f46f498d640 1 -- 172.21.15.18:0/690855761 shutdown_connections 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.114+0000 7f46f498d640 1 --2- 172.21.15.18:0/690855761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46f0100aa0 0x7f46f010ea20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.114+0000 7f46f498d640 1 --2- 172.21.15.18:0/690855761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f0100100 0x7f46f0100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.114+0000 7f46f498d640 1 --2- 172.21.15.18:0/690855761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0106b80 0x7f46f0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.114+0000 7f46f498d640 1 -- 172.21.15.18:0/690855761 >> 172.21.15.18:0/690855761 conn(0x7f46f0077230 msgr2=0x7f46f00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.115+0000 7f46f498d640 1 -- 172.21.15.18:0/690855761 shutdown_connections 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.115+0000 7f46f498d640 1 -- 172.21.15.18:0/690855761 wait complete. 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.115+0000 7f46f498d640 1 Processor -- start 2024-09-19T09:53:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.115+0000 7f46f498d640 1 -- start start 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46f498d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f0100100 0x7f46f0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46f498d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46f0100aa0 0x7f46f01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46f498d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0106b80 0x7f46f019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46f498d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0112050 con 0x7f46f0100aa0 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46f498d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0111ed0 con 0x7f46f0106b80 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46f498d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46f01121d0 con 0x7f46f0100100 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46edd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46f0100aa0 0x7f46f01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46edd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46f0100aa0 0x7f46f01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53336/0 (socket says 172.21.15.18:53336) 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46edd9b640 1 -- 172.21.15.18:0/172339805 learned_addr learned my addr 172.21.15.18:0/172339805 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46ee59c640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f0100100 0x7f46f0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46eed9d640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0106b80 0x7f46f019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46edd9b640 1 -- 172.21.15.18:0/172339805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f0100100 msgr2=0x7f46f0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46edd9b640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f0100100 0x7f46f0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46edd9b640 1 -- 172.21.15.18:0/172339805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0106b80 msgr2=0x7f46f019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46edd9b640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0106b80 0x7f46f019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46edd9b640 1 -- 172.21.15.18:0/172339805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f019d440 con 0x7f46f0100aa0 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46edd9b640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46f0100aa0 0x7f46f01989d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f46e400d770 tx=0x7f46e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.116+0000 7f46df7fe640 1 -- 172.21.15.18:0/172339805 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4017070 con 0x7f46f0100aa0 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.117+0000 7f46df7fe640 1 -- 172.21.15.18:0/172339805 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46e4005500 con 0x7f46f0100aa0 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.117+0000 7f46f498d640 1 -- 172.21.15.18:0/172339805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f019d730 con 0x7f46f0100aa0 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.117+0000 7f46df7fe640 1 -- 172.21.15.18:0/172339805 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4004e00 con 0x7f46f0100aa0 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.117+0000 7f46f498d640 1 -- 172.21.15.18:0/172339805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f01a5010 con 0x7f46f0100aa0 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.118+0000 7f46f498d640 1 -- 172.21.15.18:0/172339805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f0100560 con 0x7f46f0100aa0 2024-09-19T09:53:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.119+0000 7f46df7fe640 1 -- 172.21.15.18:0/172339805 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f46e4004fa0 con 0x7f46f0100aa0 2024-09-19T09:53:49.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.119+0000 7f46df7fe640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46d80a32c0 0x7f46d80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.119+0000 7f46df7fe640 1 -- 172.21.15.18:0/172339805 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f46e40cf720 con 0x7f46f0100aa0 2024-09-19T09:53:49.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.120+0000 7f46ee59c640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46d80a32c0 0x7f46d80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.120+0000 7f46ee59c640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46d80a32c0 0x7f46d80a5780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f46e0005d00 tx=0x7f46e000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:49.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.123+0000 7f46df7fe640 1 -- 172.21.15.18:0/172339805 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f46e409c4f0 con 0x7f46f0100aa0 2024-09-19T09:53:49.306 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:49.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.362+0000 7f46f498d640 1 -- 172.21.15.18:0/172339805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46f01a51e0 con 0x7f46f0100aa0 2024-09-19T09:53:49.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.362+0000 7f46df7fe640 1 -- 172.21.15.18:0/172339805 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f46e409bdf0 con 0x7f46f0100aa0 2024-09-19T09:53:49.364 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:53:49.365 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:53:49.365 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:53:49.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.364+0000 7f46f498d640 1 -- 172.21.15.18:0/172339805 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46d80a32c0 msgr2=0x7f46d80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.364+0000 7f46f498d640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46d80a32c0 0x7f46d80a5780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f46e0005d00 tx=0x7f46e000b410 comp rx=0 tx=0).stop 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.364+0000 7f46f498d640 1 -- 172.21.15.18:0/172339805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46f0100aa0 msgr2=0x7f46f01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.364+0000 7f46f498d640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46f0100aa0 0x7f46f01989d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f46e400d770 tx=0x7f46e400dc30 comp rx=0 tx=0).stop 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.364+0000 7f46f498d640 1 -- 172.21.15.18:0/172339805 shutdown_connections 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.364+0000 7f46f498d640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f46d80a32c0 0x7f46d80a5780 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.364+0000 7f46f498d640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f0106b80 0x7f46f019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.364+0000 7f46f498d640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46f0100aa0 0x7f46f01989d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.364+0000 7f46f498d640 1 --2- 172.21.15.18:0/172339805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f0100100 0x7f46f0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.364+0000 7f46f498d640 1 -- 172.21.15.18:0/172339805 >> 172.21.15.18:0/172339805 conn(0x7f46f0077230 msgr2=0x7f46f0104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.365+0000 7f46f498d640 1 -- 172.21.15.18:0/172339805 shutdown_connections 2024-09-19T09:53:49.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.365+0000 7f46f498d640 1 -- 172.21.15.18:0/172339805 wait complete. 2024-09-19T09:53:49.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.843+0000 7f443e1c6640 1 -- 172.21.15.18:0/404913136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4438106a80 msgr2=0x7f4438106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.843+0000 7f443e1c6640 1 --2- 172.21.15.18:0/404913136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4438106a80 0x7f4438106e60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4428009930 tx=0x7f442802a420 comp rx=0 tx=0).stop 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.844+0000 7f443e1c6640 1 -- 172.21.15.18:0/404913136 shutdown_connections 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.844+0000 7f443e1c6640 1 --2- 172.21.15.18:0/404913136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4438101420 0x7f443810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.844+0000 7f443e1c6640 1 --2- 172.21.15.18:0/404913136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4438100a80 0x7f4438100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.844+0000 7f443e1c6640 1 --2- 172.21.15.18:0/404913136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4438106a80 0x7f4438106e60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.844+0000 7f443e1c6640 1 -- 172.21.15.18:0/404913136 >> 172.21.15.18:0/404913136 conn(0x7f44380fc7a0 msgr2=0x7f44380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.844+0000 7f443e1c6640 1 -- 172.21.15.18:0/404913136 shutdown_connections 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.844+0000 7f443e1c6640 1 -- 172.21.15.18:0/404913136 wait complete. 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.844+0000 7f443e1c6640 1 Processor -- start 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.844+0000 7f443e1c6640 1 -- start start 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f443e1c6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4438100a80 0x7f4438198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f443e1c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4438101420 0x7f4438198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f443e1c6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4438106a80 0x7f443819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f443e1c6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4438110e80 con 0x7f4438106a80 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f443e1c6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4438110d00 con 0x7f4438100a80 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f443e1c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4438111000 con 0x7f4438101420 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f4437fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4438106a80 0x7f443819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f4437fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4438106a80 0x7f443819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53362/0 (socket says 172.21.15.18:53362) 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f4437fff640 1 -- 172.21.15.18:0/2847242767 learned_addr learned my addr 172.21.15.18:0/2847242767 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f442effd640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4438101420 0x7f4438198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f44377fe640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4438100a80 0x7f4438198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f4437fff640 1 -- 172.21.15.18:0/2847242767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4438101420 msgr2=0x7f4438198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f4437fff640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4438101420 0x7f4438198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f4437fff640 1 -- 172.21.15.18:0/2847242767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4438100a80 msgr2=0x7f4438198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f4437fff640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4438100a80 0x7f4438198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f4437fff640 1 -- 172.21.15.18:0/2847242767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443819d3f0 con 0x7f4438106a80 2024-09-19T09:53:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f44377fe640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4438100a80 0x7f4438198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f4437fff640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4438106a80 0x7f443819cd10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f443000eb10 tx=0x7f443000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.845+0000 7f44357fa640 1 -- 172.21.15.18:0/2847242767 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4430004b20 con 0x7f4438106a80 2024-09-19T09:53:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.846+0000 7f443e1c6640 1 -- 172.21.15.18:0/2847242767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443819d6e0 con 0x7f4438106a80 2024-09-19T09:53:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.846+0000 7f44357fa640 1 -- 172.21.15.18:0/2847242767 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4430004cc0 con 0x7f4438106a80 2024-09-19T09:53:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.846+0000 7f44357fa640 1 -- 172.21.15.18:0/2847242767 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4430010760 con 0x7f4438106a80 2024-09-19T09:53:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.846+0000 7f443e1c6640 1 -- 172.21.15.18:0/2847242767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44381a4fc0 con 0x7f4438106a80 2024-09-19T09:53:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f44357fa640 1 -- 172.21.15.18:0/2847242767 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4430005020 con 0x7f4438106a80 2024-09-19T09:53:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f444059f740 1 Processor -- start 2024-09-19T09:53:49.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f444059f740 1 -- start start 2024-09-19T09:53:49.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f444059f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4e9730 0x562fab4e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f444059f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4ea050 0x562fab4f8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f444059f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab4fb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f444059f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562fab44e160 con 0x562fab4f8e40 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f444059f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562fab3f5720 con 0x562fab4ea050 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f444059f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562fab44a120 con 0x562fab4e9730 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f442effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab4fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f442effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab4fb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53378/0 (socket says 172.21.15.18:53378) 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f442effd640 1 -- 172.21.15.18:0/164382004 learned_addr learned my addr 172.21.15.18:0/164382004 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f44377fe640 1 --2- 172.21.15.18:0/164382004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4ea050 0x562fab4f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.849+0000 7f442effd640 1 --2- 172.21.15.18:0/164382004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4e9730 0x562fab4e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f442effd640 1 -- 172.21.15.18:0/164382004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4e9730 msgr2=0x562fab4e9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f442effd640 1 --2- 172.21.15.18:0/164382004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4e9730 0x562fab4e9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f442effd640 1 -- 172.21.15.18:0/164382004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4ea050 msgr2=0x562fab4f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f442effd640 1 --2- 172.21.15.18:0/164382004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4ea050 0x562fab4f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f442effd640 1 -- 172.21.15.18:0/164382004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fab1bfba0 con 0x562fab4f8e40 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f44357fa640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44240a3240 0x7f44240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f442effd640 1 --2- 172.21.15.18:0/164382004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab4fb230 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4420011490 tx=0x7f442000a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380c8f1ea0def8c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f44377fe640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44240a3240 0x7f44240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f44357fa640 1 -- 172.21.15.18:0/2847242767 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f44300cffc0 con 0x7f4438106a80 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f442dffb640 1 -- 172.21.15.18:0/164382004 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420005220 con 0x562fab4f8e40 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f442dffb640 1 -- 172.21.15.18:0/164382004 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4420004c80 con 0x562fab4f8e40 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.850+0000 7f442dffb640 1 -- 172.21.15.18:0/164382004 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442000fcd0 con 0x562fab4f8e40 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 -- 172.21.15.18:0/164382004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 msgr2=0x562fab4fb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 --2- 172.21.15.18:0/164382004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab4fb230 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4420011490 tx=0x7f442000a750 comp rx=0 tx=0).stop 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f44377fe640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44240a3240 0x7f44240a5700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4428031550 tx=0x7f4428005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 -- 172.21.15.18:0/164382004 shutdown_connections 2024-09-19T09:53:49.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 --2- 172.21.15.18:0/164382004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab4fb230 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 --2- 172.21.15.18:0/164382004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4ea050 0x562fab4f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 --2- 172.21.15.18:0/164382004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4e9730 0x562fab4e9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 -- 172.21.15.18:0/164382004 >> 172.21.15.18:0/164382004 conn(0x562fab4e5de0 msgr2=0x562fab4e61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:49.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 -- 172.21.15.18:0/164382004 shutdown_connections 2024-09-19T09:53:49.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 -- 172.21.15.18:0/164382004 wait complete. 2024-09-19T09:53:49.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 -- start start 2024-09-19T09:53:49.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.851+0000 7f444059f740 1 Processor -- start 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f444059f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f444059f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f444059f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 0x562fab4f6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f444059f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562fab4fba10 con 0x562fab4ea050 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f444059f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562fab3d6900 con 0x562fab4e9730 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f444059f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562fab4fbb90 con 0x562fab4f8e40 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f444059f740 10 client.0 _ll_register_callbacks cb 0x562fab3d4780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f442effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f442effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53384/0 (socket says 172.21.15.18:53384) 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f442effd640 1 -- 172.21.15.18:0/585438529 learned_addr learned my addr 172.21.15.18:0/585438529 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f44377fe640 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f4437fff640 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 0x562fab4f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f442effd640 1 -- 172.21.15.18:0/585438529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 msgr2=0x562fab4f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f442effd640 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 0x562fab4f6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f442effd640 1 -- 172.21.15.18:0/585438529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 msgr2=0x562fab4f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f442effd640 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f442effd640 1 -- 172.21.15.18:0/585438529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fab416c50 con 0x562fab4ea050 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f44377fe640 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f442effd640 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4f62d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f44200058c0 tx=0x7f442000fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2adcbe895b1126 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.852+0000 7f4416ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f4416ffd640 1 -- 172.21.15.18:0/585438529 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442002a060 con 0x562fab4ea050 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f4416ffd640 1 -- 172.21.15.18:0/585438529 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4420005000 con 0x562fab4ea050 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f444059f740 1 -- 172.21.15.18:0/585438529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4420004c80 con 0x562fab4ea050 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f4416ffd640 1 -- 172.21.15.18:0/585438529 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4420004ae0 con 0x562fab4ea050 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f444059f740 10 client.15861 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f444059f740 1 -- 172.21.15.18:0/585438529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562fab507750 con 0x562fab4ea050 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f4416ffd640 1 -- 172.21.15.18:0/585438529 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4420004c80 con 0x562fab4ea050 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f4416ffd640 1 -- 172.21.15.18:0/585438529 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f442001b030 con 0x562fab4ea050 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f444059f740 10 client.15861 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f444059f740 10 client.15861 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f444059f740 20 client.15861 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f444059f740 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562fab508bb0 0x562fab50afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f444059f740 4 client.15861 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.853+0000 7f444059f740 1 -- 172.21.15.18:0/585438529 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fab45b890 con 0x562fab508bb0 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.854+0000 7f44377fe640 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562fab508bb0 0x562fab50afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.854+0000 7f44377fe640 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562fab508bb0 0x562fab50afa0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43aeb66777d8fc71 server_cookie=4bd89df84574e615 in_seq=0 out_seq=0 2024-09-19T09:53:49.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.854+0000 7f4416ffd640 10 client.15861 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f4416ffd640 1 -- 172.21.15.18:0/585438529 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fab45b890 con 0x562fab508bb0 2024-09-19T09:53:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f4416ffd640 10 client.15861 handle_command_reply: tid=0 2024-09-19T09:53:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 client.15861 shutdown 2024-09-19T09:53:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 -- 172.21.15.18:0/585438529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 msgr2=0x562fab4f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4f62d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f44200058c0 tx=0x7f442000fca0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 -- 172.21.15.18:0/585438529 shutdown_connections 2024-09-19T09:53:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562fab508bb0 0x562fab50afa0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f4416ffd640 0 client.15861 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 0x562fab4f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4f62d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 --2- 172.21.15.18:0/585438529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 -- 172.21.15.18:0/585438529 >> 172.21.15.18:0/585438529 conn(0x562fab4e5de0 msgr2=0x562fab4ebb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:49.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 -- 172.21.15.18:0/585438529 shutdown_connections 2024-09-19T09:53:49.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 1 -- 172.21.15.18:0/585438529 wait complete. 2024-09-19T09:53:49.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.855+0000 7f444059f740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T09:53:49.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.872+0000 7f444059f740 1 Processor -- start 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.872+0000 7f444059f740 1 -- start start 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f444059f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f444059f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4ea050 0x562fab4f4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f444059f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab510660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f444059f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44381ab380 con 0x562fab4f8e40 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f444059f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f44381acec0 con 0x562fab4e9730 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f444059f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44381aba50 con 0x562fab4ea050 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f4437fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab510660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f4437fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab510660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53398/0 (socket says 172.21.15.18:53398) 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f4437fff640 1 -- 172.21.15.18:0/447340308 learned_addr learned my addr 172.21.15.18:0/447340308 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f442effd640 1 --2- 172.21.15.18:0/447340308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4ea050 0x562fab4f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f44377fe640 1 --2- 172.21.15.18:0/447340308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f4437fff640 1 -- 172.21.15.18:0/447340308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4ea050 msgr2=0x562fab4f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f4437fff640 1 --2- 172.21.15.18:0/447340308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4ea050 0x562fab4f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f4437fff640 1 -- 172.21.15.18:0/447340308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 msgr2=0x562fab4f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f4437fff640 1 --2- 172.21.15.18:0/447340308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f4437fff640 1 -- 172.21.15.18:0/447340308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fab4e9e80 con 0x562fab4f8e40 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f4437fff640 1 --2- 172.21.15.18:0/447340308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab510660 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f443009c5a0 tx=0x7f4430004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53e9c906e3b00f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.873+0000 7f442d7fa640 1 -- 172.21.15.18:0/447340308 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44300b4020 con 0x562fab4f8e40 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f442d7fa640 1 -- 172.21.15.18:0/447340308 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4430098040 con 0x562fab4f8e40 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f442d7fa640 1 -- 172.21.15.18:0/447340308 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4430098c80 con 0x562fab4f8e40 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f444059f740 1 -- 172.21.15.18:0/447340308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 msgr2=0x562fab510660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f444059f740 1 --2- 172.21.15.18:0/447340308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab510660 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f443009c5a0 tx=0x7f4430004f20 comp rx=0 tx=0).stop 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f444059f740 1 -- 172.21.15.18:0/447340308 shutdown_connections 2024-09-19T09:53:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f444059f740 1 --2- 172.21.15.18:0/447340308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4f8e40 0x562fab510660 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f444059f740 1 --2- 172.21.15.18:0/447340308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4ea050 0x562fab4f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f444059f740 1 --2- 172.21.15.18:0/447340308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f444059f740 1 -- 172.21.15.18:0/447340308 >> 172.21.15.18:0/447340308 conn(0x562fab4e5de0 msgr2=0x562fab4f6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:49.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f444059f740 1 -- 172.21.15.18:0/447340308 shutdown_connections 2024-09-19T09:53:49.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.874+0000 7f444059f740 1 -- 172.21.15.18:0/447340308 wait complete. 2024-09-19T09:53:49.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f444059f740 1 -- start start 2024-09-19T09:53:49.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f444059f740 1 Processor -- start 2024-09-19T09:53:49.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f444059f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f444059f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4fda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f444059f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 0x562fab500ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f444059f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44381ac7f0 con 0x562fab4ea050 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f444059f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f44381ac120 con 0x562fab4e9730 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f444059f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44381a9380 con 0x562fab4f8e40 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f444059f740 10 client.0 _ll_register_callbacks cb 0x7f44300093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f4437fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 0x562fab500ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f442effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4fda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f4437fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 0x562fab500ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:37768/0 (socket says 172.21.15.18:37768) 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f4437fff640 1 -- 172.21.15.18:0/2175488523 learned_addr learned my addr 172.21.15.18:0/2175488523 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f442effd640 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4fda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53412/0 (socket says 172.21.15.18:53412) 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.875+0000 7f44377fe640 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f4437fff640 1 -- 172.21.15.18:0/2175488523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 msgr2=0x562fab4fd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f4437fff640 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4fd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f4437fff640 1 -- 172.21.15.18:0/2175488523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 msgr2=0x562fab4fda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f4437fff640 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4fda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f4437fff640 1 -- 172.21.15.18:0/2175488523 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fab501180 con 0x562fab4f8e40 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f442effd640 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f4437fff640 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 0x562fab500ae0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44300cde60 tx=0x7f443009c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=244b8932250ae6fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f4416ffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f4416ffd640 1 -- 172.21.15.18:0/2175488523 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4430067060 con 0x562fab4f8e40 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f444059f740 1 -- 172.21.15.18:0/2175488523 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4430098040 con 0x562fab4f8e40 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f4416ffd640 1 -- 172.21.15.18:0/2175488523 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4430067400 con 0x562fab4f8e40 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f4416ffd640 1 -- 172.21.15.18:0/2175488523 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f44300b4040 con 0x562fab4f8e40 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f444059f740 10 client.25438 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.876+0000 7f444059f740 1 -- 172.21.15.18:0/2175488523 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562fab574070 con 0x562fab4f8e40 2024-09-19T09:53:49.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.877+0000 7f4416ffd640 1 -- 172.21.15.18:0/2175488523 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4430098040 con 0x562fab4f8e40 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.877+0000 7f4416ffd640 1 -- 172.21.15.18:0/2175488523 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f443007f020 con 0x562fab4f8e40 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.877+0000 7f444059f740 10 client.25438 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.877+0000 7f444059f740 10 client.25438 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.877+0000 7f444059f740 20 client.25438 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.877+0000 7f444059f740 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562fab508bb0 0x562fab576780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.877+0000 7f444059f740 4 client.25438 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.877+0000 7f444059f740 1 -- 172.21.15.18:0/2175488523 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x562fab455be0 con 0x562fab508bb0 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.877+0000 7f44377fe640 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562fab508bb0 0x562fab576780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.878+0000 7f44377fe640 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562fab508bb0 0x562fab576780 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=471f313085315912 server_cookie=6a307886ffb1a131 in_seq=0 out_seq=0 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.878+0000 7f4416ffd640 10 client.25438 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f4416ffd640 1 -- 172.21.15.18:0/2175488523 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x562fab455be0 con 0x562fab508bb0 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f4416ffd640 10 client.25438 handle_command_reply: tid=0 2024-09-19T09:53:49.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 client.25438 shutdown 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 -- 172.21.15.18:0/2175488523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 msgr2=0x562fab500ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 0x562fab500ae0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44300cde60 tx=0x7f443009c680 comp rx=0 tx=0).stop 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 -- 172.21.15.18:0/2175488523 shutdown_connections 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562fab508bb0 0x562fab576780 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fab4f8e40 0x562fab500ae0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fab4ea050 0x562fab4fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 --2- 172.21.15.18:0/2175488523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fab4e9730 0x562fab4fd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 -- 172.21.15.18:0/2175488523 >> 172.21.15.18:0/2175488523 conn(0x562fab4e5de0 msgr2=0x562fab4f6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f4416ffd640 0 client.25438 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 -- 172.21.15.18:0/2175488523 shutdown_connections 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 1 -- 172.21.15.18:0/2175488523 wait complete. 2024-09-19T09:53:49.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.884+0000 7f444059f740 20 client.25438 trim_cache size 0 max 16384 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 6, 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout: "18324320": { 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 6, 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:53:49.896 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 140.3, 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:49.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:53:49.898 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:53:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 -- 172.21.15.18:0/2847242767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44240a3240 msgr2=0x7f44240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44240a3240 0x7f44240a5700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4428031550 tx=0x7f4428005de0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 -- 172.21.15.18:0/2847242767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4438106a80 msgr2=0x7f443819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4438106a80 0x7f443819cd10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f443000eb10 tx=0x7f443000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 -- 172.21.15.18:0/2847242767 shutdown_connections 2024-09-19T09:53:49.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f44240a3240 0x7f44240a5700 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4438106a80 0x7f443819cd10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4438101420 0x7f4438198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 --2- 172.21.15.18:0/2847242767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4438100a80 0x7f4438198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:49.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 -- 172.21.15.18:0/2847242767 >> 172.21.15.18:0/2847242767 conn(0x7f44380fc7a0 msgr2=0x7f4438104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:49.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 -- 172.21.15.18:0/2847242767 shutdown_connections 2024-09-19T09:53:49.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:49.885+0000 7f443e1c6640 1 -- 172.21.15.18:0/2847242767 wait complete. 2024-09-19T09:53:50.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:49 smithi018 ceph-mon[30956]: pgmap v383: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:53:50.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:49 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/172339805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:49 smithi049 ceph-mon[34858]: pgmap v383: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:53:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:49 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/172339805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:50.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:49 smithi162 ceph-mon[35174]: pgmap v383: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:53:50.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:49 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/172339805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:53:50.522 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:53:50.548 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '18324320', quiesce took 4.3 seconds. Will release after: 16.05 2024-09-19T09:53:50.650 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:53:50.692 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:53:50.696 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:53:50.696 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:53:50.735 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:53:50.738 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:53:50.738 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T09:53:50.755 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-09-19T09:53:50.756 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-09-19T09:53:50.756 DEBUG:teuthology.orchestra.run.smithi018:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-09-19T09:53:51.200 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:53:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:51.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.898+0000 7ff065ed9640 1 -- 172.21.15.18:0/602104353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff060106f10 msgr2=0x7ff06010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:51.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.898+0000 7ff065ed9640 1 --2- 172.21.15.18:0/602104353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff060106f10 0x7ff06010ea90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff058009ca0 tx=0x7ff05802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.898+0000 7ff065ed9640 1 -- 172.21.15.18:0/602104353 shutdown_connections 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.898+0000 7ff065ed9640 1 --2- 172.21.15.18:0/602104353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff060106f10 0x7ff06010ea90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.898+0000 7ff065ed9640 1 --2- 172.21.15.18:0/602104353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff060102790 0x7ff0601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.898+0000 7ff065ed9640 1 --2- 172.21.15.18:0/602104353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff060101de0 0x7ff0601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.898+0000 7ff065ed9640 1 -- 172.21.15.18:0/602104353 >> 172.21.15.18:0/602104353 conn(0x7ff0600fd8c0 msgr2=0x7ff0600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.898+0000 7ff065ed9640 1 -- 172.21.15.18:0/602104353 shutdown_connections 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.898+0000 7ff065ed9640 1 -- 172.21.15.18:0/602104353 wait complete. 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.899+0000 7ff065ed9640 1 Processor -- start 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.899+0000 7ff065ed9640 1 -- start start 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.899+0000 7ff065ed9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff060101de0 0x7ff0600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.899+0000 7ff065ed9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff060102790 0x7ff060074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.899+0000 7ff065ed9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff060106f10 0x7ff060074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff065ed9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff060111f70 con 0x7ff060101de0 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff065ed9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff060111df0 con 0x7ff060102790 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff065ed9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0601120f0 con 0x7ff060106f10 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff060101de0 0x7ff0600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff060101de0 0x7ff0600744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53416/0 (socket says 172.21.15.18:53416) 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05f7fe640 1 -- 172.21.15.18:0/284297593 learned_addr learned my addr 172.21.15.18:0/284297593 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff056ffd640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff060102790 0x7ff060074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05ffff640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff060106f10 0x7ff060074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05f7fe640 1 -- 172.21.15.18:0/284297593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff060106f10 msgr2=0x7ff060074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff060106f10 0x7ff060074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05f7fe640 1 -- 172.21.15.18:0/284297593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff060102790 msgr2=0x7ff060074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff060102790 0x7ff060074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05f7fe640 1 -- 172.21.15.18:0/284297593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0601a6870 con 0x7ff060101de0 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff056ffd640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff060102790 0x7ff060074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff060101de0 0x7ff0600744f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff05000d950 tx=0x7ff05000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05d7fa640 1 -- 172.21.15.18:0/284297593 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050017070 con 0x7ff060101de0 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05d7fa640 1 -- 172.21.15.18:0/284297593 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff050009c30 con 0x7ff060101de0 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff05d7fa640 1 -- 172.21.15.18:0/284297593 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05000f6b0 con 0x7ff060101de0 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff065ed9640 1 -- 172.21.15.18:0/284297593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0601a6b60 con 0x7ff060101de0 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.900+0000 7ff065ed9640 1 -- 172.21.15.18:0/284297593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0601a70f0 con 0x7ff060101de0 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff05d7fa640 1 -- 172.21.15.18:0/284297593 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff0500109d0 con 0x7ff060101de0 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff0682b2740 1 Processor -- start 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff0682b2740 1 -- start start 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e70b40 0x564762e6f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e6f5d0 0x564762e6fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e7c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff0682b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564762dd52f0 con 0x564762e7a370 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff0682b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564762d7ccf0 con 0x564762e6f5d0 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff0682b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564762dd12b0 con 0x564762e70b40 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff056ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e7c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff05ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e70b40 0x564762e6f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff056ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e7c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53432/0 (socket says 172.21.15.18:53432) 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff056ffd640 1 -- 172.21.15.18:0/2039821910 learned_addr learned my addr 172.21.15.18:0/2039821910 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.903+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/2039821910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e6f5d0 0x564762e6fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff05d7fa640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff04c0a32c0 0x7ff04c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff056ffd640 1 -- 172.21.15.18:0/2039821910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e70b40 msgr2=0x564762e6f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff056ffd640 1 --2- 172.21.15.18:0/2039821910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e70b40 0x564762e6f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff056ffd640 1 -- 172.21.15.18:0/2039821910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e6f5d0 msgr2=0x564762e6fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff056ffd640 1 --2- 172.21.15.18:0/2039821910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e6f5d0 0x564762e6fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff056ffd640 1 -- 172.21.15.18:0/2039821910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564762d613a0 con 0x564762e7a370 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff05ffff640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff04c0a32c0 0x7ff04c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff05d7fa640 1 -- 172.21.15.18:0/284297593 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff0500cf520 con 0x7ff060101de0 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff056ffd640 1 --2- 172.21.15.18:0/2039821910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e7c760 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff04800bcb0 tx=0x7ff04800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bbad0339cb9938 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff055ffb640 1 -- 172.21.15.18:0/2039821910 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff048015070 con 0x564762e7a370 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff055ffb640 1 -- 172.21.15.18:0/2039821910 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff048011920 con 0x564762e7a370 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.904+0000 7ff055ffb640 1 -- 172.21.15.18:0/2039821910 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0480109a0 con 0x564762e7a370 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff0682b2740 1 -- 172.21.15.18:0/2039821910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 msgr2=0x564762e7c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff0682b2740 1 --2- 172.21.15.18:0/2039821910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e7c760 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff04800bcb0 tx=0x7ff04800f730 comp rx=0 tx=0).stop 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff05ffff640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff04c0a32c0 0x7ff04c0a5780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff058005e30 tx=0x7ff0580095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff0682b2740 1 -- 172.21.15.18:0/2039821910 shutdown_connections 2024-09-19T09:53:51.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff0682b2740 1 --2- 172.21.15.18:0/2039821910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e7c760 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff0682b2740 1 --2- 172.21.15.18:0/2039821910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e6f5d0 0x564762e6fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff0682b2740 1 --2- 172.21.15.18:0/2039821910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e70b40 0x564762e6f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff0682b2740 1 -- 172.21.15.18:0/2039821910 >> 172.21.15.18:0/2039821910 conn(0x564762e38310 msgr2=0x564762e6bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff0682b2740 1 -- 172.21.15.18:0/2039821910 shutdown_connections 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff0682b2740 1 -- 172.21.15.18:0/2039821910 wait complete. 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.905+0000 7ff0682b2740 1 -- start start 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff0682b2740 1 Processor -- start 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e6f5d0 0x564762e79d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e70b40 0x564762e76ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e7a370 0x564762e775e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff0682b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564762e7d070 con 0x564762e70b40 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff0682b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564762d90060 con 0x564762e6f5d0 2024-09-19T09:53:51.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff0682b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564762e7d1f0 con 0x564762e7a370 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff0682b2740 10 client.0 _ll_register_callbacks cb 0x564762ae38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff056ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e70b40 0x564762e76ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff056ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e70b40 0x564762e76ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53436/0 (socket says 172.21.15.18:53436) 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff056ffd640 1 -- 172.21.15.18:0/2656009535 learned_addr learned my addr 172.21.15.18:0/2656009535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e6f5d0 0x564762e79d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.906+0000 7ff05ffff640 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e7a370 0x564762e775e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.907+0000 7ff056ffd640 1 -- 172.21.15.18:0/2656009535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e7a370 msgr2=0x564762e775e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.907+0000 7ff056ffd640 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e7a370 0x564762e775e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.907+0000 7ff056ffd640 1 -- 172.21.15.18:0/2656009535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e6f5d0 msgr2=0x564762e79d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.907+0000 7ff056ffd640 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e6f5d0 0x564762e79d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.907+0000 7ff056ffd640 1 -- 172.21.15.18:0/2656009535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564762b463c0 con 0x564762e70b40 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.907+0000 7ff056ffd640 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e70b40 0x564762e76ff0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff048010520 tx=0x7ff048010440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec16e16ef3fcbb64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:51.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.907+0000 7ff03effd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.907+0000 7ff03effd640 1 -- 172.21.15.18:0/2656009535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff048015070 con 0x564762e70b40 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.907+0000 7ff03effd640 1 -- 172.21.15.18:0/2656009535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff048011650 con 0x564762e70b40 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.907+0000 7ff0682b2740 1 -- 172.21.15.18:0/2656009535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff048011920 con 0x564762e70b40 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff03effd640 1 -- 172.21.15.18:0/2656009535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff048011ad0 con 0x564762e70b40 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff0682b2740 10 client.15879 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff0682b2740 1 -- 172.21.15.18:0/2656009535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564762e88ae0 con 0x564762e70b40 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff03effd640 1 -- 172.21.15.18:0/2656009535 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff048011920 con 0x564762e70b40 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff03effd640 1 -- 172.21.15.18:0/2656009535 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff048010950 con 0x564762e70b40 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff0682b2740 10 client.15879 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff0682b2740 10 client.15879 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:53:51.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff0682b2740 20 client.15879 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:51.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff0682b2740 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x564762e89f40 0x564762e8c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff0682b2740 4 client.15879 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:51.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.908+0000 7ff0682b2740 1 -- 172.21.15.18:0/2656009535 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564762de2860 con 0x564762e89f40 2024-09-19T09:53:51.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.909+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x564762e89f40 0x564762e8c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.909+0000 7ff03effd640 10 client.15879 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:51.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.909+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x564762e89f40 0x564762e8c330 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b750d723db7865a2 server_cookie=8888977add01d080 in_seq=0 out_seq=0 2024-09-19T09:53:51.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.909+0000 7ff03effd640 1 -- 172.21.15.18:0/2656009535 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564762de2860 con 0x564762e89f40 2024-09-19T09:53:51.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.909+0000 7ff03effd640 10 client.15879 handle_command_reply: tid=0 2024-09-19T09:53:51.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.909+0000 7ff0682b2740 1 client.15879 shutdown 2024-09-19T09:53:51.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 1 -- 172.21.15.18:0/2656009535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e70b40 msgr2=0x564762e76ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:51.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e70b40 0x564762e76ff0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff048010520 tx=0x7ff048010440 comp rx=0 tx=0).stop 2024-09-19T09:53:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 1 -- 172.21.15.18:0/2656009535 shutdown_connections 2024-09-19T09:53:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x564762e89f40 0x564762e8c330 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e7a370 0x564762e775e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e70b40 0x564762e76ff0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 1 --2- 172.21.15.18:0/2656009535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e6f5d0 0x564762e79d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 1 -- 172.21.15.18:0/2656009535 >> 172.21.15.18:0/2656009535 conn(0x564762e38310 msgr2=0x564762e71960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff03effd640 0 client.15879 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 1 -- 172.21.15.18:0/2656009535 shutdown_connections 2024-09-19T09:53:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 1 -- 172.21.15.18:0/2656009535 wait complete. 2024-09-19T09:53:51.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.910+0000 7ff0682b2740 20 client.15879 trim_cache size 0 max 16384 2024-09-19T09:53:51.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff0682b2740 1 Processor -- start 2024-09-19T09:53:51.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff0682b2740 1 -- start start 2024-09-19T09:53:51.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e6f5d0 0x564762e86310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 0x564762e75fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e7a370 0x564762e91ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff0682b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0601af670 con 0x564762e6f5d0 2024-09-19T09:53:51.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff0682b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff0601b11b0 con 0x564762e70b40 2024-09-19T09:53:51.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff0682b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0601afd40 con 0x564762e7a370 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff05f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e6f5d0 0x564762e86310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff05f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e6f5d0 0x564762e86310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53442/0 (socket says 172.21.15.18:53442) 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff05f7fe640 1 -- 172.21.15.18:0/290118254 learned_addr learned my addr 172.21.15.18:0/290118254 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff056ffd640 1 --2- 172.21.15.18:0/290118254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 0x564762e75fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff05ffff640 1 --2- 172.21.15.18:0/290118254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e7a370 0x564762e91ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.923+0000 7ff05f7fe640 1 -- 172.21.15.18:0/290118254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e7a370 msgr2=0x564762e91ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/290118254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e7a370 0x564762e91ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff05f7fe640 1 -- 172.21.15.18:0/290118254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 msgr2=0x564762e75fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/290118254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 0x564762e75fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff05f7fe640 1 -- 172.21.15.18:0/290118254 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564762e79960 con 0x564762e6f5d0 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff056ffd640 1 --2- 172.21.15.18:0/290118254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 0x564762e75fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:51.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/290118254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e6f5d0 0x564762e86310 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff0500058c0 tx=0x7ff050086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6173a76c5a1c556c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:51.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff0557fa640 1 -- 172.21.15.18:0/290118254 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0500b3070 con 0x564762e6f5d0 2024-09-19T09:53:51.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff0557fa640 1 -- 172.21.15.18:0/290118254 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff05009c270 con 0x564762e6f5d0 2024-09-19T09:53:51.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff0557fa640 1 -- 172.21.15.18:0/290118254 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050020040 con 0x564762e6f5d0 2024-09-19T09:53:51.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff0682b2740 1 -- 172.21.15.18:0/290118254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e6f5d0 msgr2=0x564762e86310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:51.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.924+0000 7ff0682b2740 1 --2- 172.21.15.18:0/290118254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e6f5d0 0x564762e86310 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff0500058c0 tx=0x7ff050086040 comp rx=0 tx=0).stop 2024-09-19T09:53:51.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 -- 172.21.15.18:0/290118254 shutdown_connections 2024-09-19T09:53:51.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 --2- 172.21.15.18:0/290118254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e7a370 0x564762e91ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 --2- 172.21.15.18:0/290118254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 0x564762e75fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 --2- 172.21.15.18:0/290118254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e6f5d0 0x564762e86310 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 -- 172.21.15.18:0/290118254 >> 172.21.15.18:0/290118254 conn(0x564762e38310 msgr2=0x564762e758c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:51.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 -- 172.21.15.18:0/290118254 shutdown_connections 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 -- 172.21.15.18:0/290118254 wait complete. 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 -- start start 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 Processor -- start 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e6f5d0 0x564762e82660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 0x564762e82ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e73800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0601b0ae0 con 0x564762e7a370 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff0601b0410 con 0x564762e70b40 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0601ad650 con 0x564762e6f5d0 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.925+0000 7ff0682b2740 10 client.0 _ll_register_callbacks cb 0x7ff050097e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff05ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e73800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff05ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e73800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53454/0 (socket says 172.21.15.18:53454) 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff05ffff640 1 -- 172.21.15.18:0/3242310735 learned_addr learned my addr 172.21.15.18:0/3242310735 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e6f5d0 0x564762e82660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff056ffd640 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 0x564762e82ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff05ffff640 1 -- 172.21.15.18:0/3242310735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e6f5d0 msgr2=0x564762e82660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff05ffff640 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e6f5d0 0x564762e82660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff05ffff640 1 -- 172.21.15.18:0/3242310735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 msgr2=0x564762e82ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff05ffff640 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 0x564762e82ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff05ffff640 1 -- 172.21.15.18:0/3242310735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564762e73e70 con 0x564762e7a370 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff056ffd640 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 0x564762e82ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff05ffff640 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e73800 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff058009ca0 tx=0x7ff058041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e62459ed20a46d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff03effd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff03effd640 1 -- 172.21.15.18:0/3242310735 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058058060 con 0x564762e7a370 2024-09-19T09:53:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff03effd640 1 -- 172.21.15.18:0/3242310735 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff05802fc20 con 0x564762e7a370 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.926+0000 7ff0682b2740 1 -- 172.21.15.18:0/3242310735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff05009c270 con 0x564762e7a370 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff03effd640 1 -- 172.21.15.18:0/3242310735 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff05802fe20 con 0x564762e7a370 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff0682b2740 10 client.15885 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff0682b2740 1 -- 172.21.15.18:0/3242310735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564762ef43f0 con 0x564762e7a370 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff03effd640 1 -- 172.21.15.18:0/3242310735 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff05009c270 con 0x564762e7a370 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff03effd640 1 -- 172.21.15.18:0/3242310735 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff05805f6e0 con 0x564762e7a370 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff0682b2740 10 client.15885 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff0682b2740 10 client.15885 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff0682b2740 20 client.15885 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff0682b2740 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x564762ef4b50 0x564762ef6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff0682b2740 4 client.15885 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:51.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff0682b2740 1 -- 172.21.15.18:0/3242310735 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564762ddcd70 con 0x564762ef4b50 2024-09-19T09:53:51.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x564762ef4b50 0x564762ef6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:51.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff05f7fe640 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x564762ef4b50 0x564762ef6f70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=36dc6befa6f3bef3 server_cookie=73cd6f119939ce96 in_seq=0 out_seq=0 2024-09-19T09:53:51.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.927+0000 7ff03effd640 10 client.15885 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:51.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff03effd640 1 -- 172.21.15.18:0/3242310735 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564762ddcd70 con 0x564762ef4b50 2024-09-19T09:53:51.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff03effd640 10 client.15885 handle_command_reply: tid=0 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 client.15885 shutdown 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 -- 172.21.15.18:0/3242310735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 msgr2=0x564762e73800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e73800 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff058009ca0 tx=0x7ff058041000 comp rx=0 tx=0).stop 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 -- 172.21.15.18:0/3242310735 shutdown_connections 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x564762ef4b50 0x564762ef6f70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564762e7a370 0x564762e73800 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564762e70b40 0x564762e82ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 --2- 172.21.15.18:0/3242310735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564762e6f5d0 0x564762e82660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 -- 172.21.15.18:0/3242310735 >> 172.21.15.18:0/3242310735 conn(0x564762e38310 msgr2=0x564762e760e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff03effd640 0 client.15885 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 -- 172.21.15.18:0/3242310735 shutdown_connections 2024-09-19T09:53:51.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 1 -- 172.21.15.18:0/3242310735 wait complete. 2024-09-19T09:53:51.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.928+0000 7ff0682b2740 20 client.15885 trim_cache size 0 max 16384 2024-09-19T09:53:51.937 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:51.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 -- 172.21.15.18:0/284297593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff04c0a32c0 msgr2=0x7ff04c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:51.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff04c0a32c0 0x7ff04c0a5780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff058005e30 tx=0x7ff0580095c0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 -- 172.21.15.18:0/284297593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff060101de0 msgr2=0x7ff0600744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:51.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff060101de0 0x7ff0600744f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff05000d950 tx=0x7ff05000de10 comp rx=0 tx=0).stop 2024-09-19T09:53:51.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 -- 172.21.15.18:0/284297593 shutdown_connections 2024-09-19T09:53:51.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff04c0a32c0 0x7ff04c0a5780 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff060106f10 0x7ff060074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff060102790 0x7ff060074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 --2- 172.21.15.18:0/284297593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff060101de0 0x7ff0600744f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:51.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 -- 172.21.15.18:0/284297593 >> 172.21.15.18:0/284297593 conn(0x7ff0600fd8c0 msgr2=0x7ff0600fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:51.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 -- 172.21.15.18:0/284297593 shutdown_connections 2024-09-19T09:53:51.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:51.929+0000 7ff065ed9640 1 -- 172.21.15.18:0/284297593 wait complete. 2024-09-19T09:53:52.246 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:51 smithi018 ceph-mon[30956]: pgmap v384: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-09-19T09:53:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.351+0000 7f758e4d0640 1 -- 172.21.15.18:0/2955302279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7588103710 msgr2=0x7f7588109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.351+0000 7f758e4d0640 1 --2- 172.21.15.18:0/2955302279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7588103710 0x7f7588109fa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7580009ca0 tx=0x7f758002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.351+0000 7f758e4d0640 1 -- 172.21.15.18:0/2955302279 shutdown_connections 2024-09-19T09:53:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.351+0000 7f758e4d0640 1 --2- 172.21.15.18:0/2955302279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7588103710 0x7f7588109fa0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.351+0000 7f758e4d0640 1 --2- 172.21.15.18:0/2955302279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7588102d50 0x7f75881031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.351+0000 7f758e4d0640 1 --2- 172.21.15.18:0/2955302279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7588101b60 0x7f7588101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.351+0000 7f758e4d0640 1 -- 172.21.15.18:0/2955302279 >> 172.21.15.18:0/2955302279 conn(0x7f75880fd2e0 msgr2=0x7f75880ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.351+0000 7f758e4d0640 1 -- 172.21.15.18:0/2955302279 shutdown_connections 2024-09-19T09:53:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.351+0000 7f758e4d0640 1 -- 172.21.15.18:0/2955302279 wait complete. 2024-09-19T09:53:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f758e4d0640 1 Processor -- start 2024-09-19T09:53:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f758e4d0640 1 -- start start 2024-09-19T09:53:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f758e4d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7588101b60 0x7f7588075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f758e4d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7588102d50 0x7f75880745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f758e4d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7588103710 0x7f7588074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f758e4d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f758810d7e0 con 0x7f7588102d50 2024-09-19T09:53:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f758e4d0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f758810d660 con 0x7f7588101b60 2024-09-19T09:53:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f758e4d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f758810d960 con 0x7f7588103710 2024-09-19T09:53:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f75877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7588102d50 0x7f75880745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f75877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7588102d50 0x7f75880745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53476/0 (socket says 172.21.15.18:53476) 2024-09-19T09:53:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f75877fe640 1 -- 172.21.15.18:0/277103707 learned_addr learned my addr 172.21.15.18:0/277103707 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f758ca6d640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7588103710 0x7f7588074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.352+0000 7f7587fff640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7588101b60 0x7f7588075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f75877fe640 1 -- 172.21.15.18:0/277103707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7588103710 msgr2=0x7f7588074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f75877fe640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7588103710 0x7f7588074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f75877fe640 1 -- 172.21.15.18:0/277103707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7588101b60 msgr2=0x7f7588075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f75877fe640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7588101b60 0x7f7588075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f75877fe640 1 -- 172.21.15.18:0/277103707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75880753b0 con 0x7f7588102d50 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f75877fe640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7588102d50 0x7f75880745e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f757c00d770 tx=0x7f757c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f75857fa640 1 -- 172.21.15.18:0/277103707 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c017070 con 0x7f7588102d50 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f75857fa640 1 -- 172.21.15.18:0/277103707 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f757c005500 con 0x7f7588102d50 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f758e4d0640 1 -- 172.21.15.18:0/277103707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75881a1ef0 con 0x7f7588102d50 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f75857fa640 1 -- 172.21.15.18:0/277103707 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c004e00 con 0x7f7588102d50 2024-09-19T09:53:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.353+0000 7f758e4d0640 1 -- 172.21.15.18:0/277103707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75881a2300 con 0x7f7588102d50 2024-09-19T09:53:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.355+0000 7f75857fa640 1 -- 172.21.15.18:0/277103707 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f757c004fa0 con 0x7f7588102d50 2024-09-19T09:53:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f759126d740 1 Processor -- start 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f759126d740 1 -- start start 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f75857fa640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32f0 0x7f75700a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f759126d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d49a0 0x55eece6d4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f759126d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6d9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f759126d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6da370 0x55eece6dc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f759126d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55eece6382f0 con 0x55eece6d52e0 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f759126d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55eece5e0270 con 0x55eece6d49a0 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f759126d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55eece6342b0 con 0x55eece6da370 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f75877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6d9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f758ca6d640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32f0 0x7f75700a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f75857fa640 1 -- 172.21.15.18:0/277103707 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f757c0cf230 con 0x7f7588102d50 2024-09-19T09:53:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f75877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6d9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53486/0 (socket says 172.21.15.18:53486) 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f75877fe640 1 -- 172.21.15.18:0/1878028825 learned_addr learned my addr 172.21.15.18:0/1878028825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.356+0000 7f7587fff640 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d49a0 0x55eece6d4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f758ca6d640 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6da370 0x55eece6dc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f75877fe640 1 -- 172.21.15.18:0/1878028825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6da370 msgr2=0x55eece6dc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f75877fe640 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6da370 0x55eece6dc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f75877fe640 1 -- 172.21.15.18:0/1878028825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d49a0 msgr2=0x55eece6d4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f75877fe640 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d49a0 0x55eece6d4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f75877fe640 1 -- 172.21.15.18:0/1878028825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eece5df340 con 0x55eece6d52e0 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f758ca6d640 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6da370 0x55eece6dc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f7587fff640 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d49a0 0x55eece6d4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f75877fe640 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6d9da0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f757c009610 tx=0x7f757c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cca3580ebf018a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f758ca6d640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32f0 0x7f75700a57b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7580004af0 tx=0x7f7580004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f756e7fc640 1 -- 172.21.15.18:0/1878028825 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c020070 con 0x55eece6d52e0 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f756e7fc640 1 -- 172.21.15.18:0/1878028825 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f757c0046c0 con 0x55eece6d52e0 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.357+0000 7f756e7fc640 1 -- 172.21.15.18:0/1878028825 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c005290 con 0x55eece6d52e0 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.358+0000 7f759126d740 1 -- 172.21.15.18:0/1878028825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 msgr2=0x55eece6d9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.358+0000 7f759126d740 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6d9da0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f757c009610 tx=0x7f757c005760 comp rx=0 tx=0).stop 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.358+0000 7f759126d740 1 -- 172.21.15.18:0/1878028825 shutdown_connections 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.358+0000 7f759126d740 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6da370 0x55eece6dc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.358+0000 7f759126d740 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6d9da0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.358+0000 7f759126d740 1 --2- 172.21.15.18:0/1878028825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d49a0 0x55eece6d4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.358+0000 7f759126d740 1 -- 172.21.15.18:0/1878028825 >> 172.21.15.18:0/1878028825 conn(0x55eece6d0010 msgr2=0x55eece6d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.358+0000 7f759126d740 1 -- 172.21.15.18:0/1878028825 shutdown_connections 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.358+0000 7f759126d740 1 -- 172.21.15.18:0/1878028825 wait complete. 2024-09-19T09:53:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.358+0000 7f759126d740 1 -- start start 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f759126d740 1 Processor -- start 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f759126d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6debc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f759126d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6d52e0 0x55eece6df100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f759126d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 0x55eece6e6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f759126d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55eece6dd2e0 con 0x55eece6d49a0 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f759126d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55eece5c1290 con 0x55eece6da370 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f759126d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55eece6dd460 con 0x55eece6d52e0 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f759126d740 10 client.0 _ll_register_callbacks cb 0x55eece5f2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f7587fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6debc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f7587fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6debc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53492/0 (socket says 172.21.15.18:53492) 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f7587fff640 1 -- 172.21.15.18:0/2445701928 learned_addr learned my addr 172.21.15.18:0/2445701928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f75877fe640 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6d52e0 0x55eece6df100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f758ca6d640 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 0x55eece6e6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f7587fff640 1 -- 172.21.15.18:0/2445701928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6d52e0 msgr2=0x55eece6df100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f7587fff640 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6d52e0 0x55eece6df100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f7587fff640 1 -- 172.21.15.18:0/2445701928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 msgr2=0x55eece6e6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f7587fff640 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 0x55eece6e6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f7587fff640 1 -- 172.21.15.18:0/2445701928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eece34b210 con 0x55eece6d49a0 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f7587fff640 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6debc0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7578010800 tx=0x7f7578010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbb0784a2ebb82b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f75677fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.359+0000 7f75677fe640 1 -- 172.21.15.18:0/2445701928 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578004240 con 0x55eece6d49a0 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f75677fe640 1 -- 172.21.15.18:0/2445701928 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f75780043e0 con 0x55eece6d49a0 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f759126d740 1 -- 172.21.15.18:0/2445701928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eece645a20 con 0x55eece6d49a0 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f75677fe640 1 -- 172.21.15.18:0/2445701928 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f757800f980 con 0x55eece6d49a0 2024-09-19T09:53:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f759126d740 10 client.15897 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f759126d740 1 -- 172.21.15.18:0/2445701928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eece417620 con 0x55eece6d49a0 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f75677fe640 1 -- 172.21.15.18:0/2445701928 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55eece645a20 con 0x55eece6d49a0 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f75677fe640 1 -- 172.21.15.18:0/2445701928 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7578025420 con 0x55eece6d49a0 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f759126d740 10 client.15897 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f759126d740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f759126d740 20 client.15897 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f759126d740 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eece6ea910 0x55eece6ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f759126d740 4 client.15897 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.360+0000 7f759126d740 1 -- 172.21.15.18:0/2445701928 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eece63fd70 con 0x55eece6ea910 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.361+0000 7f75877fe640 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eece6ea910 0x55eece6ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.361+0000 7f75677fe640 10 client.15897 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.361+0000 7f75877fe640 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eece6ea910 0x55eece6ecdb0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6862d36bbec2d2e4 server_cookie=9e99c9a18aa49d0f in_seq=0 out_seq=0 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f75677fe640 1 -- 172.21.15.18:0/2445701928 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eece63fd70 con 0x55eece6ea910 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f75677fe640 10 client.15897 handle_command_reply: tid=0 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 client.15897 shutdown 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 -- 172.21.15.18:0/2445701928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 msgr2=0x55eece6debc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6debc0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7578010800 tx=0x7f7578010cc0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 -- 172.21.15.18:0/2445701928 shutdown_connections 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eece6ea910 0x55eece6ecdb0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 0x55eece6e6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6d52e0 0x55eece6df100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f75677fe640 0 client.15897 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 --2- 172.21.15.18:0/2445701928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6debc0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 -- 172.21.15.18:0/2445701928 >> 172.21.15.18:0/2445701928 conn(0x55eece6d0010 msgr2=0x55eece6d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 -- 172.21.15.18:0/2445701928 shutdown_connections 2024-09-19T09:53:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 1 -- 172.21.15.18:0/2445701928 wait complete. 2024-09-19T09:53:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.362+0000 7f759126d740 20 client.15897 trim_cache size 0 max 16384 2024-09-19T09:53:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f759126d740 1 Processor -- start 2024-09-19T09:53:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f759126d740 1 -- start start 2024-09-19T09:53:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f759126d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f759126d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d52e0 0x55eece6e6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f759126d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6da370 0x55eece6d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f759126d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f75881ab170 con 0x55eece6d49a0 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f759126d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75881accb0 con 0x55eece6d52e0 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f759126d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75881ab840 con 0x55eece6da370 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f7587fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f7587fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53504/0 (socket says 172.21.15.18:53504) 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f7587fff640 1 -- 172.21.15.18:0/1644590280 learned_addr learned my addr 172.21.15.18:0/1644590280 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f75877fe640 1 --2- 172.21.15.18:0/1644590280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d52e0 0x55eece6e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f7587fff640 1 -- 172.21.15.18:0/1644590280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6da370 msgr2=0x55eece6d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f7587fff640 1 --2- 172.21.15.18:0/1644590280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6da370 0x55eece6d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f7587fff640 1 -- 172.21.15.18:0/1644590280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d52e0 msgr2=0x55eece6e6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f7587fff640 1 --2- 172.21.15.18:0/1644590280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d52e0 0x55eece6e6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f7587fff640 1 -- 172.21.15.18:0/1644590280 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eece6de700 con 0x55eece6d49a0 2024-09-19T09:53:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.377+0000 7f7587fff640 1 --2- 172.21.15.18:0/1644590280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6cf0b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7578025f50 tx=0x7f7578025f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823283127baeabf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f756dffb640 1 -- 172.21.15.18:0/1644590280 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757800a340 con 0x55eece6d49a0 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f756dffb640 1 -- 172.21.15.18:0/1644590280 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7578025b00 con 0x55eece6d49a0 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f756dffb640 1 -- 172.21.15.18:0/1644590280 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75780035f0 con 0x55eece6d49a0 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f759126d740 1 -- 172.21.15.18:0/1644590280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 msgr2=0x55eece6cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f759126d740 1 --2- 172.21.15.18:0/1644590280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6cf0b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7578025f50 tx=0x7f7578025f80 comp rx=0 tx=0).stop 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f759126d740 1 -- 172.21.15.18:0/1644590280 shutdown_connections 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f759126d740 1 --2- 172.21.15.18:0/1644590280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6da370 0x55eece6d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f759126d740 1 --2- 172.21.15.18:0/1644590280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6d52e0 0x55eece6e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f759126d740 1 --2- 172.21.15.18:0/1644590280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d49a0 0x55eece6cf0b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f759126d740 1 -- 172.21.15.18:0/1644590280 >> 172.21.15.18:0/1644590280 conn(0x55eece6d0010 msgr2=0x55eece6ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f759126d740 1 -- 172.21.15.18:0/1644590280 shutdown_connections 2024-09-19T09:53:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f759126d740 1 -- 172.21.15.18:0/1644590280 wait complete. 2024-09-19T09:53:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.378+0000 7f759126d740 1 -- start start 2024-09-19T09:53:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f759126d740 1 Processor -- start 2024-09-19T09:53:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f759126d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6d49a0 0x55eece6e3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f759126d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6e3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f759126d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 0x55eece6e46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f759126d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f75881ac5e0 con 0x55eece6d52e0 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f759126d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75881abf10 con 0x55eece6da370 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f759126d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75881a9150 con 0x55eece6d49a0 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f759126d740 10 client.0 _ll_register_callbacks cb 0x7f757800a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f75877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f75877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6e3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53508/0 (socket says 172.21.15.18:53508) 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f75877fe640 1 -- 172.21.15.18:0/3956022851 learned_addr learned my addr 172.21.15.18:0/3956022851 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f758ca6d640 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 0x55eece6e46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f7587fff640 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6d49a0 0x55eece6e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f75877fe640 1 -- 172.21.15.18:0/3956022851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6d49a0 msgr2=0x55eece6e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f75877fe640 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6d49a0 0x55eece6e3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f75877fe640 1 -- 172.21.15.18:0/3956022851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 msgr2=0x55eece6e46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f75877fe640 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 0x55eece6e46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f75877fe640 1 -- 172.21.15.18:0/3956022851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eece6e4cb0 con 0x55eece6d52e0 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.379+0000 7f758ca6d640 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 0x55eece6e46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f75877fe640 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6e3690 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f757c097d90 tx=0x7f757c097bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b00f3b1ab0e936 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f75677fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f75677fe640 1 -- 172.21.15.18:0/3956022851 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c0b9060 con 0x55eece6d52e0 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f75677fe640 1 -- 172.21.15.18:0/3956022851 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f757c0860b0 con 0x55eece6d52e0 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f759126d740 1 -- 172.21.15.18:0/3956022851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7578025b00 con 0x55eece6d52e0 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f75677fe640 1 -- 172.21.15.18:0/3956022851 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f757c0b3030 con 0x55eece6d52e0 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f759126d740 10 client.15903 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f759126d740 1 -- 172.21.15.18:0/3956022851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eece6e5fc0 con 0x55eece6d52e0 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f75677fe640 1 -- 172.21.15.18:0/3956022851 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7578025b00 con 0x55eece6d52e0 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f75677fe640 1 -- 172.21.15.18:0/3956022851 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f757c097fa0 con 0x55eece6d52e0 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f759126d740 10 client.15903 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f759126d740 10 client.15903 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f759126d740 20 client.15903 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f759126d740 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eece755650 0x55eece757a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f759126d740 4 client.15903 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:53:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.380+0000 7f759126d740 1 -- 172.21.15.18:0/3956022851 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eece5bc900 con 0x55eece755650 2024-09-19T09:53:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.381+0000 7f7587fff640 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eece755650 0x55eece757a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.381+0000 7f75677fe640 10 client.15903 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.381+0000 7f7587fff640 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eece755650 0x55eece757a70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23fe9bfe316cb9a4 server_cookie=b0fc8c8ae4ee83ea in_seq=0 out_seq=0 2024-09-19T09:53:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f75677fe640 1 -- 172.21.15.18:0/3956022851 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eece5bc900 con 0x55eece755650 2024-09-19T09:53:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f75677fe640 10 client.15903 handle_command_reply: tid=0 2024-09-19T09:53:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 client.15903 shutdown 2024-09-19T09:53:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 -- 172.21.15.18:0/3956022851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 msgr2=0x55eece6e3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6e3690 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f757c097d90 tx=0x7f757c097bd0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 -- 172.21.15.18:0/3956022851 shutdown_connections 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eece755650 0x55eece757a70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eece6da370 0x55eece6e46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f75677fe640 0 client.15903 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eece6d52e0 0x55eece6e3690 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 --2- 172.21.15.18:0/3956022851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eece6d49a0 0x55eece6e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 -- 172.21.15.18:0/3956022851 >> 172.21.15.18:0/3956022851 conn(0x55eece6d0010 msgr2=0x55eece6cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 -- 172.21.15.18:0/3956022851 shutdown_connections 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 1 -- 172.21.15.18:0/3956022851 wait complete. 2024-09-19T09:53:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.387+0000 7f759126d740 20 client.15903 trim_cache size 0 max 16384 2024-09-19T09:53:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:53:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:53:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:53:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:53:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 -- 172.21.15.18:0/277103707 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32f0 msgr2=0x7f75700a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32f0 0x7f75700a57b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7580004af0 tx=0x7f7580004a40 comp rx=0 tx=0).stop 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 -- 172.21.15.18:0/277103707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7588102d50 msgr2=0x7f75880745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7588102d50 0x7f75880745e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f757c00d770 tx=0x7f757c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 -- 172.21.15.18:0/277103707 shutdown_connections 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f75700a32f0 0x7f75700a57b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7588103710 0x7f7588074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7588102d50 0x7f75880745e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 --2- 172.21.15.18:0/277103707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7588101b60 0x7f7588075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 -- 172.21.15.18:0/277103707 >> 172.21.15.18:0/277103707 conn(0x7f75880fd2e0 msgr2=0x7f7588105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 -- 172.21.15.18:0/277103707 shutdown_connections 2024-09-19T09:53:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:53:52.388+0000 7f758e4d0640 1 -- 172.21.15.18:0/277103707 wait complete. 2024-09-19T09:53:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:51 smithi049 ceph-mon[34858]: pgmap v384: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-09-19T09:53:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:51 smithi162 ceph-mon[35174]: pgmap v384: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-09-19T09:53:52.674 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:53:52.930 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.425+0000 7f56cd732640 1 -- 172.21.15.18:0/509000411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56c8106c30 msgr2=0x7f56c8107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.425+0000 7f56cd732640 1 --2- 172.21.15.18:0/509000411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56c8106c30 0x7f56c8107010 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f56b8009900 tx=0x7f56b802a410 comp rx=0 tx=0).stop 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.425+0000 7f56cd732640 1 -- 172.21.15.18:0/509000411 shutdown_connections 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.425+0000 7f56cd732640 1 --2- 172.21.15.18:0/509000411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8101b40 0x7f56c810da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.425+0000 7f56cd732640 1 --2- 172.21.15.18:0/509000411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c81011a0 0x7f56c8101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.425+0000 7f56cd732640 1 --2- 172.21.15.18:0/509000411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56c8106c30 0x7f56c8107010 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.425+0000 7f56cd732640 1 -- 172.21.15.18:0/509000411 >> 172.21.15.18:0/509000411 conn(0x7f56c8077210 msgr2=0x7f56c80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.425+0000 7f56cd732640 1 -- 172.21.15.18:0/509000411 shutdown_connections 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.425+0000 7f56cd732640 1 -- 172.21.15.18:0/509000411 wait complete. 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56cd732640 1 Processor -- start 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56cd732640 1 -- start start 2024-09-19T09:53:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56cd732640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56c81011a0 0x7f56c8199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56cd732640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c8101b40 0x7f56c8199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56cd732640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8106c30 0x7f56c81a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56cd732640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56c8110fc0 con 0x7f56c81011a0 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56cd732640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f56c8110e40 con 0x7f56c8106c30 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56cd732640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56c8111140 con 0x7f56c8101b40 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56c6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56c81011a0 0x7f56c8199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56c6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56c81011a0 0x7f56c8199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53530/0 (socket says 172.21.15.18:53530) 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.426+0000 7f56c6ffd640 1 -- 172.21.15.18:0/3807558796 learned_addr learned my addr 172.21.15.18:0/3807558796 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56c77fe640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8106c30 0x7f56c81a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56c67fc640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c8101b40 0x7f56c8199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56c6ffd640 1 -- 172.21.15.18:0/3807558796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c8101b40 msgr2=0x7f56c8199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c8101b40 0x7f56c8199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56c6ffd640 1 -- 172.21.15.18:0/3807558796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8106c30 msgr2=0x7f56c81a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8106c30 0x7f56c81a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56c6ffd640 1 -- 172.21.15.18:0/3807558796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c81a4a10 con 0x7f56c81011a0 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56c67fc640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c8101b40 0x7f56c8199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56c81011a0 0x7f56c8199450 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f56b8006010 tx=0x7f56b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56affff640 1 -- 172.21.15.18:0/3807558796 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b803f030 con 0x7f56c81011a0 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56affff640 1 -- 172.21.15.18:0/3807558796 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56b8003ce0 con 0x7f56c81011a0 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56cd732640 1 -- 172.21.15.18:0/3807558796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c81a4be0 con 0x7f56c81011a0 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56affff640 1 -- 172.21.15.18:0/3807558796 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b8035070 con 0x7f56c81011a0 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.427+0000 7f56cd732640 1 -- 172.21.15.18:0/3807558796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c81a5090 con 0x7f56c81011a0 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.429+0000 7f56affff640 1 -- 172.21.15.18:0/3807558796 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f56b8042030 con 0x7f56c81011a0 2024-09-19T09:53:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56cfb0b740 1 Processor -- start 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56cfb0b740 1 -- start start 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a41090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 0x564221a41a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a4e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5642219a72f0 con 0x564221a42b40 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56422194ecf0 con 0x564221a4c370 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5642219a32b0 con 0x564221a415d0 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56c77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a41090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56c77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a41090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53546/0 (socket says 172.21.15.18:53546) 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56c77fe640 1 -- 172.21.15.18:0/2614491006 learned_addr learned my addr 172.21.15.18:0/2614491006 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/2614491006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 0x564221a41a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56affff640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56b00a32c0 0x7f56b00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56c67fc640 1 --2- 172.21.15.18:0/2614491006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a4e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.430+0000 7f56c77fe640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56b00a32c0 0x7f56b00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56c77fe640 1 -- 172.21.15.18:0/2614491006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 msgr2=0x564221a41a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56c77fe640 1 --2- 172.21.15.18:0/2614491006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 0x564221a41a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56c77fe640 1 -- 172.21.15.18:0/2614491006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 msgr2=0x564221a4e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56c77fe640 1 --2- 172.21.15.18:0/2614491006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a4e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56affff640 1 -- 172.21.15.18:0/3807558796 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f56b80efe90 con 0x7f56c81011a0 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56c77fe640 1 -- 172.21.15.18:0/2614491006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642219333a0 con 0x564221a42b40 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56c67fc640 1 --2- 172.21.15.18:0/2614491006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a4e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56c77fe640 1 --2- 172.21.15.18:0/2614491006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a41090 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f56c0005f40 tx=0x7f56c0014f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9a114a87648929 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56ad7fa640 1 -- 172.21.15.18:0/2614491006 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0012d90 con 0x564221a42b40 2024-09-19T09:53:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56ad7fa640 1 -- 172.21.15.18:0/2614491006 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c0023070 con 0x564221a42b40 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.431+0000 7f56ad7fa640 1 -- 172.21.15.18:0/2614491006 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c000e360 con 0x564221a42b40 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 -- 172.21.15.18:0/2614491006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 msgr2=0x564221a41090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/2614491006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a41090 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f56c0005f40 tx=0x7f56c0014f70 comp rx=0 tx=0).stop 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56c77fe640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56b00a32c0 0x7f56b00a5780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f56c0022000 tx=0x7f56c0020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 -- 172.21.15.18:0/2614491006 shutdown_connections 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/2614491006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a4e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/2614491006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 0x564221a41a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/2614491006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a41090 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 -- 172.21.15.18:0/2614491006 >> 172.21.15.18:0/2614491006 conn(0x564221a0a310 msgr2=0x564221a3dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 -- 172.21.15.18:0/2614491006 shutdown_connections 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 -- 172.21.15.18:0/2614491006 wait complete. 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 -- start start 2024-09-19T09:53:53.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 Processor -- start 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a4bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a42b40 0x564221a48ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564221a4f070 con 0x564221a415d0 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564221962060 con 0x564221a4c370 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.432+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564221a4f1f0 con 0x564221a42b40 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56cfb0b740 10 client.0 _ll_register_callbacks cb 0x5642216b58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a4bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a4bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53550/0 (socket says 172.21.15.18:53550) 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c6ffd640 1 -- 172.21.15.18:0/3073080496 learned_addr learned my addr 172.21.15.18:0/3073080496 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c67fc640 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a42b40 0x564221a48ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c77fe640 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c6ffd640 1 -- 172.21.15.18:0/3073080496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a42b40 msgr2=0x564221a48ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a42b40 0x564221a48ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c6ffd640 1 -- 172.21.15.18:0/3073080496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 msgr2=0x564221a495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c6ffd640 1 -- 172.21.15.18:0/3073080496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642217183c0 con 0x564221a415d0 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c77fe640 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a4bd40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f56b80bc2a0 tx=0x7f56b80b8140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fd358bbb98925f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56aaff5640 1 -- 172.21.15.18:0/3073080496 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b8049070 con 0x564221a415d0 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56aaff5640 1 -- 172.21.15.18:0/3073080496 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f56b80bc800 con 0x564221a415d0 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56cfb0b740 1 -- 172.21.15.18:0/3073080496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c0023070 con 0x564221a415d0 2024-09-19T09:53:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56aaff5640 1 -- 172.21.15.18:0/3073080496 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f56b80bc0e0 con 0x564221a415d0 2024-09-19T09:53:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56cfb0b740 10 client.15915 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.433+0000 7f56cfb0b740 1 -- 172.21.15.18:0/3073080496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564221a5aae0 con 0x564221a415d0 2024-09-19T09:53:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.434+0000 7f56aaff5640 1 -- 172.21.15.18:0/3073080496 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c0023070 con 0x564221a415d0 2024-09-19T09:53:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.434+0000 7f56aaff5640 1 -- 172.21.15.18:0/3073080496 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f56b80c4d80 con 0x564221a415d0 2024-09-19T09:53:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.434+0000 7f56cfb0b740 10 client.15915 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.434+0000 7f56cfb0b740 10 client.15915 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:53:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.434+0000 7f56cfb0b740 20 client.15915 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.434+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564221a5bea0 0x564221a5e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.434+0000 7f56cfb0b740 4 client.15915 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.434+0000 7f56cfb0b740 1 -- 172.21.15.18:0/3073080496 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642219b4860 con 0x564221a5bea0 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.434+0000 7f56c67fc640 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564221a5bea0 0x564221a5e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.435+0000 7f56aaff5640 10 client.15915 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.435+0000 7f56c67fc640 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564221a5bea0 0x564221a5e2d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2c266b0e6be40e47 server_cookie=7970d95b59da6bc3 in_seq=0 out_seq=0 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.435+0000 7f56aaff5640 1 -- 172.21.15.18:0/3073080496 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642219b4860 con 0x564221a5bea0 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.435+0000 7f56aaff5640 10 client.15915 handle_command_reply: tid=0 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 client.15915 shutdown 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 -- 172.21.15.18:0/3073080496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 msgr2=0x564221a4bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a4bd40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f56b80bc2a0 tx=0x7f56b80b8140 comp rx=0 tx=0).stop 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 -- 172.21.15.18:0/3073080496 shutdown_connections 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564221a5bea0 0x564221a5e2d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a42b40 0x564221a48ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/3073080496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a4bd40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56aaff5640 0 client.15915 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:53.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 -- 172.21.15.18:0/3073080496 >> 172.21.15.18:0/3073080496 conn(0x564221a0a310 msgr2=0x564221a43960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:53.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 -- 172.21.15.18:0/3073080496 shutdown_connections 2024-09-19T09:53:53.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 1 -- 172.21.15.18:0/3073080496 wait complete. 2024-09-19T09:53:53.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.436+0000 7f56cfb0b740 20 client.15915 trim_cache size 0 max 16384 2024-09-19T09:53:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56cfb0b740 1 Processor -- start 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56cfb0b740 1 -- start start 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 0x564221a488b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a44120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a44660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56c81ad480 con 0x564221a42b40 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f56c81aefc0 con 0x564221a4c370 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56c81adb50 con 0x564221a415d0 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56c67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a44120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56c67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a44120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53564/0 (socket says 172.21.15.18:53564) 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56c67fc640 1 -- 172.21.15.18:0/47492167 learned_addr learned my addr 172.21.15.18:0/47492167 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56c77fe640 1 --2- 172.21.15.18:0/47492167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a44660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.449+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/47492167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 0x564221a488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.450+0000 7f56c67fc640 1 -- 172.21.15.18:0/47492167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 msgr2=0x564221a488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.450+0000 7f56c67fc640 1 --2- 172.21.15.18:0/47492167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 0x564221a488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.450+0000 7f56c67fc640 1 -- 172.21.15.18:0/47492167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 msgr2=0x564221a44660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.450+0000 7f56c67fc640 1 --2- 172.21.15.18:0/47492167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a44660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.450+0000 7f56c67fc640 1 -- 172.21.15.18:0/47492167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564221a47fa0 con 0x564221a42b40 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.450+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/47492167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 0x564221a488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.450+0000 7f56c67fc640 1 --2- 172.21.15.18:0/47492167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a44120 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0075d0 tx=0x7f56bc018380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73369bc73f81dc98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.450+0000 7f56acff9640 1 -- 172.21.15.18:0/47492167 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc026070 con 0x564221a42b40 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.450+0000 7f56acff9640 1 -- 172.21.15.18:0/47492167 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56bc018dc0 con 0x564221a42b40 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.450+0000 7f56acff9640 1 -- 172.21.15.18:0/47492167 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc019700 con 0x564221a42b40 2024-09-19T09:53:53.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 -- 172.21.15.18:0/47492167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 msgr2=0x564221a44120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/47492167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a44120 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0075d0 tx=0x7f56bc018380 comp rx=0 tx=0).stop 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 -- 172.21.15.18:0/47492167 shutdown_connections 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/47492167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a44660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/47492167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a42b40 0x564221a44120 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/47492167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a415d0 0x564221a488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 -- 172.21.15.18:0/47492167 >> 172.21.15.18:0/47492167 conn(0x564221a0a310 msgr2=0x564221a4b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 -- 172.21.15.18:0/47492167 shutdown_connections 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 -- 172.21.15.18:0/47492167 wait complete. 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 -- start start 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.451+0000 7f56cfb0b740 1 Processor -- start 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a50340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a42b40 0x564221a50880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56cfb0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a50dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56c81ae8f0 con 0x564221a415d0 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f56c81ae220 con 0x564221a4c370 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56cfb0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56c81ab480 con 0x564221a42b40 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56cfb0b740 10 client.0 _ll_register_callbacks cb 0x7f56b8005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a50340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a50340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53580/0 (socket says 172.21.15.18:53580) 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c6ffd640 1 -- 172.21.15.18:0/842178669 learned_addr learned my addr 172.21.15.18:0/842178669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c67fc640 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a42b40 0x564221a50880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c77fe640 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a50dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c6ffd640 1 -- 172.21.15.18:0/842178669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a42b40 msgr2=0x564221a50880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a42b40 0x564221a50880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c6ffd640 1 -- 172.21.15.18:0/842178669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 msgr2=0x564221a50dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a50dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c6ffd640 1 -- 172.21.15.18:0/842178669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564221aca0f0 con 0x564221a415d0 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c77fe640 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a50dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56c6ffd640 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a50340 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f56b80edd30 tx=0x7f56b80c0ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f707e12870940ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56aaff5640 1 -- 172.21.15.18:0/842178669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b8049040 con 0x564221a415d0 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56aaff5640 1 -- 172.21.15.18:0/842178669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f56b80d52e0 con 0x564221a415d0 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.452+0000 7f56cfb0b740 1 -- 172.21.15.18:0/842178669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56bc018dc0 con 0x564221a415d0 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56aaff5640 1 -- 172.21.15.18:0/842178669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f56b803bcb0 con 0x564221a415d0 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56cfb0b740 10 client.15921 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56cfb0b740 1 -- 172.21.15.18:0/842178669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564221acb3b0 con 0x564221a415d0 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56aaff5640 1 -- 172.21.15.18:0/842178669 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56bc018dc0 con 0x564221a415d0 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56aaff5640 1 -- 172.21.15.18:0/842178669 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f56b80b82f0 con 0x564221a415d0 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56cfb0b740 10 client.15921 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56cfb0b740 10 client.15921 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56cfb0b740 20 client.15921 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564221acb990 0x564221acdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56cfb0b740 4 client.15921 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56cfb0b740 1 -- 172.21.15.18:0/842178669 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5642219aed70 con 0x564221acb990 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.453+0000 7f56c67fc640 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564221acb990 0x564221acdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56c67fc640 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564221acb990 0x564221acdd80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=419185c76b86ca60 server_cookie=a84f095118b5ed in_seq=0 out_seq=0 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56aaff5640 10 client.15921 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56aaff5640 1 -- 172.21.15.18:0/842178669 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5642219aed70 con 0x564221acb990 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56aaff5640 10 client.15921 handle_command_reply: tid=0 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 client.15921 shutdown 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 -- 172.21.15.18:0/842178669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 msgr2=0x564221a50340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:53.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a50340 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f56b80edd30 tx=0x7f56b80c0ad0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 -- 172.21.15.18:0/842178669 shutdown_connections 2024-09-19T09:53:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564221acb990 0x564221acdd80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564221a4c370 0x564221a50dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56aaff5640 0 client.15921 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:53:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564221a42b40 0x564221a50880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 --2- 172.21.15.18:0/842178669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564221a415d0 0x564221a50340 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 -- 172.21.15.18:0/842178669 >> 172.21.15.18:0/842178669 conn(0x564221a0a310 msgr2=0x564221a4b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 -- 172.21.15.18:0/842178669 shutdown_connections 2024-09-19T09:53:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 1 -- 172.21.15.18:0/842178669 wait complete. 2024-09-19T09:53:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.454+0000 7f56cfb0b740 20 client.15921 trim_cache size 0 max 16384 2024-09-19T09:53:53.466 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:53.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 -- 172.21.15.18:0/3807558796 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56b00a32c0 msgr2=0x7f56b00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:53.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56b00a32c0 0x7f56b00a5780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f56c0022000 tx=0x7f56c0020000 comp rx=0 tx=0).stop 2024-09-19T09:53:53.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 -- 172.21.15.18:0/3807558796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56c81011a0 msgr2=0x7f56c8199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:53.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56c81011a0 0x7f56c8199450 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f56b8006010 tx=0x7f56b80042f0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 -- 172.21.15.18:0/3807558796 shutdown_connections 2024-09-19T09:53:53.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56b00a32c0 0x7f56b00a5780 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8106c30 0x7f56c81a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56c8101b40 0x7f56c8199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 --2- 172.21.15.18:0/3807558796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56c81011a0 0x7f56c8199450 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:53.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 -- 172.21.15.18:0/3807558796 >> 172.21.15.18:0/3807558796 conn(0x7f56c8077210 msgr2=0x7f56c8103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:53.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 -- 172.21.15.18:0/3807558796 shutdown_connections 2024-09-19T09:53:53.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:53.455+0000 7f56cd732640 1 -- 172.21.15.18:0/3807558796 wait complete. 2024-09-19T09:53:54.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:53:54.362 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:54.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:53 smithi018 ceph-mon[30956]: pgmap v385: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:53:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:53 smithi049 ceph-mon[34858]: pgmap v385: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:53:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:53 smithi162 ceph-mon[35174]: pgmap v385: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:53:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.773+0000 7f7d3bac2640 1 -- 172.21.15.18:0/4225923514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d34106f10 msgr2=0x7f7d3410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.773+0000 7f7d3bac2640 1 --2- 172.21.15.18:0/4225923514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d34106f10 0x7f7d3410ea90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009ca0 tx=0x7f7d2c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.773+0000 7f7d3bac2640 1 -- 172.21.15.18:0/4225923514 shutdown_connections 2024-09-19T09:53:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.773+0000 7f7d3bac2640 1 --2- 172.21.15.18:0/4225923514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d34106f10 0x7f7d3410ea90 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.773+0000 7f7d3bac2640 1 --2- 172.21.15.18:0/4225923514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d34102790 0x7f7d341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.773+0000 7f7d3bac2640 1 --2- 172.21.15.18:0/4225923514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d34101de0 0x7f7d341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.773+0000 7f7d3bac2640 1 -- 172.21.15.18:0/4225923514 >> 172.21.15.18:0/4225923514 conn(0x7f7d340fd8c0 msgr2=0x7f7d340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.773+0000 7f7d3bac2640 1 -- 172.21.15.18:0/4225923514 shutdown_connections 2024-09-19T09:53:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.773+0000 7f7d3bac2640 1 -- 172.21.15.18:0/4225923514 wait complete. 2024-09-19T09:53:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3bac2640 1 Processor -- start 2024-09-19T09:53:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3bac2640 1 -- start start 2024-09-19T09:53:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3bac2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d34101de0 0x7f7d34198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3bac2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d34102790 0x7f7d34198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3bac2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d34106f10 0x7f7d3419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3bac2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d34111f70 con 0x7f7d34102790 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3bac2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7d34111df0 con 0x7f7d34106f10 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3bac2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d341120f0 con 0x7f7d34101de0 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3905d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d34102790 0x7f7d34198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3905d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d34102790 0x7f7d34198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53590/0 (socket says 172.21.15.18:53590) 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.774+0000 7f7d3905d640 1 -- 172.21.15.18:0/216296793 learned_addr learned my addr 172.21.15.18:0/216296793 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d3985e640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d34101de0 0x7f7d34198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d3a05f640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d34106f10 0x7f7d3419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d3905d640 1 -- 172.21.15.18:0/216296793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d34101de0 msgr2=0x7f7d34198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d3905d640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d34101de0 0x7f7d34198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d3905d640 1 -- 172.21.15.18:0/216296793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d34106f10 msgr2=0x7f7d3419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d3905d640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d34106f10 0x7f7d3419cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d3905d640 1 -- 172.21.15.18:0/216296793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3419d300 con 0x7f7d34102790 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d3905d640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d34102790 0x7f7d34198890 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400c920 tx=0x7f7d2400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d2affd640 1 -- 172.21.15.18:0/216296793 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24007c70 con 0x7f7d34102790 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d3bac2640 1 -- 172.21.15.18:0/216296793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3419d5f0 con 0x7f7d34102790 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d2affd640 1 -- 172.21.15.18:0/216296793 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d24007e10 con 0x7f7d34102790 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d2affd640 1 -- 172.21.15.18:0/216296793 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24018890 con 0x7f7d34102790 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.775+0000 7f7d3bac2640 1 -- 172.21.15.18:0/216296793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d341a4ed0 con 0x7f7d34102790 2024-09-19T09:53:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.777+0000 7f7d2affd640 1 -- 172.21.15.18:0/216296793 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7d24018a70 con 0x7f7d34102790 2024-09-19T09:53:54.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.778+0000 7f7d3de9b740 1 Processor -- start 2024-09-19T09:53:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.778+0000 7f7d3de9b740 1 -- start start 2024-09-19T09:53:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.778+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03adb40 0x5626d03ac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.778+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03aca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.778+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 0x5626d03bdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.778+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626d03122f0 con 0x5626d03ac5d0 2024-09-19T09:53:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.778+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5626d02b9cf0 con 0x5626d03bb780 2024-09-19T09:53:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.778+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5626d030e2b0 con 0x5626d03adb40 2024-09-19T09:53:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3985e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3985e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53598/0 (socket says 172.21.15.18:53598) 2024-09-19T09:53:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3985e640 1 -- 172.21.15.18:0/1183835390 learned_addr learned my addr 172.21.15.18:0/1183835390 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d2affd640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d200a3240 0x7f7d200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3a05f640 1 --2- 172.21.15.18:0/1183835390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03adb40 0x5626d03ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3905d640 1 --2- 172.21.15.18:0/1183835390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 0x5626d03bdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3a05f640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d200a3240 0x7f7d200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3985e640 1 -- 172.21.15.18:0/1183835390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03adb40 msgr2=0x5626d03ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3985e640 1 --2- 172.21.15.18:0/1183835390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03adb40 0x5626d03ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3985e640 1 -- 172.21.15.18:0/1183835390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 msgr2=0x5626d03bdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3985e640 1 --2- 172.21.15.18:0/1183835390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 0x5626d03bdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3985e640 1 -- 172.21.15.18:0/1183835390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d029e3a0 con 0x5626d03ac5d0 2024-09-19T09:53:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3905d640 1 --2- 172.21.15.18:0/1183835390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 0x5626d03bdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d2affd640 1 -- 172.21.15.18:0/216296793 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7d240cfac0 con 0x7f7d34102790 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3985e640 1 --2- 172.21.15.18:0/1183835390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03aca10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000bcb0 tx=0x7f7d3000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a72fa6e7b6452d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d3a05f640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d200a3240 0x7f7d200a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c005cc0 tx=0x7f7d2c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d1ffff640 1 -- 172.21.15.18:0/1183835390 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30015070 con 0x5626d03ac5d0 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d1ffff640 1 -- 172.21.15.18:0/1183835390 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d3001a940 con 0x5626d03ac5d0 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.779+0000 7f7d1ffff640 1 -- 172.21.15.18:0/1183835390 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30011aa0 con 0x5626d03ac5d0 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.780+0000 7f7d3de9b740 1 -- 172.21.15.18:0/1183835390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 msgr2=0x5626d03aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.780+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/1183835390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03aca10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000bcb0 tx=0x7f7d3000f730 comp rx=0 tx=0).stop 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.780+0000 7f7d3de9b740 1 -- 172.21.15.18:0/1183835390 shutdown_connections 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.780+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/1183835390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 0x5626d03bdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.780+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/1183835390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03aca10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.780+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/1183835390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03adb40 0x5626d03ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.780+0000 7f7d3de9b740 1 -- 172.21.15.18:0/1183835390 >> 172.21.15.18:0/1183835390 conn(0x5626d0375310 msgr2=0x5626d03a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:54.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.780+0000 7f7d3de9b740 1 -- 172.21.15.18:0/1183835390 shutdown_connections 2024-09-19T09:53:54.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.780+0000 7f7d3de9b740 1 -- 172.21.15.18:0/1183835390 wait complete. 2024-09-19T09:53:54.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3de9b740 1 -- start start 2024-09-19T09:53:54.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3de9b740 1 Processor -- start 2024-09-19T09:53:54.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03bb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03adb40 0x5626d03b8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 0x5626d03b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626d03be480 con 0x5626d03ac5d0 2024-09-19T09:53:54.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5626d02cd060 con 0x5626d03bb780 2024-09-19T09:53:54.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5626d03be600 con 0x5626d03adb40 2024-09-19T09:53:54.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3985e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03bb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3de9b740 10 client.0 _ll_register_callbacks cb 0x5626d00208c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:54.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3985e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03bb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53610/0 (socket says 172.21.15.18:53610) 2024-09-19T09:53:54.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3985e640 1 -- 172.21.15.18:0/3668671529 learned_addr learned my addr 172.21.15.18:0/3668671529 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:54.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3905d640 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03adb40 0x5626d03b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.781+0000 7f7d3a05f640 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 0x5626d03b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d3985e640 1 -- 172.21.15.18:0/3668671529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03adb40 msgr2=0x5626d03b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d3985e640 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03adb40 0x5626d03b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d3985e640 1 -- 172.21.15.18:0/3668671529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 msgr2=0x5626d03b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d3985e640 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 0x5626d03b8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d3985e640 1 -- 172.21.15.18:0/3668671529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d00833c0 con 0x5626d03ac5d0 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d3985e640 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03bb1c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7d30000c00 tx=0x7f7d3000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938873a4f8a13f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/3668671529 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30015070 con 0x5626d03ac5d0 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d3de9b740 1 -- 172.21.15.18:0/3668671529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d3001a940 con 0x5626d03ac5d0 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/3668671529 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7d3001a670 con 0x5626d03ac5d0 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/3668671529 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d3001aaf0 con 0x5626d03ac5d0 2024-09-19T09:53:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d3de9b740 10 client.15933 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.782+0000 7f7d3de9b740 1 -- 172.21.15.18:0/3668671529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5626d03c9ee0 con 0x5626d03ac5d0 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/3668671529 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d3001a940 con 0x5626d03ac5d0 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/3668671529 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d30011a90 con 0x5626d03ac5d0 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d3de9b740 10 client.15933 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d3de9b740 10 client.15933 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d3de9b740 20 client.15933 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5626d03cb290 0x5626d03cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d3de9b740 4 client.15933 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d3de9b740 1 -- 172.21.15.18:0/3668671529 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626d031f860 con 0x5626d03cb290 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d3905d640 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5626d03cb290 0x5626d03cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d1d7fa640 10 client.15933 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.783+0000 7f7d3905d640 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5626d03cb290 0x5626d03cd680 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ff0666e8fe86d214 server_cookie=8dda6b89462c8da6 in_seq=0 out_seq=0 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/3668671529 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626d031f860 con 0x5626d03cb290 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d1d7fa640 10 client.15933 handle_command_reply: tid=0 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d3de9b740 1 client.15933 shutdown 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d3de9b740 1 -- 172.21.15.18:0/3668671529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 msgr2=0x5626d03bb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03bb1c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7d30000c00 tx=0x7f7d3000bfd0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d3de9b740 1 -- 172.21.15.18:0/3668671529 shutdown_connections 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5626d03cb290 0x5626d03cd680 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03bb780 0x5626d03b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03adb40 0x5626d03b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/3668671529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03bb1c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d1d7fa640 0 client.15933 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:54.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.784+0000 7f7d3de9b740 1 -- 172.21.15.18:0/3668671529 >> 172.21.15.18:0/3668671529 conn(0x5626d0375310 msgr2=0x5626d03ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:54.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.785+0000 7f7d3de9b740 1 -- 172.21.15.18:0/3668671529 shutdown_connections 2024-09-19T09:53:54.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.785+0000 7f7d3de9b740 1 -- 172.21.15.18:0/3668671529 wait complete. 2024-09-19T09:53:54.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.785+0000 7f7d3de9b740 20 client.15933 trim_cache size 0 max 16384 2024-09-19T09:53:54.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.797+0000 7f7d3de9b740 1 Processor -- start 2024-09-19T09:53:54.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3de9b740 1 -- start start 2024-09-19T09:53:54.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 0x5626d03d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03bb780 0x5626d03d3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d341ab210 con 0x5626d03ac5d0 2024-09-19T09:53:54.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7d341acd50 con 0x5626d03adb40 2024-09-19T09:53:54.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d341ab8e0 con 0x5626d03bb780 2024-09-19T09:53:54.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3985e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03a7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3985e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03a7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53622/0 (socket says 172.21.15.18:53622) 2024-09-19T09:53:54.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3985e640 1 -- 172.21.15.18:0/1450343676 learned_addr learned my addr 172.21.15.18:0/1450343676 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:54.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3985e640 1 -- 172.21.15.18:0/1450343676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03bb780 msgr2=0x5626d03d3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:54.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3985e640 1 --2- 172.21.15.18:0/1450343676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03bb780 0x5626d03d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3905d640 1 --2- 172.21.15.18:0/1450343676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 0x5626d03d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3985e640 1 -- 172.21.15.18:0/1450343676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 msgr2=0x5626d03d2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:54.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3985e640 1 --2- 172.21.15.18:0/1450343676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 0x5626d03d2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3985e640 1 -- 172.21.15.18:0/1450343676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d03a9960 con 0x5626d03ac5d0 2024-09-19T09:53:54.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3905d640 1 --2- 172.21.15.18:0/1450343676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 0x5626d03d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:54.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d3985e640 1 --2- 172.21.15.18:0/1450343676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03a7bf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000bbd0 tx=0x7f7d3000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9589879e9a6532b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:54.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d1f7fe640 1 -- 172.21.15.18:0/1450343676 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30015040 con 0x5626d03ac5d0 2024-09-19T09:53:54.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d1f7fe640 1 -- 172.21.15.18:0/1450343676 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d3000b850 con 0x5626d03ac5d0 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.798+0000 7f7d1f7fe640 1 -- 172.21.15.18:0/1450343676 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d300117b0 con 0x5626d03ac5d0 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.799+0000 7f7d3de9b740 1 -- 172.21.15.18:0/1450343676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 msgr2=0x5626d03a7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.799+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/1450343676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03a7bf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000bbd0 tx=0x7f7d3000f730 comp rx=0 tx=0).stop 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.799+0000 7f7d3de9b740 1 -- 172.21.15.18:0/1450343676 shutdown_connections 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.799+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/1450343676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03bb780 0x5626d03d3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.799+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/1450343676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 0x5626d03d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.799+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/1450343676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03a7bf0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.799+0000 7f7d3de9b740 1 -- 172.21.15.18:0/1450343676 >> 172.21.15.18:0/1450343676 conn(0x5626d0375310 msgr2=0x5626d03a74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.799+0000 7f7d3de9b740 1 -- 172.21.15.18:0/1450343676 shutdown_connections 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.799+0000 7f7d3de9b740 1 -- 172.21.15.18:0/1450343676 wait complete. 2024-09-19T09:53:54.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.800+0000 7f7d3de9b740 1 -- start start 2024-09-19T09:53:54.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.800+0000 7f7d3de9b740 1 Processor -- start 2024-09-19T09:53:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03c4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 0x5626d03b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3de9b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03bb780 0x5626d03b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d341ac680 con 0x5626d03ac5d0 2024-09-19T09:53:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7d341abfb0 con 0x5626d03adb40 2024-09-19T09:53:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3de9b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d341a9210 con 0x5626d03bb780 2024-09-19T09:53:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3de9b740 10 client.0 _ll_register_callbacks cb 0x7f7d3000bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3985e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3985e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53630/0 (socket says 172.21.15.18:53630) 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3985e640 1 -- 172.21.15.18:0/2188359653 learned_addr learned my addr 172.21.15.18:0/2188359653 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3a05f640 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03bb780 0x5626d03b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3905d640 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 0x5626d03b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3985e640 1 -- 172.21.15.18:0/2188359653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03bb780 msgr2=0x5626d03b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3985e640 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03bb780 0x5626d03b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3985e640 1 -- 172.21.15.18:0/2188359653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 msgr2=0x5626d03b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3985e640 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 0x5626d03b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3985e640 1 -- 172.21.15.18:0/2188359653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d0434de0 con 0x5626d03ac5d0 2024-09-19T09:53:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.801+0000 7f7d3a05f640 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03bb780 0x5626d03b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.802+0000 7f7d3985e640 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03c4160 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7d30011f30 tx=0x7f7d30005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa9724e2a79f5aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.802+0000 7f7d1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.802+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/2188359653 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3003d060 con 0x5626d03ac5d0 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.802+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/2188359653 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7d30004030 con 0x5626d03ac5d0 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.802+0000 7f7d3de9b740 1 -- 172.21.15.18:0/2188359653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d3000b850 con 0x5626d03ac5d0 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.802+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/2188359653 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d30015040 con 0x5626d03ac5d0 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.802+0000 7f7d3de9b740 10 client.15939 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.802+0000 7f7d3de9b740 1 -- 172.21.15.18:0/2188359653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5626d0435ee0 con 0x5626d03ac5d0 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.802+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/2188359653 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d3000b850 con 0x5626d03ac5d0 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.802+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/2188359653 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d30003950 con 0x5626d03ac5d0 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d3de9b740 10 client.15939 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d3de9b740 10 client.15939 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:53:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d3de9b740 20 client.15939 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5626d0436540 0x5626d0438930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d3de9b740 4 client.15939 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d3de9b740 1 -- 172.21.15.18:0/2188359653 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5626d0319d70 con 0x5626d0436540 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d3905d640 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5626d0436540 0x5626d0438930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d3905d640 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5626d0436540 0x5626d0438930 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e81592039ff7bfb5 server_cookie=3b066e94da72f5ea in_seq=0 out_seq=0 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d1d7fa640 10 client.15939 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d1d7fa640 1 -- 172.21.15.18:0/2188359653 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5626d0319d70 con 0x5626d0436540 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d1d7fa640 10 client.15939 handle_command_reply: tid=0 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.803+0000 7f7d3de9b740 1 client.15939 shutdown 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 1 -- 172.21.15.18:0/2188359653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 msgr2=0x5626d03c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03c4160 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7d30011f30 tx=0x7f7d30005a70 comp rx=0 tx=0).stop 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 1 -- 172.21.15.18:0/2188359653 shutdown_connections 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5626d0436540 0x5626d0438930 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5626d03bb780 0x5626d03b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5626d03adb40 0x5626d03b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 1 --2- 172.21.15.18:0/2188359653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626d03ac5d0 0x5626d03c4160 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d1d7fa640 0 client.15939 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:53:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 1 -- 172.21.15.18:0/2188359653 >> 172.21.15.18:0/2188359653 conn(0x5626d0375310 msgr2=0x5626d03a7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 1 -- 172.21.15.18:0/2188359653 shutdown_connections 2024-09-19T09:53:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 1 -- 172.21.15.18:0/2188359653 wait complete. 2024-09-19T09:53:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3de9b740 20 client.15939 trim_cache size 0 max 16384 2024-09-19T09:53:54.828 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3bac2640 1 -- 172.21.15.18:0/216296793 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d200a3240 msgr2=0x7f7d200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3bac2640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d200a3240 0x7f7d200a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c005cc0 tx=0x7f7d2c0095c0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3bac2640 1 -- 172.21.15.18:0/216296793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d34102790 msgr2=0x7f7d34198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.804+0000 7f7d3bac2640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d34102790 0x7f7d34198890 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400c920 tx=0x7f7d2400cde0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.805+0000 7f7d3bac2640 1 -- 172.21.15.18:0/216296793 shutdown_connections 2024-09-19T09:53:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.805+0000 7f7d3bac2640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d200a3240 0x7f7d200a5700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.805+0000 7f7d3bac2640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d34106f10 0x7f7d3419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.805+0000 7f7d3bac2640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d34102790 0x7f7d34198890 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.805+0000 7f7d3bac2640 1 --2- 172.21.15.18:0/216296793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d34101de0 0x7f7d34198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.805+0000 7f7d3bac2640 1 -- 172.21.15.18:0/216296793 >> 172.21.15.18:0/216296793 conn(0x7f7d340fd8c0 msgr2=0x7f7d340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.805+0000 7f7d3bac2640 1 -- 172.21.15.18:0/216296793 shutdown_connections 2024-09-19T09:53:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:54.805+0000 7f7d3bac2640 1 -- 172.21.15.18:0/216296793 wait complete. 2024-09-19T09:53:55.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:53:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:56.082 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:55 smithi018 ceph-mon[30956]: pgmap v386: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:53:56.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.163+0000 7fa25c9fc640 1 -- 172.21.15.18:0/294426530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258102da0 msgr2=0x7fa258103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.163+0000 7fa25c9fc640 1 --2- 172.21.15.18:0/294426530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258102da0 0x7fa258103180 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa248009900 tx=0x7fa24802a480 comp rx=0 tx=0).stop 2024-09-19T09:53:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.163+0000 7fa25c9fc640 1 -- 172.21.15.18:0/294426530 shutdown_connections 2024-09-19T09:53:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.163+0000 7fa25c9fc640 1 --2- 172.21.15.18:0/294426530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25810c180 0x7fa25810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.163+0000 7fa25c9fc640 1 --2- 172.21.15.18:0/294426530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2581036c0 0x7fa25810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.163+0000 7fa25c9fc640 1 --2- 172.21.15.18:0/294426530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa258102da0 0x7fa258103180 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.163+0000 7fa25c9fc640 1 -- 172.21.15.18:0/294426530 >> 172.21.15.18:0/294426530 conn(0x7fa2580fc7a0 msgr2=0x7fa2580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.163+0000 7fa25c9fc640 1 -- 172.21.15.18:0/294426530 shutdown_connections 2024-09-19T09:53:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.163+0000 7fa25c9fc640 1 -- 172.21.15.18:0/294426530 wait complete. 2024-09-19T09:53:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa25c9fc640 1 Processor -- start 2024-09-19T09:53:56.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa25c9fc640 1 -- start start 2024-09-19T09:53:56.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa25c9fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa258102da0 0x7fa2581983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa25c9fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2581036c0 0x7fa258198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa25c9fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25810c180 0x7fa25819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa25c9fc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa258111f60 con 0x7fa2581036c0 2024-09-19T09:53:56.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa25c9fc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa258111de0 con 0x7fa258102da0 2024-09-19T09:53:56.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa25c9fc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581120e0 con 0x7fa25810c180 2024-09-19T09:53:56.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa24dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2581036c0 0x7fa258198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa24dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2581036c0 0x7fa258198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53644/0 (socket says 172.21.15.18:53644) 2024-09-19T09:53:56.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa24dd9b640 1 -- 172.21.15.18:0/1710684728 learned_addr learned my addr 172.21.15.18:0/1710684728 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:56.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa25659c640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa258102da0 0x7fa2581983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.164+0000 7fa256d9d640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25810c180 0x7fa25819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa24dd9b640 1 -- 172.21.15.18:0/1710684728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25810c180 msgr2=0x7fa25819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25810c180 0x7fa25819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa24dd9b640 1 -- 172.21.15.18:0/1710684728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa258102da0 msgr2=0x7fa2581983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa258102da0 0x7fa2581983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa24dd9b640 1 -- 172.21.15.18:0/1710684728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25819d380 con 0x7fa2581036c0 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa25659c640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa258102da0 0x7fa2581983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2581036c0 0x7fa258198910 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa24000d950 tx=0x7fa24000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa24ffff640 1 -- 172.21.15.18:0/1710684728 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240017070 con 0x7fa2581036c0 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa24ffff640 1 -- 172.21.15.18:0/1710684728 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa240009c30 con 0x7fa2581036c0 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa25c9fc640 1 -- 172.21.15.18:0/1710684728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25819d670 con 0x7fa2581036c0 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa24ffff640 1 -- 172.21.15.18:0/1710684728 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24000f6b0 con 0x7fa2581036c0 2024-09-19T09:53:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.165+0000 7fa25c9fc640 1 -- 172.21.15.18:0/1710684728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2581a4f50 con 0x7fa2581036c0 2024-09-19T09:53:56.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.168+0000 7fa24ffff640 1 -- 172.21.15.18:0/1710684728 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa2400109d0 con 0x7fa2581036c0 2024-09-19T09:53:56.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.168+0000 7fa25edd5740 1 Processor -- start 2024-09-19T09:53:56.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa25edd5740 1 -- start start 2024-09-19T09:53:56.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde318090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde3185d0 0x562fde318a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde325760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa25edd5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562fde27e2f0 con 0x562fde319b40 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa25edd5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562fde225cf0 con 0x562fde323370 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa25edd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562fde27a2b0 con 0x562fde3185d0 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa256d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde318090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa256d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde318090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53656/0 (socket says 172.21.15.18:53656) 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa256d9d640 1 -- 172.21.15.18:0/1406811752 learned_addr learned my addr 172.21.15.18:0/1406811752 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa25659c640 1 --2- 172.21.15.18:0/1406811752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde3185d0 0x562fde318a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/1406811752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde325760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa256d9d640 1 -- 172.21.15.18:0/1406811752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde3185d0 msgr2=0x562fde318a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.169+0000 7fa256d9d640 1 --2- 172.21.15.18:0/1406811752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde3185d0 0x562fde318a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa256d9d640 1 -- 172.21.15.18:0/1406811752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 msgr2=0x562fde325760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa256d9d640 1 --2- 172.21.15.18:0/1406811752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde325760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa256d9d640 1 -- 172.21.15.18:0/1406811752 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fde20a3a0 con 0x562fde319b40 2024-09-19T09:53:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/1406811752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde325760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa24ffff640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa2440a3240 0x7fa2440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa256d9d640 1 --2- 172.21.15.18:0/1406811752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde318090 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa250009f70 tx=0x7fa250010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d1ab31d937d38d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa25659c640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa2440a3240 0x7fa2440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa24ffff640 1 -- 172.21.15.18:0/1710684728 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa2400cf4a0 con 0x7fa2581036c0 2024-09-19T09:53:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa24cd99640 1 -- 172.21.15.18:0/1406811752 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250016070 con 0x562fde319b40 2024-09-19T09:53:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa24cd99640 1 -- 172.21.15.18:0/1406811752 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa250004d20 con 0x562fde319b40 2024-09-19T09:53:56.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.170+0000 7fa24cd99640 1 -- 172.21.15.18:0/1406811752 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250012810 con 0x562fde319b40 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 -- 172.21.15.18:0/1406811752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 msgr2=0x562fde318090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25659c640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa2440a3240 0x7fa2440a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa248009230 tx=0x7fa2480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 --2- 172.21.15.18:0/1406811752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde318090 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa250009f70 tx=0x7fa250010740 comp rx=0 tx=0).stop 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 -- 172.21.15.18:0/1406811752 shutdown_connections 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 --2- 172.21.15.18:0/1406811752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde325760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 --2- 172.21.15.18:0/1406811752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde3185d0 0x562fde318a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 --2- 172.21.15.18:0/1406811752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde318090 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 -- 172.21.15.18:0/1406811752 >> 172.21.15.18:0/1406811752 conn(0x562fde2e1310 msgr2=0x562fde314c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 -- 172.21.15.18:0/1406811752 shutdown_connections 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 -- 172.21.15.18:0/1406811752 wait complete. 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 -- start start 2024-09-19T09:53:56.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.171+0000 7fa25edd5740 1 Processor -- start 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde322cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde319b40 0x562fde31fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde320600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25edd5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562fde326070 con 0x562fde3185d0 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25edd5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562fde239060 con 0x562fde323370 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25edd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562fde3261f0 con 0x562fde319b40 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25edd5740 10 client.0 _ll_register_callbacks cb 0x562fddf8c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde322cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde322cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53664/0 (socket says 172.21.15.18:53664) 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25659c640 1 -- 172.21.15.18:0/3168419505 learned_addr learned my addr 172.21.15.18:0/3168419505 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:56.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde319b40 0x562fde31fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa256d9d640 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde320600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25659c640 1 -- 172.21.15.18:0/3168419505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde319b40 msgr2=0x562fde31fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25659c640 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde319b40 0x562fde31fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25659c640 1 -- 172.21.15.18:0/3168419505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 msgr2=0x562fde320600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25659c640 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde320600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25659c640 1 -- 172.21.15.18:0/3168419505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fddfef3c0 con 0x562fde3185d0 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde319b40 0x562fde31fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa256d9d640 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde320600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa25659c640 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde322cf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa248009900 tx=0x7fa248009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da8a4405ecee968 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.172+0000 7fa23dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa23dffb640 1 -- 172.21.15.18:0/3168419505 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24804d070 con 0x562fde3185d0 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa23dffb640 1 -- 172.21.15.18:0/3168419505 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa248003cc0 con 0x562fde3185d0 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa25edd5740 1 -- 172.21.15.18:0/3168419505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa250004d20 con 0x562fde3185d0 2024-09-19T09:53:56.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa23dffb640 1 -- 172.21.15.18:0/3168419505 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa248059070 con 0x562fde3185d0 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa25edd5740 10 client.15951 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa25edd5740 1 -- 172.21.15.18:0/3168419505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562fde335ef0 con 0x562fde3185d0 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa23dffb640 1 -- 172.21.15.18:0/3168419505 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa250004d20 con 0x562fde3185d0 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa23dffb640 1 -- 172.21.15.18:0/3168419505 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa24803d4e0 con 0x562fde3185d0 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa25edd5740 10 client.15951 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa25edd5740 10 client.15951 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa25edd5740 20 client.15951 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa25edd5740 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x562fde3373b0 0x562fde339800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa25edd5740 4 client.15951 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.173+0000 7fa25edd5740 1 -- 172.21.15.18:0/3168419505 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fde28b860 con 0x562fde3373b0 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.174+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x562fde3373b0 0x562fde339800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.174+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x562fde3373b0 0x562fde339800 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9a61b770a159733 server_cookie=b6d226d4e2a1014a in_seq=0 out_seq=0 2024-09-19T09:53:56.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.174+0000 7fa23dffb640 10 client.15951 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa23dffb640 1 -- 172.21.15.18:0/3168419505 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fde28b860 con 0x562fde3373b0 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa23dffb640 10 client.15951 handle_command_reply: tid=0 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 client.15951 shutdown 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 -- 172.21.15.18:0/3168419505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 msgr2=0x562fde322cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde322cf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa248009900 tx=0x7fa248009260 comp rx=0 tx=0).stop 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 -- 172.21.15.18:0/3168419505 shutdown_connections 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x562fde3373b0 0x562fde339800 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde320600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde319b40 0x562fde31fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa23dffb640 0 client.15951 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 --2- 172.21.15.18:0/3168419505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde322cf0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 -- 172.21.15.18:0/3168419505 >> 172.21.15.18:0/3168419505 conn(0x562fde2e1310 msgr2=0x562fde31a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 -- 172.21.15.18:0/3168419505 shutdown_connections 2024-09-19T09:53:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 1 -- 172.21.15.18:0/3168419505 wait complete. 2024-09-19T09:53:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.175+0000 7fa25edd5740 20 client.15951 trim_cache size 0 max 16384 2024-09-19T09:53:56.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.188+0000 7fa25edd5740 1 Processor -- start 2024-09-19T09:53:56.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.188+0000 7fa25edd5740 1 -- start start 2024-09-19T09:53:56.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.188+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde3185d0 0x562fde31b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.188+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde31b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.188+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde33f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.188+0000 7fa25edd5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581ab210 con 0x562fde319b40 2024-09-19T09:53:56.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.188+0000 7fa25edd5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581acd50 con 0x562fde323370 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.188+0000 7fa25edd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581ab8e0 con 0x562fde3185d0 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa24dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde31b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa24dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde31b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53680/0 (socket says 172.21.15.18:53680) 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa24dd9b640 1 -- 172.21.15.18:0/1364329510 learned_addr learned my addr 172.21.15.18:0/1364329510 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa256d9d640 1 --2- 172.21.15.18:0/1364329510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde33f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa25659c640 1 --2- 172.21.15.18:0/1364329510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde3185d0 0x562fde31b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa24dd9b640 1 -- 172.21.15.18:0/1364329510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde3185d0 msgr2=0x562fde31b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/1364329510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde3185d0 0x562fde31b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa24dd9b640 1 -- 172.21.15.18:0/1364329510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 msgr2=0x562fde33f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/1364329510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde33f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa24dd9b640 1 -- 172.21.15.18:0/1364329510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fde313310 con 0x562fde319b40 2024-09-19T09:53:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa256d9d640 1 --2- 172.21.15.18:0/1364329510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde33f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/1364329510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde31b660 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa24009b8a0 tx=0x7fa24000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c2d5e915c8c6b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa23ffff640 1 -- 172.21.15.18:0/1364329510 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240020040 con 0x562fde319b40 2024-09-19T09:53:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa23ffff640 1 -- 172.21.15.18:0/1364329510 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa24009bba0 con 0x562fde319b40 2024-09-19T09:53:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.189+0000 7fa23ffff640 1 -- 172.21.15.18:0/1364329510 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2400a42d0 con 0x562fde319b40 2024-09-19T09:53:56.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 -- 172.21.15.18:0/1364329510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 msgr2=0x562fde31b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 --2- 172.21.15.18:0/1364329510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde31b660 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa24009b8a0 tx=0x7fa24000bf60 comp rx=0 tx=0).stop 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 -- 172.21.15.18:0/1364329510 shutdown_connections 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 --2- 172.21.15.18:0/1364329510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde323370 0x562fde33f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 --2- 172.21.15.18:0/1364329510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde319b40 0x562fde31b660 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 --2- 172.21.15.18:0/1364329510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde3185d0 0x562fde31b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 -- 172.21.15.18:0/1364329510 >> 172.21.15.18:0/1364329510 conn(0x562fde2e1310 msgr2=0x562fde313d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 -- 172.21.15.18:0/1364329510 shutdown_connections 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 -- 172.21.15.18:0/1364329510 wait complete. 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 -- start start 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.190+0000 7fa25edd5740 1 Processor -- start 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde31d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde319b40 0x562fde31d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25edd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde323370 0x562fde31dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25edd5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581ac680 con 0x562fde3185d0 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25edd5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581abfb0 con 0x562fde319b40 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25edd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581a91f0 con 0x562fde323370 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25edd5740 10 client.0 _ll_register_callbacks cb 0x7fa248005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde31d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde31d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53686/0 (socket says 172.21.15.18:53686) 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25659c640 1 -- 172.21.15.18:0/2637403025 learned_addr learned my addr 172.21.15.18:0/2637403025 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa256d9d640 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde323370 0x562fde31dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde319b40 0x562fde31d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25659c640 1 -- 172.21.15.18:0/2637403025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde323370 msgr2=0x562fde31dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25659c640 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde323370 0x562fde31dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25659c640 1 -- 172.21.15.18:0/2637403025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde319b40 msgr2=0x562fde31d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:56.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25659c640 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde319b40 0x562fde31d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25659c640 1 -- 172.21.15.18:0/2637403025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fde320f90 con 0x562fde3185d0 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde319b40 0x562fde31d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa25659c640 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde31d060 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa248005780 tx=0x7fa2480317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bf9268fd4fd983 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.191+0000 7fa23dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa23dffb640 1 -- 172.21.15.18:0/2637403025 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24804d040 con 0x562fde3185d0 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa23dffb640 1 -- 172.21.15.18:0/2637403025 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa24803d660 con 0x562fde3185d0 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa25edd5740 1 -- 172.21.15.18:0/2637403025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa24009bba0 con 0x562fde3185d0 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa23dffb640 1 -- 172.21.15.18:0/2637403025 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa248043070 con 0x562fde3185d0 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa25edd5740 10 client.15957 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa25edd5740 1 -- 172.21.15.18:0/2637403025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562fde3a2220 con 0x562fde3185d0 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa23dffb640 1 -- 172.21.15.18:0/2637403025 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa24009bba0 con 0x562fde3185d0 2024-09-19T09:53:56.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa23dffb640 1 -- 172.21.15.18:0/2637403025 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa248068ba0 con 0x562fde3185d0 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa25edd5740 10 client.15957 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa25edd5740 10 client.15957 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa25edd5740 20 client.15957 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa25edd5740 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x562fde3a2940 0x562fde3a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa25edd5740 4 client.15957 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.192+0000 7fa25edd5740 1 -- 172.21.15.18:0/2637403025 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562fde285d70 con 0x562fde3a2940 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x562fde3a2940 0x562fde3a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa24dd9b640 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x562fde3a2940 0x562fde3a4d60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8027bc6160e46609 server_cookie=997fae63b527fde7 in_seq=0 out_seq=0 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa23dffb640 10 client.15957 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa23dffb640 1 -- 172.21.15.18:0/2637403025 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562fde285d70 con 0x562fde3a2940 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa23dffb640 10 client.15957 handle_command_reply: tid=0 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa25edd5740 1 client.15957 shutdown 2024-09-19T09:53:56.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa25edd5740 1 -- 172.21.15.18:0/2637403025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 msgr2=0x562fde31d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa25edd5740 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde31d060 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa248005780 tx=0x7fa2480317e0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa25edd5740 1 -- 172.21.15.18:0/2637403025 shutdown_connections 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa25edd5740 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x562fde3a2940 0x562fde3a4d60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa25edd5740 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562fde323370 0x562fde31dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa25edd5740 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562fde319b40 0x562fde31d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa23dffb640 0 client.15957 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa25edd5740 1 --2- 172.21.15.18:0/2637403025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562fde3185d0 0x562fde31d060 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.193+0000 7fa25edd5740 1 -- 172.21.15.18:0/2637403025 >> 172.21.15.18:0/2637403025 conn(0x562fde2e1310 msgr2=0x562fde321850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25edd5740 1 -- 172.21.15.18:0/2637403025 shutdown_connections 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25edd5740 1 -- 172.21.15.18:0/2637403025 wait complete. 2024-09-19T09:53:56.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25edd5740 20 client.15957 trim_cache size 0 max 16384 2024-09-19T09:53:56.202 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:56.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 -- 172.21.15.18:0/1710684728 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa2440a3240 msgr2=0x7fa2440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:56.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa2440a3240 0x7fa2440a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa248009230 tx=0x7fa2480058d0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 -- 172.21.15.18:0/1710684728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2581036c0 msgr2=0x7fa258198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:56.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2581036c0 0x7fa258198910 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa24000d950 tx=0x7fa24000de10 comp rx=0 tx=0).stop 2024-09-19T09:53:56.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 -- 172.21.15.18:0/1710684728 shutdown_connections 2024-09-19T09:53:56.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa2440a3240 0x7fa2440a5700 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa25810c180 0x7fa25819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2581036c0 0x7fa258198910 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 --2- 172.21.15.18:0/1710684728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa258102da0 0x7fa2581983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:56.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 -- 172.21.15.18:0/1710684728 >> 172.21.15.18:0/1710684728 conn(0x7fa2580fc7a0 msgr2=0x7fa2580fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:56.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 -- 172.21.15.18:0/1710684728 shutdown_connections 2024-09-19T09:53:56.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:56.194+0000 7fa25c9fc640 1 -- 172.21.15.18:0/1710684728 wait complete. 2024-09-19T09:53:56.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:55 smithi049 ceph-mon[34858]: pgmap v386: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:53:56.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:55 smithi162 ceph-mon[35174]: pgmap v386: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:53:56.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:53:57.075 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:57.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.554+0000 7f1af9293640 1 -- 172.21.15.18:0/1721792268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1af41082a0 msgr2=0x7f1af410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:57.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.554+0000 7f1af9293640 1 --2- 172.21.15.18:0/1721792268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1af41082a0 0x7f1af410ec40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009cd0 tx=0x7f1aec02a910 comp rx=0 tx=0).stop 2024-09-19T09:53:57.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.554+0000 7f1af9293640 1 -- 172.21.15.18:0/1721792268 shutdown_connections 2024-09-19T09:53:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.554+0000 7f1af9293640 1 --2- 172.21.15.18:0/1721792268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1af41082a0 0x7f1af410ec40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.554+0000 7f1af9293640 1 --2- 172.21.15.18:0/1721792268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1af41036e0 0x7f1af4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.554+0000 7f1af9293640 1 --2- 172.21.15.18:0/1721792268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1af4102d30 0x7f1af4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.554+0000 7f1af9293640 1 -- 172.21.15.18:0/1721792268 >> 172.21.15.18:0/1721792268 conn(0x7f1af40fc7d0 msgr2=0x7f1af40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.554+0000 7f1af9293640 1 -- 172.21.15.18:0/1721792268 shutdown_connections 2024-09-19T09:53:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.554+0000 7f1af9293640 1 -- 172.21.15.18:0/1721792268 wait complete. 2024-09-19T09:53:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af9293640 1 Processor -- start 2024-09-19T09:53:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af9293640 1 -- start start 2024-09-19T09:53:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af9293640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1af4102d30 0x7f1af41986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af9293640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1af41036e0 0x7f1af4198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af9293640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1af41082a0 0x7f1af419cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af9293640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1af4112160 con 0x7f1af41082a0 2024-09-19T09:53:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af9293640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1af4111fe0 con 0x7f1af41036e0 2024-09-19T09:53:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af9293640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1af41122e0 con 0x7f1af4102d30 2024-09-19T09:53:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1af41082a0 0x7f1af419cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1af41082a0 0x7f1af419cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60458/0 (socket says 172.21.15.18:60458) 2024-09-19T09:53:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af37fe640 1 -- 172.21.15.18:0/270195846 learned_addr learned my addr 172.21.15.18:0/270195846 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1aebfff640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1af41036e0 0x7f1af4198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1af4102d30 0x7f1af41986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af37fe640 1 -- 172.21.15.18:0/270195846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1af4102d30 msgr2=0x7f1af41986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af37fe640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1af4102d30 0x7f1af41986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af37fe640 1 -- 172.21.15.18:0/270195846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1af41036e0 msgr2=0x7f1af4198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af37fe640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1af41036e0 0x7f1af4198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.555+0000 7f1af37fe640 1 -- 172.21.15.18:0/270195846 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af419d690 con 0x7f1af41082a0 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.556+0000 7f1aebfff640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1af41036e0 0x7f1af4198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.556+0000 7f1af37fe640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1af41082a0 0x7f1af419cfb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1aec005cc0 tx=0x7f1aec031460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.556+0000 7f1af0ff9640 1 -- 172.21.15.18:0/270195846 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec031850 con 0x7f1af41082a0 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.556+0000 7f1af0ff9640 1 -- 172.21.15.18:0/270195846 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aec004520 con 0x7f1af41082a0 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.556+0000 7f1af9293640 1 -- 172.21.15.18:0/270195846 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af419d920 con 0x7f1af41082a0 2024-09-19T09:53:57.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.556+0000 7f1af0ff9640 1 -- 172.21.15.18:0/270195846 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec02fe20 con 0x7f1af41082a0 2024-09-19T09:53:57.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.556+0000 7f1af9293640 1 -- 172.21.15.18:0/270195846 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af41a5260 con 0x7f1af41082a0 2024-09-19T09:53:57.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1af0ff9640 1 -- 172.21.15.18:0/270195846 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1aec004040 con 0x7f1af41082a0 2024-09-19T09:53:57.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1afb66c740 1 Processor -- start 2024-09-19T09:53:57.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1afb66c740 1 -- start start 2024-09-19T09:53:57.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e97b40 0x5648c4e96090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e96a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 0x5648c4ea3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1afb66c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5648c4dfc2f0 con 0x5648c4e965d0 2024-09-19T09:53:57.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1afb66c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5648c4da3cf0 con 0x5648c4ea1370 2024-09-19T09:53:57.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1afb66c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5648c4df82b0 con 0x5648c4e97b40 2024-09-19T09:53:57.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e96a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e96a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60468/0 (socket says 172.21.15.18:60468) 2024-09-19T09:53:57.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.559+0000 7f1af2ffd640 1 -- 172.21.15.18:0/752129097 learned_addr learned my addr 172.21.15.18:0/752129097 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:57.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1aebfff640 1 --2- 172.21.15.18:0/752129097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 0x5648c4ea3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1aebfff640 1 --2- 172.21.15.18:0/752129097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e97b40 0x5648c4e96090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1af2ffd640 1 -- 172.21.15.18:0/752129097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e97b40 msgr2=0x5648c4e96090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:57.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/752129097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e97b40 0x5648c4e96090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1af2ffd640 1 -- 172.21.15.18:0/752129097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 msgr2=0x5648c4ea3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:57.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/752129097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 0x5648c4ea3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1af2ffd640 1 -- 172.21.15.18:0/752129097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648c4d883a0 con 0x5648c4e965d0 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1aebfff640 1 --2- 172.21.15.18:0/752129097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e97b40 0x5648c4e96090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1af0ff9640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1ae00a32c0 0x7f1ae00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/752129097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e96a10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400b820 tx=0x7f1ae400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f912c5e81ab6beaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1aebfff640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1ae00a32c0 0x7f1ae00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1af0ff9640 1 -- 172.21.15.18:0/270195846 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1aec0f10e0 con 0x7f1af41082a0 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1ae97fa640 1 -- 172.21.15.18:0/752129097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400d950 con 0x5648c4e965d0 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1ae97fa640 1 -- 172.21.15.18:0/752129097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae4019070 con 0x5648c4e965d0 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.560+0000 7f1ae97fa640 1 -- 172.21.15.18:0/752129097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40123e0 con 0x5648c4e965d0 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.561+0000 7f1afb66c740 1 -- 172.21.15.18:0/752129097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 msgr2=0x5648c4e96a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.561+0000 7f1aebfff640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1ae00a32c0 0x7f1ae00a5780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5648c4e97070 tx=0x7f1adc00a2b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.561+0000 7f1afb66c740 1 --2- 172.21.15.18:0/752129097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e96a10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400b820 tx=0x7f1ae400bce0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.561+0000 7f1afb66c740 1 -- 172.21.15.18:0/752129097 shutdown_connections 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.561+0000 7f1afb66c740 1 --2- 172.21.15.18:0/752129097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 0x5648c4ea3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.561+0000 7f1afb66c740 1 --2- 172.21.15.18:0/752129097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e96a10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.561+0000 7f1afb66c740 1 --2- 172.21.15.18:0/752129097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e97b40 0x5648c4e96090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.561+0000 7f1afb66c740 1 -- 172.21.15.18:0/752129097 >> 172.21.15.18:0/752129097 conn(0x5648c4e5f310 msgr2=0x5648c4e92c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.561+0000 7f1afb66c740 1 -- 172.21.15.18:0/752129097 shutdown_connections 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.561+0000 7f1afb66c740 1 -- 172.21.15.18:0/752129097 wait complete. 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1afb66c740 1 -- start start 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1afb66c740 1 Processor -- start 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 0x5648c4ea0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e97b40 0x5648c4e9e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 0x5648c4e9e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1afb66c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5648c4ea4070 con 0x5648c4e97b40 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1afb66c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5648c4db7060 con 0x5648c4ea1370 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1afb66c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5648c4ea41f0 con 0x5648c4e965d0 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1afb66c740 10 client.0 _ll_register_callbacks cb 0x5648c4b0a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1aebfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e97b40 0x5648c4e9e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1aebfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e97b40 0x5648c4e9e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60472/0 (socket says 172.21.15.18:60472) 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.562+0000 7f1aebfff640 1 -- 172.21.15.18:0/343025628 learned_addr learned my addr 172.21.15.18:0/343025628 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 0x5648c4ea0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1af37fe640 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 0x5648c4e9e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1aebfff640 1 -- 172.21.15.18:0/343025628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 msgr2=0x5648c4ea0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1aebfff640 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 0x5648c4ea0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1aebfff640 1 -- 172.21.15.18:0/343025628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 msgr2=0x5648c4e9e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1aebfff640 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 0x5648c4e9e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1aebfff640 1 -- 172.21.15.18:0/343025628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648c4b6d3c0 con 0x5648c4e97b40 2024-09-19T09:53:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 0x5648c4ea0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1af37fe640 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 0x5648c4e9e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1aebfff640 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e97b40 0x5648c4e9e010 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0176e0 tx=0x7f1adc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58da8eab8668079 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1ada7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1ada7fc640 1 -- 172.21.15.18:0/343025628 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc027060 con 0x5648c4e97b40 2024-09-19T09:53:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1afb66c740 1 -- 172.21.15.18:0/343025628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ae4019070 con 0x5648c4e97b40 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1ada7fc640 1 -- 172.21.15.18:0/343025628 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1adc015970 con 0x5648c4e97b40 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1ada7fc640 1 -- 172.21.15.18:0/343025628 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1adc015b70 con 0x5648c4e97b40 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1afb66c740 10 client.15969 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1afb66c740 1 -- 172.21.15.18:0/343025628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5648c4eafb10 con 0x5648c4e97b40 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.563+0000 7f1ada7fc640 1 -- 172.21.15.18:0/343025628 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae4019070 con 0x5648c4e97b40 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.564+0000 7f1ada7fc640 1 -- 172.21.15.18:0/343025628 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1adc015040 con 0x5648c4e97b40 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.564+0000 7f1afb66c740 10 client.15969 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.564+0000 7f1afb66c740 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.564+0000 7f1afb66c740 20 client.15969 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.564+0000 7f1afb66c740 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5648c4eb1020 0x5648c4eb34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.564+0000 7f1afb66c740 4 client.15969 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:53:57.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.564+0000 7f1afb66c740 1 -- 172.21.15.18:0/343025628 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648c4e09860 con 0x5648c4eb1020 2024-09-19T09:53:57.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.564+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5648c4eb1020 0x5648c4eb34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.564+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5648c4eb1020 0x5648c4eb34a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6df55ed458a79fd server_cookie=94779aaf1ebca76b in_seq=0 out_seq=0 2024-09-19T09:53:57.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.564+0000 7f1ada7fc640 10 client.15969 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1ada7fc640 1 -- 172.21.15.18:0/343025628 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648c4e09860 con 0x5648c4eb1020 2024-09-19T09:53:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1ada7fc640 10 client.15969 handle_command_reply: tid=0 2024-09-19T09:53:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1afb66c740 1 client.15969 shutdown 2024-09-19T09:53:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1afb66c740 1 -- 172.21.15.18:0/343025628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e97b40 msgr2=0x5648c4e9e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1afb66c740 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e97b40 0x5648c4e9e010 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0176e0 tx=0x7f1adc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1afb66c740 1 -- 172.21.15.18:0/343025628 shutdown_connections 2024-09-19T09:53:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1afb66c740 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5648c4eb1020 0x5648c4eb34a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1ada7fc640 0 client.15969 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1afb66c740 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4ea1370 0x5648c4e9e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1afb66c740 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e97b40 0x5648c4e9e010 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1afb66c740 1 --2- 172.21.15.18:0/343025628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 0x5648c4ea0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.565+0000 7f1afb66c740 1 -- 172.21.15.18:0/343025628 >> 172.21.15.18:0/343025628 conn(0x5648c4e5f310 msgr2=0x5648c4e98960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.566+0000 7f1afb66c740 1 -- 172.21.15.18:0/343025628 shutdown_connections 2024-09-19T09:53:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.566+0000 7f1afb66c740 1 -- 172.21.15.18:0/343025628 wait complete. 2024-09-19T09:53:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.566+0000 7f1afb66c740 20 client.15969 trim_cache size 0 max 16384 2024-09-19T09:53:57.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1afb66c740 1 Processor -- start 2024-09-19T09:53:57.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1afb66c740 1 -- start start 2024-09-19T09:53:57.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 0x5648c4e9dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4e97b40 0x5648c4ead310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4ea1370 0x5648c4ea9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1afb66c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1af41ad6b0 con 0x5648c4ea1370 2024-09-19T09:53:57.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1afb66c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1af41af1f0 con 0x5648c4e97b40 2024-09-19T09:53:57.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1afb66c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1af41add80 con 0x5648c4e965d0 2024-09-19T09:53:57.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1af37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4ea1370 0x5648c4ea9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1af37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4ea1370 0x5648c4ea9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60478/0 (socket says 172.21.15.18:60478) 2024-09-19T09:53:57.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1af37fe640 1 -- 172.21.15.18:0/3553834117 learned_addr learned my addr 172.21.15.18:0/3553834117 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:57.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1aebfff640 1 --2- 172.21.15.18:0/3553834117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4e97b40 0x5648c4ead310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/3553834117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 0x5648c4e9dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1af37fe640 1 -- 172.21.15.18:0/3553834117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 msgr2=0x5648c4e9dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:57.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1af37fe640 1 --2- 172.21.15.18:0/3553834117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 0x5648c4e9dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1af37fe640 1 -- 172.21.15.18:0/3553834117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4e97b40 msgr2=0x5648c4ead310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:57.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1af37fe640 1 --2- 172.21.15.18:0/3553834117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4e97b40 0x5648c4ead310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.579+0000 7f1af37fe640 1 -- 172.21.15.18:0/3553834117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648c4e92320 con 0x5648c4ea1370 2024-09-19T09:53:57.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.580+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/3553834117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 0x5648c4e9dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:53:57.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.580+0000 7f1af37fe640 1 --2- 172.21.15.18:0/3553834117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4ea1370 0x5648c4ea9860 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1aec003fd0 tx=0x7f1aec039f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e02caaffabb48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:57.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.580+0000 7f1ae8ff9640 1 -- 172.21.15.18:0/3553834117 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0098d0 con 0x5648c4ea1370 2024-09-19T09:53:57.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.580+0000 7f1ae8ff9640 1 -- 172.21.15.18:0/3553834117 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aec036030 con 0x5648c4ea1370 2024-09-19T09:53:57.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.580+0000 7f1ae8ff9640 1 -- 172.21.15.18:0/3553834117 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0bba30 con 0x5648c4ea1370 2024-09-19T09:53:57.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 -- 172.21.15.18:0/3553834117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4ea1370 msgr2=0x5648c4ea9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:57.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 --2- 172.21.15.18:0/3553834117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4ea1370 0x5648c4ea9860 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1aec003fd0 tx=0x7f1aec039f90 comp rx=0 tx=0).stop 2024-09-19T09:53:57.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 -- 172.21.15.18:0/3553834117 shutdown_connections 2024-09-19T09:53:57.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 --2- 172.21.15.18:0/3553834117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4ea1370 0x5648c4ea9860 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 --2- 172.21.15.18:0/3553834117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4e97b40 0x5648c4ead310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 --2- 172.21.15.18:0/3553834117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4e965d0 0x5648c4e9dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 -- 172.21.15.18:0/3553834117 >> 172.21.15.18:0/3553834117 conn(0x5648c4e5f310 msgr2=0x5648c4e8da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:57.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 -- 172.21.15.18:0/3553834117 shutdown_connections 2024-09-19T09:53:57.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 -- 172.21.15.18:0/3553834117 wait complete. 2024-09-19T09:53:57.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 -- start start 2024-09-19T09:53:57.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 Processor -- start 2024-09-19T09:53:57.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e9a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4e97b40 0x5648c4e9a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4ea1370 0x5648c4e9adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1af41aeb20 con 0x5648c4e965d0 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1af41ae450 con 0x5648c4e97b40 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.581+0000 7f1afb66c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1af41ab690 con 0x5648c4ea1370 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1afb66c740 10 client.0 _ll_register_callbacks cb 0x7f1adc00a1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e9a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e9a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60482/0 (socket says 172.21.15.18:60482) 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1af2ffd640 1 -- 172.21.15.18:0/2058671965 learned_addr learned my addr 172.21.15.18:0/2058671965 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1aebfff640 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4e97b40 0x5648c4e9a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1af37fe640 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4ea1370 0x5648c4e9adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1af2ffd640 1 -- 172.21.15.18:0/2058671965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4ea1370 msgr2=0x5648c4e9adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4ea1370 0x5648c4e9adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1af2ffd640 1 -- 172.21.15.18:0/2058671965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4e97b40 msgr2=0x5648c4e9a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:53:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4e97b40 0x5648c4e9a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1af2ffd640 1 -- 172.21.15.18:0/2058671965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648c4e9b5f0 con 0x5648c4e965d0 2024-09-19T09:53:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1af2ffd640 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e9a280 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400b820 tx=0x7f1ae400b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e2ba3eced8ccc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1ada7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:53:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1ada7fc640 1 -- 172.21.15.18:0/2058671965 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4025070 con 0x5648c4e965d0 2024-09-19T09:53:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1ada7fc640 1 -- 172.21.15.18:0/2058671965 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1ae400d950 con 0x5648c4e965d0 2024-09-19T09:53:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1afb66c740 1 -- 172.21.15.18:0/2058671965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aec036030 con 0x5648c4e965d0 2024-09-19T09:53:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1ada7fc640 1 -- 172.21.15.18:0/2058671965 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ae400db50 con 0x5648c4e965d0 2024-09-19T09:53:57.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1afb66c740 10 client.15975 fetch_fsmap learned FSMap version 28 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.582+0000 7f1afb66c740 1 -- 172.21.15.18:0/2058671965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5648c4f203a0 con 0x5648c4e965d0 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.583+0000 7f1ada7fc640 1 -- 172.21.15.18:0/2058671965 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aec036030 con 0x5648c4e965d0 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.583+0000 7f1ada7fc640 1 -- 172.21.15.18:0/2058671965 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1ae4013070 con 0x5648c4e965d0 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.583+0000 7f1afb66c740 10 client.15975 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.583+0000 7f1afb66c740 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.583+0000 7f1afb66c740 20 client.15975 populate_metadata read hostname 'smithi018' 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.583+0000 7f1afb66c740 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5648c4eb1020 0x5648c4f229a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.583+0000 7f1afb66c740 4 client.15975 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.583+0000 7f1afb66c740 1 -- 172.21.15.18:0/2058671965 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648c4e03d70 con 0x5648c4eb1020 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.583+0000 7f1aebfff640 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5648c4eb1020 0x5648c4f229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:57.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1aebfff640 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5648c4eb1020 0x5648c4f229a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c39ae7e7cf75d88c server_cookie=eb1a4ec96befa60a in_seq=0 out_seq=0 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1ada7fc640 10 client.15975 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1ada7fc640 1 -- 172.21.15.18:0/2058671965 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648c4e03d70 con 0x5648c4eb1020 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1ada7fc640 10 client.15975 handle_command_reply: tid=0 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 client.15975 shutdown 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 -- 172.21.15.18:0/2058671965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 msgr2=0x5648c4e9a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e9a280 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400b820 tx=0x7f1ae400b720 comp rx=0 tx=0).stop 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 -- 172.21.15.18:0/2058671965 shutdown_connections 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5648c4eb1020 0x5648c4f229a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648c4ea1370 0x5648c4e9adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5648c4e97b40 0x5648c4e9a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 --2- 172.21.15.18:0/2058671965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648c4e965d0 0x5648c4e9a280 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 -- 172.21.15.18:0/2058671965 >> 172.21.15.18:0/2058671965 conn(0x5648c4e5f310 msgr2=0x5648c4e92700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1ada7fc640 0 client.15975 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:53:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 -- 172.21.15.18:0/2058671965 shutdown_connections 2024-09-19T09:53:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 1 -- 172.21.15.18:0/2058671965 wait complete. 2024-09-19T09:53:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.584+0000 7f1afb66c740 20 client.15975 trim_cache size 0 max 16384 2024-09-19T09:53:57.593 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:53:57.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 -- 172.21.15.18:0/270195846 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1ae00a32c0 msgr2=0x7f1ae00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:57.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1ae00a32c0 0x7f1ae00a5780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5648c4e97070 tx=0x7f1adc00a2b0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 -- 172.21.15.18:0/270195846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1af41082a0 msgr2=0x7f1af419cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:57.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1af41082a0 0x7f1af419cfb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1aec005cc0 tx=0x7f1aec031460 comp rx=0 tx=0).stop 2024-09-19T09:53:57.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 -- 172.21.15.18:0/270195846 shutdown_connections 2024-09-19T09:53:57.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1ae00a32c0 0x7f1ae00a5780 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1af41082a0 0x7f1af419cfb0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1af41036e0 0x7f1af4198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 --2- 172.21.15.18:0/270195846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1af4102d30 0x7f1af41986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:57.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 -- 172.21.15.18:0/270195846 >> 172.21.15.18:0/270195846 conn(0x7f1af40fc7d0 msgr2=0x7f1af4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:57.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 -- 172.21.15.18:0/270195846 shutdown_connections 2024-09-19T09:53:57.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:57.585+0000 7f1af9293640 1 -- 172.21.15.18:0/270195846 wait complete. 2024-09-19T09:53:58.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:57 smithi018 ceph-mon[30956]: pgmap v387: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:53:58.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:57 smithi049 ceph-mon[34858]: pgmap v387: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:53:58.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:57 smithi162 ceph-mon[35174]: pgmap v387: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:53:59.241 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:53:59.241 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:53:59.513 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:53:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 -- 172.21.15.18:0/2274284201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6414102d40 msgr2=0x7f6414103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 --2- 172.21.15.18:0/2274284201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6414102d40 0x7f6414103120 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6404009900 tx=0x7f640402a480 comp rx=0 tx=0).stop 2024-09-19T09:53:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 -- 172.21.15.18:0/2274284201 shutdown_connections 2024-09-19T09:53:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 --2- 172.21.15.18:0/2274284201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641410c170 0x7f641410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 --2- 172.21.15.18:0/2274284201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414103660 0x7f641410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 --2- 172.21.15.18:0/2274284201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6414102d40 0x7f6414103120 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 -- 172.21.15.18:0/2274284201 >> 172.21.15.18:0/2274284201 conn(0x7f64140fc7a0 msgr2=0x7f64140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 -- 172.21.15.18:0/2274284201 shutdown_connections 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 -- 172.21.15.18:0/2274284201 wait complete. 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 Processor -- start 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.991+0000 7f641a787640 1 -- start start 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f641a787640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414102d40 0x7f64141984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f641a787640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6414103660 0x7f6414198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f641a787640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641410c170 0x7f641419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f641a787640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6414111f70 con 0x7f6414103660 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f641a787640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6414111df0 con 0x7f641410c170 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f641a787640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64141120f0 con 0x7f6414102d40 2024-09-19T09:53:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f640bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6414103660 0x7f6414198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f640bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6414103660 0x7f6414198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60498/0 (socket says 172.21.15.18:60498) 2024-09-19T09:53:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f640bfff640 1 -- 172.21.15.18:0/1940520964 learned_addr learned my addr 172.21.15.18:0/1940520964 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:53:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f6413fff640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414102d40 0x7f64141984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f6418d24640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641410c170 0x7f641419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:53:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f640bfff640 1 -- 172.21.15.18:0/1940520964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414102d40 msgr2=0x7f64141984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f640bfff640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414102d40 0x7f64141984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f640bfff640 1 -- 172.21.15.18:0/1940520964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641410c170 msgr2=0x7f641419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:53:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f640bfff640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641410c170 0x7f641419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:53:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f640bfff640 1 -- 172.21.15.18:0/1940520964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641419d4a0 con 0x7f6414103660 2024-09-19T09:53:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f640bfff640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6414103660 0x7f6414198a30 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00d750 tx=0x7f63fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:53:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f6411ffb640 1 -- 172.21.15.18:0/1940520964 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc017070 con 0x7f6414103660 2024-09-19T09:53:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f6411ffb640 1 -- 172.21.15.18:0/1940520964 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63fc005020 con 0x7f6414103660 2024-09-19T09:53:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f641a787640 1 -- 172.21.15.18:0/1940520964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641419d790 con 0x7f6414103660 2024-09-19T09:53:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.992+0000 7f6411ffb640 1 -- 172.21.15.18:0/1940520964 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc004d00 con 0x7f6414103660 2024-09-19T09:53:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.993+0000 7f641a787640 1 -- 172.21.15.18:0/1940520964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64141a5070 con 0x7f6414103660 2024-09-19T09:54:00.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.995+0000 7f6411ffb640 1 -- 172.21.15.18:0/1940520964 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f63fc009a30 con 0x7f6414103660 2024-09-19T09:54:00.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.995+0000 7f641cb60740 1 Processor -- start 2024-09-19T09:54:00.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.995+0000 7f641cb60740 1 -- start start 2024-09-19T09:54:00.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.995+0000 7f641cb60740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b645f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.995+0000 7f641cb60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 0x5647b6469c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.995+0000 7f641cb60740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b646c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.995+0000 7f641cb60740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5647b63c0280 con 0x5647b645ef70 2024-09-19T09:54:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.995+0000 7f641cb60740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5647b6367b10 con 0x5647b645f890 2024-09-19T09:54:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.995+0000 7f641cb60740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5647b63bc240 con 0x5647b646a150 2024-09-19T09:54:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6418d24640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b645f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6418d24640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b645f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60502/0 (socket says 172.21.15.18:60502) 2024-09-19T09:54:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6418d24640 1 -- 172.21.15.18:0/1564724862 learned_addr learned my addr 172.21.15.18:0/1564724862 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f640bfff640 1 --2- 172.21.15.18:0/1564724862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b646c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6413fff640 1 --2- 172.21.15.18:0/1564724862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 0x5647b6469c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6411ffb640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f64000a32c0 0x7f64000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6418d24640 1 -- 172.21.15.18:0/1564724862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 msgr2=0x5647b646c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6418d24640 1 --2- 172.21.15.18:0/1564724862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b646c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6418d24640 1 -- 172.21.15.18:0/1564724862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 msgr2=0x5647b6469c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6418d24640 1 --2- 172.21.15.18:0/1564724862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 0x5647b6469c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6418d24640 1 -- 172.21.15.18:0/1564724862 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647b63741f0 con 0x5647b645ef70 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6413fff640 1 --2- 172.21.15.18:0/1564724862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 0x5647b6469c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6411ffb640 1 -- 172.21.15.18:0/1940520964 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f63fc0cf2d0 con 0x7f6414103660 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6418d24640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f64000a32c0 0x7f64000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.996+0000 7f6418d24640 1 --2- 172.21.15.18:0/1564724862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b645f350 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f640c008ec0 tx=0x7f640c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6565d3986ab7e3d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:00.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f640a7fc640 1 -- 172.21.15.18:0/1564724862 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c022070 con 0x5647b645ef70 2024-09-19T09:54:00.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f640a7fc640 1 -- 172.21.15.18:0/1564724862 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f640c01c470 con 0x5647b645ef70 2024-09-19T09:54:00.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f640a7fc640 1 -- 172.21.15.18:0/1564724862 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c01a660 con 0x5647b645ef70 2024-09-19T09:54:00.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f641cb60740 1 -- 172.21.15.18:0/1564724862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 msgr2=0x5647b645f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:00.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f641cb60740 1 --2- 172.21.15.18:0/1564724862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b645f350 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f640c008ec0 tx=0x7f640c00e720 comp rx=0 tx=0).stop 2024-09-19T09:54:00.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f6418d24640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f64000a32c0 0x7f64000a5780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f640c01f000 tx=0x7f640c020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:00.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f641cb60740 1 -- 172.21.15.18:0/1564724862 shutdown_connections 2024-09-19T09:54:00.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f641cb60740 1 --2- 172.21.15.18:0/1564724862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b646c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f641cb60740 1 --2- 172.21.15.18:0/1564724862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 0x5647b6469c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f641cb60740 1 --2- 172.21.15.18:0/1564724862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b645f350 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f641cb60740 1 -- 172.21.15.18:0/1564724862 >> 172.21.15.18:0/1564724862 conn(0x5647b645b500 msgr2=0x5647b645b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:00.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f641cb60740 1 -- 172.21.15.18:0/1564724862 shutdown_connections 2024-09-19T09:54:00.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.997+0000 7f641cb60740 1 -- 172.21.15.18:0/1564724862 wait complete. 2024-09-19T09:54:00.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f641cb60740 1 -- start start 2024-09-19T09:54:00.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f641cb60740 1 Processor -- start 2024-09-19T09:54:00.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f641cb60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645ef70 0x5647b6466ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f641cb60740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6467530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f641cb60740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b6467a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f641cb60740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5647b646cd20 con 0x5647b645f890 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f641cb60740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5647b637af10 con 0x5647b645ef70 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f641cb60740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5647b646cea0 con 0x5647b646a150 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f641cb60740 10 client.0 _ll_register_callbacks cb 0x5647b6343a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f640bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6467530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f640bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6467530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60510/0 (socket says 172.21.15.18:60510) 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f640bfff640 1 -- 172.21.15.18:0/496654856 learned_addr learned my addr 172.21.15.18:0/496654856 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.998+0000 7f6413fff640 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645ef70 0x5647b6466ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f6418d24640 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b6467a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f6413fff640 1 -- 172.21.15.18:0/496654856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 msgr2=0x5647b6467a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f6413fff640 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b6467a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f6413fff640 1 -- 172.21.15.18:0/496654856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 msgr2=0x5647b6467530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f6413fff640 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6467530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f6413fff640 1 -- 172.21.15.18:0/496654856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647b61316a0 con 0x5647b645ef70 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f640bfff640 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6467530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f6413fff640 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645ef70 0x5647b6466ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6404005940 tx=0x7f6404031b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a4379e73ee3206c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f63f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f63f37fe640 1 -- 172.21.15.18:0/496654856 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404035040 con 0x5647b645ef70 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f641cb60740 1 -- 172.21.15.18:0/496654856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f640c01c470 con 0x5647b645ef70 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:53:59.999+0000 7f63f37fe640 1 -- 172.21.15.18:0/496654856 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6404004480 con 0x5647b645ef70 2024-09-19T09:54:00.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f63f37fe640 1 -- 172.21.15.18:0/496654856 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6404005020 con 0x5647b645ef70 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f641cb60740 10 client.25592 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f641cb60740 1 -- 172.21.15.18:0/496654856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5647b6478940 con 0x5647b645ef70 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f63f37fe640 1 -- 172.21.15.18:0/496654856 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f640c01c470 con 0x5647b645ef70 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f63f37fe640 1 -- 172.21.15.18:0/496654856 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f64040035f0 con 0x5647b645ef70 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f641cb60740 10 client.25592 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f641cb60740 10 client.25592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f641cb60740 20 client.25592 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f641cb60740 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5647b6479e00 0x5647b647c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f641cb60740 4 client.25592 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f641cb60740 1 -- 172.21.15.18:0/496654856 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647b63cd7f0 con 0x5647b6479e00 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.000+0000 7f640bfff640 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5647b6479e00 0x5647b647c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.001+0000 7f640bfff640 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5647b6479e00 0x5647b647c210 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ace9c6d89c5702a3 server_cookie=4092491b05b33ba3 in_seq=0 out_seq=0 2024-09-19T09:54:00.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.001+0000 7f63f37fe640 10 client.25592 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:00.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.001+0000 7f63f37fe640 1 -- 172.21.15.18:0/496654856 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647b63cd7f0 con 0x5647b6479e00 2024-09-19T09:54:00.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.001+0000 7f63f37fe640 10 client.25592 handle_command_reply: tid=0 2024-09-19T09:54:00.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.001+0000 7f641cb60740 1 client.25592 shutdown 2024-09-19T09:54:00.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 1 -- 172.21.15.18:0/496654856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645ef70 msgr2=0x5647b6466ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:00.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645ef70 0x5647b6466ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6404005940 tx=0x7f6404031b30 comp rx=0 tx=0).stop 2024-09-19T09:54:00.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 1 -- 172.21.15.18:0/496654856 shutdown_connections 2024-09-19T09:54:00.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5647b6479e00 0x5647b647c210 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b6467a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6467530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f63f37fe640 0 client.25592 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:00.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 1 --2- 172.21.15.18:0/496654856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645ef70 0x5647b6466ff0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 1 -- 172.21.15.18:0/496654856 >> 172.21.15.18:0/496654856 conn(0x5647b645b500 msgr2=0x5647b6456270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:00.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 1 -- 172.21.15.18:0/496654856 shutdown_connections 2024-09-19T09:54:00.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 1 -- 172.21.15.18:0/496654856 wait complete. 2024-09-19T09:54:00.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.002+0000 7f641cb60740 20 client.25592 trim_cache size 0 max 16384 2024-09-19T09:54:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f641cb60740 1 Processor -- start 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f641cb60740 1 -- start start 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f641cb60740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b645ef70 0x5647b6461a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f641cb60740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6456160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f641cb60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b646a150 0x5647b6481ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f641cb60740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f64141ab200 con 0x5647b645f890 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f641cb60740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f64141acd40 con 0x5647b646a150 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f641cb60740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64141ab8d0 con 0x5647b645ef70 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f640bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6456160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f640bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6456160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60518/0 (socket says 172.21.15.18:60518) 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.019+0000 7f640bfff640 1 -- 172.21.15.18:0/4196131296 learned_addr learned my addr 172.21.15.18:0/4196131296 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f6418d24640 1 --2- 172.21.15.18:0/4196131296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b646a150 0x5647b6481ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f640bfff640 1 -- 172.21.15.18:0/4196131296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b645ef70 msgr2=0x5647b6461a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f6413fff640 1 --2- 172.21.15.18:0/4196131296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b645ef70 0x5647b6461a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f640bfff640 1 --2- 172.21.15.18:0/4196131296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b645ef70 0x5647b6461a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f640bfff640 1 -- 172.21.15.18:0/4196131296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b646a150 msgr2=0x5647b6481ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f640bfff640 1 --2- 172.21.15.18:0/4196131296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b646a150 0x5647b6481ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f640bfff640 1 -- 172.21.15.18:0/4196131296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647b64695d0 con 0x5647b645f890 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f6413fff640 1 --2- 172.21.15.18:0/4196131296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b645ef70 0x5647b6461a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f640bfff640 1 --2- 172.21.15.18:0/4196131296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6456160 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00bfd0 tx=0x7f63fc0d1720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d702873f71f403e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f6409ffb640 1 -- 172.21.15.18:0/4196131296 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc020040 con 0x5647b645f890 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f6409ffb640 1 -- 172.21.15.18:0/4196131296 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63fc09fc70 con 0x5647b645f890 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.020+0000 7f6409ffb640 1 -- 172.21.15.18:0/4196131296 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0051d0 con 0x5647b645f890 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 -- 172.21.15.18:0/4196131296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 msgr2=0x5647b6456160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 --2- 172.21.15.18:0/4196131296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6456160 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00bfd0 tx=0x7f63fc0d1720 comp rx=0 tx=0).stop 2024-09-19T09:54:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 -- 172.21.15.18:0/4196131296 shutdown_connections 2024-09-19T09:54:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 --2- 172.21.15.18:0/4196131296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b646a150 0x5647b6481ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 --2- 172.21.15.18:0/4196131296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645f890 0x5647b6456160 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 --2- 172.21.15.18:0/4196131296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b645ef70 0x5647b6461a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 -- 172.21.15.18:0/4196131296 >> 172.21.15.18:0/4196131296 conn(0x5647b645b500 msgr2=0x5647b6455a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 -- 172.21.15.18:0/4196131296 shutdown_connections 2024-09-19T09:54:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 -- 172.21.15.18:0/4196131296 wait complete. 2024-09-19T09:54:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 -- start start 2024-09-19T09:54:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.021+0000 7f641cb60740 1 Processor -- start 2024-09-19T09:54:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f641cb60740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b6472a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f641cb60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 0x5647b6463ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f641cb60740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b64645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f641cb60740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f64141ac670 con 0x5647b645ef70 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f641cb60740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f64141abfa0 con 0x5647b645f890 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f641cb60740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64141a9200 con 0x5647b646a150 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f641cb60740 10 client.0 _ll_register_callbacks cb 0x7f64040315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f6413fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b6472a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f6413fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b6472a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60526/0 (socket says 172.21.15.18:60526) 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f6413fff640 1 -- 172.21.15.18:0/1807965988 learned_addr learned my addr 172.21.15.18:0/1807965988 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f640bfff640 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 0x5647b6463ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f6418d24640 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b64645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f6413fff640 1 -- 172.21.15.18:0/1807965988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 msgr2=0x5647b64645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f6413fff640 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b64645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f6413fff640 1 -- 172.21.15.18:0/1807965988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 msgr2=0x5647b6463ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f6413fff640 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 0x5647b6463ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f6413fff640 1 -- 172.21.15.18:0/1807965988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647b64e3ab0 con 0x5647b645ef70 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f640bfff640 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 0x5647b6463ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f6413fff640 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b6472a00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6404006010 tx=0x7f6404003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7751215d01bfa44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f63f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f63f37fe640 1 -- 172.21.15.18:0/1807965988 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404035040 con 0x5647b645ef70 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f641cb60740 1 -- 172.21.15.18:0/1807965988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63fc09fc70 con 0x5647b645ef70 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.022+0000 7f63f37fe640 1 -- 172.21.15.18:0/1807965988 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6404004480 con 0x5647b645ef70 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f63f37fe640 1 -- 172.21.15.18:0/1807965988 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6404061050 con 0x5647b645ef70 2024-09-19T09:54:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f641cb60740 10 client.15993 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f641cb60740 1 -- 172.21.15.18:0/1807965988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5647b64e4c20 con 0x5647b645ef70 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f63f37fe640 1 -- 172.21.15.18:0/1807965988 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63fc09fc70 con 0x5647b645ef70 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f63f37fe640 1 -- 172.21.15.18:0/1807965988 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f64040049f0 con 0x5647b645ef70 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f641cb60740 10 client.15993 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f641cb60740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f641cb60740 20 client.15993 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f641cb60740 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5647b6479e00 0x5647b64e7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f641cb60740 4 client.15993 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f641cb60740 1 -- 172.21.15.18:0/1807965988 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5647b63c7d00 con 0x5647b6479e00 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.023+0000 7f640bfff640 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5647b6479e00 0x5647b64e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.024+0000 7f640bfff640 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5647b6479e00 0x5647b64e7350 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6a40357d9221a09 server_cookie=99a4d4bcc2849ec7 in_seq=0 out_seq=0 2024-09-19T09:54:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.024+0000 7f63f37fe640 10 client.15993 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f63f37fe640 1 -- 172.21.15.18:0/1807965988 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5647b63c7d00 con 0x5647b6479e00 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f63f37fe640 10 client.15993 handle_command_reply: tid=0 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 client.15993 shutdown 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 -- 172.21.15.18:0/1807965988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 msgr2=0x5647b6472a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b6472a00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6404006010 tx=0x7f6404003820 comp rx=0 tx=0).stop 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 -- 172.21.15.18:0/1807965988 shutdown_connections 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5647b6479e00 0x5647b64e7350 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647b646a150 0x5647b64645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5647b645f890 0x5647b6463ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 --2- 172.21.15.18:0/1807965988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b645ef70 0x5647b6472a00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f63f37fe640 0 client.15993 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 -- 172.21.15.18:0/1807965988 >> 172.21.15.18:0/1807965988 conn(0x5647b645b500 msgr2=0x5647b6456270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 -- 172.21.15.18:0/1807965988 shutdown_connections 2024-09-19T09:54:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 1 -- 172.21.15.18:0/1807965988 wait complete. 2024-09-19T09:54:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.025+0000 7f641cb60740 20 client.15993 trim_cache size 0 max 16384 2024-09-19T09:54:00.035 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:54:00.035 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T09:54:00.035 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "4574c4d0-d63d-419f-bc24-c8fb5041b12c", 2024-09-19T09:54:00.036 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T09:54:00.036 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 -- 172.21.15.18:0/1940520964 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f64000a32c0 msgr2=0x7f64000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f64000a32c0 0x7f64000a5780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f640c01f000 tx=0x7f640c020000 comp rx=0 tx=0).stop 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 -- 172.21.15.18:0/1940520964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6414103660 msgr2=0x7f6414198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6414103660 0x7f6414198a30 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00d750 tx=0x7f63fc00dc10 comp rx=0 tx=0).stop 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 -- 172.21.15.18:0/1940520964 shutdown_connections 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f64000a32c0 0x7f64000a5780 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f641410c170 0x7f641419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6414103660 0x7f6414198a30 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 --2- 172.21.15.18:0/1940520964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414102d40 0x7f64141984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 -- 172.21.15.18:0/1940520964 >> 172.21.15.18:0/1940520964 conn(0x7f64140fc7a0 msgr2=0x7f64140fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 -- 172.21.15.18:0/1940520964 shutdown_connections 2024-09-19T09:54:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:00.026+0000 7f641a787640 1 -- 172.21.15.18:0/1940520964 wait complete. 2024-09-19T09:54:00.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:53:59 smithi018 ceph-mon[30956]: pgmap v388: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:54:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:53:59 smithi049 ceph-mon[34858]: pgmap v388: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:54:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:53:59 smithi162 ceph-mon[35174]: pgmap v388: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:54:00.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:54:00.915 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:01.305 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:00 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T09:54:01.305 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:00 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:54:01.305 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:00 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T09:54:01.305 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:00 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:54:01.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.387+0000 7f19d3784640 1 -- 172.21.15.18:0/3378368711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19cc10e500 msgr2=0x7f19cc110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:01.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.387+0000 7f19d3784640 1 --2- 172.21.15.18:0/3378368711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19cc10e500 0x7f19cc110910 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009ca0 tx=0x7f19c402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.388+0000 7f19d3784640 1 -- 172.21.15.18:0/3378368711 shutdown_connections 2024-09-19T09:54:01.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.388+0000 7f19d3784640 1 --2- 172.21.15.18:0/3378368711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19cc10e500 0x7f19cc110910 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.388+0000 7f19d3784640 1 --2- 172.21.15.18:0/3378368711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19cc101440 0x7f19cc10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.388+0000 7f19d3784640 1 --2- 172.21.15.18:0/3378368711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19cc100b20 0x7f19cc100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.388+0000 7f19d3784640 1 -- 172.21.15.18:0/3378368711 >> 172.21.15.18:0/3378368711 conn(0x7f19cc0fc7d0 msgr2=0x7f19cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.388+0000 7f19d3784640 1 -- 172.21.15.18:0/3378368711 shutdown_connections 2024-09-19T09:54:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.388+0000 7f19d3784640 1 -- 172.21.15.18:0/3378368711 wait complete. 2024-09-19T09:54:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.388+0000 7f19d3784640 1 Processor -- start 2024-09-19T09:54:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.388+0000 7f19d3784640 1 -- start start 2024-09-19T09:54:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d3784640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19cc100b20 0x7f19cc1a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d3784640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19cc101440 0x7f19cc1a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d3784640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19cc10e500 0x7f19cc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d3784640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc1142b0 con 0x7f19cc10e500 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d3784640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc114130 con 0x7f19cc101440 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d3784640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc114430 con 0x7f19cc100b20 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d1d21640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19cc10e500 0x7f19cc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d1d21640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19cc10e500 0x7f19cc19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60540/0 (socket says 172.21.15.18:60540) 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d1d21640 1 -- 172.21.15.18:0/122654712 learned_addr learned my addr 172.21.15.18:0/122654712 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d1520640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19cc100b20 0x7f19cc1a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19cc101440 0x7f19cc1a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d1d21640 1 -- 172.21.15.18:0/122654712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19cc100b20 msgr2=0x7f19cc1a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d1d21640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19cc100b20 0x7f19cc1a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d1d21640 1 -- 172.21.15.18:0/122654712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19cc101440 msgr2=0x7f19cc1a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:01.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d1d21640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19cc101440 0x7f19cc1a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d1d21640 1 -- 172.21.15.18:0/122654712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc19acd0 con 0x7f19cc10e500 2024-09-19T09:54:01.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.389+0000 7f19d1d21640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19cc10e500 0x7f19cc19a5a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f19c4031680 tx=0x7f19c40316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:01.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.390+0000 7f19ca7fc640 1 -- 172.21.15.18:0/122654712 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c40319d0 con 0x7f19cc10e500 2024-09-19T09:54:01.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.390+0000 7f19d3784640 1 -- 172.21.15.18:0/122654712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19cc19af60 con 0x7f19cc10e500 2024-09-19T09:54:01.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.390+0000 7f19ca7fc640 1 -- 172.21.15.18:0/122654712 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19c4003e20 con 0x7f19cc10e500 2024-09-19T09:54:01.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.390+0000 7f19ca7fc640 1 -- 172.21.15.18:0/122654712 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c402fd00 con 0x7f19cc10e500 2024-09-19T09:54:01.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.390+0000 7f19d3784640 1 -- 172.21.15.18:0/122654712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19cc1a72b0 con 0x7f19cc10e500 2024-09-19T09:54:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.393+0000 7f19d5b5d740 1 Processor -- start 2024-09-19T09:54:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.393+0000 7f19ca7fc640 1 -- 172.21.15.18:0/122654712 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f19c4004040 con 0x7f19cc10e500 2024-09-19T09:54:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.393+0000 7f19d5b5d740 1 -- start start 2024-09-19T09:54:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.393+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841f4a0 0x556b2841f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.393+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841fdc0 0x556b2842a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.393+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b2842ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.393+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556b283852e0 con 0x556b2842a680 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.393+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556b2832cce0 con 0x556b2841f4a0 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.393+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556b283812a0 con 0x556b2841fdc0 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d0d1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b2842ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d0d1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b2842ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60542/0 (socket says 172.21.15.18:60542) 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d0d1f640 1 -- 172.21.15.18:0/3267697113 learned_addr learned my addr 172.21.15.18:0/3267697113 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d1520640 1 --2- 172.21.15.18:0/3267697113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841fdc0 0x556b2842a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/3267697113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841f4a0 0x556b2841f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d0d1f640 1 -- 172.21.15.18:0/3267697113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841fdc0 msgr2=0x556b2842a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/3267697113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841fdc0 0x556b2842a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19ca7fc640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19b40a3420 0x7f19b40a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d0d1f640 1 -- 172.21.15.18:0/3267697113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841f4a0 msgr2=0x556b2841f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/3267697113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841f4a0 0x556b2841f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d0d1f640 1 -- 172.21.15.18:0/3267697113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b28311440 con 0x556b2842a680 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d1520640 1 --2- 172.21.15.18:0/3267697113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841fdc0 0x556b2842a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d1d21640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19b40a3420 0x7f19b40a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/3267697113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b2842ca70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f19c0005fd0 tx=0x7f19c000e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7527cd80bbac2ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19ca7fc640 1 -- 172.21.15.18:0/122654712 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f19c40f0ee0 con 0x7f19cc10e500 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19b37fe640 1 -- 172.21.15.18:0/3267697113 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0018070 con 0x556b2842a680 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19b37fe640 1 -- 172.21.15.18:0/3267697113 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19c0004230 con 0x556b2842a680 2024-09-19T09:54:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.394+0000 7f19b37fe640 1 -- 172.21.15.18:0/3267697113 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0003af0 con 0x556b2842a680 2024-09-19T09:54:01.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.395+0000 7f19d5b5d740 1 -- 172.21.15.18:0/3267697113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 msgr2=0x556b2842ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:01.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.395+0000 7f19d1d21640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19b40a3420 0x7f19b40a58e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f19c40b9f00 tx=0x7f19c40b2a10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:01.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.395+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/3267697113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b2842ca70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f19c0005fd0 tx=0x7f19c000e630 comp rx=0 tx=0).stop 2024-09-19T09:54:01.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.395+0000 7f19d5b5d740 1 -- 172.21.15.18:0/3267697113 shutdown_connections 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.395+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/3267697113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b2842ca70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.395+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/3267697113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841fdc0 0x556b2842a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.395+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/3267697113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841f4a0 0x556b2841f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.395+0000 7f19d5b5d740 1 -- 172.21.15.18:0/3267697113 >> 172.21.15.18:0/3267697113 conn(0x556b2841ba30 msgr2=0x556b2841be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.395+0000 7f19d5b5d740 1 -- 172.21.15.18:0/3267697113 shutdown_connections 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.395+0000 7f19d5b5d740 1 -- 172.21.15.18:0/3267697113 wait complete. 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d5b5d740 1 -- start start 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d5b5d740 1 Processor -- start 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b2842a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b284272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28427840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556b2842d250 con 0x556b2842a680 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556b28340050 con 0x556b2841fdc0 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556b2842d3d0 con 0x556b2841f4a0 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d5b5d740 10 client.0 _ll_register_callbacks cb 0x556b28380160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d0d1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28427840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d0d1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28427840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60548/0 (socket says 172.21.15.18:60548) 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d0d1f640 1 -- 172.21.15.18:0/2943154194 learned_addr learned my addr 172.21.15.18:0/2943154194 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.396+0000 7f19d1520640 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b284272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b2842a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19d0d1f640 1 -- 172.21.15.18:0/2943154194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 msgr2=0x556b2842a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b2842a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19d0d1f640 1 -- 172.21.15.18:0/2943154194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 msgr2=0x556b284272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:01.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b284272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19d0d1f640 1 -- 172.21.15.18:0/2943154194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b280f63c0 con 0x556b2842a680 2024-09-19T09:54:01.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28427840 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f19c000eea0 tx=0x7f19c00037d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e168673595e003 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:01.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:01.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2943154194 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0018070 con 0x556b2842a680 2024-09-19T09:54:01.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2943154194 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f19c0004ad0 con 0x556b2842a680 2024-09-19T09:54:01.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2943154194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19c0004230 con 0x556b2842a680 2024-09-19T09:54:01.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2943154194 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19c0032020 con 0x556b2842a680 2024-09-19T09:54:01.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19d5b5d740 10 client.16005 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:01.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.397+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2943154194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b28438c40 con 0x556b2842a680 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.398+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2943154194 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19c0004230 con 0x556b2842a680 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.398+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2943154194 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f19c00106a0 con 0x556b2842a680 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.398+0000 7f19d5b5d740 10 client.16005 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.398+0000 7f19d5b5d740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.398+0000 7f19d5b5d740 20 client.16005 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.398+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556b2843a050 0x556b2843c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.398+0000 7f19d5b5d740 4 client.16005 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.398+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2943154194 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b28392850 con 0x556b2843a050 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.398+0000 7f19d1520640 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556b2843a050 0x556b2843c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.399+0000 7f19d1520640 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556b2843a050 0x556b2843c440 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b3f6f71565da8e9 server_cookie=f55d45d8a7b7c7e6 in_seq=0 out_seq=0 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.399+0000 7f19b0ff9640 10 client.16005 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:01.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.399+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2943154194 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b28392850 con 0x556b2843a050 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.399+0000 7f19b0ff9640 10 client.16005 handle_command_reply: tid=0 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 client.16005 shutdown 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2943154194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 msgr2=0x556b28427840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28427840 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f19c000eea0 tx=0x7f19c00037d0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2943154194 shutdown_connections 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556b2843a050 0x556b2843c440 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28427840 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b284272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2943154194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b2842a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2943154194 >> 172.21.15.18:0/2943154194 conn(0x556b2841ba30 msgr2=0x556b28421710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19b0ff9640 0 client.16005 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2943154194 shutdown_connections 2024-09-19T09:54:01.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2943154194 wait complete. 2024-09-19T09:54:01.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.400+0000 7f19d5b5d740 20 client.16005 trim_cache size 0 max 16384 2024-09-19T09:54:01.408 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:00 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T09:54:01.408 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:00 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:54:01.408 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:00 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T09:54:01.408 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:00 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:54:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:00 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T09:54:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:00 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:54:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:00 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T09:54:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:00 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:54:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.417+0000 7f19d5b5d740 1 Processor -- start 2024-09-19T09:54:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.417+0000 7f19d5b5d740 1 -- start start 2024-09-19T09:54:01.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b284364b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b28422700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28441ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc1af6c0 con 0x556b2842a680 2024-09-19T09:54:01.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc1b1200 con 0x556b2841fdc0 2024-09-19T09:54:01.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc1afd90 con 0x556b2841f4a0 2024-09-19T09:54:01.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d0d1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28441ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d0d1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28441ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60560/0 (socket says 172.21.15.18:60560) 2024-09-19T09:54:01.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d0d1f640 1 -- 172.21.15.18:0/3683739305 learned_addr learned my addr 172.21.15.18:0/3683739305 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:01.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/3683739305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b284364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d1520640 1 --2- 172.21.15.18:0/3683739305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b28422700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d0d1f640 1 -- 172.21.15.18:0/3683739305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 msgr2=0x556b284364b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:01.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/3683739305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b284364b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d0d1f640 1 -- 172.21.15.18:0/3683739305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 msgr2=0x556b28422700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:01.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/3683739305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b28422700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d0d1f640 1 -- 172.21.15.18:0/3683739305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b2842a380 con 0x556b2842a680 2024-09-19T09:54:01.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/3683739305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28441ad0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f19c000e530 tx=0x7f19c00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa2b92ef7ccf18f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:01.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19b2ffd640 1 -- 172.21.15.18:0/3683739305 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0018040 con 0x556b2842a680 2024-09-19T09:54:01.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.418+0000 7f19b2ffd640 1 -- 172.21.15.18:0/3683739305 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19c0021030 con 0x556b2842a680 2024-09-19T09:54:01.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19b2ffd640 1 -- 172.21.15.18:0/3683739305 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0037450 con 0x556b2842a680 2024-09-19T09:54:01.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19d5b5d740 1 -- 172.21.15.18:0/3683739305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 msgr2=0x556b28441ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:01.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/3683739305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28441ad0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f19c000e530 tx=0x7f19c00035f0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19d5b5d740 1 -- 172.21.15.18:0/3683739305 shutdown_connections 2024-09-19T09:54:01.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/3683739305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28441ad0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/3683739305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b28422700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/3683739305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b284364b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19d5b5d740 1 -- 172.21.15.18:0/3683739305 >> 172.21.15.18:0/3683739305 conn(0x556b2841ba30 msgr2=0x556b28429340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19d5b5d740 1 -- 172.21.15.18:0/3683739305 shutdown_connections 2024-09-19T09:54:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19d5b5d740 1 -- 172.21.15.18:0/3683739305 wait complete. 2024-09-19T09:54:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.419+0000 7f19d5b5d740 1 -- start start 2024-09-19T09:54:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d5b5d740 1 Processor -- start 2024-09-19T09:54:01.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b28432e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b28424250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d5b5d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28424790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc1b0b30 con 0x556b2842a680 2024-09-19T09:54:01.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc1b0460 con 0x556b2841fdc0 2024-09-19T09:54:01.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d5b5d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc1ad6a0 con 0x556b2841f4a0 2024-09-19T09:54:01.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d5b5d740 10 client.0 _ll_register_callbacks cb 0x7f19c0012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:01.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d0d1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28424790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d0d1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28424790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60570/0 (socket says 172.21.15.18:60570) 2024-09-19T09:54:01.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d0d1f640 1 -- 172.21.15.18:0/2464872118 learned_addr learned my addr 172.21.15.18:0/2464872118 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:01.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d1520640 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b28424250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.420+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b28432e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19d0d1f640 1 -- 172.21.15.18:0/2464872118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 msgr2=0x556b28432e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:01.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b28432e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19d0d1f640 1 -- 172.21.15.18:0/2464872118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 msgr2=0x556b28424250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:01.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b28424250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19d0d1f640 1 -- 172.21.15.18:0/2464872118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b28424f90 con 0x556b2842a680 2024-09-19T09:54:01.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19d0d1f640 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28424790 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f19c0006010 tx=0x7f19c00106a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4673dc782750718d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:01.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:01.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2464872118 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0018040 con 0x556b2842a680 2024-09-19T09:54:01.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2464872118 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f19c00048d0 con 0x556b2842a680 2024-09-19T09:54:01.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2464872118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19c0021030 con 0x556b2842a680 2024-09-19T09:54:01.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2464872118 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19c004e020 con 0x556b2842a680 2024-09-19T09:54:01.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19d5b5d740 10 client.16011 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:01.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2464872118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b284a4ae0 con 0x556b2842a680 2024-09-19T09:54:01.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2464872118 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19c0021030 con 0x556b2842a680 2024-09-19T09:54:01.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.421+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2464872118 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f19c0045070 con 0x556b2842a680 2024-09-19T09:54:01.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.422+0000 7f19d5b5d740 10 client.16011 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:01.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.422+0000 7f19d5b5d740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:01.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.422+0000 7f19d5b5d740 20 client.16011 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:01.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.422+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556b284a5090 0x556b284a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:01.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.422+0000 7f19d5b5d740 4 client.16011 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:54:01.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.422+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2464872118 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556b2838cd60 con 0x556b284a5090 2024-09-19T09:54:01.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.422+0000 7f19d1520640 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556b284a5090 0x556b284a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:01.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.422+0000 7f19b0ff9640 10 client.16011 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:01.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.422+0000 7f19d1520640 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556b284a5090 0x556b284a74b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec87c309d827166 server_cookie=12196c443dc0ad85 in_seq=0 out_seq=0 2024-09-19T09:54:01.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19b0ff9640 1 -- 172.21.15.18:0/2464872118 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556b2838cd60 con 0x556b284a5090 2024-09-19T09:54:01.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19b0ff9640 10 client.16011 handle_command_reply: tid=0 2024-09-19T09:54:01.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 client.16011 shutdown 2024-09-19T09:54:01.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2464872118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 msgr2=0x556b28424790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:01.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28424790 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f19c0006010 tx=0x7f19c00106a0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2464872118 shutdown_connections 2024-09-19T09:54:01.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556b284a5090 0x556b284a74b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556b2842a680 0x556b28424790 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2841fdc0 0x556b28424250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 --2- 172.21.15.18:0/2464872118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b2841f4a0 0x556b28432e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2464872118 >> 172.21.15.18:0/2464872118 conn(0x556b2841ba30 msgr2=0x556b28425a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:01.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19b0ff9640 0 client.16011 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:01.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2464872118 shutdown_connections 2024-09-19T09:54:01.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 1 -- 172.21.15.18:0/2464872118 wait complete. 2024-09-19T09:54:01.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.423+0000 7f19d5b5d740 20 client.16011 trim_cache size 0 max 16384 2024-09-19T09:54:01.441 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:54:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:54:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T09:54:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "4574c4d0-d63d-419f-bc24-c8fb5041b12c": { 2024-09-19T09:54:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T09:54:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "4574c4d0-d63d-419f-bc24-c8fb5041b12c", 2024-09-19T09:54:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T09:54:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:01.442 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:54:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 -- 172.21.15.18:0/122654712 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19b40a3420 msgr2=0x7f19b40a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19b40a3420 0x7f19b40a58e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f19c40b9f00 tx=0x7f19c40b2a10 comp rx=0 tx=0).stop 2024-09-19T09:54:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 -- 172.21.15.18:0/122654712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19cc10e500 msgr2=0x7f19cc19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19cc10e500 0x7f19cc19a5a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f19c4031680 tx=0x7f19c40316b0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 -- 172.21.15.18:0/122654712 shutdown_connections 2024-09-19T09:54:01.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f19b40a3420 0x7f19b40a58e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19cc10e500 0x7f19cc19a5a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19cc101440 0x7f19cc1a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 --2- 172.21.15.18:0/122654712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19cc100b20 0x7f19cc1a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:01.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 -- 172.21.15.18:0/122654712 >> 172.21.15.18:0/122654712 conn(0x7f19cc0fc7d0 msgr2=0x7f19cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:01.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 -- 172.21.15.18:0/122654712 shutdown_connections 2024-09-19T09:54:01.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:01.424+0000 7f19d3784640 1 -- 172.21.15.18:0/122654712 wait complete. 2024-09-19T09:54:02.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:01 smithi018 ceph-mon[30956]: pgmap v389: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:54:02.046 INFO:tasks.cephfs.filesystem:scrub status for tag:4574c4d0-d63d-419f-bc24-c8fb5041b12c - {'path': '/', 'tag': '4574c4d0-d63d-419f-bc24-c8fb5041b12c', 'options': 'recursive,force'} 2024-09-19T09:54:02.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:01 smithi049 ceph-mon[34858]: pgmap v389: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:54:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:01 smithi162 ceph-mon[35174]: pgmap v389: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:54:04.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:03 smithi018 ceph-mon[30956]: pgmap v390: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:54:04.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:03 smithi049 ceph-mon[34858]: pgmap v390: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:54:04.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:03 smithi162 ceph-mon[35174]: pgmap v390: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:54:05.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:04 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T09:54:05.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:04 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T09:54:05.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:04 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T09:54:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.489+0000 7fe58dc47640 1 -- 172.21.15.18:0/1780549881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe588102d30 msgr2=0x7fe5881031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.489+0000 7fe58dc47640 1 --2- 172.21.15.18:0/1780549881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe588102d30 0x7fe5881031b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009900 tx=0x7fe57c02a410 comp rx=0 tx=0).stop 2024-09-19T09:54:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.489+0000 7fe58dc47640 1 -- 172.21.15.18:0/1780549881 shutdown_connections 2024-09-19T09:54:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.489+0000 7fe58dc47640 1 --2- 172.21.15.18:0/1780549881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5881036f0 0x7fe588109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.489+0000 7fe58dc47640 1 --2- 172.21.15.18:0/1780549881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe588102d30 0x7fe5881031b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.489+0000 7fe58dc47640 1 --2- 172.21.15.18:0/1780549881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe588101b40 0x7fe588101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.489+0000 7fe58dc47640 1 -- 172.21.15.18:0/1780549881 >> 172.21.15.18:0/1780549881 conn(0x7fe5880fd2e0 msgr2=0x7fe5880ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.489+0000 7fe58dc47640 1 -- 172.21.15.18:0/1780549881 shutdown_connections 2024-09-19T09:54:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.489+0000 7fe58dc47640 1 -- 172.21.15.18:0/1780549881 wait complete. 2024-09-19T09:54:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe58dc47640 1 Processor -- start 2024-09-19T09:54:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe58dc47640 1 -- start start 2024-09-19T09:54:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe58dc47640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe588101b40 0x7fe588197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe58dc47640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe588102d30 0x7fe588198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe58dc47640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5881036f0 0x7fe58819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe58dc47640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe58810d7a0 con 0x7fe5881036f0 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe58dc47640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe58810d620 con 0x7fe588102d30 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe58dc47640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe58810d920 con 0x7fe588101b40 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe587fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5881036f0 0x7fe58819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe587fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5881036f0 0x7fe58819f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60592/0 (socket says 172.21.15.18:60592) 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.490+0000 7fe587fff640 1 -- 172.21.15.18:0/2685465044 learned_addr learned my addr 172.21.15.18:0/2685465044 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe586ffd640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe588102d30 0x7fe588198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe5877fe640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe588101b40 0x7fe588197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe587fff640 1 -- 172.21.15.18:0/2685465044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe588101b40 msgr2=0x7fe588197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe587fff640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe588101b40 0x7fe588197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe587fff640 1 -- 172.21.15.18:0/2685465044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe588102d30 msgr2=0x7fe588198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe587fff640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe588102d30 0x7fe588198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe587fff640 1 -- 172.21.15.18:0/2685465044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58819f9f0 con 0x7fe5881036f0 2024-09-19T09:54:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe5877fe640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe588101b40 0x7fe588197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe586ffd640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe588102d30 0x7fe588198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe587fff640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5881036f0 0x7fe58819f380 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe58000e970 tx=0x7fe58000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe584ff9640 1 -- 172.21.15.18:0/2685465044 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58000ccc0 con 0x7fe5881036f0 2024-09-19T09:54:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe58dc47640 1 -- 172.21.15.18:0/2685465044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58819fce0 con 0x7fe5881036f0 2024-09-19T09:54:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe584ff9640 1 -- 172.21.15.18:0/2685465044 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe58000ce60 con 0x7fe5881036f0 2024-09-19T09:54:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe584ff9640 1 -- 172.21.15.18:0/2685465044 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580010490 con 0x7fe5881036f0 2024-09-19T09:54:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.491+0000 7fe58dc47640 1 -- 172.21.15.18:0/2685465044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5881a01b0 con 0x7fe5881036f0 2024-09-19T09:54:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe584ff9640 1 -- 172.21.15.18:0/2685465044 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe580005020 con 0x7fe5881036f0 2024-09-19T09:54:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5909de740 1 Processor -- start 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5909de740 1 -- start start 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5909de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881729a0 0x55ae88172da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5909de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881732e0 0x55ae88177da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5909de740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae88178370 0x55ae8817a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5909de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ae880d62f0 con 0x55ae881732e0 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5909de740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ae8807e270 con 0x55ae88178370 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5909de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ae880d22b0 con 0x55ae881729a0 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe584ff9640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5700a32f0 0x7fe5700a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881732e0 0x55ae88177da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881732e0 0x55ae88177da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60600/0 (socket says 172.21.15.18:60600) 2024-09-19T09:54:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.494+0000 7fe5877fe640 1 -- 172.21.15.18:0/1637218730 learned_addr learned my addr 172.21.15.18:0/1637218730 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe586ffd640 1 --2- 172.21.15.18:0/1637218730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae88178370 0x55ae8817a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe586ffd640 1 --2- 172.21.15.18:0/1637218730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881729a0 0x55ae88172da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe584ff9640 1 -- 172.21.15.18:0/2685465044 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe5800cfea0 con 0x7fe5881036f0 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe587fff640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5700a32f0 0x7fe5700a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe5877fe640 1 -- 172.21.15.18:0/1637218730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881729a0 msgr2=0x55ae88172da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe5877fe640 1 --2- 172.21.15.18:0/1637218730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881729a0 0x55ae88172da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe5877fe640 1 -- 172.21.15.18:0/1637218730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae88178370 msgr2=0x55ae8817a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe5877fe640 1 --2- 172.21.15.18:0/1637218730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae88178370 0x55ae8817a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe5877fe640 1 -- 172.21.15.18:0/1637218730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8807d340 con 0x55ae881732e0 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe5877fe640 1 --2- 172.21.15.18:0/1637218730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881732e0 0x55ae88177da0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe57800f390 tx=0x7fe57800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e274a30e252b0678 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe587fff640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5700a32f0 0x7fe5700a57b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe58000d010 tx=0x7fe580010670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe56dffb640 1 -- 172.21.15.18:0/1637218730 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578011700 con 0x55ae881732e0 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe56dffb640 1 -- 172.21.15.18:0/1637218730 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe578011d80 con 0x55ae881732e0 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.495+0000 7fe56dffb640 1 -- 172.21.15.18:0/1637218730 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57801be50 con 0x55ae881732e0 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.496+0000 7fe5909de740 1 -- 172.21.15.18:0/1637218730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881732e0 msgr2=0x55ae88177da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.496+0000 7fe5909de740 1 --2- 172.21.15.18:0/1637218730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881732e0 0x55ae88177da0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe57800f390 tx=0x7fe57800f850 comp rx=0 tx=0).stop 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.496+0000 7fe5909de740 1 -- 172.21.15.18:0/1637218730 shutdown_connections 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.496+0000 7fe5909de740 1 --2- 172.21.15.18:0/1637218730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae88178370 0x55ae8817a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.496+0000 7fe5909de740 1 --2- 172.21.15.18:0/1637218730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881732e0 0x55ae88177da0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.496+0000 7fe5909de740 1 --2- 172.21.15.18:0/1637218730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881729a0 0x55ae88172da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.496+0000 7fe5909de740 1 -- 172.21.15.18:0/1637218730 >> 172.21.15.18:0/1637218730 conn(0x55ae8816e010 msgr2=0x55ae8816e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.496+0000 7fe5909de740 1 -- 172.21.15.18:0/1637218730 shutdown_connections 2024-09-19T09:54:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.496+0000 7fe5909de740 1 -- 172.21.15.18:0/1637218730 wait complete. 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.496+0000 7fe5909de740 1 -- start start 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe5909de740 1 Processor -- start 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe5909de740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae881729a0 0x55ae8817cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe5909de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae8817d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe5909de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88184140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe5909de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ae8817b340 con 0x55ae88178370 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe5909de740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ae8805f290 con 0x55ae881729a0 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe5909de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ae8817b4c0 con 0x55ae881732e0 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe5909de740 10 client.0 _ll_register_callbacks cb 0x55ae88090140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe586ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88184140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe586ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88184140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60614/0 (socket says 172.21.15.18:60614) 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe586ffd640 1 -- 172.21.15.18:0/970149751 learned_addr learned my addr 172.21.15.18:0/970149751 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe5877fe640 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae8817d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe586ffd640 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae881729a0 0x55ae8817cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe586ffd640 1 -- 172.21.15.18:0/970149751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 msgr2=0x55ae8817d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe586ffd640 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae8817d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe586ffd640 1 -- 172.21.15.18:0/970149751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae881729a0 msgr2=0x55ae8817cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe586ffd640 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae881729a0 0x55ae8817cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.497+0000 7fe586ffd640 1 -- 172.21.15.18:0/970149751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae87de9210 con 0x55ae88178370 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.498+0000 7fe586ffd640 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88184140 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe57c005ec0 tx=0x7fe57c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b20a03be995954 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.498+0000 7fe566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.498+0000 7fe566ffd640 1 -- 172.21.15.18:0/970149751 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c035040 con 0x55ae88178370 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.498+0000 7fe566ffd640 1 -- 172.21.15.18:0/970149751 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe57c0035f0 con 0x55ae88178370 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.498+0000 7fe5909de740 1 -- 172.21.15.18:0/970149751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe578011d80 con 0x55ae88178370 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.498+0000 7fe566ffd640 1 -- 172.21.15.18:0/970149751 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe57c0037f0 con 0x55ae88178370 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.498+0000 7fe5909de740 10 client.16023 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.498+0000 7fe5909de740 1 -- 172.21.15.18:0/970149751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae87eb5620 con 0x55ae88178370 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.498+0000 7fe566ffd640 1 -- 172.21.15.18:0/970149751 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe578011d80 con 0x55ae88178370 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.498+0000 7fe566ffd640 1 -- 172.21.15.18:0/970149751 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe57c03b9c0 con 0x55ae88178370 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.499+0000 7fe5909de740 10 client.16023 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.499+0000 7fe5909de740 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.499+0000 7fe5909de740 20 client.16023 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.499+0000 7fe5909de740 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ae88188830 0x55ae8818ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.499+0000 7fe5909de740 4 client.16023 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:05.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.499+0000 7fe5909de740 1 -- 172.21.15.18:0/970149751 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae880e3a20 con 0x55ae88188830 2024-09-19T09:54:05.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.499+0000 7fe5877fe640 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ae88188830 0x55ae8818ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.499+0000 7fe5877fe640 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ae88188830 0x55ae8818ac20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c49f783670c31f5 server_cookie=bf4b2c74c37d8a3b in_seq=0 out_seq=0 2024-09-19T09:54:05.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.499+0000 7fe566ffd640 10 client.16023 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:05.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe566ffd640 1 -- 172.21.15.18:0/970149751 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae880e3a20 con 0x55ae88188830 2024-09-19T09:54:05.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe566ffd640 10 client.16023 handle_command_reply: tid=0 2024-09-19T09:54:05.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 client.16023 shutdown 2024-09-19T09:54:05.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 -- 172.21.15.18:0/970149751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 msgr2=0x55ae88184140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:05.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88184140 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe57c005ec0 tx=0x7fe57c005dd0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 -- 172.21.15.18:0/970149751 shutdown_connections 2024-09-19T09:54:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ae88188830 0x55ae8818ac20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88184140 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae8817d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe566ffd640 0 client.16023 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 --2- 172.21.15.18:0/970149751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae881729a0 0x55ae8817cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 -- 172.21.15.18:0/970149751 >> 172.21.15.18:0/970149751 conn(0x55ae8816e010 msgr2=0x55ae8816f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 -- 172.21.15.18:0/970149751 shutdown_connections 2024-09-19T09:54:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 1 -- 172.21.15.18:0/970149751 wait complete. 2024-09-19T09:54:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.500+0000 7fe5909de740 20 client.16023 trim_cache size 0 max 16384 2024-09-19T09:54:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe5909de740 1 Processor -- start 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe5909de740 1 -- start start 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe5909de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881729a0 0x55ae8816d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe5909de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae88184060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe5909de740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae88178370 0x55ae8818f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe5909de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881a8e70 con 0x55ae881729a0 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe5909de740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881aa9b0 con 0x55ae88178370 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe5909de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881a9540 con 0x55ae881732e0 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe586ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881729a0 0x55ae8816d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe586ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881729a0 0x55ae8816d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60622/0 (socket says 172.21.15.18:60622) 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe586ffd640 1 -- 172.21.15.18:0/1391900820 learned_addr learned my addr 172.21.15.18:0/1391900820 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.515+0000 7fe586ffd640 1 --2- 172.21.15.18:0/1391900820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae88178370 0x55ae8818f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.516+0000 7fe586ffd640 1 -- 172.21.15.18:0/1391900820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 msgr2=0x55ae88184060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.516+0000 7fe5877fe640 1 --2- 172.21.15.18:0/1391900820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae88184060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.516+0000 7fe586ffd640 1 --2- 172.21.15.18:0/1391900820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae88184060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.516+0000 7fe586ffd640 1 -- 172.21.15.18:0/1391900820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae88178370 msgr2=0x55ae8818f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.516+0000 7fe586ffd640 1 --2- 172.21.15.18:0/1391900820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae88178370 0x55ae8818f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.516+0000 7fe586ffd640 1 -- 172.21.15.18:0/1391900820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8817b430 con 0x55ae881729a0 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.516+0000 7fe586ffd640 1 --2- 172.21.15.18:0/1391900820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881729a0 0x55ae8816d0b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009850 tx=0x7fe57c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173e58639f40d0c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.516+0000 7fe56d7fa640 1 -- 172.21.15.18:0/1391900820 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c035070 con 0x55ae881729a0 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.516+0000 7fe56d7fa640 1 -- 172.21.15.18:0/1391900820 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe57c003990 con 0x55ae881729a0 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.516+0000 7fe56d7fa640 1 -- 172.21.15.18:0/1391900820 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c03b6b0 con 0x55ae881729a0 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 -- 172.21.15.18:0/1391900820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881729a0 msgr2=0x55ae8816d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 --2- 172.21.15.18:0/1391900820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881729a0 0x55ae8816d0b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009850 tx=0x7fe57c005c90 comp rx=0 tx=0).stop 2024-09-19T09:54:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 -- 172.21.15.18:0/1391900820 shutdown_connections 2024-09-19T09:54:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 --2- 172.21.15.18:0/1391900820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae88178370 0x55ae8818f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 --2- 172.21.15.18:0/1391900820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae88184060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 --2- 172.21.15.18:0/1391900820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae881729a0 0x55ae8816d0b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 -- 172.21.15.18:0/1391900820 >> 172.21.15.18:0/1391900820 conn(0x55ae8816e010 msgr2=0x55ae8816c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 -- 172.21.15.18:0/1391900820 shutdown_connections 2024-09-19T09:54:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 -- 172.21.15.18:0/1391900820 wait complete. 2024-09-19T09:54:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 -- start start 2024-09-19T09:54:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 Processor -- start 2024-09-19T09:54:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae881729a0 0x55ae88181a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae88181f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88182f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881aa2e0 con 0x55ae88178370 2024-09-19T09:54:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881a9c10 con 0x55ae881729a0 2024-09-19T09:54:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.517+0000 7fe5909de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881a6e50 con 0x55ae881732e0 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe5909de740 10 client.0 _ll_register_callbacks cb 0x7fe57c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe586ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88182f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe586ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88182f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60632/0 (socket says 172.21.15.18:60632) 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe586ffd640 1 -- 172.21.15.18:0/1678482540 learned_addr learned my addr 172.21.15.18:0/1678482540 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe5877fe640 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae88181f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe586ffd640 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae881729a0 0x55ae88181a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe5877fe640 1 -- 172.21.15.18:0/1678482540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae881729a0 msgr2=0x55ae88181a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe5877fe640 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae881729a0 0x55ae88181a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe5877fe640 1 -- 172.21.15.18:0/1678482540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 msgr2=0x55ae88182f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe5877fe640 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88182f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe5877fe640 1 -- 172.21.15.18:0/1678482540 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae88183510 con 0x55ae881732e0 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe586ffd640 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88182f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:54:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe5877fe640 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae88181f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe57800f360 tx=0x7fe57800fe90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=867408da3e147279 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe566ffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:54:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.518+0000 7fe566ffd640 1 -- 172.21.15.18:0/1678482540 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578004bc0 con 0x55ae881732e0 2024-09-19T09:54:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe5909de740 1 -- 172.21.15.18:0/1678482540 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe57c003990 con 0x55ae881732e0 2024-09-19T09:54:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe566ffd640 1 -- 172.21.15.18:0/1678482540 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe578004d60 con 0x55ae881732e0 2024-09-19T09:54:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe566ffd640 1 -- 172.21.15.18:0/1678482540 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe578005020 con 0x55ae881732e0 2024-09-19T09:54:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe5909de740 10 client.25570 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe5909de740 1 -- 172.21.15.18:0/1678482540 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae881f3770 con 0x55ae881732e0 2024-09-19T09:54:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe566ffd640 1 -- 172.21.15.18:0/1678482540 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe57c003990 con 0x55ae881732e0 2024-09-19T09:54:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe566ffd640 1 -- 172.21.15.18:0/1678482540 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe5780118c0 con 0x55ae881732e0 2024-09-19T09:54:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe5909de740 10 client.25570 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe5909de740 10 client.25570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe5909de740 20 client.25570 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe5909de740 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ae881f3e70 0x55ae881f6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe5909de740 4 client.25570 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:54:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe5909de740 1 -- 172.21.15.18:0/1678482540 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae880ddd70 con 0x55ae881f3e70 2024-09-19T09:54:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.519+0000 7fe586ffd640 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ae881f3e70 0x55ae881f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.520+0000 7fe586ffd640 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ae881f3e70 0x55ae881f6290 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d701d39c95d3adc5 server_cookie=ae0a5114967bad23 in_seq=0 out_seq=0 2024-09-19T09:54:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.520+0000 7fe566ffd640 10 client.25570 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.523+0000 7fe566ffd640 1 -- 172.21.15.18:0/1678482540 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae880ddd70 con 0x55ae881f3e70 2024-09-19T09:54:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.523+0000 7fe566ffd640 10 client.25570 handle_command_reply: tid=0 2024-09-19T09:54:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.523+0000 7fe5909de740 1 client.25570 shutdown 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 1 -- 172.21.15.18:0/1678482540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 msgr2=0x55ae88181f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae88181f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe57800f360 tx=0x7fe57800fe90 comp rx=0 tx=0).stop 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 1 -- 172.21.15.18:0/1678482540 shutdown_connections 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ae881f3e70 0x55ae881f6290 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae88178370 0x55ae88182f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe566ffd640 0 client.25570 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae881732e0 0x55ae88181f40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 1 --2- 172.21.15.18:0/1678482540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae881729a0 0x55ae88181a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 1 -- 172.21.15.18:0/1678482540 >> 172.21.15.18:0/1678482540 conn(0x55ae8816e010 msgr2=0x55ae8816d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 1 -- 172.21.15.18:0/1678482540 shutdown_connections 2024-09-19T09:54:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 1 -- 172.21.15.18:0/1678482540 wait complete. 2024-09-19T09:54:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe5909de740 20 client.25570 trim_cache size 0 max 16384 2024-09-19T09:54:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:54:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:54:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:54:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:54:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe58dc47640 1 -- 172.21.15.18:0/2685465044 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5700a32f0 msgr2=0x7fe5700a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe58dc47640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5700a32f0 0x7fe5700a57b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe58000d010 tx=0x7fe580010670 comp rx=0 tx=0).stop 2024-09-19T09:54:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe58dc47640 1 -- 172.21.15.18:0/2685465044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5881036f0 msgr2=0x7fe58819f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe58dc47640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5881036f0 0x7fe58819f380 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe58000e970 tx=0x7fe58000ed70 comp rx=0 tx=0).stop 2024-09-19T09:54:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe58dc47640 1 -- 172.21.15.18:0/2685465044 shutdown_connections 2024-09-19T09:54:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe58dc47640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe5700a32f0 0x7fe5700a57b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe58dc47640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5881036f0 0x7fe58819f380 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe58dc47640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe588102d30 0x7fe588198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe58dc47640 1 --2- 172.21.15.18:0/2685465044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe588101b40 0x7fe588197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.524+0000 7fe58dc47640 1 -- 172.21.15.18:0/2685465044 >> 172.21.15.18:0/2685465044 conn(0x7fe5880fd2e0 msgr2=0x7fe5881060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.525+0000 7fe58dc47640 1 -- 172.21.15.18:0/2685465044 shutdown_connections 2024-09-19T09:54:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:05.525+0000 7fe58dc47640 1 -- 172.21.15.18:0/2685465044 wait complete. 2024-09-19T09:54:06.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:05 smithi018 ceph-mon[30956]: pgmap v391: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T09:54:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:05 smithi049 ceph-mon[34858]: pgmap v391: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T09:54:06.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:05 smithi162 ceph-mon[35174]: pgmap v391: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T09:54:06.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:54:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:07.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.350+0000 7fdab18f1640 1 -- 172.21.15.18:0/3312382558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdaac100e20 msgr2=0x7fdaac101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:07.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.350+0000 7fdab18f1640 1 --2- 172.21.15.18:0/3312382558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdaac100e20 0x7fdaac101200 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009ca0 tx=0x7fdaa402a950 comp rx=0 tx=0).stop 2024-09-19T09:54:07.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.350+0000 7fdab18f1640 1 -- 172.21.15.18:0/3312382558 shutdown_connections 2024-09-19T09:54:07.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.350+0000 7fdab18f1640 1 --2- 172.21.15.18:0/3312382558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac102ef0 0x7fdaac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.350+0000 7fdab18f1640 1 --2- 172.21.15.18:0/3312382558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaac102570 0x7fdaac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.350+0000 7fdab18f1640 1 --2- 172.21.15.18:0/3312382558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdaac100e20 0x7fdaac101200 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.350+0000 7fdab18f1640 1 -- 172.21.15.18:0/3312382558 >> 172.21.15.18:0/3312382558 conn(0x7fdaac0fc7d0 msgr2=0x7fdaac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.350+0000 7fdab18f1640 1 -- 172.21.15.18:0/3312382558 shutdown_connections 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.350+0000 7fdab18f1640 1 -- 172.21.15.18:0/3312382558 wait complete. 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.350+0000 7fdab18f1640 1 Processor -- start 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdab18f1640 1 -- start start 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdab18f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaac100e20 0x7fdaac1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdab18f1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac102570 0x7fdaac1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdab18f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdaac102ef0 0x7fdaac19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdab18f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac110f80 con 0x7fdaac102ef0 2024-09-19T09:54:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdab18f1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac110e00 con 0x7fdaac102570 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdab18f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac111100 con 0x7fdaac100e20 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdaab7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdaac102ef0 0x7fdaac19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdaab7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdaac102ef0 0x7fdaac19cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35118/0 (socket says 172.21.15.18:35118) 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdaab7fe640 1 -- 172.21.15.18:0/3462559497 learned_addr learned my addr 172.21.15.18:0/3462559497 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdaaa7fc640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac102570 0x7fdaac1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdaaaffd640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaac100e20 0x7fdaac1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdaab7fe640 1 -- 172.21.15.18:0/3462559497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaac100e20 msgr2=0x7fdaac1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdaab7fe640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaac100e20 0x7fdaac1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdaab7fe640 1 -- 172.21.15.18:0/3462559497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac102570 msgr2=0x7fdaac1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdaab7fe640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac102570 0x7fdaac1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.351+0000 7fdaab7fe640 1 -- 172.21.15.18:0/3462559497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaac19d450 con 0x7fdaac102ef0 2024-09-19T09:54:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.352+0000 7fdaab7fe640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdaac102ef0 0x7fdaac19cd70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00c970 tx=0x7fda9c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.352+0000 7fdab08ef640 1 -- 172.21.15.18:0/3462559497 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c007bb0 con 0x7fdaac102ef0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.352+0000 7fdab18f1640 1 -- 172.21.15.18:0/3462559497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaac19d740 con 0x7fdaac102ef0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.352+0000 7fdab08ef640 1 -- 172.21.15.18:0/3462559497 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda9c007d50 con 0x7fdaac102ef0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.352+0000 7fdab08ef640 1 -- 172.21.15.18:0/3462559497 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c018800 con 0x7fdaac102ef0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.352+0000 7fdab18f1640 1 -- 172.21.15.18:0/3462559497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaac1a5020 con 0x7fdaac102ef0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.353+0000 7fdab18f1640 1 -- 172.21.15.18:0/3462559497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaac101200 con 0x7fdaac102ef0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.354+0000 7fdab08ef640 1 -- 172.21.15.18:0/3462559497 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fda9c00fa50 con 0x7fdaac102ef0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.355+0000 7fdab08ef640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fda980a3240 0x7fda980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.355+0000 7fdab08ef640 1 -- 172.21.15.18:0/3462559497 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fda9c0cfb90 con 0x7fdaac102ef0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.355+0000 7fdaaaffd640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fda980a3240 0x7fda980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.355+0000 7fdaaaffd640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fda980a3240 0x7fda980a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4005fc0 tx=0x7fdaa4009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.358+0000 7fdab08ef640 1 -- 172.21.15.18:0/3462559497 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda9c014030 con 0x7fdaac102ef0 2024-09-19T09:54:07.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.573+0000 7fdab18f1640 1 -- 172.21.15.18:0/3462559497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdaac199800 con 0x7fdaac102ef0 2024-09-19T09:54:07.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.574+0000 7fdab08ef640 1 -- 172.21.15.18:0/3462559497 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fdaac199800 con 0x7fdaac102ef0 2024-09-19T09:54:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:54:07.576 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:54:07.577 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:54:07.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 -- 172.21.15.18:0/3462559497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fda980a3240 msgr2=0x7fda980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:07.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fda980a3240 0x7fda980a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4005fc0 tx=0x7fdaa4009360 comp rx=0 tx=0).stop 2024-09-19T09:54:07.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 -- 172.21.15.18:0/3462559497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdaac102ef0 msgr2=0x7fdaac19cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:07.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdaac102ef0 0x7fdaac19cd70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00c970 tx=0x7fda9c00ce30 comp rx=0 tx=0).stop 2024-09-19T09:54:07.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 -- 172.21.15.18:0/3462559497 shutdown_connections 2024-09-19T09:54:07.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fda980a3240 0x7fda980a5700 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:07.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdaac102ef0 0x7fdaac19cd70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:07.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac102570 0x7fdaac1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:07.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 --2- 172.21.15.18:0/3462559497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaac100e20 0x7fdaac1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:07.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 -- 172.21.15.18:0/3462559497 >> 172.21.15.18:0/3462559497 conn(0x7fdaac0fc7d0 msgr2=0x7fdaac105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:07.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 -- 172.21.15.18:0/3462559497 shutdown_connections 2024-09-19T09:54:07.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:07.576+0000 7fdab18f1640 1 -- 172.21.15.18:0/3462559497 wait complete. 2024-09-19T09:54:08.152 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --set-id 18324320 --release --await' 2024-09-19T09:54:08.152 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --set-id 18324320 --release --await 2024-09-19T09:54:08.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:07 smithi018 ceph-mon[30956]: pgmap v392: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:54:08.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:07 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3462559497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:07 smithi049 ceph-mon[34858]: pgmap v392: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:54:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:07 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3462559497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:08.410 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:08.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:07 smithi162 ceph-mon[35174]: pgmap v392: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:54:08.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:07 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3462559497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.847+0000 7ff591753640 1 -- 172.21.15.18:0/2802326915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c100e20 msgr2=0x7ff58c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.847+0000 7ff591753640 1 --2- 172.21.15.18:0/2802326915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c100e20 0x7ff58c101200 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009900 tx=0x7ff57c02a480 comp rx=0 tx=0).stop 2024-09-19T09:54:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.847+0000 7ff591753640 1 -- 172.21.15.18:0/2802326915 shutdown_connections 2024-09-19T09:54:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.847+0000 7ff591753640 1 --2- 172.21.15.18:0/2802326915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff58c102ef0 0x7ff58c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.847+0000 7ff591753640 1 --2- 172.21.15.18:0/2802326915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58c102570 0x7ff58c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.847+0000 7ff591753640 1 --2- 172.21.15.18:0/2802326915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c100e20 0x7ff58c101200 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.847+0000 7ff591753640 1 -- 172.21.15.18:0/2802326915 >> 172.21.15.18:0/2802326915 conn(0x7ff58c0fc7d0 msgr2=0x7ff58c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.847+0000 7ff591753640 1 -- 172.21.15.18:0/2802326915 shutdown_connections 2024-09-19T09:54:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.848+0000 7ff591753640 1 -- 172.21.15.18:0/2802326915 wait complete. 2024-09-19T09:54:08.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.848+0000 7ff591753640 1 Processor -- start 2024-09-19T09:54:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.848+0000 7ff591753640 1 -- start start 2024-09-19T09:54:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.848+0000 7ff591753640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58c100e20 0x7ff58c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.848+0000 7ff591753640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c102570 0x7ff58c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.848+0000 7ff591753640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff58c102ef0 0x7ff58c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff591753640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c110fd0 con 0x7ff58c102570 2024-09-19T09:54:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff591753640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c110e50 con 0x7ff58c102ef0 2024-09-19T09:54:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff591753640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c111150 con 0x7ff58c100e20 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c102570 0x7ff58c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c102570 0x7ff58c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35128/0 (socket says 172.21.15.18:35128) 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58a7fc640 1 -- 172.21.15.18:0/1801326895 learned_addr learned my addr 172.21.15.18:0/1801326895 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58affd640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58c100e20 0x7ff58c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff58c102ef0 0x7ff58c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58a7fc640 1 -- 172.21.15.18:0/1801326895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58c100e20 msgr2=0x7ff58c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58c100e20 0x7ff58c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58a7fc640 1 -- 172.21.15.18:0/1801326895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff58c102ef0 msgr2=0x7ff58c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff58c102ef0 0x7ff58c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58a7fc640 1 -- 172.21.15.18:0/1801326895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c1a6a40 con 0x7ff58c102570 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff58c102ef0 0x7ff58c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c102570 0x7ff58c0fd1c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff58000c970 tx=0x7ff58000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff573fff640 1 -- 172.21.15.18:0/1801326895 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580007bb0 con 0x7ff58c102570 2024-09-19T09:54:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff573fff640 1 -- 172.21.15.18:0/1801326895 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff580007d50 con 0x7ff58c102570 2024-09-19T09:54:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff591753640 1 -- 172.21.15.18:0/1801326895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58c1a6d30 con 0x7ff58c102570 2024-09-19T09:54:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.849+0000 7ff573fff640 1 -- 172.21.15.18:0/1801326895 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58000f450 con 0x7ff58c102570 2024-09-19T09:54:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.850+0000 7ff591753640 1 -- 172.21.15.18:0/1801326895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58c1a71c0 con 0x7ff58c102570 2024-09-19T09:54:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.852+0000 7ff573fff640 1 -- 172.21.15.18:0/1801326895 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff580005020 con 0x7ff58c102570 2024-09-19T09:54:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.852+0000 7ff593b2c740 1 Processor -- start 2024-09-19T09:54:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.852+0000 7ff593b2c740 1 -- start start 2024-09-19T09:54:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.852+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f761440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.852+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 0x55c90f76bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.852+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f76e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.852+0000 7ff593b2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c90f6c6620 con 0x55c90f76c240 2024-09-19T09:54:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.852+0000 7ff593b2c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c90f66de50 con 0x55c90f761980 2024-09-19T09:54:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.852+0000 7ff593b2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c90f6c25e0 con 0x55c90f761060 2024-09-19T09:54:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f76e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f76e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35138/0 (socket says 172.21.15.18:35138) 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58a7fc640 1 -- 172.21.15.18:0/2373057940 learned_addr learned my addr 172.21.15.18:0/2373057940 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/2373057940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f761440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58affd640 1 --2- 172.21.15.18:0/2373057940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 0x55c90f76bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff573fff640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5740a3240 0x7ff5740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5740a3240 0x7ff5740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff573fff640 1 -- 172.21.15.18:0/1801326895 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff5800cf6f0 con 0x7ff58c102570 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58a7fc640 1 -- 172.21.15.18:0/2373057940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 msgr2=0x55c90f761440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/2373057940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f761440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58a7fc640 1 -- 172.21.15.18:0/2373057940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 msgr2=0x55c90f76bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/2373057940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 0x55c90f76bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58a7fc640 1 -- 172.21.15.18:0/2373057940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c90f65ed40 con 0x55c90f76c240 2024-09-19T09:54:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/2373057940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f761440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:54:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.853+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/2373057940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f76e630 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff58009ba20 tx=0x7ff580004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22be957b91ce383 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff5717fa640 1 -- 172.21.15.18:0/2373057940 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58001d050 con 0x55c90f76c240 2024-09-19T09:54:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff5717fa640 1 -- 172.21.15.18:0/2373057940 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff58009c420 con 0x55c90f76c240 2024-09-19T09:54:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff5717fa640 1 -- 172.21.15.18:0/2373057940 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580098390 con 0x55c90f76c240 2024-09-19T09:54:08.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff593b2c740 1 -- 172.21.15.18:0/2373057940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 msgr2=0x55c90f76e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:08.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff593b2c740 1 --2- 172.21.15.18:0/2373057940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f76e630 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff58009ba20 tx=0x7ff580004a20 comp rx=0 tx=0).stop 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5740a3240 0x7ff5740a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff584005fd0 tx=0x7ff584004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff593b2c740 1 -- 172.21.15.18:0/2373057940 shutdown_connections 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff593b2c740 1 --2- 172.21.15.18:0/2373057940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f76e630 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff593b2c740 1 --2- 172.21.15.18:0/2373057940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 0x55c90f76bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff593b2c740 1 --2- 172.21.15.18:0/2373057940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f761440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff593b2c740 1 -- 172.21.15.18:0/2373057940 >> 172.21.15.18:0/2373057940 conn(0x55c90f75d5f0 msgr2=0x55c90f75d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff593b2c740 1 -- 172.21.15.18:0/2373057940 shutdown_connections 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.854+0000 7ff593b2c740 1 -- 172.21.15.18:0/2373057940 wait complete. 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff593b2c740 1 -- start start 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff593b2c740 1 Processor -- start 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f769220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761980 0x55c90f769760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 0x55c90f769ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff593b2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c90f76ee10 con 0x55c90f761980 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff593b2c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c90f64ef10 con 0x55c90f76c240 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff593b2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c90f76ef90 con 0x55c90f761060 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff593b2c740 10 client.0 _ll_register_callbacks cb 0x55c90f672db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff58a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761980 0x55c90f769760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff58a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761980 0x55c90f769760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35146/0 (socket says 172.21.15.18:35146) 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff58a7fc640 1 -- 172.21.15.18:0/2259033783 learned_addr learned my addr 172.21.15.18:0/2259033783 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff58affd640 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f769220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.855+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 0x55c90f769ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff58a7fc640 1 -- 172.21.15.18:0/2259033783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 msgr2=0x55c90f769220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f769220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff58a7fc640 1 -- 172.21.15.18:0/2259033783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 msgr2=0x55c90f769ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 0x55c90f769ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff58a7fc640 1 -- 172.21.15.18:0/2259033783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c90f3d5580 con 0x55c90f761980 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761980 0x55c90f769760 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff5800986f0 tx=0x7ff58009a220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93a5ef7c97bdb69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff56eff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff56eff5640 1 -- 172.21.15.18:0/2259033783 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58009bd20 con 0x55c90f761980 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff56eff5640 1 -- 172.21.15.18:0/2259033783 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff58009b170 con 0x55c90f761980 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff593b2c740 1 -- 172.21.15.18:0/2259033783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff58009c420 con 0x55c90f761980 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff56eff5640 1 -- 172.21.15.18:0/2259033783 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff58001d030 con 0x55c90f761980 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff593b2c740 10 client.16047 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff593b2c740 1 -- 172.21.15.18:0/2259033783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c90f49f960 con 0x55c90f761980 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff56eff5640 1 -- 172.21.15.18:0/2259033783 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff58009c420 con 0x55c90f761980 2024-09-19T09:54:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.856+0000 7ff56eff5640 1 -- 172.21.15.18:0/2259033783 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff58009abe0 con 0x55c90f761980 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.857+0000 7ff593b2c740 10 client.16047 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.857+0000 7ff593b2c740 10 client.16047 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.857+0000 7ff593b2c740 20 client.16047 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.857+0000 7ff593b2c740 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c90f77bd20 0x55c90f77e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.857+0000 7ff593b2c740 4 client.16047 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.857+0000 7ff593b2c740 1 -- 172.21.15.18:0/2259033783 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c90f6d3b90 con 0x55c90f77bd20 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.857+0000 7ff58affd640 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c90f77bd20 0x55c90f77e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.857+0000 7ff58affd640 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c90f77bd20 0x55c90f77e110 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8322c51eb32966d server_cookie=61402e59f446de5e in_seq=0 out_seq=0 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.857+0000 7ff56eff5640 10 client.16047 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff56eff5640 1 -- 172.21.15.18:0/2259033783 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c90f6d3b90 con 0x55c90f77bd20 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff56eff5640 10 client.16047 handle_command_reply: tid=0 2024-09-19T09:54:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 client.16047 shutdown 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 -- 172.21.15.18:0/2259033783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761980 msgr2=0x55c90f769760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761980 0x55c90f769760 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff5800986f0 tx=0x7ff58009a220 comp rx=0 tx=0).stop 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 -- 172.21.15.18:0/2259033783 shutdown_connections 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c90f77bd20 0x55c90f77e110 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 0x55c90f769ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761980 0x55c90f769760 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 --2- 172.21.15.18:0/2259033783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f769220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 -- 172.21.15.18:0/2259033783 >> 172.21.15.18:0/2259033783 conn(0x55c90f75d5f0 msgr2=0x55c90f7632d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff56eff5640 0 client.16047 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 -- 172.21.15.18:0/2259033783 shutdown_connections 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 1 -- 172.21.15.18:0/2259033783 wait complete. 2024-09-19T09:54:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.858+0000 7ff593b2c740 20 client.16047 trim_cache size 0 max 16384 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.875+0000 7ff593b2c740 1 Processor -- start 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.875+0000 7ff593b2c740 1 -- start start 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f768180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 0x55c90f780d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f781290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff593b2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1af7e0 con 0x55c90f76c240 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff593b2c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1b1320 con 0x55c90f761980 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff593b2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1afeb0 con 0x55c90f761060 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f781290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f781290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35154/0 (socket says 172.21.15.18:35154) 2024-09-19T09:54:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58b7fe640 1 -- 172.21.15.18:0/1714042430 learned_addr learned my addr 172.21.15.18:0/1714042430 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58affd640 1 --2- 172.21.15.18:0/1714042430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f768180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/1714042430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 0x55c90f780d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58b7fe640 1 -- 172.21.15.18:0/1714042430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 msgr2=0x55c90f768180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/1714042430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f768180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58b7fe640 1 -- 172.21.15.18:0/1714042430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 msgr2=0x55c90f780d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/1714042430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 0x55c90f780d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58b7fe640 1 -- 172.21.15.18:0/1714042430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c90f76bb90 con 0x55c90f76c240 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/1714042430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 0x55c90f780d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.876+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/1714042430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f781290 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff584009750 tx=0x7ff5840097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6295b4f31b08977 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff570ff9640 1 -- 172.21.15.18:0/1714042430 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584018070 con 0x55c90f76c240 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff570ff9640 1 -- 172.21.15.18:0/1714042430 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff584020b90 con 0x55c90f76c240 2024-09-19T09:54:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff570ff9640 1 -- 172.21.15.18:0/1714042430 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58401b5e0 con 0x55c90f76c240 2024-09-19T09:54:08.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff593b2c740 1 -- 172.21.15.18:0/1714042430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 msgr2=0x55c90f781290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:08.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff593b2c740 1 --2- 172.21.15.18:0/1714042430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f781290 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff584009750 tx=0x7ff5840097a0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff593b2c740 1 -- 172.21.15.18:0/1714042430 shutdown_connections 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff593b2c740 1 --2- 172.21.15.18:0/1714042430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f76c240 0x55c90f781290 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff593b2c740 1 --2- 172.21.15.18:0/1714042430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f761980 0x55c90f780d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff593b2c740 1 --2- 172.21.15.18:0/1714042430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761060 0x55c90f768180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff593b2c740 1 -- 172.21.15.18:0/1714042430 >> 172.21.15.18:0/1714042430 conn(0x55c90f75d5f0 msgr2=0x55c90f76b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff593b2c740 1 -- 172.21.15.18:0/1714042430 shutdown_connections 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.877+0000 7ff593b2c740 1 -- 172.21.15.18:0/1714042430 wait complete. 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff593b2c740 1 -- start start 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff593b2c740 1 Processor -- start 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761060 0x55c90f781150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761980 0x55c90f781690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff593b2c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 0x55c90f77f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff593b2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1b0c50 con 0x55c90f761060 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff593b2c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1b0580 con 0x55c90f76c240 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff593b2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1ad7c0 con 0x55c90f761980 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff593b2c740 10 client.0 _ll_register_callbacks cb 0x7ff580005690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff58affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761060 0x55c90f781150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff58affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761060 0x55c90f781150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35164/0 (socket says 172.21.15.18:35164) 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff58affd640 1 -- 172.21.15.18:0/664198916 learned_addr learned my addr 172.21.15.18:0/664198916 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 0x55c90f77f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761980 0x55c90f781690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff58affd640 1 -- 172.21.15.18:0/664198916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761980 msgr2=0x55c90f781690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff58affd640 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761980 0x55c90f781690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff58affd640 1 -- 172.21.15.18:0/664198916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 msgr2=0x55c90f77f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff58affd640 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 0x55c90f77f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.878+0000 7ff58affd640 1 -- 172.21.15.18:0/664198916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c90f77ff50 con 0x55c90f761060 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761980 0x55c90f781690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff58b7fe640 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 0x55c90f77f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff58affd640 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761060 0x55c90f781150 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009230 tx=0x7ff57c004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6524d69916ac953 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff56eff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff56eff5640 1 -- 172.21.15.18:0/664198916 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c035040 con 0x55c90f761060 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff56eff5640 1 -- 172.21.15.18:0/664198916 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff57c0046c0 con 0x55c90f761060 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff593b2c740 1 -- 172.21.15.18:0/664198916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff584020b90 con 0x55c90f761060 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff56eff5640 1 -- 172.21.15.18:0/664198916 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff57c005610 con 0x55c90f761060 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff593b2c740 10 client.16053 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff593b2c740 1 -- 172.21.15.18:0/664198916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c90f7e7450 con 0x55c90f761060 2024-09-19T09:54:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff56eff5640 1 -- 172.21.15.18:0/664198916 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff584020b90 con 0x55c90f761060 2024-09-19T09:54:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.879+0000 7ff56eff5640 1 -- 172.21.15.18:0/664198916 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff57c031c90 con 0x55c90f761060 2024-09-19T09:54:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.880+0000 7ff593b2c740 10 client.16053 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.880+0000 7ff593b2c740 10 client.16053 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:54:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.880+0000 7ff593b2c740 20 client.16053 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.880+0000 7ff593b2c740 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c90f7e7b80 0x55c90f7e9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.880+0000 7ff593b2c740 4 client.16053 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "18324320", "release": true, "await": true}] 2024-09-19T09:54:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.880+0000 7ff593b2c740 1 -- 172.21.15.18:0/664198916 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "set_id": "18324320", "release": true, "await": true}) -- 0x55c90f6ce0a0 con 0x55c90f7e7b80 2024-09-19T09:54:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.880+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c90f7e7b80 0x55c90f7e9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.880+0000 7ff56eff5640 10 client.16053 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.880+0000 7ff58a7fc640 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c90f7e7b80 0x55c90f7e9fa0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37ce9cfedc109b5 server_cookie=bbcccbd11581ece3 in_seq=0 out_seq=0 2024-09-19T09:54:08.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff56eff5640 1 -- 172.21.15.18:0/664198916 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c90f6ce0a0 con 0x55c90f7e7b80 2024-09-19T09:54:08.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff56eff5640 10 client.16053 handle_command_reply: tid=0 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 client.16053 shutdown 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 -- 172.21.15.18:0/664198916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761060 msgr2=0x55c90f781150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761060 0x55c90f781150 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009230 tx=0x7ff57c004420 comp rx=0 tx=0).stop 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 -- 172.21.15.18:0/664198916 shutdown_connections 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c90f7e7b80 0x55c90f7e9fa0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c90f76c240 0x55c90f77f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c90f761980 0x55c90f781690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 --2- 172.21.15.18:0/664198916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c90f761060 0x55c90f781150 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 -- 172.21.15.18:0/664198916 >> 172.21.15.18:0/664198916 conn(0x55c90f75d5f0 msgr2=0x55c90f75bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff56eff5640 0 client.16053 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 -- 172.21.15.18:0/664198916 shutdown_connections 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 1 -- 172.21.15.18:0/664198916 wait complete. 2024-09-19T09:54:08.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.885+0000 7ff593b2c740 20 client.16053 trim_cache size 0 max 16384 2024-09-19T09:54:08.890 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:54:08.890 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:54:08.890 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:54:08.890 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 8, 2024-09-19T09:54:08.890 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:54:08.890 INFO:teuthology.orchestra.run.smithi018.stdout: "18324320": { 2024-09-19T09:54:08.890 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 8, 2024-09-19T09:54:08.890 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:54:08.890 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:54:08.890 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 140.3, 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:08.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:08.892 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:08.892 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:08.892 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:54:08.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 -- 172.21.15.18:0/1801326895 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5740a3240 msgr2=0x7ff5740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:08.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5740a3240 0x7ff5740a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff584005fd0 tx=0x7ff584004ab0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 -- 172.21.15.18:0/1801326895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c102570 msgr2=0x7ff58c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:08.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c102570 0x7ff58c0fd1c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff58000c970 tx=0x7ff58000ce30 comp rx=0 tx=0).stop 2024-09-19T09:54:08.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 -- 172.21.15.18:0/1801326895 shutdown_connections 2024-09-19T09:54:08.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5740a3240 0x7ff5740a5700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff58c102ef0 0x7ff58c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c102570 0x7ff58c0fd1c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 --2- 172.21.15.18:0/1801326895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58c100e20 0x7ff58c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:08.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 -- 172.21.15.18:0/1801326895 >> 172.21.15.18:0/1801326895 conn(0x7ff58c0fc7d0 msgr2=0x7ff58c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:08.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 -- 172.21.15.18:0/1801326895 shutdown_connections 2024-09-19T09:54:08.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:08.886+0000 7ff591753640 1 -- 172.21.15.18:0/1801326895 wait complete. 2024-09-19T09:54:08.894 INFO:tasks.workunit.client.0.smithi018.stdout:getting iogen 2024-09-19T09:54:08.894 INFO:tasks.workunit.client.0.smithi018.stderr:+ echo 'getting iogen' 2024-09-19T09:54:08.894 INFO:tasks.workunit.client.0.smithi018.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-19T09:54:08.912 INFO:tasks.workunit.client.0.smithi018.stderr:--2024-09-19 09:54:08-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-19T09:54:08.913 INFO:tasks.workunit.client.0.smithi018.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-19T09:54:08.990 INFO:tasks.workunit.client.0.smithi018.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-19T09:54:09.067 INFO:tasks.workunit.client.0.smithi018.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-19T09:54:09.067 INFO:tasks.workunit.client.0.smithi018.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-09-19T09:54:09.068 INFO:tasks.workunit.client.0.smithi018.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-09-19T09:54:09.072 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T09:54:09.072 INFO:tasks.workunit.client.0.smithi018.stderr: 0K ....... 100% 878M=0s 2024-09-19T09:54:09.072 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T09:54:09.072 INFO:tasks.workunit.client.0.smithi018.stderr:2024-09-19 09:54:09 (878 MB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-09-19T09:54:09.072 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-09-19T09:54:09.072 INFO:tasks.workunit.client.0.smithi018.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-09-19T09:54:09.131 INFO:tasks.workunit.client.0.smithi018.stdout:iogen_3.1p0 2024-09-19T09:54:09.132 INFO:tasks.workunit.client.0.smithi018.stdout:iogen_3.1p0/src 2024-09-19T09:54:09.133 INFO:tasks.workunit.client.0.smithi018.stdout:iogen_3.1p0/src/iogen.8 2024-09-19T09:54:09.134 INFO:tasks.workunit.client.0.smithi018.stdout:iogen_3.1p0/src/iogen.c 2024-09-19T09:54:09.135 INFO:tasks.workunit.client.0.smithi018.stdout:iogen_3.1p0/README 2024-09-19T09:54:09.136 INFO:tasks.workunit.client.0.smithi018.stdout:iogen_3.1p0/Makefile.bsd 2024-09-19T09:54:09.137 INFO:tasks.workunit.client.0.smithi018.stdout:iogen_3.1p0/Makefile 2024-09-19T09:54:09.139 INFO:tasks.workunit.client.0.smithi018.stderr:+ cd iogen_3.1p0 2024-09-19T09:54:09.139 INFO:tasks.workunit.client.0.smithi018.stdout:making iogen 2024-09-19T09:54:09.139 INFO:tasks.workunit.client.0.smithi018.stderr:+ echo 'making iogen' 2024-09-19T09:54:09.139 INFO:tasks.workunit.client.0.smithi018.stderr:+ make 2024-09-19T09:54:09.150 INFO:tasks.workunit.client.0.smithi018.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-09-19T09:54:09.702 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '18324320', total seconds elapsed: 23.4 2024-09-19T09:54:09.702 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:54:09.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:54:09.870 INFO:tasks.workunit.client.0.smithi018.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-09-19T09:54:09.963 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:09.976 INFO:tasks.workunit.client.0.smithi018.stdout:running iogen 2024-09-19T09:54:09.976 INFO:tasks.workunit.client.0.smithi018.stderr:+ echo 'running iogen' 2024-09-19T09:54:09.977 INFO:tasks.workunit.client.0.smithi018.stderr:+ ./iogen -n 5 -s 2g 2024-09-19T09:54:09.977 INFO:tasks.workunit.client.0.smithi018.stderr:child spawned 91160 2024-09-19T09:54:09.977 INFO:tasks.workunit.client.0.smithi018.stderr:child spawned 91161 2024-09-19T09:54:09.978 INFO:tasks.workunit.client.0.smithi018.stderr:child spawned 91162 2024-09-19T09:54:09.978 INFO:tasks.workunit.client.0.smithi018.stderr:child spawned 91163 2024-09-19T09:54:09.978 INFO:tasks.workunit.client.0.smithi018.stderr:child spawned 91164 2024-09-19T09:54:09.978 INFO:tasks.workunit.client.0.smithi018.stdout:sleep for 10 min 2024-09-19T09:54:09.978 INFO:tasks.workunit.client.0.smithi018.stderr:+ echo 'sleep for 10 min' 2024-09-19T09:54:09.979 INFO:tasks.workunit.client.0.smithi018.stderr:+ sleep 600 2024-09-19T09:54:10.232 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:09 smithi018 ceph-mon[30956]: pgmap v393: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-19T09:54:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:09 smithi049 ceph-mon[34858]: pgmap v393: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-19T09:54:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:09 smithi162 ceph-mon[35174]: pgmap v393: 97 pgs: 97 active+clean; 670 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-19T09:54:10.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.665+0000 7f0557552640 1 -- 172.21.15.18:0/3435105290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0550074590 msgr2=0x7f0550074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:10.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.665+0000 7f0557552640 1 --2- 172.21.15.18:0/3435105290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0550074590 0x7f0550074970 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f054c009900 tx=0x7f054c02a4b0 comp rx=0 tx=0).stop 2024-09-19T09:54:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.666+0000 7f0557552640 1 -- 172.21.15.18:0/3435105290 shutdown_connections 2024-09-19T09:54:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.667+0000 7f0557552640 1 --2- 172.21.15.18:0/3435105290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0550112ba0 0x7f0550114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.667+0000 7f0557552640 1 --2- 172.21.15.18:0/3435105290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0550074eb0 0x7f0550112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.667+0000 7f0557552640 1 --2- 172.21.15.18:0/3435105290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0550074590 0x7f0550074970 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.667+0000 7f0557552640 1 -- 172.21.15.18:0/3435105290 >> 172.21.15.18:0/3435105290 conn(0x7f05500fd8f0 msgr2=0x7f05500ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:10.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.669+0000 7f0557552640 1 -- 172.21.15.18:0/3435105290 shutdown_connections 2024-09-19T09:54:10.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.669+0000 7f0557552640 1 -- 172.21.15.18:0/3435105290 wait complete. 2024-09-19T09:54:10.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.671+0000 7f0557552640 1 Processor -- start 2024-09-19T09:54:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.672+0000 7f0557552640 1 -- start start 2024-09-19T09:54:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.673+0000 7f0557552640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0550074590 0x7f05501a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:10.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.674+0000 7f0557552640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0550074eb0 0x7f05501a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:10.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.674+0000 7f0557552640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0550112ba0 0x7f055019ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:10.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.674+0000 7f0557552640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05501186d0 con 0x7f0550112ba0 2024-09-19T09:54:10.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.674+0000 7f0557552640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0550118550 con 0x7f0550074eb0 2024-09-19T09:54:10.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.674+0000 7f0557552640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0550118850 con 0x7f0550074590 2024-09-19T09:54:10.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.675+0000 7f0555aef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0550112ba0 0x7f055019ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:10.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.675+0000 7f0554aed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0550074eb0 0x7f05501a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:10.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.675+0000 7f0554aed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0550074eb0 0x7f05501a4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:54884/0 (socket says 172.21.15.18:54884) 2024-09-19T09:54:10.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.675+0000 7f0554aed640 1 -- 172.21.15.18:0/193774360 learned_addr learned my addr 172.21.15.18:0/193774360 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.676+0000 7f05552ee640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0550074590 0x7f05501a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.676+0000 7f0555aef640 1 -- 172.21.15.18:0/193774360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0550074590 msgr2=0x7f05501a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.676+0000 7f0555aef640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0550074590 0x7f05501a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.676+0000 7f0555aef640 1 -- 172.21.15.18:0/193774360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0550074eb0 msgr2=0x7f05501a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.676+0000 7f0555aef640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0550074eb0 0x7f05501a4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.676+0000 7f0555aef640 1 -- 172.21.15.18:0/193774360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055019f190 con 0x7f0550112ba0 2024-09-19T09:54:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.676+0000 7f05552ee640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0550074590 0x7f05501a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:10.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.678+0000 7f0555aef640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0550112ba0 0x7f055019ea60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f054800bdf0 tx=0x7f054800bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:10.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.678+0000 7f05467fc640 1 -- 172.21.15.18:0/193774360 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548019070 con 0x7f0550112ba0 2024-09-19T09:54:10.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.679+0000 7f0557552640 1 -- 172.21.15.18:0/193774360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055019f480 con 0x7f0550112ba0 2024-09-19T09:54:10.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.679+0000 7f05467fc640 1 -- 172.21.15.18:0/193774360 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0548014920 con 0x7f0550112ba0 2024-09-19T09:54:10.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.679+0000 7f05467fc640 1 -- 172.21.15.18:0/193774360 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548012900 con 0x7f0550112ba0 2024-09-19T09:54:10.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.681+0000 7f0557552640 1 -- 172.21.15.18:0/193774360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05501ab770 con 0x7f0550112ba0 2024-09-19T09:54:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.686+0000 7f0557552640 1 -- 172.21.15.18:0/193774360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05500749f0 con 0x7f0550112ba0 2024-09-19T09:54:10.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.691+0000 7f05467fc640 1 -- 172.21.15.18:0/193774360 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f054801c070 con 0x7f0550112ba0 2024-09-19T09:54:10.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.692+0000 7f05467fc640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f053c0a3380 0x7f053c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.693+0000 7f05467fc640 1 -- 172.21.15.18:0/193774360 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f05480cfce0 con 0x7f0550112ba0 2024-09-19T09:54:10.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.696+0000 7f05552ee640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f053c0a3380 0x7f053c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:10.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.700+0000 7f05552ee640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f053c0a3380 0x7f053c0a5840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f054c0096c0 tx=0x7f054c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:10.700+0000 7f05467fc640 1 -- 172.21.15.18:0/193774360 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0548023030 con 0x7f0550112ba0 2024-09-19T09:54:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.205+0000 7f0557552640 1 -- 172.21.15.18:0/193774360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0550105000 con 0x7f0550112ba0 2024-09-19T09:54:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.208+0000 7f05467fc640 1 -- 172.21.15.18:0/193774360 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f054809c9d0 con 0x7f0550112ba0 2024-09-19T09:54:11.211 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:54:11.211 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:54:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:54:11.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.218+0000 7f0557552640 1 -- 172.21.15.18:0/193774360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f053c0a3380 msgr2=0x7f053c0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:11.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.218+0000 7f0557552640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f053c0a3380 0x7f053c0a5840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f054c0096c0 tx=0x7f054c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:54:11.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.218+0000 7f0557552640 1 -- 172.21.15.18:0/193774360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0550112ba0 msgr2=0x7f055019ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:11.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.218+0000 7f0557552640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0550112ba0 0x7f055019ea60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f054800bdf0 tx=0x7f054800bee0 comp rx=0 tx=0).stop 2024-09-19T09:54:11.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.219+0000 7f0557552640 1 -- 172.21.15.18:0/193774360 shutdown_connections 2024-09-19T09:54:11.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.219+0000 7f0557552640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f053c0a3380 0x7f053c0a5840 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:11.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.219+0000 7f0557552640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0550112ba0 0x7f055019ea60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:11.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.219+0000 7f0557552640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0550074eb0 0x7f05501a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:11.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.219+0000 7f0557552640 1 --2- 172.21.15.18:0/193774360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0550074590 0x7f05501a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:11.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.219+0000 7f0557552640 1 -- 172.21.15.18:0/193774360 >> 172.21.15.18:0/193774360 conn(0x7f05500fd8f0 msgr2=0x7f05500ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:11.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.220+0000 7f0557552640 1 -- 172.21.15.18:0/193774360 shutdown_connections 2024-09-19T09:54:11.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:11.223+0000 7f0557552640 1 -- 172.21.15.18:0/193774360 wait complete. 2024-09-19T09:54:12.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:12 smithi018 ceph-mon[30956]: pgmap v394: 97 pgs: 97 active+clean; 696 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-19T09:54:12.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:12 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/193774360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:12 smithi049 ceph-mon[34858]: pgmap v394: 97 pgs: 97 active+clean; 696 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-19T09:54:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:12 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/193774360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:12.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:12 smithi162 ceph-mon[35174]: pgmap v394: 97 pgs: 97 active+clean; 696 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-19T09:54:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:12 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/193774360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:14.265 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:54:14.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:54:14.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:14 smithi018 ceph-mon[30956]: pgmap v395: 97 pgs: 97 active+clean; 522 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 43 MiB/s wr, 21 op/s 2024-09-19T09:54:14.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:14 smithi049 ceph-mon[34858]: pgmap v395: 97 pgs: 97 active+clean; 522 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 43 MiB/s wr, 21 op/s 2024-09-19T09:54:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:14 smithi162 ceph-mon[35174]: pgmap v395: 97 pgs: 97 active+clean; 522 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 43 MiB/s wr, 21 op/s 2024-09-19T09:54:14.768 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:15.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.705+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/3172164145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e6806ea30 msgr2=0x7f1e6806ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:15.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.705+0000 7f1e6ca1e640 1 --2- 172.21.15.18:0/3172164145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e6806ea30 0x7f1e6806ee90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009900 tx=0x7f1e5c02a440 comp rx=0 tx=0).stop 2024-09-19T09:54:15.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.707+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/3172164145 shutdown_connections 2024-09-19T09:54:15.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.707+0000 7f1e6ca1e640 1 --2- 172.21.15.18:0/3172164145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e6811b140 0x7f1e6811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.707+0000 7f1e6ca1e640 1 --2- 172.21.15.18:0/3172164145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e6806ea30 0x7f1e6806ee90 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.707+0000 7f1e6ca1e640 1 --2- 172.21.15.18:0/3172164145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e68110220 0x7f1e6806e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.707+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/3172164145 >> 172.21.15.18:0/3172164145 conn(0x7f1e68073210 msgr2=0x7f1e68073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:15.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.709+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/3172164145 shutdown_connections 2024-09-19T09:54:15.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.709+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/3172164145 wait complete. 2024-09-19T09:54:15.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.714+0000 7f1e6ca1e640 1 Processor -- start 2024-09-19T09:54:15.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.714+0000 7f1e6ca1e640 1 -- start start 2024-09-19T09:54:15.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.715+0000 7f1e6ca1e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e6806ea30 0x7f1e681a7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.716+0000 7f1e6ca1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e68110220 0x7f1e681a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.716+0000 7f1e6ca1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e6811b140 0x7f1e681abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.716+0000 7f1e6ca1e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68120dc0 con 0x7f1e68110220 2024-09-19T09:54:15.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.716+0000 7f1e6ca1e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68120c40 con 0x7f1e6811b140 2024-09-19T09:54:15.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.716+0000 7f1e6ca1e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68120f40 con 0x7f1e6806ea30 2024-09-19T09:54:15.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.716+0000 7f1e65d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e68110220 0x7f1e681a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.716+0000 7f1e65d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e68110220 0x7f1e681a77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35196/0 (socket says 172.21.15.18:35196) 2024-09-19T09:54:15.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.716+0000 7f1e65d9b640 1 -- 172.21.15.18:0/1130861798 learned_addr learned my addr 172.21.15.18:0/1130861798 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:15.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.717+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e6811b140 0x7f1e681abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.719+0000 7f1e65d9b640 1 -- 172.21.15.18:0/1130861798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e6806ea30 msgr2=0x7f1e681a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:15.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.719+0000 7f1e65d9b640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e6806ea30 0x7f1e681a7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.719+0000 7f1e65d9b640 1 -- 172.21.15.18:0/1130861798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e6811b140 msgr2=0x7f1e681abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:15.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.719+0000 7f1e65d9b640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e6811b140 0x7f1e681abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.719+0000 7f1e65d9b640 1 -- 172.21.15.18:0/1130861798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e681ac210 con 0x7f1e68110220 2024-09-19T09:54:15.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.720+0000 7f1e65d9b640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e68110220 0x7f1e681a77a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0058c0 tx=0x7f1e5c005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:15.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.721+0000 7f1e577fe640 1 -- 172.21.15.18:0/1130861798 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c040030 con 0x7f1e68110220 2024-09-19T09:54:15.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.721+0000 7f1e577fe640 1 -- 172.21.15.18:0/1130861798 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e5c005630 con 0x7f1e68110220 2024-09-19T09:54:15.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.721+0000 7f1e577fe640 1 -- 172.21.15.18:0/1130861798 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c03c940 con 0x7f1e68110220 2024-09-19T09:54:15.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.725+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/1130861798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e681ac4a0 con 0x7f1e68110220 2024-09-19T09:54:15.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.725+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/1130861798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e681ac900 con 0x7f1e68110220 2024-09-19T09:54:15.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.731+0000 7f1e6edf7740 1 Processor -- start 2024-09-19T09:54:15.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.732+0000 7f1e6edf7740 1 -- start start 2024-09-19T09:54:15.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.733+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a08a20 0x55e478a08e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.733+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a136c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.733+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a13c00 0x55e478a15ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.733+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e47896d160 con 0x55e478a09340 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.733+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e478914720 con 0x55e478a08a20 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.733+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e478969120 con 0x55e478a13c00 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.733+0000 7f1e6659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.733+0000 7f1e6659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35206/0 (socket says 172.21.15.18:35206) 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.733+0000 7f1e6659c640 1 -- 172.21.15.18:0/3402828420 learned_addr learned my addr 172.21.15.18:0/3402828420 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.734+0000 7f1e6659c640 1 -- 172.21.15.18:0/3402828420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a13c00 msgr2=0x55e478a15ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.734+0000 7f1e6659c640 1 --2- 172.21.15.18:0/3402828420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a13c00 0x55e478a15ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.734+0000 7f1e6659c640 1 -- 172.21.15.18:0/3402828420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a08a20 msgr2=0x55e478a08e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.734+0000 7f1e6659c640 1 --2- 172.21.15.18:0/3402828420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a08a20 0x55e478a08e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.734+0000 7f1e6659c640 1 -- 172.21.15.18:0/3402828420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4786deba0 con 0x55e478a09340 2024-09-19T09:54:15.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.735+0000 7f1e6659c640 1 --2- 172.21.15.18:0/3402828420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a136c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009d80 tx=0x7f1e6000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fd08ff82c324c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:15.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.736+0000 7f1e54ff9640 1 -- 172.21.15.18:0/3402828420 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000bd40 con 0x55e478a09340 2024-09-19T09:54:15.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.736+0000 7f1e54ff9640 1 -- 172.21.15.18:0/3402828420 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e60017070 con 0x55e478a09340 2024-09-19T09:54:15.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.736+0000 7f1e54ff9640 1 -- 172.21.15.18:0/3402828420 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e600117a0 con 0x55e478a09340 2024-09-19T09:54:15.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.737+0000 7f1e6edf7740 1 -- 172.21.15.18:0/3402828420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 msgr2=0x55e478a136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:15.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.737+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/3402828420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a136c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009d80 tx=0x7f1e6000b420 comp rx=0 tx=0).stop 2024-09-19T09:54:15.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.737+0000 7f1e577fe640 1 -- 172.21.15.18:0/1130861798 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1e5c043030 con 0x7f1e68110220 2024-09-19T09:54:15.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.737+0000 7f1e6edf7740 1 -- 172.21.15.18:0/3402828420 shutdown_connections 2024-09-19T09:54:15.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.737+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/3402828420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a13c00 0x55e478a15ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.737+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/3402828420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a136c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.737+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/3402828420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a08a20 0x55e478a08e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.738+0000 7f1e6edf7740 1 -- 172.21.15.18:0/3402828420 >> 172.21.15.18:0/3402828420 conn(0x55e478a04fb0 msgr2=0x55e478a05390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.738+0000 7f1e6edf7740 1 -- 172.21.15.18:0/3402828420 shutdown_connections 2024-09-19T09:54:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.738+0000 7f1e6edf7740 1 -- 172.21.15.18:0/3402828420 wait complete. 2024-09-19T09:54:15.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.739+0000 7f1e6edf7740 1 -- start start 2024-09-19T09:54:15.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.739+0000 7f1e6edf7740 1 Processor -- start 2024-09-19T09:54:15.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.739+0000 7f1e577fe640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e500a3290 0x7f1e500a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.739+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a08a20 0x55e478a10be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.739+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a09340 0x55e478a11120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.739+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a13c00 0x55e478a11660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.739+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e478a167d0 con 0x55e478a13c00 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.739+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e4788f5900 con 0x55e478a08a20 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.739+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e478a16950 con 0x55e478a09340 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.739+0000 7f1e6edf7740 10 client.0 _ll_register_callbacks cb 0x55e4788f3780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.740+0000 7f1e577fe640 1 -- 172.21.15.18:0/1130861798 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1e5c0f05f0 con 0x7f1e68110220 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.740+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e500a3290 0x7f1e500a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.740+0000 7f1e66d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a13c00 0x55e478a11660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.740+0000 7f1e66d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a13c00 0x55e478a11660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35208/0 (socket says 172.21.15.18:35208) 2024-09-19T09:54:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.740+0000 7f1e66d9d640 1 -- 172.21.15.18:0/766345232 learned_addr learned my addr 172.21.15.18:0/766345232 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e65d9b640 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a09340 0x55e478a11120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e6659c640 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a08a20 0x55e478a10be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e66d9d640 1 -- 172.21.15.18:0/766345232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a09340 msgr2=0x55e478a11120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a09340 0x55e478a11120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e66d9d640 1 -- 172.21.15.18:0/766345232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a08a20 msgr2=0x55e478a10be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a08a20 0x55e478a10be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e66d9d640 1 -- 172.21.15.18:0/766345232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e478935c50 con 0x55e478a13c00 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e500a3290 0x7f1e500a5750 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1e58016620 tx=0x7f1e5800a4e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a13c00 0x55e478a11660 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1e58006e10 tx=0x7f1e58019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6978763921530be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.741+0000 7f1e6659c640 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a08a20 0x55e478a10be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.742+0000 7f1e4dffb640 1 -- 172.21.15.18:0/766345232 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58025060 con 0x55e478a13c00 2024-09-19T09:54:15.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.742+0000 7f1e4dffb640 1 -- 172.21.15.18:0/766345232 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1e58018c50 con 0x55e478a13c00 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.742+0000 7f1e6edf7740 1 -- 172.21.15.18:0/766345232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e60017070 con 0x55e478a13c00 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.742+0000 7f1e4dffb640 1 -- 172.21.15.18:0/766345232 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e5801c070 con 0x55e478a13c00 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.742+0000 7f1e6edf7740 10 client.16071 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.742+0000 7f1e6edf7740 1 -- 172.21.15.18:0/766345232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e478a22590 con 0x55e478a13c00 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.742+0000 7f1e4dffb640 1 -- 172.21.15.18:0/766345232 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e60017070 con 0x55e478a13c00 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.743+0000 7f1e4dffb640 1 -- 172.21.15.18:0/766345232 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1e58015040 con 0x55e478a13c00 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.743+0000 7f1e6edf7740 10 client.16071 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.743+0000 7f1e6edf7740 10 client.16071 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.743+0000 7f1e6edf7740 20 client.16071 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.743+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e478a23aa0 0x55e478a25ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.743+0000 7f1e6edf7740 4 client.16071 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.743+0000 7f1e6edf7740 1 -- 172.21.15.18:0/766345232 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e47897a890 con 0x55e478a23aa0 2024-09-19T09:54:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.746+0000 7f1e6659c640 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e478a23aa0 0x55e478a25ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.755+0000 7f1e4dffb640 10 client.16071 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.755+0000 7f1e6659c640 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e478a23aa0 0x55e478a25ed0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57e358fbbe420d98 server_cookie=1d11cf3f043384ae in_seq=0 out_seq=0 2024-09-19T09:54:15.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.759+0000 7f1e4dffb640 1 -- 172.21.15.18:0/766345232 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e47897a890 con 0x55e478a23aa0 2024-09-19T09:54:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.759+0000 7f1e4dffb640 10 client.16071 handle_command_reply: tid=0 2024-09-19T09:54:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.759+0000 7f1e6edf7740 1 client.16071 shutdown 2024-09-19T09:54:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.759+0000 7f1e6edf7740 1 -- 172.21.15.18:0/766345232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a13c00 msgr2=0x55e478a11660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.759+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a13c00 0x55e478a11660 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1e58006e10 tx=0x7f1e58019000 comp rx=0 tx=0).stop 2024-09-19T09:54:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.760+0000 7f1e6edf7740 1 -- 172.21.15.18:0/766345232 shutdown_connections 2024-09-19T09:54:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.760+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e478a23aa0 0x55e478a25ed0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.760+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a13c00 0x55e478a11660 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.760+0000 7f1e4dffb640 0 client.16071 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.760+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a09340 0x55e478a11120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.760+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/766345232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a08a20 0x55e478a10be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.760+0000 7f1e6edf7740 1 -- 172.21.15.18:0/766345232 >> 172.21.15.18:0/766345232 conn(0x55e478a04fb0 msgr2=0x55e478a0ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.760+0000 7f1e6edf7740 1 -- 172.21.15.18:0/766345232 shutdown_connections 2024-09-19T09:54:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.760+0000 7f1e6edf7740 1 -- 172.21.15.18:0/766345232 wait complete. 2024-09-19T09:54:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.760+0000 7f1e6edf7740 20 client.16071 trim_cache size 0 max 16384 2024-09-19T09:54:15.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.784+0000 7f1e6edf7740 1 Processor -- start 2024-09-19T09:54:15.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.785+0000 7f1e6edf7740 1 -- start start 2024-09-19T09:54:15.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.785+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a04fb0 0x55e478a2b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.785+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a08a20 0x55e478a2bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.785+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a0de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.785+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681bc100 con 0x55e478a09340 2024-09-19T09:54:15.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.785+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681bdc40 con 0x55e478a04fb0 2024-09-19T09:54:15.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.785+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681bc7d0 con 0x55e478a08a20 2024-09-19T09:54:15.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.785+0000 7f1e66d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a0de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.785+0000 7f1e66d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a0de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35210/0 (socket says 172.21.15.18:35210) 2024-09-19T09:54:15.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.785+0000 7f1e66d9d640 1 -- 172.21.15.18:0/3065011585 learned_addr learned my addr 172.21.15.18:0/3065011585 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:15.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.786+0000 7f1e66d9d640 1 -- 172.21.15.18:0/3065011585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a08a20 msgr2=0x55e478a2bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:15.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.786+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/3065011585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a08a20 0x55e478a2bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.786+0000 7f1e66d9d640 1 -- 172.21.15.18:0/3065011585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a04fb0 msgr2=0x55e478a2b7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:15.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.786+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/3065011585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a04fb0 0x55e478a2b7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.786+0000 7f1e66d9d640 1 -- 172.21.15.18:0/3065011585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e478a09170 con 0x55e478a09340 2024-09-19T09:54:15.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.786+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/3065011585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a0de40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800a150 tx=0x7f1e58006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59480941ab90d542 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:15.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.786+0000 7f1e4ffff640 1 -- 172.21.15.18:0/3065011585 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58030020 con 0x55e478a09340 2024-09-19T09:54:15.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.787+0000 7f1e4ffff640 1 -- 172.21.15.18:0/3065011585 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e5800a9f0 con 0x55e478a09340 2024-09-19T09:54:15.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.787+0000 7f1e4ffff640 1 -- 172.21.15.18:0/3065011585 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58025040 con 0x55e478a09340 2024-09-19T09:54:15.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.788+0000 7f1e6edf7740 1 -- 172.21.15.18:0/3065011585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 msgr2=0x55e478a0de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:15.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.788+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/3065011585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a0de40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800a150 tx=0x7f1e58006a30 comp rx=0 tx=0).stop 2024-09-19T09:54:15.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.788+0000 7f1e6edf7740 1 -- 172.21.15.18:0/3065011585 shutdown_connections 2024-09-19T09:54:15.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.788+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/3065011585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a0de40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.788+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/3065011585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a08a20 0x55e478a2bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.788+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/3065011585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a04fb0 0x55e478a2b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.788+0000 7f1e6edf7740 1 -- 172.21.15.18:0/3065011585 >> 172.21.15.18:0/3065011585 conn(0x55e478a117c0 msgr2=0x55e478a10ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:15.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.788+0000 7f1e6edf7740 1 -- 172.21.15.18:0/3065011585 shutdown_connections 2024-09-19T09:54:15.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.788+0000 7f1e6edf7740 1 -- 172.21.15.18:0/3065011585 wait complete. 2024-09-19T09:54:15.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.789+0000 7f1e6edf7740 1 -- start start 2024-09-19T09:54:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.789+0000 7f1e6edf7740 1 Processor -- start 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.789+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a04fb0 0x55e478a18190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.789+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a08a20 0x55e478a186d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.789+0000 7f1e6edf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a87740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.789+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681bd570 con 0x55e478a09340 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.789+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681bcea0 con 0x55e478a04fb0 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.789+0000 7f1e6edf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681ba100 con 0x55e478a08a20 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.789+0000 7f1e6edf7740 10 client.0 _ll_register_callbacks cb 0x7f1e6806f5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.790+0000 7f1e66d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a87740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.790+0000 7f1e66d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a87740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35216/0 (socket says 172.21.15.18:35216) 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.790+0000 7f1e66d9d640 1 -- 172.21.15.18:0/2561976306 learned_addr learned my addr 172.21.15.18:0/2561976306 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.790+0000 7f1e66d9d640 1 -- 172.21.15.18:0/2561976306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a08a20 msgr2=0x55e478a186d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.790+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a08a20 0x55e478a186d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.790+0000 7f1e66d9d640 1 -- 172.21.15.18:0/2561976306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a04fb0 msgr2=0x55e478a18190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:15.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.790+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a04fb0 0x55e478a18190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.790+0000 7f1e66d9d640 1 -- 172.21.15.18:0/2561976306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e478a87d80 con 0x55e478a09340 2024-09-19T09:54:15.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.791+0000 7f1e66d9d640 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a87740 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1e58020ee0 tx=0x7f1e58019f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934faf1cdba6d808 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.791+0000 7f1e4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.791+0000 7f1e4dffb640 1 -- 172.21.15.18:0/2561976306 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58030070 con 0x55e478a09340 2024-09-19T09:54:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.791+0000 7f1e4dffb640 1 -- 172.21.15.18:0/2561976306 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1e58020420 con 0x55e478a09340 2024-09-19T09:54:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.791+0000 7f1e6edf7740 1 -- 172.21.15.18:0/2561976306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e5800a9f0 con 0x55e478a09340 2024-09-19T09:54:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.791+0000 7f1e4dffb640 1 -- 172.21.15.18:0/2561976306 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e58025070 con 0x55e478a09340 2024-09-19T09:54:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.791+0000 7f1e6edf7740 10 client.16077 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.791+0000 7f1e6edf7740 1 -- 172.21.15.18:0/2561976306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e478a8f0d0 con 0x55e478a09340 2024-09-19T09:54:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.791+0000 7f1e4dffb640 1 -- 172.21.15.18:0/2561976306 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e5800a9f0 con 0x55e478a09340 2024-09-19T09:54:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.792+0000 7f1e4dffb640 1 -- 172.21.15.18:0/2561976306 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1e5801fa10 con 0x55e478a09340 2024-09-19T09:54:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.792+0000 7f1e6edf7740 10 client.16077 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.792+0000 7f1e6edf7740 10 client.16077 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:54:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.792+0000 7f1e6edf7740 20 client.16077 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.793+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e478a13c00 0x55e478a91790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.793+0000 7f1e6edf7740 4 client.16077 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:54:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.793+0000 7f1e6edf7740 1 -- 172.21.15.18:0/2561976306 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55e478974be0 con 0x55e478a13c00 2024-09-19T09:54:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.798+0000 7f1e6659c640 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e478a13c00 0x55e478a91790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.805+0000 7f1e4dffb640 10 client.16077 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.805+0000 7f1e6659c640 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e478a13c00 0x55e478a91790 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f7bb7c1e8cccc9e server_cookie=a7b2e8f586efb0ac in_seq=0 out_seq=0 2024-09-19T09:54:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e4dffb640 1 -- 172.21.15.18:0/2561976306 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e478974be0 con 0x55e478a13c00 2024-09-19T09:54:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e4dffb640 10 client.16077 handle_command_reply: tid=0 2024-09-19T09:54:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 client.16077 shutdown 2024-09-19T09:54:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 -- 172.21.15.18:0/2561976306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 msgr2=0x55e478a87740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a87740 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1e58020ee0 tx=0x7f1e58019f10 comp rx=0 tx=0).stop 2024-09-19T09:54:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 -- 172.21.15.18:0/2561976306 shutdown_connections 2024-09-19T09:54:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e478a13c00 0x55e478a91790 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e478a09340 0x55e478a87740 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e478a08a20 0x55e478a186d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 --2- 172.21.15.18:0/2561976306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e478a04fb0 0x55e478a18190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 -- 172.21.15.18:0/2561976306 >> 172.21.15.18:0/2561976306 conn(0x55e478a117c0 msgr2=0x55e478a0a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:15.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e4dffb640 0 client.16077 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:15.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 -- 172.21.15.18:0/2561976306 shutdown_connections 2024-09-19T09:54:15.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.974+0000 7f1e6edf7740 1 -- 172.21.15.18:0/2561976306 wait complete. 2024-09-19T09:54:15.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6edf7740 20 client.16077 trim_cache size 0 max 16384 2024-09-19T09:54:15.978 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:54:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:54:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:54:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 10, 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "9655fe98": { 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 10, 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 140.3, 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:54:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:54:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:54:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:54:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:54:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:15.980 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:54:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/1130861798 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e500a3290 msgr2=0x7f1e500a5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e500a3290 0x7f1e500a5750 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1e58016620 tx=0x7f1e5800a4e0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/1130861798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e68110220 msgr2=0x7f1e681a77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e68110220 0x7f1e681a77a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0058c0 tx=0x7f1e5c005230 comp rx=0 tx=0).stop 2024-09-19T09:54:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/1130861798 shutdown_connections 2024-09-19T09:54:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1e500a3290 0x7f1e500a5750 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e6811b140 0x7f1e681abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e68110220 0x7f1e681a77a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 --2- 172.21.15.18:0/1130861798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e6806ea30 0x7f1e681a7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/1130861798 >> 172.21.15.18:0/1130861798 conn(0x7f1e68073210 msgr2=0x7f1e681192d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/1130861798 shutdown_connections 2024-09-19T09:54:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:15.975+0000 7f1e6ca1e640 1 -- 172.21.15.18:0/1130861798 wait complete. 2024-09-19T09:54:16.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:16 smithi018 ceph-mon[30956]: pgmap v396: 97 pgs: 97 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 143 MiB/s wr, 150 op/s 2024-09-19T09:54:16.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:16 smithi049 ceph-mon[34858]: pgmap v396: 97 pgs: 97 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 143 MiB/s wr, 150 op/s 2024-09-19T09:54:16.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:16 smithi162 ceph-mon[35174]: pgmap v396: 97 pgs: 97 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 143 MiB/s wr, 150 op/s 2024-09-19T09:54:16.718 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9655fe98', quiesce took 7.0 seconds. Will release after: 13.350000000000001 2024-09-19T09:54:18.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:18 smithi018 ceph-mon[30956]: pgmap v397: 97 pgs: 97 active+clean; 3.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 299 MiB/s wr, 248 op/s 2024-09-19T09:54:18.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:18 smithi049 ceph-mon[34858]: pgmap v397: 97 pgs: 97 active+clean; 3.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 299 MiB/s wr, 248 op/s 2024-09-19T09:54:18.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:18 smithi162 ceph-mon[35174]: pgmap v397: 97 pgs: 97 active+clean; 3.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 299 MiB/s wr, 248 op/s 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.625+0000 7fd417a23640 1 -- 172.21.15.18:0/3647566749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd410102640 msgr2=0x7fd410104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.625+0000 7fd417a23640 1 --2- 172.21.15.18:0/3647566749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd410102640 0x7fd410104a30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009900 tx=0x7fd40c02a410 comp rx=0 tx=0).stop 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.625+0000 7fd417a23640 1 -- 172.21.15.18:0/3647566749 shutdown_connections 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.625+0000 7fd417a23640 1 --2- 172.21.15.18:0/3647566749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4101078a0 0x7fd410109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.625+0000 7fd417a23640 1 --2- 172.21.15.18:0/3647566749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd410104f70 0x7fd410107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.625+0000 7fd417a23640 1 --2- 172.21.15.18:0/3647566749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd410102640 0x7fd410104a30 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 -- 172.21.15.18:0/3647566749 >> 172.21.15.18:0/3647566749 conn(0x7fd4100fc1e0 msgr2=0x7fd4100fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 -- 172.21.15.18:0/3647566749 shutdown_connections 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 -- 172.21.15.18:0/3647566749 wait complete. 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 Processor -- start 2024-09-19T09:54:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 -- start start 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd410102640 0x7fd410197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd410104f70 0x7fd4101983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4101078a0 0x7fd41019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd41010d830 con 0x7fd410102640 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd41010d6b0 con 0x7fd410104f70 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.626+0000 7fd417a23640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd41010d9b0 con 0x7fd4101078a0 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4157bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd410102640 0x7fd410197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4157bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd410102640 0x7fd410197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47236/0 (socket says 172.21.15.18:47236) 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4157bf640 1 -- 172.21.15.18:0/1205151328 learned_addr learned my addr 172.21.15.18:0/1205151328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd415fc0640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4101078a0 0x7fd41019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd414fbe640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd410104f70 0x7fd4101983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4157bf640 1 -- 172.21.15.18:0/1205151328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4101078a0 msgr2=0x7fd41019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4157bf640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4101078a0 0x7fd41019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4157bf640 1 -- 172.21.15.18:0/1205151328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd410104f70 msgr2=0x7fd4101983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4157bf640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd410104f70 0x7fd4101983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4157bf640 1 -- 172.21.15.18:0/1205151328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41019fab0 con 0x7fd410102640 2024-09-19T09:54:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd414fbe640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd410104f70 0x7fd4101983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4157bf640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd410102640 0x7fd410197e90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009230 tx=0x7fd40c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4067fc640 1 -- 172.21.15.18:0/1205151328 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c03f030 con 0x7fd410102640 2024-09-19T09:54:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4067fc640 1 -- 172.21.15.18:0/1205151328 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd40c003ce0 con 0x7fd410102640 2024-09-19T09:54:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd417a23640 1 -- 172.21.15.18:0/1205151328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41019fd40 con 0x7fd410102640 2024-09-19T09:54:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.627+0000 7fd4067fc640 1 -- 172.21.15.18:0/1205151328 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c035070 con 0x7fd410102640 2024-09-19T09:54:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.628+0000 7fd417a23640 1 -- 172.21.15.18:0/1205151328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4101a01d0 con 0x7fd410102640 2024-09-19T09:54:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.630+0000 7fd4067fc640 1 -- 172.21.15.18:0/1205151328 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd40c042030 con 0x7fd410102640 2024-09-19T09:54:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.630+0000 7fd41a7ba740 1 Processor -- start 2024-09-19T09:54:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.630+0000 7fd41a7ba740 1 -- start start 2024-09-19T09:54:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161cfe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 0x55e161d031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161d05c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e161c5d2f0 con 0x55e161cfddb0 2024-09-19T09:54:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e161c05270 con 0x55e161cfe6f0 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e161c592b0 con 0x55e161d03780 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd415fc0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161cfe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd415fc0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161cfe1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47242/0 (socket says 172.21.15.18:47242) 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd415fc0640 1 -- 172.21.15.18:0/820324041 learned_addr learned my addr 172.21.15.18:0/820324041 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd414fbe640 1 --2- 172.21.15.18:0/820324041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161d05c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd4157bf640 1 --2- 172.21.15.18:0/820324041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 0x55e161d031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd4067fc640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3fc0a3370 0x7fd3fc0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd415fc0640 1 -- 172.21.15.18:0/820324041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 msgr2=0x55e161d05c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd415fc0640 1 --2- 172.21.15.18:0/820324041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161d05c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd415fc0640 1 -- 172.21.15.18:0/820324041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 msgr2=0x55e161d031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd415fc0640 1 --2- 172.21.15.18:0/820324041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 0x55e161d031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd415fc0640 1 -- 172.21.15.18:0/820324041 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e161c04340 con 0x55e161cfddb0 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd4067fc640 1 -- 172.21.15.18:0/1205151328 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd40c0f0280 con 0x7fd410102640 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd415fc0640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3fc0a3370 0x7fd3fc0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.631+0000 7fd415fc0640 1 --2- 172.21.15.18:0/820324041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161cfe1b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd408009fc0 tx=0x7fd408010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701a636ee8844652 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.632+0000 7fd3fb7fe640 1 -- 172.21.15.18:0/820324041 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408022070 con 0x55e161cfddb0 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.632+0000 7fd3fb7fe640 1 -- 172.21.15.18:0/820324041 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4080113e0 con 0x55e161cfddb0 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.632+0000 7fd3fb7fe640 1 -- 172.21.15.18:0/820324041 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408016070 con 0x55e161cfddb0 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.632+0000 7fd41a7ba740 1 -- 172.21.15.18:0/820324041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 msgr2=0x55e161cfe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.632+0000 7fd415fc0640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3fc0a3370 0x7fd3fc0a5830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd40801f000 tx=0x7fd408022000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.632+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/820324041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161cfe1b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd408009fc0 tx=0x7fd408010800 comp rx=0 tx=0).stop 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 -- 172.21.15.18:0/820324041 shutdown_connections 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/820324041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161d05c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/820324041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 0x55e161d031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/820324041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161cfe1b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 -- 172.21.15.18:0/820324041 >> 172.21.15.18:0/820324041 conn(0x55e161cf5010 msgr2=0x55e161cf5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 -- 172.21.15.18:0/820324041 shutdown_connections 2024-09-19T09:54:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 -- 172.21.15.18:0/820324041 wait complete. 2024-09-19T09:54:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 -- start start 2024-09-19T09:54:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 Processor -- start 2024-09-19T09:54:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161d07fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.633+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 0x55e161d08520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161d0f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e161d06750 con 0x55e161cfddb0 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e161be6290 con 0x55e161cfe6f0 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e161d068d0 con 0x55e161d03780 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd41a7ba740 10 client.0 _ll_register_callbacks cb 0x55e161c17140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd4157bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161d07fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd4157bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161d07fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47244/0 (socket says 172.21.15.18:47244) 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd4157bf640 1 -- 172.21.15.18:0/1033513999 learned_addr learned my addr 172.21.15.18:0/1033513999 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd415fc0640 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161d0f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd414fbe640 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 0x55e161d08520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd4157bf640 1 -- 172.21.15.18:0/1033513999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 msgr2=0x55e161d0f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd4157bf640 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161d0f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd4157bf640 1 -- 172.21.15.18:0/1033513999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 msgr2=0x55e161d08520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd4157bf640 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 0x55e161d08520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd4157bf640 1 -- 172.21.15.18:0/1033513999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e161970210 con 0x55e161cfddb0 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd414fbe640 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 0x55e161d08520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd4157bf640 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161d07fe0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd40c004650 tx=0x7fd40c0b8510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8cebc579625f223 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd3f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1033513999 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c049050 con 0x55e161cfddb0 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1033513999 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd40c0b8f40 con 0x55e161cfddb0 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.634+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1033513999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4080113e0 con 0x55e161cfddb0 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1033513999 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd40c0bc230 con 0x55e161cfddb0 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd41a7ba740 10 client.16089 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1033513999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e161a3c620 con 0x55e161cfddb0 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1033513999 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4080113e0 con 0x55e161cfddb0 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1033513999 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd40c0bcb30 con 0x55e161cfddb0 2024-09-19T09:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd41a7ba740 10 client.16089 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd41a7ba740 10 client.16089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd41a7ba740 20 client.16089 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e161d13bd0 0x55e161d16040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd41a7ba740 4 client.16089 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1033513999 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e161c6aa20 con 0x55e161d13bd0 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.635+0000 7fd414fbe640 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e161d13bd0 0x55e161d16040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.636+0000 7fd3f8ff9640 10 client.16089 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.636+0000 7fd414fbe640 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e161d13bd0 0x55e161d16040 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14106d3b34a55bef server_cookie=74407074142d9d05 in_seq=0 out_seq=0 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.636+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1033513999 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e161c6aa20 con 0x55e161d13bd0 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.636+0000 7fd3f8ff9640 10 client.16089 handle_command_reply: tid=0 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 client.16089 shutdown 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1033513999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 msgr2=0x55e161d07fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161d07fe0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd40c004650 tx=0x7fd40c0b8510 comp rx=0 tx=0).stop 2024-09-19T09:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1033513999 shutdown_connections 2024-09-19T09:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e161d13bd0 0x55e161d16040 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161d0f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfe6f0 0x55e161d08520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1033513999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfddb0 0x55e161d07fe0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1033513999 >> 172.21.15.18:0/1033513999 conn(0x55e161cf5010 msgr2=0x55e161cf6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd3f8ff9640 0 client.16089 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1033513999 shutdown_connections 2024-09-19T09:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1033513999 wait complete. 2024-09-19T09:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.637+0000 7fd41a7ba740 20 client.16089 trim_cache size 0 max 16384 2024-09-19T09:54:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd41a7ba740 1 Processor -- start 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd41a7ba740 1 -- start start 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfddb0 0x55e161cf5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161cf64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd4101a6d50 con 0x55e161cfe6f0 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd4101a8890 con 0x55e161cfddb0 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4101a7420 con 0x55e161d03780 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd414fbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd414fbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47254/0 (socket says 172.21.15.18:47254) 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd414fbe640 1 -- 172.21.15.18:0/732645338 learned_addr learned my addr 172.21.15.18:0/732645338 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd415fc0640 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161cf64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd4157bf640 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfddb0 0x55e161cf5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd414fbe640 1 -- 172.21.15.18:0/732645338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 msgr2=0x55e161cf64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd414fbe640 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161cf64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd414fbe640 1 -- 172.21.15.18:0/732645338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfddb0 msgr2=0x55e161cf5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd414fbe640 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfddb0 0x55e161cf5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd414fbe640 1 -- 172.21.15.18:0/732645338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e161d07b20 con 0x55e161cfe6f0 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd415fc0640 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161cf64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.652+0000 7fd4157bf640 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfddb0 0x55e161cf5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd414fbe640 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0f4f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd4101993a0 tx=0x7fd4000094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da719d2f485c63e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd3faffd640 1 -- 172.21.15.18:0/732645338 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40001e070 con 0x55e161cfe6f0 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd3faffd640 1 -- 172.21.15.18:0/732645338 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd40001aa60 con 0x55e161cfe6f0 2024-09-19T09:54:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd3faffd640 1 -- 172.21.15.18:0/732645338 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400011d40 con 0x55e161cfe6f0 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd41a7ba740 1 -- 172.21.15.18:0/732645338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 msgr2=0x55e161d0f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0f4f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd4101993a0 tx=0x7fd4000094a0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd41a7ba740 1 -- 172.21.15.18:0/732645338 shutdown_connections 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161d03780 0x55e161cf64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0f4f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/732645338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161cfddb0 0x55e161cf5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd41a7ba740 1 -- 172.21.15.18:0/732645338 >> 172.21.15.18:0/732645338 conn(0x55e161cf5010 msgr2=0x55e161d07d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd41a7ba740 1 -- 172.21.15.18:0/732645338 shutdown_connections 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.653+0000 7fd41a7ba740 1 -- 172.21.15.18:0/732645338 wait complete. 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd41a7ba740 1 -- start start 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd41a7ba740 1 Processor -- start 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161cfddb0 0x55e161d0cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd41a7ba740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161d03780 0x55e161d0e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd4101a81c0 con 0x55e161cfe6f0 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd4101a7af0 con 0x55e161d03780 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd41a7ba740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4101a4d30 con 0x55e161cfddb0 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd41a7ba740 10 client.0 _ll_register_callbacks cb 0x7fd40c004550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd414fbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd414fbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47270/0 (socket says 172.21.15.18:47270) 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd414fbe640 1 -- 172.21.15.18:0/1828173954 learned_addr learned my addr 172.21.15.18:0/1828173954 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd4157bf640 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161cfddb0 0x55e161d0cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.654+0000 7fd415fc0640 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161d03780 0x55e161d0e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd414fbe640 1 -- 172.21.15.18:0/1828173954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161cfddb0 msgr2=0x55e161d0cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd414fbe640 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161cfddb0 0x55e161d0cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd414fbe640 1 -- 172.21.15.18:0/1828173954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161d03780 msgr2=0x55e161d0e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd414fbe640 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161d03780 0x55e161d0e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd414fbe640 1 -- 172.21.15.18:0/1828173954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e161d0eab0 con 0x55e161cfe6f0 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd414fbe640 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0d490 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd4000118c0 tx=0x7fd400009ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8a469ab61b31ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd3f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1828173954 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40001e050 con 0x55e161cfe6f0 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1828173954 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd400011cc0 con 0x55e161cfe6f0 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1828173954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd40001aa60 con 0x55e161cfe6f0 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1828173954 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd400004020 con 0x55e161cfe6f0 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd41a7ba740 10 client.16095 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1828173954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e161d7ebe0 con 0x55e161cfe6f0 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.655+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1828173954 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd40001aa60 con 0x55e161cfe6f0 2024-09-19T09:54:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.656+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1828173954 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd40002a030 con 0x55e161cfe6f0 2024-09-19T09:54:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.656+0000 7fd41a7ba740 10 client.16095 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.656+0000 7fd41a7ba740 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.656+0000 7fd41a7ba740 20 client.16095 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.656+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e161d7f530 0x55e161d81950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.656+0000 7fd41a7ba740 4 client.16095 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:54:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.656+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1828173954 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e161c64d70 con 0x55e161d7f530 2024-09-19T09:54:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.656+0000 7fd4157bf640 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e161d7f530 0x55e161d81950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.656+0000 7fd4157bf640 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e161d7f530 0x55e161d81950 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9206972c9545d9b1 server_cookie=2bb97e848f5e584 in_seq=0 out_seq=0 2024-09-19T09:54:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.656+0000 7fd3f8ff9640 10 client.16095 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd3f8ff9640 1 -- 172.21.15.18:0/1828173954 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e161c64d70 con 0x55e161d7f530 2024-09-19T09:54:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd3f8ff9640 10 client.16095 handle_command_reply: tid=0 2024-09-19T09:54:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd41a7ba740 1 client.16095 shutdown 2024-09-19T09:54:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1828173954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 msgr2=0x55e161d0d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0d490 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd4000118c0 tx=0x7fd400009ac0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1828173954 shutdown_connections 2024-09-19T09:54:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e161d7f530 0x55e161d81950 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e161d03780 0x55e161d0e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e161cfe6f0 0x55e161d0d490 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd3f8ff9640 0 client.16095 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd41a7ba740 1 --2- 172.21.15.18:0/1828173954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e161cfddb0 0x55e161d0cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.679+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1828173954 >> 172.21.15.18:0/1828173954 conn(0x55e161cf5010 msgr2=0x55e161cf5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1828173954 shutdown_connections 2024-09-19T09:54:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd41a7ba740 1 -- 172.21.15.18:0/1828173954 wait complete. 2024-09-19T09:54:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd41a7ba740 20 client.16095 trim_cache size 0 max 16384 2024-09-19T09:54:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:54:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:54:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:54:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:54:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 -- 172.21.15.18:0/1205151328 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3fc0a3370 msgr2=0x7fd3fc0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3fc0a3370 0x7fd3fc0a5830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd40801f000 tx=0x7fd408022000 comp rx=0 tx=0).stop 2024-09-19T09:54:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 -- 172.21.15.18:0/1205151328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd410102640 msgr2=0x7fd410197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd410102640 0x7fd410197e90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009230 tx=0x7fd40c004360 comp rx=0 tx=0).stop 2024-09-19T09:54:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 -- 172.21.15.18:0/1205151328 shutdown_connections 2024-09-19T09:54:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd3fc0a3370 0x7fd3fc0a5830 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4101078a0 0x7fd41019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd410104f70 0x7fd4101983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 --2- 172.21.15.18:0/1205151328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd410102640 0x7fd410197e90 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 -- 172.21.15.18:0/1205151328 >> 172.21.15.18:0/1205151328 conn(0x7fd4100fc1e0 msgr2=0x7fd410102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 -- 172.21.15.18:0/1205151328 shutdown_connections 2024-09-19T09:54:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:18.680+0000 7fd417a23640 1 -- 172.21.15.18:0/1205151328 wait complete. 2024-09-19T09:54:20.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:20 smithi018 ceph-mon[30956]: pgmap v398: 97 pgs: 97 active+clean; 4.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 358 MiB/s wr, 325 op/s 2024-09-19T09:54:20.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:20 smithi049 ceph-mon[34858]: pgmap v398: 97 pgs: 97 active+clean; 4.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 358 MiB/s wr, 325 op/s 2024-09-19T09:54:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:20 smithi162 ceph-mon[35174]: pgmap v398: 97 pgs: 97 active+clean; 4.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 358 MiB/s wr, 325 op/s 2024-09-19T09:54:22.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:22 smithi018 ceph-mon[30956]: pgmap v399: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 404 MiB/s wr, 341 op/s 2024-09-19T09:54:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:22 smithi049 ceph-mon[34858]: pgmap v399: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 404 MiB/s wr, 341 op/s 2024-09-19T09:54:22.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:22 smithi162 ceph-mon[35174]: pgmap v399: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 404 MiB/s wr, 341 op/s 2024-09-19T09:54:24.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:24 smithi018 ceph-mon[30956]: pgmap v400: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 409 MiB/s wr, 349 op/s 2024-09-19T09:54:24.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:24 smithi049 ceph-mon[34858]: pgmap v400: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 409 MiB/s wr, 349 op/s 2024-09-19T09:54:24.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:24 smithi162 ceph-mon[35174]: pgmap v400: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 409 MiB/s wr, 349 op/s 2024-09-19T09:54:26.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:26 smithi018 ceph-mon[30956]: pgmap v401: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 376 MiB/s wr, 343 op/s 2024-09-19T09:54:26.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:26 smithi049 ceph-mon[34858]: pgmap v401: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 376 MiB/s wr, 343 op/s 2024-09-19T09:54:26.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:26 smithi162 ceph-mon[35174]: pgmap v401: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 376 MiB/s wr, 343 op/s 2024-09-19T09:54:28.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:28 smithi018 ceph-mon[30956]: pgmap v402: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 293 MiB/s wr, 219 op/s 2024-09-19T09:54:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:28 smithi049 ceph-mon[34858]: pgmap v402: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 293 MiB/s wr, 219 op/s 2024-09-19T09:54:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:28 smithi162 ceph-mon[35174]: pgmap v402: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 293 MiB/s wr, 219 op/s 2024-09-19T09:54:30.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:54:30.340 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:30.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:30 smithi018 ceph-mon[30956]: pgmap v403: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 140 MiB/s wr, 119 op/s 2024-09-19T09:54:30.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:30 smithi049 ceph-mon[34858]: pgmap v403: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 140 MiB/s wr, 119 op/s 2024-09-19T09:54:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:30 smithi162 ceph-mon[35174]: pgmap v403: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 140 MiB/s wr, 119 op/s 2024-09-19T09:54:30.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.806+0000 7fe81093b640 1 -- 172.21.15.18:0/1596692960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe80c10c180 msgr2=0x7fe80c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.806+0000 7fe81093b640 1 --2- 172.21.15.18:0/1596692960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe80c10c180 0x7fe80c10e600 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe804009ca0 tx=0x7fe80402a950 comp rx=0 tx=0).stop 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.806+0000 7fe81093b640 1 -- 172.21.15.18:0/1596692960 shutdown_connections 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.806+0000 7fe81093b640 1 --2- 172.21.15.18:0/1596692960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe80c10c180 0x7fe80c10e600 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.806+0000 7fe81093b640 1 --2- 172.21.15.18:0/1596692960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe80c1036c0 0x7fe80c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.806+0000 7fe81093b640 1 --2- 172.21.15.18:0/1596692960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c102da0 0x7fe80c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.806+0000 7fe81093b640 1 -- 172.21.15.18:0/1596692960 >> 172.21.15.18:0/1596692960 conn(0x7fe80c0fc7a0 msgr2=0x7fe80c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.806+0000 7fe81093b640 1 -- 172.21.15.18:0/1596692960 shutdown_connections 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.806+0000 7fe81093b640 1 -- 172.21.15.18:0/1596692960 wait complete. 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.806+0000 7fe81093b640 1 Processor -- start 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe81093b640 1 -- start start 2024-09-19T09:54:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe81093b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe80c102da0 0x7fe80c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe81093b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c1036c0 0x7fe80c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe81093b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe80c10c180 0x7fe80c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe81093b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c111f40 con 0x7fe80c102da0 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe81093b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c111dc0 con 0x7fe80c1036c0 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe81093b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c1120c0 con 0x7fe80c10c180 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe80a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe80c102da0 0x7fe80c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe80a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe80c102da0 0x7fe80c100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59120/0 (socket says 172.21.15.18:59120) 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe80a59c640 1 -- 172.21.15.18:0/2048075274 learned_addr learned my addr 172.21.15.18:0/2048075274 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe809d9b640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c1036c0 0x7fe80c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe80ad9d640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe80c10c180 0x7fe80c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe80a59c640 1 -- 172.21.15.18:0/2048075274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe80c10c180 msgr2=0x7fe80c101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe80a59c640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe80c10c180 0x7fe80c101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe80a59c640 1 -- 172.21.15.18:0/2048075274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c1036c0 msgr2=0x7fe80c100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe80a59c640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c1036c0 0x7fe80c100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe80a59c640 1 -- 172.21.15.18:0/2048075274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c1a6890 con 0x7fe80c102da0 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.807+0000 7fe80a59c640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe80c102da0 0x7fe80c100a00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00d950 tx=0x7fe7fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.808+0000 7fe7fb7fe640 1 -- 172.21.15.18:0/2048075274 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc017030 con 0x7fe80c102da0 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.808+0000 7fe7fb7fe640 1 -- 172.21.15.18:0/2048075274 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7fc004020 con 0x7fe80c102da0 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.808+0000 7fe81093b640 1 -- 172.21.15.18:0/2048075274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80c1a6b80 con 0x7fe80c102da0 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.808+0000 7fe7fb7fe640 1 -- 172.21.15.18:0/2048075274 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0047a0 con 0x7fe80c102da0 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.808+0000 7fe81093b640 1 -- 172.21.15.18:0/2048075274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe80c1a70c0 con 0x7fe80c102da0 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.809+0000 7fe81093b640 1 -- 172.21.15.18:0/2048075274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe80c103180 con 0x7fe80c102da0 2024-09-19T09:54:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.810+0000 7fe7fb7fe640 1 -- 172.21.15.18:0/2048075274 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe7fc0041d0 con 0x7fe80c102da0 2024-09-19T09:54:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.811+0000 7fe7fb7fe640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe7f40a3240 0x7fe7f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.811+0000 7fe809d9b640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe7f40a3240 0x7fe7f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.811+0000 7fe7fb7fe640 1 -- 172.21.15.18:0/2048075274 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe7fc0cf300 con 0x7fe80c102da0 2024-09-19T09:54:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.811+0000 7fe809d9b640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe7f40a3240 0x7fe7f40a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe80c102490 tx=0x7fe80000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:30.815+0000 7fe7fb7fe640 1 -- 172.21.15.18:0/2048075274 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe7fc09bff0 con 0x7fe80c102da0 2024-09-19T09:54:31.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.028+0000 7fe81093b640 1 -- 172.21.15.18:0/2048075274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe80c107250 con 0x7fe80c102da0 2024-09-19T09:54:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.029+0000 7fe7fb7fe640 1 -- 172.21.15.18:0/2048075274 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fe7fc0860c0 con 0x7fe80c102da0 2024-09-19T09:54:31.032 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:54:31.033 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:54:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:54:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.031+0000 7fe81093b640 1 -- 172.21.15.18:0/2048075274 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe7f40a3240 msgr2=0x7fe7f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.031+0000 7fe81093b640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe7f40a3240 0x7fe7f40a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe80c102490 tx=0x7fe80000b390 comp rx=0 tx=0).stop 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.031+0000 7fe81093b640 1 -- 172.21.15.18:0/2048075274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe80c102da0 msgr2=0x7fe80c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.031+0000 7fe81093b640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe80c102da0 0x7fe80c100a00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00d950 tx=0x7fe7fc00de10 comp rx=0 tx=0).stop 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.032+0000 7fe81093b640 1 -- 172.21.15.18:0/2048075274 shutdown_connections 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.032+0000 7fe81093b640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe7f40a3240 0x7fe7f40a5700 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.032+0000 7fe81093b640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe80c10c180 0x7fe80c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.032+0000 7fe81093b640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c1036c0 0x7fe80c100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.032+0000 7fe81093b640 1 --2- 172.21.15.18:0/2048075274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe80c102da0 0x7fe80c100a00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.032+0000 7fe81093b640 1 -- 172.21.15.18:0/2048075274 >> 172.21.15.18:0/2048075274 conn(0x7fe80c0fc7a0 msgr2=0x7fe80c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.032+0000 7fe81093b640 1 -- 172.21.15.18:0/2048075274 shutdown_connections 2024-09-19T09:54:31.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:31.032+0000 7fe81093b640 1 -- 172.21.15.18:0/2048075274 wait complete. 2024-09-19T09:54:31.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:31 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2048075274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:31.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:31 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2048075274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:31.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:31 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2048075274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:31.732 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --set-id 9655fe98 --release --await' 2024-09-19T09:54:31.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --set-id 9655fe98 --release --await 2024-09-19T09:54:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.800+0000 7f2d16453640 1 -- 172.21.15.18:0/3980688876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d10104f70 msgr2=0x7f2d10107360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.800+0000 7f2d16453640 1 --2- 172.21.15.18:0/3980688876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d10104f70 0x7f2d10107360 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009900 tx=0x7f2d0402a410 comp rx=0 tx=0).stop 2024-09-19T09:54:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.800+0000 7f2d16453640 1 -- 172.21.15.18:0/3980688876 shutdown_connections 2024-09-19T09:54:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.800+0000 7f2d16453640 1 --2- 172.21.15.18:0/3980688876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d101078a0 0x7f2d10109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.800+0000 7f2d16453640 1 --2- 172.21.15.18:0/3980688876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d10104f70 0x7f2d10107360 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.800+0000 7f2d16453640 1 --2- 172.21.15.18:0/3980688876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d10102640 0x7f2d10104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.800+0000 7f2d16453640 1 -- 172.21.15.18:0/3980688876 >> 172.21.15.18:0/3980688876 conn(0x7f2d100fc1e0 msgr2=0x7f2d100fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.800+0000 7f2d16453640 1 -- 172.21.15.18:0/3980688876 shutdown_connections 2024-09-19T09:54:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.800+0000 7f2d16453640 1 -- 172.21.15.18:0/3980688876 wait complete. 2024-09-19T09:54:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.801+0000 7f2d16453640 1 Processor -- start 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.801+0000 7f2d16453640 1 -- start start 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.801+0000 7f2d16453640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d10102640 0x7f2d10197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.801+0000 7f2d16453640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d10104f70 0x7f2d101982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.801+0000 7f2d16453640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d101078a0 0x7f2d1019f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.801+0000 7f2d16453640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1010d7d0 con 0x7f2d101078a0 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.801+0000 7f2d16453640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1010d650 con 0x7f2d10102640 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.801+0000 7f2d16453640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1010d950 con 0x7f2d10104f70 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.802+0000 7f2d149f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d101078a0 0x7f2d1019f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.802+0000 7f2d149f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d101078a0 0x7f2d1019f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59134/0 (socket says 172.21.15.18:59134) 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.802+0000 7f2d149f0640 1 -- 172.21.15.18:0/3161878658 learned_addr learned my addr 172.21.15.18:0/3161878658 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.802+0000 7f2d149f0640 1 -- 172.21.15.18:0/3161878658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d10104f70 msgr2=0x7f2d101982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.802+0000 7f2d149f0640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d10104f70 0x7f2d101982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.802+0000 7f2d149f0640 1 -- 172.21.15.18:0/3161878658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d10102640 msgr2=0x7f2d10197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.802+0000 7f2d149f0640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d10102640 0x7f2d10197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.802+0000 7f2d149f0640 1 -- 172.21.15.18:0/3161878658 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1019f980 con 0x7f2d101078a0 2024-09-19T09:54:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.802+0000 7f2d149f0640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d101078a0 0x7f2d1019f310 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800ccb0 tx=0x7f2d0800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.803+0000 7f2d0d7fa640 1 -- 172.21.15.18:0/3161878658 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800f450 con 0x7f2d101078a0 2024-09-19T09:54:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.803+0000 7f2d16453640 1 -- 172.21.15.18:0/3161878658 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1019fc70 con 0x7f2d101078a0 2024-09-19T09:54:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.803+0000 7f2d16453640 1 -- 172.21.15.18:0/3161878658 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d101a01c0 con 0x7f2d101078a0 2024-09-19T09:54:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.803+0000 7f2d0d7fa640 1 -- 172.21.15.18:0/3161878658 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d0800fad0 con 0x7f2d101078a0 2024-09-19T09:54:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.804+0000 7f2d0d7fa640 1 -- 172.21.15.18:0/3161878658 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08018af0 con 0x7f2d101078a0 2024-09-19T09:54:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.806+0000 7f2d191e8740 1 Processor -- start 2024-09-19T09:54:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.807+0000 7f2d0d7fa640 1 -- 172.21.15.18:0/3161878658 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2d0800fc80 con 0x7f2d101078a0 2024-09-19T09:54:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.807+0000 7f2d191e8740 1 -- start start 2024-09-19T09:54:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.807+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca991f9a0 0x555ca991fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.808+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca99202e0 0x555ca9924da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.808+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca9925370 0x555ca9927830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.808+0000 7f2d191e8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555ca98832f0 con 0x555ca9925370 2024-09-19T09:54:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.808+0000 7f2d191e8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555ca982b270 con 0x555ca991f9a0 2024-09-19T09:54:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.808+0000 7f2d191e8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555ca987f2b0 con 0x555ca99202e0 2024-09-19T09:54:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.808+0000 7f2d0f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca9925370 0x555ca9927830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.808+0000 7f2d0f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca9925370 0x555ca9927830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59148/0 (socket says 172.21.15.18:59148) 2024-09-19T09:54:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.808+0000 7f2d0f7fe640 1 -- 172.21.15.18:0/1333082511 learned_addr learned my addr 172.21.15.18:0/1333082511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.808+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/1333082511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca991f9a0 0x555ca991fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.808+0000 7f2d0d7fa640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2cf80a32f0 0x7f2cf80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2d0f7fe640 1 -- 172.21.15.18:0/1333082511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca99202e0 msgr2=0x555ca9924da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/1333082511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca99202e0 0x555ca9924da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2d0f7fe640 1 -- 172.21.15.18:0/1333082511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca991f9a0 msgr2=0x555ca991fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/1333082511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca991f9a0 0x555ca991fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2d149f0640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2cf80a32f0 0x7f2cf80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2d0f7fe640 1 -- 172.21.15.18:0/1333082511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ca982a340 con 0x555ca9925370 2024-09-19T09:54:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2d0d7fa640 1 -- 172.21.15.18:0/3161878658 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2d080cfd50 con 0x7f2d101078a0 2024-09-19T09:54:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/1333082511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca9925370 0x555ca9927830 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2d04033000 tx=0x7f2d04000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a6cd153f299d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2cf67fc640 1 -- 172.21.15.18:0/1333082511 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04041070 con 0x555ca9925370 2024-09-19T09:54:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2d149f0640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2cf80a32f0 0x7f2cf80a57b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d080a4ae0 tx=0x7f2d08097f20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.809+0000 7f2cf67fc640 1 -- 172.21.15.18:0/1333082511 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d04004220 con 0x555ca9925370 2024-09-19T09:54:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.810+0000 7f2cf67fc640 1 -- 172.21.15.18:0/1333082511 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04035030 con 0x555ca9925370 2024-09-19T09:54:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.811+0000 7f2d191e8740 1 -- 172.21.15.18:0/1333082511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca9925370 msgr2=0x555ca9927830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.811+0000 7f2d191e8740 1 --2- 172.21.15.18:0/1333082511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca9925370 0x555ca9927830 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2d04033000 tx=0x7f2d04000bc0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.811+0000 7f2d191e8740 1 -- 172.21.15.18:0/1333082511 shutdown_connections 2024-09-19T09:54:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.811+0000 7f2d191e8740 1 --2- 172.21.15.18:0/1333082511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca9925370 0x555ca9927830 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.811+0000 7f2d191e8740 1 --2- 172.21.15.18:0/1333082511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca99202e0 0x555ca9924da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.811+0000 7f2d191e8740 1 --2- 172.21.15.18:0/1333082511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca991f9a0 0x555ca991fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.811+0000 7f2d191e8740 1 -- 172.21.15.18:0/1333082511 >> 172.21.15.18:0/1333082511 conn(0x555ca991b010 msgr2=0x555ca991b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.811+0000 7f2d191e8740 1 -- 172.21.15.18:0/1333082511 shutdown_connections 2024-09-19T09:54:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.811+0000 7f2d191e8740 1 -- 172.21.15.18:0/1333082511 wait complete. 2024-09-19T09:54:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.812+0000 7f2d191e8740 1 -- start start 2024-09-19T09:54:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.812+0000 7f2d191e8740 1 Processor -- start 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca991f9a0 0x555ca9929bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca9925370 0x555ca9931170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d191e8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555ca99282e0 con 0x555ca99202e0 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d191e8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555ca980c290 con 0x555ca9925370 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59158/0 (socket says 172.21.15.18:59158) 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d0ffff640 1 -- 172.21.15.18:0/936884908 learned_addr learned my addr 172.21.15.18:0/936884908 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca991f9a0 0x555ca9929bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d191e8740 1 -- 172.21.15.18:0/936884908 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555ca9928460 con 0x555ca991f9a0 2024-09-19T09:54:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d191e8740 10 client.0 _ll_register_callbacks cb 0x555ca983d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca9925370 0x555ca9931170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d0ffff640 1 -- 172.21.15.18:0/936884908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca991f9a0 msgr2=0x555ca9929bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d0ffff640 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca991f9a0 0x555ca9929bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.814+0000 7f2d0ffff640 1 -- 172.21.15.18:0/936884908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca9925370 msgr2=0x555ca9931170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.815+0000 7f2d0ffff640 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca9925370 0x555ca9931170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.815+0000 7f2d0ffff640 1 -- 172.21.15.18:0/936884908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ca9596210 con 0x555ca99202e0 2024-09-19T09:54:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.815+0000 7f2d0ffff640 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992a130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000afd0 tx=0x7f2d0000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9239e982e73dea67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.815+0000 7f2cef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.815+0000 7f2cef7fe640 1 -- 172.21.15.18:0/936884908 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00011c20 con 0x555ca99202e0 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.815+0000 7f2cef7fe640 1 -- 172.21.15.18:0/936884908 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2d00011dc0 con 0x555ca99202e0 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.815+0000 7f2d191e8740 1 -- 172.21.15.18:0/936884908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d04004220 con 0x555ca99202e0 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2cef7fe640 1 -- 172.21.15.18:0/936884908 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2d0001f020 con 0x555ca99202e0 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2d191e8740 10 client.16113 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2d191e8740 1 -- 172.21.15.18:0/936884908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555ca9662620 con 0x555ca99202e0 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2cef7fe640 1 -- 172.21.15.18:0/936884908 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d00005020 con 0x555ca99202e0 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2cef7fe640 1 -- 172.21.15.18:0/936884908 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2d000049d0 con 0x555ca99202e0 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2d191e8740 10 client.16113 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2d191e8740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2d191e8740 20 client.16113 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2d191e8740 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555ca99359b0 0x555ca9937da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2d191e8740 4 client.16113 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.816+0000 7f2d191e8740 1 -- 172.21.15.18:0/936884908 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2d04004220 con 0x555ca99359b0 2024-09-19T09:54:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.817+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555ca99359b0 0x555ca9937da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.818+0000 7f2cef7fe640 10 client.16113 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.818+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555ca99359b0 0x555ca9937da0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca007d19242b53eb server_cookie=645817e395b2016f in_seq=0 out_seq=0 2024-09-19T09:54:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.819+0000 7f2cef7fe640 1 -- 172.21.15.18:0/936884908 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2d04004220 con 0x555ca99359b0 2024-09-19T09:54:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.819+0000 7f2cef7fe640 10 client.16113 handle_command_reply: tid=0 2024-09-19T09:54:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 client.16113 shutdown 2024-09-19T09:54:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 -- 172.21.15.18:0/936884908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 msgr2=0x555ca992a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992a130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000afd0 tx=0x7f2d0000c830 comp rx=0 tx=0).stop 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 -- 172.21.15.18:0/936884908 shutdown_connections 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555ca99359b0 0x555ca9937da0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca9925370 0x555ca9931170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992a130 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2cef7fe640 0 client.16113 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 --2- 172.21.15.18:0/936884908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca991f9a0 0x555ca9929bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 -- 172.21.15.18:0/936884908 >> 172.21.15.18:0/936884908 conn(0x555ca991b010 msgr2=0x555ca991c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 -- 172.21.15.18:0/936884908 shutdown_connections 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 1 -- 172.21.15.18:0/936884908 wait complete. 2024-09-19T09:54:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.820+0000 7f2d191e8740 20 client.16113 trim_cache size 0 max 16384 2024-09-19T09:54:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.838+0000 7f2d191e8740 1 Processor -- start 2024-09-19T09:54:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.838+0000 7f2d191e8740 1 -- start start 2024-09-19T09:54:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.838+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca991f9a0 0x555ca9920a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.838+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca99202e0 0x555ca9931130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.838+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca9925370 0x555ca991b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.838+0000 7f2d191e8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc00e400 con 0x555ca991f9a0 2024-09-19T09:54:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.838+0000 7f2d191e8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc00ff40 con 0x555ca99202e0 2024-09-19T09:54:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.838+0000 7f2d191e8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc00ead0 con 0x555ca9925370 2024-09-19T09:54:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.839+0000 7f2d0f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca991f9a0 0x555ca9920a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.839+0000 7f2d0f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca991f9a0 0x555ca9920a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59174/0 (socket says 172.21.15.18:59174) 2024-09-19T09:54:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.839+0000 7f2d0f7fe640 1 -- 172.21.15.18:0/4179292833 learned_addr learned my addr 172.21.15.18:0/4179292833 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.839+0000 7f2d0ffff640 1 --2- 172.21.15.18:0/4179292833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca99202e0 0x555ca9931130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.839+0000 7f2d0f7fe640 1 -- 172.21.15.18:0/4179292833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca9925370 msgr2=0x555ca991b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.839+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/4179292833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca9925370 0x555ca991b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.839+0000 7f2d0f7fe640 1 -- 172.21.15.18:0/4179292833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca99202e0 msgr2=0x555ca9931130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.839+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/4179292833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca99202e0 0x555ca9931130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.839+0000 7f2d0f7fe640 1 -- 172.21.15.18:0/4179292833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ca9938110 con 0x555ca991f9a0 2024-09-19T09:54:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.839+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/4179292833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca991f9a0 0x555ca9920a30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2d040314e0 tx=0x7f2d04005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddc3818525d20dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.840+0000 7f2cf5ffb640 1 -- 172.21.15.18:0/4179292833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04054070 con 0x555ca991f9a0 2024-09-19T09:54:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.840+0000 7f2cf5ffb640 1 -- 172.21.15.18:0/4179292833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d04004200 con 0x555ca991f9a0 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.840+0000 7f2cf5ffb640 1 -- 172.21.15.18:0/4179292833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04035040 con 0x555ca991f9a0 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.841+0000 7f2d191e8740 1 -- 172.21.15.18:0/4179292833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca991f9a0 msgr2=0x555ca9920a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.841+0000 7f2d191e8740 1 --2- 172.21.15.18:0/4179292833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca991f9a0 0x555ca9920a30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2d040314e0 tx=0x7f2d04005fd0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.841+0000 7f2d191e8740 1 -- 172.21.15.18:0/4179292833 shutdown_connections 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.841+0000 7f2d191e8740 1 --2- 172.21.15.18:0/4179292833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca9925370 0x555ca991b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.841+0000 7f2d191e8740 1 --2- 172.21.15.18:0/4179292833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca99202e0 0x555ca9931130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.841+0000 7f2d191e8740 1 --2- 172.21.15.18:0/4179292833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca991f9a0 0x555ca9920a30 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.841+0000 7f2d191e8740 1 -- 172.21.15.18:0/4179292833 >> 172.21.15.18:0/4179292833 conn(0x555ca991b010 msgr2=0x555ca9924b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.841+0000 7f2d191e8740 1 -- 172.21.15.18:0/4179292833 shutdown_connections 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.841+0000 7f2d191e8740 1 -- 172.21.15.18:0/4179292833 wait complete. 2024-09-19T09:54:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d191e8740 1 -- start start 2024-09-19T09:54:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d191e8740 1 Processor -- start 2024-09-19T09:54:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca991f9a0 0x555ca992e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d191e8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca9925370 0x555ca992f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d191e8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc00f870 con 0x555ca99202e0 2024-09-19T09:54:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d191e8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc00f1a0 con 0x555ca991f9a0 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d191e8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc00c3e0 con 0x555ca9925370 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d191e8740 10 client.0 _ll_register_callbacks cb 0x7f2d00005ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59188/0 (socket says 172.21.15.18:59188) 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d0ffff640 1 -- 172.21.15.18:0/2775146652 learned_addr learned my addr 172.21.15.18:0/2775146652 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.842+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca991f9a0 0x555ca992e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.843+0000 7f2d0ffff640 1 -- 172.21.15.18:0/2775146652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca9925370 msgr2=0x555ca992f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.843+0000 7f2d0ffff640 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca9925370 0x555ca992f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.843+0000 7f2d0ffff640 1 -- 172.21.15.18:0/2775146652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca991f9a0 msgr2=0x555ca992e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.843+0000 7f2d0ffff640 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca991f9a0 0x555ca992e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.843+0000 7f2d0ffff640 1 -- 172.21.15.18:0/2775146652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ca992fe70 con 0x555ca99202e0 2024-09-19T09:54:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.843+0000 7f2d0ffff640 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992e850 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x555ca992b0d0 tx=0x7f2d00005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8723ff7280ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.843+0000 7f2cef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.843+0000 7f2cef7fe640 1 -- 172.21.15.18:0/2775146652 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00034060 con 0x555ca99202e0 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.843+0000 7f2cef7fe640 1 -- 172.21.15.18:0/2775146652 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2d00004020 con 0x555ca99202e0 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.843+0000 7f2d191e8740 1 -- 172.21.15.18:0/2775146652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d04004200 con 0x555ca99202e0 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2cef7fe640 1 -- 172.21.15.18:0/2775146652 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2d00004bb0 con 0x555ca99202e0 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2d191e8740 10 client.16119 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2d191e8740 1 -- 172.21.15.18:0/2775146652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555ca99311b0 con 0x555ca99202e0 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2cef7fe640 1 -- 172.21.15.18:0/2775146652 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d04004200 con 0x555ca99202e0 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2cef7fe640 1 -- 172.21.15.18:0/2775146652 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2d00003740 con 0x555ca99202e0 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2d191e8740 10 client.16119 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2d191e8740 10 client.16119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2d191e8740 20 client.16119 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2d191e8740 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555ca99a0a40 0x555ca99a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2d191e8740 4 client.16119 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:54:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.844+0000 7f2d191e8740 1 -- 172.21.15.18:0/2775146652 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555ca9890a20 con 0x555ca99a0a40 2024-09-19T09:54:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.845+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555ca99a0a40 0x555ca99a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.845+0000 7f2d0f7fe640 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555ca99a0a40 0x555ca99a2e60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71aedcfd57a356b server_cookie=5ff6d9528e91b407 in_seq=0 out_seq=0 2024-09-19T09:54:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.845+0000 7f2cef7fe640 10 client.16119 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:31.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2cef7fe640 1 -- 172.21.15.18:0/2775146652 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555ca9890a20 con 0x555ca99a0a40 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2cef7fe640 10 client.16119 handle_command_reply: tid=0 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 client.16119 shutdown 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 -- 172.21.15.18:0/2775146652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 msgr2=0x555ca992e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992e850 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x555ca992b0d0 tx=0x7f2d00005c90 comp rx=0 tx=0).stop 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 -- 172.21.15.18:0/2775146652 shutdown_connections 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555ca99a0a40 0x555ca99a2e60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555ca9925370 0x555ca992f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2cef7fe640 0 client.16119 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ca99202e0 0x555ca992e850 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 --2- 172.21.15.18:0/2775146652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555ca991f9a0 0x555ca992e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 -- 172.21.15.18:0/2775146652 >> 172.21.15.18:0/2775146652 conn(0x555ca991b010 msgr2=0x555ca9929b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 -- 172.21.15.18:0/2775146652 shutdown_connections 2024-09-19T09:54:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 1 -- 172.21.15.18:0/2775146652 wait complete. 2024-09-19T09:54:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.928+0000 7f2d191e8740 20 client.16119 trim_cache size 0 max 16384 2024-09-19T09:54:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:54:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:54:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:54:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:54:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 -- 172.21.15.18:0/3161878658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2cf80a32f0 msgr2=0x7f2cf80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2cf80a32f0 0x7f2cf80a57b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d080a4ae0 tx=0x7f2d08097f20 comp rx=0 tx=0).stop 2024-09-19T09:54:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 -- 172.21.15.18:0/3161878658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d101078a0 msgr2=0x7f2d1019f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d101078a0 0x7f2d1019f310 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800ccb0 tx=0x7f2d0800a620 comp rx=0 tx=0).stop 2024-09-19T09:54:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 -- 172.21.15.18:0/3161878658 shutdown_connections 2024-09-19T09:54:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2cf80a32f0 0x7f2cf80a57b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d101078a0 0x7f2d1019f310 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d10104f70 0x7f2d101982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 --2- 172.21.15.18:0/3161878658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d10102640 0x7f2d10197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 -- 172.21.15.18:0/3161878658 >> 172.21.15.18:0/3161878658 conn(0x7f2d100fc1e0 msgr2=0x7f2d10103240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 -- 172.21.15.18:0/3161878658 shutdown_connections 2024-09-19T09:54:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:31.929+0000 7f2d16453640 1 -- 172.21.15.18:0/3161878658 wait complete. 2024-09-19T09:54:32.030 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:32.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:54:32.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:32 smithi018 ceph-mon[30956]: pgmap v404: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 92 MiB/s wr, 47 op/s 2024-09-19T09:54:32.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:32 smithi049 ceph-mon[34858]: pgmap v404: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 92 MiB/s wr, 47 op/s 2024-09-19T09:54:32.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:32 smithi162 ceph-mon[35174]: pgmap v404: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 92 MiB/s wr, 47 op/s 2024-09-19T09:54:32.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.544+0000 7f6874851640 1 -- 172.21.15.18:0/2583249676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6870102790 msgr2=0x7f68701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:32.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.544+0000 7f6874851640 1 --2- 172.21.15.18:0/2583249676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6870102790 0x7f68701067e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6858009900 tx=0x7f685802a410 comp rx=0 tx=0).stop 2024-09-19T09:54:32.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.545+0000 7f6874851640 1 -- 172.21.15.18:0/2583249676 shutdown_connections 2024-09-19T09:54:32.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.545+0000 7f6874851640 1 --2- 172.21.15.18:0/2583249676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6870106f10 0x7f687010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.545+0000 7f6874851640 1 --2- 172.21.15.18:0/2583249676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6870102790 0x7f68701067e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.545+0000 7f6874851640 1 --2- 172.21.15.18:0/2583249676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6870101de0 0x7f68701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.545+0000 7f6874851640 1 -- 172.21.15.18:0/2583249676 >> 172.21.15.18:0/2583249676 conn(0x7f68700fd8c0 msgr2=0x7f68700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.545+0000 7f6874851640 1 -- 172.21.15.18:0/2583249676 shutdown_connections 2024-09-19T09:54:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.545+0000 7f6874851640 1 -- 172.21.15.18:0/2583249676 wait complete. 2024-09-19T09:54:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.545+0000 7f6874851640 1 Processor -- start 2024-09-19T09:54:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.545+0000 7f6874851640 1 -- start start 2024-09-19T09:54:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f6874851640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6870101de0 0x7f68701984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f6874851640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6870102790 0x7f68701989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f6874851640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6870106f10 0x7f687019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f6874851640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6870111f70 con 0x7f6870106f10 2024-09-19T09:54:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f6874851640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6870111df0 con 0x7f6870101de0 2024-09-19T09:54:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f6874851640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68701120f0 con 0x7f6870102790 2024-09-19T09:54:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6870106f10 0x7f687019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6870106f10 0x7f687019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59210/0 (socket says 172.21.15.18:59210) 2024-09-19T09:54:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686ed9d640 1 -- 172.21.15.18:0/938219841 learned_addr learned my addr 172.21.15.18:0/938219841 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f6867fff640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6870102790 0x7f68701989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686e59c640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6870101de0 0x7f68701984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686ed9d640 1 -- 172.21.15.18:0/938219841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6870102790 msgr2=0x7f68701989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686ed9d640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6870102790 0x7f68701989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686ed9d640 1 -- 172.21.15.18:0/938219841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6870101de0 msgr2=0x7f68701984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686ed9d640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6870101de0 0x7f68701984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686ed9d640 1 -- 172.21.15.18:0/938219841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687019d460 con 0x7f6870106f10 2024-09-19T09:54:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686e59c640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6870101de0 0x7f68701984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.546+0000 7f686ed9d640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6870106f10 0x7f687019cd80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f686800eb10 tx=0x7f686800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.547+0000 7f68677fe640 1 -- 172.21.15.18:0/938219841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868004b20 con 0x7f6870106f10 2024-09-19T09:54:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.547+0000 7f68677fe640 1 -- 172.21.15.18:0/938219841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6868004cc0 con 0x7f6870106f10 2024-09-19T09:54:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.547+0000 7f6874851640 1 -- 172.21.15.18:0/938219841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687019d750 con 0x7f6870106f10 2024-09-19T09:54:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.547+0000 7f68677fe640 1 -- 172.21.15.18:0/938219841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868010760 con 0x7f6870106f10 2024-09-19T09:54:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.547+0000 7f6874851640 1 -- 172.21.15.18:0/938219841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68701a5030 con 0x7f6870106f10 2024-09-19T09:54:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.549+0000 7f68677fe640 1 -- 172.21.15.18:0/938219841 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6868005020 con 0x7f6870106f10 2024-09-19T09:54:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.549+0000 7f6876c2a740 1 Processor -- start 2024-09-19T09:54:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.549+0000 7f6876c2a740 1 -- start start 2024-09-19T09:54:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006060 0x56295a006440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 0x56295a010d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a013630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6876c2a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562959f6b620 con 0x56295a011240 2024-09-19T09:54:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6876c2a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562959f12e50 con 0x56295a006060 2024-09-19T09:54:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6876c2a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562959f675e0 con 0x56295a006980 2024-09-19T09:54:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6867fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a013630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6867fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a013630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59224/0 (socket says 172.21.15.18:59224) 2024-09-19T09:54:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f686e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 0x56295a010d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6867fff640 1 -- 172.21.15.18:0/1110128196 learned_addr learned my addr 172.21.15.18:0/1110128196 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6867fff640 1 -- 172.21.15.18:0/1110128196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 msgr2=0x56295a010d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6867fff640 1 --2- 172.21.15.18:0/1110128196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 0x56295a010d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6867fff640 1 -- 172.21.15.18:0/1110128196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006060 msgr2=0x56295a006440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6867fff640 1 --2- 172.21.15.18:0/1110128196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006060 0x56295a006440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6867fff640 1 -- 172.21.15.18:0/1110128196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562959f03d40 con 0x56295a011240 2024-09-19T09:54:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f68677fe640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f685c0a3240 0x7f685c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f686e59c640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f685c0a3240 0x7f685c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f68677fe640 1 -- 172.21.15.18:0/938219841 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f68680cfe80 con 0x7f6870106f10 2024-09-19T09:54:32.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.550+0000 7f6867fff640 1 --2- 172.21.15.18:0/1110128196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a013630 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6858009900 tx=0x7f6858005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3e70db13d0c5cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:32.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f6864ff9640 1 -- 172.21.15.18:0/1110128196 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858041070 con 0x56295a011240 2024-09-19T09:54:32.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f6864ff9640 1 -- 172.21.15.18:0/1110128196 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68580318f0 con 0x56295a011240 2024-09-19T09:54:32.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f6864ff9640 1 -- 172.21.15.18:0/1110128196 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858035040 con 0x56295a011240 2024-09-19T09:54:32.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f6876c2a740 1 -- 172.21.15.18:0/1110128196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 msgr2=0x56295a013630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:32.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f686e59c640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f685c0a3240 0x7f685c0a5700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x56295a003450 tx=0x7f6860005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:32.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1110128196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a013630 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6858009900 tx=0x7f6858005d50 comp rx=0 tx=0).stop 2024-09-19T09:54:32.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f6876c2a740 1 -- 172.21.15.18:0/1110128196 shutdown_connections 2024-09-19T09:54:32.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1110128196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a013630 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1110128196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 0x56295a010d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1110128196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006060 0x56295a006440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.551+0000 7f6876c2a740 1 -- 172.21.15.18:0/1110128196 >> 172.21.15.18:0/1110128196 conn(0x56295a0025f0 msgr2=0x56295a0029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 1 -- 172.21.15.18:0/1110128196 shutdown_connections 2024-09-19T09:54:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 1 -- 172.21.15.18:0/1110128196 wait complete. 2024-09-19T09:54:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 1 -- start start 2024-09-19T09:54:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 1 Processor -- start 2024-09-19T09:54:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006060 0x56295a00e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 0x56295a00e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a00ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56295a013e10 con 0x56295a011240 2024-09-19T09:54:32.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562959ef3f10 con 0x56295a006060 2024-09-19T09:54:32.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56295a013f90 con 0x56295a006980 2024-09-19T09:54:32.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f6876c2a740 10 client.0 _ll_register_callbacks cb 0x562959f17db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:32.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f686ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a00ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f686e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006060 0x56295a00e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f686ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a00ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59236/0 (socket says 172.21.15.18:59236) 2024-09-19T09:54:32.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.552+0000 7f686ed9d640 1 -- 172.21.15.18:0/1779410872 learned_addr learned my addr 172.21.15.18:0/1779410872 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:32.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f6867fff640 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 0x56295a00e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f686ed9d640 1 -- 172.21.15.18:0/1779410872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 msgr2=0x56295a00e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:32.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f686ed9d640 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 0x56295a00e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f686ed9d640 1 -- 172.21.15.18:0/1779410872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006060 msgr2=0x56295a00e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:32.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f686ed9d640 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006060 0x56295a00e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f686ed9d640 1 -- 172.21.15.18:0/1779410872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562959c7a580 con 0x56295a011240 2024-09-19T09:54:32.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f6867fff640 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 0x56295a00e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:32.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f686ed9d640 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a00ec60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f68680a4c10 tx=0x7f686809c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3ecd924b5d2b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:32.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f6855ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:32.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f6855ffb640 1 -- 172.21.15.18:0/1779410872 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68680a4eb0 con 0x56295a011240 2024-09-19T09:54:32.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f6855ffb640 1 -- 172.21.15.18:0/1779410872 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6868005310 con 0x56295a011240 2024-09-19T09:54:32.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f6876c2a740 1 -- 172.21.15.18:0/1779410872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68580318f0 con 0x56295a011240 2024-09-19T09:54:32.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f6855ffb640 1 -- 172.21.15.18:0/1779410872 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f686809c4d0 con 0x56295a011240 2024-09-19T09:54:32.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f6876c2a740 10 client.16131 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:32.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f6876c2a740 1 -- 172.21.15.18:0/1779410872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562959d44960 con 0x56295a011240 2024-09-19T09:54:32.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.553+0000 7f6855ffb640 1 -- 172.21.15.18:0/1779410872 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68580318f0 con 0x56295a011240 2024-09-19T09:54:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.554+0000 7f6855ffb640 1 -- 172.21.15.18:0/1779410872 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f68680b5320 con 0x56295a011240 2024-09-19T09:54:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.554+0000 7f6876c2a740 10 client.16131 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.554+0000 7f6876c2a740 10 client.16131 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:54:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.554+0000 7f6876c2a740 20 client.16131 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.554+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56295a020df0 0x56295a023220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.554+0000 7f6876c2a740 4 client.16131 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.554+0000 7f6876c2a740 1 -- 172.21.15.18:0/1779410872 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562959f78b90 con 0x56295a020df0 2024-09-19T09:54:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.554+0000 7f686e59c640 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56295a020df0 0x56295a023220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.554+0000 7f6855ffb640 10 client.16131 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.554+0000 7f686e59c640 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56295a020df0 0x56295a023220 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1383532757839596 server_cookie=76892c8af573c303 in_seq=0 out_seq=0 2024-09-19T09:54:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6855ffb640 1 -- 172.21.15.18:0/1779410872 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562959f78b90 con 0x56295a020df0 2024-09-19T09:54:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6855ffb640 10 client.16131 handle_command_reply: tid=0 2024-09-19T09:54:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 client.16131 shutdown 2024-09-19T09:54:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 -- 172.21.15.18:0/1779410872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 msgr2=0x56295a00ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a00ec60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f68680a4c10 tx=0x7f686809c360 comp rx=0 tx=0).stop 2024-09-19T09:54:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 -- 172.21.15.18:0/1779410872 shutdown_connections 2024-09-19T09:54:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56295a020df0 0x56295a023220 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a00ec60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006980 0x56295a00e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1779410872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006060 0x56295a00e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 -- 172.21.15.18:0/1779410872 >> 172.21.15.18:0/1779410872 conn(0x56295a0025f0 msgr2=0x56295a0082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:32.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6855ffb640 0 client.16131 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:32.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 -- 172.21.15.18:0/1779410872 shutdown_connections 2024-09-19T09:54:32.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 1 -- 172.21.15.18:0/1779410872 wait complete. 2024-09-19T09:54:32.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.555+0000 7f6876c2a740 20 client.16131 trim_cache size 0 max 16384 2024-09-19T09:54:32.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.574+0000 7f6876c2a740 1 Processor -- start 2024-09-19T09:54:32.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.574+0000 7f6876c2a740 1 -- start start 2024-09-19T09:54:32.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006060 0x56295a0094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 0x56295a001640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a028af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f6876c2a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f68701ad470 con 0x56295a011240 2024-09-19T09:54:32.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f6876c2a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f68701aefb0 con 0x56295a006980 2024-09-19T09:54:32.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f6876c2a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68701adb40 con 0x56295a006060 2024-09-19T09:54:32.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006060 0x56295a0094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a028af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006060 0x56295a0094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:53752/0 (socket says 172.21.15.18:53752) 2024-09-19T09:54:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a028af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59238/0 (socket says 172.21.15.18:59238) 2024-09-19T09:54:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686e59c640 1 -- 172.21.15.18:0/1452623491 learned_addr learned my addr 172.21.15.18:0/1452623491 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f6867fff640 1 --2- 172.21.15.18:0/1452623491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 0x56295a001640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686ed9d640 1 -- 172.21.15.18:0/1452623491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006060 msgr2=0x56295a0094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686ed9d640 1 --2- 172.21.15.18:0/1452623491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006060 0x56295a0094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686ed9d640 1 -- 172.21.15.18:0/1452623491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 msgr2=0x56295a001640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686ed9d640 1 --2- 172.21.15.18:0/1452623491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 0x56295a001640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686ed9d640 1 -- 172.21.15.18:0/1452623491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56295a010120 con 0x56295a011240 2024-09-19T09:54:32.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.575+0000 7f686e59c640 1 --2- 172.21.15.18:0/1452623491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006060 0x56295a0094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:54:32.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.576+0000 7f686ed9d640 1 --2- 172.21.15.18:0/1452623491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a028af0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f68680049d0 tx=0x7f686809a9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a169b937c27cc53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:32.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.576+0000 7f6857fff640 1 -- 172.21.15.18:0/1452623491 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686809be30 con 0x56295a011240 2024-09-19T09:54:32.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.576+0000 7f6857fff640 1 -- 172.21.15.18:0/1452623491 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68680a0880 con 0x56295a011240 2024-09-19T09:54:32.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.576+0000 7f6857fff640 1 -- 172.21.15.18:0/1452623491 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68680b5460 con 0x56295a011240 2024-09-19T09:54:32.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.577+0000 7f6876c2a740 1 -- 172.21.15.18:0/1452623491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 msgr2=0x56295a028af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:32.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.577+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1452623491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a028af0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f68680049d0 tx=0x7f686809a9e0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.577+0000 7f6876c2a740 1 -- 172.21.15.18:0/1452623491 shutdown_connections 2024-09-19T09:54:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.577+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1452623491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a011240 0x56295a028af0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.577+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1452623491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 0x56295a001640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.577+0000 7f6876c2a740 1 --2- 172.21.15.18:0/1452623491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a006060 0x56295a0094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.577+0000 7f6876c2a740 1 -- 172.21.15.18:0/1452623491 >> 172.21.15.18:0/1452623491 conn(0x56295a0025f0 msgr2=0x56295a000f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.577+0000 7f6876c2a740 1 -- 172.21.15.18:0/1452623491 shutdown_connections 2024-09-19T09:54:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.577+0000 7f6876c2a740 1 -- 172.21.15.18:0/1452623491 wait complete. 2024-09-19T09:54:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.578+0000 7f6876c2a740 1 -- start start 2024-09-19T09:54:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.578+0000 7f6876c2a740 1 Processor -- start 2024-09-19T09:54:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a006060 0x56295a0195d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 0x56295a019b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f686e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a006060 0x56295a0195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f6876c2a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a011240 0x56295a0163b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f686e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a006060 0x56295a0195d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59240/0 (socket says 172.21.15.18:59240) 2024-09-19T09:54:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f686e59c640 1 -- 172.21.15.18:0/3459701642 learned_addr learned my addr 172.21.15.18:0/3459701642 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f68701ae8e0 con 0x56295a006060 2024-09-19T09:54:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f68701ae210 con 0x56295a006980 2024-09-19T09:54:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68701ab450 con 0x56295a011240 2024-09-19T09:54:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f6876c2a740 10 client.0 _ll_register_callbacks cb 0x7f6868004e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:32.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f6867fff640 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 0x56295a019b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f686ed9d640 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a011240 0x56295a0163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.579+0000 7f686e59c640 1 -- 172.21.15.18:0/3459701642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a011240 msgr2=0x56295a0163b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:32.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f686e59c640 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a011240 0x56295a0163b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f686e59c640 1 -- 172.21.15.18:0/3459701642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 msgr2=0x56295a019b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:32.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f686e59c640 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 0x56295a019b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f686e59c640 1 -- 172.21.15.18:0/3459701642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56295a016be0 con 0x56295a006060 2024-09-19T09:54:32.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f6867fff640 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 0x56295a019b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:32.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f686ed9d640 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a011240 0x56295a0163b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:54:32.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f686e59c640 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a006060 0x56295a0195d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6860012e50 tx=0x7f68600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dc69d627e1cf21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:32.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f6855ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:32.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f6855ffb640 1 -- 172.21.15.18:0/3459701642 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860037060 con 0x56295a006060 2024-09-19T09:54:32.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f6855ffb640 1 -- 172.21.15.18:0/3459701642 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f686002ac10 con 0x56295a006060 2024-09-19T09:54:32.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68680a0880 con 0x56295a006060 2024-09-19T09:54:32.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.580+0000 7f6855ffb640 1 -- 172.21.15.18:0/3459701642 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f686001e4f0 con 0x56295a006060 2024-09-19T09:54:32.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.581+0000 7f6876c2a740 10 client.16137 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:32.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.581+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56295a08c820 con 0x56295a006060 2024-09-19T09:54:32.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.581+0000 7f6855ffb640 1 -- 172.21.15.18:0/3459701642 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68680a0880 con 0x56295a006060 2024-09-19T09:54:32.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.581+0000 7f6855ffb640 1 -- 172.21.15.18:0/3459701642 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6860032880 con 0x56295a006060 2024-09-19T09:54:32.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.581+0000 7f6876c2a740 10 client.16137 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:32.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.581+0000 7f6876c2a740 10 client.16137 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:54:32.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.581+0000 7f6876c2a740 20 client.16137 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:32.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.581+0000 7f6876c2a740 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56295a08cf50 0x56295a08f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:32.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.581+0000 7f6876c2a740 4 client.16137 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9655fe98", "release": true, "await": true}] 2024-09-19T09:54:32.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.581+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9655fe98", "release": true, "await": true}) -- 0x562959f730a0 con 0x56295a08cf50 2024-09-19T09:54:32.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.582+0000 7f6867fff640 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56295a08cf50 0x56295a08f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:32.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.582+0000 7f6855ffb640 10 client.16137 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:32.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.582+0000 7f6867fff640 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56295a08cf50 0x56295a08f370 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3c06d63ed9c907a server_cookie=66ed4f88304d4722 in_seq=0 out_seq=0 2024-09-19T09:54:32.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.587+0000 7f6855ffb640 1 -- 172.21.15.18:0/3459701642 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562959f730a0 con 0x56295a08cf50 2024-09-19T09:54:32.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.587+0000 7f6855ffb640 10 client.16137 handle_command_reply: tid=0 2024-09-19T09:54:32.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.587+0000 7f6876c2a740 1 client.16137 shutdown 2024-09-19T09:54:32.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.587+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a006060 msgr2=0x56295a0195d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:32.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.587+0000 7f6876c2a740 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a006060 0x56295a0195d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6860012e50 tx=0x7f68600046c0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.588+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 shutdown_connections 2024-09-19T09:54:32.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.588+0000 7f6876c2a740 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56295a08cf50 0x56295a08f370 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.588+0000 7f6876c2a740 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56295a011240 0x56295a0163b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.588+0000 7f6876c2a740 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56295a006980 0x56295a019b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.588+0000 7f6876c2a740 1 --2- 172.21.15.18:0/3459701642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56295a006060 0x56295a0195d0 secure :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6860012e50 tx=0x7f68600046c0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.588+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 >> 172.21.15.18:0/3459701642 conn(0x56295a0025f0 msgr2=0x56295a0082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:32.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.589+0000 7f6855ffb640 0 client.16137 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:32.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.589+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 shutdown_connections 2024-09-19T09:54:32.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.590+0000 7f6876c2a740 1 -- 172.21.15.18:0/3459701642 wait complete. 2024-09-19T09:54:32.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.590+0000 7f6876c2a740 20 client.16137 trim_cache size 0 max 16384 2024-09-19T09:54:32.596 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:54:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:54:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:54:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 12, 2024-09-19T09:54:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:54:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "9655fe98": { 2024-09-19T09:54:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 12, 2024-09-19T09:54:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:54:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:54:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:54:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:54:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:54:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:54:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 140.3, 2024-09-19T09:54:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:54:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:54:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:54:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:54:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:54:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:54:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:54:32.599 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:54:32.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.592+0000 7f6874851640 1 -- 172.21.15.18:0/938219841 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f685c0a3240 msgr2=0x7f685c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.592+0000 7f6874851640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f685c0a3240 0x7f685c0a5700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x56295a003450 tx=0x7f6860005f90 comp rx=0 tx=0).stop 2024-09-19T09:54:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.592+0000 7f6874851640 1 -- 172.21.15.18:0/938219841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6870106f10 msgr2=0x7f687019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.592+0000 7f6874851640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6870106f10 0x7f687019cd80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f686800eb10 tx=0x7f686800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.592+0000 7f6874851640 1 -- 172.21.15.18:0/938219841 shutdown_connections 2024-09-19T09:54:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.592+0000 7f6874851640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f685c0a3240 0x7f685c0a5700 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.593+0000 7f6874851640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6870106f10 0x7f687019cd80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.593+0000 7f6874851640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6870102790 0x7f68701989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.593+0000 7f6874851640 1 --2- 172.21.15.18:0/938219841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6870101de0 0x7f68701984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.593+0000 7f6874851640 1 -- 172.21.15.18:0/938219841 >> 172.21.15.18:0/938219841 conn(0x7f68700fd8c0 msgr2=0x7f68700fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:32.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.598+0000 7f6874851640 1 -- 172.21.15.18:0/938219841 shutdown_connections 2024-09-19T09:54:32.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:32.598+0000 7f6874851640 1 -- 172.21.15.18:0/938219841 wait complete. 2024-09-19T09:54:32.649 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:34.124 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9655fe98', total seconds elapsed: 24.4 2024-09-19T09:54:34.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:34 smithi018 ceph-mon[30956]: pgmap v405: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 61 MiB/s wr, 35 op/s 2024-09-19T09:54:34.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.502+0000 7fa40e85f640 1 -- 172.21.15.18:0/1345454999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4000a4d30 msgr2=0x7fa4000a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:34.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.502+0000 7fa40e85f640 1 --2- 172.21.15.18:0/1345454999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4000a4d30 0x7fa4000a51e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa408067960 tx=0x7fa40808e340 comp rx=0 tx=0).stop 2024-09-19T09:54:34.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.502+0000 7fa40e85f640 1 -- 172.21.15.18:0/1345454999 shutdown_connections 2024-09-19T09:54:34.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.502+0000 7fa40e85f640 1 --2- 172.21.15.18:0/1345454999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4000a4d30 0x7fa4000a51e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.502+0000 7fa40e85f640 1 --2- 172.21.15.18:0/1345454999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4000aab50 0x7fa4000a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.502+0000 7fa40e85f640 1 --2- 172.21.15.18:0/1345454999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4000aa230 0x7fa4000aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.502+0000 7fa40e85f640 1 -- 172.21.15.18:0/1345454999 >> 172.21.15.18:0/1345454999 conn(0x7fa40001a0a0 msgr2=0x7fa40001a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.503+0000 7fa40e85f640 1 -- 172.21.15.18:0/1345454999 shutdown_connections 2024-09-19T09:54:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.503+0000 7fa40e85f640 1 -- 172.21.15.18:0/1345454999 wait complete. 2024-09-19T09:54:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.504+0000 7fa40e85f640 1 Processor -- start 2024-09-19T09:54:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.504+0000 7fa40e85f640 1 -- start start 2024-09-19T09:54:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.505+0000 7fa40e85f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4000a4d30 0x7fa4000ba790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.505+0000 7fa40e85f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4000aa230 0x7fa4000b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.505+0000 7fa40e85f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4000aab50 0x7fa4000b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.505+0000 7fa40e85f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa4000ad1c0 con 0x7fa4000a4d30 2024-09-19T09:54:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.505+0000 7fa40e85f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa4000ad040 con 0x7fa4000aab50 2024-09-19T09:54:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.505+0000 7fa40e85f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4000ad340 con 0x7fa4000aa230 2024-09-19T09:54:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.505+0000 7fa40d85d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4000a4d30 0x7fa4000ba790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.506+0000 7fa40d85d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4000a4d30 0x7fa4000ba790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59252/0 (socket says 172.21.15.18:59252) 2024-09-19T09:54:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.506+0000 7fa40d85d640 1 -- 172.21.15.18:0/944546209 learned_addr learned my addr 172.21.15.18:0/944546209 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.507+0000 7fa40d85d640 1 -- 172.21.15.18:0/944546209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4000aa230 msgr2=0x7fa4000b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.507+0000 7fa40d85d640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4000aa230 0x7fa4000b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.507+0000 7fa40e05e640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4000aab50 0x7fa4000b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.507+0000 7fa40d85d640 1 -- 172.21.15.18:0/944546209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4000aab50 msgr2=0x7fa4000b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.507+0000 7fa40d85d640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4000aab50 0x7fa4000b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.507+0000 7fa40d85d640 1 -- 172.21.15.18:0/944546209 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4000b54b0 con 0x7fa4000a4d30 2024-09-19T09:54:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.508+0000 7fa40d85d640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4000a4d30 0x7fa4000ba790 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c890 tx=0x7fa40400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.514+0000 7fa3feffd640 1 -- 172.21.15.18:0/944546209 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404004220 con 0x7fa4000a4d30 2024-09-19T09:54:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.514+0000 7fa40e85f640 1 -- 172.21.15.18:0/944546209 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa400158240 con 0x7fa4000a4d30 2024-09-19T09:54:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.515+0000 7fa40e85f640 1 -- 172.21.15.18:0/944546209 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa400158720 con 0x7fa4000a4d30 2024-09-19T09:54:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.515+0000 7fa3feffd640 1 -- 172.21.15.18:0/944546209 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4040043c0 con 0x7fa4000a4d30 2024-09-19T09:54:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.515+0000 7fa3feffd640 1 -- 172.21.15.18:0/944546209 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4040049e0 con 0x7fa4000a4d30 2024-09-19T09:54:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.525+0000 7fa411e9a740 1 Processor -- start 2024-09-19T09:54:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.526+0000 7fa411e9a740 1 -- start start 2024-09-19T09:54:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.528+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee1ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.530+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee29310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.530+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee29850 0x55cb3ee2bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.530+0000 7fa411e9a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cb3ed842e0 con 0x55cb3ee29850 2024-09-19T09:54:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.530+0000 7fa411e9a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cb3ed2bce0 con 0x55cb3ee1e670 2024-09-19T09:54:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.530+0000 7fa411e9a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cb3ed802a0 con 0x55cb3ee1ef90 2024-09-19T09:54:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.533+0000 7fa40e05e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee1ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.534+0000 7fa3feffd640 1 -- 172.21.15.18:0/944546209 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa4040079b0 con 0x7fa4000a4d30 2024-09-19T09:54:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.535+0000 7fa40e05e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee1ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:42348/0 (socket says 172.21.15.18:42348) 2024-09-19T09:54:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.535+0000 7fa40e05e640 1 -- 172.21.15.18:0/3202198411 learned_addr learned my addr 172.21.15.18:0/3202198411 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.535+0000 7fa3feffd640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3f40a3450 0x7fa3f40a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.536+0000 7fa40d85d640 1 --2- 172.21.15.18:0/3202198411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee29310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.536+0000 7fa3feffd640 1 -- 172.21.15.18:0/944546209 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa4040cf5e0 con 0x7fa4000a4d30 2024-09-19T09:54:34.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.537+0000 7fa40d05c640 1 --2- 172.21.15.18:0/3202198411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee29850 0x55cb3ee2bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.537+0000 7fa40e05e640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3f40a3450 0x7fa3f40a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.538+0000 7fa40d05c640 1 -- 172.21.15.18:0/3202198411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ef90 msgr2=0x55cb3ee29310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:34.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.538+0000 7fa40d05c640 1 --2- 172.21.15.18:0/3202198411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee29310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.539+0000 7fa40d05c640 1 -- 172.21.15.18:0/3202198411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 msgr2=0x55cb3ee1ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:34.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.539+0000 7fa40d05c640 1 --2- 172.21.15.18:0/3202198411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee1ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.539+0000 7fa40d05c640 1 -- 172.21.15.18:0/3202198411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3ed10440 con 0x55cb3ee29850 2024-09-19T09:54:34.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.539+0000 7fa40d05c640 1 --2- 172.21.15.18:0/3202198411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee29850 0x55cb3ee2bc40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa4000b5fd0 tx=0x7fa3f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a1ec497aba51da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:34.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.540+0000 7fa40e05e640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3f40a3450 0x7fa3f40a5910 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa408000b60 tx=0x7fa408050800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.542+0000 7fa3f3fff640 1 -- 172.21.15.18:0/3202198411 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8016070 con 0x55cb3ee29850 2024-09-19T09:54:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.542+0000 7fa3f3fff640 1 -- 172.21.15.18:0/3202198411 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f800de30 con 0x55cb3ee29850 2024-09-19T09:54:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.543+0000 7fa3f3fff640 1 -- 172.21.15.18:0/3202198411 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f80047a0 con 0x55cb3ee29850 2024-09-19T09:54:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.543+0000 7fa411e9a740 1 -- 172.21.15.18:0/3202198411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee29850 msgr2=0x55cb3ee2bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.543+0000 7fa411e9a740 1 --2- 172.21.15.18:0/3202198411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee29850 0x55cb3ee2bc40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa4000b5fd0 tx=0x7fa3f800be30 comp rx=0 tx=0).stop 2024-09-19T09:54:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.544+0000 7fa411e9a740 1 -- 172.21.15.18:0/3202198411 shutdown_connections 2024-09-19T09:54:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.544+0000 7fa411e9a740 1 --2- 172.21.15.18:0/3202198411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee29850 0x55cb3ee2bc40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.544+0000 7fa411e9a740 1 --2- 172.21.15.18:0/3202198411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee29310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.544+0000 7fa411e9a740 1 --2- 172.21.15.18:0/3202198411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee1ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.544+0000 7fa411e9a740 1 -- 172.21.15.18:0/3202198411 >> 172.21.15.18:0/3202198411 conn(0x55cb3ee1ac00 msgr2=0x55cb3ee1afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.544+0000 7fa411e9a740 1 -- 172.21.15.18:0/3202198411 shutdown_connections 2024-09-19T09:54:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.544+0000 7fa411e9a740 1 -- 172.21.15.18:0/3202198411 wait complete. 2024-09-19T09:54:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.544+0000 7fa411e9a740 1 -- start start 2024-09-19T09:54:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.545+0000 7fa411e9a740 1 Processor -- start 2024-09-19T09:54:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.545+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee29130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.545+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.545+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee29850 0x55cb3ee26920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.545+0000 7fa411e9a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cb3ee2c470 con 0x55cb3ee1ef90 2024-09-19T09:54:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.545+0000 7fa411e9a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cb3ed3f050 con 0x55cb3ee1e670 2024-09-19T09:54:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.545+0000 7fa411e9a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cb3ee2c5f0 con 0x55cb3ee29850 2024-09-19T09:54:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.546+0000 7fa411e9a740 10 client.0 _ll_register_callbacks cb 0x55cb3ed7f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.546+0000 7fa40d05c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.546+0000 7fa40d05c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee263e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59268/0 (socket says 172.21.15.18:59268) 2024-09-19T09:54:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.546+0000 7fa40d05c640 1 -- 172.21.15.18:0/3789062863 learned_addr learned my addr 172.21.15.18:0/3789062863 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.547+0000 7fa40d05c640 1 -- 172.21.15.18:0/3789062863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee29850 msgr2=0x55cb3ee26920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.547+0000 7fa40d05c640 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee29850 0x55cb3ee26920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.547+0000 7fa40d05c640 1 -- 172.21.15.18:0/3789062863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 msgr2=0x55cb3ee29130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.547+0000 7fa40d05c640 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee29130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.547+0000 7fa40d05c640 1 -- 172.21.15.18:0/3789062863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb3eaf53c0 con 0x55cb3ee1ef90 2024-09-19T09:54:34.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.547+0000 7fa40d05c640 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee263e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80057b0 tx=0x7fa3f800b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f3c650b4f38422 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:34.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.547+0000 7fa3f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:34.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.547+0000 7fa3f17fa640 1 -- 172.21.15.18:0/3789062863 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8016070 con 0x55cb3ee1ef90 2024-09-19T09:54:34.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.547+0000 7fa3f17fa640 1 -- 172.21.15.18:0/3789062863 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa3f800db50 con 0x55cb3ee1ef90 2024-09-19T09:54:34.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.547+0000 7fa411e9a740 1 -- 172.21.15.18:0/3789062863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f800de30 con 0x55cb3ee1ef90 2024-09-19T09:54:34.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.548+0000 7fa3f17fa640 1 -- 172.21.15.18:0/3789062863 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa3f80047a0 con 0x55cb3ee1ef90 2024-09-19T09:54:34.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.548+0000 7fa411e9a740 10 client.16149 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.548+0000 7fa411e9a740 1 -- 172.21.15.18:0/3789062863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb3ee37e70 con 0x55cb3ee1ef90 2024-09-19T09:54:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.549+0000 7fa3f17fa640 1 -- 172.21.15.18:0/3789062863 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f800de30 con 0x55cb3ee1ef90 2024-09-19T09:54:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.549+0000 7fa3f17fa640 1 -- 172.21.15.18:0/3789062863 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa3f8010ba0 con 0x55cb3ee1ef90 2024-09-19T09:54:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.549+0000 7fa411e9a740 10 client.16149 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.549+0000 7fa411e9a740 10 client.16149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.549+0000 7fa411e9a740 20 client.16149 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.549+0000 7fa411e9a740 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb3ee39220 0x55cb3ee3b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.549+0000 7fa411e9a740 4 client.16149 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.549+0000 7fa411e9a740 1 -- 172.21.15.18:0/3789062863 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb3ed91850 con 0x55cb3ee39220 2024-09-19T09:54:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.552+0000 7fa40d85d640 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb3ee39220 0x55cb3ee3b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.559+0000 7fa3f17fa640 10 client.16149 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:34.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.559+0000 7fa40d85d640 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb3ee39220 0x55cb3ee3b610 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64c68159b593dffc server_cookie=8a60a84f7613aef7 in_seq=0 out_seq=0 2024-09-19T09:54:34.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.562+0000 7fa3f17fa640 1 -- 172.21.15.18:0/3789062863 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb3ed91850 con 0x55cb3ee39220 2024-09-19T09:54:34.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.562+0000 7fa3f17fa640 10 client.16149 handle_command_reply: tid=0 2024-09-19T09:54:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.563+0000 7fa411e9a740 1 client.16149 shutdown 2024-09-19T09:54:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.563+0000 7fa411e9a740 1 -- 172.21.15.18:0/3789062863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 msgr2=0x55cb3ee263e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.563+0000 7fa411e9a740 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee263e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80057b0 tx=0x7fa3f800b5c0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.563+0000 7fa411e9a740 1 -- 172.21.15.18:0/3789062863 shutdown_connections 2024-09-19T09:54:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.563+0000 7fa411e9a740 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb3ee39220 0x55cb3ee3b610 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.563+0000 7fa411e9a740 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee29850 0x55cb3ee26920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.563+0000 7fa411e9a740 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee263e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.563+0000 7fa411e9a740 1 --2- 172.21.15.18:0/3789062863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee29130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.563+0000 7fa411e9a740 1 -- 172.21.15.18:0/3789062863 >> 172.21.15.18:0/3789062863 conn(0x55cb3ee1ac00 msgr2=0x55cb3ee208e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.563+0000 7fa3f17fa640 0 client.16149 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.564+0000 7fa411e9a740 1 -- 172.21.15.18:0/3789062863 shutdown_connections 2024-09-19T09:54:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.564+0000 7fa411e9a740 1 -- 172.21.15.18:0/3789062863 wait complete. 2024-09-19T09:54:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.564+0000 7fa411e9a740 20 client.16149 trim_cache size 0 max 16384 2024-09-19T09:54:34.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.590+0000 7fa411e9a740 1 Processor -- start 2024-09-19T09:54:34.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.590+0000 7fa411e9a740 1 -- start start 2024-09-19T09:54:34.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.591+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1ac00 0x55cb3ee35760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.591+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1e670 0x55cb3ee40d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.591+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee41270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.591+0000 7fa411e9a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec00e3d0 con 0x55cb3ee1e670 2024-09-19T09:54:34.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.591+0000 7fa411e9a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec00ff10 con 0x55cb3ee1ac00 2024-09-19T09:54:34.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.591+0000 7fa411e9a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec00eaa0 con 0x55cb3ee1ef90 2024-09-19T09:54:34.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.591+0000 7fa40d05c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1e670 0x55cb3ee40d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.591+0000 7fa40d05c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1e670 0x55cb3ee40d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59284/0 (socket says 172.21.15.18:59284) 2024-09-19T09:54:34.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.591+0000 7fa40d05c640 1 -- 172.21.15.18:0/369762231 learned_addr learned my addr 172.21.15.18:0/369762231 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.592+0000 7fa40d05c640 1 -- 172.21.15.18:0/369762231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ef90 msgr2=0x55cb3ee41270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.592+0000 7fa40d05c640 1 --2- 172.21.15.18:0/369762231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee41270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.592+0000 7fa40d05c640 1 -- 172.21.15.18:0/369762231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1ac00 msgr2=0x55cb3ee35760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.592+0000 7fa40d05c640 1 --2- 172.21.15.18:0/369762231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1ac00 0x55cb3ee35760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.592+0000 7fa40d05c640 1 -- 172.21.15.18:0/369762231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3ee1aa30 con 0x55cb3ee1e670 2024-09-19T09:54:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.592+0000 7fa40d05c640 1 --2- 172.21.15.18:0/369762231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1e670 0x55cb3ee40d30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8005f70 tx=0x7fa3f8005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb92435a90cde46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.593+0000 7fa3f37fe640 1 -- 172.21.15.18:0/369762231 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8033020 con 0x55cb3ee1e670 2024-09-19T09:54:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.593+0000 7fa3f37fe640 1 -- 172.21.15.18:0/369762231 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f801f030 con 0x55cb3ee1e670 2024-09-19T09:54:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.593+0000 7fa3f37fe640 1 -- 172.21.15.18:0/369762231 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8016070 con 0x55cb3ee1e670 2024-09-19T09:54:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.594+0000 7fa411e9a740 1 -- 172.21.15.18:0/369762231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1e670 msgr2=0x55cb3ee40d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.594+0000 7fa411e9a740 1 --2- 172.21.15.18:0/369762231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1e670 0x55cb3ee40d30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8005f70 tx=0x7fa3f8005910 comp rx=0 tx=0).stop 2024-09-19T09:54:34.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.594+0000 7fa411e9a740 1 -- 172.21.15.18:0/369762231 shutdown_connections 2024-09-19T09:54:34.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.594+0000 7fa411e9a740 1 --2- 172.21.15.18:0/369762231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee41270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.594+0000 7fa411e9a740 1 --2- 172.21.15.18:0/369762231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1e670 0x55cb3ee40d30 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.594+0000 7fa411e9a740 1 --2- 172.21.15.18:0/369762231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1ac00 0x55cb3ee35760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.594+0000 7fa411e9a740 1 -- 172.21.15.18:0/369762231 >> 172.21.15.18:0/369762231 conn(0x55cb3ee26a80 msgr2=0x55cb3ee24cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.594+0000 7fa411e9a740 1 -- 172.21.15.18:0/369762231 shutdown_connections 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.594+0000 7fa411e9a740 1 -- 172.21.15.18:0/369762231 wait complete. 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.595+0000 7fa411e9a740 1 -- start start 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.595+0000 7fa411e9a740 1 Processor -- start 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.596+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ac00 0x55cb3ee2d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.596+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee2dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.596+0000 7fa411e9a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee2e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.596+0000 7fa411e9a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec00f840 con 0x55cb3ee1ef90 2024-09-19T09:54:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.596+0000 7fa411e9a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec00f170 con 0x55cb3ee1e670 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.596+0000 7fa411e9a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec00c3b0 con 0x55cb3ee1ac00 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.596+0000 7fa411e9a740 10 client.0 _ll_register_callbacks cb 0x7fa408050f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.596+0000 7fa40e05e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee2e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.596+0000 7fa40e05e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee2e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59288/0 (socket says 172.21.15.18:59288) 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.596+0000 7fa40e05e640 1 -- 172.21.15.18:0/1667441856 learned_addr learned my addr 172.21.15.18:0/1667441856 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.597+0000 7fa40d05c640 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee2dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.597+0000 7fa40e05e640 1 -- 172.21.15.18:0/1667441856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ac00 msgr2=0x55cb3ee2d740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.597+0000 7fa40e05e640 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ac00 0x55cb3ee2d740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.597+0000 7fa40e05e640 1 -- 172.21.15.18:0/1667441856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 msgr2=0x55cb3ee2dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.597+0000 7fa40e05e640 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee2dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.597+0000 7fa40e05e640 1 -- 172.21.15.18:0/1667441856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb3eea2e60 con 0x55cb3ee1ef90 2024-09-19T09:54:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.597+0000 7fa40e05e640 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee2e1c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa408051500 tx=0x7fa408068410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f9e293d1310520 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.597+0000 7fa3f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.598+0000 7fa3f17fa640 1 -- 172.21.15.18:0/1667441856 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40809f050 con 0x55cb3ee1ef90 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.598+0000 7fa411e9a740 1 -- 172.21.15.18:0/1667441856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f801f030 con 0x55cb3ee1ef90 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.598+0000 7fa3f17fa640 1 -- 172.21.15.18:0/1667441856 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa408063030 con 0x55cb3ee1ef90 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.598+0000 7fa3f17fa640 1 -- 172.21.15.18:0/1667441856 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4080b4050 con 0x55cb3ee1ef90 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.598+0000 7fa411e9a740 10 client.16155 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.598+0000 7fa411e9a740 1 -- 172.21.15.18:0/1667441856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb3eea40f0 con 0x55cb3ee1ef90 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.599+0000 7fa3f17fa640 1 -- 172.21.15.18:0/1667441856 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f801f030 con 0x55cb3ee1ef90 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.599+0000 7fa3f17fa640 1 -- 172.21.15.18:0/1667441856 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4080627d0 con 0x55cb3ee1ef90 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.599+0000 7fa411e9a740 10 client.16155 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.599+0000 7fa411e9a740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.599+0000 7fa411e9a740 20 client.16155 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.599+0000 7fa411e9a740 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb3ee29850 0x55cb3eea68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.599+0000 7fa411e9a740 4 client.16155 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:54:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.599+0000 7fa411e9a740 1 -- 172.21.15.18:0/1667441856 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cb3ed8bd60 con 0x55cb3ee29850 2024-09-19T09:54:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.602+0000 7fa40d85d640 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb3ee29850 0x55cb3eea68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.604+0000 7fa40d85d640 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb3ee29850 0x55cb3eea68e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1016f3e365703c6b server_cookie=98ea81a2342208df in_seq=0 out_seq=0 2024-09-19T09:54:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.604+0000 7fa3f17fa640 10 client.16155 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa3f17fa640 1 -- 172.21.15.18:0/1667441856 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cb3ed8bd60 con 0x55cb3ee29850 2024-09-19T09:54:34.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa3f17fa640 10 client.16155 handle_command_reply: tid=0 2024-09-19T09:54:34.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 client.16155 shutdown 2024-09-19T09:54:34.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 -- 172.21.15.18:0/1667441856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 msgr2=0x55cb3ee2e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:34.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee2e1c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa408051500 tx=0x7fa408068410 comp rx=0 tx=0).stop 2024-09-19T09:54:34.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 -- 172.21.15.18:0/1667441856 shutdown_connections 2024-09-19T09:54:34.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb3ee29850 0x55cb3eea68e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb3ee1ef90 0x55cb3ee2e1c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa3f17fa640 0 client.16155 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:34.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb3ee1e670 0x55cb3ee2dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 --2- 172.21.15.18:0/1667441856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb3ee1ac00 0x55cb3ee2d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 -- 172.21.15.18:0/1667441856 >> 172.21.15.18:0/1667441856 conn(0x55cb3ee26a80 msgr2=0x55cb3ee200c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:34.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 -- 172.21.15.18:0/1667441856 shutdown_connections 2024-09-19T09:54:34.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 1 -- 172.21.15.18:0/1667441856 wait complete. 2024-09-19T09:54:34.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.607+0000 7fa411e9a740 20 client.16155 trim_cache size 0 max 16384 2024-09-19T09:54:34.614 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:54:34.614 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T09:54:34.614 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T09:54:34.614 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:54:34.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 -- 172.21.15.18:0/944546209 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3f40a3450 msgr2=0x7fa3f40a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:34.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3f40a3450 0x7fa3f40a5910 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa408000b60 tx=0x7fa408050800 comp rx=0 tx=0).stop 2024-09-19T09:54:34.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 -- 172.21.15.18:0/944546209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4000a4d30 msgr2=0x7fa4000ba790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:34.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4000a4d30 0x7fa4000ba790 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c890 tx=0x7fa40400cd50 comp rx=0 tx=0).stop 2024-09-19T09:54:34.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 -- 172.21.15.18:0/944546209 shutdown_connections 2024-09-19T09:54:34.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3f40a3450 0x7fa3f40a5910 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4000aab50 0x7fa4000b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4000aa230 0x7fa4000b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 --2- 172.21.15.18:0/944546209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4000a4d30 0x7fa4000ba790 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:34.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 -- 172.21.15.18:0/944546209 >> 172.21.15.18:0/944546209 conn(0x7fa40001a0a0 msgr2=0x7fa4000a69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:34.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 -- 172.21.15.18:0/944546209 shutdown_connections 2024-09-19T09:54:34.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:34.608+0000 7fa40e85f640 1 -- 172.21.15.18:0/944546209 wait complete. 2024-09-19T09:54:34.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:34 smithi049 ceph-mon[34858]: pgmap v405: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 61 MiB/s wr, 35 op/s 2024-09-19T09:54:34.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:34 smithi162 ceph-mon[35174]: pgmap v405: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 61 MiB/s wr, 35 op/s 2024-09-19T09:54:36.043 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:54:36.043 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:54:36.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:36 smithi018 ceph-mon[30956]: pgmap v406: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 99 MiB/s wr, 38 op/s 2024-09-19T09:54:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:36 smithi049 ceph-mon[34858]: pgmap v406: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 99 MiB/s wr, 38 op/s 2024-09-19T09:54:36.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:36 smithi162 ceph-mon[35174]: pgmap v406: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 99 MiB/s wr, 38 op/s 2024-09-19T09:54:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:38.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.112+0000 7efebd318640 1 -- 172.21.15.18:0/143138591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb81027c0 msgr2=0x7efeb8106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.112+0000 7efebd318640 1 --2- 172.21.15.18:0/143138591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb81027c0 0x7efeb8106810 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7efea0009ca0 tx=0x7efea002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:54:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.113+0000 7efebd318640 1 -- 172.21.15.18:0/143138591 shutdown_connections 2024-09-19T09:54:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.113+0000 7efebd318640 1 --2- 172.21.15.18:0/143138591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb8106f40 0x7efeb810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.113+0000 7efebd318640 1 --2- 172.21.15.18:0/143138591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb81027c0 0x7efeb8106810 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.113+0000 7efebd318640 1 --2- 172.21.15.18:0/143138591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb8101e10 0x7efeb81021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.113+0000 7efebd318640 1 -- 172.21.15.18:0/143138591 >> 172.21.15.18:0/143138591 conn(0x7efeb80fd8d0 msgr2=0x7efeb80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.113+0000 7efebd318640 1 -- 172.21.15.18:0/143138591 shutdown_connections 2024-09-19T09:54:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.113+0000 7efebd318640 1 -- 172.21.15.18:0/143138591 wait complete. 2024-09-19T09:54:38.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.115+0000 7efebd318640 1 Processor -- start 2024-09-19T09:54:38.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.116+0000 7efebd318640 1 -- start start 2024-09-19T09:54:38.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.116+0000 7efebd318640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb8101e10 0x7efeb81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:38.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.116+0000 7efebd318640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb81027c0 0x7efeb8196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.117+0000 7efebd318640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb8106f40 0x7efeb819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.117+0000 7efebd318640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efeb810fe00 con 0x7efeb8106f40 2024-09-19T09:54:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.117+0000 7efebd318640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efeb810fc80 con 0x7efeb81027c0 2024-09-19T09:54:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.117+0000 7efebd318640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efeb810ff80 con 0x7efeb8101e10 2024-09-19T09:54:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.117+0000 7efeb77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb8106f40 0x7efeb819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.117+0000 7efeb77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb8106f40 0x7efeb819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55306/0 (socket says 172.21.15.18:55306) 2024-09-19T09:54:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.117+0000 7efeb77fe640 1 -- 172.21.15.18:0/1797483011 learned_addr learned my addr 172.21.15.18:0/1797483011 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.118+0000 7efeb77fe640 1 -- 172.21.15.18:0/1797483011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb8101e10 msgr2=0x7efeb81962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.118+0000 7efeb77fe640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb8101e10 0x7efeb81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.118+0000 7efeb77fe640 1 -- 172.21.15.18:0/1797483011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb81027c0 msgr2=0x7efeb8196820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:54:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.118+0000 7efeb77fe640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb81027c0 0x7efeb8196820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.118+0000 7efeb77fe640 1 -- 172.21.15.18:0/1797483011 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb819b290 con 0x7efeb8106f40 2024-09-19T09:54:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.119+0000 7efeb77fe640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb8106f40 0x7efeb819abb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efeb000d950 tx=0x7efeb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.119+0000 7efeb4ff9640 1 -- 172.21.15.18:0/1797483011 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0017030 con 0x7efeb8106f40 2024-09-19T09:54:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.119+0000 7efebd318640 1 -- 172.21.15.18:0/1797483011 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb819b580 con 0x7efeb8106f40 2024-09-19T09:54:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.119+0000 7efeb4ff9640 1 -- 172.21.15.18:0/1797483011 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeb0004020 con 0x7efeb8106f40 2024-09-19T09:54:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.120+0000 7efeb4ff9640 1 -- 172.21.15.18:0/1797483011 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0003c00 con 0x7efeb8106f40 2024-09-19T09:54:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.120+0000 7efebd318640 1 -- 172.21.15.18:0/1797483011 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81a2e60 con 0x7efeb8106f40 2024-09-19T09:54:38.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.122+0000 7efebd318640 1 -- 172.21.15.18:0/1797483011 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb81021f0 con 0x7efeb8106f40 2024-09-19T09:54:38.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.124+0000 7efeb4ff9640 1 -- 172.21.15.18:0/1797483011 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efeb001a070 con 0x7efeb8106f40 2024-09-19T09:54:38.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.125+0000 7efeb4ff9640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe980a7710 0x7efe980a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:38.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.125+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe980a7710 0x7efe980a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:38.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.125+0000 7efeb4ff9640 1 -- 172.21.15.18:0/1797483011 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efeb00cedf0 con 0x7efeb8106f40 2024-09-19T09:54:38.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.126+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe980a7710 0x7efe980a9bd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efea8009710 tx=0x7efea8006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.131+0000 7efeb4ff9640 1 -- 172.21.15.18:0/1797483011 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efeb0021020 con 0x7efeb8106f40 2024-09-19T09:54:38.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:38 smithi018 ceph-mon[30956]: pgmap v407: 97 pgs: 97 active+clean; 7.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 211 MiB/s wr, 103 op/s 2024-09-19T09:54:38.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:38 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:54:38.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:38 smithi049 ceph-mon[34858]: pgmap v407: 97 pgs: 97 active+clean; 7.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 211 MiB/s wr, 103 op/s 2024-09-19T09:54:38.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:38 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:54:38.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:38 smithi162 ceph-mon[35174]: pgmap v407: 97 pgs: 97 active+clean; 7.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 211 MiB/s wr, 103 op/s 2024-09-19T09:54:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:38 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:54:38.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.787+0000 7efebd318640 1 -- 172.21.15.18:0/1797483011 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efeb810a180 con 0x7efeb8106f40 2024-09-19T09:54:38.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.795+0000 7efeb4ff9640 1 -- 172.21.15.18:0/1797483011 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7efeb009bb40 con 0x7efeb8106f40 2024-09-19T09:54:38.802 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:54:38.802 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:54:38.802 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:54:38.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.812+0000 7efebd318640 1 -- 172.21.15.18:0/1797483011 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe980a7710 msgr2=0x7efe980a9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:38.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.812+0000 7efebd318640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe980a7710 0x7efe980a9bd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efea8009710 tx=0x7efea8006c90 comp rx=0 tx=0).stop 2024-09-19T09:54:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.812+0000 7efebd318640 1 -- 172.21.15.18:0/1797483011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb8106f40 msgr2=0x7efeb819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.812+0000 7efebd318640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb8106f40 0x7efeb819abb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efeb000d950 tx=0x7efeb000de10 comp rx=0 tx=0).stop 2024-09-19T09:54:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.813+0000 7efebd318640 1 -- 172.21.15.18:0/1797483011 shutdown_connections 2024-09-19T09:54:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.813+0000 7efebd318640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe980a7710 0x7efe980a9bd0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.813+0000 7efebd318640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb8106f40 0x7efeb819abb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.813+0000 7efebd318640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efeb81027c0 0x7efeb8196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.813+0000 7efebd318640 1 --2- 172.21.15.18:0/1797483011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb8101e10 0x7efeb81962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.813+0000 7efebd318640 1 -- 172.21.15.18:0/1797483011 >> 172.21.15.18:0/1797483011 conn(0x7efeb80fd8d0 msgr2=0x7efeb80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.814+0000 7efebd318640 1 -- 172.21.15.18:0/1797483011 shutdown_connections 2024-09-19T09:54:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:38.814+0000 7efebd318640 1 -- 172.21.15.18:0/1797483011 wait complete. 2024-09-19T09:54:39.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:39 smithi018 ceph-mon[30956]: pgmap v408: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 282 MiB/s wr, 196 op/s 2024-09-19T09:54:39.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:39 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:39 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1797483011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:39.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:39 smithi049 ceph-mon[34858]: pgmap v408: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 282 MiB/s wr, 196 op/s 2024-09-19T09:54:39.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:39 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:39 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1797483011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:39.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:39 smithi162 ceph-mon[35174]: pgmap v408: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 282 MiB/s wr, 196 op/s 2024-09-19T09:54:39.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:39 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:39.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:39 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1797483011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:54:40.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:54:40.641 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:54:40.641 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:54:40.641 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:40.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:40 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:54:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:40 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:54:40.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:40 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:40.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:40 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:54:40.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:40 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:54:40.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:40 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:54:41.185 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:41.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.922+0000 7fb5067cc640 1 -- 172.21.15.18:0/4176011569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5000745e0 msgr2=0x7fb5000749c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:41.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.922+0000 7fb5067cc640 1 --2- 172.21.15.18:0/4176011569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5000745e0 0x7fb5000749c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009ca0 tx=0x7fb4f002a980 comp rx=0 tx=0).stop 2024-09-19T09:54:41.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.922+0000 7fb5067cc640 1 -- 172.21.15.18:0/4176011569 shutdown_connections 2024-09-19T09:54:41.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.922+0000 7fb5067cc640 1 --2- 172.21.15.18:0/4176011569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb50010e400 0x7fb500110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.922+0000 7fb5067cc640 1 --2- 172.21.15.18:0/4176011569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb500074f00 0x7fb50010dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.922+0000 7fb5067cc640 1 --2- 172.21.15.18:0/4176011569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5000745e0 0x7fb5000749c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.922+0000 7fb5067cc640 1 -- 172.21.15.18:0/4176011569 >> 172.21.15.18:0/4176011569 conn(0x7fb5000fd8c0 msgr2=0x7fb5000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.922+0000 7fb5067cc640 1 -- 172.21.15.18:0/4176011569 shutdown_connections 2024-09-19T09:54:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.922+0000 7fb5067cc640 1 -- 172.21.15.18:0/4176011569 wait complete. 2024-09-19T09:54:41.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.923+0000 7fb5067cc640 1 Processor -- start 2024-09-19T09:54:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.924+0000 7fb5067cc640 1 -- start start 2024-09-19T09:54:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.924+0000 7fb5067cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5000745e0 0x7fb50010dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.924+0000 7fb5067cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb500074f00 0x7fb50010ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.924+0000 7fb5067cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb50010e400 0x7fb50010b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.924+0000 7fb5067cc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb5001142c0 con 0x7fb5000745e0 2024-09-19T09:54:41.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.924+0000 7fb5067cc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb500114140 con 0x7fb500074f00 2024-09-19T09:54:41.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.924+0000 7fb5067cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb500114440 con 0x7fb50010e400 2024-09-19T09:54:41.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.924+0000 7fb4fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5000745e0 0x7fb50010dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.925+0000 7fb4fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5000745e0 0x7fb50010dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55312/0 (socket says 172.21.15.18:55312) 2024-09-19T09:54:41.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.925+0000 7fb4fffff640 1 -- 172.21.15.18:0/3903299068 learned_addr learned my addr 172.21.15.18:0/3903299068 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:41.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.925+0000 7fb4f7fff640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb500074f00 0x7fb50010ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.925+0000 7fb4fffff640 1 -- 172.21.15.18:0/3903299068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb50010e400 msgr2=0x7fb50010b390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:54:41.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.925+0000 7fb4fffff640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb50010e400 0x7fb50010b390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.925+0000 7fb4fffff640 1 -- 172.21.15.18:0/3903299068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb500074f00 msgr2=0x7fb50010ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:41.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.925+0000 7fb4fffff640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb500074f00 0x7fb50010ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.925+0000 7fb4fffff640 1 -- 172.21.15.18:0/3903299068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50010bc50 con 0x7fb5000745e0 2024-09-19T09:54:41.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.926+0000 7fb4fffff640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5000745e0 0x7fb50010dd80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00098d0 tx=0x7fb4f0030930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:41.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.926+0000 7fb4fdffb640 1 -- 172.21.15.18:0/3903299068 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0047070 con 0x7fb5000745e0 2024-09-19T09:54:41.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.927+0000 7fb5067cc640 1 -- 172.21.15.18:0/3903299068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5001ab0c0 con 0x7fb5000745e0 2024-09-19T09:54:41.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.927+0000 7fb4fdffb640 1 -- 172.21.15.18:0/3903299068 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f002f7e0 con 0x7fb5000745e0 2024-09-19T09:54:41.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.927+0000 7fb4fdffb640 1 -- 172.21.15.18:0/3903299068 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0034070 con 0x7fb5000745e0 2024-09-19T09:54:41.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.927+0000 7fb5067cc640 1 -- 172.21.15.18:0/3903299068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5001ab5f0 con 0x7fb5000745e0 2024-09-19T09:54:41.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.934+0000 7fb508ba5740 1 Processor -- start 2024-09-19T09:54:41.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.934+0000 7fb4fdffb640 1 -- 172.21.15.18:0/3903299068 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb4f004a070 con 0x7fb5000745e0 2024-09-19T09:54:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.935+0000 7fb508ba5740 1 -- start start 2024-09-19T09:54:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.935+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee8b40 0x55cd0bee7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.935+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bee7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.935+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 0x55cd0bef4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.935+0000 7fb508ba5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cd0be4d2f0 con 0x55cd0bee75d0 2024-09-19T09:54:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.935+0000 7fb508ba5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cd0bdf4cf0 con 0x55cd0bee8b40 2024-09-19T09:54:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.935+0000 7fb508ba5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cd0be492b0 con 0x55cd0bef2370 2024-09-19T09:54:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.936+0000 7fb4fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bee7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.936+0000 7fb4fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bee7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55326/0 (socket says 172.21.15.18:55326) 2024-09-19T09:54:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.936+0000 7fb4fffff640 1 -- 172.21.15.18:0/3629918337 learned_addr learned my addr 172.21.15.18:0/3629918337 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.937+0000 7fb4fffff640 1 -- 172.21.15.18:0/3629918337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 msgr2=0x55cd0bef4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.937+0000 7fb4fffff640 1 --2- 172.21.15.18:0/3629918337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 0x55cd0bef4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.937+0000 7fb4fffff640 1 -- 172.21.15.18:0/3629918337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee8b40 msgr2=0x55cd0bee7090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.937+0000 7fb4fffff640 1 --2- 172.21.15.18:0/3629918337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee8b40 0x55cd0bee7090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.937+0000 7fb4fffff640 1 -- 172.21.15.18:0/3629918337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0bdd93a0 con 0x55cd0bee75d0 2024-09-19T09:54:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.937+0000 7fb4fffff640 1 --2- 172.21.15.18:0/3629918337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bee7a10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00f6c20 tx=0x7fb4f00f8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bad1bcff561bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.938+0000 7fb4fdffb640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4ec0a32c0 0x7fb4ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.938+0000 7fb4f67fc640 1 -- 172.21.15.18:0/3629918337 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00ff070 con 0x55cd0bee75d0 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.938+0000 7fb4f67fc640 1 -- 172.21.15.18:0/3629918337 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f00c1080 con 0x55cd0bee75d0 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.938+0000 7fb4f67fc640 1 -- 172.21.15.18:0/3629918337 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00c5940 con 0x55cd0bee75d0 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.938+0000 7fb504d69640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4ec0a32c0 0x7fb4ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.938+0000 7fb4fdffb640 1 -- 172.21.15.18:0/3903299068 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb4f00f06e0 con 0x7fb5000745e0 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.939+0000 7fb508ba5740 1 -- 172.21.15.18:0/3629918337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 msgr2=0x55cd0bee7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.939+0000 7fb508ba5740 1 --2- 172.21.15.18:0/3629918337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bee7a10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00f6c20 tx=0x7fb4f00f8670 comp rx=0 tx=0).stop 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.940+0000 7fb508ba5740 1 -- 172.21.15.18:0/3629918337 shutdown_connections 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.940+0000 7fb508ba5740 1 --2- 172.21.15.18:0/3629918337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 0x55cd0bef4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.940+0000 7fb508ba5740 1 --2- 172.21.15.18:0/3629918337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bee7a10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.940+0000 7fb508ba5740 1 --2- 172.21.15.18:0/3629918337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee8b40 0x55cd0bee7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.940+0000 7fb508ba5740 1 -- 172.21.15.18:0/3629918337 >> 172.21.15.18:0/3629918337 conn(0x55cd0beb0310 msgr2=0x55cd0bee3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.940+0000 7fb504d69640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4ec0a32c0 0x7fb4ec0a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb50010f740 tx=0x7fb4f8006bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.940+0000 7fb508ba5740 1 -- 172.21.15.18:0/3629918337 shutdown_connections 2024-09-19T09:54:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.940+0000 7fb508ba5740 1 -- 172.21.15.18:0/3629918337 wait complete. 2024-09-19T09:54:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.941+0000 7fb508ba5740 1 -- start start 2024-09-19T09:54:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.942+0000 7fb508ba5740 1 Processor -- start 2024-09-19T09:54:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.943+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bef1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.943+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee8b40 0x55cd0beeefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.943+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 0x55cd0beef520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.943+0000 7fb508ba5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cd0be4d2f0 con 0x55cd0bee75d0 2024-09-19T09:54:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.943+0000 7fb508ba5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cd0be08060 con 0x55cd0bee8b40 2024-09-19T09:54:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.943+0000 7fb508ba5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cd0bef4e30 con 0x55cd0bef2370 2024-09-19T09:54:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.943+0000 7fb508ba5740 10 client.0 _ll_register_callbacks cb 0x55cd0bb5b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.944+0000 7fb4f7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee8b40 0x55cd0beeefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.944+0000 7fb4f7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee8b40 0x55cd0beeefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43398/0 (socket says 172.21.15.18:43398) 2024-09-19T09:54:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.944+0000 7fb4f7fff640 1 -- 172.21.15.18:0/555952726 learned_addr learned my addr 172.21.15.18:0/555952726 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.944+0000 7fb4fffff640 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bef1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.945+0000 7fb4fffff640 1 -- 172.21.15.18:0/555952726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 msgr2=0x55cd0beef520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.945+0000 7fb4fffff640 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 0x55cd0beef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.945+0000 7fb4fffff640 1 -- 172.21.15.18:0/555952726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee8b40 msgr2=0x55cd0beeefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.945+0000 7fb4fffff640 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee8b40 0x55cd0beeefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.945+0000 7fb4fffff640 1 -- 172.21.15.18:0/555952726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0bbbe3c0 con 0x55cd0bee75d0 2024-09-19T09:54:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.946+0000 7fb4fffff640 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bef1cf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0000f80 tx=0x7fb4f00f66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7d4595b4d44e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:41.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.946+0000 7fb4df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:41.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.946+0000 7fb4df7fe640 1 -- 172.21.15.18:0/555952726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00ff030 con 0x55cd0bee75d0 2024-09-19T09:54:41.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.946+0000 7fb4df7fe640 1 -- 172.21.15.18:0/555952726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb4f00ee230 con 0x55cd0bee75d0 2024-09-19T09:54:41.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.946+0000 7fb508ba5740 1 -- 172.21.15.18:0/555952726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4f00c1080 con 0x55cd0bee75d0 2024-09-19T09:54:41.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.947+0000 7fb4df7fe640 1 -- 172.21.15.18:0/555952726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb4f00f8ea0 con 0x55cd0bee75d0 2024-09-19T09:54:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.947+0000 7fb508ba5740 10 client.16173 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.947+0000 7fb508ba5740 1 -- 172.21.15.18:0/555952726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd0bf006a0 con 0x55cd0bee75d0 2024-09-19T09:54:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.947+0000 7fb4df7fe640 1 -- 172.21.15.18:0/555952726 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f00c1080 con 0x55cd0bee75d0 2024-09-19T09:54:41.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.949+0000 7fb4df7fe640 1 -- 172.21.15.18:0/555952726 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb4f0041030 con 0x55cd0bee75d0 2024-09-19T09:54:41.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.949+0000 7fb508ba5740 10 client.16173 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:41.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.949+0000 7fb508ba5740 10 client.16173 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:54:41.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.949+0000 7fb508ba5740 20 client.16173 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:41.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.949+0000 7fb508ba5740 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55cd0bf01820 0x55cd0bf03c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.950+0000 7fb508ba5740 4 client.16173 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:41.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.950+0000 7fb508ba5740 1 -- 172.21.15.18:0/555952726 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd0be5a860 con 0x55cd0bf01820 2024-09-19T09:54:41.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.951+0000 7fb4f7fff640 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55cd0bf01820 0x55cd0bf03c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.951+0000 7fb4f7fff640 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55cd0bf01820 0x55cd0bf03c30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=94c7774c93b705c4 server_cookie=f93fd1cd34d29fb5 in_seq=0 out_seq=0 2024-09-19T09:54:41.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.952+0000 7fb4df7fe640 10 client.16173 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:54:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.953+0000 7fb4df7fe640 1 -- 172.21.15.18:0/555952726 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd0be5a860 con 0x55cd0bf01820 2024-09-19T09:54:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.953+0000 7fb4df7fe640 10 client.16173 handle_command_reply: tid=0 2024-09-19T09:54:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.953+0000 7fb508ba5740 1 client.16173 shutdown 2024-09-19T09:54:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.954+0000 7fb508ba5740 1 -- 172.21.15.18:0/555952726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 msgr2=0x55cd0bef1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.954+0000 7fb508ba5740 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bef1cf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0000f80 tx=0x7fb4f00f66d0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.955+0000 7fb508ba5740 1 -- 172.21.15.18:0/555952726 shutdown_connections 2024-09-19T09:54:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.955+0000 7fb508ba5740 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55cd0bf01820 0x55cd0bf03c30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.955+0000 7fb508ba5740 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 0x55cd0beef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.955+0000 7fb508ba5740 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee8b40 0x55cd0beeefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.955+0000 7fb508ba5740 1 --2- 172.21.15.18:0/555952726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0bef1cf0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.955+0000 7fb508ba5740 1 -- 172.21.15.18:0/555952726 >> 172.21.15.18:0/555952726 conn(0x55cd0beb0310 msgr2=0x55cd0bee9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.955+0000 7fb4df7fe640 0 client.16173 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:54:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.955+0000 7fb508ba5740 1 -- 172.21.15.18:0/555952726 shutdown_connections 2024-09-19T09:54:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.956+0000 7fb508ba5740 1 -- 172.21.15.18:0/555952726 wait complete. 2024-09-19T09:54:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.956+0000 7fb508ba5740 20 client.16173 trim_cache size 0 max 16384 2024-09-19T09:54:41.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.977+0000 7fb508ba5740 1 Processor -- start 2024-09-19T09:54:41.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.978+0000 7fb508ba5740 1 -- start start 2024-09-19T09:54:41.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.978+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0befdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.978+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bee8b40 0x55cd0bee2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.978+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bef2370 0x55cd0bf094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.978+0000 7fb508ba5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb5001b3d20 con 0x55cd0bee75d0 2024-09-19T09:54:41.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.978+0000 7fb508ba5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb5001b5860 con 0x55cd0bef2370 2024-09-19T09:54:41.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.978+0000 7fb508ba5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb5001b43f0 con 0x55cd0bee8b40 2024-09-19T09:54:41.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.978+0000 7fb4fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0befdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.978+0000 7fb4fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0befdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55338/0 (socket says 172.21.15.18:55338) 2024-09-19T09:54:41.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.978+0000 7fb4fffff640 1 -- 172.21.15.18:0/2358761269 learned_addr learned my addr 172.21.15.18:0/2358761269 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:41.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.979+0000 7fb4fffff640 1 -- 172.21.15.18:0/2358761269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bee8b40 msgr2=0x55cd0bee2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:41.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.979+0000 7fb4fffff640 1 --2- 172.21.15.18:0/2358761269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bee8b40 0x55cd0bee2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.979+0000 7fb4fffff640 1 -- 172.21.15.18:0/2358761269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bef2370 msgr2=0x55cd0bf094d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.979+0000 7fb4fffff640 1 --2- 172.21.15.18:0/2358761269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bef2370 0x55cd0bf094d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.979+0000 7fb4fffff640 1 -- 172.21.15.18:0/2358761269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0bee4960 con 0x55cd0bee75d0 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.979+0000 7fb4fffff640 1 --2- 172.21.15.18:0/2358761269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0befdf10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00baf80 tx=0x7fb4f00f8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2552812181ee21c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.979+0000 7fb4f5ffb640 1 -- 172.21.15.18:0/2358761269 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00ff070 con 0x55cd0bee75d0 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.979+0000 7fb4f5ffb640 1 -- 172.21.15.18:0/2358761269 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f00f6300 con 0x55cd0bee75d0 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.979+0000 7fb4f5ffb640 1 -- 172.21.15.18:0/2358761269 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00b8f70 con 0x55cd0bee75d0 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.980+0000 7fb508ba5740 1 -- 172.21.15.18:0/2358761269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 msgr2=0x55cd0befdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.980+0000 7fb508ba5740 1 --2- 172.21.15.18:0/2358761269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0befdf10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00baf80 tx=0x7fb4f00f8670 comp rx=0 tx=0).stop 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.980+0000 7fb508ba5740 1 -- 172.21.15.18:0/2358761269 shutdown_connections 2024-09-19T09:54:41.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.980+0000 7fb508ba5740 1 --2- 172.21.15.18:0/2358761269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bef2370 0x55cd0bf094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.980+0000 7fb508ba5740 1 --2- 172.21.15.18:0/2358761269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bee8b40 0x55cd0bee2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.980+0000 7fb508ba5740 1 --2- 172.21.15.18:0/2358761269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee75d0 0x55cd0befdf10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.980+0000 7fb508ba5740 1 -- 172.21.15.18:0/2358761269 >> 172.21.15.18:0/2358761269 conn(0x55cd0beb0310 msgr2=0x55cd0bee2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:41.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.981+0000 7fb508ba5740 1 -- 172.21.15.18:0/2358761269 shutdown_connections 2024-09-19T09:54:41.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.981+0000 7fb508ba5740 1 -- 172.21.15.18:0/2358761269 wait complete. 2024-09-19T09:54:41.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.981+0000 7fb508ba5740 1 -- start start 2024-09-19T09:54:41.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.982+0000 7fb508ba5740 1 Processor -- start 2024-09-19T09:54:41.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.982+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee75d0 0x55cd0befa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.983+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee8b40 0x55cd0beebda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.983+0000 7fb508ba5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 0x55cd0beec390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.983+0000 7fb508ba5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb5001b5190 con 0x55cd0bee8b40 2024-09-19T09:54:41.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.983+0000 7fb508ba5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb5001b4ac0 con 0x55cd0bee75d0 2024-09-19T09:54:41.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.983+0000 7fb508ba5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb5001b1d00 con 0x55cd0bef2370 2024-09-19T09:54:41.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.983+0000 7fb508ba5740 10 client.0 _ll_register_callbacks cb 0x7fb4f00f6a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:41.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.983+0000 7fb4f7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee8b40 0x55cd0beebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.983+0000 7fb4f7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee8b40 0x55cd0beebda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55340/0 (socket says 172.21.15.18:55340) 2024-09-19T09:54:41.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.983+0000 7fb4f7fff640 1 -- 172.21.15.18:0/2414219359 learned_addr learned my addr 172.21.15.18:0/2414219359 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:41.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.984+0000 7fb504d69640 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 0x55cd0beec390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.984+0000 7fb4fffff640 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee75d0 0x55cd0befa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.985+0000 7fb4f7fff640 1 -- 172.21.15.18:0/2414219359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 msgr2=0x55cd0beec390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:41.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.985+0000 7fb4f7fff640 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 0x55cd0beec390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.985+0000 7fb4f7fff640 1 -- 172.21.15.18:0/2414219359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee75d0 msgr2=0x55cd0befa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:41.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.985+0000 7fb4f7fff640 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee75d0 0x55cd0befa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.985+0000 7fb4f7fff640 1 -- 172.21.15.18:0/2414219359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0beecbc0 con 0x55cd0bee8b40 2024-09-19T09:54:41.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.986+0000 7fb4f7fff640 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee8b40 0x55cd0beebda0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x55cd0bf04470 tx=0x7fb4e800af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2f03f4089f4d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:41.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.986+0000 7fb4df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:41.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.986+0000 7fb4df7fe640 1 -- 172.21.15.18:0/2414219359 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8016a70 con 0x55cd0bee8b40 2024-09-19T09:54:41.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.986+0000 7fb4df7fe640 1 -- 172.21.15.18:0/2414219359 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb4e8016c10 con 0x55cd0bee8b40 2024-09-19T09:54:41.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.986+0000 7fb508ba5740 1 -- 172.21.15.18:0/2414219359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4f00f6300 con 0x55cd0bee8b40 2024-09-19T09:54:41.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.987+0000 7fb4df7fe640 1 -- 172.21.15.18:0/2414219359 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb4e8016e10 con 0x55cd0bee8b40 2024-09-19T09:54:41.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.987+0000 7fb508ba5740 10 client.16179 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:41.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.987+0000 7fb508ba5740 1 -- 172.21.15.18:0/2414219359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd0bf6c610 con 0x55cd0bee8b40 2024-09-19T09:54:41.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.987+0000 7fb4df7fe640 1 -- 172.21.15.18:0/2414219359 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f00f6300 con 0x55cd0bee8b40 2024-09-19T09:54:41.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.988+0000 7fb4df7fe640 1 -- 172.21.15.18:0/2414219359 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb4e80136e0 con 0x55cd0bee8b40 2024-09-19T09:54:41.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.988+0000 7fb508ba5740 10 client.16179 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:41.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.988+0000 7fb508ba5740 10 client.16179 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:54:41.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.988+0000 7fb508ba5740 20 client.16179 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:41.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.988+0000 7fb508ba5740 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55cd0bf6ce10 0x55cd0bf6f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:41.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.988+0000 7fb508ba5740 4 client.16179 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:54:41.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.989+0000 7fb4fffff640 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55cd0bf6ce10 0x55cd0bf6f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:41.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.989+0000 7fb508ba5740 1 -- 172.21.15.18:0/2414219359 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd0be54d70 con 0x55cd0bf6ce10 2024-09-19T09:54:41.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.990+0000 7fb4fffff640 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55cd0bf6ce10 0x55cd0bf6f230 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e3b210aff0065cec server_cookie=423d270af0a8f313 in_seq=0 out_seq=0 2024-09-19T09:54:41.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.990+0000 7fb4df7fe640 10 client.16179 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:54:41.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.991+0000 7fb4df7fe640 1 -- 172.21.15.18:0/2414219359 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd0be54d70 con 0x55cd0bf6ce10 2024-09-19T09:54:41.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.991+0000 7fb4df7fe640 10 client.16179 handle_command_reply: tid=0 2024-09-19T09:54:41.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.991+0000 7fb508ba5740 1 client.16179 shutdown 2024-09-19T09:54:41.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.992+0000 7fb508ba5740 1 -- 172.21.15.18:0/2414219359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee8b40 msgr2=0x55cd0beebda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:41.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.992+0000 7fb508ba5740 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee8b40 0x55cd0beebda0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x55cd0bf04470 tx=0x7fb4e800af00 comp rx=0 tx=0).stop 2024-09-19T09:54:41.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.992+0000 7fb508ba5740 1 -- 172.21.15.18:0/2414219359 shutdown_connections 2024-09-19T09:54:41.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.992+0000 7fb508ba5740 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55cd0bf6ce10 0x55cd0bf6f230 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.992+0000 7fb508ba5740 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd0bef2370 0x55cd0beec390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.992+0000 7fb4df7fe640 0 client.16179 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:54:41.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.992+0000 7fb508ba5740 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cd0bee8b40 0x55cd0beebda0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.992+0000 7fb508ba5740 1 --2- 172.21.15.18:0/2414219359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd0bee75d0 0x55cd0befa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.992+0000 7fb508ba5740 1 -- 172.21.15.18:0/2414219359 >> 172.21.15.18:0/2414219359 conn(0x55cd0beb0310 msgr2=0x55cd0bee9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:41.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.993+0000 7fb508ba5740 1 -- 172.21.15.18:0/2414219359 shutdown_connections 2024-09-19T09:54:41.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.993+0000 7fb508ba5740 1 -- 172.21.15.18:0/2414219359 wait complete. 2024-09-19T09:54:41.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.993+0000 7fb508ba5740 20 client.16179 trim_cache size 0 max 16384 2024-09-19T09:54:41.997 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:54:41.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.995+0000 7fb5067cc640 1 -- 172.21.15.18:0/3903299068 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4ec0a32c0 msgr2=0x7fb4ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:41.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.995+0000 7fb5067cc640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4ec0a32c0 0x7fb4ec0a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb50010f740 tx=0x7fb4f8006bd0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.995+0000 7fb5067cc640 1 -- 172.21.15.18:0/3903299068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5000745e0 msgr2=0x7fb50010dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:41.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.995+0000 7fb5067cc640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5000745e0 0x7fb50010dd80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00098d0 tx=0x7fb4f0030930 comp rx=0 tx=0).stop 2024-09-19T09:54:41.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.995+0000 7fb5067cc640 1 -- 172.21.15.18:0/3903299068 shutdown_connections 2024-09-19T09:54:41.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.995+0000 7fb5067cc640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4ec0a32c0 0x7fb4ec0a5780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.995+0000 7fb5067cc640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb50010e400 0x7fb50010b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.995+0000 7fb5067cc640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb500074f00 0x7fb50010ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.995+0000 7fb5067cc640 1 --2- 172.21.15.18:0/3903299068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5000745e0 0x7fb50010dd80 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:41.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.995+0000 7fb5067cc640 1 -- 172.21.15.18:0/3903299068 >> 172.21.15.18:0/3903299068 conn(0x7fb5000fd8c0 msgr2=0x7fb5000fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:42.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.996+0000 7fb5067cc640 1 -- 172.21.15.18:0/3903299068 shutdown_connections 2024-09-19T09:54:42.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:41.996+0000 7fb5067cc640 1 -- 172.21.15.18:0/3903299068 wait complete. 2024-09-19T09:54:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:42 smithi018 ceph-mon[30956]: pgmap v409: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 413 MiB/s wr, 513 op/s 2024-09-19T09:54:42.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:42 smithi049 ceph-mon[34858]: pgmap v409: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 413 MiB/s wr, 513 op/s 2024-09-19T09:54:42.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:42 smithi162 ceph-mon[35174]: pgmap v409: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 413 MiB/s wr, 513 op/s 2024-09-19T09:54:43.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:54:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:44.369 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:44 smithi018 ceph-mon[30956]: pgmap v410: 97 pgs: 97 active+clean; 9.8 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 572 MiB/s wr, 1.05k op/s 2024-09-19T09:54:44.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:44 smithi049 ceph-mon[34858]: pgmap v410: 97 pgs: 97 active+clean; 9.8 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 572 MiB/s wr, 1.05k op/s 2024-09-19T09:54:44.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:44 smithi162 ceph-mon[35174]: pgmap v410: 97 pgs: 97 active+clean; 9.8 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 572 MiB/s wr, 1.05k op/s 2024-09-19T09:54:44.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.739+0000 7f043f7fe640 1 -- 172.21.15.18:0/378813026 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04280319b0 con 0x7f0440106a80 2024-09-19T09:54:44.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.740+0000 7f044634c640 1 -- 172.21.15.18:0/378813026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0440106a80 msgr2=0x7f0440106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:44.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.740+0000 7f044634c640 1 --2- 172.21.15.18:0/378813026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0440106a80 0x7f0440106e60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0428009930 tx=0x7f042802a420 comp rx=0 tx=0).stop 2024-09-19T09:54:44.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.740+0000 7f044634c640 1 -- 172.21.15.18:0/378813026 shutdown_connections 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.740+0000 7f044634c640 1 --2- 172.21.15.18:0/378813026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0440101420 0x7f044010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.740+0000 7f044634c640 1 --2- 172.21.15.18:0/378813026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0440100a80 0x7f0440100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.740+0000 7f044634c640 1 --2- 172.21.15.18:0/378813026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0440106a80 0x7f0440106e60 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.740+0000 7f044634c640 1 -- 172.21.15.18:0/378813026 >> 172.21.15.18:0/378813026 conn(0x7f04400fc7a0 msgr2=0x7f04400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.741+0000 7f044634c640 1 -- 172.21.15.18:0/378813026 shutdown_connections 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.741+0000 7f044634c640 1 -- 172.21.15.18:0/378813026 wait complete. 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.743+0000 7f044634c640 1 Processor -- start 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.743+0000 7f044634c640 1 -- start start 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.743+0000 7f044634c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0440100a80 0x7f0440108cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.743+0000 7f044634c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0440101420 0x7f0440109230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.743+0000 7f044634c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0440106a80 0x7f0440109770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.743+0000 7f044634c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f044006b6f0 con 0x7f0440100a80 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.743+0000 7f044634c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f044006b570 con 0x7f0440101420 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.743+0000 7f044634c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0440110010 con 0x7f0440106a80 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.744+0000 7f043ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0440100a80 0x7f0440108cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.744+0000 7f043ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0440100a80 0x7f0440108cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55352/0 (socket says 172.21.15.18:55352) 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.744+0000 7f043ffff640 1 -- 172.21.15.18:0/61790764 learned_addr learned my addr 172.21.15.18:0/61790764 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.745+0000 7f04377fe640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0440101420 0x7f0440109230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.745+0000 7f043ffff640 1 -- 172.21.15.18:0/61790764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0440106a80 msgr2=0x7f0440109770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.745+0000 7f043ffff640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0440106a80 0x7f0440109770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.745+0000 7f043ffff640 1 -- 172.21.15.18:0/61790764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0440101420 msgr2=0x7f0440109230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.745+0000 7f043ffff640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0440101420 0x7f0440109230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.745+0000 7f043ffff640 1 -- 172.21.15.18:0/61790764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044006bd70 con 0x7f0440100a80 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.746+0000 7f043ffff640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0440100a80 0x7f0440108cf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f042802a940 tx=0x7f0428003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.747+0000 7f043dffb640 1 -- 172.21.15.18:0/61790764 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042803f070 con 0x7f0440100a80 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.747+0000 7f043dffb640 1 -- 172.21.15.18:0/61790764 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f042803b460 con 0x7f0440100a80 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.747+0000 7f043dffb640 1 -- 172.21.15.18:0/61790764 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428035030 con 0x7f0440100a80 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.747+0000 7f044634c640 1 -- 172.21.15.18:0/61790764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044006c000 con 0x7f0440100a80 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.748+0000 7f044634c640 1 -- 172.21.15.18:0/61790764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044006c490 con 0x7f0440100a80 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.751+0000 7f043dffb640 1 -- 172.21.15.18:0/61790764 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0428042070 con 0x7f0440100a80 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.752+0000 7f0448725740 1 Processor -- start 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.752+0000 7f0448725740 1 -- start start 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.753+0000 7f0448725740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff212b40 0x5636ff211090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.753+0000 7f0448725740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff2115d0 0x5636ff211a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.753+0000 7f0448725740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.753+0000 7f0448725740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5636ff1772f0 con 0x5636ff21c370 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.753+0000 7f0448725740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5636ff11ecf0 con 0x5636ff2115d0 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.753+0000 7f0448725740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5636ff1732b0 con 0x5636ff212b40 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.753+0000 7f04377fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.753+0000 7f04377fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55364/0 (socket says 172.21.15.18:55364) 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.753+0000 7f04377fe640 1 -- 172.21.15.18:0/4157645112 learned_addr learned my addr 172.21.15.18:0/4157645112 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.753+0000 7f043dffb640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f042c0a32c0 0x7f042c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.754+0000 7f04448e9640 1 --2- 172.21.15.18:0/4157645112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff212b40 0x5636ff211090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.754+0000 7f043dffb640 1 -- 172.21.15.18:0/61790764 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f04280f0160 con 0x7f0440100a80 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.754+0000 7f04448e9640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f042c0a32c0 0x7f042c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.754+0000 7f04377fe640 1 -- 172.21.15.18:0/4157645112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff212b40 msgr2=0x5636ff211090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.754+0000 7f04377fe640 1 --2- 172.21.15.18:0/4157645112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff212b40 0x5636ff211090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.754+0000 7f04377fe640 1 -- 172.21.15.18:0/4157645112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff2115d0 msgr2=0x5636ff211a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.754+0000 7f04377fe640 1 --2- 172.21.15.18:0/4157645112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff2115d0 0x5636ff211a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.754+0000 7f04377fe640 1 -- 172.21.15.18:0/4157645112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636ff1033a0 con 0x5636ff21c370 2024-09-19T09:54:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.755+0000 7f04448e9640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f042c0a32c0 0x7f042c0a5780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f043800bf20 tx=0x7f0438006960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.755+0000 7f04377fe640 1 --2- 172.21.15.18:0/4157645112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21e760 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0430009f40 tx=0x7f043000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d415304e28630f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.756+0000 7f04367fc640 1 -- 172.21.15.18:0/4157645112 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043001a070 con 0x5636ff21c370 2024-09-19T09:54:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.757+0000 7f04367fc640 1 -- 172.21.15.18:0/4157645112 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04300158f0 con 0x5636ff21c370 2024-09-19T09:54:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.757+0000 7f04367fc640 1 -- 172.21.15.18:0/4157645112 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043000a960 con 0x5636ff21c370 2024-09-19T09:54:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.758+0000 7f0448725740 1 -- 172.21.15.18:0/4157645112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 msgr2=0x5636ff21e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.758+0000 7f0448725740 1 --2- 172.21.15.18:0/4157645112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21e760 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0430009f40 tx=0x7f043000c8b0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.758+0000 7f0448725740 1 -- 172.21.15.18:0/4157645112 shutdown_connections 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.758+0000 7f0448725740 1 --2- 172.21.15.18:0/4157645112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21e760 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.758+0000 7f0448725740 1 --2- 172.21.15.18:0/4157645112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff2115d0 0x5636ff211a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.758+0000 7f0448725740 1 --2- 172.21.15.18:0/4157645112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff212b40 0x5636ff211090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.758+0000 7f0448725740 1 -- 172.21.15.18:0/4157645112 >> 172.21.15.18:0/4157645112 conn(0x5636ff1da310 msgr2=0x5636ff20dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.758+0000 7f0448725740 1 -- 172.21.15.18:0/4157645112 shutdown_connections 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.758+0000 7f0448725740 1 -- 172.21.15.18:0/4157645112 wait complete. 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.759+0000 7f0448725740 1 -- start start 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.760+0000 7f0448725740 1 Processor -- start 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.760+0000 7f0448725740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff2115d0 0x5636ff2190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.760+0000 7f0448725740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff212b40 0x5636ff219630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.761+0000 7f0448725740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff21c370 0x5636ff219b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.761+0000 7f0448725740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5636ff21f070 con 0x5636ff2115d0 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.761+0000 7f0448725740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5636ff132060 con 0x5636ff212b40 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.761+0000 7f0448725740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5636ff21f1f0 con 0x5636ff21c370 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.761+0000 7f043ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff2115d0 0x5636ff2190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.761+0000 7f0448725740 10 client.0 _ll_register_callbacks cb 0x5636fee858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.761+0000 7f043ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff2115d0 0x5636ff2190f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55372/0 (socket says 172.21.15.18:55372) 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.761+0000 7f043ffff640 1 -- 172.21.15.18:0/4157900062 learned_addr learned my addr 172.21.15.18:0/4157900062 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.761+0000 7f04448e9640 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff21c370 0x5636ff219b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.762+0000 7f043ffff640 1 -- 172.21.15.18:0/4157900062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff21c370 msgr2=0x5636ff219b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.762+0000 7f043ffff640 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff21c370 0x5636ff219b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.762+0000 7f043ffff640 1 -- 172.21.15.18:0/4157900062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff212b40 msgr2=0x5636ff219630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.762+0000 7f043ffff640 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff212b40 0x5636ff219630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.762+0000 7f043ffff640 1 -- 172.21.15.18:0/4157900062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636feee83c0 con 0x5636ff2115d0 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.762+0000 7f043ffff640 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff2115d0 0x5636ff2190f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f04280bc740 tx=0x7f04280bc640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e7f16b9d9995d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.762+0000 7f041f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.762+0000 7f041f7fe640 1 -- 172.21.15.18:0/4157900062 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04280bc7b0 con 0x5636ff2115d0 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.762+0000 7f041f7fe640 1 -- 172.21.15.18:0/4157900062 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f04280b8e20 con 0x5636ff2115d0 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.762+0000 7f0448725740 1 -- 172.21.15.18:0/4157900062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04300158f0 con 0x5636ff2115d0 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.763+0000 7f041f7fe640 1 -- 172.21.15.18:0/4157900062 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f04280c0b60 con 0x5636ff2115d0 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.763+0000 7f0448725740 10 client.16191 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.763+0000 7f0448725740 1 -- 172.21.15.18:0/4157900062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5636ff22ac50 con 0x5636ff2115d0 2024-09-19T09:54:44.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.763+0000 7f041f7fe640 1 -- 172.21.15.18:0/4157900062 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04300158f0 con 0x5636ff2115d0 2024-09-19T09:54:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.763+0000 7f041f7fe640 1 -- 172.21.15.18:0/4157900062 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f04280bca10 con 0x5636ff2115d0 2024-09-19T09:54:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.763+0000 7f0448725740 10 client.16191 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.763+0000 7f0448725740 10 client.16191 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:54:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.764+0000 7f0448725740 20 client.16191 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.764+0000 7f0448725740 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5636ff22bfa0 0x5636ff22e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.764+0000 7f0448725740 4 client.16191 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.764+0000 7f0448725740 1 -- 172.21.15.18:0/4157900062 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636ff184860 con 0x5636ff22bfa0 2024-09-19T09:54:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.765+0000 7f04377fe640 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5636ff22bfa0 0x5636ff22e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.768+0000 7f041f7fe640 10 client.16191 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:54:44.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.768+0000 7f04377fe640 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5636ff22bfa0 0x5636ff22e410 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7e0676da3cb1f42d server_cookie=f40f0dd1406fff8a in_seq=0 out_seq=0 2024-09-19T09:54:44.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.771+0000 7f041f7fe640 1 -- 172.21.15.18:0/4157900062 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636ff184860 con 0x5636ff22bfa0 2024-09-19T09:54:44.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.771+0000 7f041f7fe640 10 client.16191 handle_command_reply: tid=0 2024-09-19T09:54:44.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.771+0000 7f0448725740 1 client.16191 shutdown 2024-09-19T09:54:44.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.771+0000 7f0448725740 1 -- 172.21.15.18:0/4157900062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff2115d0 msgr2=0x5636ff2190f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:44.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.771+0000 7f0448725740 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff2115d0 0x5636ff2190f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f04280bc740 tx=0x7f04280bc640 comp rx=0 tx=0).stop 2024-09-19T09:54:44.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.771+0000 7f0448725740 1 -- 172.21.15.18:0/4157900062 shutdown_connections 2024-09-19T09:54:44.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.771+0000 7f0448725740 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5636ff22bfa0 0x5636ff22e410 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.772+0000 7f0448725740 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff21c370 0x5636ff219b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.772+0000 7f0448725740 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff212b40 0x5636ff219630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.772+0000 7f0448725740 1 --2- 172.21.15.18:0/4157900062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff2115d0 0x5636ff2190f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.772+0000 7f0448725740 1 -- 172.21.15.18:0/4157900062 >> 172.21.15.18:0/4157900062 conn(0x5636ff1da310 msgr2=0x5636ff213960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:44.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.772+0000 7f041f7fe640 0 client.16191 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:54:44.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.772+0000 7f0448725740 1 -- 172.21.15.18:0/4157900062 shutdown_connections 2024-09-19T09:54:44.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.772+0000 7f0448725740 1 -- 172.21.15.18:0/4157900062 wait complete. 2024-09-19T09:54:44.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.772+0000 7f0448725740 20 client.16191 trim_cache size 0 max 16384 2024-09-19T09:54:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.795+0000 7f0448725740 1 Processor -- start 2024-09-19T09:54:44.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.795+0000 7f0448725740 1 -- start start 2024-09-19T09:54:44.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.795+0000 7f0448725740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff2115d0 0x5636ff214120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f0448725740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff212b40 0x5636ff214660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f0448725740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff21c370 0x5636ff233cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f0448725740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04401bc3c0 con 0x5636ff212b40 2024-09-19T09:54:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f0448725740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f04401bdf00 con 0x5636ff21c370 2024-09-19T09:54:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f0448725740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f04401bca90 con 0x5636ff2115d0 2024-09-19T09:54:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f04377fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff212b40 0x5636ff214660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f04377fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff212b40 0x5636ff214660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55380/0 (socket says 172.21.15.18:55380) 2024-09-19T09:54:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f04377fe640 1 -- 172.21.15.18:0/159816328 learned_addr learned my addr 172.21.15.18:0/159816328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f04377fe640 1 -- 172.21.15.18:0/159816328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff2115d0 msgr2=0x5636ff214120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f04377fe640 1 --2- 172.21.15.18:0/159816328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff2115d0 0x5636ff214120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f04377fe640 1 -- 172.21.15.18:0/159816328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff21c370 msgr2=0x5636ff233cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:54:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f04377fe640 1 --2- 172.21.15.18:0/159816328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff21c370 0x5636ff233cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.797+0000 7f04377fe640 1 -- 172.21.15.18:0/159816328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636ff211d40 con 0x5636ff212b40 2024-09-19T09:54:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.798+0000 7f04377fe640 1 --2- 172.21.15.18:0/159816328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff212b40 0x5636ff214660 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f043000a510 tx=0x7f043000a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470b385bc7166c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.799+0000 7f0435ffb640 1 -- 172.21.15.18:0/159816328 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043001a040 con 0x5636ff212b40 2024-09-19T09:54:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.799+0000 7f0435ffb640 1 -- 172.21.15.18:0/159816328 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043001c040 con 0x5636ff212b40 2024-09-19T09:54:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.799+0000 7f0435ffb640 1 -- 172.21.15.18:0/159816328 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04300158a0 con 0x5636ff212b40 2024-09-19T09:54:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.800+0000 7f0448725740 1 -- 172.21.15.18:0/159816328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff212b40 msgr2=0x5636ff214660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.800+0000 7f0448725740 1 --2- 172.21.15.18:0/159816328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff212b40 0x5636ff214660 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f043000a510 tx=0x7f043000a400 comp rx=0 tx=0).stop 2024-09-19T09:54:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.801+0000 7f0448725740 1 -- 172.21.15.18:0/159816328 shutdown_connections 2024-09-19T09:54:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.801+0000 7f0448725740 1 --2- 172.21.15.18:0/159816328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff21c370 0x5636ff233cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.801+0000 7f0448725740 1 --2- 172.21.15.18:0/159816328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff212b40 0x5636ff214660 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.801+0000 7f0448725740 1 --2- 172.21.15.18:0/159816328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff2115d0 0x5636ff214120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.801+0000 7f0448725740 1 -- 172.21.15.18:0/159816328 >> 172.21.15.18:0/159816328 conn(0x5636ff1da310 msgr2=0x5636ff2198d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.801+0000 7f0448725740 1 -- 172.21.15.18:0/159816328 shutdown_connections 2024-09-19T09:54:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.801+0000 7f0448725740 1 -- 172.21.15.18:0/159816328 wait complete. 2024-09-19T09:54:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.802+0000 7f0448725740 1 -- start start 2024-09-19T09:54:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.802+0000 7f0448725740 1 Processor -- start 2024-09-19T09:54:44.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.803+0000 7f0448725740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff2115d0 0x5636ff2247e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.803+0000 7f0448725740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff212b40 0x5636ff224d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.804+0000 7f0448725740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.804+0000 7f0448725740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04401bd830 con 0x5636ff21c370 2024-09-19T09:54:44.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.804+0000 7f0448725740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f04401bd160 con 0x5636ff212b40 2024-09-19T09:54:44.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.804+0000 7f0448725740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0440072af0 con 0x5636ff2115d0 2024-09-19T09:54:44.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.804+0000 7f0448725740 10 client.0 _ll_register_callbacks cb 0x7f0428005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:44.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.805+0000 7f04448e9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.805+0000 7f04448e9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55392/0 (socket says 172.21.15.18:55392) 2024-09-19T09:54:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.805+0000 7f04448e9640 1 -- 172.21.15.18:0/451012829 learned_addr learned my addr 172.21.15.18:0/451012829 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.805+0000 7f04448e9640 1 -- 172.21.15.18:0/451012829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff2115d0 msgr2=0x5636ff2247e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.805+0000 7f04448e9640 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff2115d0 0x5636ff2247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.805+0000 7f04448e9640 1 -- 172.21.15.18:0/451012829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff212b40 msgr2=0x5636ff224d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.805+0000 7f04448e9640 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff212b40 0x5636ff224d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.805+0000 7f04448e9640 1 -- 172.21.15.18:0/451012829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636ff2203d0 con 0x5636ff21c370 2024-09-19T09:54:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.806+0000 7f04448e9640 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21fba0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0438004fd0 tx=0x7f04380047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6bf08bc74dfcfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.806+0000 7f041f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.807+0000 7f041f7fe640 1 -- 172.21.15.18:0/451012829 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438028060 con 0x5636ff21c370 2024-09-19T09:54:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.807+0000 7f041f7fe640 1 -- 172.21.15.18:0/451012829 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0438006560 con 0x5636ff21c370 2024-09-19T09:54:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.807+0000 7f0448725740 1 -- 172.21.15.18:0/451012829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f043001c040 con 0x5636ff21c370 2024-09-19T09:54:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.807+0000 7f041f7fe640 1 -- 172.21.15.18:0/451012829 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0438018890 con 0x5636ff21c370 2024-09-19T09:54:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.808+0000 7f0448725740 10 client.16197 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.808+0000 7f0448725740 1 -- 172.21.15.18:0/451012829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5636ff296910 con 0x5636ff21c370 2024-09-19T09:54:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.809+0000 7f041f7fe640 1 -- 172.21.15.18:0/451012829 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043001c040 con 0x5636ff21c370 2024-09-19T09:54:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.810+0000 7f041f7fe640 1 -- 172.21.15.18:0/451012829 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f043802ca10 con 0x5636ff21c370 2024-09-19T09:54:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.810+0000 7f0448725740 10 client.16197 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.810+0000 7f0448725740 10 client.16197 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:54:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.810+0000 7f0448725740 20 client.16197 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.810+0000 7f0448725740 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5636ff2970a0 0x5636ff299500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:44.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.810+0000 7f0448725740 4 client.16197 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:54:44.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.810+0000 7f0448725740 1 -- 172.21.15.18:0/451012829 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5636ff17ed70 con 0x5636ff2970a0 2024-09-19T09:54:44.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.812+0000 7f043ffff640 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5636ff2970a0 0x5636ff299500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:44.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.814+0000 7f041f7fe640 10 client.16197 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:54:44.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.814+0000 7f043ffff640 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5636ff2970a0 0x5636ff299500 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1263aa2350dfad47 server_cookie=7b29b0b5ef7bfd30 in_seq=0 out_seq=0 2024-09-19T09:54:44.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f041f7fe640 1 -- 172.21.15.18:0/451012829 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5636ff17ed70 con 0x5636ff2970a0 2024-09-19T09:54:44.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f041f7fe640 10 client.16197 handle_command_reply: tid=0 2024-09-19T09:54:44.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f0448725740 1 client.16197 shutdown 2024-09-19T09:54:44.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f0448725740 1 -- 172.21.15.18:0/451012829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 msgr2=0x5636ff21fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f0448725740 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21fba0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0438004fd0 tx=0x7f04380047d0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f0448725740 1 -- 172.21.15.18:0/451012829 shutdown_connections 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f0448725740 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5636ff2970a0 0x5636ff299500 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f041f7fe640 0 client.16197 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f0448725740 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5636ff21c370 0x5636ff21fba0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f0448725740 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5636ff212b40 0x5636ff224d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f0448725740 1 --2- 172.21.15.18:0/451012829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636ff2115d0 0x5636ff2247e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.815+0000 7f0448725740 1 -- 172.21.15.18:0/451012829 >> 172.21.15.18:0/451012829 conn(0x5636ff1da310 msgr2=0x5636ff2190b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.816+0000 7f0448725740 1 -- 172.21.15.18:0/451012829 shutdown_connections 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.816+0000 7f0448725740 1 -- 172.21.15.18:0/451012829 wait complete. 2024-09-19T09:54:44.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.816+0000 7f0448725740 20 client.16197 trim_cache size 0 max 16384 2024-09-19T09:54:44.820 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:54:44.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.817+0000 7f044634c640 1 -- 172.21.15.18:0/61790764 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f042c0a32c0 msgr2=0x7f042c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:44.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.817+0000 7f044634c640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f042c0a32c0 0x7f042c0a5780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f043800bf20 tx=0x7f0438006960 comp rx=0 tx=0).stop 2024-09-19T09:54:44.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.817+0000 7f044634c640 1 -- 172.21.15.18:0/61790764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0440100a80 msgr2=0x7f0440108cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:44.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.817+0000 7f044634c640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0440100a80 0x7f0440108cf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f042802a940 tx=0x7f0428003c00 comp rx=0 tx=0).stop 2024-09-19T09:54:44.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.818+0000 7f044634c640 1 -- 172.21.15.18:0/61790764 shutdown_connections 2024-09-19T09:54:44.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.818+0000 7f044634c640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f042c0a32c0 0x7f042c0a5780 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.818+0000 7f044634c640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0440106a80 0x7f0440109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.818+0000 7f044634c640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0440101420 0x7f0440109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.818+0000 7f044634c640 1 --2- 172.21.15.18:0/61790764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0440100a80 0x7f0440108cf0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:44.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.818+0000 7f044634c640 1 -- 172.21.15.18:0/61790764 >> 172.21.15.18:0/61790764 conn(0x7f04400fc7a0 msgr2=0x7f0440104c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:44.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.818+0000 7f044634c640 1 -- 172.21.15.18:0/61790764 shutdown_connections 2024-09-19T09:54:44.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:44.818+0000 7f044634c640 1 -- 172.21.15.18:0/61790764 wait complete. 2024-09-19T09:54:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.144+0000 7ff27cccf640 1 -- 172.21.15.18:0/12189278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff27810dbb0 msgr2=0x7ff278110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.144+0000 7ff27cccf640 1 --2- 172.21.15.18:0/12189278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff27810dbb0 0x7ff278110070 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff270009ca0 tx=0x7ff27002a8f0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.145+0000 7ff27cccf640 1 -- 172.21.15.18:0/12189278 shutdown_connections 2024-09-19T09:54:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.145+0000 7ff27cccf640 1 --2- 172.21.15.18:0/12189278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff27810dbb0 0x7ff278110070 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.145+0000 7ff27cccf640 1 --2- 172.21.15.18:0/12189278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278073680 0x7ff27810d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.145+0000 7ff27cccf640 1 --2- 172.21.15.18:0/12189278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff278072cb0 0x7ff2780730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.145+0000 7ff27cccf640 1 -- 172.21.15.18:0/12189278 >> 172.21.15.18:0/12189278 conn(0x7ff27806eb50 msgr2=0x7ff278070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.146+0000 7ff27cccf640 1 -- 172.21.15.18:0/12189278 shutdown_connections 2024-09-19T09:54:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.150+0000 7ff27cccf640 1 -- 172.21.15.18:0/12189278 wait complete. 2024-09-19T09:54:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.151+0000 7ff27cccf640 1 Processor -- start 2024-09-19T09:54:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.152+0000 7ff27cccf640 1 -- start start 2024-09-19T09:54:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.152+0000 7ff27cccf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278072cb0 0x7ff2781157b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.152+0000 7ff27cccf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff278073680 0x7ff278115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.152+0000 7ff27cccf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff27810dbb0 0x7ff2781b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.152+0000 7ff27cccf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff27811c540 con 0x7ff27810dbb0 2024-09-19T09:54:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.152+0000 7ff27cccf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff27811c3c0 con 0x7ff278072cb0 2024-09-19T09:54:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.152+0000 7ff27cccf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff27811c6c0 con 0x7ff278073680 2024-09-19T09:54:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.153+0000 7ff277fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff27810dbb0 0x7ff2781b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.153+0000 7ff277fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff27810dbb0 0x7ff2781b6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55412/0 (socket says 172.21.15.18:55412) 2024-09-19T09:54:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.153+0000 7ff277fff640 1 -- 172.21.15.18:0/1663143649 learned_addr learned my addr 172.21.15.18:0/1663143649 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.154+0000 7ff277fff640 1 -- 172.21.15.18:0/1663143649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff278073680 msgr2=0x7ff278115cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:54:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.154+0000 7ff277fff640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff278073680 0x7ff278115cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.154+0000 7ff277fff640 1 -- 172.21.15.18:0/1663143649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278072cb0 msgr2=0x7ff2781157b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:54:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.154+0000 7ff277fff640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278072cb0 0x7ff2781157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.154+0000 7ff277fff640 1 -- 172.21.15.18:0/1663143649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff278118e70 con 0x7ff27810dbb0 2024-09-19T09:54:45.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.155+0000 7ff277fff640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff27810dbb0 0x7ff2781b6c50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff270003f10 tx=0x7ff270003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.156+0000 7ff274ff9640 1 -- 172.21.15.18:0/1663143649 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270004340 con 0x7ff27810dbb0 2024-09-19T09:54:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.156+0000 7ff274ff9640 1 -- 172.21.15.18:0/1663143649 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff27002d070 con 0x7ff27810dbb0 2024-09-19T09:54:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.157+0000 7ff274ff9640 1 -- 172.21.15.18:0/1663143649 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270030850 con 0x7ff27810dbb0 2024-09-19T09:54:45.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.158+0000 7ff27cccf640 1 -- 172.21.15.18:0/1663143649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2781b7190 con 0x7ff27810dbb0 2024-09-19T09:54:45.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.158+0000 7ff27cccf640 1 -- 172.21.15.18:0/1663143649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2781b7620 con 0x7ff27810dbb0 2024-09-19T09:54:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.165+0000 7ff280cd1740 1 Processor -- start 2024-09-19T09:54:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.166+0000 7ff280cd1740 1 -- start start 2024-09-19T09:54:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.166+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55747867feb0 0x5574786802b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.166+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x5574786852b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.166+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557478685880 0x557478687d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.166+0000 7ff280cd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5574785e32f0 con 0x557478685880 2024-09-19T09:54:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.166+0000 7ff280cd1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55747858b270 con 0x5574786807f0 2024-09-19T09:54:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.166+0000 7ff280cd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5574785df2b0 con 0x55747867feb0 2024-09-19T09:54:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.176+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x5574786852b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.176+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x5574786852b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43512/0 (socket says 172.21.15.18:43512) 2024-09-19T09:54:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.176+0000 7ff2777fe640 1 -- 172.21.15.18:0/1623002959 learned_addr learned my addr 172.21.15.18:0/1623002959 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.177+0000 7ff2777fe640 1 -- 172.21.15.18:0/1623002959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55747867feb0 msgr2=0x5574786802b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:54:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.177+0000 7ff2777fe640 1 --2- 172.21.15.18:0/1623002959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55747867feb0 0x5574786802b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.177+0000 7ff2777fe640 1 -- 172.21.15.18:0/1623002959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557478685880 msgr2=0x557478687d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:54:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.177+0000 7ff2777fe640 1 --2- 172.21.15.18:0/1623002959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557478685880 0x557478687d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.177+0000 7ff2777fe640 1 -- 172.21.15.18:0/1623002959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747858a340 con 0x5574786807f0 2024-09-19T09:54:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.177+0000 7ff2777fe640 1 --2- 172.21.15.18:0/1623002959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x5574786852b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff26802b810 tx=0x7ff26802bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cde29d827a251c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.181+0000 7ff274ff9640 1 -- 172.21.15.18:0/1663143649 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff2700044e0 con 0x7ff27810dbb0 2024-09-19T09:54:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.181+0000 7ff25d7fa640 1 -- 172.21.15.18:0/1623002959 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268037020 con 0x5574786807f0 2024-09-19T09:54:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.181+0000 7ff25d7fa640 1 -- 172.21.15.18:0/1623002959 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26802ddc0 con 0x5574786807f0 2024-09-19T09:54:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.181+0000 7ff25d7fa640 1 -- 172.21.15.18:0/1623002959 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268032390 con 0x5574786807f0 2024-09-19T09:54:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.186+0000 7ff280cd1740 1 -- 172.21.15.18:0/1623002959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 msgr2=0x5574786852b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.187+0000 7ff280cd1740 1 --2- 172.21.15.18:0/1623002959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x5574786852b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff26802b810 tx=0x7ff26802bcd0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.187+0000 7ff280cd1740 1 -- 172.21.15.18:0/1623002959 shutdown_connections 2024-09-19T09:54:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.187+0000 7ff280cd1740 1 --2- 172.21.15.18:0/1623002959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557478685880 0x557478687d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.187+0000 7ff280cd1740 1 --2- 172.21.15.18:0/1623002959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x5574786852b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.187+0000 7ff280cd1740 1 --2- 172.21.15.18:0/1623002959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55747867feb0 0x5574786802b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.187+0000 7ff280cd1740 1 -- 172.21.15.18:0/1623002959 >> 172.21.15.18:0/1623002959 conn(0x55747867b520 msgr2=0x55747867b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.188+0000 7ff280cd1740 1 -- 172.21.15.18:0/1623002959 shutdown_connections 2024-09-19T09:54:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.193+0000 7ff280cd1740 1 -- 172.21.15.18:0/1623002959 wait complete. 2024-09-19T09:54:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.194+0000 7ff280cd1740 1 -- start start 2024-09-19T09:54:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.194+0000 7ff280cd1740 1 Processor -- start 2024-09-19T09:54:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.194+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55747867feb0 0x557478689e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.194+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x55747868a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.195+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557478685880 0x5574786913a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.195+0000 7ff280cd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557478688760 con 0x557478685880 2024-09-19T09:54:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.195+0000 7ff280cd1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55747856c290 con 0x5574786807f0 2024-09-19T09:54:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.195+0000 7ff280cd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5574786888e0 con 0x55747867feb0 2024-09-19T09:54:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.195+0000 7ff280cd1740 10 client.0 _ll_register_callbacks cb 0x55747859d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.196+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x55747868a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.196+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x55747868a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43516/0 (socket says 172.21.15.18:43516) 2024-09-19T09:54:45.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.196+0000 7ff2777fe640 1 -- 172.21.15.18:0/512445363 learned_addr learned my addr 172.21.15.18:0/512445363 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:45.201 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.198+0000 7ff274ff9640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff2600a3250 0x7ff2600a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.202 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.198+0000 7ff2777fe640 1 -- 172.21.15.18:0/512445363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55747867feb0 msgr2=0x557478689e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:45.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.198+0000 7ff2777fe640 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55747867feb0 0x557478689e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.198+0000 7ff2777fe640 1 -- 172.21.15.18:0/512445363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557478685880 msgr2=0x5574786913a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:45.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.198+0000 7ff2777fe640 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557478685880 0x5574786913a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.198+0000 7ff2777fe640 1 -- 172.21.15.18:0/512445363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574782f6210 con 0x5574786807f0 2024-09-19T09:54:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.204+0000 7ff2777fe640 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x55747868a3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff2680337d0 tx=0x7ff26802b550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e1c7bc60794247c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.206+0000 7ff274ff9640 1 -- 172.21.15.18:0/1663143649 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff2700f1820 con 0x7ff27810dbb0 2024-09-19T09:54:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.206+0000 7ff25b7f6640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:54:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.206+0000 7ff25b7f6640 1 -- 172.21.15.18:0/512445363 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268037030 con 0x5574786807f0 2024-09-19T09:54:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.207+0000 7ff280cd1740 1 -- 172.21.15.18:0/512445363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff26802ddc0 con 0x5574786807f0 2024-09-19T09:54:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.207+0000 7ff25b7f6640 1 -- 172.21.15.18:0/512445363 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff26802d960 con 0x5574786807f0 2024-09-19T09:54:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.211+0000 7ff25b7f6640 1 -- 172.21.15.18:0/512445363 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff26804d070 con 0x5574786807f0 2024-09-19T09:54:45.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.216+0000 7ff277fff640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff2600a3250 0x7ff2600a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:45.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.216+0000 7ff280cd1740 10 client.25712 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:45.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.216+0000 7ff280cd1740 1 -- 172.21.15.18:0/512445363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574783c2620 con 0x5574786807f0 2024-09-19T09:54:45.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.217+0000 7ff25b7f6640 1 -- 172.21.15.18:0/512445363 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26802db60 con 0x5574786807f0 2024-09-19T09:54:45.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.219+0000 7ff25b7f6640 1 -- 172.21.15.18:0/512445363 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff268032070 con 0x5574786807f0 2024-09-19T09:54:45.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.233+0000 7ff280cd1740 10 client.25712 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:45.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.233+0000 7ff280cd1740 10 client.25712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:45.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.233+0000 7ff280cd1740 20 client.25712 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.233+0000 7ff280cd1740 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x557478695790 0x557478697b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.233+0000 7ff280cd1740 4 client.25712 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.233+0000 7ff280cd1740 1 -- 172.21.15.18:0/512445363 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff26802ddc0 con 0x557478695790 2024-09-19T09:54:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.238+0000 7ff276ffd640 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x557478695790 0x557478697b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.239+0000 7ff277fff640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff2600a3250 0x7ff2600a5710 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff270030040 tx=0x7ff2700095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.244+0000 7ff276ffd640 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x557478695790 0x557478697b80 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96c981d633b2b1b8 server_cookie=cf18bcb085b84170 in_seq=0 out_seq=0 2024-09-19T09:54:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.245+0000 7ff25b7f6640 10 client.25712 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.248+0000 7ff25b7f6640 1 -- 172.21.15.18:0/512445363 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff26802ddc0 con 0x557478695790 2024-09-19T09:54:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.248+0000 7ff25b7f6640 10 client.25712 handle_command_reply: tid=0 2024-09-19T09:54:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.248+0000 7ff280cd1740 1 client.25712 shutdown 2024-09-19T09:54:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff280cd1740 1 -- 172.21.15.18:0/512445363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 msgr2=0x55747868a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff280cd1740 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x55747868a3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff2680337d0 tx=0x7ff26802b550 comp rx=0 tx=0).stop 2024-09-19T09:54:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff280cd1740 1 -- 172.21.15.18:0/512445363 shutdown_connections 2024-09-19T09:54:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff280cd1740 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x557478695790 0x557478697b80 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff280cd1740 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557478685880 0x5574786913a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff280cd1740 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x55747868a3d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff280cd1740 1 --2- 172.21.15.18:0/512445363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55747867feb0 0x557478689e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff25b7f6640 0 client.25712 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff280cd1740 1 -- 172.21.15.18:0/512445363 >> 172.21.15.18:0/512445363 conn(0x55747867b520 msgr2=0x55747867cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff280cd1740 1 -- 172.21.15.18:0/512445363 shutdown_connections 2024-09-19T09:54:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.249+0000 7ff280cd1740 1 -- 172.21.15.18:0/512445363 wait complete. 2024-09-19T09:54:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.250+0000 7ff280cd1740 20 client.25712 trim_cache size 0 max 16384 2024-09-19T09:54:45.286 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.283+0000 7ff280cd1740 1 Processor -- start 2024-09-19T09:54:45.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.284+0000 7ff280cd1740 1 -- start start 2024-09-19T09:54:45.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.284+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x557478676350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.284+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574786807f0 0x557478691360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.287 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.284+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557478685880 0x55747867c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.284+0000 7ff280cd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff25400e2b0 con 0x55747867feb0 2024-09-19T09:54:45.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.284+0000 7ff280cd1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff25400fdf0 con 0x557478685880 2024-09-19T09:54:45.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.284+0000 7ff280cd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff25400e980 con 0x5574786807f0 2024-09-19T09:54:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.284+0000 7ff276ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x557478676350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.284+0000 7ff276ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x557478676350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55424/0 (socket says 172.21.15.18:55424) 2024-09-19T09:54:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.284+0000 7ff276ffd640 1 -- 172.21.15.18:0/2374591037 learned_addr learned my addr 172.21.15.18:0/2374591037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.285+0000 7ff276ffd640 1 -- 172.21.15.18:0/2374591037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574786807f0 msgr2=0x557478691360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.285+0000 7ff276ffd640 1 --2- 172.21.15.18:0/2374591037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574786807f0 0x557478691360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.285+0000 7ff276ffd640 1 -- 172.21.15.18:0/2374591037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557478685880 msgr2=0x55747867c3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.285+0000 7ff276ffd640 1 --2- 172.21.15.18:0/2374591037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557478685880 0x55747867c3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.285+0000 7ff276ffd640 1 -- 172.21.15.18:0/2374591037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557478650700 con 0x55747867feb0 2024-09-19T09:54:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.285+0000 7ff276ffd640 1 --2- 172.21.15.18:0/2374591037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x557478676350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x5574786982f0 tx=0x7ff26c0066a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea213dddb047fcd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.285+0000 7ff25cff9640 1 -- 172.21.15.18:0/2374591037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c006ad0 con 0x55747867feb0 2024-09-19T09:54:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.286+0000 7ff25cff9640 1 -- 172.21.15.18:0/2374591037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c012d10 con 0x55747867feb0 2024-09-19T09:54:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.286+0000 7ff25cff9640 1 -- 172.21.15.18:0/2374591037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0075a0 con 0x55747867feb0 2024-09-19T09:54:45.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.287+0000 7ff280cd1740 1 -- 172.21.15.18:0/2374591037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 msgr2=0x557478676350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:45.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.287+0000 7ff280cd1740 1 --2- 172.21.15.18:0/2374591037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x557478676350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x5574786982f0 tx=0x7ff26c0066a0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.287+0000 7ff280cd1740 1 -- 172.21.15.18:0/2374591037 shutdown_connections 2024-09-19T09:54:45.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.287+0000 7ff280cd1740 1 --2- 172.21.15.18:0/2374591037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557478685880 0x55747867c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.287+0000 7ff280cd1740 1 --2- 172.21.15.18:0/2374591037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5574786807f0 0x557478691360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.287+0000 7ff280cd1740 1 --2- 172.21.15.18:0/2374591037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x557478676350 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.287+0000 7ff280cd1740 1 -- 172.21.15.18:0/2374591037 >> 172.21.15.18:0/2374591037 conn(0x55747867b520 msgr2=0x557478689e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.287+0000 7ff280cd1740 1 -- 172.21.15.18:0/2374591037 shutdown_connections 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.287+0000 7ff280cd1740 1 -- 172.21.15.18:0/2374591037 wait complete. 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.288+0000 7ff280cd1740 1 -- start start 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.288+0000 7ff280cd1740 1 Processor -- start 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.289+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x55747868eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.289+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x55747868f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.289+0000 7ff280cd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557478685880 0x5574786900f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.289+0000 7ff280cd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff25400f720 con 0x55747867feb0 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.289+0000 7ff280cd1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff25400f050 con 0x5574786807f0 2024-09-19T09:54:45.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.289+0000 7ff280cd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff25400c340 con 0x557478685880 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.289+0000 7ff280cd1740 10 client.0 _ll_register_callbacks cb 0x7ff26802b660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.289+0000 7ff276ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x55747868eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.289+0000 7ff276ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x55747868eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55436/0 (socket says 172.21.15.18:55436) 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.289+0000 7ff276ffd640 1 -- 172.21.15.18:0/605943709 learned_addr learned my addr 172.21.15.18:0/605943709 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.290+0000 7ff276ffd640 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557478685880 0x5574786900f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.290+0000 7ff2777fe640 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x55747868f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.291+0000 7ff276ffd640 1 -- 172.21.15.18:0/605943709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 msgr2=0x55747868f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.291+0000 7ff276ffd640 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x55747868f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.291+0000 7ff276ffd640 1 -- 172.21.15.18:0/605943709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 msgr2=0x55747868eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.291+0000 7ff276ffd640 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x55747868eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:45.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.291+0000 7ff276ffd640 1 -- 172.21.15.18:0/605943709 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557478690700 con 0x557478685880 2024-09-19T09:54:45.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.291+0000 7ff276ffd640 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557478685880 0x5574786900f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55747868e170 tx=0x7ff26c007ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c8c93783019a945 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:45.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.291+0000 7ff25b7f6640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:54:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.292+0000 7ff25b7f6640 1 -- 172.21.15.18:0/605943709 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c006860 con 0x557478685880 2024-09-19T09:54:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.292+0000 7ff25b7f6640 1 -- 172.21.15.18:0/605943709 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff26c006a00 con 0x557478685880 2024-09-19T09:54:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.292+0000 7ff280cd1740 1 -- 172.21.15.18:0/605943709 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff26c012d10 con 0x557478685880 2024-09-19T09:54:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.293+0000 7ff25b7f6640 1 -- 172.21.15.18:0/605943709 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff26c006c00 con 0x557478685880 2024-09-19T09:54:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.293+0000 7ff280cd1740 10 client.25654 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.293+0000 7ff280cd1740 1 -- 172.21.15.18:0/605943709 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574787004a0 con 0x557478685880 2024-09-19T09:54:45.298 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.295+0000 7ff25b7f6640 1 -- 172.21.15.18:0/605943709 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c030070 con 0x557478685880 2024-09-19T09:54:45.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.297+0000 7ff25b7f6640 1 -- 172.21.15.18:0/605943709 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff26c028480 con 0x557478685880 2024-09-19T09:54:45.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.298+0000 7ff280cd1740 10 client.25654 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:45.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.298+0000 7ff280cd1740 10 client.25654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:45.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.298+0000 7ff280cd1740 20 client.25654 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:45.301 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.298+0000 7ff280cd1740 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x557478700df0 0x5574787031e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:45.301 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.298+0000 7ff280cd1740 4 client.25654 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:54:45.301 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.298+0000 7ff280cd1740 1 -- 172.21.15.18:0/605943709 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7ff26c012d10 con 0x557478700df0 2024-09-19T09:54:45.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.300+0000 7ff2777fe640 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x557478700df0 0x5574787031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:45.307 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.304+0000 7ff2777fe640 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x557478700df0 0x5574787031e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b706ae61d32d5742 server_cookie=3cfc2267267daa46 in_seq=0 out_seq=0 2024-09-19T09:54:45.307 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:45.304+0000 7ff25b7f6640 10 client.25654 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:45.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:54:46.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:46 smithi018 ceph-mon[30956]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 741 MiB/s wr, 1.57k op/s 2024-09-19T09:54:46.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:46 smithi049 ceph-mon[34858]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 741 MiB/s wr, 1.57k op/s 2024-09-19T09:54:46.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:46 smithi162 ceph-mon[35174]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 741 MiB/s wr, 1.57k op/s 2024-09-19T09:54:46.779 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:47.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.758+0000 7fd0be769640 1 -- 172.21.15.18:0/2332346147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b81008c0 msgr2=0x7fd0b8100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:47.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.758+0000 7fd0be769640 1 --2- 172.21.15.18:0/2332346147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b81008c0 0x7fd0b8100d20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009890 tx=0x7fd0b402a380 comp rx=0 tx=0).stop 2024-09-19T09:54:47.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.761+0000 7fd0be769640 1 -- 172.21.15.18:0/2332346147 shutdown_connections 2024-09-19T09:54:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.761+0000 7fd0be769640 1 --2- 172.21.15.18:0/2332346147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b8101260 0x7fd0b810d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.761+0000 7fd0be769640 1 --2- 172.21.15.18:0/2332346147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b81008c0 0x7fd0b8100d20 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.761+0000 7fd0be769640 1 --2- 172.21.15.18:0/2332346147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0b81068c0 0x7fd0b8106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.761+0000 7fd0be769640 1 -- 172.21.15.18:0/2332346147 >> 172.21.15.18:0/2332346147 conn(0x7fd0b80fc620 msgr2=0x7fd0b80fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.762+0000 7fd0be769640 1 -- 172.21.15.18:0/2332346147 shutdown_connections 2024-09-19T09:54:47.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.762+0000 7fd0be769640 1 -- 172.21.15.18:0/2332346147 wait complete. 2024-09-19T09:54:47.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.764+0000 7fd0be769640 1 Processor -- start 2024-09-19T09:54:47.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.764+0000 7fd0be769640 1 -- start start 2024-09-19T09:54:47.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.765+0000 7fd0be769640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b81008c0 0x7fd0b8196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.765+0000 7fd0be769640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0b8101260 0x7fd0b81968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.765+0000 7fd0be769640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b81068c0 0x7fd0b819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.765+0000 7fd0be769640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b8110d10 con 0x7fd0b81008c0 2024-09-19T09:54:47.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.765+0000 7fd0be769640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b8110b90 con 0x7fd0b81068c0 2024-09-19T09:54:47.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.765+0000 7fd0be769640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b8110e90 con 0x7fd0b8101260 2024-09-19T09:54:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.770+0000 7fd0bdf68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b81068c0 0x7fd0b819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.770+0000 7fd0bcf66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0b8101260 0x7fd0b81968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.772+0000 7fd0bdf68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b81068c0 0x7fd0b819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:51766/0 (socket says 172.21.15.18:51766) 2024-09-19T09:54:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.772+0000 7fd0bdf68640 1 -- 172.21.15.18:0/633589675 learned_addr learned my addr 172.21.15.18:0/633589675 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:47.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.777+0000 7fd0bdf68640 1 -- 172.21.15.18:0/633589675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0b8101260 msgr2=0x7fd0b81968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:47.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.777+0000 7fd0bdf68640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0b8101260 0x7fd0b81968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.777+0000 7fd0bdf68640 1 -- 172.21.15.18:0/633589675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b81008c0 msgr2=0x7fd0b8196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:47.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.777+0000 7fd0bdf68640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b81008c0 0x7fd0b8196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.777+0000 7fd0bdf68640 1 -- 172.21.15.18:0/633589675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b819b030 con 0x7fd0b81068c0 2024-09-19T09:54:47.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.784+0000 7fd0bdf68640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b81068c0 0x7fd0b819a9f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000cce0 tx=0x7fd0b000a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.790+0000 7fd0ae7fc640 1 -- 172.21.15.18:0/633589675 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b000f450 con 0x7fd0b81068c0 2024-09-19T09:54:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.790+0000 7fd0be769640 1 -- 172.21.15.18:0/633589675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b819b320 con 0x7fd0b81068c0 2024-09-19T09:54:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.790+0000 7fd0be769640 1 -- 172.21.15.18:0/633589675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b81a2ce0 con 0x7fd0b81068c0 2024-09-19T09:54:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.799+0000 7fd0c1da4740 1 Processor -- start 2024-09-19T09:54:47.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.802+0000 7fd0c1da4740 1 -- start start 2024-09-19T09:54:47.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.803+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a865d20 0x55796a864270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.803+0000 7fd0ae7fc640 1 -- 172.21.15.18:0/633589675 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0b000fad0 con 0x7fd0b81068c0 2024-09-19T09:54:47.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.803+0000 7fd0ae7fc640 1 -- 172.21.15.18:0/633589675 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0018c10 con 0x7fd0b81068c0 2024-09-19T09:54:47.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.803+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a8647b0 0x55796a864bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.804+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86f550 0x55796a871940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.804+0000 7fd0c1da4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55796a7ca2f0 con 0x55796a8647b0 2024-09-19T09:54:47.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.804+0000 7fd0c1da4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55796a771cf0 con 0x55796a86f550 2024-09-19T09:54:47.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.804+0000 7fd0c1da4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55796a7c62b0 con 0x55796a865d20 2024-09-19T09:54:47.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.807+0000 7fd0ae7fc640 1 -- 172.21.15.18:0/633589675 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd0b000f5f0 con 0x7fd0b81068c0 2024-09-19T09:54:47.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.810+0000 7fd0ae7fc640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd0a40a33e0 0x7fd0a40a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.810+0000 7fd0bcf66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a865d20 0x55796a864270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.810+0000 7fd0ae7fc640 1 -- 172.21.15.18:0/633589675 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd0b00cfc80 con 0x7fd0b81068c0 2024-09-19T09:54:47.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.811+0000 7fd0bd767640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a8647b0 0x55796a864bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.811+0000 7fd0bcf66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a865d20 0x55796a864270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:46836/0 (socket says 172.21.15.18:46836) 2024-09-19T09:54:47.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.811+0000 7fd0bcf66640 1 -- 172.21.15.18:0/2286097540 learned_addr learned my addr 172.21.15.18:0/2286097540 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:47.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.811+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/2286097540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86f550 0x55796a871940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.813+0000 7fd0bdf68640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd0a40a33e0 0x7fd0a40a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.814+0000 7fd0bdf68640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd0a40a33e0 0x7fd0a40a58a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00a4a10 tx=0x7fd0b00077a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:47.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.816+0000 7fd0bcf66640 1 -- 172.21.15.18:0/2286097540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86f550 msgr2=0x55796a871940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:47.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.816+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/2286097540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86f550 0x55796a871940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.816+0000 7fd0bcf66640 1 -- 172.21.15.18:0/2286097540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a8647b0 msgr2=0x55796a864bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:47.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.816+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/2286097540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a8647b0 0x55796a864bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.816+0000 7fd0bcf66640 1 -- 172.21.15.18:0/2286097540 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796a7563a0 con 0x55796a865d20 2024-09-19T09:54:47.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.822+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/2286097540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a865d20 0x55796a864270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40095f0 tx=0x7fd0b4005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7384c530d54ad1e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:47.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.824+0000 7fd0a37fe640 1 -- 172.21.15.18:0/2286097540 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4047070 con 0x55796a865d20 2024-09-19T09:54:47.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.824+0000 7fd0a37fe640 1 -- 172.21.15.18:0/2286097540 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0b4030820 con 0x55796a865d20 2024-09-19T09:54:47.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.826+0000 7fd0c1da4740 1 -- 172.21.15.18:0/2286097540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a865d20 msgr2=0x55796a864270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:47.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.826+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/2286097540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a865d20 0x55796a864270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40095f0 tx=0x7fd0b4005ad0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.827+0000 7fd0c1da4740 1 -- 172.21.15.18:0/2286097540 shutdown_connections 2024-09-19T09:54:47.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.827+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/2286097540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86f550 0x55796a871940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.827+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/2286097540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a8647b0 0x55796a864bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.827+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/2286097540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a865d20 0x55796a864270 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.827+0000 7fd0c1da4740 1 -- 172.21.15.18:0/2286097540 >> 172.21.15.18:0/2286097540 conn(0x55796a82d310 msgr2=0x55796a860e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:47.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.827+0000 7fd0c1da4740 1 -- 172.21.15.18:0/2286097540 shutdown_connections 2024-09-19T09:54:47.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.827+0000 7fd0c1da4740 1 -- 172.21.15.18:0/2286097540 wait complete. 2024-09-19T09:54:47.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.828+0000 7fd0c1da4740 1 -- start start 2024-09-19T09:54:47.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.829+0000 7fd0c1da4740 1 Processor -- start 2024-09-19T09:54:47.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.830+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a8647b0 0x55796a86ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.831+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 0x55796a86c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.831+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86c560 0x55796a86c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.831+0000 7fd0c1da4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55796a872240 con 0x55796a8647b0 2024-09-19T09:54:47.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.831+0000 7fd0c1da4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55796a785060 con 0x55796a86c560 2024-09-19T09:54:47.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.831+0000 7fd0c1da4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55796a8723c0 con 0x55796a86f550 2024-09-19T09:54:47.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.831+0000 7fd0c1da4740 10 client.0 _ll_register_callbacks cb 0x55796a4d88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:47.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.835+0000 7fd0bd767640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 0x55796a86c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.835+0000 7fd0bd767640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 0x55796a86c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:46842/0 (socket says 172.21.15.18:46842) 2024-09-19T09:54:47.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.835+0000 7fd0bd767640 1 -- 172.21.15.18:0/3704236724 learned_addr learned my addr 172.21.15.18:0/3704236724 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:47.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.835+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86c560 0x55796a86c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.844+0000 7fd0bd767640 1 -- 172.21.15.18:0/3704236724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86c560 msgr2=0x55796a86c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.844+0000 7fd0bd767640 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86c560 0x55796a86c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.844+0000 7fd0bd767640 1 -- 172.21.15.18:0/3704236724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a8647b0 msgr2=0x55796a86ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.844+0000 7fd0bd767640 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a8647b0 0x55796a86ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.844+0000 7fd0bd767640 1 -- 172.21.15.18:0/3704236724 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796a53b3c0 con 0x55796a86f550 2024-09-19T09:54:47.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.850+0000 7fd0bd767640 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 0x55796a86c020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8011690 tx=0x7fd0a8011b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea62fd32e8320c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:47.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.851+0000 7fd0a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:54:47.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.856+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3704236724 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a801f060 con 0x55796a86f550 2024-09-19T09:54:47.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.856+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3704236724 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd0a800fac0 con 0x55796a86f550 2024-09-19T09:54:47.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.856+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3704236724 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55796a7d7860 con 0x55796a86f550 2024-09-19T09:54:47.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.857+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3704236724 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd0a800fd00 con 0x55796a86f550 2024-09-19T09:54:47.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.857+0000 7fd0c1da4740 10 client.25666 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:47.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.857+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3704236724 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55796a87e0e0 con 0x55796a86f550 2024-09-19T09:54:47.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.858+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3704236724 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55796a7d7860 con 0x55796a86f550 2024-09-19T09:54:47.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.860+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3704236724 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd0a8025440 con 0x55796a86f550 2024-09-19T09:54:47.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.860+0000 7fd0c1da4740 10 client.25666 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:47.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.860+0000 7fd0c1da4740 10 client.25666 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:54:47.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.860+0000 7fd0c1da4740 20 client.25666 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:47.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.860+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55796a87f970 0x55796a881df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.861+0000 7fd0c1da4740 4 client.25666 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:47.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.861+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3704236724 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55796a7d1d70 con 0x55796a87f970 2024-09-19T09:54:47.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.862+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55796a87f970 0x55796a881df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.864+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55796a87f970 0x55796a881df0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f1d9b1c4cee8fc29 server_cookie=94940af8b46afaed in_seq=0 out_seq=0 2024-09-19T09:54:47.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.864+0000 7fd0a0ff9640 10 client.25666 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:54:47.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.867+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3704236724 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55796a7d1d70 con 0x55796a87f970 2024-09-19T09:54:47.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.867+0000 7fd0a0ff9640 10 client.25666 handle_command_reply: tid=0 2024-09-19T09:54:47.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.867+0000 7fd0c1da4740 1 client.25666 shutdown 2024-09-19T09:54:47.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.867+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3704236724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 msgr2=0x55796a86c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:47.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.867+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 0x55796a86c020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8011690 tx=0x7fd0a8011b50 comp rx=0 tx=0).stop 2024-09-19T09:54:47.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.868+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3704236724 shutdown_connections 2024-09-19T09:54:47.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.868+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55796a87f970 0x55796a881df0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.868+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86c560 0x55796a86c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.868+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 0x55796a86c020 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.868+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3704236724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a8647b0 0x55796a86ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.868+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3704236724 >> 172.21.15.18:0/3704236724 conn(0x55796a82d310 msgr2=0x55796a866ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:47.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.868+0000 7fd0a0ff9640 0 client.25666 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:54:47.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.869+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3704236724 shutdown_connections 2024-09-19T09:54:47.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.869+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3704236724 wait complete. 2024-09-19T09:54:47.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.869+0000 7fd0c1da4740 20 client.25666 trim_cache size 0 max 16384 2024-09-19T09:54:47.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.933+0000 7fd0c1da4740 1 Processor -- start 2024-09-19T09:54:47.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.933+0000 7fd0c1da4740 1 -- start start 2024-09-19T09:54:47.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.934+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a8647b0 0x55796a86b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.934+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 0x55796a867300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.935+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86f550 0x55796a887700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.935+0000 7fd0bd767640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 0x55796a867300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.935+0000 7fd0c1da4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c00e310 con 0x55796a86c560 2024-09-19T09:54:47.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.935+0000 7fd0c1da4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c00fe50 con 0x55796a86f550 2024-09-19T09:54:47.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.935+0000 7fd0c1da4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c00e9e0 con 0x55796a8647b0 2024-09-19T09:54:47.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.938+0000 7fd0bd767640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 0x55796a867300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49746/0 (socket says 172.21.15.18:49746) 2024-09-19T09:54:47.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.938+0000 7fd0bd767640 1 -- 172.21.15.18:0/2223627232 learned_addr learned my addr 172.21.15.18:0/2223627232 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:47.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.939+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/2223627232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a8647b0 0x55796a86b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.939+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/2223627232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86f550 0x55796a887700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.942+0000 7fd0bd767640 1 -- 172.21.15.18:0/2223627232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a8647b0 msgr2=0x55796a86b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:47.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.942+0000 7fd0bd767640 1 --2- 172.21.15.18:0/2223627232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a8647b0 0x55796a86b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.942+0000 7fd0bd767640 1 -- 172.21.15.18:0/2223627232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86f550 msgr2=0x55796a887700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:47.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.942+0000 7fd0bd767640 1 --2- 172.21.15.18:0/2223627232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86f550 0x55796a887700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.942+0000 7fd0bd767640 1 -- 172.21.15.18:0/2223627232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796a861380 con 0x55796a86c560 2024-09-19T09:54:47.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.962+0000 7fd0bd767640 1 --2- 172.21.15.18:0/2223627232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 0x55796a867300 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80092a0 tx=0x7fd0a8011fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b853daae31274c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:47.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.963+0000 7fd0a2ffd640 1 -- 172.21.15.18:0/2223627232 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8033070 con 0x55796a86c560 2024-09-19T09:54:47.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.963+0000 7fd0a2ffd640 1 -- 172.21.15.18:0/2223627232 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0a8005df0 con 0x55796a86c560 2024-09-19T09:54:47.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.963+0000 7fd0a2ffd640 1 -- 172.21.15.18:0/2223627232 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a802a040 con 0x55796a86c560 2024-09-19T09:54:47.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.965+0000 7fd0c1da4740 1 -- 172.21.15.18:0/2223627232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 msgr2=0x55796a867300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:47.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.965+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/2223627232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 0x55796a867300 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80092a0 tx=0x7fd0a8011fd0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.965+0000 7fd0c1da4740 1 -- 172.21.15.18:0/2223627232 shutdown_connections 2024-09-19T09:54:47.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.965+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/2223627232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a86f550 0x55796a887700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.965+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/2223627232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 0x55796a867300 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.965+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/2223627232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a8647b0 0x55796a86b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.965+0000 7fd0c1da4740 1 -- 172.21.15.18:0/2223627232 >> 172.21.15.18:0/2223627232 conn(0x55796a82d310 msgr2=0x55796a86a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:47.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.965+0000 7fd0c1da4740 1 -- 172.21.15.18:0/2223627232 shutdown_connections 2024-09-19T09:54:47.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.965+0000 7fd0c1da4740 1 -- 172.21.15.18:0/2223627232 wait complete. 2024-09-19T09:54:47.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.966+0000 7fd0c1da4740 1 -- start start 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.966+0000 7fd0c1da4740 1 Processor -- start 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.967+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a8647b0 0x55796a869cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.968+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 0x55796a877730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.968+0000 7fd0c1da4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 0x55796a877ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.968+0000 7fd0c1da4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c00f780 con 0x55796a86c560 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.968+0000 7fd0bcf66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a8647b0 0x55796a869cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.968+0000 7fd0bcf66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a8647b0 0x55796a869cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:51800/0 (socket says 172.21.15.18:51800) 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.968+0000 7fd0bcf66640 1 -- 172.21.15.18:0/3266229600 learned_addr learned my addr 172.21.15.18:0/3266229600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.968+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3266229600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c00f0b0 con 0x55796a8647b0 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.968+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3266229600 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c00c3a0 con 0x55796a86f550 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.969+0000 7fd0c1da4740 10 client.0 _ll_register_callbacks cb 0x7fd0a8009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.969+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 0x55796a877ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:47.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.971+0000 7fd0bcf66640 1 -- 172.21.15.18:0/3266229600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 msgr2=0x55796a877ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:47.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.971+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 0x55796a877ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.971+0000 7fd0bcf66640 1 -- 172.21.15.18:0/3266229600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 msgr2=0x55796a877730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:47.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.971+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 0x55796a877730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:47.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.971+0000 7fd0bcf66640 1 -- 172.21.15.18:0/3266229600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796a861b40 con 0x55796a8647b0 2024-09-19T09:54:47.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.983+0000 7fd0bcf66640 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a8647b0 0x55796a869cc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4030d50 tx=0x7fd0b4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23a87acb858a4933 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:47.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.984+0000 7fd0a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:54:47.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.986+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3266229600 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4047040 con 0x55796a8647b0 2024-09-19T09:54:47.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.986+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3266229600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0a8005df0 con 0x55796a8647b0 2024-09-19T09:54:47.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.986+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3266229600 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd0b40035f0 con 0x55796a8647b0 2024-09-19T09:54:47.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.989+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3266229600 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd0b405e050 con 0x55796a8647b0 2024-09-19T09:54:47.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.989+0000 7fd0c1da4740 10 client.25730 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:47.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.989+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3266229600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55796a8e97e0 con 0x55796a8647b0 2024-09-19T09:54:47.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.990+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3266229600 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0a8005df0 con 0x55796a8647b0 2024-09-19T09:54:47.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.990+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3266229600 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd0b404c2f0 con 0x55796a8647b0 2024-09-19T09:54:47.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.991+0000 7fd0c1da4740 10 client.25730 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:47.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.991+0000 7fd0c1da4740 10 client.25730 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:54:47.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.991+0000 7fd0c1da4740 20 client.25730 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:47.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.991+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55796a8e9e80 0x55796a8ec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:47.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.991+0000 7fd0c1da4740 4 client.25730 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:54:47.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.991+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3266229600 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55796a74e170 con 0x55796a8e9e80 2024-09-19T09:54:47.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:47.995+0000 7fd0bd767640 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55796a8e9e80 0x55796a8ec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.002+0000 7fd0bd767640 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55796a8e9e80 0x55796a8ec2e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=66e5341e07ee1c76 server_cookie=4284ef3c40da262c in_seq=0 out_seq=0 2024-09-19T09:54:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.002+0000 7fd0a0ff9640 10 client.25730 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:54:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.003+0000 7fd0a0ff9640 1 -- 172.21.15.18:0/3266229600 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55796a74e170 con 0x55796a8e9e80 2024-09-19T09:54:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.003+0000 7fd0a0ff9640 10 client.25730 handle_command_reply: tid=0 2024-09-19T09:54:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.003+0000 7fd0c1da4740 1 client.25730 shutdown 2024-09-19T09:54:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.004+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3266229600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a8647b0 msgr2=0x55796a869cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.004+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a8647b0 0x55796a869cc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4030d50 tx=0x7fd0b4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:54:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.004+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3266229600 shutdown_connections 2024-09-19T09:54:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.004+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55796a8e9e80 0x55796a8ec2e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.004+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55796a86f550 0x55796a877ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.004+0000 7fd0a0ff9640 0 client.25730 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:54:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.004+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55796a86c560 0x55796a877730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.004+0000 7fd0c1da4740 1 --2- 172.21.15.18:0/3266229600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55796a8647b0 0x55796a869cc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:48.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.004+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3266229600 >> 172.21.15.18:0/3266229600 conn(0x55796a82d310 msgr2=0x55796a86a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:48.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.005+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3266229600 shutdown_connections 2024-09-19T09:54:48.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.005+0000 7fd0c1da4740 1 -- 172.21.15.18:0/3266229600 wait complete. 2024-09-19T09:54:48.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.006+0000 7fd0c1da4740 20 client.25730 trim_cache size 0 max 16384 2024-09-19T09:54:48.009 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:54:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.008+0000 7fd0be769640 1 -- 172.21.15.18:0/633589675 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd0a40a33e0 msgr2=0x7fd0a40a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.008+0000 7fd0be769640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd0a40a33e0 0x7fd0a40a58a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00a4a10 tx=0x7fd0b00077a0 comp rx=0 tx=0).stop 2024-09-19T09:54:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.008+0000 7fd0be769640 1 -- 172.21.15.18:0/633589675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b81068c0 msgr2=0x7fd0b819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.008+0000 7fd0be769640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b81068c0 0x7fd0b819a9f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000cce0 tx=0x7fd0b000a620 comp rx=0 tx=0).stop 2024-09-19T09:54:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.008+0000 7fd0be769640 1 -- 172.21.15.18:0/633589675 shutdown_connections 2024-09-19T09:54:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.008+0000 7fd0be769640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd0a40a33e0 0x7fd0a40a58a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.008+0000 7fd0be769640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b81068c0 0x7fd0b819a9f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.008+0000 7fd0be769640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0b8101260 0x7fd0b81968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.008+0000 7fd0be769640 1 --2- 172.21.15.18:0/633589675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b81008c0 0x7fd0b8196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.008+0000 7fd0be769640 1 -- 172.21.15.18:0/633589675 >> 172.21.15.18:0/633589675 conn(0x7fd0b80fc620 msgr2=0x7fd0b81023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.009+0000 7fd0be769640 1 -- 172.21.15.18:0/633589675 shutdown_connections 2024-09-19T09:54:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:48.009+0000 7fd0be769640 1 -- 172.21.15.18:0/633589675 wait complete. 2024-09-19T09:54:48.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:48 smithi018 ceph-mon[30956]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 859 MiB/s wr, 1.99k op/s 2024-09-19T09:54:48.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:48 smithi049 ceph-mon[34858]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 859 MiB/s wr, 1.99k op/s 2024-09-19T09:54:48.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:48 smithi162 ceph-mon[35174]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 859 MiB/s wr, 1.99k op/s 2024-09-19T09:54:48.949 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:54:49.975 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:50.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:50 smithi018 ceph-mon[30956]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 824 MiB/s wr, 2.14k op/s 2024-09-19T09:54:50.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:50 smithi049 ceph-mon[34858]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 824 MiB/s wr, 2.14k op/s 2024-09-19T09:54:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:50 smithi162 ceph-mon[35174]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 824 MiB/s wr, 2.14k op/s 2024-09-19T09:54:50.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.698+0000 7f7cb57fe640 1 -- 172.21.15.18:0/2485309836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cb0109450 msgr2=0x7f7cb0110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.698+0000 7f7cb57fe640 1 --2- 172.21.15.18:0/2485309836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cb0109450 0x7f7cb0110250 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009900 tx=0x7f7ca002a440 comp rx=0 tx=0).stop 2024-09-19T09:54:50.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.699+0000 7f7cb57fe640 1 -- 172.21.15.18:0/2485309836 shutdown_connections 2024-09-19T09:54:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.699+0000 7f7cb57fe640 1 --2- 172.21.15.18:0/2485309836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cb011b140 0x7f7cb011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.699+0000 7f7cb57fe640 1 --2- 172.21.15.18:0/2485309836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb0109830 0x7f7cb0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.699+0000 7f7cb57fe640 1 --2- 172.21.15.18:0/2485309836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cb0109450 0x7f7cb0110250 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.699+0000 7f7cb57fe640 1 -- 172.21.15.18:0/2485309836 >> 172.21.15.18:0/2485309836 conn(0x7f7cb006e140 msgr2=0x7f7cb006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.699+0000 7f7cb57fe640 1 -- 172.21.15.18:0/2485309836 shutdown_connections 2024-09-19T09:54:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.699+0000 7f7cb57fe640 1 -- 172.21.15.18:0/2485309836 wait complete. 2024-09-19T09:54:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.700+0000 7f7cb57fe640 1 Processor -- start 2024-09-19T09:54:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.700+0000 7f7cb57fe640 1 -- start start 2024-09-19T09:54:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.700+0000 7f7cb57fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cb0109450 0x7f7cb01a7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.701+0000 7f7cb57fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cb0109830 0x7f7cb01a79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.701+0000 7f7cb57fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb011b140 0x7f7cb01abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.701+0000 7f7cb57fe640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb0120e80 con 0x7f7cb0109450 2024-09-19T09:54:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.701+0000 7f7cb57fe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb0120d00 con 0x7f7cb0109830 2024-09-19T09:54:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.701+0000 7f7cb57fe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb0121000 con 0x7f7cb011b140 2024-09-19T09:54:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.701+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cb0109450 0x7f7cb01a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.701+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cb0109450 0x7f7cb01a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49772/0 (socket says 172.21.15.18:49772) 2024-09-19T09:54:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.701+0000 7f7caeffd640 1 -- 172.21.15.18:0/109919720 learned_addr learned my addr 172.21.15.18:0/109919720 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.701+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb011b140 0x7f7cb01abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.702+0000 7f7caeffd640 1 -- 172.21.15.18:0/109919720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb011b140 msgr2=0x7f7cb01abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.702+0000 7f7caeffd640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb011b140 0x7f7cb01abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.702+0000 7f7caeffd640 1 -- 172.21.15.18:0/109919720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cb0109830 msgr2=0x7f7cb01a79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.702+0000 7f7caeffd640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cb0109830 0x7f7cb01a79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.702+0000 7f7caeffd640 1 -- 172.21.15.18:0/109919720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb01ac430 con 0x7f7cb0109450 2024-09-19T09:54:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.702+0000 7f7caeffd640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cb0109450 0x7f7cb01a7480 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0005ab0 tx=0x7f7ca00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.703+0000 7f7c97fff640 1 -- 172.21.15.18:0/109919720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca003f030 con 0x7f7cb0109450 2024-09-19T09:54:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.703+0000 7f7c97fff640 1 -- 172.21.15.18:0/109919720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca0003ce0 con 0x7f7cb0109450 2024-09-19T09:54:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.703+0000 7f7c97fff640 1 -- 172.21.15.18:0/109919720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0035070 con 0x7f7cb0109450 2024-09-19T09:54:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.703+0000 7f7cb57fe640 1 -- 172.21.15.18:0/109919720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb01ac6c0 con 0x7f7cb0109450 2024-09-19T09:54:50.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.703+0000 7f7cb57fe640 1 -- 172.21.15.18:0/109919720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb01acb50 con 0x7f7cb0109450 2024-09-19T09:54:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.708+0000 7f7cb7bd7740 1 Processor -- start 2024-09-19T09:54:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.709+0000 7f7cb7bd7740 1 -- start start 2024-09-19T09:54:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.710+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 0x55eb904c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.710+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904c95d0 0x55eb904c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.710+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 0x55eb904d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.711+0000 7f7cb7bd7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55eb9042f2f0 con 0x55eb904cab40 2024-09-19T09:54:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.711+0000 7f7cb7bd7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55eb903d6cf0 con 0x55eb904c95d0 2024-09-19T09:54:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.711+0000 7f7cb7bd7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55eb9042b2b0 con 0x55eb904d4370 2024-09-19T09:54:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.711+0000 7f7c97fff640 1 -- 172.21.15.18:0/109919720 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7ca0042030 con 0x7f7cb0109450 2024-09-19T09:54:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.712+0000 7f7cae7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 0x55eb904d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.712+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904c95d0 0x55eb904c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.712+0000 7f7cae7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 0x55eb904d6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:46880/0 (socket says 172.21.15.18:46880) 2024-09-19T09:54:50.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.712+0000 7f7cae7fc640 1 -- 172.21.15.18:0/1274999407 learned_addr learned my addr 172.21.15.18:0/1274999407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:50.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.713+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/1274999407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 0x55eb904c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.713+0000 7f7c97fff640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c980a3410 0x7f7c980a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.713+0000 7f7c97fff640 1 -- 172.21.15.18:0/109919720 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7ca00efe40 con 0x7f7cb0109450 2024-09-19T09:54:50.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.714+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c980a3410 0x7f7c980a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.714+0000 7f7caf7fe640 1 -- 172.21.15.18:0/1274999407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 msgr2=0x55eb904d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:50.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.714+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/1274999407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 0x55eb904d6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.714+0000 7f7caf7fe640 1 -- 172.21.15.18:0/1274999407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904c95d0 msgr2=0x55eb904c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:50.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.714+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/1274999407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904c95d0 0x55eb904c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.714+0000 7f7caf7fe640 1 -- 172.21.15.18:0/1274999407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb903bb3a0 con 0x55eb904cab40 2024-09-19T09:54:50.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.714+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/1274999407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 0x55eb904c9090 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c930 tx=0x7f7ca800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e402a6d7444a99c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:50.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.715+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c980a3410 0x7f7c980a58d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8020000 tx=0x7f7ca801b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:50.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.715+0000 7f7c957fa640 1 -- 172.21.15.18:0/1274999407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8015070 con 0x55eb904cab40 2024-09-19T09:54:50.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.715+0000 7f7c957fa640 1 -- 172.21.15.18:0/1274999407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca8016040 con 0x55eb904cab40 2024-09-19T09:54:50.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.715+0000 7f7c957fa640 1 -- 172.21.15.18:0/1274999407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800b6a0 con 0x55eb904cab40 2024-09-19T09:54:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.717+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1274999407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 msgr2=0x55eb904c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.718+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/1274999407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 0x55eb904c9090 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c930 tx=0x7f7ca800cdf0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.718+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1274999407 shutdown_connections 2024-09-19T09:54:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.718+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/1274999407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 0x55eb904d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.718+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/1274999407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904c95d0 0x55eb904c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.718+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/1274999407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 0x55eb904c9090 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.719+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1274999407 >> 172.21.15.18:0/1274999407 conn(0x55eb90492310 msgr2=0x55eb904c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:50.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.719+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1274999407 shutdown_connections 2024-09-19T09:54:50.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.720+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1274999407 wait complete. 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.721+0000 7f7cb7bd7740 1 -- start start 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.721+0000 7f7cb7bd7740 1 Processor -- start 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.722+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904c95d0 0x55eb904d3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.722+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904cab40 0x55eb904d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.722+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904d4370 0x55eb904d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.722+0000 7f7cb7bd7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55eb904d7070 con 0x55eb904d4370 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.722+0000 7f7cb7bd7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55eb903ea060 con 0x55eb904c95d0 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.722+0000 7f7cb7bd7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55eb904d71f0 con 0x55eb904cab40 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7caf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904d4370 0x55eb904d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7cb7bd7740 10 client.0 _ll_register_callbacks cb 0x55eb9013d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7caf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904d4370 0x55eb904d1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49792/0 (socket says 172.21.15.18:49792) 2024-09-19T09:54:50.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7caf7fe640 1 -- 172.21.15.18:0/2509674134 learned_addr learned my addr 172.21.15.18:0/2509674134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:50.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7caeffd640 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904c95d0 0x55eb904d3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7cae7fc640 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904cab40 0x55eb904d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7caf7fe640 1 -- 172.21.15.18:0/2509674134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904cab40 msgr2=0x55eb904d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:50.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904cab40 0x55eb904d1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7caf7fe640 1 -- 172.21.15.18:0/2509674134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904c95d0 msgr2=0x55eb904d3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:50.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904c95d0 0x55eb904d3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.723+0000 7f7caf7fe640 1 -- 172.21.15.18:0/2509674134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb901a03c0 con 0x55eb904d4370 2024-09-19T09:54:50.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.724+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904d4370 0x55eb904d1800 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80095b0 tx=0x7f7ca8009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1109b63ce53254 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:50.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.724+0000 7f7c92ff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:50.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.724+0000 7f7c92ff5640 1 -- 172.21.15.18:0/2509674134 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8015050 con 0x55eb904d4370 2024-09-19T09:54:50.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.725+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/2509674134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca8016040 con 0x55eb904d4370 2024-09-19T09:54:50.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.725+0000 7f7c92ff5640 1 -- 172.21.15.18:0/2509674134 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7ca801a910 con 0x55eb904d4370 2024-09-19T09:54:50.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.725+0000 7f7c92ff5640 1 -- 172.21.15.18:0/2509674134 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ca8023420 con 0x55eb904d4370 2024-09-19T09:54:50.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.725+0000 7f7cb7bd7740 10 client.16230 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:50.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.725+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/2509674134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eb904e2b80 con 0x55eb904d4370 2024-09-19T09:54:50.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.726+0000 7f7c92ff5640 1 -- 172.21.15.18:0/2509674134 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca8016040 con 0x55eb904d4370 2024-09-19T09:54:50.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.726+0000 7f7c92ff5640 1 -- 172.21.15.18:0/2509674134 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ca802b5e0 con 0x55eb904d4370 2024-09-19T09:54:50.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.726+0000 7f7cb7bd7740 10 client.16230 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:50.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.726+0000 7f7cb7bd7740 10 client.16230 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:54:50.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.726+0000 7f7cb7bd7740 20 client.16230 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:50.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.726+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55eb904e3f90 0x55eb904e6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.726+0000 7f7cb7bd7740 4 client.16230 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:50.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.726+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/2509674134 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb9043c860 con 0x55eb904e3f90 2024-09-19T09:54:50.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.728+0000 7f7caeffd640 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55eb904e3f90 0x55eb904e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.731+0000 7f7caeffd640 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55eb904e3f90 0x55eb904e6380 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c26757fd140e2b7 server_cookie=1660e65c8de444d8 in_seq=0 out_seq=0 2024-09-19T09:54:50.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.731+0000 7f7c92ff5640 10 client.16230 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:54:50.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.733+0000 7f7c92ff5640 1 -- 172.21.15.18:0/2509674134 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb9043c860 con 0x55eb904e3f90 2024-09-19T09:54:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.733+0000 7f7c92ff5640 10 client.16230 handle_command_reply: tid=0 2024-09-19T09:54:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.734+0000 7f7cb7bd7740 1 client.16230 shutdown 2024-09-19T09:54:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.734+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/2509674134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904d4370 msgr2=0x55eb904d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.734+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904d4370 0x55eb904d1800 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80095b0 tx=0x7f7ca8009f00 comp rx=0 tx=0).stop 2024-09-19T09:54:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.734+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/2509674134 shutdown_connections 2024-09-19T09:54:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.734+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55eb904e3f90 0x55eb904e6380 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.734+0000 7f7c92ff5640 0 client.16230 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:54:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.734+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904d4370 0x55eb904d1800 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.735+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904cab40 0x55eb904d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.735+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/2509674134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904c95d0 0x55eb904d3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.735+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/2509674134 >> 172.21.15.18:0/2509674134 conn(0x55eb90492310 msgr2=0x55eb904cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.736+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/2509674134 shutdown_connections 2024-09-19T09:54:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.736+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/2509674134 wait complete. 2024-09-19T09:54:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.736+0000 7f7cb7bd7740 20 client.16230 trim_cache size 0 max 16384 2024-09-19T09:54:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.765+0000 7f7cb7bd7740 1 Processor -- start 2024-09-19T09:54:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.765+0000 7f7cb7bd7740 1 -- start start 2024-09-19T09:54:50.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.766+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904c95d0 0x55eb904d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.766+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904cab40 0x55eb904eba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.766+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904c95d0 0x55eb904d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.766+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904c95d0 0x55eb904d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49804/0 (socket says 172.21.15.18:49804) 2024-09-19T09:54:50.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.766+0000 7f7caeffd640 1 -- 172.21.15.18:0/1150891989 learned_addr learned my addr 172.21.15.18:0/1150891989 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:50.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.766+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 0x55eb904ebf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.767+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1150891989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01bc3d0 con 0x55eb904c95d0 2024-09-19T09:54:50.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.767+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1150891989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01bdf10 con 0x55eb904cab40 2024-09-19T09:54:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.767+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1150891989 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01bcaa0 con 0x55eb904d4370 2024-09-19T09:54:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.767+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 0x55eb904ebf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.767+0000 7f7cae7fc640 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904cab40 0x55eb904eba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.767+0000 7f7caf7fe640 1 -- 172.21.15.18:0/1150891989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904cab40 msgr2=0x55eb904eba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.767+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904cab40 0x55eb904eba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.767+0000 7f7caf7fe640 1 -- 172.21.15.18:0/1150891989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904c95d0 msgr2=0x55eb904d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.767+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904c95d0 0x55eb904d17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.767+0000 7f7caf7fe640 1 -- 172.21.15.18:0/1150891989 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb90442e70 con 0x55eb904d4370 2024-09-19T09:54:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.768+0000 7f7caeffd640 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904c95d0 0x55eb904d17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:54:50.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.768+0000 7f7caf7fe640 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 0x55eb904ebf70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800b800 tx=0x7f7ca8009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fdfba9bf32a89e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.768+0000 7f7c94ff9640 1 -- 172.21.15.18:0/1150891989 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8015030 con 0x55eb904d4370 2024-09-19T09:54:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.768+0000 7f7c94ff9640 1 -- 172.21.15.18:0/1150891989 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca8016040 con 0x55eb904d4370 2024-09-19T09:54:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.769+0000 7f7c94ff9640 1 -- 172.21.15.18:0/1150891989 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8023820 con 0x55eb904d4370 2024-09-19T09:54:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.769+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1150891989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 msgr2=0x55eb904ebf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.769+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 0x55eb904ebf70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800b800 tx=0x7f7ca8009360 comp rx=0 tx=0).stop 2024-09-19T09:54:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.769+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1150891989 shutdown_connections 2024-09-19T09:54:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.769+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904d4370 0x55eb904ebf70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.770+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904cab40 0x55eb904eba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.770+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/1150891989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904c95d0 0x55eb904d17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.770+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1150891989 >> 172.21.15.18:0/1150891989 conn(0x55eb90492310 msgr2=0x55eb904c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:50.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.770+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1150891989 shutdown_connections 2024-09-19T09:54:50.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.770+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/1150891989 wait complete. 2024-09-19T09:54:50.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.771+0000 7f7cb7bd7740 1 -- start start 2024-09-19T09:54:50.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.771+0000 7f7cb7bd7740 1 Processor -- start 2024-09-19T09:54:50.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.771+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904c95d0 0x55eb904dc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.771+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 0x55eb904dc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7cb7bd7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904d4370 0x55eb904cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904c95d0 0x55eb904dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7cb7bd7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01bd840 con 0x55eb904cab40 2024-09-19T09:54:50.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904c95d0 0x55eb904dc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:46904/0 (socket says 172.21.15.18:46904) 2024-09-19T09:54:50.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7cb7bd7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01bd170 con 0x55eb904d4370 2024-09-19T09:54:50.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/3921193053 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01ba3d0 con 0x55eb904c95d0 2024-09-19T09:54:50.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7caeffd640 1 -- 172.21.15.18:0/3921193053 learned_addr learned my addr 172.21.15.18:0/3921193053 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:50.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7cb7bd7740 10 client.0 _ll_register_callbacks cb 0x7f7ca00b86d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7cae7fc640 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 0x55eb904dc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7caeffd640 1 -- 172.21.15.18:0/3921193053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904d4370 msgr2=0x55eb904cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7caeffd640 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904d4370 0x55eb904cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7caeffd640 1 -- 172.21.15.18:0/3921193053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 msgr2=0x55eb904dc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7caeffd640 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 0x55eb904dc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.772+0000 7f7caeffd640 1 -- 172.21.15.18:0/3921193053 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb904cdbe0 con 0x55eb904c95d0 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.773+0000 7f7caeffd640 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904c95d0 0x55eb904dc480 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00b8e00 tx=0x7f7ca00b8040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ed266cbd36cdeb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.773+0000 7f7c92ff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.773+0000 7f7c92ff5640 1 -- 172.21.15.18:0/3921193053 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00d5060 con 0x55eb904c95d0 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.773+0000 7f7c92ff5640 1 -- 172.21.15.18:0/3921193053 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7ca003b460 con 0x55eb904c95d0 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.773+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/3921193053 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca8016040 con 0x55eb904c95d0 2024-09-19T09:54:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7c92ff5640 1 -- 172.21.15.18:0/3921193053 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ca0049040 con 0x55eb904c95d0 2024-09-19T09:54:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7cb7bd7740 10 client.25687 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/3921193053 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eb9054e200 con 0x55eb904c95d0 2024-09-19T09:54:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7c92ff5640 1 -- 172.21.15.18:0/3921193053 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca8016040 con 0x55eb904c95d0 2024-09-19T09:54:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7c92ff5640 1 -- 172.21.15.18:0/3921193053 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ca00c6020 con 0x55eb904c95d0 2024-09-19T09:54:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7cb7bd7740 10 client.25687 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7cb7bd7740 10 client.25687 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:54:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7cb7bd7740 20 client.25687 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55eb904e3f90 0x55eb90550920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7cb7bd7740 4 client.25687 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:54:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.774+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/3921193053 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eb90436d70 con 0x55eb904e3f90 2024-09-19T09:54:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.775+0000 7f7cae7fc640 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55eb904e3f90 0x55eb90550920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.776+0000 7f7cae7fc640 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55eb904e3f90 0x55eb90550920 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5469b3137d321b52 server_cookie=f04d8a5524374432 in_seq=0 out_seq=0 2024-09-19T09:54:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.776+0000 7f7c92ff5640 10 client.25687 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:54:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.777+0000 7f7c92ff5640 1 -- 172.21.15.18:0/3921193053 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eb90436d70 con 0x55eb904e3f90 2024-09-19T09:54:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.777+0000 7f7c92ff5640 10 client.25687 handle_command_reply: tid=0 2024-09-19T09:54:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.777+0000 7f7cb7bd7740 1 client.25687 shutdown 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/3921193053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904c95d0 msgr2=0x55eb904dc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904c95d0 0x55eb904dc480 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00b8e00 tx=0x7f7ca00b8040 comp rx=0 tx=0).stop 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/3921193053 shutdown_connections 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55eb904e3f90 0x55eb90550920 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eb904d4370 0x55eb904cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb904cab40 0x55eb904dc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7c92ff5640 0 client.25687 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7cb7bd7740 1 --2- 172.21.15.18:0/3921193053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb904c95d0 0x55eb904dc480 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/3921193053 >> 172.21.15.18:0/3921193053 conn(0x55eb90492310 msgr2=0x55eb904cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/3921193053 shutdown_connections 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.778+0000 7f7cb7bd7740 1 -- 172.21.15.18:0/3921193053 wait complete. 2024-09-19T09:54:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.779+0000 7f7cb7bd7740 20 client.25687 trim_cache size 0 max 16384 2024-09-19T09:54:50.782 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:54:50.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.779+0000 7f7cb57fe640 1 -- 172.21.15.18:0/109919720 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c980a3410 msgr2=0x7f7c980a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.779+0000 7f7cb57fe640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c980a3410 0x7f7c980a58d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8020000 tx=0x7f7ca801b000 comp rx=0 tx=0).stop 2024-09-19T09:54:50.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.779+0000 7f7cb57fe640 1 -- 172.21.15.18:0/109919720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cb0109450 msgr2=0x7f7cb01a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.779+0000 7f7cb57fe640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cb0109450 0x7f7cb01a7480 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0005ab0 tx=0x7f7ca00042f0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.780+0000 7f7cb57fe640 1 -- 172.21.15.18:0/109919720 shutdown_connections 2024-09-19T09:54:50.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.780+0000 7f7cb57fe640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c980a3410 0x7f7c980a58d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.780+0000 7f7cb57fe640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb011b140 0x7f7cb01abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.780+0000 7f7cb57fe640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7cb0109830 0x7f7cb01a79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.780+0000 7f7cb57fe640 1 --2- 172.21.15.18:0/109919720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cb0109450 0x7f7cb01a7480 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.780+0000 7f7cb57fe640 1 -- 172.21.15.18:0/109919720 >> 172.21.15.18:0/109919720 conn(0x7f7cb006e140 msgr2=0x7f7cb011be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.780+0000 7f7cb57fe640 1 -- 172.21.15.18:0/109919720 shutdown_connections 2024-09-19T09:54:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:50.780+0000 7f7cb57fe640 1 -- 172.21.15.18:0/109919720 wait complete. 2024-09-19T09:54:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.964+0000 7ff25b7f6640 1 -- 172.21.15.18:0/605943709 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7ff26c012d10 con 0x557478700df0 2024-09-19T09:54:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.964+0000 7ff25b7f6640 10 client.25654 handle_command_reply: tid=0 2024-09-19T09:54:50.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.964+0000 7ff280cd1740 1 client.25654 shutdown 2024-09-19T09:54:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.969+0000 7ff280cd1740 1 -- 172.21.15.18:0/605943709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557478685880 msgr2=0x5574786900f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.969+0000 7ff280cd1740 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557478685880 0x5574786900f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55747868e170 tx=0x7ff26c007ad0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.969+0000 7ff280cd1740 1 -- 172.21.15.18:0/605943709 shutdown_connections 2024-09-19T09:54:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.969+0000 7ff280cd1740 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x557478700df0 0x5574787031e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.969+0000 7ff280cd1740 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557478685880 0x5574786900f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.969+0000 7ff280cd1740 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5574786807f0 0x55747868f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.969+0000 7ff280cd1740 1 --2- 172.21.15.18:0/605943709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55747867feb0 0x55747868eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.969+0000 7ff280cd1740 1 -- 172.21.15.18:0/605943709 >> 172.21.15.18:0/605943709 conn(0x55747867b520 msgr2=0x557478679eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.969+0000 7ff25b7f6640 0 client.25654 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.970+0000 7ff280cd1740 1 -- 172.21.15.18:0/605943709 shutdown_connections 2024-09-19T09:54:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.970+0000 7ff280cd1740 1 -- 172.21.15.18:0/605943709 wait complete. 2024-09-19T09:54:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.970+0000 7ff280cd1740 20 client.25654 trim_cache size 0 max 16384 2024-09-19T09:54:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:54:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:54:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:54:50.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:54:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.981+0000 7ff25e7fc640 1 -- 172.21.15.18:0/1663143649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff2600a3250 msgr2=0x7ff2600a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.981+0000 7ff25e7fc640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff2600a3250 0x7ff2600a5710 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff270030040 tx=0x7ff2700095c0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.981+0000 7ff25e7fc640 1 -- 172.21.15.18:0/1663143649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff27810dbb0 msgr2=0x7ff2781b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.981+0000 7ff25e7fc640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff27810dbb0 0x7ff2781b6c50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff270003f10 tx=0x7ff270003f40 comp rx=0 tx=0).stop 2024-09-19T09:54:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.987+0000 7ff25e7fc640 1 -- 172.21.15.18:0/1663143649 shutdown_connections 2024-09-19T09:54:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.987+0000 7ff25e7fc640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff2600a3250 0x7ff2600a5710 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.987+0000 7ff25e7fc640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff27810dbb0 0x7ff2781b6c50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.987+0000 7ff25e7fc640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff278073680 0x7ff278115cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.988+0000 7ff25e7fc640 1 --2- 172.21.15.18:0/1663143649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff278072cb0 0x7ff2781157b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.988+0000 7ff25e7fc640 1 -- 172.21.15.18:0/1663143649 >> 172.21.15.18:0/1663143649 conn(0x7ff27806eb50 msgr2=0x7ff2780707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.988+0000 7ff25e7fc640 1 -- 172.21.15.18:0/1663143649 shutdown_connections 2024-09-19T09:54:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:54:50.988+0000 7ff25e7fc640 1 -- 172.21.15.18:0/1663143649 wait complete. 2024-09-19T09:54:51.800 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:54:52.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:52 smithi018 ceph-mon[30956]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 870 MiB/s wr, 2.33k op/s 2024-09-19T09:54:52.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:52 smithi049 ceph-mon[34858]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 870 MiB/s wr, 2.33k op/s 2024-09-19T09:54:52.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:52 smithi162 ceph-mon[35174]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 870 MiB/s wr, 2.33k op/s 2024-09-19T09:54:52.832 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.718+0000 7f2fa3672640 1 -- 172.21.15.18:0/3399966062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f9c101470 msgr2=0x7f2f9c101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.718+0000 7f2fa3672640 1 --2- 172.21.15.18:0/3399966062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f9c101470 0x7f2f9c101850 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009900 tx=0x7f2f9802a410 comp rx=0 tx=0).stop 2024-09-19T09:54:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.718+0000 7f2fa3672640 1 -- 172.21.15.18:0/3399966062 shutdown_connections 2024-09-19T09:54:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.718+0000 7f2fa3672640 1 --2- 172.21.15.18:0/3399966062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f9c105de0 0x7f2f9c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.718+0000 7f2fa3672640 1 --2- 172.21.15.18:0/3399966062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c101e20 0x7f2f9c1056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.718+0000 7f2fa3672640 1 --2- 172.21.15.18:0/3399966062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f9c101470 0x7f2f9c101850 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.718+0000 7f2fa3672640 1 -- 172.21.15.18:0/3399966062 >> 172.21.15.18:0/3399966062 conn(0x7f2f9c077230 msgr2=0x7f2f9c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:53.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.719+0000 7f2fa3672640 1 -- 172.21.15.18:0/3399966062 shutdown_connections 2024-09-19T09:54:53.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.719+0000 7f2fa3672640 1 -- 172.21.15.18:0/3399966062 wait complete. 2024-09-19T09:54:53.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.720+0000 7f2fa3672640 1 Processor -- start 2024-09-19T09:54:53.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.720+0000 7f2fa3672640 1 -- start start 2024-09-19T09:54:53.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.721+0000 7f2fa3672640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f9c101470 0x7f2f9c19f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.721+0000 7f2fa3672640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c101e20 0x7f2f9c19f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.721+0000 7f2fa3672640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f9c105de0 0x7f2f9c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.721+0000 7f2fa3672640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c10fd10 con 0x7f2f9c105de0 2024-09-19T09:54:53.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.721+0000 7f2fa3672640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c10fb90 con 0x7f2f9c101e20 2024-09-19T09:54:53.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.721+0000 7f2fa3672640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c10fe90 con 0x7f2f9c101470 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.721+0000 7f2fa1c0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f9c105de0 0x7f2f9c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.721+0000 7f2fa1c0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f9c105de0 0x7f2f9c19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49830/0 (socket says 172.21.15.18:49830) 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.721+0000 7f2fa1c0f640 1 -- 172.21.15.18:0/3625233152 learned_addr learned my addr 172.21.15.18:0/3625233152 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.722+0000 7f2fa1c0f640 1 -- 172.21.15.18:0/3625233152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f9c101470 msgr2=0x7f2f9c19f250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.722+0000 7f2fa1c0f640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f9c101470 0x7f2f9c19f250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.722+0000 7f2fa1c0f640 1 -- 172.21.15.18:0/3625233152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c101e20 msgr2=0x7f2f9c19f790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.722+0000 7f2fa1c0f640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c101e20 0x7f2f9c19f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.722+0000 7f2fa1c0f640 1 -- 172.21.15.18:0/3625233152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c19ae00 con 0x7f2f9c105de0 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.723+0000 7f2fa1c0f640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f9c105de0 0x7f2f9c19a6d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400eaa0 tx=0x7f2f9400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.723+0000 7f2f927fc640 1 -- 172.21.15.18:0/3625233152 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400cdb0 con 0x7f2f9c105de0 2024-09-19T09:54:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.723+0000 7f2f927fc640 1 -- 172.21.15.18:0/3625233152 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f94005020 con 0x7f2f9c105de0 2024-09-19T09:54:53.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.723+0000 7f2f927fc640 1 -- 172.21.15.18:0/3625233152 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f940116b0 con 0x7f2f9c105de0 2024-09-19T09:54:53.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.723+0000 7f2fa3672640 1 -- 172.21.15.18:0/3625233152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c19b0f0 con 0x7f2f9c105de0 2024-09-19T09:54:53.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.724+0000 7f2fa3672640 1 -- 172.21.15.18:0/3625233152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9c1a71d0 con 0x7f2f9c105de0 2024-09-19T09:54:53.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.730+0000 7f2fa5a4b740 1 Processor -- start 2024-09-19T09:54:53.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.731+0000 7f2f927fc640 1 -- 172.21.15.18:0/3625233152 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2f940051d0 con 0x7f2f9c105de0 2024-09-19T09:54:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.732+0000 7f2fa5a4b740 1 -- start start 2024-09-19T09:54:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.733+0000 7f2f927fc640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2f880a3410 0x7f2f880a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.733+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 0x55b68baac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.733+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baacde0 0x55b68baad220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.733+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab7b80 0x55b68bab9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.733+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b68ba0a2f0 con 0x55b68baacde0 2024-09-19T09:54:53.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.733+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b68b9b1cf0 con 0x55b68bab7b80 2024-09-19T09:54:53.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.733+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b68ba062b0 con 0x55b68baae350 2024-09-19T09:54:53.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.733+0000 7f2fa0c0d640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2f880a3410 0x7f2f880a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.734+0000 7f2f927fc640 1 -- 172.21.15.18:0/3625233152 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2f940cfab0 con 0x7f2f9c105de0 2024-09-19T09:54:53.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.734+0000 7f2fa0c0d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baacde0 0x55b68baad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.734+0000 7f2fa0c0d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baacde0 0x55b68baad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49844/0 (socket says 172.21.15.18:49844) 2024-09-19T09:54:53.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.734+0000 7f2fa0c0d640 1 -- 172.21.15.18:0/2076788468 learned_addr learned my addr 172.21.15.18:0/2076788468 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.735+0000 7f2fa0c0d640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2f880a3410 0x7f2f880a58d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009ca0 tx=0x7f2f8c0125e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.735+0000 7f2fa0c0d640 1 -- 172.21.15.18:0/2076788468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 msgr2=0x55b68baac8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.735+0000 7f2fa0c0d640 1 --2- 172.21.15.18:0/2076788468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 0x55b68baac8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.735+0000 7f2fa0c0d640 1 -- 172.21.15.18:0/2076788468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab7b80 msgr2=0x55b68bab9f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.735+0000 7f2fa0c0d640 1 --2- 172.21.15.18:0/2076788468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab7b80 0x55b68bab9f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.735+0000 7f2fa0c0d640 1 -- 172.21.15.18:0/2076788468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b68b9963a0 con 0x55b68baacde0 2024-09-19T09:54:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.736+0000 7f2fa0c0d640 1 --2- 172.21.15.18:0/2076788468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baacde0 0x55b68baad220 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c012ae0 tx=0x7f2f8c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c622b15906e2c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.736+0000 7f2f877fe640 1 -- 172.21.15.18:0/2076788468 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c024070 con 0x55b68baacde0 2024-09-19T09:54:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.737+0000 7f2f877fe640 1 -- 172.21.15.18:0/2076788468 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f8c010040 con 0x55b68baacde0 2024-09-19T09:54:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.737+0000 7f2f877fe640 1 -- 172.21.15.18:0/2076788468 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00f050 con 0x55b68baacde0 2024-09-19T09:54:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.738+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/2076788468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baacde0 msgr2=0x55b68baad220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.738+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/2076788468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baacde0 0x55b68baad220 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c012ae0 tx=0x7f2f8c01a000 comp rx=0 tx=0).stop 2024-09-19T09:54:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.738+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/2076788468 shutdown_connections 2024-09-19T09:54:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.738+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/2076788468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab7b80 0x55b68bab9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.738+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/2076788468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baacde0 0x55b68baad220 secure :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c012ae0 tx=0x7f2f8c01a000 comp rx=0 tx=0).stop 2024-09-19T09:54:53.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.738+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/2076788468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 0x55b68baac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.738+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/2076788468 >> 172.21.15.18:0/2076788468 conn(0x55b68ba6d310 msgr2=0x55b68baa9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:53.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.739+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/2076788468 shutdown_connections 2024-09-19T09:54:53.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.739+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/2076788468 wait complete. 2024-09-19T09:54:53.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.740+0000 7f2fa5a4b740 1 -- start start 2024-09-19T09:54:53.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.740+0000 7f2fa5a4b740 1 Processor -- start 2024-09-19T09:54:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.742+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 0x55b68bab4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.742+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab7b80 0x55b68bab4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.742+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bac3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.742+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b68baba820 con 0x55b68bab7b80 2024-09-19T09:54:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.742+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b68b9c5060 con 0x55b68bab54d0 2024-09-19T09:54:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.742+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b68baba9a0 con 0x55b68baae350 2024-09-19T09:54:53.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.742+0000 7f2fa5a4b740 10 client.0 _ll_register_callbacks cb 0x55b68b7188c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:53.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.743+0000 7f2fa0c0d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab7b80 0x55b68bab4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.743+0000 7f2fa0c0d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab7b80 0x55b68bab4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49846/0 (socket says 172.21.15.18:49846) 2024-09-19T09:54:53.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.743+0000 7f2fa0c0d640 1 -- 172.21.15.18:0/391724458 learned_addr learned my addr 172.21.15.18:0/391724458 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.744+0000 7f2fa1c0f640 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bac3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.744+0000 7f2fa0c0d640 1 -- 172.21.15.18:0/391724458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 msgr2=0x55b68bab4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.744+0000 7f2fa0c0d640 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 0x55b68bab4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.744+0000 7f2fa0c0d640 1 -- 172.21.15.18:0/391724458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 msgr2=0x55b68bac3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.744+0000 7f2fa0c0d640 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bac3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.744+0000 7f2fa0c0d640 1 -- 172.21.15.18:0/391724458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b68b77b3c0 con 0x55b68bab7b80 2024-09-19T09:54:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.744+0000 7f2fa0c0d640 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab7b80 0x55b68bab4f90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c007010 tx=0x7f2f8c01fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffaf61aea7dc6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.744+0000 7f2f84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:53.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.745+0000 7f2f84ff9640 1 -- 172.21.15.18:0/391724458 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c024040 con 0x55b68bab7b80 2024-09-19T09:54:53.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.745+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/391724458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f8c010040 con 0x55b68bab7b80 2024-09-19T09:54:53.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.745+0000 7f2f84ff9640 1 -- 172.21.15.18:0/391724458 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2f8c029610 con 0x55b68bab7b80 2024-09-19T09:54:53.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.745+0000 7f2f84ff9640 1 -- 172.21.15.18:0/391724458 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f8c006d70 con 0x55b68bab7b80 2024-09-19T09:54:53.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.745+0000 7f2fa5a4b740 10 client.16248 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:53.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.745+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/391724458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b68bac68e0 con 0x55b68bab7b80 2024-09-19T09:54:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.746+0000 7f2f84ff9640 1 -- 172.21.15.18:0/391724458 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f8c010040 con 0x55b68bab7b80 2024-09-19T09:54:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.746+0000 7f2f84ff9640 1 -- 172.21.15.18:0/391724458 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2f8c015070 con 0x55b68bab7b80 2024-09-19T09:54:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.746+0000 7f2fa5a4b740 10 client.16248 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.746+0000 7f2fa5a4b740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.746+0000 7f2fa5a4b740 20 client.16248 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.746+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b68bac7c90 0x55b68baca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.746+0000 7f2fa5a4b740 4 client.16248 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.746+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/391724458 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b68ba17860 con 0x55b68bac7c90 2024-09-19T09:54:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.747+0000 7f2fa140e640 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b68bac7c90 0x55b68baca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.751+0000 7f2fa140e640 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b68bac7c90 0x55b68baca080 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2847cfec6428cc7b server_cookie=8f9f7d32212d2551 in_seq=0 out_seq=0 2024-09-19T09:54:53.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.751+0000 7f2f84ff9640 10 client.16248 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.754+0000 7f2f84ff9640 1 -- 172.21.15.18:0/391724458 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b68ba17860 con 0x55b68bac7c90 2024-09-19T09:54:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.754+0000 7f2f84ff9640 10 client.16248 handle_command_reply: tid=0 2024-09-19T09:54:53.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.754+0000 7f2fa5a4b740 1 client.16248 shutdown 2024-09-19T09:54:53.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/391724458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab7b80 msgr2=0x55b68bab4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:53.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab7b80 0x55b68bab4f90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c007010 tx=0x7f2f8c01fa30 comp rx=0 tx=0).stop 2024-09-19T09:54:53.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/391724458 shutdown_connections 2024-09-19T09:54:53.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b68bac7c90 0x55b68baca080 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bac3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab7b80 0x55b68bab4f90 secure :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c007010 tx=0x7f2f8c01fa30 comp rx=0 tx=0).stop 2024-09-19T09:54:53.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/391724458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 0x55b68bab4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/391724458 >> 172.21.15.18:0/391724458 conn(0x55b68ba6d310 msgr2=0x55b68baaf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:53.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2f84ff9640 0 client.16248 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:53.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/391724458 shutdown_connections 2024-09-19T09:54:53.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/391724458 wait complete. 2024-09-19T09:54:53.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.755+0000 7f2fa5a4b740 20 client.16248 trim_cache size 0 max 16384 2024-09-19T09:54:53.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.781+0000 7f2fa5a4b740 1 Processor -- start 2024-09-19T09:54:53.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.781+0000 7f2fa5a4b740 1 -- start start 2024-09-19T09:54:53.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.782+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baae350 0x55b68bab3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.782+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bab8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.782+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68bab94b0 0x55b68baaf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.782+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1ab420 con 0x55b68baae350 2024-09-19T09:54:53.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.782+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1acf60 con 0x55b68bab54d0 2024-09-19T09:54:53.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.782+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1abaf0 con 0x55b68bab94b0 2024-09-19T09:54:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.782+0000 7f2fa140e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baae350 0x55b68bab3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.782+0000 7f2fa140e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baae350 0x55b68bab3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49848/0 (socket says 172.21.15.18:49848) 2024-09-19T09:54:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.782+0000 7f2fa140e640 1 -- 172.21.15.18:0/3694295188 learned_addr learned my addr 172.21.15.18:0/3694295188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.783+0000 7f2fa140e640 1 -- 172.21.15.18:0/3694295188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68bab94b0 msgr2=0x55b68baaf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.783+0000 7f2fa1c0f640 1 --2- 172.21.15.18:0/3694295188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68bab94b0 0x55b68baaf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.783+0000 7f2fa140e640 1 --2- 172.21.15.18:0/3694295188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68bab94b0 0x55b68baaf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.783+0000 7f2fa140e640 1 -- 172.21.15.18:0/3694295188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 msgr2=0x55b68bab8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.783+0000 7f2fa140e640 1 --2- 172.21.15.18:0/3694295188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bab8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.783+0000 7f2fa140e640 1 -- 172.21.15.18:0/3694295188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b68bab2fa0 con 0x55b68baae350 2024-09-19T09:54:53.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.783+0000 7f2fa1c0f640 1 --2- 172.21.15.18:0/3694295188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68bab94b0 0x55b68baaf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:54:53.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.783+0000 7f2fa140e640 1 --2- 172.21.15.18:0/3694295188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baae350 0x55b68bab3cc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009900 tx=0x7f2f98004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d8e3ee2b55ccf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:53.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.783+0000 7f2f86ffd640 1 -- 172.21.15.18:0/3694295188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98035040 con 0x55b68baae350 2024-09-19T09:54:53.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.784+0000 7f2f86ffd640 1 -- 172.21.15.18:0/3694295188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f98004470 con 0x55b68baae350 2024-09-19T09:54:53.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.784+0000 7f2f86ffd640 1 -- 172.21.15.18:0/3694295188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98003850 con 0x55b68baae350 2024-09-19T09:54:53.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.785+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/3694295188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baae350 msgr2=0x55b68bab3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:53.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.785+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/3694295188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baae350 0x55b68bab3cc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009900 tx=0x7f2f98004040 comp rx=0 tx=0).stop 2024-09-19T09:54:53.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.786+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/3694295188 shutdown_connections 2024-09-19T09:54:53.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.786+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/3694295188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68bab94b0 0x55b68baaf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.786+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/3694295188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bab8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.786+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/3694295188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68baae350 0x55b68bab3cc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.786+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/3694295188 >> 172.21.15.18:0/3694295188 conn(0x55b68ba6d310 msgr2=0x55b68ba9fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:53.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.786+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/3694295188 shutdown_connections 2024-09-19T09:54:53.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.786+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/3694295188 wait complete. 2024-09-19T09:54:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.786+0000 7f2fa5a4b740 1 -- start start 2024-09-19T09:54:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.787+0000 7f2fa5a4b740 1 Processor -- start 2024-09-19T09:54:53.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.788+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 0x55b68bac8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.788+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bac8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.788+0000 7f2fa5a4b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab94b0 0x55b68bac9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.789+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1ac890 con 0x55b68bab94b0 2024-09-19T09:54:53.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.789+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1ac1c0 con 0x55b68bab54d0 2024-09-19T09:54:53.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.789+0000 7f2fa5a4b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1a9420 con 0x55b68baae350 2024-09-19T09:54:53.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.789+0000 7f2fa140e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 0x55b68bac8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.789+0000 7f2fa5a4b740 10 client.0 _ll_register_callbacks cb 0x7f2f8c022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:53.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.789+0000 7f2fa1c0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab94b0 0x55b68bac9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.789+0000 7f2fa1c0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab94b0 0x55b68bac9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49862/0 (socket says 172.21.15.18:49862) 2024-09-19T09:54:53.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.789+0000 7f2fa1c0f640 1 -- 172.21.15.18:0/1123270523 learned_addr learned my addr 172.21.15.18:0/1123270523 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:53.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.790+0000 7f2fa0c0d640 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bac8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.790+0000 7f2fa1c0f640 1 -- 172.21.15.18:0/1123270523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 msgr2=0x55b68bac8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:53.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.790+0000 7f2fa1c0f640 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 0x55b68bac8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.790+0000 7f2fa1c0f640 1 -- 172.21.15.18:0/1123270523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 msgr2=0x55b68bac8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:53.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.790+0000 7f2fa1c0f640 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bac8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.790+0000 7f2fa1c0f640 1 -- 172.21.15.18:0/1123270523 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b68bb315c0 con 0x55b68bab94b0 2024-09-19T09:54:53.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.791+0000 7f2fa1c0f640 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab94b0 0x55b68bac9490 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2f940a47e0 tx=0x7f2f9409c0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cac1f7fbe10e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:53.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.791+0000 7f2f84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:54:53.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.792+0000 7f2f84ff9640 1 -- 172.21.15.18:0/1123270523 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9401f040 con 0x55b68bab94b0 2024-09-19T09:54:53.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.792+0000 7f2f84ff9640 1 -- 172.21.15.18:0/1123270523 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2f94005520 con 0x55b68bab94b0 2024-09-19T09:54:53.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.792+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/1123270523 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f98004470 con 0x55b68bab94b0 2024-09-19T09:54:53.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.792+0000 7f2f84ff9640 1 -- 172.21.15.18:0/1123270523 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f940a4d10 con 0x55b68bab94b0 2024-09-19T09:54:53.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.792+0000 7f2fa5a4b740 10 client.16254 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:53.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.792+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/1123270523 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b68bb327f0 con 0x55b68bab94b0 2024-09-19T09:54:53.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.792+0000 7f2f84ff9640 1 -- 172.21.15.18:0/1123270523 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f98004470 con 0x55b68bab94b0 2024-09-19T09:54:53.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.793+0000 7f2f84ff9640 1 -- 172.21.15.18:0/1123270523 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2f940bace0 con 0x55b68bab94b0 2024-09-19T09:54:53.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.793+0000 7f2fa5a4b740 10 client.16254 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:53.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.793+0000 7f2fa5a4b740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:53.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.793+0000 7f2fa5a4b740 20 client.16254 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:53.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.793+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b68bb32f10 0x55b68bb35330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:53.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.793+0000 7f2fa5a4b740 4 client.16254 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:54:53.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.793+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/1123270523 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b68ba11d70 con 0x55b68bb32f10 2024-09-19T09:54:53.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.798+0000 7f2fa140e640 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b68bb32f10 0x55b68bb35330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:53.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.804+0000 7f2f84ff9640 10 client.16254 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:53.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.804+0000 7f2fa140e640 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b68bb32f10 0x55b68bb35330 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb89d3983d2207bc server_cookie=e4154a325322c48b in_seq=0 out_seq=0 2024-09-19T09:54:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.807+0000 7f2f84ff9640 1 -- 172.21.15.18:0/1123270523 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b68ba11d70 con 0x55b68bb32f10 2024-09-19T09:54:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.807+0000 7f2f84ff9640 10 client.16254 handle_command_reply: tid=0 2024-09-19T09:54:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.807+0000 7f2fa5a4b740 1 client.16254 shutdown 2024-09-19T09:54:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.807+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/1123270523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab94b0 msgr2=0x55b68bac9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.807+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab94b0 0x55b68bac9490 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2f940a47e0 tx=0x7f2f9409c0a0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.808+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/1123270523 shutdown_connections 2024-09-19T09:54:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.808+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b68bb32f10 0x55b68bb35330 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.808+0000 7f2f84ff9640 0 client.16254 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.808+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b68bab94b0 0x55b68bac9490 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.808+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b68bab54d0 0x55b68bac8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.808+0000 7f2fa5a4b740 1 --2- 172.21.15.18:0/1123270523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b68baae350 0x55b68bac8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.808+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/1123270523 >> 172.21.15.18:0/1123270523 conn(0x55b68ba6d310 msgr2=0x55b68bab62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.808+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/1123270523 shutdown_connections 2024-09-19T09:54:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.808+0000 7f2fa5a4b740 1 -- 172.21.15.18:0/1123270523 wait complete. 2024-09-19T09:54:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.808+0000 7f2fa5a4b740 20 client.16254 trim_cache size 0 max 16384 2024-09-19T09:54:53.811 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:54:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.809+0000 7f2fa3672640 1 -- 172.21.15.18:0/3625233152 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2f880a3410 msgr2=0x7f2f880a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.809+0000 7f2fa3672640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2f880a3410 0x7f2f880a58d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009ca0 tx=0x7f2f8c0125e0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.809+0000 7f2fa3672640 1 -- 172.21.15.18:0/3625233152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f9c105de0 msgr2=0x7f2f9c19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.809+0000 7f2fa3672640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f9c105de0 0x7f2f9c19a6d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400eaa0 tx=0x7f2f9400ef60 comp rx=0 tx=0).stop 2024-09-19T09:54:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.810+0000 7f2fa3672640 1 -- 172.21.15.18:0/3625233152 shutdown_connections 2024-09-19T09:54:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.810+0000 7f2fa3672640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2f880a3410 0x7f2f880a58d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.810+0000 7f2fa3672640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f9c105de0 0x7f2f9c19a6d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.810+0000 7f2fa3672640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c101e20 0x7f2f9c19f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.810+0000 7f2fa3672640 1 --2- 172.21.15.18:0/3625233152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f9c101470 0x7f2f9c19f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.810+0000 7f2fa3672640 1 -- 172.21.15.18:0/3625233152 >> 172.21.15.18:0/3625233152 conn(0x7f2f9c077230 msgr2=0x7f2f9c104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.810+0000 7f2fa3672640 1 -- 172.21.15.18:0/3625233152 shutdown_connections 2024-09-19T09:54:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:53.810+0000 7f2fa3672640 1 -- 172.21.15.18:0/3625233152 wait complete. 2024-09-19T09:54:54.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:54 smithi049 ceph-mon[34858]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 899 MiB/s wr, 2.36k op/s 2024-09-19T09:54:54.684 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:54 smithi018 ceph-mon[30956]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 899 MiB/s wr, 2.36k op/s 2024-09-19T09:54:54.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:54 smithi162 ceph-mon[35174]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 899 MiB/s wr, 2.36k op/s 2024-09-19T09:54:55.758 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:54:55.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:54:55.805 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:55 smithi018 ceph-mon[30956]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 911 MiB/s wr, 2.40k op/s 2024-09-19T09:54:55.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:55 smithi049 ceph-mon[34858]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 911 MiB/s wr, 2.40k op/s 2024-09-19T09:54:55.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:55 smithi162 ceph-mon[35174]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 911 MiB/s wr, 2.40k op/s 2024-09-19T09:54:56.402 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:54:57.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.183+0000 7f1171ed8640 1 -- 172.21.15.18:0/3047800042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f116c074590 msgr2=0x7f116c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:57.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.183+0000 7f1171ed8640 1 --2- 172.21.15.18:0/3047800042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f116c074590 0x7f116c074970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1160009900 tx=0x7f116002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.185+0000 7f1171ed8640 1 -- 172.21.15.18:0/3047800042 shutdown_connections 2024-09-19T09:54:57.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.185+0000 7f1171ed8640 1 --2- 172.21.15.18:0/3047800042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f116c112b90 0x7f116c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.185+0000 7f1171ed8640 1 --2- 172.21.15.18:0/3047800042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c074eb0 0x7f116c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.185+0000 7f1171ed8640 1 --2- 172.21.15.18:0/3047800042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f116c074590 0x7f116c074970 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.185+0000 7f1171ed8640 1 -- 172.21.15.18:0/3047800042 >> 172.21.15.18:0/3047800042 conn(0x7f116c0fd8e0 msgr2=0x7f116c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:57.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.186+0000 7f1171ed8640 1 -- 172.21.15.18:0/3047800042 shutdown_connections 2024-09-19T09:54:57.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.186+0000 7f1171ed8640 1 -- 172.21.15.18:0/3047800042 wait complete. 2024-09-19T09:54:57.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.187+0000 7f1171ed8640 1 Processor -- start 2024-09-19T09:54:57.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.192+0000 7f1171ed8640 1 -- start start 2024-09-19T09:54:57.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.192+0000 7f1171ed8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c074590 0x7f116c0739b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.192+0000 7f1171ed8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f116c074eb0 0x7f116c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.192+0000 7f1171ed8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f116c112b90 0x7f116c06cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.192+0000 7f1171ed8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f116c1185a0 con 0x7f116c074590 2024-09-19T09:54:57.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.192+0000 7f1171ed8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f116c118420 con 0x7f116c112b90 2024-09-19T09:54:57.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.192+0000 7f1171ed8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f116c118720 con 0x7f116c074eb0 2024-09-19T09:54:57.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.194+0000 7f116affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f116c074eb0 0x7f116c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.194+0000 7f116affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f116c074eb0 0x7f116c06ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49100/0 (socket says 172.21.15.18:49100) 2024-09-19T09:54:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.194+0000 7f116affd640 1 -- 172.21.15.18:0/2598960212 learned_addr learned my addr 172.21.15.18:0/2598960212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:57.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.195+0000 7f116bfff640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f116c112b90 0x7f116c06cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.197+0000 7f116b7fe640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c074590 0x7f116c0739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.200+0000 7f116affd640 1 -- 172.21.15.18:0/2598960212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f116c112b90 msgr2=0x7f116c06cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:57.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.200+0000 7f116affd640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f116c112b90 0x7f116c06cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.200+0000 7f116affd640 1 -- 172.21.15.18:0/2598960212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c074590 msgr2=0x7f116c0739b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.200+0000 7f116affd640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c074590 0x7f116c0739b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.200+0000 7f116affd640 1 -- 172.21.15.18:0/2598960212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c06d5c0 con 0x7f116c074eb0 2024-09-19T09:54:57.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.206+0000 7f116affd640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f116c074eb0 0x7f116c06ca40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f116400eab0 tx=0x7f116400ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:57.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.207+0000 7f1168ff9640 1 -- 172.21.15.18:0/2598960212 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116400ce40 con 0x7f116c074eb0 2024-09-19T09:54:57.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.207+0000 7f1168ff9640 1 -- 172.21.15.18:0/2598960212 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1164011950 con 0x7f116c074eb0 2024-09-19T09:54:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.207+0000 7f1171ed8640 1 -- 172.21.15.18:0/2598960212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c0714e0 con 0x7f116c074eb0 2024-09-19T09:54:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.209+0000 7f1168ff9640 1 -- 172.21.15.18:0/2598960212 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164010ae0 con 0x7f116c074eb0 2024-09-19T09:54:57.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.213+0000 7f1171ed8640 1 -- 172.21.15.18:0/2598960212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c071a20 con 0x7f116c074eb0 2024-09-19T09:54:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.225+0000 7f1168ff9640 1 -- 172.21.15.18:0/2598960212 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1164010d60 con 0x7f116c074eb0 2024-09-19T09:54:57.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.226+0000 7f1168ff9640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f11540a32c0 0x7f11540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.227+0000 7f11742b1740 1 Processor -- start 2024-09-19T09:54:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.227+0000 7f1168ff9640 1 -- 172.21.15.18:0/2598960212 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f11640cf100 con 0x7f116c074eb0 2024-09-19T09:54:57.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.228+0000 7f11742b1740 1 -- start start 2024-09-19T09:54:57.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.229+0000 7f11742b1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 0x55ab93939f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.229+0000 7f11742b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab9393a480 0x55ab93944800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.229+0000 7f11742b1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93947130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.229+0000 7f11742b1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ab9389f280 con 0x55ab93944d40 2024-09-19T09:54:57.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.229+0000 7f11742b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ab93846b10 con 0x55ab9393a480 2024-09-19T09:54:57.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.229+0000 7f11742b1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ab9389b240 con 0x55ab93939b60 2024-09-19T09:54:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.230+0000 7f116bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93947130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.231+0000 7f116bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93947130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45480/0 (socket says 172.21.15.18:45480) 2024-09-19T09:54:57.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.231+0000 7f116bfff640 1 -- 172.21.15.18:0/4186246051 learned_addr learned my addr 172.21.15.18:0/4186246051 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.233+0000 7f116b7fe640 1 --2- 172.21.15.18:0/4186246051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 0x55ab93939f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.234+0000 7f116affd640 1 --2- 172.21.15.18:0/4186246051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab9393a480 0x55ab93944800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.241+0000 7f116b7fe640 1 -- 172.21.15.18:0/4186246051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab9393a480 msgr2=0x55ab93944800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.241+0000 7f116b7fe640 1 --2- 172.21.15.18:0/4186246051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab9393a480 0x55ab93944800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.241+0000 7f116b7fe640 1 -- 172.21.15.18:0/4186246051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 msgr2=0x55ab93947130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.241+0000 7f116b7fe640 1 --2- 172.21.15.18:0/4186246051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93947130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.241+0000 7f116b7fe640 1 -- 172.21.15.18:0/4186246051 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab938531f0 con 0x55ab93939b60 2024-09-19T09:54:57.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.246+0000 7f116b7fe640 1 --2- 172.21.15.18:0/4186246051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 0x55ab93939f40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1160009850 tx=0x7f1160003740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a36cb7b9df9af93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:57.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.248+0000 7f116b7fe640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f11540a32c0 0x7f11540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.248+0000 7f1151ffb640 1 -- 172.21.15.18:0/4186246051 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11600054e0 con 0x55ab93939b60 2024-09-19T09:54:57.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.248+0000 7f1151ffb640 1 -- 172.21.15.18:0/4186246051 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1160043030 con 0x55ab93939b60 2024-09-19T09:54:57.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.250+0000 7f11742b1740 1 -- 172.21.15.18:0/4186246051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 msgr2=0x55ab93939f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:57.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.250+0000 7f11742b1740 1 --2- 172.21.15.18:0/4186246051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 0x55ab93939f40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1160009850 tx=0x7f1160003740 comp rx=0 tx=0).stop 2024-09-19T09:54:57.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.250+0000 7f11742b1740 1 -- 172.21.15.18:0/4186246051 shutdown_connections 2024-09-19T09:54:57.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.250+0000 7f11742b1740 1 --2- 172.21.15.18:0/4186246051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93947130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.250+0000 7f11742b1740 1 --2- 172.21.15.18:0/4186246051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab9393a480 0x55ab93944800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.250+0000 7f11742b1740 1 --2- 172.21.15.18:0/4186246051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 0x55ab93939f40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.250+0000 7f11742b1740 1 -- 172.21.15.18:0/4186246051 >> 172.21.15.18:0/4186246051 conn(0x55ab939360f0 msgr2=0x55ab939364d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.253+0000 7f11742b1740 1 -- 172.21.15.18:0/4186246051 shutdown_connections 2024-09-19T09:54:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.253+0000 7f11742b1740 1 -- 172.21.15.18:0/4186246051 wait complete. 2024-09-19T09:54:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.254+0000 7f11742b1740 1 -- start start 2024-09-19T09:54:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.254+0000 7f11742b1740 1 Processor -- start 2024-09-19T09:54:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.255+0000 7f11742b1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93939b60 0x55ab93941c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.256+0000 7f11742b1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 0x55ab93942150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.256+0000 7f11742b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 0x55ab93942690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.256+0000 7f11742b1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ab93947960 con 0x55ab93939b60 2024-09-19T09:54:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.256+0000 7f11742b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ab93859f10 con 0x55ab93944d40 2024-09-19T09:54:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.256+0000 7f11742b1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ab93947ae0 con 0x55ab9393a480 2024-09-19T09:54:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.256+0000 7f11742b1740 10 client.0 _ll_register_callbacks cb 0x55ab93822a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.260+0000 7f116affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 0x55ab93942150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.261+0000 7f116affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 0x55ab93942150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49112/0 (socket says 172.21.15.18:49112) 2024-09-19T09:54:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.261+0000 7f116affd640 1 -- 172.21.15.18:0/281576362 learned_addr learned my addr 172.21.15.18:0/281576362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.262+0000 7f116bfff640 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 0x55ab93942690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.264+0000 7f116b7fe640 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93939b60 0x55ab93941c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.265+0000 7f116affd640 1 -- 172.21.15.18:0/281576362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 msgr2=0x55ab93942690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.265+0000 7f116affd640 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 0x55ab93942690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.265+0000 7f116affd640 1 -- 172.21.15.18:0/281576362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93939b60 msgr2=0x55ab93941c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.265+0000 7f116affd640 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93939b60 0x55ab93941c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.265+0000 7f116affd640 1 -- 172.21.15.18:0/281576362 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab936106a0 con 0x55ab9393a480 2024-09-19T09:54:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.266+0000 7f116affd640 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 0x55ab93942150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11640ccbd0 tx=0x7f116409b150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66b370808271f83c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.266+0000 7f114affd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:54:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.267+0000 7f114affd640 1 -- 172.21.15.18:0/281576362 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11640b9060 con 0x55ab9393a480 2024-09-19T09:54:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.267+0000 7f11742b1740 1 -- 172.21.15.18:0/281576362 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1160043030 con 0x55ab9393a480 2024-09-19T09:54:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.267+0000 7f114affd640 1 -- 172.21.15.18:0/281576362 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1164097de0 con 0x55ab9393a480 2024-09-19T09:54:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.271+0000 7f116b7fe640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f11540a32c0 0x7f11540a5780 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1160033040 tx=0x7f1160005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.272+0000 7f114affd640 1 -- 172.21.15.18:0/281576362 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11640a9050 con 0x55ab9393a480 2024-09-19T09:54:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.273+0000 7f11742b1740 10 client.25705 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.273+0000 7f11742b1740 1 -- 172.21.15.18:0/281576362 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ab93953630 con 0x55ab9393a480 2024-09-19T09:54:57.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.277+0000 7f114affd640 1 -- 172.21.15.18:0/281576362 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1160043030 con 0x55ab9393a480 2024-09-19T09:54:57.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.277+0000 7f114affd640 1 -- 172.21.15.18:0/281576362 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f116400f040 con 0x55ab9393a480 2024-09-19T09:54:57.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.279+0000 7f11742b1740 10 client.25705 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:57.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.279+0000 7f11742b1740 10 client.25705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:57.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.279+0000 7f11742b1740 20 client.25705 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:57.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.279+0000 7f11742b1740 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab93955000 0x55ab93957440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.279+0000 7f11742b1740 4 client.25705 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:54:57.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.279+0000 7f11742b1740 1 -- 172.21.15.18:0/281576362 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab938ac7f0 con 0x55ab93955000 2024-09-19T09:54:57.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.286+0000 7f116b7fe640 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab93955000 0x55ab93957440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.294+0000 7f116b7fe640 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab93955000 0x55ab93957440 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d70c49bb737163 server_cookie=edecf51e87f13c81 in_seq=0 out_seq=0 2024-09-19T09:54:57.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.294+0000 7f114affd640 10 client.25705 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:57.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.301+0000 7f114affd640 1 -- 172.21.15.18:0/281576362 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab938ac7f0 con 0x55ab93955000 2024-09-19T09:54:57.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.301+0000 7f114affd640 10 client.25705 handle_command_reply: tid=0 2024-09-19T09:54:57.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.301+0000 7f11742b1740 1 client.25705 shutdown 2024-09-19T09:54:57.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f11742b1740 1 -- 172.21.15.18:0/281576362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 msgr2=0x55ab93942150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:57.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f11742b1740 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 0x55ab93942150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11640ccbd0 tx=0x7f116409b150 comp rx=0 tx=0).stop 2024-09-19T09:54:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f11742b1740 1 -- 172.21.15.18:0/281576362 shutdown_connections 2024-09-19T09:54:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f11742b1740 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab93955000 0x55ab93957440 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f11742b1740 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 0x55ab93942690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f11742b1740 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 0x55ab93942150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f114affd640 0 client.25705 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f11742b1740 1 --2- 172.21.15.18:0/281576362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93939b60 0x55ab93941c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f11742b1740 1 -- 172.21.15.18:0/281576362 >> 172.21.15.18:0/281576362 conn(0x55ab939360f0 msgr2=0x55ab93935270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f11742b1740 1 -- 172.21.15.18:0/281576362 shutdown_connections 2024-09-19T09:54:57.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.302+0000 7f11742b1740 1 -- 172.21.15.18:0/281576362 wait complete. 2024-09-19T09:54:57.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.303+0000 7f11742b1740 20 client.25705 trim_cache size 0 max 16384 2024-09-19T09:54:57.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.401+0000 7f11742b1740 1 Processor -- start 2024-09-19T09:54:57.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.402+0000 7f11742b1740 1 -- start start 2024-09-19T09:54:57.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.403+0000 7f11742b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93939b60 0x55ab9395cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.403+0000 7f11742b1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 0x55ab9395d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.403+0000 7f11742b1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93934a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.403+0000 7f116bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93934a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.403+0000 7f116bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93934a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45494/0 (socket says 172.21.15.18:45494) 2024-09-19T09:54:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.403+0000 7f116bfff640 1 -- 172.21.15.18:0/473100678 learned_addr learned my addr 172.21.15.18:0/473100678 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.403+0000 7f11742b1740 1 -- 172.21.15.18:0/473100678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f116c10d480 con 0x55ab93944d40 2024-09-19T09:54:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.403+0000 7f11742b1740 1 -- 172.21.15.18:0/473100678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f116c1c6460 con 0x55ab93939b60 2024-09-19T09:54:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.403+0000 7f11742b1740 1 -- 172.21.15.18:0/473100678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f116c10db50 con 0x55ab9393a480 2024-09-19T09:54:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.406+0000 7f116bfff640 1 -- 172.21.15.18:0/473100678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 msgr2=0x55ab9395d290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.406+0000 7f116bfff640 1 --2- 172.21.15.18:0/473100678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 0x55ab9395d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.406+0000 7f116bfff640 1 -- 172.21.15.18:0/473100678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93939b60 msgr2=0x55ab9395cd50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:54:57.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.406+0000 7f116bfff640 1 --2- 172.21.15.18:0/473100678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93939b60 0x55ab9395cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.406+0000 7f116bfff640 1 -- 172.21.15.18:0/473100678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab93937260 con 0x55ab93944d40 2024-09-19T09:54:57.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.413+0000 7f116bfff640 1 --2- 172.21.15.18:0/473100678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93934a50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f115c00b730 tx=0x7f115c00bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494ca17166c51118 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:57.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.415+0000 7f11517fa640 1 -- 172.21.15.18:0/473100678 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c00be40 con 0x55ab93944d40 2024-09-19T09:54:57.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.416+0000 7f11517fa640 1 -- 172.21.15.18:0/473100678 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115c011440 con 0x55ab93944d40 2024-09-19T09:54:57.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.416+0000 7f11517fa640 1 -- 172.21.15.18:0/473100678 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c010670 con 0x55ab93944d40 2024-09-19T09:54:57.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.417+0000 7f11742b1740 1 -- 172.21.15.18:0/473100678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 msgr2=0x55ab93934a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:57.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.417+0000 7f11742b1740 1 --2- 172.21.15.18:0/473100678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93934a50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f115c00b730 tx=0x7f115c00bbf0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.417+0000 7f11742b1740 1 -- 172.21.15.18:0/473100678 shutdown_connections 2024-09-19T09:54:57.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.417+0000 7f11742b1740 1 --2- 172.21.15.18:0/473100678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab93944d40 0x55ab93934a50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.417+0000 7f11742b1740 1 --2- 172.21.15.18:0/473100678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab9393a480 0x55ab9395d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.418+0000 7f11742b1740 1 --2- 172.21.15.18:0/473100678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93939b60 0x55ab9395cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.418+0000 7f11742b1740 1 -- 172.21.15.18:0/473100678 >> 172.21.15.18:0/473100678 conn(0x55ab939360f0 msgr2=0x55ab93940d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:57.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.419+0000 7f11742b1740 1 -- 172.21.15.18:0/473100678 shutdown_connections 2024-09-19T09:54:57.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.420+0000 7f11742b1740 1 -- 172.21.15.18:0/473100678 wait complete. 2024-09-19T09:54:57.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.420+0000 7f11742b1740 1 -- start start 2024-09-19T09:54:57.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.421+0000 7f11742b1740 1 Processor -- start 2024-09-19T09:54:57.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.423+0000 7f11742b1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 0x55ab9394d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.423+0000 7f11742b1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab9393a480 0x55ab939486c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.423+0000 7f11742b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 0x55ab93948c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.424+0000 7f11742b1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f116c1c5d90 con 0x55ab9393a480 2024-09-19T09:54:57.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.424+0000 7f11742b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f116c10e220 con 0x55ab93944d40 2024-09-19T09:54:57.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.424+0000 7f11742b1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f116c10b460 con 0x55ab93939b60 2024-09-19T09:54:57.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.424+0000 7f11742b1740 10 client.0 _ll_register_callbacks cb 0x7f11640103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:54:57.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.425+0000 7f116bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 0x55ab93948c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.425+0000 7f116bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 0x55ab93948c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:57760/0 (socket says 172.21.15.18:57760) 2024-09-19T09:54:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.425+0000 7f116bfff640 1 -- 172.21.15.18:0/3596660263 learned_addr learned my addr 172.21.15.18:0/3596660263 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:54:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.425+0000 7f116b7fe640 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 0x55ab9394d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.428+0000 7f116bfff640 1 -- 172.21.15.18:0/3596660263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 msgr2=0x55ab9394d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.428+0000 7f116bfff640 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 0x55ab9394d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.428+0000 7f116bfff640 1 -- 172.21.15.18:0/3596660263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab9393a480 msgr2=0x55ab939486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:54:57.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.428+0000 7f116bfff640 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab9393a480 0x55ab939486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.428+0000 7f116bfff640 1 -- 172.21.15.18:0/3596660263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab939492a0 con 0x55ab93944d40 2024-09-19T09:54:57.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.431+0000 7f116bfff640 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 0x55ab93948c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f115c011dc0 tx=0x7f115c00bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2193887bb37d4bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:54:57.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.431+0000 7f114affd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:54:57.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.433+0000 7f114affd640 1 -- 172.21.15.18:0/3596660263 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c021040 con 0x55ab93944d40 2024-09-19T09:54:57.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.433+0000 7f114affd640 1 -- 172.21.15.18:0/3596660263 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f115c018070 con 0x55ab93944d40 2024-09-19T09:54:57.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.433+0000 7f11742b1740 1 -- 172.21.15.18:0/3596660263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f115c011440 con 0x55ab93944d40 2024-09-19T09:54:57.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.436+0000 7f114affd640 1 -- 172.21.15.18:0/3596660263 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f115c003bf0 con 0x55ab93944d40 2024-09-19T09:54:57.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.436+0000 7f11742b1740 10 client.25757 fetch_fsmap learned FSMap version 28 2024-09-19T09:54:57.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.437+0000 7f11742b1740 1 -- 172.21.15.18:0/3596660263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ab939bfbf0 con 0x55ab93944d40 2024-09-19T09:54:57.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.439+0000 7f114affd640 1 -- 172.21.15.18:0/3596660263 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115c003d90 con 0x55ab93944d40 2024-09-19T09:54:57.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.441+0000 7f114affd640 1 -- 172.21.15.18:0/3596660263 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f115c024070 con 0x55ab93944d40 2024-09-19T09:54:57.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.442+0000 7f11742b1740 10 client.25757 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:54:57.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.442+0000 7f11742b1740 10 client.25757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:54:57.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.442+0000 7f11742b1740 20 client.25757 populate_metadata read hostname 'smithi018' 2024-09-19T09:54:57.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.442+0000 7f11742b1740 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab939c0250 0x55ab939c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:54:57.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.442+0000 7f11742b1740 4 client.25757 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:54:57.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.442+0000 7f11742b1740 1 -- 172.21.15.18:0/3596660263 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f115c011440 con 0x55ab939c0250 2024-09-19T09:54:57.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.448+0000 7f116b7fe640 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab939c0250 0x55ab939c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:54:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.453+0000 7f116b7fe640 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab939c0250 0x55ab939c2670 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8f5bad6b5a7d8a8 server_cookie=30378452d8c36dc0 in_seq=0 out_seq=0 2024-09-19T09:54:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.453+0000 7f114affd640 10 client.25757 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:57.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.845+0000 7f114affd640 1 -- 172.21.15.18:0/3596660263 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f115c011440 con 0x55ab939c0250 2024-09-19T09:54:57.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.845+0000 7f114affd640 10 client.25757 handle_command_reply: tid=0 2024-09-19T09:54:57.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.846+0000 7f11742b1740 1 client.25757 shutdown 2024-09-19T09:54:57.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.846+0000 7f11742b1740 1 -- 172.21.15.18:0/3596660263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 msgr2=0x55ab93948c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:57.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.846+0000 7f11742b1740 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 0x55ab93948c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f115c011dc0 tx=0x7f115c00bf80 comp rx=0 tx=0).stop 2024-09-19T09:54:57.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:57 smithi018 ceph-mon[30956]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 898 MiB/s wr, 2.39k op/s 2024-09-19T09:54:57.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.847+0000 7f11742b1740 1 -- 172.21.15.18:0/3596660263 shutdown_connections 2024-09-19T09:54:57.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.847+0000 7f11742b1740 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab939c0250 0x55ab939c2670 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.847+0000 7f11742b1740 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab93944d40 0x55ab93948c00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.847+0000 7f11742b1740 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab9393a480 0x55ab939486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.847+0000 7f11742b1740 1 --2- 172.21.15.18:0/3596660263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab93939b60 0x55ab9394d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.847+0000 7f11742b1740 1 -- 172.21.15.18:0/3596660263 >> 172.21.15.18:0/3596660263 conn(0x55ab939360f0 msgr2=0x55ab93943280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:57.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.847+0000 7f114affd640 0 client.25757 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:54:57.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.847+0000 7f11742b1740 1 -- 172.21.15.18:0/3596660263 shutdown_connections 2024-09-19T09:54:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:54:57.852 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T09:54:57.852 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "cc392d73-0751-4aa9-ad93-704ce8dde7f0", 2024-09-19T09:54:57.852 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T09:54:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:54:57.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.848+0000 7f11742b1740 1 -- 172.21.15.18:0/3596660263 wait complete. 2024-09-19T09:54:57.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.848+0000 7f11742b1740 20 client.25757 trim_cache size 0 max 16384 2024-09-19T09:54:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.850+0000 7f1171ed8640 1 -- 172.21.15.18:0/2598960212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f11540a32c0 msgr2=0x7f11540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.850+0000 7f1171ed8640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f11540a32c0 0x7f11540a5780 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1160033040 tx=0x7f1160005c00 comp rx=0 tx=0).stop 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.850+0000 7f1171ed8640 1 -- 172.21.15.18:0/2598960212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f116c074eb0 msgr2=0x7f116c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.850+0000 7f1171ed8640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f116c074eb0 0x7f116c06ca40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f116400eab0 tx=0x7f116400ef70 comp rx=0 tx=0).stop 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.850+0000 7f1171ed8640 1 -- 172.21.15.18:0/2598960212 shutdown_connections 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.850+0000 7f1171ed8640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f11540a32c0 0x7f11540a5780 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1160033040 tx=0x7f1160005c00 comp rx=0 tx=0).stop 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.850+0000 7f1171ed8640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f116c112b90 0x7f116c06cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.850+0000 7f1171ed8640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f116c074eb0 0x7f116c06ca40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.850+0000 7f1171ed8640 1 --2- 172.21.15.18:0/2598960212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c074590 0x7f116c0739b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.850+0000 7f1171ed8640 1 -- 172.21.15.18:0/2598960212 >> 172.21.15.18:0/2598960212 conn(0x7f116c0fd8e0 msgr2=0x7f116c0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.851+0000 7f1171ed8640 1 -- 172.21.15.18:0/2598960212 shutdown_connections 2024-09-19T09:54:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:54:57.851+0000 7f1171ed8640 1 -- 172.21.15.18:0/2598960212 wait complete. 2024-09-19T09:54:57.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:57 smithi049 ceph-mon[34858]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 898 MiB/s wr, 2.39k op/s 2024-09-19T09:54:57.912 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:57 smithi162 ceph-mon[35174]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 898 MiB/s wr, 2.39k op/s 2024-09-19T09:54:59.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:55:00.112 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:00.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:59 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T09:55:00.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:59 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:55:00.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:59 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T09:55:00.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:54:59 smithi018 ceph-mon[30956]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 824 MiB/s wr, 2.11k op/s 2024-09-19T09:55:00.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:59 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T09:55:00.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:59 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:55:00.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:59 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T09:55:00.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:54:59 smithi049 ceph-mon[34858]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 824 MiB/s wr, 2.11k op/s 2024-09-19T09:55:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:59 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T09:55:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:59 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:55:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:59 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T09:55:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:54:59 smithi162 ceph-mon[35174]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 824 MiB/s wr, 2.11k op/s 2024-09-19T09:55:00.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.995+0000 7f482a13d640 1 -- 172.21.15.18:0/629715223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48240ffa60 msgr2=0x7f48240ffe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:00.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.995+0000 7f482a13d640 1 --2- 172.21.15.18:0/629715223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48240ffa60 0x7f48240ffe40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4820009900 tx=0x7f482002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:55:00.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.995+0000 7f482a13d640 1 -- 172.21.15.18:0/629715223 shutdown_connections 2024-09-19T09:55:00.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.995+0000 7f482a13d640 1 --2- 172.21.15.18:0/629715223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48241126f0 0x7f4824114ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:00.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.995+0000 7f482a13d640 1 --2- 172.21.15.18:0/629715223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4824100380 0x7f48241121b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:00.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.995+0000 7f482a13d640 1 --2- 172.21.15.18:0/629715223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48240ffa60 0x7f48240ffe40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:00.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.995+0000 7f482a13d640 1 -- 172.21.15.18:0/629715223 >> 172.21.15.18:0/629715223 conn(0x7f48240fb920 msgr2=0x7f48240fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:00.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.996+0000 7f482a13d640 1 -- 172.21.15.18:0/629715223 shutdown_connections 2024-09-19T09:55:01.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.996+0000 7f482a13d640 1 -- 172.21.15.18:0/629715223 wait complete. 2024-09-19T09:55:01.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.997+0000 7f482a13d640 1 Processor -- start 2024-09-19T09:55:01.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.997+0000 7f482a13d640 1 -- start start 2024-09-19T09:55:01.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.998+0000 7f482a13d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4824100380 0x7f48241120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.998+0000 7f482a13d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48241126f0 0x7f482410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.998+0000 7f482a13d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f482410c700 0x7f482410cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.998+0000 7f482a13d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f48241083e0 con 0x7f482410c700 2024-09-19T09:55:01.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.998+0000 7f482a13d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4824108260 con 0x7f4824100380 2024-09-19T09:55:01.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.998+0000 7f482a13d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4824108560 con 0x7f48241126f0 2024-09-19T09:55:01.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.999+0000 7f482893a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48241126f0 0x7f482410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:00.999+0000 7f482913b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4824100380 0x7f48241120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.000+0000 7f482893a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48241126f0 0x7f482410c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49152/0 (socket says 172.21.15.18:49152) 2024-09-19T09:55:01.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.000+0000 7f482893a640 1 -- 172.21.15.18:0/2599371925 learned_addr learned my addr 172.21.15.18:0/2599371925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:01.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.001+0000 7f482893a640 1 -- 172.21.15.18:0/2599371925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4824100380 msgr2=0x7f48241120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:01.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.001+0000 7f482893a640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4824100380 0x7f48241120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.001+0000 7f482893a640 1 -- 172.21.15.18:0/2599371925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f482410c700 msgr2=0x7f482410cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.001+0000 7f482893a640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f482410c700 0x7f482410cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.001+0000 7f482893a640 1 -- 172.21.15.18:0/2599371925 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482406bd40 con 0x7f48241126f0 2024-09-19T09:55:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.002+0000 7f482893a640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48241126f0 0x7f482410c170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f481400b450 tx=0x7f481400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:01.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.006+0000 7f481a7fc640 1 -- 172.21.15.18:0/2599371925 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814015020 con 0x7f48241126f0 2024-09-19T09:55:01.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.006+0000 7f481a7fc640 1 -- 172.21.15.18:0/2599371925 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4814011d70 con 0x7f48241126f0 2024-09-19T09:55:01.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.006+0000 7f482a13d640 1 -- 172.21.15.18:0/2599371925 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f482406c030 con 0x7f48241126f0 2024-09-19T09:55:01.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.006+0000 7f481a7fc640 1 -- 172.21.15.18:0/2599371925 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481400f340 con 0x7f48241126f0 2024-09-19T09:55:01.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.006+0000 7f482a13d640 1 -- 172.21.15.18:0/2599371925 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f482406c570 con 0x7f48241126f0 2024-09-19T09:55:01.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.011+0000 7f482d778740 1 Processor -- start 2024-09-19T09:55:01.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.011+0000 7f482d778740 1 -- start start 2024-09-19T09:55:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.011+0000 7f482d778740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec531970 0x5560ec531d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.011+0000 7f482d778740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec532290 0x5560ec53c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.011+0000 7f482d778740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 0x5560ec53ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.011+0000 7f482d778740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5560ec4972e0 con 0x5560ec532290 2024-09-19T09:55:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.011+0000 7f482d778740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5560ec43ece0 con 0x5560ec53cb50 2024-09-19T09:55:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.011+0000 7f482d778740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5560ec4932a0 con 0x5560ec531970 2024-09-19T09:55:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.016+0000 7f482893a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 0x5560ec53ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.017+0000 7f482993c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec531970 0x5560ec531d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.017+0000 7f482993c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec531970 0x5560ec531d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49168/0 (socket says 172.21.15.18:49168) 2024-09-19T09:55:01.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.017+0000 7f482993c640 1 -- 172.21.15.18:0/1724475628 learned_addr learned my addr 172.21.15.18:0/1724475628 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:01.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.018+0000 7f481a7fc640 1 -- 172.21.15.18:0/2599371925 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4814018020 con 0x7f48241126f0 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.018+0000 7f482913b640 1 --2- 172.21.15.18:0/1724475628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec532290 0x5560ec53c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.019+0000 7f482893a640 1 -- 172.21.15.18:0/1724475628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec531970 msgr2=0x5560ec531d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.019+0000 7f482893a640 1 --2- 172.21.15.18:0/1724475628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec531970 0x5560ec531d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.019+0000 7f482893a640 1 -- 172.21.15.18:0/1724475628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec532290 msgr2=0x5560ec53c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.019+0000 7f482893a640 1 --2- 172.21.15.18:0/1724475628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec532290 0x5560ec53c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.019+0000 7f482893a640 1 -- 172.21.15.18:0/1724475628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ec423440 con 0x5560ec53cb50 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.019+0000 7f482993c640 1 --2- 172.21.15.18:0/1724475628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec531970 0x5560ec531d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.020+0000 7f482893a640 1 --2- 172.21.15.18:0/1724475628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 0x5560ec53ef40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f48140ccd30 tx=0x7f48140d7750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a29541ad5fd944c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.021+0000 7f480effd640 1 -- 172.21.15.18:0/1724475628 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48140e2070 con 0x5560ec53cb50 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.021+0000 7f480effd640 1 -- 172.21.15.18:0/1724475628 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48140cfab0 con 0x5560ec53cb50 2024-09-19T09:55:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.021+0000 7f480effd640 1 -- 172.21.15.18:0/1724475628 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48140ddaa0 con 0x5560ec53cb50 2024-09-19T09:55:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.021+0000 7f481a7fc640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48100a3450 0x7f48100a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.022+0000 7f481a7fc640 1 -- 172.21.15.18:0/2599371925 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f48140cf2c0 con 0x7f48241126f0 2024-09-19T09:55:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.022+0000 7f482d778740 1 -- 172.21.15.18:0/1724475628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 msgr2=0x5560ec53ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.022+0000 7f482d778740 1 --2- 172.21.15.18:0/1724475628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 0x5560ec53ef40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f48140ccd30 tx=0x7f48140d7750 comp rx=0 tx=0).stop 2024-09-19T09:55:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.022+0000 7f482d778740 1 -- 172.21.15.18:0/1724475628 shutdown_connections 2024-09-19T09:55:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.022+0000 7f482d778740 1 --2- 172.21.15.18:0/1724475628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 0x5560ec53ef40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.022+0000 7f482d778740 1 --2- 172.21.15.18:0/1724475628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec532290 0x5560ec53c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.022+0000 7f482d778740 1 --2- 172.21.15.18:0/1724475628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec531970 0x5560ec531d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.022+0000 7f482d778740 1 -- 172.21.15.18:0/1724475628 >> 172.21.15.18:0/1724475628 conn(0x5560ec52df00 msgr2=0x5560ec52e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.023+0000 7f482d778740 1 -- 172.21.15.18:0/1724475628 shutdown_connections 2024-09-19T09:55:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.023+0000 7f482d778740 1 -- 172.21.15.18:0/1724475628 wait complete. 2024-09-19T09:55:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.023+0000 7f482d778740 1 -- start start 2024-09-19T09:55:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.023+0000 7f482d778740 1 Processor -- start 2024-09-19T09:55:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.023+0000 7f482993c640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48100a3450 0x7f48100a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.024+0000 7f482d778740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec531970 0x5560ec53c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.024+0000 7f482d778740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 0x5560ec539540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.024+0000 7f482d778740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 0x5560ec539a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.024+0000 7f482d778740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5560ec53f630 con 0x5560ec531970 2024-09-19T09:55:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.024+0000 7f482d778740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5560ec452050 con 0x5560ec53cb50 2024-09-19T09:55:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.024+0000 7f482d778740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5560ec53f7b0 con 0x5560ec532290 2024-09-19T09:55:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.024+0000 7f482d778740 10 client.0 _ll_register_callbacks cb 0x5560ec492160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.026+0000 7f482993c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 0x5560ec539a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.026+0000 7f482993c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 0x5560ec539a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:57800/0 (socket says 172.21.15.18:57800) 2024-09-19T09:55:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.026+0000 7f482913b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec531970 0x5560ec53c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.026+0000 7f482993c640 1 -- 172.21.15.18:0/4201270527 learned_addr learned my addr 172.21.15.18:0/4201270527 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.027+0000 7f482893a640 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 0x5560ec539540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.028+0000 7f482893a640 1 -- 172.21.15.18:0/4201270527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 msgr2=0x5560ec539a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:01.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.029+0000 7f482893a640 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 0x5560ec539a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.029+0000 7f482893a640 1 -- 172.21.15.18:0/4201270527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec531970 msgr2=0x5560ec53c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:01.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.029+0000 7f482893a640 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec531970 0x5560ec53c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.029+0000 7f482893a640 1 -- 172.21.15.18:0/4201270527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ec2083c0 con 0x5560ec532290 2024-09-19T09:55:01.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.029+0000 7f482913b640 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec531970 0x5560ec53c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:55:01.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.029+0000 7f482993c640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48100a3450 0x7f48100a5910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f481c015960 tx=0x7f481c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:01.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.030+0000 7f482893a640 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 0x5560ec539540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f481400be10 tx=0x7f4814009300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cf93481c5e8c77c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:01.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.030+0000 7f480cff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:55:01.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.031+0000 7f480cff9640 1 -- 172.21.15.18:0/4201270527 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814097b50 con 0x5560ec532290 2024-09-19T09:55:01.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.031+0000 7f482d778740 1 -- 172.21.15.18:0/4201270527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48140cfab0 con 0x5560ec532290 2024-09-19T09:55:01.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.031+0000 7f480cff9640 1 -- 172.21.15.18:0/4201270527 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4814099bb0 con 0x5560ec532290 2024-09-19T09:55:01.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.032+0000 7f480cff9640 1 -- 172.21.15.18:0/4201270527 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f481409b210 con 0x5560ec532290 2024-09-19T09:55:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.032+0000 7f482d778740 10 client.25717 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.032+0000 7f482d778740 1 -- 172.21.15.18:0/4201270527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560ec53f630 con 0x5560ec532290 2024-09-19T09:55:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.033+0000 7f480cff9640 1 -- 172.21.15.18:0/4201270527 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48140cfab0 con 0x5560ec532290 2024-09-19T09:55:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.033+0000 7f480cff9640 1 -- 172.21.15.18:0/4201270527 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f48140103e0 con 0x5560ec532290 2024-09-19T09:55:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.035+0000 7f482d778740 10 client.25717 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.035+0000 7f482d778740 10 client.25717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.035+0000 7f482d778740 20 client.25717 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.035+0000 7f482d778740 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5560ec54c240 0x5560ec54e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.035+0000 7f482d778740 4 client.25717 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.035+0000 7f482d778740 1 -- 172.21.15.18:0/4201270527 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560ec4a4850 con 0x5560ec54c240 2024-09-19T09:55:01.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.037+0000 7f482913b640 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5560ec54c240 0x5560ec54e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.041+0000 7f482913b640 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5560ec54c240 0x5560ec54e660 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a798121443382ee1 server_cookie=a8726ee9bfd845f8 in_seq=0 out_seq=0 2024-09-19T09:55:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.041+0000 7f480cff9640 10 client.25717 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f480cff9640 1 -- 172.21.15.18:0/4201270527 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560ec4a4850 con 0x5560ec54c240 2024-09-19T09:55:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f480cff9640 10 client.25717 handle_command_reply: tid=0 2024-09-19T09:55:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f482d778740 1 client.25717 shutdown 2024-09-19T09:55:01.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f482d778740 1 -- 172.21.15.18:0/4201270527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 msgr2=0x5560ec539540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:01.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f482d778740 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 0x5560ec539540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f481400be10 tx=0x7f4814009300 comp rx=0 tx=0).stop 2024-09-19T09:55:01.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f482d778740 1 -- 172.21.15.18:0/4201270527 shutdown_connections 2024-09-19T09:55:01.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f482d778740 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5560ec54c240 0x5560ec54e660 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f482d778740 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec53cb50 0x5560ec539a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f482d778740 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 0x5560ec539540 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f482d778740 1 --2- 172.21.15.18:0/4201270527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec531970 0x5560ec53c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.046+0000 7f482d778740 1 -- 172.21.15.18:0/4201270527 >> 172.21.15.18:0/4201270527 conn(0x5560ec52df00 msgr2=0x5560ec533410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:01.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.047+0000 7f480cff9640 0 client.25717 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:01.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.047+0000 7f482d778740 1 -- 172.21.15.18:0/4201270527 shutdown_connections 2024-09-19T09:55:01.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.047+0000 7f482d778740 1 -- 172.21.15.18:0/4201270527 wait complete. 2024-09-19T09:55:01.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.047+0000 7f482d778740 20 client.25717 trim_cache size 0 max 16384 2024-09-19T09:55:01.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.116+0000 7f482d778740 1 Processor -- start 2024-09-19T09:55:01.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.116+0000 7f482d778740 1 -- start start 2024-09-19T09:55:01.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.117+0000 7f482d778740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec531970 0x5560ec52d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.117+0000 7f482d778740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 0x5560ec538540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.122+0000 7f482913b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec531970 0x5560ec52d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.123+0000 7f482d778740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec53cb50 0x5560ec553f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.123+0000 7f482d778740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f480800e4b0 con 0x5560ec53cb50 2024-09-19T09:55:01.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.123+0000 7f482d778740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f480800fff0 con 0x5560ec531970 2024-09-19T09:55:01.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.123+0000 7f482d778740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f480800eb80 con 0x5560ec532290 2024-09-19T09:55:01.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.123+0000 7f482913b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec531970 0x5560ec52d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:57802/0 (socket says 172.21.15.18:57802) 2024-09-19T09:55:01.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.124+0000 7f482913b640 1 -- 172.21.15.18:0/2490889384 learned_addr learned my addr 172.21.15.18:0/2490889384 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:01.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.124+0000 7f482893a640 1 --2- 172.21.15.18:0/2490889384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 0x5560ec538540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.125+0000 7f482993c640 1 --2- 172.21.15.18:0/2490889384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec53cb50 0x5560ec553f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.127+0000 7f482913b640 1 -- 172.21.15.18:0/2490889384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 msgr2=0x5560ec538540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:01.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.127+0000 7f482913b640 1 --2- 172.21.15.18:0/2490889384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 0x5560ec538540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.127+0000 7f482913b640 1 -- 172.21.15.18:0/2490889384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec53cb50 msgr2=0x5560ec553f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:01.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.127+0000 7f482913b640 1 --2- 172.21.15.18:0/2490889384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec53cb50 0x5560ec553f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.127+0000 7f482913b640 1 -- 172.21.15.18:0/2490889384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ec5320c0 con 0x5560ec531970 2024-09-19T09:55:01.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.128+0000 7f482913b640 1 --2- 172.21.15.18:0/2490889384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec531970 0x5560ec52d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f482002aac0 tx=0x7f4820005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f78d04a6b82b6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:01.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.128+0000 7f480e7fc640 1 -- 172.21.15.18:0/2490889384 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820049020 con 0x5560ec531970 2024-09-19T09:55:01.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.129+0000 7f480e7fc640 1 -- 172.21.15.18:0/2490889384 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4820004410 con 0x5560ec531970 2024-09-19T09:55:01.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.130+0000 7f482d778740 1 -- 172.21.15.18:0/2490889384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec531970 msgr2=0x5560ec52d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:01.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.130+0000 7f482d778740 1 --2- 172.21.15.18:0/2490889384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec531970 0x5560ec52d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f482002aac0 tx=0x7f4820005fd0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.131+0000 7f482d778740 1 -- 172.21.15.18:0/2490889384 shutdown_connections 2024-09-19T09:55:01.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.131+0000 7f482d778740 1 --2- 172.21.15.18:0/2490889384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec53cb50 0x5560ec553f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.131+0000 7f482d778740 1 --2- 172.21.15.18:0/2490889384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec532290 0x5560ec538540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.131+0000 7f482d778740 1 --2- 172.21.15.18:0/2490889384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec531970 0x5560ec52d300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.131+0000 7f482d778740 1 -- 172.21.15.18:0/2490889384 >> 172.21.15.18:0/2490889384 conn(0x5560ec52df00 msgr2=0x5560ec537e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:01.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.131+0000 7f482d778740 1 -- 172.21.15.18:0/2490889384 shutdown_connections 2024-09-19T09:55:01.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.131+0000 7f482d778740 1 -- 172.21.15.18:0/2490889384 wait complete. 2024-09-19T09:55:01.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.132+0000 7f482d778740 1 -- start start 2024-09-19T09:55:01.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.133+0000 7f482d778740 1 Processor -- start 2024-09-19T09:55:01.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.137+0000 7f482d778740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec531970 0x5560ec536530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.137+0000 7f482d778740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec532290 0x5560ec536a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.137+0000 7f482d778740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec53cb50 0x5560ec536fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.137+0000 7f482d778740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f480800f920 con 0x5560ec531970 2024-09-19T09:55:01.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.137+0000 7f482d778740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f480800f250 con 0x5560ec532290 2024-09-19T09:55:01.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.137+0000 7f482d778740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f480800c490 con 0x5560ec53cb50 2024-09-19T09:55:01.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.137+0000 7f482d778740 10 client.0 _ll_register_callbacks cb 0x7f48140e0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:01.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.138+0000 7f482993c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec53cb50 0x5560ec536fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.138+0000 7f482993c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec53cb50 0x5560ec536fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49206/0 (socket says 172.21.15.18:49206) 2024-09-19T09:55:01.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.138+0000 7f482993c640 1 -- 172.21.15.18:0/2706410480 learned_addr learned my addr 172.21.15.18:0/2706410480 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:01.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.138+0000 7f482893a640 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec532290 0x5560ec536a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.139+0000 7f482993c640 1 -- 172.21.15.18:0/2706410480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec532290 msgr2=0x5560ec536a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:01.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.139+0000 7f482993c640 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec532290 0x5560ec536a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.139+0000 7f482993c640 1 -- 172.21.15.18:0/2706410480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec531970 msgr2=0x5560ec536530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:01.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.139+0000 7f482993c640 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec531970 0x5560ec536530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.139+0000 7f482993c640 1 -- 172.21.15.18:0/2706410480 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ec5001d0 con 0x5560ec53cb50 2024-09-19T09:55:01.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.140+0000 7f482993c640 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec53cb50 0x5560ec536fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f481c009b60 tx=0x7f481c01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4da96433213e6600 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:01.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.140+0000 7f480cff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:55:01.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.142+0000 7f480cff9640 1 -- 172.21.15.18:0/2706410480 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c02b060 con 0x5560ec53cb50 2024-09-19T09:55:01.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.143+0000 7f482d778740 1 -- 172.21.15.18:0/2706410480 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4820004410 con 0x5560ec53cb50 2024-09-19T09:55:01.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.143+0000 7f480cff9640 1 -- 172.21.15.18:0/2706410480 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f481c01a800 con 0x5560ec53cb50 2024-09-19T09:55:01.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.147+0000 7f480cff9640 1 -- 172.21.15.18:0/2706410480 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f481c01aa00 con 0x5560ec53cb50 2024-09-19T09:55:01.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.149+0000 7f482d778740 10 client.25723 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:01.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.149+0000 7f482d778740 1 -- 172.21.15.18:0/2706410480 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560ec5b7030 con 0x5560ec53cb50 2024-09-19T09:55:01.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.154+0000 7f480cff9640 1 -- 172.21.15.18:0/2706410480 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4820004410 con 0x5560ec53cb50 2024-09-19T09:55:01.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.154+0000 7f480cff9640 1 -- 172.21.15.18:0/2706410480 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f481c02f3a0 con 0x5560ec53cb50 2024-09-19T09:55:01.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.156+0000 7f482d778740 10 client.25723 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.156+0000 7f482d778740 10 client.25723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.156+0000 7f482d778740 20 client.25723 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.156+0000 7f482d778740 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5560ec5b7740 0x5560ec5b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.156+0000 7f482d778740 4 client.25723 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:55:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.156+0000 7f482d778740 1 -- 172.21.15.18:0/2706410480 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5560ec49ed60 con 0x5560ec5b7740 2024-09-19T09:55:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.161+0000 7f482913b640 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5560ec5b7740 0x5560ec5b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:01.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.173+0000 7f480cff9640 10 client.25723 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:01.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.173+0000 7f482913b640 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5560ec5b7740 0x5560ec5b9b80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76bfb9016f1900fc server_cookie=c695a38ff9f753d0 in_seq=0 out_seq=0 2024-09-19T09:55:01.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.176+0000 7f480cff9640 1 -- 172.21.15.18:0/2706410480 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5560ec49ed60 con 0x5560ec5b7740 2024-09-19T09:55:01.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.176+0000 7f480cff9640 10 client.25723 handle_command_reply: tid=0 2024-09-19T09:55:01.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.177+0000 7f482d778740 1 client.25723 shutdown 2024-09-19T09:55:01.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.182+0000 7f482d778740 1 -- 172.21.15.18:0/2706410480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec53cb50 msgr2=0x5560ec536fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:01.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.182+0000 7f482d778740 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec53cb50 0x5560ec536fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f481c009b60 tx=0x7f481c01a000 comp rx=0 tx=0).stop 2024-09-19T09:55:01.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.187+0000 7f482d778740 1 -- 172.21.15.18:0/2706410480 shutdown_connections 2024-09-19T09:55:01.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.187+0000 7f482d778740 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5560ec5b7740 0x5560ec5b9b80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.187+0000 7f482d778740 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560ec53cb50 0x5560ec536fb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.187+0000 7f482d778740 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5560ec532290 0x5560ec536a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.187+0000 7f482d778740 1 --2- 172.21.15.18:0/2706410480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560ec531970 0x5560ec536530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.187+0000 7f480cff9640 0 client.25723 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:01.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.187+0000 7f482d778740 1 -- 172.21.15.18:0/2706410480 >> 172.21.15.18:0/2706410480 conn(0x5560ec52df00 msgr2=0x5560ec538650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:01.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.189+0000 7f482d778740 1 -- 172.21.15.18:0/2706410480 shutdown_connections 2024-09-19T09:55:01.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.189+0000 7f482d778740 1 -- 172.21.15.18:0/2706410480 wait complete. 2024-09-19T09:55:01.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.189+0000 7f482d778740 20 client.25723 trim_cache size 0 max 16384 2024-09-19T09:55:01.196 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:55:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:55:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "cc392d73-0751-4aa9-ad93-704ce8dde7f0": { 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "cc392d73-0751-4aa9-ad93-704ce8dde7f0", 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.190+0000 7f480ffff640 1 -- 172.21.15.18:0/2599371925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48100a3450 msgr2=0x7f48100a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.190+0000 7f480ffff640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48100a3450 0x7f48100a5910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f481c015960 tx=0x7f481c0095c0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.191+0000 7f480ffff640 1 -- 172.21.15.18:0/2599371925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48241126f0 msgr2=0x7f482410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.191+0000 7f480ffff640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48241126f0 0x7f482410c170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f481400b450 tx=0x7f481400b910 comp rx=0 tx=0).stop 2024-09-19T09:55:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.191+0000 7f480ffff640 1 -- 172.21.15.18:0/2599371925 shutdown_connections 2024-09-19T09:55:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.191+0000 7f480ffff640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48100a3450 0x7f48100a5910 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.191+0000 7f480ffff640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f482410c700 0x7f482410cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.192+0000 7f480ffff640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48241126f0 0x7f482410c170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.192+0000 7f480ffff640 1 --2- 172.21.15.18:0/2599371925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4824100380 0x7f48241120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.192+0000 7f480ffff640 1 -- 172.21.15.18:0/2599371925 >> 172.21.15.18:0/2599371925 conn(0x7f48240fb920 msgr2=0x7f4824114850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.198+0000 7f480ffff640 1 -- 172.21.15.18:0/2599371925 shutdown_connections 2024-09-19T09:55:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:01.198+0000 7f480ffff640 1 -- 172.21.15.18:0/2599371925 wait complete. 2024-09-19T09:55:02.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:01 smithi018 ceph-mon[30956]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 871 MiB/s wr, 2.24k op/s 2024-09-19T09:55:02.079 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:01 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:55:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:01 smithi049 ceph-mon[34858]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 871 MiB/s wr, 2.24k op/s 2024-09-19T09:55:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:01 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:55:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:01 smithi162 ceph-mon[35174]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 871 MiB/s wr, 2.24k op/s 2024-09-19T09:55:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:01 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:55:02.241 INFO:tasks.cephfs.filesystem:scrub status for tag:cc392d73-0751-4aa9-ad93-704ce8dde7f0 - {'path': '/', 'tag': 'cc392d73-0751-4aa9-ad93-704ce8dde7f0', 'options': 'recursive,force'} 2024-09-19T09:55:04.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:03 smithi018 ceph-mon[30956]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 905 MiB/s wr, 2.48k op/s 2024-09-19T09:55:04.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:03 smithi049 ceph-mon[34858]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 905 MiB/s wr, 2.48k op/s 2024-09-19T09:55:04.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:03 smithi162 ceph-mon[35174]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 905 MiB/s wr, 2.48k op/s 2024-09-19T09:55:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.239+0000 7efe338af640 1 -- 172.21.15.18:0/630278793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe2c10b4e0 msgr2=0x7efe2c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:04.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.239+0000 7efe338af640 1 --2- 172.21.15.18:0/630278793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe2c10b4e0 0x7efe2c10d950 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7efe24009ca0 tx=0x7efe2402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.239+0000 7efe338af640 1 -- 172.21.15.18:0/630278793 shutdown_connections 2024-09-19T09:55:04.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.239+0000 7efe338af640 1 --2- 172.21.15.18:0/630278793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c10de90 0x7efe2c110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.239+0000 7efe338af640 1 --2- 172.21.15.18:0/630278793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe2c10b4e0 0x7efe2c10d950 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.239+0000 7efe338af640 1 --2- 172.21.15.18:0/630278793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe2c072d80 0x7efe2c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.239+0000 7efe338af640 1 -- 172.21.15.18:0/630278793 >> 172.21.15.18:0/630278793 conn(0x7efe2c06eb50 msgr2=0x7efe2c070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:04.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.240+0000 7efe338af640 1 -- 172.21.15.18:0/630278793 shutdown_connections 2024-09-19T09:55:04.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.240+0000 7efe338af640 1 -- 172.21.15.18:0/630278793 wait complete. 2024-09-19T09:55:04.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.242+0000 7efe338af640 1 Processor -- start 2024-09-19T09:55:04.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.242+0000 7efe338af640 1 -- start start 2024-09-19T09:55:04.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.243+0000 7efe338af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c072d80 0x7efe2c1a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.243+0000 7efe338af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe2c10b4e0 0x7efe2c1a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.243+0000 7efe338af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe2c10de90 0x7efe2c1ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.244+0000 7efe3164b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c072d80 0x7efe2c1a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.244+0000 7efe3164b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c072d80 0x7efe2c1a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49222/0 (socket says 172.21.15.18:49222) 2024-09-19T09:55:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.244+0000 7efe3164b640 1 -- 172.21.15.18:0/4131392870 learned_addr learned my addr 172.21.15.18:0/4131392870 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.244+0000 7efe30e4a640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe2c10b4e0 0x7efe2c1a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.243+0000 7efe338af640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c11c400 con 0x7efe2c10b4e0 2024-09-19T09:55:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.244+0000 7efe31e4c640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe2c10de90 0x7efe2c1ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.244+0000 7efe338af640 1 -- 172.21.15.18:0/4131392870 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c11c280 con 0x7efe2c10de90 2024-09-19T09:55:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.245+0000 7efe338af640 1 -- 172.21.15.18:0/4131392870 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c11c580 con 0x7efe2c072d80 2024-09-19T09:55:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.246+0000 7efe3164b640 1 -- 172.21.15.18:0/4131392870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe2c10de90 msgr2=0x7efe2c1ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.246+0000 7efe3164b640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe2c10de90 0x7efe2c1ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.246+0000 7efe3164b640 1 -- 172.21.15.18:0/4131392870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe2c10b4e0 msgr2=0x7efe2c1a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.246+0000 7efe3164b640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe2c10b4e0 0x7efe2c1a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.246+0000 7efe3164b640 1 -- 172.21.15.18:0/4131392870 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2c1ae700 con 0x7efe2c072d80 2024-09-19T09:55:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.246+0000 7efe3164b640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c072d80 0x7efe2c1a6ae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00e9f0 tx=0x7efe1c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.248+0000 7efe227fc640 1 -- 172.21.15.18:0/4131392870 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00cd80 con 0x7efe2c072d80 2024-09-19T09:55:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.248+0000 7efe227fc640 1 -- 172.21.15.18:0/4131392870 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe1c005500 con 0x7efe2c072d80 2024-09-19T09:55:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.249+0000 7efe227fc640 1 -- 172.21.15.18:0/4131392870 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c010690 con 0x7efe2c072d80 2024-09-19T09:55:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.249+0000 7efe338af640 1 -- 172.21.15.18:0/4131392870 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe2c1ae9f0 con 0x7efe2c072d80 2024-09-19T09:55:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.250+0000 7efe338af640 1 -- 172.21.15.18:0/4131392870 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2c1aeec0 con 0x7efe2c072d80 2024-09-19T09:55:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.254+0000 7efe3663d740 1 Processor -- start 2024-09-19T09:55:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.255+0000 7efe3663d740 1 -- start start 2024-09-19T09:55:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.258+0000 7efe3663d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 0x55ce55cbbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.258+0000 7efe3663d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.259+0000 7efe3663d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cc1540 0x55ce55cc3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.259+0000 7efe3663d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ce55c1f2f0 con 0x55ce55cc1540 2024-09-19T09:55:04.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.259+0000 7efe31e4c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 0x55ce55cbbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.259+0000 7efe31e4c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 0x55ce55cbbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49230/0 (socket says 172.21.15.18:49230) 2024-09-19T09:55:04.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.259+0000 7efe31e4c640 1 -- 172.21.15.18:0/1487859652 learned_addr learned my addr 172.21.15.18:0/1487859652 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:04.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.259+0000 7efe3663d740 1 -- 172.21.15.18:0/1487859652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ce55bc7270 con 0x55ce55cbc4b0 2024-09-19T09:55:04.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.259+0000 7efe3663d740 1 -- 172.21.15.18:0/1487859652 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce55c1b2b0 con 0x55ce55cbbb70 2024-09-19T09:55:04.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.259+0000 7efe3164b640 1 --2- 172.21.15.18:0/1487859652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.260+0000 7efe227fc640 1 -- 172.21.15.18:0/4131392870 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efe1c004680 con 0x7efe2c072d80 2024-09-19T09:55:04.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.260+0000 7efe31e4c640 1 -- 172.21.15.18:0/1487859652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbc4b0 msgr2=0x55ce55cc0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:04.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.260+0000 7efe31e4c640 1 --2- 172.21.15.18:0/1487859652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.260+0000 7efe31e4c640 1 -- 172.21.15.18:0/1487859652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cc1540 msgr2=0x55ce55cc3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:04.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.260+0000 7efe31e4c640 1 --2- 172.21.15.18:0/1487859652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cc1540 0x55ce55cc3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.260+0000 7efe31e4c640 1 -- 172.21.15.18:0/1487859652 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce55bc6340 con 0x55ce55cbbb70 2024-09-19T09:55:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.263+0000 7efe31e4c640 1 --2- 172.21.15.18:0/1487859652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 0x55ce55cbbf70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe2800ab80 tx=0x7efe2800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d178443717d32c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.264+0000 7efe227fc640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe180a3210 0x7efe180a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.265+0000 7efe227fc640 1 -- 172.21.15.18:0/4131392870 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efe1c0cfcb0 con 0x7efe2c072d80 2024-09-19T09:55:04.268 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.266+0000 7efe3164b640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe180a3210 0x7efe180a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.269 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.267+0000 7efe3164b640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe180a3210 0x7efe180a56d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efe1c098c70 tx=0x7efe1c0d36b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:04.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.286+0000 7efe177fe640 1 -- 172.21.15.18:0/1487859652 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2801d070 con 0x55ce55cbbb70 2024-09-19T09:55:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.286+0000 7efe177fe640 1 -- 172.21.15.18:0/1487859652 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe28018b20 con 0x55ce55cbbb70 2024-09-19T09:55:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.286+0000 7efe177fe640 1 -- 172.21.15.18:0/1487859652 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28010af0 con 0x55ce55cbbb70 2024-09-19T09:55:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.288+0000 7efe3663d740 1 -- 172.21.15.18:0/1487859652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 msgr2=0x55ce55cbbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.288+0000 7efe3663d740 1 --2- 172.21.15.18:0/1487859652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 0x55ce55cbbf70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe2800ab80 tx=0x7efe2800f790 comp rx=0 tx=0).stop 2024-09-19T09:55:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.290+0000 7efe3663d740 1 -- 172.21.15.18:0/1487859652 shutdown_connections 2024-09-19T09:55:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.290+0000 7efe3663d740 1 --2- 172.21.15.18:0/1487859652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cc1540 0x55ce55cc3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.290+0000 7efe3663d740 1 --2- 172.21.15.18:0/1487859652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.290+0000 7efe3663d740 1 --2- 172.21.15.18:0/1487859652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 0x55ce55cbbf70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.290+0000 7efe3663d740 1 -- 172.21.15.18:0/1487859652 >> 172.21.15.18:0/1487859652 conn(0x55ce55cb71e0 msgr2=0x55ce55cb75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:04.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.290+0000 7efe3663d740 1 -- 172.21.15.18:0/1487859652 shutdown_connections 2024-09-19T09:55:04.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.291+0000 7efe3663d740 1 -- 172.21.15.18:0/1487859652 wait complete. 2024-09-19T09:55:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.291+0000 7efe3663d740 1 -- start start 2024-09-19T09:55:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.291+0000 7efe3663d740 1 Processor -- start 2024-09-19T09:55:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.292+0000 7efe3663d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbbb70 0x55ce55cc5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.292+0000 7efe3663d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.292+0000 7efe3663d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cc1540 0x55ce55ccd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.292+0000 7efe3663d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ce55cc4510 con 0x55ce55cbbb70 2024-09-19T09:55:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.293+0000 7efe30e4a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.293+0000 7efe30e4a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49234/0 (socket says 172.21.15.18:49234) 2024-09-19T09:55:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.293+0000 7efe30e4a640 1 -- 172.21.15.18:0/326364920 learned_addr learned my addr 172.21.15.18:0/326364920 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.293+0000 7efe31e4c640 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cc1540 0x55ce55ccd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.293+0000 7efe3663d740 1 -- 172.21.15.18:0/326364920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ce55ba8290 con 0x55ce55cc1540 2024-09-19T09:55:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.293+0000 7efe3663d740 1 -- 172.21.15.18:0/326364920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce55cc4690 con 0x55ce55cbc4b0 2024-09-19T09:55:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.294+0000 7efe3663d740 10 client.0 _ll_register_callbacks cb 0x55ce55bd9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.295+0000 7efe30e4a640 1 -- 172.21.15.18:0/326364920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cc1540 msgr2=0x55ce55ccd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.295+0000 7efe30e4a640 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cc1540 0x55ce55ccd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.295+0000 7efe30e4a640 1 -- 172.21.15.18:0/326364920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbbb70 msgr2=0x55ce55cc5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.295+0000 7efe30e4a640 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbbb70 0x55ce55cc5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.295+0000 7efe30e4a640 1 -- 172.21.15.18:0/326364920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce55932210 con 0x55ce55cbc4b0 2024-09-19T09:55:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.296+0000 7efe30e4a640 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc6390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe24031d00 tx=0x7efe24009a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c6d4d1aa63704b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:04.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.296+0000 7efe14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:55:04.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.296+0000 7efe14ff9640 1 -- 172.21.15.18:0/326364920 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe240307c0 con 0x55ce55cbc4b0 2024-09-19T09:55:04.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.296+0000 7efe3663d740 1 -- 172.21.15.18:0/326364920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe28018b20 con 0x55ce55cbc4b0 2024-09-19T09:55:04.299 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.297+0000 7efe14ff9640 1 -- 172.21.15.18:0/326364920 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efe24003b80 con 0x55ce55cbc4b0 2024-09-19T09:55:04.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.297+0000 7efe14ff9640 1 -- 172.21.15.18:0/326364920 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efe24003d80 con 0x55ce55cbc4b0 2024-09-19T09:55:04.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.297+0000 7efe3663d740 10 client.25732 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:04.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.297+0000 7efe3663d740 1 -- 172.21.15.18:0/326364920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ce559fe620 con 0x55ce55cbc4b0 2024-09-19T09:55:04.300 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.298+0000 7efe14ff9640 1 -- 172.21.15.18:0/326364920 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe28018b20 con 0x55ce55cbc4b0 2024-09-19T09:55:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.300+0000 7efe14ff9640 1 -- 172.21.15.18:0/326364920 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efe24043070 con 0x55ce55cbc4b0 2024-09-19T09:55:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.300+0000 7efe3663d740 10 client.25732 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.300+0000 7efe3663d740 10 client.25732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.300+0000 7efe3663d740 20 client.25732 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.300+0000 7efe3663d740 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ce55cd1cd0 0x55ce55cd4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.300+0000 7efe3663d740 4 client.25732 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.300+0000 7efe3663d740 1 -- 172.21.15.18:0/326364920 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce55c2ca20 con 0x55ce55cd1cd0 2024-09-19T09:55:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.303+0000 7efe31e4c640 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ce55cd1cd0 0x55ce55cd4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.305+0000 7efe31e4c640 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ce55cd1cd0 0x55ce55cd4100 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4923a2426089487 server_cookie=44ff6172a0b2db9 in_seq=0 out_seq=0 2024-09-19T09:55:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.306+0000 7efe14ff9640 10 client.25732 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.311+0000 7efe14ff9640 1 -- 172.21.15.18:0/326364920 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce55c2ca20 con 0x55ce55cd1cd0 2024-09-19T09:55:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.311+0000 7efe14ff9640 10 client.25732 handle_command_reply: tid=0 2024-09-19T09:55:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.311+0000 7efe3663d740 1 client.25732 shutdown 2024-09-19T09:55:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.311+0000 7efe3663d740 1 -- 172.21.15.18:0/326364920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbc4b0 msgr2=0x55ce55cc6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.311+0000 7efe3663d740 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc6390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe24031d00 tx=0x7efe24009a10 comp rx=0 tx=0).stop 2024-09-19T09:55:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.312+0000 7efe3663d740 1 -- 172.21.15.18:0/326364920 shutdown_connections 2024-09-19T09:55:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.312+0000 7efe3663d740 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ce55cd1cd0 0x55ce55cd4100 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.312+0000 7efe3663d740 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cc1540 0x55ce55ccd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.312+0000 7efe3663d740 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc6390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.312+0000 7efe3663d740 1 --2- 172.21.15.18:0/326364920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbbb70 0x55ce55cc5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.312+0000 7efe3663d740 1 -- 172.21.15.18:0/326364920 >> 172.21.15.18:0/326364920 conn(0x55ce55cb71e0 msgr2=0x55ce55cb89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.312+0000 7efe14ff9640 0 client.25732 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.312+0000 7efe3663d740 1 -- 172.21.15.18:0/326364920 shutdown_connections 2024-09-19T09:55:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.312+0000 7efe3663d740 1 -- 172.21.15.18:0/326364920 wait complete. 2024-09-19T09:55:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.313+0000 7efe3663d740 20 client.25732 trim_cache size 0 max 16384 2024-09-19T09:55:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.376+0000 7efe3663d740 1 Processor -- start 2024-09-19T09:55:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.377+0000 7efe3663d740 1 -- start start 2024-09-19T09:55:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.378+0000 7efe3663d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 0x55ce55cb75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.390+0000 7efe3663d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55ccd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.390+0000 7efe3663d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cc1540 0x55ce55cb7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.390+0000 7efe3663d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c1b7a70 con 0x55ce55cbc4b0 2024-09-19T09:55:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.390+0000 7efe3663d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c1b95b0 con 0x55ce55cc1540 2024-09-19T09:55:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.390+0000 7efe3663d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c1b8140 con 0x55ce55cbbb70 2024-09-19T09:55:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.392+0000 7efe30e4a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55ccd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.392+0000 7efe30e4a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55ccd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45606/0 (socket says 172.21.15.18:45606) 2024-09-19T09:55:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.392+0000 7efe30e4a640 1 -- 172.21.15.18:0/1518028405 learned_addr learned my addr 172.21.15.18:0/1518028405 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.392+0000 7efe31e4c640 1 --2- 172.21.15.18:0/1518028405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 0x55ce55cb75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.392+0000 7efe31e4c640 1 --2- 172.21.15.18:0/1518028405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cc1540 0x55ce55cb7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.395+0000 7efe30e4a640 1 -- 172.21.15.18:0/1518028405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 msgr2=0x55ce55cb75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.395+0000 7efe30e4a640 1 --2- 172.21.15.18:0/1518028405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 0x55ce55cb75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.395+0000 7efe30e4a640 1 -- 172.21.15.18:0/1518028405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cc1540 msgr2=0x55ce55cb7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.395+0000 7efe30e4a640 1 --2- 172.21.15.18:0/1518028405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cc1540 0x55ce55cb7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.395+0000 7efe30e4a640 1 -- 172.21.15.18:0/1518028405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce55cb7000 con 0x55ce55cbc4b0 2024-09-19T09:55:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.396+0000 7efe30e4a640 1 --2- 172.21.15.18:0/1518028405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55ccd390 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7efe2402ade0 tx=0x7efe24000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854866fa93a2482b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.396+0000 7efe16ffd640 1 -- 172.21.15.18:0/1518028405 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24003b80 con 0x55ce55cbc4b0 2024-09-19T09:55:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.396+0000 7efe16ffd640 1 -- 172.21.15.18:0/1518028405 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe24054020 con 0x55ce55cbc4b0 2024-09-19T09:55:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.396+0000 7efe16ffd640 1 -- 172.21.15.18:0/1518028405 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24045ae0 con 0x55ce55cbc4b0 2024-09-19T09:55:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.398+0000 7efe3663d740 1 -- 172.21.15.18:0/1518028405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 msgr2=0x55ce55ccd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.398+0000 7efe3663d740 1 --2- 172.21.15.18:0/1518028405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55ccd390 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7efe2402ade0 tx=0x7efe24000f40 comp rx=0 tx=0).stop 2024-09-19T09:55:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.400+0000 7efe3663d740 1 -- 172.21.15.18:0/1518028405 shutdown_connections 2024-09-19T09:55:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.400+0000 7efe3663d740 1 --2- 172.21.15.18:0/1518028405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cc1540 0x55ce55cb7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.400+0000 7efe3663d740 1 --2- 172.21.15.18:0/1518028405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55ccd390 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.400+0000 7efe3663d740 1 --2- 172.21.15.18:0/1518028405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cbbb70 0x55ce55cb75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.400+0000 7efe3663d740 1 -- 172.21.15.18:0/1518028405 >> 172.21.15.18:0/1518028405 conn(0x55ce55cb71e0 msgr2=0x55ce55cbd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.400+0000 7efe3663d740 1 -- 172.21.15.18:0/1518028405 shutdown_connections 2024-09-19T09:55:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.400+0000 7efe3663d740 1 -- 172.21.15.18:0/1518028405 wait complete. 2024-09-19T09:55:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.401+0000 7efe3663d740 1 -- start start 2024-09-19T09:55:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.401+0000 7efe3663d740 1 Processor -- start 2024-09-19T09:55:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.402+0000 7efe3663d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbbb70 0x55ce55cccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.402+0000 7efe3663d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.403+0000 7efe3663d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cc1540 0x55ce55cca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.403+0000 7efe3663d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c1b8ee0 con 0x55ce55cbc4b0 2024-09-19T09:55:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.403+0000 7efe3663d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c1b8810 con 0x55ce55cbbb70 2024-09-19T09:55:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.403+0000 7efe3663d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c1b5b00 con 0x55ce55cc1540 2024-09-19T09:55:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.403+0000 7efe3663d740 10 client.0 _ll_register_callbacks cb 0x7efe24009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.404+0000 7efe31e4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbbb70 0x55ce55cccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.404+0000 7efe31e4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbbb70 0x55ce55cccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:57874/0 (socket says 172.21.15.18:57874) 2024-09-19T09:55:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.404+0000 7efe31e4c640 1 -- 172.21.15.18:0/3184209035 learned_addr learned my addr 172.21.15.18:0/3184209035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.404+0000 7efe30e4a640 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.405+0000 7efe31e4c640 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cc1540 0x55ce55cca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.406+0000 7efe30e4a640 1 -- 172.21.15.18:0/3184209035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cc1540 msgr2=0x55ce55cca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.406+0000 7efe30e4a640 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cc1540 0x55ce55cca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.406+0000 7efe30e4a640 1 -- 172.21.15.18:0/3184209035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbbb70 msgr2=0x55ce55cccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.406+0000 7efe30e4a640 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbbb70 0x55ce55cccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.406+0000 7efe30e4a640 1 -- 172.21.15.18:0/3184209035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce55cca540 con 0x55ce55cbc4b0 2024-09-19T09:55:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.410+0000 7efe30e4a640 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc9ac0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7efe24009bf0 tx=0x7efe24031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9767bc27594700c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.410+0000 7efe14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:04.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.417+0000 7efe14ff9640 1 -- 172.21.15.18:0/3184209035 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24045440 con 0x55ce55cbc4b0 2024-09-19T09:55:04.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.417+0000 7efe3663d740 1 -- 172.21.15.18:0/3184209035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe24054020 con 0x55ce55cbc4b0 2024-09-19T09:55:04.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.417+0000 7efe14ff9640 1 -- 172.21.15.18:0/3184209035 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efe24045d40 con 0x55ce55cbc4b0 2024-09-19T09:55:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.430+0000 7efe14ff9640 1 -- 172.21.15.18:0/3184209035 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efe240305c0 con 0x55ce55cbc4b0 2024-09-19T09:55:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.430+0000 7efe3663d740 10 client.16290 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.430+0000 7efe3663d740 1 -- 172.21.15.18:0/3184209035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ce55d3b960 con 0x55ce55cbc4b0 2024-09-19T09:55:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.431+0000 7efe14ff9640 1 -- 172.21.15.18:0/3184209035 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe24036030 con 0x55ce55cbc4b0 2024-09-19T09:55:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.431+0000 7efe14ff9640 1 -- 172.21.15.18:0/3184209035 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efe24043070 con 0x55ce55cbc4b0 2024-09-19T09:55:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.431+0000 7efe3663d740 10 client.16290 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.431+0000 7efe3663d740 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.431+0000 7efe3663d740 20 client.16290 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.431+0000 7efe3663d740 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ce55d3c210 0x55ce55d3e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.431+0000 7efe3663d740 4 client.16290 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:55:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.431+0000 7efe3663d740 1 -- 172.21.15.18:0/3184209035 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7efe24054020 con 0x55ce55d3c210 2024-09-19T09:55:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.433+0000 7efe31e4c640 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ce55d3c210 0x55ce55d3e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.436+0000 7efe31e4c640 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ce55d3c210 0x55ce55d3e630 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14f02a10f2f3330b server_cookie=9f2e0c9c93c66b35 in_seq=0 out_seq=0 2024-09-19T09:55:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:04.437+0000 7efe14ff9640 10 client.16290 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:05.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:04 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T09:55:05.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:04 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T09:55:05.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:04 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T09:55:06.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:05 smithi018 ceph-mon[30956]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 932 MiB/s wr, 2.61k op/s 2024-09-19T09:55:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:05 smithi049 ceph-mon[34858]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 932 MiB/s wr, 2.61k op/s 2024-09-19T09:55:06.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:05 smithi162 ceph-mon[35174]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 932 MiB/s wr, 2.61k op/s 2024-09-19T09:55:08.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:08 smithi018 ceph-mon[30956]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 921 MiB/s wr, 2.38k op/s 2024-09-19T09:55:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:08 smithi049 ceph-mon[34858]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 921 MiB/s wr, 2.38k op/s 2024-09-19T09:55:08.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:08 smithi162 ceph-mon[35174]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 921 MiB/s wr, 2.38k op/s 2024-09-19T09:55:10.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:10 smithi018 ceph-mon[30956]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 832 MiB/s wr, 2.09k op/s 2024-09-19T09:55:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:10 smithi049 ceph-mon[34858]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 832 MiB/s wr, 2.09k op/s 2024-09-19T09:55:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:10 smithi162 ceph-mon[35174]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 832 MiB/s wr, 2.09k op/s 2024-09-19T09:55:12.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:12 smithi018 ceph-mon[30956]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 879 MiB/s wr, 2.28k op/s 2024-09-19T09:55:12.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:12 smithi049 ceph-mon[34858]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 879 MiB/s wr, 2.28k op/s 2024-09-19T09:55:12.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:12 smithi162 ceph-mon[35174]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 879 MiB/s wr, 2.28k op/s 2024-09-19T09:55:14.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:14 smithi018 ceph-mon[30956]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 903 MiB/s wr, 2.26k op/s 2024-09-19T09:55:14.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:14 smithi049 ceph-mon[34858]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 903 MiB/s wr, 2.26k op/s 2024-09-19T09:55:14.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:14 smithi162 ceph-mon[35174]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 903 MiB/s wr, 2.26k op/s 2024-09-19T09:55:15.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.661+0000 7efe14ff9640 1 -- 172.21.15.18:0/3184209035 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7efe24054020 con 0x55ce55d3c210 2024-09-19T09:55:15.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.661+0000 7efe14ff9640 10 client.16290 handle_command_reply: tid=0 2024-09-19T09:55:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.661+0000 7efe3663d740 1 client.16290 shutdown 2024-09-19T09:55:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.661+0000 7efe3663d740 1 -- 172.21.15.18:0/3184209035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 msgr2=0x55ce55cc9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.661+0000 7efe3663d740 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc9ac0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7efe24009bf0 tx=0x7efe24031ba0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.662+0000 7efe3663d740 1 -- 172.21.15.18:0/3184209035 shutdown_connections 2024-09-19T09:55:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.662+0000 7efe3663d740 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ce55d3c210 0x55ce55d3e630 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.662+0000 7efe3663d740 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce55cc1540 0x55ce55cca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.662+0000 7efe3663d740 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ce55cbc4b0 0x55ce55cc9ac0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.662+0000 7efe3663d740 1 --2- 172.21.15.18:0/3184209035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce55cbbb70 0x55ce55cccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.662+0000 7efe3663d740 1 -- 172.21.15.18:0/3184209035 >> 172.21.15.18:0/3184209035 conn(0x55ce55cb71e0 msgr2=0x55ce55cb5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.662+0000 7efe14ff9640 0 client.16290 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.662+0000 7efe3663d740 1 -- 172.21.15.18:0/3184209035 shutdown_connections 2024-09-19T09:55:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.662+0000 7efe3663d740 1 -- 172.21.15.18:0/3184209035 wait complete. 2024-09-19T09:55:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.662+0000 7efe3663d740 20 client.16290 trim_cache size 0 max 16384 2024-09-19T09:55:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:55:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:55:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:55:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:55:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.664+0000 7efe338af640 1 -- 172.21.15.18:0/4131392870 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe180a3210 msgr2=0x7efe180a56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.664+0000 7efe338af640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe180a3210 0x7efe180a56d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efe1c098c70 tx=0x7efe1c0d36b0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.664+0000 7efe338af640 1 -- 172.21.15.18:0/4131392870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c072d80 msgr2=0x7efe2c1a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.664+0000 7efe338af640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c072d80 0x7efe2c1a6ae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00e9f0 tx=0x7efe1c00edf0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.664+0000 7efe338af640 1 -- 172.21.15.18:0/4131392870 shutdown_connections 2024-09-19T09:55:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.664+0000 7efe338af640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efe180a3210 0x7efe180a56d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.664+0000 7efe338af640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe2c10de90 0x7efe2c1ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.664+0000 7efe338af640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe2c10b4e0 0x7efe2c1a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.664+0000 7efe338af640 1 --2- 172.21.15.18:0/4131392870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c072d80 0x7efe2c1a6ae0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.664+0000 7efe338af640 1 -- 172.21.15.18:0/4131392870 >> 172.21.15.18:0/4131392870 conn(0x7efe2c06eb50 msgr2=0x7efe2c10f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.665+0000 7efe338af640 1 -- 172.21.15.18:0/4131392870 shutdown_connections 2024-09-19T09:55:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:15.665+0000 7efe338af640 1 -- 172.21.15.18:0/4131392870 wait complete. 2024-09-19T09:55:16.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:16 smithi018 ceph-mon[30956]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 929 MiB/s wr, 2.25k op/s 2024-09-19T09:55:16.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:16 smithi049 ceph-mon[34858]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 929 MiB/s wr, 2.25k op/s 2024-09-19T09:55:16.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:16 smithi162 ceph-mon[35174]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 929 MiB/s wr, 2.25k op/s 2024-09-19T09:55:18.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:18 smithi018 ceph-mon[30956]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 912 MiB/s wr, 2.25k op/s 2024-09-19T09:55:18.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:18 smithi049 ceph-mon[34858]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 912 MiB/s wr, 2.25k op/s 2024-09-19T09:55:18.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:18 smithi162 ceph-mon[35174]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 912 MiB/s wr, 2.25k op/s 2024-09-19T09:55:20.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:20 smithi018 ceph-mon[30956]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 825 MiB/s wr, 2.04k op/s 2024-09-19T09:55:20.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:20 smithi049 ceph-mon[34858]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 825 MiB/s wr, 2.04k op/s 2024-09-19T09:55:20.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:20 smithi162 ceph-mon[35174]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 825 MiB/s wr, 2.04k op/s 2024-09-19T09:55:22.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:21 smithi018 ceph-mon[30956]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 878 MiB/s wr, 2.18k op/s 2024-09-19T09:55:22.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:21 smithi049 ceph-mon[34858]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 878 MiB/s wr, 2.18k op/s 2024-09-19T09:55:22.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:21 smithi162 ceph-mon[35174]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 878 MiB/s wr, 2.18k op/s 2024-09-19T09:55:24.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:23 smithi018 ceph-mon[30956]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 910 MiB/s wr, 2.32k op/s 2024-09-19T09:55:24.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:23 smithi049 ceph-mon[34858]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 910 MiB/s wr, 2.32k op/s 2024-09-19T09:55:24.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:23 smithi162 ceph-mon[35174]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 910 MiB/s wr, 2.32k op/s 2024-09-19T09:55:26.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:25 smithi049 ceph-mon[34858]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 887 MiB/s wr, 2.30k op/s 2024-09-19T09:55:26.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:25 smithi162 ceph-mon[35174]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 887 MiB/s wr, 2.30k op/s 2024-09-19T09:55:26.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:25 smithi018 ceph-mon[30956]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 887 MiB/s wr, 2.30k op/s 2024-09-19T09:55:28.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:27 smithi018 ceph-mon[30956]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 871 MiB/s wr, 2.00k op/s 2024-09-19T09:55:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:27 smithi049 ceph-mon[34858]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 871 MiB/s wr, 2.00k op/s 2024-09-19T09:55:28.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:27 smithi162 ceph-mon[35174]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 871 MiB/s wr, 2.00k op/s 2024-09-19T09:55:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.928+0000 7f58d3978640 1 -- 172.21.15.18:0/1749323440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58cc1025d0 msgr2=0x7f58cc1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.928+0000 7f58d3978640 1 --2- 172.21.15.18:0/1749323440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58cc1025d0 0x7f58cc1049c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009900 tx=0x7f58bc02a420 comp rx=0 tx=0).stop 2024-09-19T09:55:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.928+0000 7f58d3978640 1 -- 172.21.15.18:0/1749323440 shutdown_connections 2024-09-19T09:55:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.928+0000 7f58d3978640 1 --2- 172.21.15.18:0/1749323440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58cc107830 0x7f58cc109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.928+0000 7f58d3978640 1 --2- 172.21.15.18:0/1749323440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58cc104f00 0x7f58cc1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.928+0000 7f58d3978640 1 --2- 172.21.15.18:0/1749323440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58cc1025d0 0x7f58cc1049c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.928+0000 7f58d3978640 1 -- 172.21.15.18:0/1749323440 >> 172.21.15.18:0/1749323440 conn(0x7f58cc0fc1b0 msgr2=0x7f58cc0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.928+0000 7f58d3978640 1 -- 172.21.15.18:0/1749323440 shutdown_connections 2024-09-19T09:55:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.929+0000 7f58d3978640 1 -- 172.21.15.18:0/1749323440 wait complete. 2024-09-19T09:55:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.930+0000 7f58d3978640 1 Processor -- start 2024-09-19T09:55:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.930+0000 7f58d3978640 1 -- start start 2024-09-19T09:55:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.930+0000 7f58d3978640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58cc1025d0 0x7f58cc06fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.930+0000 7f58d3978640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58cc104f00 0x7f58cc070360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.930+0000 7f58d3978640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58cc107830 0x7f58cc0733b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.930+0000 7f58d3978640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc100e10 con 0x7f58cc104f00 2024-09-19T09:55:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.930+0000 7f58d3978640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc100c90 con 0x7f58cc107830 2024-09-19T09:55:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.930+0000 7f58d3978640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc100f90 con 0x7f58cc1025d0 2024-09-19T09:55:28.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.931+0000 7f58d1714640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58cc1025d0 0x7f58cc06fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:28.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.931+0000 7f58d1714640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58cc1025d0 0x7f58cc06fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47136/0 (socket says 172.21.15.18:47136) 2024-09-19T09:55:28.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.931+0000 7f58d0f13640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58cc104f00 0x7f58cc070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:28.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.931+0000 7f58d1f15640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58cc107830 0x7f58cc0733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:28.934 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.931+0000 7f58d0f13640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58cc104f00 0x7f58cc070360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49306/0 (socket says 172.21.15.18:49306) 2024-09-19T09:55:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.931+0000 7f58d0f13640 1 -- 172.21.15.18:0/3659475307 learned_addr learned my addr 172.21.15.18:0/3659475307 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.932+0000 7f58d0f13640 1 -- 172.21.15.18:0/3659475307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58cc1025d0 msgr2=0x7f58cc06fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.932+0000 7f58d0f13640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58cc1025d0 0x7f58cc06fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.932+0000 7f58d0f13640 1 -- 172.21.15.18:0/3659475307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58cc107830 msgr2=0x7f58cc0733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.932+0000 7f58d0f13640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58cc107830 0x7f58cc0733b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.932+0000 7f58d0f13640 1 -- 172.21.15.18:0/3659475307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc073a20 con 0x7f58cc104f00 2024-09-19T09:55:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.932+0000 7f58d1714640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58cc1025d0 0x7f58cc06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:55:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.932+0000 7f58d0f13640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58cc104f00 0x7f58cc070360 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f58c800b450 tx=0x7f58c800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.933+0000 7f58c27fc640 1 -- 172.21.15.18:0/3659475307 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8015020 con 0x7f58cc104f00 2024-09-19T09:55:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.933+0000 7f58c27fc640 1 -- 172.21.15.18:0/3659475307 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c8011d70 con 0x7f58cc104f00 2024-09-19T09:55:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.933+0000 7f58d3978640 1 -- 172.21.15.18:0/3659475307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58cc073d10 con 0x7f58cc104f00 2024-09-19T09:55:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.933+0000 7f58c27fc640 1 -- 172.21.15.18:0/3659475307 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c800f340 con 0x7f58cc104f00 2024-09-19T09:55:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.933+0000 7f58d3978640 1 -- 172.21.15.18:0/3659475307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58cc1ab000 con 0x7f58cc104f00 2024-09-19T09:55:28.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.937+0000 7f58d67ee740 1 Processor -- start 2024-09-19T09:55:28.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.937+0000 7f58d67ee740 1 -- start start 2024-09-19T09:55:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.938+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f231b0 0x5587d9f235b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.938+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f23af0 0x5587d9f285b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.938+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f2b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.938+0000 7f58d67ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5587d9e7e2f0 con 0x5587d9f28b80 2024-09-19T09:55:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.938+0000 7f58d67ee740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5587d9e26270 con 0x5587d9f23af0 2024-09-19T09:55:28.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.938+0000 7f58d67ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5587d9e7a2b0 con 0x5587d9f231b0 2024-09-19T09:55:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.939+0000 7f58c27fc640 1 -- 172.21.15.18:0/3659475307 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f58c8018020 con 0x7f58cc104f00 2024-09-19T09:55:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.939+0000 7f58d0f13640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f2b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:28.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.939+0000 7f58d1714640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f23af0 0x5587d9f285b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.939+0000 7f58d0f13640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f2b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49308/0 (socket says 172.21.15.18:49308) 2024-09-19T09:55:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.939+0000 7f58d0f13640 1 -- 172.21.15.18:0/1741483820 learned_addr learned my addr 172.21.15.18:0/1741483820 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:28.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.940+0000 7f58d1f15640 1 --2- 172.21.15.18:0/1741483820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f231b0 0x5587d9f235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.940+0000 7f58d0f13640 1 -- 172.21.15.18:0/1741483820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f231b0 msgr2=0x5587d9f235b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.940+0000 7f58d0f13640 1 --2- 172.21.15.18:0/1741483820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f231b0 0x5587d9f235b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.940+0000 7f58d0f13640 1 -- 172.21.15.18:0/1741483820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f23af0 msgr2=0x5587d9f285b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.940+0000 7f58d0f13640 1 --2- 172.21.15.18:0/1741483820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f23af0 0x5587d9f285b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.940+0000 7f58d0f13640 1 -- 172.21.15.18:0/1741483820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587d9e25340 con 0x5587d9f28b80 2024-09-19T09:55:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.940+0000 7f58c27fc640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f58b80a3370 0x7f58b80a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.941+0000 7f58d0f13640 1 --2- 172.21.15.18:0/1741483820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f2b040 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f58c80d7480 tx=0x7f58c80d7940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d6d7184e2d101a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.941+0000 7f58c27fc640 1 -- 172.21.15.18:0/3659475307 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f58c80cf130 con 0x7f58cc104f00 2024-09-19T09:55:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.941+0000 7f58d1f15640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f58b80a3370 0x7f58b80a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.941+0000 7f58b77fe640 1 -- 172.21.15.18:0/1741483820 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8097a20 con 0x5587d9f28b80 2024-09-19T09:55:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.941+0000 7f58b77fe640 1 -- 172.21.15.18:0/1741483820 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c809be80 con 0x5587d9f28b80 2024-09-19T09:55:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.942+0000 7f58d1f15640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f58b80a3370 0x7f58b80a5830 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f58cc06b1a0 tx=0x7f58c400e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:28.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.942+0000 7f58b77fe640 1 -- 172.21.15.18:0/1741483820 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8009280 con 0x5587d9f28b80 2024-09-19T09:55:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.943+0000 7f58d67ee740 1 -- 172.21.15.18:0/1741483820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 msgr2=0x5587d9f2b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.943+0000 7f58d67ee740 1 --2- 172.21.15.18:0/1741483820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f2b040 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f58c80d7480 tx=0x7f58c80d7940 comp rx=0 tx=0).stop 2024-09-19T09:55:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.943+0000 7f58d67ee740 1 -- 172.21.15.18:0/1741483820 shutdown_connections 2024-09-19T09:55:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.943+0000 7f58d67ee740 1 --2- 172.21.15.18:0/1741483820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f2b040 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.943+0000 7f58d67ee740 1 --2- 172.21.15.18:0/1741483820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f23af0 0x5587d9f285b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.943+0000 7f58d67ee740 1 --2- 172.21.15.18:0/1741483820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f231b0 0x5587d9f235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.943+0000 7f58d67ee740 1 -- 172.21.15.18:0/1741483820 >> 172.21.15.18:0/1741483820 conn(0x5587d9f16010 msgr2=0x5587d9f16410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.943+0000 7f58d67ee740 1 -- 172.21.15.18:0/1741483820 shutdown_connections 2024-09-19T09:55:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.944+0000 7f58d67ee740 1 -- 172.21.15.18:0/1741483820 wait complete. 2024-09-19T09:55:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.944+0000 7f58d67ee740 1 -- start start 2024-09-19T09:55:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.944+0000 7f58d67ee740 1 Processor -- start 2024-09-19T09:55:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.945+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.945+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f23af0 0x5587d9f2d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.945+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f28b80 0x5587d9f34980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.945+0000 7f58d67ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5587d9f2bb50 con 0x5587d9f231b0 2024-09-19T09:55:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.945+0000 7f58d67ee740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5587d9e07290 con 0x5587d9f28b80 2024-09-19T09:55:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.945+0000 7f58d67ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5587d9f2bcd0 con 0x5587d9f23af0 2024-09-19T09:55:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.946+0000 7f58d67ee740 10 client.0 _ll_register_callbacks cb 0x5587d9e38140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.946+0000 7f58d1714640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.946+0000 7f58d1714640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49322/0 (socket says 172.21.15.18:49322) 2024-09-19T09:55:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.946+0000 7f58d1714640 1 -- 172.21.15.18:0/805103050 learned_addr learned my addr 172.21.15.18:0/805103050 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.947+0000 7f58d0f13640 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f23af0 0x5587d9f2d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.947+0000 7f58d1714640 1 -- 172.21.15.18:0/805103050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f23af0 msgr2=0x5587d9f2d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.947+0000 7f58d1714640 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f23af0 0x5587d9f2d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.947+0000 7f58d1714640 1 -- 172.21.15.18:0/805103050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f28b80 msgr2=0x5587d9f34980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.947+0000 7f58d1714640 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f28b80 0x5587d9f34980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.947+0000 7f58d1714640 1 -- 172.21.15.18:0/805103050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587d9b91210 con 0x5587d9f231b0 2024-09-19T09:55:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.947+0000 7f58d1714640 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2d470 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f58bc005ec0 tx=0x7f58bc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ac4ed11e277402 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.947+0000 7f58b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.948+0000 7f58b4ff9640 1 -- 172.21.15.18:0/805103050 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc035070 con 0x5587d9f231b0 2024-09-19T09:55:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.948+0000 7f58b4ff9640 1 -- 172.21.15.18:0/805103050 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f58bc005220 con 0x5587d9f231b0 2024-09-19T09:55:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.948+0000 7f58d67ee740 1 -- 172.21.15.18:0/805103050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58c809be80 con 0x5587d9f231b0 2024-09-19T09:55:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.948+0000 7f58b4ff9640 1 -- 172.21.15.18:0/805103050 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f58bc005420 con 0x5587d9f231b0 2024-09-19T09:55:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.948+0000 7f58d67ee740 10 client.16302 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.948+0000 7f58d67ee740 1 -- 172.21.15.18:0/805103050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5587d9c5d620 con 0x5587d9f231b0 2024-09-19T09:55:28.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.948+0000 7f58b4ff9640 1 -- 172.21.15.18:0/805103050 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c809be80 con 0x5587d9f231b0 2024-09-19T09:55:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.949+0000 7f58b4ff9640 1 -- 172.21.15.18:0/805103050 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f58bc0039f0 con 0x5587d9f231b0 2024-09-19T09:55:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.949+0000 7f58d67ee740 10 client.16302 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.949+0000 7f58d67ee740 10 client.16302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.949+0000 7f58d67ee740 20 client.16302 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.949+0000 7f58d67ee740 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5587d9f394d0 0x5587d9f3b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.949+0000 7f58d67ee740 4 client.16302 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.949+0000 7f58d67ee740 1 -- 172.21.15.18:0/805103050 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587d9e8ba20 con 0x5587d9f394d0 2024-09-19T09:55:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.951+0000 7f58d0f13640 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5587d9f394d0 0x5587d9f3b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.954+0000 7f58d0f13640 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5587d9f394d0 0x5587d9f3b990 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa8c51b63a65e2a server_cookie=a1efef8816f0889c in_seq=0 out_seq=0 2024-09-19T09:55:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.955+0000 7f58b4ff9640 10 client.16302 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.963+0000 7f58b4ff9640 1 -- 172.21.15.18:0/805103050 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587d9e8ba20 con 0x5587d9f394d0 2024-09-19T09:55:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.964+0000 7f58b4ff9640 10 client.16302 handle_command_reply: tid=0 2024-09-19T09:55:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.964+0000 7f58d67ee740 1 client.16302 shutdown 2024-09-19T09:55:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 1 -- 172.21.15.18:0/805103050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 msgr2=0x5587d9f2d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2d470 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f58bc005ec0 tx=0x7f58bc0043b0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 1 -- 172.21.15.18:0/805103050 shutdown_connections 2024-09-19T09:55:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5587d9f394d0 0x5587d9f3b990 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f28b80 0x5587d9f34980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f23af0 0x5587d9f2d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 1 --2- 172.21.15.18:0/805103050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2d470 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 1 -- 172.21.15.18:0/805103050 >> 172.21.15.18:0/805103050 conn(0x5587d9f16010 msgr2=0x5587d9f17820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58b4ff9640 0 client.16302 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 1 -- 172.21.15.18:0/805103050 shutdown_connections 2024-09-19T09:55:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 1 -- 172.21.15.18:0/805103050 wait complete. 2024-09-19T09:55:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:28.965+0000 7f58d67ee740 20 client.16302 trim_cache size 0 max 16384 2024-09-19T09:55:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.005+0000 7f58d67ee740 1 Processor -- start 2024-09-19T09:55:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.005+0000 7f58d67ee740 1 -- start start 2024-09-19T09:55:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.006+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.006+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f23af0 0x5587d9f34940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.006+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f28b80 0x5587d9f150b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.006+0000 7f58d67ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1af630 con 0x5587d9f231b0 2024-09-19T09:55:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.006+0000 7f58d67ee740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1b1170 con 0x5587d9f28b80 2024-09-19T09:55:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.006+0000 7f58d67ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1afd00 con 0x5587d9f23af0 2024-09-19T09:55:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.007+0000 7f58d0f13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f23af0 0x5587d9f34940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.007+0000 7f58d1714640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.007+0000 7f58d1714640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49336/0 (socket says 172.21.15.18:49336) 2024-09-19T09:55:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.007+0000 7f58d1714640 1 -- 172.21.15.18:0/691211053 learned_addr learned my addr 172.21.15.18:0/691211053 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.007+0000 7f58d1714640 1 -- 172.21.15.18:0/691211053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f23af0 msgr2=0x5587d9f34940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.007+0000 7f58d1714640 1 --2- 172.21.15.18:0/691211053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f23af0 0x5587d9f34940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.007+0000 7f58d1714640 1 -- 172.21.15.18:0/691211053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f28b80 msgr2=0x5587d9f150b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.007+0000 7f58d1714640 1 --2- 172.21.15.18:0/691211053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f28b80 0x5587d9f150b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.008+0000 7f58d1714640 1 -- 172.21.15.18:0/691211053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587d9f15e30 con 0x5587d9f231b0 2024-09-19T09:55:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.009+0000 7f58d1714640 1 --2- 172.21.15.18:0/691211053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2da40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f58bc003e10 tx=0x7f58bc005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27220e1a3d100cf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.009+0000 7f58b6ffd640 1 -- 172.21.15.18:0/691211053 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc035070 con 0x5587d9f231b0 2024-09-19T09:55:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.010+0000 7f58b6ffd640 1 -- 172.21.15.18:0/691211053 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58bc003ad0 con 0x5587d9f231b0 2024-09-19T09:55:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.010+0000 7f58b6ffd640 1 -- 172.21.15.18:0/691211053 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc04f430 con 0x5587d9f231b0 2024-09-19T09:55:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.011+0000 7f58d67ee740 1 -- 172.21.15.18:0/691211053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 msgr2=0x5587d9f2da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.011+0000 7f58d67ee740 1 --2- 172.21.15.18:0/691211053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2da40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f58bc003e10 tx=0x7f58bc005d50 comp rx=0 tx=0).stop 2024-09-19T09:55:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.011+0000 7f58d67ee740 1 -- 172.21.15.18:0/691211053 shutdown_connections 2024-09-19T09:55:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.011+0000 7f58d67ee740 1 --2- 172.21.15.18:0/691211053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f28b80 0x5587d9f150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.011+0000 7f58d67ee740 1 --2- 172.21.15.18:0/691211053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f23af0 0x5587d9f34940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:29.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.011+0000 7f58d67ee740 1 --2- 172.21.15.18:0/691211053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f231b0 0x5587d9f2da40 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:29.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.011+0000 7f58d67ee740 1 -- 172.21.15.18:0/691211053 >> 172.21.15.18:0/691211053 conn(0x5587d9f16010 msgr2=0x5587d9f149a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:29.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.014+0000 7f58d67ee740 1 -- 172.21.15.18:0/691211053 shutdown_connections 2024-09-19T09:55:29.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.014+0000 7f58d67ee740 1 -- 172.21.15.18:0/691211053 wait complete. 2024-09-19T09:55:29.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.014+0000 7f58d67ee740 1 -- start start 2024-09-19T09:55:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.015+0000 7f58d67ee740 1 Processor -- start 2024-09-19T09:55:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.020+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f231b0 0x5587d9f2ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.020+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f23af0 0x5587d9f304e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.020+0000 7f58d67ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f33500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.020+0000 7f58d67ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1b0aa0 con 0x5587d9f28b80 2024-09-19T09:55:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.020+0000 7f58d67ee740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1b03d0 con 0x5587d9f23af0 2024-09-19T09:55:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.020+0000 7f58d67ee740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc1ad630 con 0x5587d9f231b0 2024-09-19T09:55:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.020+0000 7f58d67ee740 10 client.0 _ll_register_callbacks cb 0x7f58bc005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.022+0000 7f58d1f15640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f33500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.022+0000 7f58d1f15640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f33500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49340/0 (socket says 172.21.15.18:49340) 2024-09-19T09:55:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.022+0000 7f58d1f15640 1 -- 172.21.15.18:0/3401536793 learned_addr learned my addr 172.21.15.18:0/3401536793 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.023+0000 7f58d1714640 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f231b0 0x5587d9f2ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.023+0000 7f58d1f15640 1 -- 172.21.15.18:0/3401536793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f231b0 msgr2=0x5587d9f2ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.023+0000 7f58d1f15640 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f231b0 0x5587d9f2ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.023+0000 7f58d1f15640 1 -- 172.21.15.18:0/3401536793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f23af0 msgr2=0x5587d9f304e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.023+0000 7f58d1f15640 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f23af0 0x5587d9f304e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.023+0000 7f58d1f15640 1 -- 172.21.15.18:0/3401536793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587d9f33b10 con 0x5587d9f28b80 2024-09-19T09:55:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.026+0000 7f58d1f15640 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f33500 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009fd0 tx=0x7f58c40077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a8095c555f1c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.026+0000 7f58b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.029+0000 7f58b4ff9640 1 -- 172.21.15.18:0/3401536793 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c4007d20 con 0x5587d9f28b80 2024-09-19T09:55:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.029+0000 7f58d67ee740 1 -- 172.21.15.18:0/3401536793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58bc003ad0 con 0x5587d9f28b80 2024-09-19T09:55:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.030+0000 7f58b4ff9640 1 -- 172.21.15.18:0/3401536793 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f58c4018030 con 0x5587d9f28b80 2024-09-19T09:55:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.031+0000 7f58b4ff9640 1 -- 172.21.15.18:0/3401536793 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f58c4018270 con 0x5587d9f28b80 2024-09-19T09:55:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.031+0000 7f58d67ee740 10 client.16308 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.031+0000 7f58d67ee740 1 -- 172.21.15.18:0/3401536793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5587d9f1e540 con 0x5587d9f28b80 2024-09-19T09:55:29.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.034+0000 7f58b4ff9640 1 -- 172.21.15.18:0/3401536793 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58bc003ad0 con 0x5587d9f28b80 2024-09-19T09:55:29.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.036+0000 7f58b4ff9640 1 -- 172.21.15.18:0/3401536793 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f58c4016070 con 0x5587d9f28b80 2024-09-19T09:55:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.037+0000 7f58d67ee740 10 client.16308 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.037+0000 7f58d67ee740 10 client.16308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.037+0000 7f58d67ee740 20 client.16308 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.037+0000 7f58d67ee740 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5587d9f1eef0 0x5587d9f21310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.037+0000 7f58d67ee740 4 client.16308 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:55:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.037+0000 7f58d67ee740 1 -- 172.21.15.18:0/3401536793 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5587d9e85d70 con 0x5587d9f1eef0 2024-09-19T09:55:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.039+0000 7f58d1714640 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5587d9f1eef0 0x5587d9f21310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.053+0000 7f58b4ff9640 10 client.16308 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:29.053+0000 7f58d1714640 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5587d9f1eef0 0x5587d9f21310 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6036cafcd9b78d6c server_cookie=b0c471061ea1803e in_seq=0 out_seq=0 2024-09-19T09:55:30.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:30 smithi018 ceph-mon[30956]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 781 MiB/s wr, 1.65k op/s 2024-09-19T09:55:30.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:30 smithi049 ceph-mon[34858]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 781 MiB/s wr, 1.65k op/s 2024-09-19T09:55:30.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:30 smithi162 ceph-mon[35174]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 781 MiB/s wr, 1.65k op/s 2024-09-19T09:55:32.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:55:32.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:32 smithi018 ceph-mon[30956]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 817 MiB/s wr, 1.71k op/s 2024-09-19T09:55:32.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:32 smithi049 ceph-mon[34858]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 817 MiB/s wr, 1.71k op/s 2024-09-19T09:55:32.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:32 smithi162 ceph-mon[35174]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 817 MiB/s wr, 1.71k op/s 2024-09-19T09:55:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:34.152 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:34 smithi018 ceph-mon[30956]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 877 MiB/s wr, 1.72k op/s 2024-09-19T09:55:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.163+0000 7f12f0aeb640 1 -- 172.21.15.18:0/3540159553 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc035020 con 0x7f12ec109830 2024-09-19T09:55:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.163+0000 7f12f3d51640 1 -- 172.21.15.18:0/3540159553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12ec109830 msgr2=0x7f12ec109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.163+0000 7f12f3d51640 1 --2- 172.21.15.18:0/3540159553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12ec109830 0x7f12ec109c90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009900 tx=0x7f12dc02a440 comp rx=0 tx=0).stop 2024-09-19T09:55:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.164+0000 7f12f3d51640 1 -- 172.21.15.18:0/3540159553 shutdown_connections 2024-09-19T09:55:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.164+0000 7f12f3d51640 1 --2- 172.21.15.18:0/3540159553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12ec11b140 0x7f12ec11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.164+0000 7f12f3d51640 1 --2- 172.21.15.18:0/3540159553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12ec109830 0x7f12ec109c90 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.164+0000 7f12f3d51640 1 --2- 172.21.15.18:0/3540159553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec109450 0x7f12ec110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.164+0000 7f12f3d51640 1 -- 172.21.15.18:0/3540159553 >> 172.21.15.18:0/3540159553 conn(0x7f12ec06e140 msgr2=0x7f12ec06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.165+0000 7f12f3d51640 1 -- 172.21.15.18:0/3540159553 shutdown_connections 2024-09-19T09:55:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.165+0000 7f12f3d51640 1 -- 172.21.15.18:0/3540159553 wait complete. 2024-09-19T09:55:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.166+0000 7f12f3d51640 1 Processor -- start 2024-09-19T09:55:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.166+0000 7f12f3d51640 1 -- start start 2024-09-19T09:55:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.167+0000 7f12f3d51640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12ec109450 0x7f12ec118630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.167+0000 7f12f3d51640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12ec109830 0x7f12ec118b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.167+0000 7f12f3d51640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec11b140 0x7f12ec1118a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.167+0000 7f12f3d51640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec120ed0 con 0x7f12ec109830 2024-09-19T09:55:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.167+0000 7f12f3d51640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec120d50 con 0x7f12ec109450 2024-09-19T09:55:34.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.167+0000 7f12f3d51640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec121050 con 0x7f12ec11b140 2024-09-19T09:55:34.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.167+0000 7f12f12ec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12ec109830 0x7f12ec118b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.167+0000 7f12f12ec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12ec109830 0x7f12ec118b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49356/0 (socket says 172.21.15.18:49356) 2024-09-19T09:55:34.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.167+0000 7f12f12ec640 1 -- 172.21.15.18:0/3005561945 learned_addr learned my addr 172.21.15.18:0/3005561945 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:34.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.167+0000 7f12f22ee640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec11b140 0x7f12ec1118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.168+0000 7f12f12ec640 1 -- 172.21.15.18:0/3005561945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec11b140 msgr2=0x7f12ec1118a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.168+0000 7f12f12ec640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec11b140 0x7f12ec1118a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.168+0000 7f12f12ec640 1 -- 172.21.15.18:0/3005561945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12ec109450 msgr2=0x7f12ec118630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.168+0000 7f12f12ec640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12ec109450 0x7f12ec118630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.168+0000 7f12f12ec640 1 -- 172.21.15.18:0/3005561945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ec112160 con 0x7f12ec109830 2024-09-19T09:55:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.168+0000 7f12f22ee640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec11b140 0x7f12ec1118a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:55:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.169+0000 7f12f12ec640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12ec109830 0x7f12ec118b70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f12dc02a960 tx=0x7f12dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:34.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.169+0000 7f12e2ffd640 1 -- 172.21.15.18:0/3005561945 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc040070 con 0x7f12ec109830 2024-09-19T09:55:34.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.169+0000 7f12f3d51640 1 -- 172.21.15.18:0/3005561945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ec1123f0 con 0x7f12ec109830 2024-09-19T09:55:34.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.170+0000 7f12f3d51640 1 -- 172.21.15.18:0/3005561945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ec116380 con 0x7f12ec109830 2024-09-19T09:55:34.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.170+0000 7f12e2ffd640 1 -- 172.21.15.18:0/3005561945 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12dc0047a0 con 0x7f12ec109830 2024-09-19T09:55:34.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.171+0000 7f12e2ffd640 1 -- 172.21.15.18:0/3005561945 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc035020 con 0x7f12ec109830 2024-09-19T09:55:34.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.174+0000 7f12f612a740 1 Processor -- start 2024-09-19T09:55:34.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.174+0000 7f12f612a740 1 -- start start 2024-09-19T09:55:34.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.175+0000 7f12f612a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.175+0000 7f12f612a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7fff140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.175+0000 7f12f612a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 0x55e1f8001a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.175+0000 7f12f612a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e1f7f5a2e0 con 0x55e1f7ff4dc0 2024-09-19T09:55:34.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.175+0000 7f12f612a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e1f7f01ce0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.175+0000 7f12f612a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e1f7f562a0 con 0x55e1f7fff680 2024-09-19T09:55:34.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.176+0000 7f12e2ffd640 1 -- 172.21.15.18:0/3005561945 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f12dc043070 con 0x7f12ec109830 2024-09-19T09:55:34.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.177+0000 7f12f12ec640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 0x55e1f8001a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.177+0000 7f12f22ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.177+0000 7f12f22ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:36130/0 (socket says 172.21.15.18:36130) 2024-09-19T09:55:34.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.177+0000 7f12f22ee640 1 -- 172.21.15.18:0/3060388213 learned_addr learned my addr 172.21.15.18:0/3060388213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:34.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.178+0000 7f12f1aed640 1 --2- 172.21.15.18:0/3060388213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7fff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.178+0000 7f12e2ffd640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f12d80a3440 0x7f12d80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.179+0000 7f12f22ee640 1 -- 172.21.15.18:0/3060388213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 msgr2=0x55e1f8001a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:34.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.179+0000 7f12f22ee640 1 --2- 172.21.15.18:0/3060388213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 0x55e1f8001a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.179+0000 7f12f22ee640 1 -- 172.21.15.18:0/3060388213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff4dc0 msgr2=0x55e1f7fff140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:34.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.179+0000 7f12e2ffd640 1 -- 172.21.15.18:0/3005561945 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f12dc0035f0 con 0x7f12ec109830 2024-09-19T09:55:34.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.179+0000 7f12f22ee640 1 --2- 172.21.15.18:0/3060388213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7fff140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.179+0000 7f12f22ee640 1 -- 172.21.15.18:0/3060388213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1f7ee6440 con 0x55e1f7ff44a0 2024-09-19T09:55:34.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.179+0000 7f12f22ee640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f12d80a3440 0x7f12d80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.180+0000 7f12f22ee640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f12d80a3440 0x7f12d80a5900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f12e4017000 tx=0x7f12e4019000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:34.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.180+0000 7f12f22ee640 1 --2- 172.21.15.18:0/3060388213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff4880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12e400b970 tx=0x7f12e400be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ac32af33b6678ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:34.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.184+0000 7f12d7fff640 1 -- 172.21.15.18:0/3060388213 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4025070 con 0x55e1f7ff44a0 2024-09-19T09:55:34.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.184+0000 7f12d7fff640 1 -- 172.21.15.18:0/3060388213 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e4020af0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.185+0000 7f12d7fff640 1 -- 172.21.15.18:0/3060388213 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e40178e0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.186+0000 7f12f612a740 1 -- 172.21.15.18:0/3060388213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff44a0 msgr2=0x55e1f7ff4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.186+0000 7f12f612a740 1 --2- 172.21.15.18:0/3060388213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff4880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12e400b970 tx=0x7f12e400be30 comp rx=0 tx=0).stop 2024-09-19T09:55:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.186+0000 7f12f612a740 1 -- 172.21.15.18:0/3060388213 shutdown_connections 2024-09-19T09:55:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.186+0000 7f12f612a740 1 --2- 172.21.15.18:0/3060388213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 0x55e1f8001a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.186+0000 7f12f612a740 1 --2- 172.21.15.18:0/3060388213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7fff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.186+0000 7f12f612a740 1 --2- 172.21.15.18:0/3060388213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff4880 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.186+0000 7f12f612a740 1 -- 172.21.15.18:0/3060388213 >> 172.21.15.18:0/3060388213 conn(0x55e1f7ff0a30 msgr2=0x55e1f7ff0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:34.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.186+0000 7f12f612a740 1 -- 172.21.15.18:0/3060388213 shutdown_connections 2024-09-19T09:55:34.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.186+0000 7f12f612a740 1 -- 172.21.15.18:0/3060388213 wait complete. 2024-09-19T09:55:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.187+0000 7f12f612a740 1 -- start start 2024-09-19T09:55:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.187+0000 7f12f612a740 1 Processor -- start 2024-09-19T09:55:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.188+0000 7f12f612a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ffee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.188+0000 7f12f612a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7ffc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.188+0000 7f12f612a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7fff680 0x55e1f7ffc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.188+0000 7f12f612a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e1f80022f0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.188+0000 7f12f612a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e1f7f15050 con 0x55e1f7fff680 2024-09-19T09:55:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.188+0000 7f12f612a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e1f8002470 con 0x55e1f7ff4dc0 2024-09-19T09:55:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.188+0000 7f12f612a740 10 client.0 _ll_register_callbacks cb 0x55e1f7f55160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.188+0000 7f12f1aed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ffee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.188+0000 7f12f1aed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ffee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49364/0 (socket says 172.21.15.18:49364) 2024-09-19T09:55:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.188+0000 7f12f1aed640 1 -- 172.21.15.18:0/316265224 learned_addr learned my addr 172.21.15.18:0/316265224 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.190+0000 7f12f12ec640 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7ffc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.191+0000 7f12f22ee640 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7fff680 0x55e1f7ffc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.191+0000 7f12f1aed640 1 -- 172.21.15.18:0/316265224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff4dc0 msgr2=0x55e1f7ffc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.191+0000 7f12f1aed640 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7ffc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.191+0000 7f12f1aed640 1 -- 172.21.15.18:0/316265224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7fff680 msgr2=0x55e1f7ffc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.191+0000 7f12f1aed640 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7fff680 0x55e1f7ffc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.191+0000 7f12f1aed640 1 -- 172.21.15.18:0/316265224 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1f7ccb3c0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.192+0000 7f12f1aed640 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ffee80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f12e800e250 tx=0x7f12e800e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f4eec8bcff3abe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.192+0000 7f12d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.193+0000 7f12d57fa640 1 -- 172.21.15.18:0/316265224 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8017070 con 0x55e1f7ff44a0 2024-09-19T09:55:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.193+0000 7f12f612a740 1 -- 172.21.15.18:0/316265224 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12e4020af0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.194+0000 7f12d57fa640 1 -- 172.21.15.18:0/316265224 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f12e8013680 con 0x55e1f7ff44a0 2024-09-19T09:55:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.194+0000 7f12d57fa640 1 -- 172.21.15.18:0/316265224 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f12e8021050 con 0x55e1f7ff44a0 2024-09-19T09:55:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.194+0000 7f12f612a740 10 client.16320 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.194+0000 7f12f612a740 1 -- 172.21.15.18:0/316265224 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1f800dc80 con 0x55e1f7ff44a0 2024-09-19T09:55:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.195+0000 7f12d57fa640 1 -- 172.21.15.18:0/316265224 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e4020af0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.196+0000 7f12d57fa640 1 -- 172.21.15.18:0/316265224 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f12e8024020 con 0x55e1f7ff44a0 2024-09-19T09:55:34.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.196+0000 7f12f612a740 10 client.16320 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.196+0000 7f12f612a740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.196+0000 7f12f612a740 20 client.16320 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.196+0000 7f12f612a740 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e1f800f140 0x55e1f80115a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.196+0000 7f12f612a740 4 client.16320 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.196+0000 7f12f612a740 1 -- 172.21.15.18:0/316265224 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1f7f67850 con 0x55e1f800f140 2024-09-19T09:55:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.197+0000 7f12f12ec640 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e1f800f140 0x55e1f80115a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.204+0000 7f12f12ec640 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e1f800f140 0x55e1f80115a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f7892f58c10281c server_cookie=44d705fa6e38371f in_seq=0 out_seq=0 2024-09-19T09:55:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.204+0000 7f12d57fa640 10 client.16320 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.208+0000 7f12d57fa640 1 -- 172.21.15.18:0/316265224 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1f7f67850 con 0x55e1f800f140 2024-09-19T09:55:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.208+0000 7f12d57fa640 10 client.16320 handle_command_reply: tid=0 2024-09-19T09:55:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.208+0000 7f12f612a740 1 client.16320 shutdown 2024-09-19T09:55:34.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.210+0000 7f12f612a740 1 -- 172.21.15.18:0/316265224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 msgr2=0x55e1f7ffee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:34.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.210+0000 7f12f612a740 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ffee80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f12e800e250 tx=0x7f12e800e710 comp rx=0 tx=0).stop 2024-09-19T09:55:34.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.210+0000 7f12f612a740 1 -- 172.21.15.18:0/316265224 shutdown_connections 2024-09-19T09:55:34.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.210+0000 7f12f612a740 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e1f800f140 0x55e1f80115a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.210+0000 7f12f612a740 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7fff680 0x55e1f7ffc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.211+0000 7f12f612a740 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7ffc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.211+0000 7f12d57fa640 0 client.16320 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:34.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.211+0000 7f12f612a740 1 --2- 172.21.15.18:0/316265224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ffee80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.211+0000 7f12f612a740 1 -- 172.21.15.18:0/316265224 >> 172.21.15.18:0/316265224 conn(0x55e1f7ff0a30 msgr2=0x55e1f7ff6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:34.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.211+0000 7f12f612a740 1 -- 172.21.15.18:0/316265224 shutdown_connections 2024-09-19T09:55:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.211+0000 7f12f612a740 1 -- 172.21.15.18:0/316265224 wait complete. 2024-09-19T09:55:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.211+0000 7f12f612a740 20 client.16320 trim_cache size 0 max 16384 2024-09-19T09:55:34.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.242+0000 7f12f612a740 1 Processor -- start 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.242+0000 7f12f612a740 1 -- start start 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.243+0000 7f12f612a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f8016e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.243+0000 7f12f612a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff4dc0 0x55e1f80173b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.243+0000 7f12f612a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 0x55e1f7ff93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.243+0000 7f12f612a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f12d000e3f0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.243+0000 7f12f612a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f12d000ff30 con 0x55e1f7ff4dc0 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.243+0000 7f12f612a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12d000eac0 con 0x55e1f7fff680 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.243+0000 7f12f1aed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f8016e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.243+0000 7f12f1aed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f8016e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49380/0 (socket says 172.21.15.18:49380) 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.243+0000 7f12f1aed640 1 -- 172.21.15.18:0/1935161607 learned_addr learned my addr 172.21.15.18:0/1935161607 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:34.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.243+0000 7f12f22ee640 1 --2- 172.21.15.18:0/1935161607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 0x55e1f7ff93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.244+0000 7f12f1aed640 1 -- 172.21.15.18:0/1935161607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 msgr2=0x55e1f7ff93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:34.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.244+0000 7f12f1aed640 1 --2- 172.21.15.18:0/1935161607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 0x55e1f7ff93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.244+0000 7f12f1aed640 1 -- 172.21.15.18:0/1935161607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff4dc0 msgr2=0x55e1f80173b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:34.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.244+0000 7f12f1aed640 1 --2- 172.21.15.18:0/1935161607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff4dc0 0x55e1f80173b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.244+0000 7f12f1aed640 1 -- 172.21.15.18:0/1935161607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1f7ff0860 con 0x55e1f7ff44a0 2024-09-19T09:55:34.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.244+0000 7f12f22ee640 1 --2- 172.21.15.18:0/1935161607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 0x55e1f7ff93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:55:34.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.244+0000 7f12f1aed640 1 --2- 172.21.15.18:0/1935161607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f8016e70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000ea0 tx=0x7f12e8012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f67d5aa7685172 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:34.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.244+0000 7f12d77fe640 1 -- 172.21.15.18:0/1935161607 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8017070 con 0x55e1f7ff44a0 2024-09-19T09:55:34.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.244+0000 7f12d77fe640 1 -- 172.21.15.18:0/1935161607 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e802a070 con 0x55e1f7ff44a0 2024-09-19T09:55:34.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.244+0000 7f12d77fe640 1 -- 172.21.15.18:0/1935161607 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8013970 con 0x55e1f7ff44a0 2024-09-19T09:55:34.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.246+0000 7f12f612a740 1 -- 172.21.15.18:0/1935161607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 msgr2=0x55e1f8016e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:34.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.246+0000 7f12f612a740 1 --2- 172.21.15.18:0/1935161607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f8016e70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000ea0 tx=0x7f12e8012f50 comp rx=0 tx=0).stop 2024-09-19T09:55:34.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.246+0000 7f12f612a740 1 -- 172.21.15.18:0/1935161607 shutdown_connections 2024-09-19T09:55:34.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.246+0000 7f12f612a740 1 --2- 172.21.15.18:0/1935161607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7fff680 0x55e1f7ff93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.246+0000 7f12f612a740 1 --2- 172.21.15.18:0/1935161607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff4dc0 0x55e1f80173b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.246+0000 7f12f612a740 1 --2- 172.21.15.18:0/1935161607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7ff44a0 0x55e1f8016e70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.246+0000 7f12f612a740 1 -- 172.21.15.18:0/1935161607 >> 172.21.15.18:0/1935161607 conn(0x55e1f7ff0a30 msgr2=0x55e1f7ff6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:34.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.246+0000 7f12f612a740 1 -- 172.21.15.18:0/1935161607 shutdown_connections 2024-09-19T09:55:34.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.247+0000 7f12f612a740 1 -- 172.21.15.18:0/1935161607 wait complete. 2024-09-19T09:55:34.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.247+0000 7f12f612a740 1 -- start start 2024-09-19T09:55:34.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.248+0000 7f12f612a740 1 Processor -- start 2024-09-19T09:55:34.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.248+0000 7f12f612a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f612a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7ff9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f612a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7fff680 0x55e1f7ff9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f1aed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f1aed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47208/0 (socket says 172.21.15.18:47208) 2024-09-19T09:55:34.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f1aed640 1 -- 172.21.15.18:0/97673195 learned_addr learned my addr 172.21.15.18:0/97673195 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:34.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f12d000f860 con 0x55e1f7fff680 2024-09-19T09:55:34.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f12d000f190 con 0x55e1f7ff4dc0 2024-09-19T09:55:34.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12d000c3d0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f22ee640 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7fff680 0x55e1f7ff9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f612a740 10 client.0 _ll_register_callbacks cb 0x7f12e8009370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:34.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.249+0000 7f12f12ec640 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7ff9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.250+0000 7f12f1aed640 1 -- 172.21.15.18:0/97673195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff4dc0 msgr2=0x55e1f7ff9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:34.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.250+0000 7f12f1aed640 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7ff9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.250+0000 7f12f1aed640 1 -- 172.21.15.18:0/97673195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7fff680 msgr2=0x55e1f7ff9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:34.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.250+0000 7f12f1aed640 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7fff680 0x55e1f7ff9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.250+0000 7f12f1aed640 1 -- 172.21.15.18:0/97673195 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1f8005cc0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.250+0000 7f12f1aed640 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff9110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f12e800e250 tx=0x7f12e8009490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cf2f96453dc3c8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:34.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.250+0000 7f12d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.251+0000 7f12d57fa640 1 -- 172.21.15.18:0/97673195 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8017040 con 0x55e1f7ff44a0 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.251+0000 7f12d57fa640 1 -- 172.21.15.18:0/97673195 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f12e8005df0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.251+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12e802a070 con 0x55e1f7ff44a0 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.251+0000 7f12d57fa640 1 -- 172.21.15.18:0/97673195 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f12e800ec10 con 0x55e1f7ff44a0 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.251+0000 7f12f612a740 10 client.25762 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.251+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1f807a0b0 con 0x55e1f7ff44a0 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.252+0000 7f12d57fa640 1 -- 172.21.15.18:0/97673195 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e802a070 con 0x55e1f7ff44a0 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.252+0000 7f12d57fa640 1 -- 172.21.15.18:0/97673195 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f12e8036030 con 0x55e1f7ff44a0 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.252+0000 7f12f612a740 10 client.25762 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.252+0000 7f12f612a740 10 client.25762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.252+0000 7f12f612a740 20 client.25762 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.252+0000 7f12f612a740 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e1f800f140 0x55e1f807c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.253+0000 7f12f612a740 4 client.25762 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:55:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.253+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e1f7f61d60 con 0x55e1f800f140 2024-09-19T09:55:34.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.254+0000 7f12f12ec640 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e1f800f140 0x55e1f807c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:34.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.257+0000 7f12f12ec640 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e1f800f140 0x55e1f807c720 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe863624408d66a server_cookie=7dcd45e2e81b25e7 in_seq=0 out_seq=0 2024-09-19T09:55:34.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.257+0000 7f12d57fa640 10 client.25762 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:34.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.266+0000 7f12d57fa640 1 -- 172.21.15.18:0/97673195 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e1f7f61d60 con 0x55e1f800f140 2024-09-19T09:55:34.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.266+0000 7f12d57fa640 10 client.25762 handle_command_reply: tid=0 2024-09-19T09:55:34.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.266+0000 7f12f612a740 1 client.25762 shutdown 2024-09-19T09:55:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.268+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff44a0 msgr2=0x55e1f7ff9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.268+0000 7f12f612a740 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff9110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f12e800e250 tx=0x7f12e8009490 comp rx=0 tx=0).stop 2024-09-19T09:55:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.268+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 shutdown_connections 2024-09-19T09:55:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.268+0000 7f12f612a740 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e1f800f140 0x55e1f807c720 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.269+0000 7f12f612a740 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1f7fff680 0x55e1f7ff9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.269+0000 7f12f612a740 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e1f7ff4dc0 0x55e1f7ff9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.269+0000 7f12d57fa640 0 client.25762 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.269+0000 7f12f612a740 1 --2- 172.21.15.18:0/97673195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e1f7ff44a0 0x55e1f7ff9110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.269+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 >> 172.21.15.18:0/97673195 conn(0x55e1f7ff0a30 msgr2=0x55e1f7ff5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.269+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 shutdown_connections 2024-09-19T09:55:34.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.269+0000 7f12f612a740 1 -- 172.21.15.18:0/97673195 wait complete. 2024-09-19T09:55:34.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.269+0000 7f12f612a740 20 client.25762 trim_cache size 0 max 16384 2024-09-19T09:55:34.280 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:55:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T09:55:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T09:55:34.281 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.278+0000 7f12f3d51640 1 -- 172.21.15.18:0/3005561945 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f12d80a3440 msgr2=0x7f12d80a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.278+0000 7f12f3d51640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f12d80a3440 0x7f12d80a5900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f12e4017000 tx=0x7f12e4019000 comp rx=0 tx=0).stop 2024-09-19T09:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.278+0000 7f12f3d51640 1 -- 172.21.15.18:0/3005561945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12ec109830 msgr2=0x7f12ec118b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.278+0000 7f12f3d51640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12ec109830 0x7f12ec118b70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f12dc02a960 tx=0x7f12dc0045e0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.279+0000 7f12f3d51640 1 -- 172.21.15.18:0/3005561945 shutdown_connections 2024-09-19T09:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.279+0000 7f12f3d51640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f12d80a3440 0x7f12d80a5900 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.279+0000 7f12f3d51640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec11b140 0x7f12ec1118a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.279+0000 7f12f3d51640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12ec109830 0x7f12ec118b70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.279+0000 7f12f3d51640 1 --2- 172.21.15.18:0/3005561945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12ec109450 0x7f12ec118630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.279+0000 7f12f3d51640 1 -- 172.21.15.18:0/3005561945 >> 172.21.15.18:0/3005561945 conn(0x7f12ec06e140 msgr2=0x7f12ec11bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.282+0000 7f12f3d51640 1 -- 172.21.15.18:0/3005561945 shutdown_connections 2024-09-19T09:55:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:34.282+0000 7f12f3d51640 1 -- 172.21.15.18:0/3005561945 wait complete. 2024-09-19T09:55:34.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:34 smithi049 ceph-mon[34858]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 877 MiB/s wr, 1.72k op/s 2024-09-19T09:55:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:34 smithi162 ceph-mon[35174]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 877 MiB/s wr, 1.72k op/s 2024-09-19T09:55:35.630 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:55:35.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:55:36.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:36 smithi018 ceph-mon[30956]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 866 MiB/s wr, 1.49k op/s 2024-09-19T09:55:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:36 smithi049 ceph-mon[34858]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 866 MiB/s wr, 1.49k op/s 2024-09-19T09:55:36.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:36 smithi162 ceph-mon[35174]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 866 MiB/s wr, 1.49k op/s 2024-09-19T09:55:36.769 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:37.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.563+0000 7f9c69e63640 1 -- 172.21.15.18:0/469979689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c64105ec0 msgr2=0x7f9c64106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:38.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.563+0000 7f9c69e63640 1 --2- 172.21.15.18:0/469979689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c64105ec0 0x7f9c64106340 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009ca0 tx=0x7f9c5c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.676 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:38 smithi162 ceph-mon[35174]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 76 GiB used, 997 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 929 MiB/s wr, 1.51k op/s 2024-09-19T09:55:38.676 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:38 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3184344560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:55:38.676 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:38 smithi049 ceph-mon[34858]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 76 GiB used, 997 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 929 MiB/s wr, 1.51k op/s 2024-09-19T09:55:38.676 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:38 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3184344560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:55:38.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.567+0000 7f9c69e63640 1 -- 172.21.15.18:0/469979689 shutdown_connections 2024-09-19T09:55:38.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.567+0000 7f9c69e63640 1 --2- 172.21.15.18:0/469979689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c64105ec0 0x7f9c64106340 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.567+0000 7f9c69e63640 1 --2- 172.21.15.18:0/469979689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c641011e0 0x7f9c64105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.567+0000 7f9c69e63640 1 --2- 172.21.15.18:0/469979689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c641008c0 0x7f9c64100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.567+0000 7f9c69e63640 1 -- 172.21.15.18:0/469979689 >> 172.21.15.18:0/469979689 conn(0x7f9c640fc7d0 msgr2=0x7f9c640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.569+0000 7f9c69e63640 1 -- 172.21.15.18:0/469979689 shutdown_connections 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.569+0000 7f9c69e63640 1 -- 172.21.15.18:0/469979689 wait complete. 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.570+0000 7f9c69e63640 1 Processor -- start 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.571+0000 7f9c69e63640 1 -- start start 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.572+0000 7f9c69e63640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c641008c0 0x7f9c64114c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.572+0000 7f9c69e63640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641011e0 0x7f9c641151d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.572+0000 7f9c69e63640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64105ec0 0x7f9c6410df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.572+0000 7f9c69e63640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64118630 con 0x7f9c641011e0 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.572+0000 7f9c69e63640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641184b0 con 0x7f9c64105ec0 2024-09-19T09:55:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.572+0000 7f9c69e63640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641187b0 con 0x7f9c641008c0 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.573+0000 7f9c63fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64105ec0 0x7f9c6410df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.575+0000 7f9c62ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641011e0 0x7f9c641151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.576+0000 7f9c62ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641011e0 0x7f9c641151d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45914/0 (socket says 172.21.15.18:45914) 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.576+0000 7f9c62ffd640 1 -- 172.21.15.18:0/3184344560 learned_addr learned my addr 172.21.15.18:0/3184344560 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.578+0000 7f9c62ffd640 1 -- 172.21.15.18:0/3184344560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c641008c0 msgr2=0x7f9c64114c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.578+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c641008c0 0x7f9c64114c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.578+0000 7f9c62ffd640 1 -- 172.21.15.18:0/3184344560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64105ec0 msgr2=0x7f9c6410df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.578+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64105ec0 0x7f9c6410df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.578+0000 7f9c62ffd640 1 -- 172.21.15.18:0/3184344560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6410e7c0 con 0x7f9c641011e0 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.583+0000 7f9c62ffd640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641011e0 0x7f9c641151d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800e9f0 tx=0x7f9c5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.586+0000 7f9c60ff9640 1 -- 172.21.15.18:0/3184344560 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5800cd80 con 0x7f9c641011e0 2024-09-19T09:55:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.586+0000 7f9c69e63640 1 -- 172.21.15.18:0/3184344560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c6410eab0 con 0x7f9c641011e0 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.586+0000 7f9c69e63640 1 -- 172.21.15.18:0/3184344560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c64112aa0 con 0x7f9c641011e0 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.591+0000 7f9c60ff9640 1 -- 172.21.15.18:0/3184344560 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c58021920 con 0x7f9c641011e0 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.593+0000 7f9c60ff9640 1 -- 172.21.15.18:0/3184344560 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58010900 con 0x7f9c641011e0 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.601+0000 7f9c69e63640 1 -- 172.21.15.18:0/3184344560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6406a850 con 0x7f9c641011e0 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.601+0000 7f9c60ff9640 1 -- 172.21.15.18:0/3184344560 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9c58010aa0 con 0x7f9c641011e0 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.603+0000 7f9c60ff9640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 0x7f9c4c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.605+0000 7f9c60ff9640 1 -- 172.21.15.18:0/3184344560 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9c580d0e30 con 0x7f9c641011e0 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.605+0000 7f9c637fe640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 0x7f9c4c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.606+0000 7f9c637fe640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 0x7f9c4c0a5780 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9c54005fd0 tx=0x7f9c54005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:37.626+0000 7f9c60ff9640 1 -- 172.21.15.18:0/3184344560 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c5800b2c0 con 0x7f9c641011e0 2024-09-19T09:55:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.236+0000 7f9c69e63640 1 -- 172.21.15.18:0/3184344560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c64112dc0 con 0x7f9c641011e0 2024-09-19T09:55:38.682 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:55:38.682 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:55:38.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.239+0000 7f9c60ff9640 1 -- 172.21.15.18:0/3184344560 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f9c5809db20 con 0x7f9c641011e0 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.249+0000 7f9c69e63640 1 -- 172.21.15.18:0/3184344560 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 msgr2=0x7f9c4c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.249+0000 7f9c69e63640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 0x7f9c4c0a5780 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9c54005fd0 tx=0x7f9c54005850 comp rx=0 tx=0).stop 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.249+0000 7f9c69e63640 1 -- 172.21.15.18:0/3184344560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641011e0 msgr2=0x7f9c641151d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.249+0000 7f9c69e63640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641011e0 0x7f9c641151d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800e9f0 tx=0x7f9c5800edf0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.249+0000 7f9c69e63640 1 -- 172.21.15.18:0/3184344560 shutdown_connections 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.249+0000 7f9c69e63640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c4c0a32c0 0x7f9c4c0a5780 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9c54005fd0 tx=0x7f9c54005850 comp rx=0 tx=0).stop 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.249+0000 7f9c69e63640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c64105ec0 0x7f9c6410df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.249+0000 7f9c69e63640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c641011e0 0x7f9c641151d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.249+0000 7f9c69e63640 1 --2- 172.21.15.18:0/3184344560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c641008c0 0x7f9c64114c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.249+0000 7f9c69e63640 1 -- 172.21.15.18:0/3184344560 >> 172.21.15.18:0/3184344560 conn(0x7f9c640fc7d0 msgr2=0x7f9c64103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.253+0000 7f9c69e63640 1 -- 172.21.15.18:0/3184344560 shutdown_connections 2024-09-19T09:55:38.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:38.256+0000 7f9c69e63640 1 -- 172.21.15.18:0/3184344560 wait complete. 2024-09-19T09:55:38.684 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:38 smithi018 ceph-mon[30956]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 76 GiB used, 997 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 929 MiB/s wr, 1.51k op/s 2024-09-19T09:55:38.684 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:38 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3184344560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:55:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58b4ff9640 1 -- 172.21.15.18:0/3401536793 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5587d9e85d70 con 0x5587d9f1eef0 2024-09-19T09:55:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58b4ff9640 10 client.16308 handle_command_reply: tid=0 2024-09-19T09:55:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58d67ee740 1 client.16308 shutdown 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58d67ee740 1 -- 172.21.15.18:0/3401536793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 msgr2=0x5587d9f33500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58d67ee740 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f33500 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009fd0 tx=0x7f58c40077a0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58d67ee740 1 -- 172.21.15.18:0/3401536793 shutdown_connections 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58d67ee740 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5587d9f1eef0 0x5587d9f21310 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58d67ee740 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5587d9f28b80 0x5587d9f33500 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58d67ee740 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587d9f23af0 0x5587d9f304e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58d67ee740 1 --2- 172.21.15.18:0/3401536793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587d9f231b0 0x5587d9f2ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58d67ee740 1 -- 172.21.15.18:0/3401536793 >> 172.21.15.18:0/3401536793 conn(0x5587d9f16010 msgr2=0x5587d9f151c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.637+0000 7f58b4ff9640 0 client.16308 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.638+0000 7f58d67ee740 1 -- 172.21.15.18:0/3401536793 shutdown_connections 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.638+0000 7f58d67ee740 1 -- 172.21.15.18:0/3401536793 wait complete. 2024-09-19T09:55:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.638+0000 7f58d67ee740 20 client.16308 trim_cache size 0 max 16384 2024-09-19T09:55:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:55:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:55:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:55:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:55:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.640+0000 7f58d3978640 1 -- 172.21.15.18:0/3659475307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f58b80a3370 msgr2=0x7f58b80a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.640+0000 7f58d3978640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f58b80a3370 0x7f58b80a5830 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f58cc06b1a0 tx=0x7f58c400e040 comp rx=0 tx=0).stop 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.640+0000 7f58d3978640 1 -- 172.21.15.18:0/3659475307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58cc104f00 msgr2=0x7f58cc070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.640+0000 7f58d3978640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58cc104f00 0x7f58cc070360 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f58c800b450 tx=0x7f58c800b910 comp rx=0 tx=0).stop 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.645+0000 7f58d3978640 1 -- 172.21.15.18:0/3659475307 shutdown_connections 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.645+0000 7f58d3978640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f58b80a3370 0x7f58b80a5830 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.645+0000 7f58d3978640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58cc107830 0x7f58cc0733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.645+0000 7f58d3978640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58cc104f00 0x7f58cc070360 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.645+0000 7f58d3978640 1 --2- 172.21.15.18:0/3659475307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58cc1025d0 0x7f58cc06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.645+0000 7f58d3978640 1 -- 172.21.15.18:0/3659475307 >> 172.21.15.18:0/3659475307 conn(0x7f58cc0fc1b0 msgr2=0x7f58cc107c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.645+0000 7f58d3978640 1 -- 172.21.15.18:0/3659475307 shutdown_connections 2024-09-19T09:55:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:38.645+0000 7f58d3978640 1 -- 172.21.15.18:0/3659475307 wait complete. 2024-09-19T09:55:39.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:55:39.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:39 smithi018 ceph-mon[30956]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 76 GiB used, 996 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 840 MiB/s wr, 1.45k op/s 2024-09-19T09:55:39.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:39 smithi049 ceph-mon[34858]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 76 GiB used, 996 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 840 MiB/s wr, 1.45k op/s 2024-09-19T09:55:39.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:39 smithi162 ceph-mon[35174]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 76 GiB used, 996 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 840 MiB/s wr, 1.45k op/s 2024-09-19T09:55:40.452 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:40.779 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:40 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:55:40.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:40 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:55:40.916 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:40 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:55:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.528+0000 7fa6fdb01640 1 -- 172.21.15.18:0/2674857308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f811b140 msgr2=0x7fa6f811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.529+0000 7fa6fdb01640 1 --2- 172.21.15.18:0/2674857308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f811b140 0x7fa6f811d530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa6f001acb0 tx=0x7fa6f003b900 comp rx=0 tx=0).stop 2024-09-19T09:55:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.530+0000 7fa6fdb01640 1 -- 172.21.15.18:0/2674857308 shutdown_connections 2024-09-19T09:55:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.530+0000 7fa6fdb01640 1 --2- 172.21.15.18:0/2674857308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f811b140 0x7fa6f811d530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.530+0000 7fa6fdb01640 1 --2- 172.21.15.18:0/2674857308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6f8109830 0x7fa6f8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.530+0000 7fa6fdb01640 1 --2- 172.21.15.18:0/2674857308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f8109450 0x7fa6f8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.530+0000 7fa6fdb01640 1 -- 172.21.15.18:0/2674857308 >> 172.21.15.18:0/2674857308 conn(0x7fa6f806e140 msgr2=0x7fa6f806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.531+0000 7fa6fdb01640 1 -- 172.21.15.18:0/2674857308 shutdown_connections 2024-09-19T09:55:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.534+0000 7fa6fdb01640 1 -- 172.21.15.18:0/2674857308 wait complete. 2024-09-19T09:55:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.536+0000 7fa6fdb01640 1 Processor -- start 2024-09-19T09:55:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.536+0000 7fa6fdb01640 1 -- start start 2024-09-19T09:55:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.537+0000 7fa6fdb01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f8109450 0x7fa6f811a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.537+0000 7fa6fdb01640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6f8109830 0x7fa6f81168b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.537+0000 7fa6fdb01640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f811b140 0x7fa6f8116df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.538+0000 7fa6fdb01640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81132f0 con 0x7fa6f8109450 2024-09-19T09:55:41.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.538+0000 7fa6fdb01640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f8113170 con 0x7fa6f8109830 2024-09-19T09:55:41.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.538+0000 7fa6fdb01640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f8113470 con 0x7fa6f811b140 2024-09-19T09:55:41.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.540+0000 7fa6f6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6f8109830 0x7fa6f81168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.540+0000 7fa6f6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6f8109830 0x7fa6f81168b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:57694/0 (socket says 172.21.15.18:57694) 2024-09-19T09:55:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.540+0000 7fa6f6ffd640 1 -- 172.21.15.18:0/1605978411 learned_addr learned my addr 172.21.15.18:0/1605978411 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.540+0000 7fa6f7fff640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f811b140 0x7fa6f8116df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.544+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f8109450 0x7fa6f811a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.546+0000 7fa6f6ffd640 1 -- 172.21.15.18:0/1605978411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f811b140 msgr2=0x7fa6f8116df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:41.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.546+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f811b140 0x7fa6f8116df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.546+0000 7fa6f6ffd640 1 -- 172.21.15.18:0/1605978411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f8109450 msgr2=0x7fa6f811a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:41.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.546+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f8109450 0x7fa6f811a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.546+0000 7fa6f6ffd640 1 -- 172.21.15.18:0/1605978411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f81174f0 con 0x7fa6f8109830 2024-09-19T09:55:41.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.551+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6f8109830 0x7fa6f81168b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00b450 tx=0x7fa6ec00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.553+0000 7fa6f4ff9640 1 -- 172.21.15.18:0/1605978411 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec015020 con 0x7fa6f8109830 2024-09-19T09:55:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.553+0000 7fa6f4ff9640 1 -- 172.21.15.18:0/1605978411 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6ec011d70 con 0x7fa6f8109830 2024-09-19T09:55:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.553+0000 7fa6fdb01640 1 -- 172.21.15.18:0/1605978411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f81ab170 con 0x7fa6f8109830 2024-09-19T09:55:41.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.554+0000 7fa6fdb01640 1 -- 172.21.15.18:0/1605978411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f81ab560 con 0x7fa6f8109830 2024-09-19T09:55:41.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.554+0000 7fa6f4ff9640 1 -- 172.21.15.18:0/1605978411 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00f340 con 0x7fa6f8109830 2024-09-19T09:55:41.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.561+0000 7fa6ffeda740 1 Processor -- start 2024-09-19T09:55:41.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.563+0000 7fa6ffeda740 1 -- start start 2024-09-19T09:55:41.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.564+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7ecb40 0x56414d7eb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.565+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d7eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.565+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7f6370 0x56414d7f8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.565+0000 7fa6ffeda740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56414d7512f0 con 0x56414d7eb5d0 2024-09-19T09:55:41.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.565+0000 7fa6f7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7ecb40 0x56414d7eb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.565+0000 7fa6f7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7ecb40 0x56414d7eb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:57700/0 (socket says 172.21.15.18:57700) 2024-09-19T09:55:41.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.565+0000 7fa6f7fff640 1 -- 172.21.15.18:0/1556341494 learned_addr learned my addr 172.21.15.18:0/1556341494 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:41.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.565+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1556341494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56414d6f8cf0 con 0x56414d7ecb40 2024-09-19T09:55:41.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.566+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1556341494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56414d74d2b0 con 0x56414d7f6370 2024-09-19T09:55:41.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.566+0000 7fa6f4ff9640 1 -- 172.21.15.18:0/1605978411 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa6ec018020 con 0x7fa6f8109830 2024-09-19T09:55:41.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.569+0000 7fa6f4ff9640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa6e00a3450 0x7fa6e00a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.569+0000 7fa6f4ff9640 1 -- 172.21.15.18:0/1605978411 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa6ec0cf200 con 0x7fa6f8109830 2024-09-19T09:55:41.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.569+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1556341494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7f6370 0x56414d7f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.572+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/1556341494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d7eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.572+0000 7fa6f7fff640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa6e00a3450 0x7fa6e00a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.573+0000 7fa6f6ffd640 1 -- 172.21.15.18:0/1556341494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7ecb40 msgr2=0x56414d7eb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:41.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.573+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1556341494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7ecb40 0x56414d7eb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.573+0000 7fa6f6ffd640 1 -- 172.21.15.18:0/1556341494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 msgr2=0x56414d7eba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:41.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.573+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1556341494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d7eba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.574+0000 7fa6f6ffd640 1 -- 172.21.15.18:0/1556341494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414d6dd3a0 con 0x56414d7f6370 2024-09-19T09:55:41.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.574+0000 7fa6f7fff640 1 --2- 172.21.15.18:0/1556341494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7ecb40 0x56414d7eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:55:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.577+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1556341494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7f6370 0x56414d7f8760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00be10 tx=0x7fa6ec09b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5abbcb54d356a93d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.578+0000 7fa6ddffb640 1 -- 172.21.15.18:0/1556341494 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec09b7f0 con 0x56414d7f6370 2024-09-19T09:55:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.578+0000 7fa6ddffb640 1 -- 172.21.15.18:0/1556341494 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6ec09fba0 con 0x56414d7f6370 2024-09-19T09:55:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.578+0000 7fa6ddffb640 1 -- 172.21.15.18:0/1556341494 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec09ac40 con 0x56414d7f6370 2024-09-19T09:55:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.578+0000 7fa6f7fff640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa6e00a3450 0x7fa6e00a5910 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005fe0 tx=0x7fa6f003b900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.579+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1556341494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7f6370 msgr2=0x56414d7f8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:41.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.580+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1556341494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7f6370 0x56414d7f8760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00be10 tx=0x7fa6ec09b330 comp rx=0 tx=0).stop 2024-09-19T09:55:41.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.580+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1556341494 shutdown_connections 2024-09-19T09:55:41.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.580+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1556341494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7f6370 0x56414d7f8760 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.580+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1556341494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d7eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.580+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1556341494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7ecb40 0x56414d7eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.580+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1556341494 >> 172.21.15.18:0/1556341494 conn(0x56414d7b4310 msgr2=0x56414d7e7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:41.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.580+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1556341494 shutdown_connections 2024-09-19T09:55:41.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.581+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1556341494 wait complete. 2024-09-19T09:55:41.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.581+0000 7fa6ffeda740 1 -- start start 2024-09-19T09:55:41.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.582+0000 7fa6ffeda740 1 Processor -- start 2024-09-19T09:55:41.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.582+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7eb5d0 0x56414d7f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.583+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7ecb40 0x56414d7f3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.583+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7eb5d0 0x56414d7f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.583+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7eb5d0 0x56414d7f5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49878/0 (socket says 172.21.15.18:49878) 2024-09-19T09:55:41.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.583+0000 7fa6f77fe640 1 -- 172.21.15.18:0/1519797437 learned_addr learned my addr 172.21.15.18:0/1519797437 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:41.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.583+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7f6370 0x56414d7f3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.583+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56414d7f9070 con 0x56414d7ecb40 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.583+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56414d70c060 con 0x56414d7f6370 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.583+0000 7fa6f7fff640 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7f6370 0x56414d7f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56414d7f91f0 con 0x56414d7eb5d0 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7ecb40 0x56414d7f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6f77fe640 1 -- 172.21.15.18:0/1519797437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7f6370 msgr2=0x56414d7f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7f6370 0x56414d7f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6f77fe640 1 -- 172.21.15.18:0/1519797437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7ecb40 msgr2=0x56414d7f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7ecb40 0x56414d7f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6f77fe640 1 -- 172.21.15.18:0/1519797437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414d4c23c0 con 0x56414d7eb5d0 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6ffeda740 10 client.0 _ll_register_callbacks cb 0x56414d45f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7eb5d0 0x56414d7f5dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80136e0 tx=0x7fa6e8013ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3877f7b9b69c121 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:41.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6ec09fba0 con 0x56414d7eb5d0 2024-09-19T09:55:41.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.584+0000 7fa6d6ffd640 10 client.25777 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:55:41.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.585+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7ecb40 0x56414d7f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:55:41.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.586+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/1519797437 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8020060 con 0x56414d7eb5d0 2024-09-19T09:55:41.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.586+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/1519797437 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa6e8011dd0 con 0x56414d7eb5d0 2024-09-19T09:55:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.594+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/1519797437 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa6e800f450 con 0x56414d7eb5d0 2024-09-19T09:55:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.594+0000 7fa6ffeda740 10 client.25777 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.594+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56414d804b70 con 0x56414d7eb5d0 2024-09-19T09:55:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.594+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/1519797437 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa6e801a030 con 0x56414d7eb5d0 2024-09-19T09:55:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.594+0000 7fa6ffeda740 10 client.25777 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.594+0000 7fa6ffeda740 10 client.25777 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:55:41.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.595+0000 7fa6ffeda740 20 client.25777 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:41.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.595+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56414d805ec0 0x56414d8082b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.595+0000 7fa6ffeda740 4 client.25777 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:41.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.595+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56414d75e860 con 0x56414d805ec0 2024-09-19T09:55:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.597+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56414d805ec0 0x56414d8082b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.611+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56414d805ec0 0x56414d8082b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d58ddc3cd2b84c2d server_cookie=c80ee9bbf5ee220b in_seq=0 out_seq=0 2024-09-19T09:55:41.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.611+0000 7fa6d6ffd640 10 client.25777 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:55:41.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.628+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/1519797437 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa6ec010560 con 0x56414d805ec0 2024-09-19T09:55:41.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.628+0000 7fa6d6ffd640 10 client.25777 handle_command_reply: tid=0 2024-09-19T09:55:41.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.628+0000 7fa6ffeda740 1 client.25777 shutdown 2024-09-19T09:55:41.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.629+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7eb5d0 msgr2=0x56414d7f5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:41.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.629+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7eb5d0 0x56414d7f5dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80136e0 tx=0x7fa6e8013ba0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.636+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 shutdown_connections 2024-09-19T09:55:41.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.636+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56414d805ec0 0x56414d8082b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.636+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7f6370 0x56414d7f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.636+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7ecb40 0x56414d7f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.636+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1519797437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7eb5d0 0x56414d7f5dc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.636+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 >> 172.21.15.18:0/1519797437 conn(0x56414d7b4310 msgr2=0x56414d7ed930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:41.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.636+0000 7fa6d6ffd640 0 client.25777 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:55:41.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.636+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 shutdown_connections 2024-09-19T09:55:41.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.636+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1519797437 wait complete. 2024-09-19T09:55:41.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.638+0000 7fa6ffeda740 20 client.25777 trim_cache size 0 max 16384 2024-09-19T09:55:41.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.667+0000 7fa6ffeda740 1 Processor -- start 2024-09-19T09:55:41.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.667+0000 7fa6ffeda740 1 -- start start 2024-09-19T09:55:41.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.668+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d801a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.668+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7ecb40 0x56414d801f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.668+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7f6370 0x56414d7ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.668+0000 7fa6ffeda740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81b3b60 con 0x56414d7eb5d0 2024-09-19T09:55:41.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.668+0000 7fa6ffeda740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81b56a0 con 0x56414d7f6370 2024-09-19T09:55:41.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.668+0000 7fa6ffeda740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81b4230 con 0x56414d7ecb40 2024-09-19T09:55:41.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.668+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d801a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.668+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d801a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45946/0 (socket says 172.21.15.18:45946) 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.668+0000 7fa6f77fe640 1 -- 172.21.15.18:0/1645688583 learned_addr learned my addr 172.21.15.18:0/1645688583 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.669+0000 7fa6f77fe640 1 -- 172.21.15.18:0/1645688583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7ecb40 msgr2=0x56414d801f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.669+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/1645688583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7ecb40 0x56414d801f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.669+0000 7fa6f77fe640 1 -- 172.21.15.18:0/1645688583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7f6370 msgr2=0x56414d7ee120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.669+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/1645688583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7f6370 0x56414d7ee120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.669+0000 7fa6f77fe640 1 -- 172.21.15.18:0/1645688583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414d7f8ad0 con 0x56414d7eb5d0 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.670+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/1645688583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d801a10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80117b0 tx=0x7fa6e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3739945aed902f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.671+0000 7fa6dd7fa640 1 -- 172.21.15.18:0/1645688583 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8020040 con 0x56414d7eb5d0 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.671+0000 7fa6dd7fa640 1 -- 172.21.15.18:0/1645688583 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6ec09fba0 con 0x56414d7eb5d0 2024-09-19T09:55:41.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.671+0000 7fa6dd7fa640 1 -- 172.21.15.18:0/1645688583 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80038e0 con 0x56414d7eb5d0 2024-09-19T09:55:41.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.672+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1645688583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 msgr2=0x56414d801a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:41.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.672+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1645688583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d801a10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80117b0 tx=0x7fa6e8016000 comp rx=0 tx=0).stop 2024-09-19T09:55:41.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.673+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1645688583 shutdown_connections 2024-09-19T09:55:41.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.673+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1645688583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7f6370 0x56414d7ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.673+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1645688583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7ecb40 0x56414d801f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.673+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/1645688583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d801a10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.673+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1645688583 >> 172.21.15.18:0/1645688583 conn(0x56414d7b4310 msgr2=0x56414d801300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:41.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.675+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1645688583 shutdown_connections 2024-09-19T09:55:41.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.675+0000 7fa6ffeda740 1 -- 172.21.15.18:0/1645688583 wait complete. 2024-09-19T09:55:41.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.676+0000 7fa6ffeda740 1 -- start start 2024-09-19T09:55:41.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.676+0000 7fa6ffeda740 1 Processor -- start 2024-09-19T09:55:41.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.677+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d7fa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.677+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7f6370 0x56414d7fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.678+0000 7fa6ffeda740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7fac00 0x56414d86fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.678+0000 7fa6ffeda740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81b4fd0 con 0x56414d7eb5d0 2024-09-19T09:55:41.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.678+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d7fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.678+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d7fa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45952/0 (socket says 172.21.15.18:45952) 2024-09-19T09:55:41.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.678+0000 7fa6f77fe640 1 -- 172.21.15.18:0/2177867957 learned_addr learned my addr 172.21.15.18:0/2177867957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:41.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.678+0000 7fa6ffeda740 1 -- 172.21.15.18:0/2177867957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81b4900 con 0x56414d7fac00 2024-09-19T09:55:41.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.678+0000 7fa6ffeda740 1 -- 172.21.15.18:0/2177867957 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81b1b40 con 0x56414d7f6370 2024-09-19T09:55:41.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.679+0000 7fa6ffeda740 10 client.0 _ll_register_callbacks cb 0x7fa6e80096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:41.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.679+0000 7fa6f77fe640 1 -- 172.21.15.18:0/2177867957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7f6370 msgr2=0x56414d7fa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:41.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.679+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7f6370 0x56414d7fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.679+0000 7fa6f77fe640 1 -- 172.21.15.18:0/2177867957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7fac00 msgr2=0x56414d86fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:41.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.679+0000 7fa6f7fff640 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7fac00 0x56414d86fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.679+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7fac00 0x56414d86fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.679+0000 7fa6f77fe640 1 -- 172.21.15.18:0/2177867957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414d86ffc0 con 0x56414d7eb5d0 2024-09-19T09:55:41.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.680+0000 7fa6f77fe640 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d7fa180 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8005d80 tx=0x7fa6e8009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c391cd652443674a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:41.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.680+0000 7fa6d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:41.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.680+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/2177867957 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8020040 con 0x56414d7eb5d0 2024-09-19T09:55:41.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.680+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/2177867957 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa6e8004230 con 0x56414d7eb5d0 2024-09-19T09:55:41.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.681+0000 7fa6ffeda740 1 -- 172.21.15.18:0/2177867957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6ec09fba0 con 0x56414d7eb5d0 2024-09-19T09:55:41.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.681+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/2177867957 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa6e8004470 con 0x56414d7eb5d0 2024-09-19T09:55:41.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.691+0000 7fa6ffeda740 10 client.16347 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:41.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.691+0000 7fa6ffeda740 1 -- 172.21.15.18:0/2177867957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56414d871150 con 0x56414d7eb5d0 2024-09-19T09:55:41.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.692+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/2177867957 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6ec09fba0 con 0x56414d7eb5d0 2024-09-19T09:55:41.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.692+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/2177867957 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa6e801a040 con 0x56414d7eb5d0 2024-09-19T09:55:41.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.692+0000 7fa6ffeda740 10 client.16347 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:41.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.692+0000 7fa6ffeda740 10 client.16347 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:55:41.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.692+0000 7fa6ffeda740 20 client.16347 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:41.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.692+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56414d8717a0 0x56414d873b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:41.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.692+0000 7fa6ffeda740 4 client.16347 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:55:41.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.692+0000 7fa6ffeda740 1 -- 172.21.15.18:0/2177867957 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56414d758d70 con 0x56414d8717a0 2024-09-19T09:55:41.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.697+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56414d8717a0 0x56414d873b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:41.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.699+0000 7fa6f6ffd640 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56414d8717a0 0x56414d873b90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=29c6e254d94f99b9 server_cookie=29d3136319eff1d1 in_seq=0 out_seq=0 2024-09-19T09:55:41.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.699+0000 7fa6d6ffd640 10 client.16347 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:55:41.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.699+0000 7fa6d6ffd640 1 -- 172.21.15.18:0/2177867957 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56414d758d70 con 0x56414d8717a0 2024-09-19T09:55:41.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.699+0000 7fa6d6ffd640 10 client.16347 handle_command_reply: tid=0 2024-09-19T09:55:41.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.700+0000 7fa6ffeda740 1 client.16347 shutdown 2024-09-19T09:55:41.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.700+0000 7fa6ffeda740 1 -- 172.21.15.18:0/2177867957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 msgr2=0x56414d7fa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:41.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.700+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d7fa180 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8005d80 tx=0x7fa6e8009fd0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.700+0000 7fa6ffeda740 1 -- 172.21.15.18:0/2177867957 shutdown_connections 2024-09-19T09:55:41.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.700+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56414d8717a0 0x56414d873b90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.700+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56414d7fac00 0x56414d86fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.701+0000 7fa6d6ffd640 0 client.16347 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:55:41.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.701+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56414d7f6370 0x56414d7fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.701+0000 7fa6ffeda740 1 --2- 172.21.15.18:0/2177867957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56414d7eb5d0 0x56414d7fa180 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.701+0000 7fa6ffeda740 1 -- 172.21.15.18:0/2177867957 >> 172.21.15.18:0/2177867957 conn(0x56414d7b4310 msgr2=0x56414d7f48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:41.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.701+0000 7fa6ffeda740 1 -- 172.21.15.18:0/2177867957 shutdown_connections 2024-09-19T09:55:41.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.701+0000 7fa6ffeda740 1 -- 172.21.15.18:0/2177867957 wait complete. 2024-09-19T09:55:41.706 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:55:41.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.701+0000 7fa6ffeda740 20 client.16347 trim_cache size 0 max 16384 2024-09-19T09:55:41.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.707+0000 7fa6fdb01640 1 -- 172.21.15.18:0/1605978411 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa6e00a3450 msgr2=0x7fa6e00a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:41.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.707+0000 7fa6fdb01640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa6e00a3450 0x7fa6e00a5910 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005fe0 tx=0x7fa6f003b900 comp rx=0 tx=0).stop 2024-09-19T09:55:41.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.707+0000 7fa6fdb01640 1 -- 172.21.15.18:0/1605978411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6f8109830 msgr2=0x7fa6f81168b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:41.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.707+0000 7fa6fdb01640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6f8109830 0x7fa6f81168b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00b450 tx=0x7fa6ec00b910 comp rx=0 tx=0).stop 2024-09-19T09:55:41.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.707+0000 7fa6fdb01640 1 -- 172.21.15.18:0/1605978411 shutdown_connections 2024-09-19T09:55:41.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.707+0000 7fa6fdb01640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa6e00a3450 0x7fa6e00a5910 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.707+0000 7fa6fdb01640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f811b140 0x7fa6f8116df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.707+0000 7fa6fdb01640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6f8109830 0x7fa6f81168b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.707+0000 7fa6fdb01640 1 --2- 172.21.15.18:0/1605978411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f8109450 0x7fa6f811a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:41.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.707+0000 7fa6fdb01640 1 -- 172.21.15.18:0/1605978411 >> 172.21.15.18:0/1605978411 conn(0x7fa6f806e140 msgr2=0x7fa6f8070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:41.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.709+0000 7fa6fdb01640 1 -- 172.21.15.18:0/1605978411 shutdown_connections 2024-09-19T09:55:41.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:41.709+0000 7fa6fdb01640 1 -- 172.21.15.18:0/1605978411 wait complete. 2024-09-19T09:55:41.892 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:41 smithi018 ceph-mon[30956]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 76 GiB used, 996 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 875 MiB/s wr, 1.66k op/s 2024-09-19T09:55:41.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:41 smithi049 ceph-mon[34858]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 76 GiB used, 996 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 875 MiB/s wr, 1.66k op/s 2024-09-19T09:55:41.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:41 smithi162 ceph-mon[35174]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 76 GiB used, 996 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 875 MiB/s wr, 1.66k op/s 2024-09-19T09:55:42.637 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:55:42.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:55:42.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:55:42.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:42 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:55:42.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:55:42.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:55:42.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:42 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:55:42.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:55:42.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:55:42.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:42 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:55:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.569+0000 7f6deae68640 1 -- 172.21.15.18:0/2644087266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ddc094cb0 msgr2=0x7f6ddc098850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.569+0000 7f6deae68640 1 --2- 172.21.15.18:0/2644087266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ddc094cb0 0x7f6ddc098850 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6de4067960 tx=0x7f6de4096f50 comp rx=0 tx=0).stop 2024-09-19T09:55:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.571+0000 7f6deae68640 1 -- 172.21.15.18:0/2644087266 shutdown_connections 2024-09-19T09:55:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.571+0000 7f6deae68640 1 --2- 172.21.15.18:0/2644087266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ddc098f80 0x7f6ddc0a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.571+0000 7f6deae68640 1 --2- 172.21.15.18:0/2644087266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ddc094cb0 0x7f6ddc098850 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.571+0000 7f6deae68640 1 --2- 172.21.15.18:0/2644087266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ddc094300 0x7f6ddc0946e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.571+0000 7f6deae68640 1 -- 172.21.15.18:0/2644087266 >> 172.21.15.18:0/2644087266 conn(0x7f6ddc009960 msgr2=0x7f6ddc009d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.573+0000 7f6deae68640 1 -- 172.21.15.18:0/2644087266 shutdown_connections 2024-09-19T09:55:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.573+0000 7f6deae68640 1 -- 172.21.15.18:0/2644087266 wait complete. 2024-09-19T09:55:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.580+0000 7f6deae68640 1 Processor -- start 2024-09-19T09:55:44.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.582+0000 7f6deae68640 1 -- start start 2024-09-19T09:55:44.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.583+0000 7f6deae68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ddc094300 0x7f6ddc151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.584+0000 7f6deae68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ddc094cb0 0x7f6ddc151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.584+0000 7f6deae68640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ddc098f80 0x7f6ddc14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.584+0000 7f6deae68640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc0b46a0 con 0x7f6ddc094cb0 2024-09-19T09:55:44.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.584+0000 7f6deae68640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc0b4520 con 0x7f6ddc094300 2024-09-19T09:55:44.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.584+0000 7f6deae68640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc0b4820 con 0x7f6ddc098f80 2024-09-19T09:55:44.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.585+0000 7f6de9665640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ddc094cb0 0x7f6ddc151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.585+0000 7f6de9665640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ddc094cb0 0x7f6ddc151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45970/0 (socket says 172.21.15.18:45970) 2024-09-19T09:55:44.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.585+0000 7f6de9665640 1 -- 172.21.15.18:0/1415706329 learned_addr learned my addr 172.21.15.18:0/1415706329 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:44.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.586+0000 7f6de9e66640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ddc094300 0x7f6ddc151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.588+0000 7f6de9665640 1 -- 172.21.15.18:0/1415706329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ddc098f80 msgr2=0x7f6ddc14ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:55:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.588+0000 7f6de9665640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ddc098f80 0x7f6ddc14ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.588+0000 7f6de9665640 1 -- 172.21.15.18:0/1415706329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ddc094300 msgr2=0x7f6ddc151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.588+0000 7f6de9665640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ddc094300 0x7f6ddc151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.589+0000 7f6de9665640 1 -- 172.21.15.18:0/1415706329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc14c150 con 0x7f6ddc094cb0 2024-09-19T09:55:44.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.589+0000 7f6de9665640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ddc094cb0 0x7f6ddc151da0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6de4065a40 tx=0x7f6de409df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:44.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.593+0000 7f6ddaffd640 1 -- 172.21.15.18:0/1415706329 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de409e5d0 con 0x7f6ddc094cb0 2024-09-19T09:55:44.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.593+0000 7f6ddaffd640 1 -- 172.21.15.18:0/1415706329 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6de409ec50 con 0x7f6ddc094cb0 2024-09-19T09:55:44.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.593+0000 7f6ddaffd640 1 -- 172.21.15.18:0/1415706329 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de409fe20 con 0x7f6ddc094cb0 2024-09-19T09:55:44.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.594+0000 7f6deae68640 1 -- 172.21.15.18:0/1415706329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ddc14c3e0 con 0x7f6ddc094cb0 2024-09-19T09:55:44.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.594+0000 7f6deae68640 1 -- 172.21.15.18:0/1415706329 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ddc158730 con 0x7f6ddc094cb0 2024-09-19T09:55:44.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.601+0000 7f6dee4a3740 1 Processor -- start 2024-09-19T09:55:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.601+0000 7f6dee4a3740 1 -- start start 2024-09-19T09:55:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.602+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 0x55675c8a8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.602+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a8780 0x55675c8a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.602+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.602+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55675c80e2f0 con 0x55675c8b3520 2024-09-19T09:55:44.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.602+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55675c7b5cf0 con 0x55675c8a9cf0 2024-09-19T09:55:44.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.602+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55675c80a2b0 con 0x55675c8a8780 2024-09-19T09:55:44.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.603+0000 7f6dea667640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 0x55675c8a8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.603+0000 7f6dea667640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 0x55675c8a8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:57734/0 (socket says 172.21.15.18:57734) 2024-09-19T09:55:44.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.603+0000 7f6dea667640 1 -- 172.21.15.18:0/1289756832 learned_addr learned my addr 172.21.15.18:0/1289756832 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:44.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.604+0000 7f6dea667640 1 -- 172.21.15.18:0/1289756832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a8780 msgr2=0x55675c8a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:44.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.604+0000 7f6dea667640 1 --2- 172.21.15.18:0/1289756832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a8780 0x55675c8a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.604+0000 7f6dea667640 1 -- 172.21.15.18:0/1289756832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 msgr2=0x55675c8b5910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:55:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.604+0000 7f6dea667640 1 --2- 172.21.15.18:0/1289756832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8b5910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.604+0000 7f6dea667640 1 -- 172.21.15.18:0/1289756832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675c79a3a0 con 0x55675c8a9cf0 2024-09-19T09:55:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.604+0000 7f6ddaffd640 1 -- 172.21.15.18:0/1415706329 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6de409d030 con 0x7f6ddc094cb0 2024-09-19T09:55:44.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.606+0000 7f6dea667640 1 --2- 172.21.15.18:0/1289756832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 0x55675c8a8240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400d9d0 tx=0x7f6dd400d2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=403f84f99369651f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:44.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.606+0000 7f6ddaffd640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6dd00a33e0 0x7f6dd00a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.609+0000 7f6dcffff640 1 -- 172.21.15.18:0/1289756832 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4019020 con 0x55675c8a9cf0 2024-09-19T09:55:44.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.609+0000 7f6dcffff640 1 -- 172.21.15.18:0/1289756832 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dd400ad30 con 0x55675c8a9cf0 2024-09-19T09:55:44.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.609+0000 7f6dcffff640 1 -- 172.21.15.18:0/1289756832 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4015400 con 0x55675c8a9cf0 2024-09-19T09:55:44.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.610+0000 7f6de9e66640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6dd00a33e0 0x7f6dd00a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.610+0000 7f6dee4a3740 1 -- 172.21.15.18:0/1289756832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 msgr2=0x55675c8a8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:44.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.610+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/1289756832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 0x55675c8a8240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400d9d0 tx=0x7f6dd400d2e0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.610+0000 7f6ddaffd640 1 -- 172.21.15.18:0/1415706329 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6de4050ea0 con 0x7f6ddc094cb0 2024-09-19T09:55:44.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.611+0000 7f6dee4a3740 1 -- 172.21.15.18:0/1289756832 shutdown_connections 2024-09-19T09:55:44.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.611+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/1289756832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.611+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/1289756832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a8780 0x55675c8a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.611+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/1289756832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 0x55675c8a8240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.611+0000 7f6dee4a3740 1 -- 172.21.15.18:0/1289756832 >> 172.21.15.18:0/1289756832 conn(0x55675c871310 msgr2=0x55675c8a4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:44.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.616+0000 7f6dee4a3740 1 -- 172.21.15.18:0/1289756832 shutdown_connections 2024-09-19T09:55:44.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.617+0000 7f6de9e66640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6dd00a33e0 0x7f6dd00a58a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6de0005d00 tx=0x7f6de0005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:44.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.618+0000 7f6dee4a3740 1 -- 172.21.15.18:0/1289756832 wait complete. 2024-09-19T09:55:44.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.618+0000 7f6dee4a3740 1 -- start start 2024-09-19T09:55:44.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.619+0000 7f6dee4a3740 1 Processor -- start 2024-09-19T09:55:44.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.620+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 0x55675c8b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.620+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 0x55675c8b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.620+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.620+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55675c8b6220 con 0x55675c8b3520 2024-09-19T09:55:44.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.620+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55675c7c9060 con 0x55675c8a8780 2024-09-19T09:55:44.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.620+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55675c8b63a0 con 0x55675c8a9cf0 2024-09-19T09:55:44.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.620+0000 7f6dee4a3740 10 client.0 _ll_register_callbacks cb 0x55675c51c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:44.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.621+0000 7f6dea667640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.621+0000 7f6de9665640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 0x55675c8b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.621+0000 7f6de9665640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 0x55675c8b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49922/0 (socket says 172.21.15.18:49922) 2024-09-19T09:55:44.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.621+0000 7f6de9665640 1 -- 172.21.15.18:0/87085026 learned_addr learned my addr 172.21.15.18:0/87085026 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:44.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.621+0000 7f6de9e66640 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 0x55675c8b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.622+0000 7f6dea667640 1 -- 172.21.15.18:0/87085026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 msgr2=0x55675c8b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:44.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.622+0000 7f6dea667640 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 0x55675c8b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.622+0000 7f6dea667640 1 -- 172.21.15.18:0/87085026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 msgr2=0x55675c8b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:44.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.622+0000 7f6dea667640 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 0x55675c8b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.622+0000 7f6dea667640 1 -- 172.21.15.18:0/87085026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675c57f3c0 con 0x55675c8b3520 2024-09-19T09:55:44.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.622+0000 7f6dea667640 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8b0680 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4004b70 tx=0x7f6dd400af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d4655689445dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:44.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.622+0000 7f6dcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:44.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.623+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/87085026 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4024070 con 0x55675c8b3520 2024-09-19T09:55:44.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.623+0000 7f6dee4a3740 1 -- 172.21.15.18:0/87085026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dd400ad30 con 0x55675c8b3520 2024-09-19T09:55:44.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.623+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/87085026 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6dd4004020 con 0x55675c8b3520 2024-09-19T09:55:44.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.623+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/87085026 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6dd4019070 con 0x55675c8b3520 2024-09-19T09:55:44.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.623+0000 7f6dee4a3740 10 client.16356 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:44.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.623+0000 7f6dee4a3740 1 -- 172.21.15.18:0/87085026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55675c8c1cc0 con 0x55675c8b3520 2024-09-19T09:55:44.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.625+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/87085026 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dd400ad30 con 0x55675c8b3520 2024-09-19T09:55:44.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.627+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/87085026 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6dd4027020 con 0x55675c8b3520 2024-09-19T09:55:44.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.628+0000 7f6dee4a3740 10 client.16356 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:44.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.628+0000 7f6dee4a3740 10 client.16356 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:55:44.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.628+0000 7f6dee4a3740 20 client.16356 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:44.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.628+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55675c8c3070 0x55675c8c5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.628+0000 7f6dee4a3740 4 client.16356 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:44.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.628+0000 7f6dee4a3740 1 -- 172.21.15.18:0/87085026 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55675c81b860 con 0x55675c8c3070 2024-09-19T09:55:44.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.636+0000 7f6de9e66640 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55675c8c3070 0x55675c8c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.653+0000 7f6dcd7fa640 10 client.16356 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:55:44.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.653+0000 7f6de9e66640 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55675c8c3070 0x55675c8c5460 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=23208db5cfed7e4b server_cookie=af6e1d968efb5224 in_seq=0 out_seq=0 2024-09-19T09:55:44.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:44 smithi018 ceph-mon[30956]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 927 MiB/s wr, 1.99k op/s 2024-09-19T09:55:44.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.654+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/87085026 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55675c81b860 con 0x55675c8c3070 2024-09-19T09:55:44.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.654+0000 7f6dcd7fa640 10 client.16356 handle_command_reply: tid=0 2024-09-19T09:55:44.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.655+0000 7f6dee4a3740 1 client.16356 shutdown 2024-09-19T09:55:44.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.656+0000 7f6dee4a3740 1 -- 172.21.15.18:0/87085026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 msgr2=0x55675c8b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:44.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.656+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8b0680 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4004b70 tx=0x7f6dd400af80 comp rx=0 tx=0).stop 2024-09-19T09:55:44.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.657+0000 7f6dee4a3740 1 -- 172.21.15.18:0/87085026 shutdown_connections 2024-09-19T09:55:44.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.657+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55675c8c3070 0x55675c8c5460 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.657+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8b0680 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.657+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 0x55675c8b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.657+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/87085026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 0x55675c8b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.657+0000 7f6dee4a3740 1 -- 172.21.15.18:0/87085026 >> 172.21.15.18:0/87085026 conn(0x55675c871310 msgr2=0x55675c8aaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:44.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.657+0000 7f6dcd7fa640 0 client.16356 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:55:44.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.657+0000 7f6dee4a3740 1 -- 172.21.15.18:0/87085026 shutdown_connections 2024-09-19T09:55:44.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.657+0000 7f6dee4a3740 1 -- 172.21.15.18:0/87085026 wait complete. 2024-09-19T09:55:44.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.657+0000 7f6dee4a3740 20 client.16356 trim_cache size 0 max 16384 2024-09-19T09:55:44.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.712+0000 7f6dee4a3740 1 Processor -- start 2024-09-19T09:55:44.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.712+0000 7f6dee4a3740 1 -- start start 2024-09-19T09:55:44.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.713+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a8780 0x55675c8bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.713+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 0x55675c8b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.714+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.714+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc160b20 con 0x55675c8b3520 2024-09-19T09:55:44.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.714+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc162660 con 0x55675c8a9cf0 2024-09-19T09:55:44.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.714+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc1611f0 con 0x55675c8a8780 2024-09-19T09:55:44.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.715+0000 7f6dea667640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.715+0000 7f6dea667640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8ab2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45992/0 (socket says 172.21.15.18:45992) 2024-09-19T09:55:44.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.715+0000 7f6dea667640 1 -- 172.21.15.18:0/657610297 learned_addr learned my addr 172.21.15.18:0/657610297 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:44.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.716+0000 7f6de9e66640 1 --2- 172.21.15.18:0/657610297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a8780 0x55675c8bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.717+0000 7f6de9665640 1 --2- 172.21.15.18:0/657610297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 0x55675c8b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.717+0000 7f6dea667640 1 -- 172.21.15.18:0/657610297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a8780 msgr2=0x55675c8bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.717+0000 7f6dea667640 1 --2- 172.21.15.18:0/657610297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a8780 0x55675c8bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.717+0000 7f6dea667640 1 -- 172.21.15.18:0/657610297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 msgr2=0x55675c8b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.717+0000 7f6dea667640 1 --2- 172.21.15.18:0/657610297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 0x55675c8b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.717+0000 7f6dea667640 1 -- 172.21.15.18:0/657610297 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675c8b09f0 con 0x55675c8b3520 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.719+0000 7f6dea667640 1 --2- 172.21.15.18:0/657610297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8ab2d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400a650 tx=0x7f6dd4004ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7335e399e19cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.719+0000 7f6dcf7fe640 1 -- 172.21.15.18:0/657610297 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4024030 con 0x55675c8b3520 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.719+0000 7f6dcf7fe640 1 -- 172.21.15.18:0/657610297 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dd4005e50 con 0x55675c8b3520 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.720+0000 7f6dcf7fe640 1 -- 172.21.15.18:0/657610297 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4003eb0 con 0x55675c8b3520 2024-09-19T09:55:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.721+0000 7f6dee4a3740 1 -- 172.21.15.18:0/657610297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 msgr2=0x55675c8ab2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:44.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.721+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/657610297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8ab2d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400a650 tx=0x7f6dd4004ba0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.721+0000 7f6dee4a3740 1 -- 172.21.15.18:0/657610297 shutdown_connections 2024-09-19T09:55:44.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.721+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/657610297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8ab2d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.721+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/657610297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a9cf0 0x55675c8b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.721+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/657610297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a8780 0x55675c8bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.721+0000 7f6dee4a3740 1 -- 172.21.15.18:0/657610297 >> 172.21.15.18:0/657610297 conn(0x55675c871310 msgr2=0x55675c8b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:44.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.726+0000 7f6dee4a3740 1 -- 172.21.15.18:0/657610297 shutdown_connections 2024-09-19T09:55:44.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.726+0000 7f6dee4a3740 1 -- 172.21.15.18:0/657610297 wait complete. 2024-09-19T09:55:44.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.727+0000 7f6dee4a3740 1 -- start start 2024-09-19T09:55:44.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.727+0000 7f6dee4a3740 1 Processor -- start 2024-09-19T09:55:44.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.728+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 0x55675c8ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.728+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 0x55675c8bb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.728+0000 7f6dee4a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.728+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc161f90 con 0x55675c8b3520 2024-09-19T09:55:44.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.728+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc1618c0 con 0x55675c8a8780 2024-09-19T09:55:44.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.728+0000 7f6dee4a3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc15ebb0 con 0x55675c8a9cf0 2024-09-19T09:55:44.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.728+0000 7f6dee4a3740 10 client.0 _ll_register_callbacks cb 0x7f6dd400d820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:44.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.731+0000 7f6de9e66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 0x55675c8ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.731+0000 7f6de9e66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 0x55675c8ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:57762/0 (socket says 172.21.15.18:57762) 2024-09-19T09:55:44.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.731+0000 7f6de9e66640 1 -- 172.21.15.18:0/3409884434 learned_addr learned my addr 172.21.15.18:0/3409884434 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:44.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.732+0000 7f6de9665640 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 0x55675c8bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.732+0000 7f6dea667640 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.733+0000 7f6de9e66640 1 -- 172.21.15.18:0/3409884434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 msgr2=0x55675c8bb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:44.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.733+0000 7f6de9e66640 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 0x55675c8bb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.733+0000 7f6de9e66640 1 -- 172.21.15.18:0/3409884434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 msgr2=0x55675c8bbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:44.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.733+0000 7f6de9e66640 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8bbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.733+0000 7f6de9e66640 1 -- 172.21.15.18:0/3409884434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675c8ac490 con 0x55675c8a8780 2024-09-19T09:55:44.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.734+0000 7f6de9e66640 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 0x55675c8ade10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc14cb60 tx=0x7f6de000d050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6a1b438c9fab020 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:44.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.734+0000 7f6dcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:55:44.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.734+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/3409884434 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de002c030 con 0x55675c8a8780 2024-09-19T09:55:44.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.734+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/3409884434 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6de0005020 con 0x55675c8a8780 2024-09-19T09:55:44.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.735+0000 7f6dee4a3740 1 -- 172.21.15.18:0/3409884434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dd4005e50 con 0x55675c8a8780 2024-09-19T09:55:44.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.738+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/3409884434 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6de0005220 con 0x55675c8a8780 2024-09-19T09:55:44.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.739+0000 7f6dee4a3740 10 client.25829 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:44.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.739+0000 7f6dee4a3740 1 -- 172.21.15.18:0/3409884434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55675c92ceb0 con 0x55675c8a8780 2024-09-19T09:55:44.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.741+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/3409884434 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dd4005e50 con 0x55675c8a8780 2024-09-19T09:55:44.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.742+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/3409884434 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6de00097a0 con 0x55675c8a8780 2024-09-19T09:55:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.742+0000 7f6dee4a3740 10 client.25829 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.742+0000 7f6dee4a3740 10 client.25829 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:55:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.742+0000 7f6dee4a3740 20 client.25829 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.742+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55675c92d630 0x55675c92fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.742+0000 7f6dee4a3740 4 client.25829 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:55:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.742+0000 7f6dee4a3740 1 -- 172.21.15.18:0/3409884434 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55675c815d70 con 0x55675c92d630 2024-09-19T09:55:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.745+0000 7f6de9665640 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55675c92d630 0x55675c92fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:44.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.753+0000 7f6dcd7fa640 10 client.25829 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:55:44.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.753+0000 7f6de9665640 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55675c92d630 0x55675c92fa50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=61ae45a1ea03719f server_cookie=4e3ab87ca9626054 in_seq=0 out_seq=0 2024-09-19T09:55:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.755+0000 7f6dcd7fa640 1 -- 172.21.15.18:0/3409884434 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55675c815d70 con 0x55675c92d630 2024-09-19T09:55:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.755+0000 7f6dcd7fa640 10 client.25829 handle_command_reply: tid=0 2024-09-19T09:55:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.755+0000 7f6dee4a3740 1 client.25829 shutdown 2024-09-19T09:55:44.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.755+0000 7f6dee4a3740 1 -- 172.21.15.18:0/3409884434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 msgr2=0x55675c8ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.755+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 0x55675c8ade10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc14cb60 tx=0x7f6de000d050 comp rx=0 tx=0).stop 2024-09-19T09:55:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.756+0000 7f6dee4a3740 1 -- 172.21.15.18:0/3409884434 shutdown_connections 2024-09-19T09:55:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.756+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55675c92d630 0x55675c92fa50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.756+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55675c8b3520 0x55675c8bbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.756+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55675c8a9cf0 0x55675c8bb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.756+0000 7f6dee4a3740 1 --2- 172.21.15.18:0/3409884434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675c8a8780 0x55675c8ade10 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc14cb60 tx=0x7f6de000d050 comp rx=0 tx=0).stop 2024-09-19T09:55:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.756+0000 7f6dee4a3740 1 -- 172.21.15.18:0/3409884434 >> 172.21.15.18:0/3409884434 conn(0x55675c871310 msgr2=0x55675c8af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.756+0000 7f6dcd7fa640 0 client.25829 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:55:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.756+0000 7f6dee4a3740 1 -- 172.21.15.18:0/3409884434 shutdown_connections 2024-09-19T09:55:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.756+0000 7f6dee4a3740 1 -- 172.21.15.18:0/3409884434 wait complete. 2024-09-19T09:55:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.756+0000 7f6dee4a3740 20 client.25829 trim_cache size 0 max 16384 2024-09-19T09:55:44.760 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:55:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.759+0000 7f6deae68640 1 -- 172.21.15.18:0/1415706329 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6dd00a33e0 msgr2=0x7f6dd00a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.759+0000 7f6deae68640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6dd00a33e0 0x7f6dd00a58a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6de0005d00 tx=0x7f6de0005c50 comp rx=0 tx=0).stop 2024-09-19T09:55:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.759+0000 7f6deae68640 1 -- 172.21.15.18:0/1415706329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ddc094cb0 msgr2=0x7f6ddc151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.760+0000 7f6deae68640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ddc094cb0 0x7f6ddc151da0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6de4065a40 tx=0x7f6de409df00 comp rx=0 tx=0).stop 2024-09-19T09:55:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.760+0000 7f6deae68640 1 -- 172.21.15.18:0/1415706329 shutdown_connections 2024-09-19T09:55:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.760+0000 7f6deae68640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6dd00a33e0 0x7f6dd00a58a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.760+0000 7f6deae68640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ddc098f80 0x7f6ddc14ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.760+0000 7f6deae68640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ddc094cb0 0x7f6ddc151da0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.760+0000 7f6deae68640 1 --2- 172.21.15.18:0/1415706329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ddc094300 0x7f6ddc151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.760+0000 7f6deae68640 1 -- 172.21.15.18:0/1415706329 >> 172.21.15.18:0/1415706329 conn(0x7f6ddc009960 msgr2=0x7f6ddc092340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.761+0000 7f6deae68640 1 -- 172.21.15.18:0/1415706329 shutdown_connections 2024-09-19T09:55:44.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:44.761+0000 7f6deae68640 1 -- 172.21.15.18:0/1415706329 wait complete. 2024-09-19T09:55:44.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:44 smithi049 ceph-mon[34858]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 927 MiB/s wr, 1.99k op/s 2024-09-19T09:55:44.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:44 smithi162 ceph-mon[35174]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 927 MiB/s wr, 1.99k op/s 2024-09-19T09:55:45.501 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:45 smithi018 ceph-mon[30956]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 873 MiB/s wr, 1.94k op/s 2024-09-19T09:55:45.756 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:55:45.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:45 smithi049 ceph-mon[34858]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 873 MiB/s wr, 1.94k op/s 2024-09-19T09:55:45.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:45 smithi162 ceph-mon[35174]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 873 MiB/s wr, 1.94k op/s 2024-09-19T09:55:46.785 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:47.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.635+0000 7fb44ac8c640 1 -- 172.21.15.18:0/1704818160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb444110190 msgr2=0x7fb44406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:47.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.635+0000 7fb44ac8c640 1 --2- 172.21.15.18:0/1704818160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb444110190 0x7fb44406e4f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb440009900 tx=0x7fb44002a440 comp rx=0 tx=0).stop 2024-09-19T09:55:47.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.640+0000 7fb44ac8c640 1 -- 172.21.15.18:0/1704818160 shutdown_connections 2024-09-19T09:55:47.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.640+0000 7fb44ac8c640 1 --2- 172.21.15.18:0/1704818160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44411b140 0x7fb44411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.640+0000 7fb44ac8c640 1 --2- 172.21.15.18:0/1704818160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb44406ea30 0x7fb44406ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.640+0000 7fb44ac8c640 1 --2- 172.21.15.18:0/1704818160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb444110190 0x7fb44406e4f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.640+0000 7fb44ac8c640 1 -- 172.21.15.18:0/1704818160 >> 172.21.15.18:0/1704818160 conn(0x7fb444073180 msgr2=0x7fb444073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:47.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.642+0000 7fb44ac8c640 1 -- 172.21.15.18:0/1704818160 shutdown_connections 2024-09-19T09:55:47.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.644+0000 7fb44ac8c640 1 -- 172.21.15.18:0/1704818160 wait complete. 2024-09-19T09:55:47.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.646+0000 7fb44ac8c640 1 Processor -- start 2024-09-19T09:55:47.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.647+0000 7fb44ac8c640 1 -- start start 2024-09-19T09:55:47.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.647+0000 7fb44ac8c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44406ea30 0x7fb4441197f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.647+0000 7fb44ac8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb444110190 0x7fb444112880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.648+0000 7fb44ac8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb44411b140 0x7fb444112dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.648+0000 7fb44ac8c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb444120c90 con 0x7fb444110190 2024-09-19T09:55:47.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.648+0000 7fb44ac8c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb444120b10 con 0x7fb44406ea30 2024-09-19T09:55:47.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.648+0000 7fb44ac8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb444120e10 con 0x7fb44411b140 2024-09-19T09:55:47.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.651+0000 7fb44a48b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb44411b140 0x7fb444112dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.655+0000 7fb44a48b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb44411b140 0x7fb444112dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51686/0 (socket says 172.21.15.18:51686) 2024-09-19T09:55:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.655+0000 7fb44a48b640 1 -- 172.21.15.18:0/3729457281 learned_addr learned my addr 172.21.15.18:0/3729457281 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:47.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.657+0000 7fb449c8a640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44406ea30 0x7fb4441197f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.657+0000 7fb449489640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb444110190 0x7fb444112880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.659+0000 7fb44a48b640 1 -- 172.21.15.18:0/3729457281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44406ea30 msgr2=0x7fb4441197f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:47.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.659+0000 7fb44a48b640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44406ea30 0x7fb4441197f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.659+0000 7fb44a48b640 1 -- 172.21.15.18:0/3729457281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb444110190 msgr2=0x7fb444112880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:47.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.659+0000 7fb44a48b640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb444110190 0x7fb444112880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.659+0000 7fb44a48b640 1 -- 172.21.15.18:0/3729457281 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb444113400 con 0x7fb44411b140 2024-09-19T09:55:47.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.663+0000 7fb44a48b640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb44411b140 0x7fb444112dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00b9e0 tx=0x7fb43c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:47.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.674+0000 7fb43affd640 1 -- 172.21.15.18:0/3729457281 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c019070 con 0x7fb44411b140 2024-09-19T09:55:47.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.674+0000 7fb43affd640 1 -- 172.21.15.18:0/3729457281 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb43c014440 con 0x7fb44411b140 2024-09-19T09:55:47.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.674+0000 7fb43affd640 1 -- 172.21.15.18:0/3729457281 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0125a0 con 0x7fb44411b140 2024-09-19T09:55:47.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.676+0000 7fb44ac8c640 1 -- 172.21.15.18:0/3729457281 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb444117320 con 0x7fb44411b140 2024-09-19T09:55:47.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.676+0000 7fb44ac8c640 1 -- 172.21.15.18:0/3729457281 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb444117810 con 0x7fb44411b140 2024-09-19T09:55:47.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.694+0000 7fb44e2c7740 1 Processor -- start 2024-09-19T09:55:47.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.694+0000 7fb44e2c7740 1 -- start start 2024-09-19T09:55:47.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.695+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300076cf0 0x558300075240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.695+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300075780 0x558300075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.695+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300080520 0x558300082910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.695+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5582fffdb2f0 con 0x558300076cf0 2024-09-19T09:55:47.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.695+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5582fff82cf0 con 0x558300075780 2024-09-19T09:55:47.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.695+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5582fffd72b0 con 0x558300080520 2024-09-19T09:55:47.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.695+0000 7fb43affd640 1 -- 172.21.15.18:0/3729457281 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb43c01c070 con 0x7fb44411b140 2024-09-19T09:55:47.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.697+0000 7fb43affd640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4300a3410 0x7fb4300a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.697+0000 7fb43affd640 1 -- 172.21.15.18:0/3729457281 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb43c0cedf0 con 0x7fb44411b140 2024-09-19T09:55:47.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.700+0000 7fb44a48b640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4300a3410 0x7fb4300a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.702+0000 7fb449c8a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300075780 0x558300075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.702+0000 7fb449c8a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300075780 0x558300075bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:45232/0 (socket says 172.21.15.18:45232) 2024-09-19T09:55:47.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.702+0000 7fb449c8a640 1 -- 172.21.15.18:0/572235546 learned_addr learned my addr 172.21.15.18:0/572235546 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:47.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.703+0000 7fb449489640 1 --2- 172.21.15.18:0/572235546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300076cf0 0x558300075240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.703+0000 7fb449489640 1 --2- 172.21.15.18:0/572235546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300080520 0x558300082910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.703+0000 7fb44a48b640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4300a3410 0x7fb4300a58d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb43c097840 tx=0x7fb43c097040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.706+0000 7fb449489640 1 -- 172.21.15.18:0/572235546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300080520 msgr2=0x558300082910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.706+0000 7fb449489640 1 --2- 172.21.15.18:0/572235546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300080520 0x558300082910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.706+0000 7fb449489640 1 -- 172.21.15.18:0/572235546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300075780 msgr2=0x558300075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.706+0000 7fb449489640 1 --2- 172.21.15.18:0/572235546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300075780 0x558300075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.706+0000 7fb449489640 1 -- 172.21.15.18:0/572235546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fff673a0 con 0x558300076cf0 2024-09-19T09:55:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.707+0000 7fb449489640 1 --2- 172.21.15.18:0/572235546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300076cf0 0x558300075240 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb444114040 tx=0x7fb43400b160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbcb716003ee624 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.708+0000 7fb42ffff640 1 -- 172.21.15.18:0/572235546 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43401c070 con 0x558300076cf0 2024-09-19T09:55:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.708+0000 7fb42ffff640 1 -- 172.21.15.18:0/572235546 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb434010040 con 0x558300076cf0 2024-09-19T09:55:47.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.709+0000 7fb44e2c7740 1 -- 172.21.15.18:0/572235546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300076cf0 msgr2=0x558300075240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:47.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.709+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/572235546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300076cf0 0x558300075240 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb444114040 tx=0x7fb43400b160 comp rx=0 tx=0).stop 2024-09-19T09:55:47.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.713+0000 7fb44e2c7740 1 -- 172.21.15.18:0/572235546 shutdown_connections 2024-09-19T09:55:47.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.713+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/572235546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300080520 0x558300082910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.713+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/572235546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300075780 0x558300075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.713+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/572235546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300076cf0 0x558300075240 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.713+0000 7fb44e2c7740 1 -- 172.21.15.18:0/572235546 >> 172.21.15.18:0/572235546 conn(0x55830003e310 msgr2=0x558300071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.714+0000 7fb44e2c7740 1 -- 172.21.15.18:0/572235546 shutdown_connections 2024-09-19T09:55:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.714+0000 7fb44e2c7740 1 -- 172.21.15.18:0/572235546 wait complete. 2024-09-19T09:55:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.715+0000 7fb44e2c7740 1 -- start start 2024-09-19T09:55:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.715+0000 7fb44e2c7740 1 Processor -- start 2024-09-19T09:55:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.716+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830007fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.716+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300076cf0 0x55830007d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.716+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300080520 0x55830007d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.716+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558300083270 con 0x558300080520 2024-09-19T09:55:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.716+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5582fff96060 con 0x558300076cf0 2024-09-19T09:55:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.716+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5583000833f0 con 0x558300075780 2024-09-19T09:55:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.716+0000 7fb44e2c7740 10 client.0 _ll_register_callbacks cb 0x5582ffce98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:47.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.718+0000 7fb449c8a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300076cf0 0x55830007d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.718+0000 7fb449c8a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300076cf0 0x55830007d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:45246/0 (socket says 172.21.15.18:45246) 2024-09-19T09:55:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.718+0000 7fb449c8a640 1 -- 172.21.15.18:0/1182678381 learned_addr learned my addr 172.21.15.18:0/1182678381 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.718+0000 7fb449489640 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830007fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.718+0000 7fb449489640 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300080520 0x55830007d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.719+0000 7fb449c8a640 1 -- 172.21.15.18:0/1182678381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 msgr2=0x55830007fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.719+0000 7fb449c8a640 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830007fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.719+0000 7fb449c8a640 1 -- 172.21.15.18:0/1182678381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300080520 msgr2=0x55830007d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.719+0000 7fb449c8a640 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300080520 0x55830007d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.719+0000 7fb449c8a640 1 -- 172.21.15.18:0/1182678381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582ffd4c3c0 con 0x558300076cf0 2024-09-19T09:55:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.719+0000 7fb449489640 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830007fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:55:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.720+0000 7fb449c8a640 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300076cf0 0x55830007d070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb44002a960 tx=0x7fb4400042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=415396bca84d5198 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.720+0000 7fb42d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:55:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.722+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1182678381 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb440035040 con 0x558300076cf0 2024-09-19T09:55:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.723+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1182678381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb434010040 con 0x558300076cf0 2024-09-19T09:55:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.723+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1182678381 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb4400037f0 con 0x558300076cf0 2024-09-19T09:55:47.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.725+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1182678381 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb440005d10 con 0x558300076cf0 2024-09-19T09:55:47.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.726+0000 7fb44e2c7740 10 client.25838 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:47.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.726+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1182678381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55830008ecb0 con 0x558300076cf0 2024-09-19T09:55:47.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.727+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1182678381 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb44003c440 con 0x558300076cf0 2024-09-19T09:55:47.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.727+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1182678381 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb440045430 con 0x558300076cf0 2024-09-19T09:55:47.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.727+0000 7fb44e2c7740 10 client.25838 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:47.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.727+0000 7fb44e2c7740 10 client.25838 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:55:47.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.728+0000 7fb44e2c7740 20 client.25838 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:47.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.728+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x558300090610 0x558300092a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.728+0000 7fb44e2c7740 4 client.25838 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:47.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.728+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1182678381 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb434010040 con 0x558300090610 2024-09-19T09:55:47.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.729+0000 7fb449489640 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x558300090610 0x558300092a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.732+0000 7fb42d7fa640 10 client.25838 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:55:47.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.732+0000 7fb449489640 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x558300090610 0x558300092a30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c204c55486746b9 server_cookie=ab019ad940b68a53 in_seq=0 out_seq=0 2024-09-19T09:55:47.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.733+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1182678381 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb434010040 con 0x558300090610 2024-09-19T09:55:47.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.733+0000 7fb42d7fa640 10 client.25838 handle_command_reply: tid=0 2024-09-19T09:55:47.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.734+0000 7fb44e2c7740 1 client.25838 shutdown 2024-09-19T09:55:47.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.739+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1182678381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300076cf0 msgr2=0x55830007d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:47.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.739+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300076cf0 0x55830007d070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb44002a960 tx=0x7fb4400042f0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.739+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1182678381 shutdown_connections 2024-09-19T09:55:47.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.739+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x558300090610 0x558300092a30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.739+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300080520 0x55830007d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.739+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300076cf0 0x55830007d070 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.739+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1182678381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830007fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.739+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1182678381 >> 172.21.15.18:0/1182678381 conn(0x55830003e310 msgr2=0x558300077ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:47.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.740+0000 7fb42d7fa640 0 client.25838 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:55:47.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.740+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1182678381 shutdown_connections 2024-09-19T09:55:47.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.740+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1182678381 wait complete. 2024-09-19T09:55:47.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.740+0000 7fb44e2c7740 20 client.25838 trim_cache size 0 max 16384 2024-09-19T09:55:47.782 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:47 smithi018 ceph-mon[30956]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 881 MiB/s wr, 1.92k op/s 2024-09-19T09:55:47.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.778+0000 7fb44e2c7740 1 Processor -- start 2024-09-19T09:55:47.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.779+0000 7fb44e2c7740 1 -- start start 2024-09-19T09:55:47.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.779+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830008c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.779+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300076cf0 0x55830007b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.779+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300080520 0x5583000782d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.779+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb42800e4f0 con 0x558300076cf0 2024-09-19T09:55:47.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.779+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb428010030 con 0x558300080520 2024-09-19T09:55:47.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.779+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb42800ebc0 con 0x558300075780 2024-09-19T09:55:47.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.781+0000 7fb449489640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830008c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.781+0000 7fb449489640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830008c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51720/0 (socket says 172.21.15.18:51720) 2024-09-19T09:55:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.781+0000 7fb449489640 1 -- 172.21.15.18:0/2900345586 learned_addr learned my addr 172.21.15.18:0/2900345586 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.782+0000 7fb449489640 1 --2- 172.21.15.18:0/2900345586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300080520 0x5583000782d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.782+0000 7fb449489640 1 -- 172.21.15.18:0/2900345586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300080520 msgr2=0x5583000782d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.782+0000 7fb449489640 1 --2- 172.21.15.18:0/2900345586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300080520 0x5583000782d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.782+0000 7fb449489640 1 -- 172.21.15.18:0/2900345586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300076cf0 msgr2=0x55830007b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.782+0000 7fb449489640 1 --2- 172.21.15.18:0/2900345586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300076cf0 0x55830007b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.782+0000 7fb449489640 1 -- 172.21.15.18:0/2900345586 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830007c020 con 0x558300075780 2024-09-19T09:55:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.782+0000 7fb449489640 1 --2- 172.21.15.18:0/2900345586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830008c5f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb43400bbf0 tx=0x7fb434014380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6df8025fb2e94726 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.787+0000 7fb42f7fe640 1 -- 172.21.15.18:0/2900345586 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434032070 con 0x558300075780 2024-09-19T09:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.787+0000 7fb42f7fe640 1 -- 172.21.15.18:0/2900345586 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb43401d040 con 0x558300075780 2024-09-19T09:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.787+0000 7fb42f7fe640 1 -- 172.21.15.18:0/2900345586 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43402a070 con 0x558300075780 2024-09-19T09:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.788+0000 7fb44e2c7740 1 -- 172.21.15.18:0/2900345586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 msgr2=0x55830008c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.788+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/2900345586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830008c5f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb43400bbf0 tx=0x7fb434014380 comp rx=0 tx=0).stop 2024-09-19T09:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.789+0000 7fb44e2c7740 1 -- 172.21.15.18:0/2900345586 shutdown_connections 2024-09-19T09:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.789+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/2900345586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300080520 0x5583000782d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.789+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/2900345586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300076cf0 0x55830007b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.789+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/2900345586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300075780 0x55830008c5f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.789+0000 7fb44e2c7740 1 -- 172.21.15.18:0/2900345586 >> 172.21.15.18:0/2900345586 conn(0x55830003e310 msgr2=0x558300070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:47.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.789+0000 7fb44e2c7740 1 -- 172.21.15.18:0/2900345586 shutdown_connections 2024-09-19T09:55:47.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.789+0000 7fb44e2c7740 1 -- 172.21.15.18:0/2900345586 wait complete. 2024-09-19T09:55:47.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.790+0000 7fb44e2c7740 1 -- start start 2024-09-19T09:55:47.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.790+0000 7fb44e2c7740 1 Processor -- start 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.791+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300075780 0x558300088760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.791+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300076cf0 0x558300088ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.791+0000 7fb44e2c7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300080520 0x5583000796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.791+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb42800f960 con 0x558300075780 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.791+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb42800f290 con 0x558300080520 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.791+0000 7fb44e2c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb42800c4d0 con 0x558300076cf0 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.791+0000 7fb44e2c7740 10 client.0 _ll_register_callbacks cb 0x7fb440009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.792+0000 7fb449c8a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300076cf0 0x558300088ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.792+0000 7fb449c8a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300076cf0 0x558300088ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51724/0 (socket says 172.21.15.18:51724) 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.792+0000 7fb449c8a640 1 -- 172.21.15.18:0/1925836061 learned_addr learned my addr 172.21.15.18:0/1925836061 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.792+0000 7fb449489640 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300080520 0x5583000796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.792+0000 7fb449c8a640 1 -- 172.21.15.18:0/1925836061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300080520 msgr2=0x5583000796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.792+0000 7fb449c8a640 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300080520 0x5583000796a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.793+0000 7fb449c8a640 1 -- 172.21.15.18:0/1925836061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300075780 msgr2=0x558300088760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.793+0000 7fb449c8a640 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300075780 0x558300088760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.793+0000 7fb449c8a640 1 -- 172.21.15.18:0/1925836061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558300080130 con 0x558300076cf0 2024-09-19T09:55:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.794+0000 7fb449c8a640 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300076cf0 0x558300088ca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb440045880 tx=0x7fb440031b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2470c6603e1d206d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:47.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.794+0000 7fb42d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:55:47.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.795+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1925836061 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44005d060 con 0x558300076cf0 2024-09-19T09:55:47.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.795+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1925836061 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb44002ac40 con 0x558300076cf0 2024-09-19T09:55:47.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.795+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1925836061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb43401d040 con 0x558300076cf0 2024-09-19T09:55:47.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.795+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1925836061 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb440045e60 con 0x558300076cf0 2024-09-19T09:55:47.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.796+0000 7fb44e2c7740 10 client.25804 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:47.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.796+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1925836061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55830011ca00 con 0x558300076cf0 2024-09-19T09:55:47.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.796+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1925836061 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb43401d040 con 0x558300076cf0 2024-09-19T09:55:47.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.796+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1925836061 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb440003ad0 con 0x558300076cf0 2024-09-19T09:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.798+0000 7fb44e2c7740 10 client.25804 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.798+0000 7fb44e2c7740 10 client.25804 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.798+0000 7fb44e2c7740 20 client.25804 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.798+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55830011d0e0 0x55830011f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.798+0000 7fb44e2c7740 4 client.25804 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.798+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1925836061 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5582fffe8860 con 0x55830011d0e0 2024-09-19T09:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.801+0000 7fb449489640 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55830011d0e0 0x55830011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:47.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.803+0000 7fb449489640 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55830011d0e0 0x55830011f500 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a2974a886afb7c2 server_cookie=2fece54613cdccb1 in_seq=0 out_seq=0 2024-09-19T09:55:47.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.803+0000 7fb42d7fa640 10 client.25804 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:55:47.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.804+0000 7fb42d7fa640 1 -- 172.21.15.18:0/1925836061 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5582fffe8860 con 0x55830011d0e0 2024-09-19T09:55:47.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.804+0000 7fb42d7fa640 10 client.25804 handle_command_reply: tid=0 2024-09-19T09:55:47.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.804+0000 7fb44e2c7740 1 client.25804 shutdown 2024-09-19T09:55:47.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.804+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1925836061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300076cf0 msgr2=0x558300088ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.804+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300076cf0 0x558300088ca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb440045880 tx=0x7fb440031b80 comp rx=0 tx=0).stop 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.805+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1925836061 shutdown_connections 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.805+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55830011d0e0 0x55830011f500 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.805+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558300080520 0x5583000796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.805+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558300076cf0 0x558300088ca0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.805+0000 7fb44e2c7740 1 --2- 172.21.15.18:0/1925836061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558300075780 0x558300088760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.805+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1925836061 >> 172.21.15.18:0/1925836061 conn(0x55830003e310 msgr2=0x55830007f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.805+0000 7fb42d7fa640 0 client.25804 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.805+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1925836061 shutdown_connections 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.806+0000 7fb44e2c7740 1 -- 172.21.15.18:0/1925836061 wait complete. 2024-09-19T09:55:47.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.806+0000 7fb44e2c7740 20 client.25804 trim_cache size 0 max 16384 2024-09-19T09:55:47.814 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:55:47.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.814+0000 7fb44ac8c640 1 -- 172.21.15.18:0/3729457281 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4300a3410 msgr2=0x7fb4300a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:47.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.814+0000 7fb44ac8c640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4300a3410 0x7fb4300a58d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb43c097840 tx=0x7fb43c097040 comp rx=0 tx=0).stop 2024-09-19T09:55:47.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.814+0000 7fb44ac8c640 1 -- 172.21.15.18:0/3729457281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb44411b140 msgr2=0x7fb444112dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:47.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.814+0000 7fb44ac8c640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb44411b140 0x7fb444112dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00b9e0 tx=0x7fb43c00bea0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.815+0000 7fb44ac8c640 1 -- 172.21.15.18:0/3729457281 shutdown_connections 2024-09-19T09:55:47.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.815+0000 7fb44ac8c640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb4300a3410 0x7fb4300a58d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.815+0000 7fb44ac8c640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb44411b140 0x7fb444112dc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.816+0000 7fb44ac8c640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb444110190 0x7fb444112880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.816+0000 7fb44ac8c640 1 --2- 172.21.15.18:0/3729457281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44406ea30 0x7fb4441197f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:47.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.816+0000 7fb44ac8c640 1 -- 172.21.15.18:0/3729457281 >> 172.21.15.18:0/3729457281 conn(0x7fb444073180 msgr2=0x7fb44406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:47.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.816+0000 7fb44ac8c640 1 -- 172.21.15.18:0/3729457281 shutdown_connections 2024-09-19T09:55:47.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:47.816+0000 7fb44ac8c640 1 -- 172.21.15.18:0/3729457281 wait complete. 2024-09-19T09:55:47.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:47 smithi049 ceph-mon[34858]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 881 MiB/s wr, 1.92k op/s 2024-09-19T09:55:47.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:47 smithi162 ceph-mon[35174]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 881 MiB/s wr, 1.92k op/s 2024-09-19T09:55:48.833 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:55:49.710 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T09:55:49.711 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:55:49.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:49 smithi049 ceph-mon[34858]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 771 MiB/s wr, 1.75k op/s 2024-09-19T09:55:49.902 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:49 smithi018 ceph-mon[30956]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 771 MiB/s wr, 1.75k op/s 2024-09-19T09:55:49.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:49 smithi162 ceph-mon[35174]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 771 MiB/s wr, 1.75k op/s 2024-09-19T09:55:50.058 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.056+0000 7feac5373640 1 -- 172.21.15.18:0/1474929161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac0109450 msgr2=0x7feac0110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.056+0000 7feac5373640 1 --2- 172.21.15.18:0/1474929161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac0109450 0x7feac0110250 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7feab0009900 tx=0x7feab002a420 comp rx=0 tx=0).stop 2024-09-19T09:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.063+0000 7feac5373640 1 -- 172.21.15.18:0/1474929161 shutdown_connections 2024-09-19T09:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.063+0000 7feac5373640 1 --2- 172.21.15.18:0/1474929161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac011b140 0x7feac011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.063+0000 7feac5373640 1 --2- 172.21.15.18:0/1474929161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac0109830 0x7feac0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.063+0000 7feac5373640 1 --2- 172.21.15.18:0/1474929161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac0109450 0x7feac0110250 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.063+0000 7feac5373640 1 -- 172.21.15.18:0/1474929161 >> 172.21.15.18:0/1474929161 conn(0x7feac006e140 msgr2=0x7feac006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:51.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.064+0000 7feac5373640 1 -- 172.21.15.18:0/1474929161 shutdown_connections 2024-09-19T09:55:51.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.064+0000 7feac5373640 1 -- 172.21.15.18:0/1474929161 wait complete. 2024-09-19T09:55:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.065+0000 7feac5373640 1 Processor -- start 2024-09-19T09:55:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.065+0000 7feac5373640 1 -- start start 2024-09-19T09:55:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.066+0000 7feac5373640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0109450 0x7feac01185e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.066+0000 7feac5373640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac0109830 0x7feac0118b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.066+0000 7feac5373640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac011b140 0x7feac0111790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.066+0000 7feac5373640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feac0120df0 con 0x7feac0109830 2024-09-19T09:55:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.066+0000 7feac5373640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7feac0120c70 con 0x7feac011b140 2024-09-19T09:55:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.066+0000 7feac5373640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feac0120f70 con 0x7feac0109450 2024-09-19T09:55:51.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.068+0000 7feabe7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac0109830 0x7feac0118b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.068+0000 7feabe7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac0109830 0x7feac0118b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56980/0 (socket says 172.21.15.18:56980) 2024-09-19T09:55:51.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.068+0000 7feabe7fc640 1 -- 172.21.15.18:0/764937585 learned_addr learned my addr 172.21.15.18:0/764937585 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.070+0000 7feabf7fe640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac011b140 0x7feac0111790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.070+0000 7feabeffd640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0109450 0x7feac01185e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.072+0000 7feabe7fc640 1 -- 172.21.15.18:0/764937585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0109450 msgr2=0x7feac01185e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.072+0000 7feabe7fc640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0109450 0x7feac01185e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.072+0000 7feabe7fc640 1 -- 172.21.15.18:0/764937585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac011b140 msgr2=0x7feac0111790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.072+0000 7feabe7fc640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac011b140 0x7feac0111790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.072+0000 7feabe7fc640 1 -- 172.21.15.18:0/764937585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac0112050 con 0x7feac0109830 2024-09-19T09:55:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.074+0000 7feabe7fc640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac0109830 0x7feac0118b20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7feab800ebc0 tx=0x7feab800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.075+0000 7feaa7fff640 1 -- 172.21.15.18:0/764937585 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8010630 con 0x7feac0109830 2024-09-19T09:55:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.075+0000 7feac5373640 1 -- 172.21.15.18:0/764937585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac0112340 con 0x7feac0109830 2024-09-19T09:55:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.075+0000 7feac5373640 1 -- 172.21.15.18:0/764937585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac0116390 con 0x7feac0109830 2024-09-19T09:55:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.075+0000 7feaa7fff640 1 -- 172.21.15.18:0/764937585 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feab8010cb0 con 0x7feac0109830 2024-09-19T09:55:51.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.077+0000 7feaa7fff640 1 -- 172.21.15.18:0/764937585 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8018bd0 con 0x7feac0109830 2024-09-19T09:55:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.091+0000 7feac774c740 1 Processor -- start 2024-09-19T09:55:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.092+0000 7feaa7fff640 1 -- 172.21.15.18:0/764937585 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7feab80107d0 con 0x7feac0109830 2024-09-19T09:55:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.095+0000 7feac774c740 1 -- start start 2024-09-19T09:55:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.095+0000 7feac774c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca2b40 0x559d82ca1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.097+0000 7feac774c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca15d0 0x559d82ca1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.097+0000 7feabf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca2b40 0x559d82ca1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.097+0000 7feabf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca2b40 0x559d82ca1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51762/0 (socket says 172.21.15.18:51762) 2024-09-19T09:55:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.097+0000 7feac774c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82cac370 0x559d82cae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.097+0000 7feabf7fe640 1 -- 172.21.15.18:0/1273300806 learned_addr learned my addr 172.21.15.18:0/1273300806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.098+0000 7feac774c740 1 -- 172.21.15.18:0/1273300806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d82c072f0 con 0x559d82cac370 2024-09-19T09:55:51.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.098+0000 7feac774c740 1 -- 172.21.15.18:0/1273300806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559d82baecf0 con 0x559d82ca15d0 2024-09-19T09:55:51.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.098+0000 7feac774c740 1 -- 172.21.15.18:0/1273300806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d82c032b0 con 0x559d82ca2b40 2024-09-19T09:55:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.099+0000 7feabe7fc640 1 --2- 172.21.15.18:0/1273300806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82cac370 0x559d82cae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.100+0000 7feaa7fff640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feaa80a3270 0x7feaa80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.100+0000 7feabf7fe640 1 -- 172.21.15.18:0/1273300806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca15d0 msgr2=0x559d82ca1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.100+0000 7feabf7fe640 1 --2- 172.21.15.18:0/1273300806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca15d0 0x559d82ca1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.101+0000 7feabf7fe640 1 -- 172.21.15.18:0/1273300806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82cac370 msgr2=0x559d82cae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.101+0000 7feabf7fe640 1 --2- 172.21.15.18:0/1273300806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82cac370 0x559d82cae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.101+0000 7feabf7fe640 1 -- 172.21.15.18:0/1273300806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d82b933a0 con 0x559d82ca2b40 2024-09-19T09:55:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.102+0000 7feaa7fff640 1 -- 172.21.15.18:0/764937585 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7feab80cff10 con 0x7feac0109830 2024-09-19T09:55:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.102+0000 7feabf7fe640 1 --2- 172.21.15.18:0/1273300806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca2b40 0x559d82ca1090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feab4009d10 tx=0x7feab4013830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3e3bb7ac8c78c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:51.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.105+0000 7feaa57fa640 1 -- 172.21.15.18:0/1273300806 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4020070 con 0x559d82ca2b40 2024-09-19T09:55:51.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.106+0000 7feaa57fa640 1 -- 172.21.15.18:0/1273300806 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feab401b8f0 con 0x559d82ca2b40 2024-09-19T09:55:51.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.106+0000 7feaa57fa640 1 -- 172.21.15.18:0/1273300806 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4020070 con 0x559d82ca2b40 2024-09-19T09:55:51.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.106+0000 7feabf7fe640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feaa80a3270 0x7feaa80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.108+0000 7feac774c740 1 -- 172.21.15.18:0/1273300806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca2b40 msgr2=0x559d82ca1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.109+0000 7feac774c740 1 --2- 172.21.15.18:0/1273300806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca2b40 0x559d82ca1090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feab4009d10 tx=0x7feab4013830 comp rx=0 tx=0).stop 2024-09-19T09:55:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.111+0000 7feac774c740 1 -- 172.21.15.18:0/1273300806 shutdown_connections 2024-09-19T09:55:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.111+0000 7feac774c740 1 --2- 172.21.15.18:0/1273300806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82cac370 0x559d82cae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.111+0000 7feac774c740 1 --2- 172.21.15.18:0/1273300806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca15d0 0x559d82ca1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.111+0000 7feac774c740 1 --2- 172.21.15.18:0/1273300806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca2b40 0x559d82ca1090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.111+0000 7feac774c740 1 -- 172.21.15.18:0/1273300806 >> 172.21.15.18:0/1273300806 conn(0x559d82c6a310 msgr2=0x559d82c9dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.112+0000 7feac774c740 1 -- 172.21.15.18:0/1273300806 shutdown_connections 2024-09-19T09:55:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.113+0000 7feabf7fe640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feaa80a3270 0x7feaa80a5730 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feab4009d10 tx=0x7feab4013830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.113+0000 7feac774c740 1 -- 172.21.15.18:0/1273300806 wait complete. 2024-09-19T09:55:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.114+0000 7feac774c740 1 -- start start 2024-09-19T09:55:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.115+0000 7feac774c740 1 Processor -- start 2024-09-19T09:55:51.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.116+0000 7feac774c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca15d0 0x559d82cabca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.116+0000 7feac774c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca2b40 0x559d82ca8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.116+0000 7feac774c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 0x559d82ca9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.116+0000 7feac774c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559d82caf070 con 0x559d82ca15d0 2024-09-19T09:55:51.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.116+0000 7feac774c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559d82bc2060 con 0x559d82ca2b40 2024-09-19T09:55:51.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.117+0000 7feac774c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d82caf1f0 con 0x559d82cac370 2024-09-19T09:55:51.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.117+0000 7feabe7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca2b40 0x559d82ca8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.117+0000 7feabe7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca2b40 0x559d82ca8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:45314/0 (socket says 172.21.15.18:45314) 2024-09-19T09:55:51.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.117+0000 7feabe7fc640 1 -- 172.21.15.18:0/456924987 learned_addr learned my addr 172.21.15.18:0/456924987 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:51.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.117+0000 7feabf7fe640 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 0x559d82ca9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.118+0000 7feac774c740 10 client.0 _ll_register_callbacks cb 0x559d829158c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:51.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.118+0000 7feabeffd640 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca15d0 0x559d82cabca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.119+0000 7feabe7fc640 1 -- 172.21.15.18:0/456924987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 msgr2=0x559d82ca9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.119+0000 7feabe7fc640 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 0x559d82ca9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.119+0000 7feabe7fc640 1 -- 172.21.15.18:0/456924987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca15d0 msgr2=0x559d82cabca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.119+0000 7feabe7fc640 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca15d0 0x559d82cabca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.119+0000 7feabe7fc640 1 -- 172.21.15.18:0/456924987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d829783c0 con 0x559d82ca2b40 2024-09-19T09:55:51.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.123+0000 7feaa2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:55:51.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.123+0000 7feabe7fc640 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca2b40 0x559d82ca8f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feab809c490 tx=0x7feab800ef80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15d106b64518b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:51.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.126+0000 7feaa2ff5640 1 -- 172.21.15.18:0/456924987 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8010e60 con 0x559d82ca2b40 2024-09-19T09:55:51.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.126+0000 7feaa2ff5640 1 -- 172.21.15.18:0/456924987 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7feab809b950 con 0x559d82ca2b40 2024-09-19T09:55:51.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.127+0000 7feac774c740 1 -- 172.21.15.18:0/456924987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feab401b8f0 con 0x559d82ca2b40 2024-09-19T09:55:51.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.131+0000 7feaa2ff5640 1 -- 172.21.15.18:0/456924987 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feab8010e60 con 0x559d82ca2b40 2024-09-19T09:55:51.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.134+0000 7feac774c740 10 client.25853 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:51.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.134+0000 7feac774c740 1 -- 172.21.15.18:0/456924987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d82cbaaf0 con 0x559d82ca2b40 2024-09-19T09:55:51.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.137+0000 7feaa2ff5640 1 -- 172.21.15.18:0/456924987 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feab401b8f0 con 0x559d82ca2b40 2024-09-19T09:55:51.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.138+0000 7feaa2ff5640 1 -- 172.21.15.18:0/456924987 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feab80b51f0 con 0x559d82ca2b40 2024-09-19T09:55:51.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.138+0000 7feac774c740 10 client.25853 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:51.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.138+0000 7feac774c740 10 client.25853 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:55:51.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.138+0000 7feac774c740 20 client.25853 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:51.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.138+0000 7feac774c740 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559d82cbbe90 0x559d82cbe280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.138+0000 7feac774c740 4 client.25853 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:51.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.138+0000 7feac774c740 1 -- 172.21.15.18:0/456924987 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d82c14860 con 0x559d82cbbe90 2024-09-19T09:55:51.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.145+0000 7feabeffd640 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559d82cbbe90 0x559d82cbe280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.153+0000 7feabeffd640 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559d82cbbe90 0x559d82cbe280 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=defc5b5817b4264d server_cookie=7a9ffb244fc40c14 in_seq=0 out_seq=0 2024-09-19T09:55:51.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.153+0000 7feaa2ff5640 10 client.25853 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:55:51.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.155+0000 7feaa2ff5640 1 -- 172.21.15.18:0/456924987 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d82c14860 con 0x559d82cbbe90 2024-09-19T09:55:51.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.155+0000 7feaa2ff5640 10 client.25853 handle_command_reply: tid=0 2024-09-19T09:55:51.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.156+0000 7feac774c740 1 client.25853 shutdown 2024-09-19T09:55:51.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.156+0000 7feac774c740 1 -- 172.21.15.18:0/456924987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca2b40 msgr2=0x559d82ca8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.156+0000 7feac774c740 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca2b40 0x559d82ca8f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feab809c490 tx=0x7feab800ef80 comp rx=0 tx=0).stop 2024-09-19T09:55:51.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.156+0000 7feac774c740 1 -- 172.21.15.18:0/456924987 shutdown_connections 2024-09-19T09:55:51.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.156+0000 7feac774c740 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559d82cbbe90 0x559d82cbe280 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.157+0000 7feaa2ff5640 0 client.25853 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:55:51.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.157+0000 7feac774c740 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 0x559d82ca9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.157+0000 7feac774c740 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca2b40 0x559d82ca8f50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.157+0000 7feac774c740 1 --2- 172.21.15.18:0/456924987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca15d0 0x559d82cabca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.157+0000 7feac774c740 1 -- 172.21.15.18:0/456924987 >> 172.21.15.18:0/456924987 conn(0x559d82c6a310 msgr2=0x559d82ca3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:51.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.158+0000 7feac774c740 1 -- 172.21.15.18:0/456924987 shutdown_connections 2024-09-19T09:55:51.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.158+0000 7feac774c740 1 -- 172.21.15.18:0/456924987 wait complete. 2024-09-19T09:55:51.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.158+0000 7feac774c740 20 client.25853 trim_cache size 0 max 16384 2024-09-19T09:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.208+0000 7feac774c740 1 Processor -- start 2024-09-19T09:55:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.208+0000 7feac774c740 1 -- start start 2024-09-19T09:55:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.209+0000 7feac774c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca15d0 0x559d82c9de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.209+0000 7feac774c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 0x559d82ca61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.210+0000 7feac774c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82cac370 0x559d82ca6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.210+0000 7feac774c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feaac00e5e0 con 0x559d82ca2b40 2024-09-19T09:55:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.210+0000 7feac774c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7feaac010120 con 0x559d82cac370 2024-09-19T09:55:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.210+0000 7feac774c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feaac00ecb0 con 0x559d82ca15d0 2024-09-19T09:55:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.211+0000 7feabeffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca15d0 0x559d82c9de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.211+0000 7feabe7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 0x559d82ca61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.211+0000 7feabe7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 0x559d82ca61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57002/0 (socket says 172.21.15.18:57002) 2024-09-19T09:55:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.211+0000 7feabe7fc640 1 -- 172.21.15.18:0/2669471993 learned_addr learned my addr 172.21.15.18:0/2669471993 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:51.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.213+0000 7feabe7fc640 1 -- 172.21.15.18:0/2669471993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca15d0 msgr2=0x559d82c9de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.213+0000 7feabe7fc640 1 --2- 172.21.15.18:0/2669471993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca15d0 0x559d82c9de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.213+0000 7feabe7fc640 1 -- 172.21.15.18:0/2669471993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82cac370 msgr2=0x559d82ca6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.213+0000 7feabe7fc640 1 --2- 172.21.15.18:0/2669471993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82cac370 0x559d82ca6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.213+0000 7feabe7fc640 1 -- 172.21.15.18:0/2669471993 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d82ca4120 con 0x559d82ca2b40 2024-09-19T09:55:51.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.216+0000 7feabe7fc640 1 --2- 172.21.15.18:0/2669471993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 0x559d82ca61d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feab809a7b0 tx=0x7feab8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9b381b1c978d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:51.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.219+0000 7feaa4ff9640 1 -- 172.21.15.18:0/2669471993 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8010e60 con 0x559d82ca2b40 2024-09-19T09:55:51.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.219+0000 7feaa4ff9640 1 -- 172.21.15.18:0/2669471993 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feab807d070 con 0x559d82ca2b40 2024-09-19T09:55:51.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.219+0000 7feaa4ff9640 1 -- 172.21.15.18:0/2669471993 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8018420 con 0x559d82ca2b40 2024-09-19T09:55:51.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.220+0000 7feac774c740 1 -- 172.21.15.18:0/2669471993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 msgr2=0x559d82ca61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.221+0000 7feac774c740 1 --2- 172.21.15.18:0/2669471993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 0x559d82ca61d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feab809a7b0 tx=0x7feab8000f40 comp rx=0 tx=0).stop 2024-09-19T09:55:51.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.224+0000 7feac774c740 1 -- 172.21.15.18:0/2669471993 shutdown_connections 2024-09-19T09:55:51.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.224+0000 7feac774c740 1 --2- 172.21.15.18:0/2669471993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82cac370 0x559d82ca6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.224+0000 7feac774c740 1 --2- 172.21.15.18:0/2669471993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 0x559d82ca61d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.224+0000 7feac774c740 1 --2- 172.21.15.18:0/2669471993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82ca15d0 0x559d82c9de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.224+0000 7feac774c740 1 -- 172.21.15.18:0/2669471993 >> 172.21.15.18:0/2669471993 conn(0x559d82c6a310 msgr2=0x559d82c9d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:51.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.225+0000 7feac774c740 1 -- 172.21.15.18:0/2669471993 shutdown_connections 2024-09-19T09:55:51.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.225+0000 7feac774c740 1 -- 172.21.15.18:0/2669471993 wait complete. 2024-09-19T09:55:51.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.226+0000 7feac774c740 1 -- start start 2024-09-19T09:55:51.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.226+0000 7feac774c740 1 Processor -- start 2024-09-19T09:55:51.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.227+0000 7feac774c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca15d0 0x559d82cc42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.227+0000 7feac774c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 0x559d82cc1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.227+0000 7feac774c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 0x559d82cc1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.227+0000 7feac774c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feaac00fa50 con 0x559d82ca2b40 2024-09-19T09:55:51.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.228+0000 7feac774c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7feaac00f380 con 0x559d82ca15d0 2024-09-19T09:55:51.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.228+0000 7feac774c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feaac00c560 con 0x559d82cac370 2024-09-19T09:55:51.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.228+0000 7feac774c740 10 client.0 _ll_register_callbacks cb 0x7feab800eb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:51.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.229+0000 7feabf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 0x559d82cc1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.229+0000 7feabf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 0x559d82cc1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51784/0 (socket says 172.21.15.18:51784) 2024-09-19T09:55:51.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.229+0000 7feabf7fe640 1 -- 172.21.15.18:0/583465579 learned_addr learned my addr 172.21.15.18:0/583465579 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:51.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.229+0000 7feabeffd640 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca15d0 0x559d82cc42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.229+0000 7feabe7fc640 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 0x559d82cc1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.231+0000 7feabf7fe640 1 -- 172.21.15.18:0/583465579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca15d0 msgr2=0x559d82cc42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.231+0000 7feabf7fe640 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca15d0 0x559d82cc42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.231+0000 7feabf7fe640 1 -- 172.21.15.18:0/583465579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 msgr2=0x559d82cc1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.231+0000 7feabf7fe640 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 0x559d82cc1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.231+0000 7feabf7fe640 1 -- 172.21.15.18:0/583465579 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d82cc2390 con 0x559d82cac370 2024-09-19T09:55:51.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.236+0000 7feabf7fe640 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 0x559d82cc1b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feab401e040 tx=0x7feab400f7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f4cde9702205077 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:51.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.236+0000 7feaa2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:55:51.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.241+0000 7feaa2ff5640 1 -- 172.21.15.18:0/583465579 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab402a040 con 0x559d82cac370 2024-09-19T09:55:51.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.241+0000 7feac774c740 1 -- 172.21.15.18:0/583465579 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feab807d070 con 0x559d82cac370 2024-09-19T09:55:51.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.241+0000 7feaa2ff5640 1 -- 172.21.15.18:0/583465579 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7feab4018070 con 0x559d82cac370 2024-09-19T09:55:51.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.242+0000 7feaa2ff5640 1 -- 172.21.15.18:0/583465579 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feab4020070 con 0x559d82cac370 2024-09-19T09:55:51.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.242+0000 7feac774c740 10 client.25819 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:51.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.243+0000 7feac774c740 1 -- 172.21.15.18:0/583465579 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d82d26b70 con 0x559d82cac370 2024-09-19T09:55:51.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.246+0000 7feaa2ff5640 1 -- 172.21.15.18:0/583465579 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feab807d070 con 0x559d82cac370 2024-09-19T09:55:51.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.247+0000 7feaa2ff5640 1 -- 172.21.15.18:0/583465579 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feab4023040 con 0x559d82cac370 2024-09-19T09:55:51.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.247+0000 7feac774c740 10 client.25819 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:51.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.247+0000 7feac774c740 10 client.25819 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:55:51.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.247+0000 7feac774c740 20 client.25819 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:51.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.248+0000 7feac774c740 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559d82cbbe90 0x559d82d29240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.248+0000 7feac774c740 4 client.25819 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:55:51.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.248+0000 7feac774c740 1 -- 172.21.15.18:0/583465579 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d82c0ed70 con 0x559d82cbbe90 2024-09-19T09:55:51.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.249+0000 7feabeffd640 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559d82cbbe90 0x559d82d29240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.253+0000 7feabeffd640 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559d82cbbe90 0x559d82d29240 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9f924f81ff359d2 server_cookie=b3e30ab7ae1fc540 in_seq=0 out_seq=0 2024-09-19T09:55:51.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.253+0000 7feaa2ff5640 10 client.25819 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:55:51.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.255+0000 7feaa2ff5640 1 -- 172.21.15.18:0/583465579 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d82c0ed70 con 0x559d82cbbe90 2024-09-19T09:55:51.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.255+0000 7feaa2ff5640 10 client.25819 handle_command_reply: tid=0 2024-09-19T09:55:51.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.255+0000 7feac774c740 1 client.25819 shutdown 2024-09-19T09:55:51.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.255+0000 7feac774c740 1 -- 172.21.15.18:0/583465579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 msgr2=0x559d82cc1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.255+0000 7feac774c740 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 0x559d82cc1b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feab401e040 tx=0x7feab400f7e0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.261 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:55:51.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.256+0000 7feac774c740 1 -- 172.21.15.18:0/583465579 shutdown_connections 2024-09-19T09:55:51.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.256+0000 7feac774c740 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x559d82cbbe90 0x559d82d29240 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.256+0000 7feac774c740 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d82cac370 0x559d82cc1b60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.256+0000 7feac774c740 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559d82ca2b40 0x559d82cc1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.256+0000 7feac774c740 1 --2- 172.21.15.18:0/583465579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559d82ca15d0 0x559d82cc42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.256+0000 7feac774c740 1 -- 172.21.15.18:0/583465579 >> 172.21.15.18:0/583465579 conn(0x559d82c6a310 msgr2=0x559d82caa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:51.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.256+0000 7feaa2ff5640 0 client.25819 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:55:51.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.256+0000 7feac774c740 1 -- 172.21.15.18:0/583465579 shutdown_connections 2024-09-19T09:55:51.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.256+0000 7feac774c740 1 -- 172.21.15.18:0/583465579 wait complete. 2024-09-19T09:55:51.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.257+0000 7feac774c740 20 client.25819 trim_cache size 0 max 16384 2024-09-19T09:55:51.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.263+0000 7feac5373640 1 -- 172.21.15.18:0/764937585 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feaa80a3270 msgr2=0x7feaa80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.263+0000 7feac5373640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feaa80a3270 0x7feaa80a5730 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feab4009d10 tx=0x7feab4013830 comp rx=0 tx=0).stop 2024-09-19T09:55:51.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.263+0000 7feac5373640 1 -- 172.21.15.18:0/764937585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac0109830 msgr2=0x7feac0118b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.263+0000 7feac5373640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac0109830 0x7feac0118b20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7feab800ebc0 tx=0x7feab800c6a0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.264+0000 7feac5373640 1 -- 172.21.15.18:0/764937585 shutdown_connections 2024-09-19T09:55:51.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.264+0000 7feac5373640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feaa80a3270 0x7feaa80a5730 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.264+0000 7feac5373640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feac011b140 0x7feac0111790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.264+0000 7feac5373640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac0109830 0x7feac0118b20 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.264+0000 7feac5373640 1 --2- 172.21.15.18:0/764937585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feac0109450 0x7feac01185e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.264+0000 7feac5373640 1 -- 172.21.15.18:0/764937585 >> 172.21.15.18:0/764937585 conn(0x7feac006e140 msgr2=0x7feac011bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:51.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.269+0000 7feac5373640 1 -- 172.21.15.18:0/764937585 shutdown_connections 2024-09-19T09:55:51.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:51.269+0000 7feac5373640 1 -- 172.21.15.18:0/764937585 wait complete. 2024-09-19T09:55:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.940+0000 7f303cae9640 1 -- 172.21.15.18:0/93134426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3038072cb0 msgr2=0x7f30380730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.940+0000 7f303cae9640 1 --2- 172.21.15.18:0/93134426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3038072cb0 0x7f30380730b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3028009900 tx=0x7f302802a400 comp rx=0 tx=0).stop 2024-09-19T09:55:51.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.944+0000 7f303cae9640 1 -- 172.21.15.18:0/93134426 shutdown_connections 2024-09-19T09:55:51.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.944+0000 7f303cae9640 1 --2- 172.21.15.18:0/93134426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f303810dbb0 0x7f3038110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.944+0000 7f303cae9640 1 --2- 172.21.15.18:0/93134426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038073680 0x7f303810d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.944+0000 7f303cae9640 1 --2- 172.21.15.18:0/93134426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3038072cb0 0x7f30380730b0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.944+0000 7f303cae9640 1 -- 172.21.15.18:0/93134426 >> 172.21.15.18:0/93134426 conn(0x7f303806eb50 msgr2=0x7f3038070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.944+0000 7f303cae9640 1 -- 172.21.15.18:0/93134426 shutdown_connections 2024-09-19T09:55:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.944+0000 7f303cae9640 1 -- 172.21.15.18:0/93134426 wait complete. 2024-09-19T09:55:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.945+0000 7f303cae9640 1 Processor -- start 2024-09-19T09:55:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.946+0000 7f303cae9640 1 -- start start 2024-09-19T09:55:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.946+0000 7f303cae9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038072cb0 0x7f3038115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.946+0000 7f303cae9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3038073680 0x7f3038115db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.946+0000 7f303cae9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f303810dbb0 0x7f30381b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.946+0000 7f303cae9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f303811c520 con 0x7f303810dbb0 2024-09-19T09:55:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.946+0000 7f303cae9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f303811c3a0 con 0x7f3038073680 2024-09-19T09:55:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.946+0000 7f303cae9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f303811c6a0 con 0x7f3038072cb0 2024-09-19T09:55:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.947+0000 7f3037fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f303810dbb0 0x7f30381b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.947+0000 7f3037fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f303810dbb0 0x7f30381b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57030/0 (socket says 172.21.15.18:57030) 2024-09-19T09:55:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.947+0000 7f3037fff640 1 -- 172.21.15.18:0/395463239 learned_addr learned my addr 172.21.15.18:0/395463239 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.947+0000 7f3036ffd640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3038073680 0x7f3038115db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.947+0000 7f30377fe640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038072cb0 0x7f3038115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.948+0000 7f3036ffd640 1 -- 172.21.15.18:0/395463239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038072cb0 msgr2=0x7f3038115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.948+0000 7f3036ffd640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038072cb0 0x7f3038115870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.948+0000 7f3036ffd640 1 -- 172.21.15.18:0/395463239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f303810dbb0 msgr2=0x7f30381b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.948+0000 7f3036ffd640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f303810dbb0 0x7f30381b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.948+0000 7f3036ffd640 1 -- 172.21.15.18:0/395463239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30381b7170 con 0x7f3038073680 2024-09-19T09:55:51.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.949+0000 7f3036ffd640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3038073680 0x7f3038115db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f302c00b3c0 tx=0x7f302c00b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:51.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.950+0000 7f3034ff9640 1 -- 172.21.15.18:0/395463239 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c011830 con 0x7f3038073680 2024-09-19T09:55:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.951+0000 7f303cae9640 1 -- 172.21.15.18:0/395463239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30381b7340 con 0x7f3038073680 2024-09-19T09:55:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.951+0000 7f303cae9640 1 -- 172.21.15.18:0/395463239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30381b7880 con 0x7f3038073680 2024-09-19T09:55:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.951+0000 7f3034ff9640 1 -- 172.21.15.18:0/395463239 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f302c016070 con 0x7f3038073680 2024-09-19T09:55:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.951+0000 7f3034ff9640 1 -- 172.21.15.18:0/395463239 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c00f2e0 con 0x7f3038073680 2024-09-19T09:55:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.955+0000 7f3040bc6740 1 Processor -- start 2024-09-19T09:55:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.956+0000 7f3040bc6740 1 -- start start 2024-09-19T09:55:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.956+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b879fb70 0x55c9b879ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.956+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87a04b0 0x55c9b87a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.956+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b87a5540 0x55c9b87a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.957+0000 7f3040bc6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c9b87032f0 con 0x55c9b87a04b0 2024-09-19T09:55:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.957+0000 7f3040bc6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c9b86ab270 con 0x55c9b879fb70 2024-09-19T09:55:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.957+0000 7f3040bc6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c9b86ff2b0 con 0x55c9b87a5540 2024-09-19T09:55:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.958+0000 7f3034ff9640 1 -- 172.21.15.18:0/395463239 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f302c0119d0 con 0x7f3038073680 2024-09-19T09:55:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.960+0000 7f3034ff9640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30200a3380 0x7f30200a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.960+0000 7f3034ff9640 1 -- 172.21.15.18:0/395463239 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f302c0cee40 con 0x7f3038073680 2024-09-19T09:55:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.960+0000 7f3036ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b87a5540 0x55c9b87a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.963+0000 7f30377fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87a04b0 0x55c9b87a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.963+0000 7f30377fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87a04b0 0x55c9b87a4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57046/0 (socket says 172.21.15.18:57046) 2024-09-19T09:55:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.963+0000 7f30377fe640 1 -- 172.21.15.18:0/3196058701 learned_addr learned my addr 172.21.15.18:0/3196058701 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.963+0000 7f3037fff640 1 --2- 172.21.15.18:0/3196058701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b879fb70 0x55c9b879ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.963+0000 7f30377fe640 1 -- 172.21.15.18:0/3196058701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b87a5540 msgr2=0x55c9b87a7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.963+0000 7f30377fe640 1 --2- 172.21.15.18:0/3196058701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b87a5540 0x55c9b87a7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.963+0000 7f30377fe640 1 -- 172.21.15.18:0/3196058701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b879fb70 msgr2=0x55c9b879ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.963+0000 7f30377fe640 1 --2- 172.21.15.18:0/3196058701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b879fb70 0x55c9b879ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.963+0000 7f30377fe640 1 -- 172.21.15.18:0/3196058701 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9b86aa340 con 0x55c9b87a04b0 2024-09-19T09:55:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.963+0000 7f3037fff640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30200a3380 0x7f30200a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.964+0000 7f3037fff640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30200a3380 0x7f30200a5840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f30300075d0 tx=0x7f303000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.965+0000 7f30377fe640 1 --2- 172.21.15.18:0/3196058701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87a04b0 0x55c9b87a4f70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3028031470 tx=0x7f3028031e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898a0579e2b55be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:51.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.973+0000 7f301dffb640 1 -- 172.21.15.18:0/3196058701 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028041070 con 0x55c9b87a04b0 2024-09-19T09:55:51.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.974+0000 7f301dffb640 1 -- 172.21.15.18:0/3196058701 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3028031840 con 0x55c9b87a04b0 2024-09-19T09:55:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.975+0000 7f3040bc6740 1 -- 172.21.15.18:0/3196058701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87a04b0 msgr2=0x55c9b87a4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.975+0000 7f3040bc6740 1 --2- 172.21.15.18:0/3196058701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87a04b0 0x55c9b87a4f70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3028031470 tx=0x7f3028031e70 comp rx=0 tx=0).stop 2024-09-19T09:55:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.976+0000 7f3040bc6740 1 -- 172.21.15.18:0/3196058701 shutdown_connections 2024-09-19T09:55:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.976+0000 7f3040bc6740 1 --2- 172.21.15.18:0/3196058701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b87a5540 0x55c9b87a7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.976+0000 7f3040bc6740 1 --2- 172.21.15.18:0/3196058701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87a04b0 0x55c9b87a4f70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.976+0000 7f3040bc6740 1 --2- 172.21.15.18:0/3196058701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b879fb70 0x55c9b879ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.976+0000 7f3040bc6740 1 -- 172.21.15.18:0/3196058701 >> 172.21.15.18:0/3196058701 conn(0x55c9b879b1e0 msgr2=0x55c9b879b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.976+0000 7f3040bc6740 1 -- 172.21.15.18:0/3196058701 shutdown_connections 2024-09-19T09:55:51.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:51 smithi018 ceph-mon[30956]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 846 MiB/s wr, 1.99k op/s 2024-09-19T09:55:51.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.976+0000 7f3040bc6740 1 -- 172.21.15.18:0/3196058701 wait complete. 2024-09-19T09:55:51.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.982+0000 7f3040bc6740 1 -- start start 2024-09-19T09:55:51.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.983+0000 7f3040bc6740 1 Processor -- start 2024-09-19T09:55:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.983+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 0x55c9b87a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.983+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.984+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 0x55c9b87b1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.984+0000 7f3040bc6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c9b87a8500 con 0x55c9b87af230 2024-09-19T09:55:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.984+0000 7f3040bc6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c9b868c290 con 0x55c9b87a5540 2024-09-19T09:55:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.984+0000 7f3040bc6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c9b87a8680 con 0x55c9b879fb70 2024-09-19T09:55:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.984+0000 7f3040bc6740 10 client.0 _ll_register_callbacks cb 0x55c9b86bd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.985+0000 7f3037fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 0x55c9b87b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.985+0000 7f30377fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 0x55c9b87a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.985+0000 7f30377fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 0x55c9b87a9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51820/0 (socket says 172.21.15.18:51820) 2024-09-19T09:55:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.985+0000 7f30377fe640 1 -- 172.21.15.18:0/2698374189 learned_addr learned my addr 172.21.15.18:0/2698374189 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.986+0000 7f3036ffd640 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.987+0000 7f3037fff640 1 -- 172.21.15.18:0/2698374189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 msgr2=0x55c9b87a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.987+0000 7f3037fff640 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 0x55c9b87a9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.987+0000 7f3037fff640 1 -- 172.21.15.18:0/2698374189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 msgr2=0x55c9b87aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.987+0000 7f3037fff640 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.987+0000 7f3037fff640 1 -- 172.21.15.18:0/2698374189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9b8416210 con 0x55c9b87af230 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.988+0000 7f3037fff640 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 0x55c9b87b1620 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3030007e60 tx=0x7f3030004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7dbea040e90ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.989+0000 7f3016ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.989+0000 7f3016ffd640 1 -- 172.21.15.18:0/2698374189 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3030029060 con 0x55c9b87af230 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.989+0000 7f3040bc6740 1 -- 172.21.15.18:0/2698374189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c9b8710a20 con 0x55c9b87af230 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.989+0000 7f3016ffd640 1 -- 172.21.15.18:0/2698374189 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3030017d70 con 0x55c9b87af230 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.990+0000 7f3016ffd640 1 -- 172.21.15.18:0/2698374189 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3030024420 con 0x55c9b87af230 2024-09-19T09:55:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.990+0000 7f3040bc6740 10 client.16401 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.990+0000 7f3040bc6740 1 -- 172.21.15.18:0/2698374189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c9b84e2620 con 0x55c9b87af230 2024-09-19T09:55:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.994+0000 7f3016ffd640 1 -- 172.21.15.18:0/2698374189 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c9b8710a20 con 0x55c9b87af230 2024-09-19T09:55:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.995+0000 7f3016ffd640 1 -- 172.21.15.18:0/2698374189 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f303002f700 con 0x55c9b87af230 2024-09-19T09:55:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.995+0000 7f3040bc6740 10 client.16401 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.995+0000 7f3040bc6740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.995+0000 7f3040bc6740 20 client.16401 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.995+0000 7f3040bc6740 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c9b87b62c0 0x55c9b87b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.995+0000 7f3040bc6740 4 client.16401 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:51.995+0000 7f3040bc6740 1 -- 172.21.15.18:0/2698374189 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9b870ad70 con 0x55c9b87b62c0 2024-09-19T09:55:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.003+0000 7f30377fe640 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c9b87b62c0 0x55c9b87b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.009+0000 7f30377fe640 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c9b87b62c0 0x55c9b87b86e0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f58fb7c6869980e6 server_cookie=a62d85cad4a203ae in_seq=0 out_seq=0 2024-09-19T09:55:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.009+0000 7f3016ffd640 10 client.16401 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.012+0000 7f3016ffd640 1 -- 172.21.15.18:0/2698374189 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9b870ad70 con 0x55c9b87b62c0 2024-09-19T09:55:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.012+0000 7f3016ffd640 10 client.16401 handle_command_reply: tid=0 2024-09-19T09:55:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.012+0000 7f3040bc6740 1 client.16401 shutdown 2024-09-19T09:55:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.013+0000 7f3040bc6740 1 -- 172.21.15.18:0/2698374189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 msgr2=0x55c9b87b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.013+0000 7f3040bc6740 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 0x55c9b87b1620 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3030007e60 tx=0x7f3030004b50 comp rx=0 tx=0).stop 2024-09-19T09:55:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.013+0000 7f3040bc6740 1 -- 172.21.15.18:0/2698374189 shutdown_connections 2024-09-19T09:55:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.013+0000 7f3040bc6740 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c9b87b62c0 0x55c9b87b86e0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.013+0000 7f3040bc6740 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 0x55c9b87b1620 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.013+0000 7f3040bc6740 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.013+0000 7f3040bc6740 1 --2- 172.21.15.18:0/2698374189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 0x55c9b87a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.013+0000 7f3040bc6740 1 -- 172.21.15.18:0/2698374189 >> 172.21.15.18:0/2698374189 conn(0x55c9b879b1e0 msgr2=0x55c9b879c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.013+0000 7f3016ffd640 0 client.16401 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.014+0000 7f3040bc6740 1 -- 172.21.15.18:0/2698374189 shutdown_connections 2024-09-19T09:55:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.014+0000 7f3040bc6740 1 -- 172.21.15.18:0/2698374189 wait complete. 2024-09-19T09:55:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.015+0000 7f3040bc6740 20 client.16401 trim_cache size 0 max 16384 2024-09-19T09:55:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.058+0000 7f3040bc6740 1 Processor -- start 2024-09-19T09:55:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.058+0000 7f3040bc6740 1 -- start start 2024-09-19T09:55:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.058+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 0x55c9b87a1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.059+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87a1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.059+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 0x55c9b87a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.059+0000 7f3040bc6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f302400e510 con 0x55c9b87af230 2024-09-19T09:55:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.059+0000 7f3040bc6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3024010050 con 0x55c9b87a5540 2024-09-19T09:55:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.059+0000 7f3040bc6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f302400ebe0 con 0x55c9b879fb70 2024-09-19T09:55:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.060+0000 7f30377fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 0x55c9b87a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.060+0000 7f30377fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 0x55c9b87a1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51830/0 (socket says 172.21.15.18:51830) 2024-09-19T09:55:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.060+0000 7f30377fe640 1 -- 172.21.15.18:0/2388642004 learned_addr learned my addr 172.21.15.18:0/2388642004 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.060+0000 7f3037fff640 1 --2- 172.21.15.18:0/2388642004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 0x55c9b87a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.060+0000 7f3036ffd640 1 --2- 172.21.15.18:0/2388642004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.061+0000 7f3037fff640 1 -- 172.21.15.18:0/2388642004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 msgr2=0x55c9b87a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.061+0000 7f3037fff640 1 --2- 172.21.15.18:0/2388642004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 0x55c9b87a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.061+0000 7f3037fff640 1 -- 172.21.15.18:0/2388642004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 msgr2=0x55c9b87a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.061+0000 7f3037fff640 1 --2- 172.21.15.18:0/2388642004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.061+0000 7f3037fff640 1 -- 172.21.15.18:0/2388642004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9b87b4770 con 0x55c9b87af230 2024-09-19T09:55:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.062+0000 7f3037fff640 1 --2- 172.21.15.18:0/2388642004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 0x55c9b87a9cc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3030007f00 tx=0x7f303002e360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd53396810728539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:52.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.063+0000 7f301d7fa640 1 -- 172.21.15.18:0/2388642004 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3030034070 con 0x55c9b87af230 2024-09-19T09:55:52.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.063+0000 7f301d7fa640 1 -- 172.21.15.18:0/2388642004 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f303002f890 con 0x55c9b87af230 2024-09-19T09:55:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.064+0000 7f3040bc6740 1 -- 172.21.15.18:0/2388642004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 msgr2=0x55c9b87a9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.064+0000 7f3040bc6740 1 --2- 172.21.15.18:0/2388642004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 0x55c9b87a9cc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3030007f00 tx=0x7f303002e360 comp rx=0 tx=0).stop 2024-09-19T09:55:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.064+0000 7f3040bc6740 1 -- 172.21.15.18:0/2388642004 shutdown_connections 2024-09-19T09:55:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.064+0000 7f3040bc6740 1 --2- 172.21.15.18:0/2388642004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b87af230 0x55c9b87a9cc0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.064+0000 7f3040bc6740 1 --2- 172.21.15.18:0/2388642004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.064+0000 7f3040bc6740 1 --2- 172.21.15.18:0/2388642004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b879fb70 0x55c9b87a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.065+0000 7f3040bc6740 1 -- 172.21.15.18:0/2388642004 >> 172.21.15.18:0/2388642004 conn(0x55c9b879b1e0 msgr2=0x55c9b87a9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.065+0000 7f3040bc6740 1 -- 172.21.15.18:0/2388642004 shutdown_connections 2024-09-19T09:55:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.065+0000 7f3040bc6740 1 -- 172.21.15.18:0/2388642004 wait complete. 2024-09-19T09:55:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.065+0000 7f3040bc6740 1 -- start start 2024-09-19T09:55:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.066+0000 7f3040bc6740 1 Processor -- start 2024-09-19T09:55:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.066+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b879fb70 0x55c9b87c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.066+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.066+0000 7f3040bc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b881ce20 0x55c9b881f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.066+0000 7f3040bc6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f302400f980 con 0x55c9b879fb70 2024-09-19T09:55:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.066+0000 7f3040bc6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f302400f2b0 con 0x55c9b87a5540 2024-09-19T09:55:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.066+0000 7f3040bc6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f302400c4f0 con 0x55c9b881ce20 2024-09-19T09:55:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.066+0000 7f3040bc6740 10 client.0 _ll_register_callbacks cb 0x7f3030019ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.068+0000 7f3037fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b881ce20 0x55c9b881f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.068+0000 7f3037fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b881ce20 0x55c9b881f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51846/0 (socket says 172.21.15.18:51846) 2024-09-19T09:55:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.068+0000 7f3037fff640 1 -- 172.21.15.18:0/993287076 learned_addr learned my addr 172.21.15.18:0/993287076 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.068+0000 7f30377fe640 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b879fb70 0x55c9b87c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.068+0000 7f3036ffd640 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.069+0000 7f30377fe640 1 -- 172.21.15.18:0/993287076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b881ce20 msgr2=0x55c9b881f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.069+0000 7f30377fe640 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b881ce20 0x55c9b881f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.069+0000 7f30377fe640 1 -- 172.21.15.18:0/993287076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 msgr2=0x55c9b87c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.069+0000 7f30377fe640 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.069+0000 7f30377fe640 1 -- 172.21.15.18:0/993287076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9b881f750 con 0x55c9b879fb70 2024-09-19T09:55:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.070+0000 7f30377fe640 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b879fb70 0x55c9b87c55e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3028031eb0 tx=0x7f302802abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccea763f364ddb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.070+0000 7f3016ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.071+0000 7f3016ffd640 1 -- 172.21.15.18:0/993287076 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028041040 con 0x55c9b879fb70 2024-09-19T09:55:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.071+0000 7f3040bc6740 1 -- 172.21.15.18:0/993287076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c9b8687900 con 0x55c9b879fb70 2024-09-19T09:55:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.071+0000 7f3016ffd640 1 -- 172.21.15.18:0/993287076 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3028003a00 con 0x55c9b879fb70 2024-09-19T09:55:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.072+0000 7f3016ffd640 1 -- 172.21.15.18:0/993287076 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f302805c070 con 0x55c9b879fb70 2024-09-19T09:55:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.072+0000 7f3040bc6740 10 client.16407 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.072+0000 7f3040bc6740 1 -- 172.21.15.18:0/993287076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c9b8820a40 con 0x55c9b879fb70 2024-09-19T09:55:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.073+0000 7f3016ffd640 1 -- 172.21.15.18:0/993287076 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c9b8687900 con 0x55c9b879fb70 2024-09-19T09:55:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.073+0000 7f3016ffd640 1 -- 172.21.15.18:0/993287076 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f302803a040 con 0x55c9b879fb70 2024-09-19T09:55:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.075+0000 7f3040bc6740 10 client.16407 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.075+0000 7f3040bc6740 10 client.16407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.075+0000 7f3040bc6740 20 client.16407 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.075+0000 7f3040bc6740 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c9b8821370 0x55c9b8823790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.075+0000 7f3040bc6740 4 client.16407 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:55:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.075+0000 7f3040bc6740 1 -- 172.21.15.18:0/993287076 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9b86d4820 con 0x55c9b8821370 2024-09-19T09:55:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.077+0000 7f3036ffd640 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c9b8821370 0x55c9b8823790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.080+0000 7f3036ffd640 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c9b8821370 0x55c9b8823790 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a58e4fa4ade6ea0f server_cookie=86ab43de113e8dda in_seq=0 out_seq=0 2024-09-19T09:55:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:52.080+0000 7f3016ffd640 10 client.16407 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:52.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:51 smithi049 ceph-mon[34858]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 846 MiB/s wr, 1.99k op/s 2024-09-19T09:55:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:51 smithi162 ceph-mon[35174]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 846 MiB/s wr, 1.99k op/s 2024-09-19T09:55:53.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:55:53.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.366+0000 7f185695b640 1 -- 172.21.15.18:0/113899762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1850109e00 msgr2=0x7f185010e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:53.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.366+0000 7f185695b640 1 --2- 172.21.15.18:0/113899762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1850109e00 0x7f185010e2b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1840009900 tx=0x7f184002a440 comp rx=0 tx=0).stop 2024-09-19T09:55:53.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.366+0000 7f185695b640 1 -- 172.21.15.18:0/113899762 shutdown_connections 2024-09-19T09:55:53.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.366+0000 7f185695b640 1 --2- 172.21.15.18:0/113899762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f185010ea10 0x7f1850115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:53.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.366+0000 7f185695b640 1 --2- 172.21.15.18:0/113899762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1850109e00 0x7f185010e2b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:53.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.366+0000 7f185695b640 1 --2- 172.21.15.18:0/113899762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1850109450 0x7f1850109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:53.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.366+0000 7f185695b640 1 -- 172.21.15.18:0/113899762 >> 172.21.15.18:0/113899762 conn(0x7f1850073660 msgr2=0x7f1850073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:53.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.366+0000 7f185695b640 1 -- 172.21.15.18:0/113899762 shutdown_connections 2024-09-19T09:55:53.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.366+0000 7f185695b640 1 -- 172.21.15.18:0/113899762 wait complete. 2024-09-19T09:55:53.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.368+0000 7f185695b640 1 Processor -- start 2024-09-19T09:55:53.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.368+0000 7f185695b640 1 -- start start 2024-09-19T09:55:53.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.368+0000 7f185695b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1850109450 0x7f185011e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:53.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.369+0000 7f185695b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1850109e00 0x7f1850118730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:53.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.369+0000 7f185695b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f185010ea10 0x7f1850118c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:53.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.369+0000 7f185695b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1850117120 con 0x7f1850109e00 2024-09-19T09:55:53.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.369+0000 7f185695b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1850116fa0 con 0x7f1850109450 2024-09-19T09:55:53.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.369+0000 7f185695b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f18501172a0 con 0x7f185010ea10 2024-09-19T09:55:53.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.370+0000 7f185615a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f185010ea10 0x7f1850118c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:53.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.370+0000 7f185615a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f185010ea10 0x7f1850118c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51866/0 (socket says 172.21.15.18:51866) 2024-09-19T09:55:53.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.370+0000 7f185615a640 1 -- 172.21.15.18:0/1306405101 learned_addr learned my addr 172.21.15.18:0/1306405101 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:53.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.371+0000 7f1855158640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1850109e00 0x7f1850118730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:53.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.371+0000 7f1855959640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1850109450 0x7f185011e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:53.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.372+0000 7f1855959640 1 -- 172.21.15.18:0/1306405101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f185010ea10 msgr2=0x7f1850118c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:53.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.372+0000 7f1855959640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f185010ea10 0x7f1850118c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:53.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.372+0000 7f1855959640 1 -- 172.21.15.18:0/1306405101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1850109e00 msgr2=0x7f1850118730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:53.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.372+0000 7f1855959640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1850109e00 0x7f1850118730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:53.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.372+0000 7f1855959640 1 -- 172.21.15.18:0/1306405101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18501193f0 con 0x7f1850109450 2024-09-19T09:55:53.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.373+0000 7f1855959640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1850109450 0x7f185011e660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f184c00d6d0 tx=0x7f184c00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:53.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.373+0000 7f1846ffd640 1 -- 172.21.15.18:0/1306405101 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c017070 con 0x7f1850109450 2024-09-19T09:55:53.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.374+0000 7f185695b640 1 -- 172.21.15.18:0/1306405101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18501bbf60 con 0x7f1850109450 2024-09-19T09:55:53.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.374+0000 7f1846ffd640 1 -- 172.21.15.18:0/1306405101 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f184c009820 con 0x7f1850109450 2024-09-19T09:55:53.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.374+0000 7f185695b640 1 -- 172.21.15.18:0/1306405101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18501bc360 con 0x7f1850109450 2024-09-19T09:55:53.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.374+0000 7f1846ffd640 1 -- 172.21.15.18:0/1306405101 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c004cd0 con 0x7f1850109450 2024-09-19T09:55:53.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.377+0000 7f185695b640 1 -- 172.21.15.18:0/1306405101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f185006eef0 con 0x7f1850109450 2024-09-19T09:55:53.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.380+0000 7f1846ffd640 1 -- 172.21.15.18:0/1306405101 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f184c0099d0 con 0x7f1850109450 2024-09-19T09:55:53.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.381+0000 7f1846ffd640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f183c0a3330 0x7f183c0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:53.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.382+0000 7f1846ffd640 1 -- 172.21.15.18:0/1306405101 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f184c0cf470 con 0x7f1850109450 2024-09-19T09:55:53.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.382+0000 7f1855158640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f183c0a3330 0x7f183c0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:53.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.384+0000 7f1855158640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f183c0a3330 0x7f183c0a57f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1840006010 tx=0x7f1840005a00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:53.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.389+0000 7f1846ffd640 1 -- 172.21.15.18:0/1306405101 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f184c09c1e0 con 0x7f1850109450 2024-09-19T09:55:53.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.945+0000 7f185695b640 1 -- 172.21.15.18:0/1306405101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f185002d7c0 con 0x7f1850109450 2024-09-19T09:55:53.955 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:55:53.955 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:55:53.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.948+0000 7f1846ffd640 1 -- 172.21.15.18:0/1306405101 <== mon.2 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f184c09bae0 con 0x7f1850109450 2024-09-19T09:55:53.956 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:55:53.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.952+0000 7f185695b640 1 -- 172.21.15.18:0/1306405101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f183c0a3330 msgr2=0x7f183c0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.952+0000 7f185695b640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f183c0a3330 0x7f183c0a57f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1840006010 tx=0x7f1840005a00 comp rx=0 tx=0).stop 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.953+0000 7f185695b640 1 -- 172.21.15.18:0/1306405101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1850109450 msgr2=0x7f185011e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.953+0000 7f185695b640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1850109450 0x7f185011e660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f184c00d6d0 tx=0x7f184c00db90 comp rx=0 tx=0).stop 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.953+0000 7f185695b640 1 -- 172.21.15.18:0/1306405101 shutdown_connections 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.953+0000 7f185695b640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f183c0a3330 0x7f183c0a57f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.953+0000 7f185695b640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f185010ea10 0x7f1850118c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.953+0000 7f185695b640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1850109e00 0x7f1850118730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.953+0000 7f185695b640 1 --2- 172.21.15.18:0/1306405101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1850109450 0x7f185011e660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.953+0000 7f185695b640 1 -- 172.21.15.18:0/1306405101 >> 172.21.15.18:0/1306405101 conn(0x7f1850073660 msgr2=0x7f185010c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.953+0000 7f185695b640 1 -- 172.21.15.18:0/1306405101 shutdown_connections 2024-09-19T09:55:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:53.953+0000 7f185695b640 1 -- 172.21.15.18:0/1306405101 wait complete. 2024-09-19T09:55:54.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:53 smithi018 ceph-mon[30956]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 914 MiB/s wr, 2.12k op/s 2024-09-19T09:55:54.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:53 smithi049 ceph-mon[34858]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 914 MiB/s wr, 2.12k op/s 2024-09-19T09:55:54.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:53 smithi162 ceph-mon[35174]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 914 MiB/s wr, 2.12k op/s 2024-09-19T09:55:54.354 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:55.064 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T09:55:55.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T09:55:55.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:54 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1306405101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:55:55.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:54 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1306405101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:55:55.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:54 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1306405101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:55:55.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.670+0000 7fdd14829640 1 -- 172.21.15.18:0/627180630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd101008d0 msgr2=0x7fdd10100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:55.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.670+0000 7fdd14829640 1 --2- 172.21.15.18:0/627180630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd101008d0 0x7fdd10100d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd0801acb0 tx=0x7fdd0803b920 comp rx=0 tx=0).stop 2024-09-19T09:55:55.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.670+0000 7fdd14829640 1 -- 172.21.15.18:0/627180630 shutdown_connections 2024-09-19T09:55:55.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.670+0000 7fdd14829640 1 --2- 172.21.15.18:0/627180630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd10101270 0x7fdd1010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.670+0000 7fdd14829640 1 --2- 172.21.15.18:0/627180630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd101008d0 0x7fdd10100d30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.670+0000 7fdd14829640 1 --2- 172.21.15.18:0/627180630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd101068d0 0x7fdd10106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.670+0000 7fdd14829640 1 -- 172.21.15.18:0/627180630 >> 172.21.15.18:0/627180630 conn(0x7fdd100fc610 msgr2=0x7fdd100fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.671+0000 7fdd14829640 1 -- 172.21.15.18:0/627180630 shutdown_connections 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.671+0000 7fdd14829640 1 -- 172.21.15.18:0/627180630 wait complete. 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.672+0000 7fdd14829640 1 Processor -- start 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.672+0000 7fdd14829640 1 -- start start 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.673+0000 7fdd14829640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd10101270 0x7fdd10108b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.673+0000 7fdd14829640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd101068d0 0x7fdd10109050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.673+0000 7fdd14829640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd10070bc0 0x7fdd10071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.673+0000 7fdd14829640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1006e5a0 con 0x7fdd10070bc0 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.673+0000 7fdd14829640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1006e420 con 0x7fdd10101270 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.673+0000 7fdd14829640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1006e720 con 0x7fdd101068d0 2024-09-19T09:55:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.674+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd10101270 0x7fdd10108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.674+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd10101270 0x7fdd10108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:45422/0 (socket says 172.21.15.18:45422) 2024-09-19T09:55:55.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.674+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/440633643 learned_addr learned my addr 172.21.15.18:0/440633643 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:55.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.674+0000 7fdd0f59e640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd10070bc0 0x7fdd10071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.674+0000 7fdd0e59c640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd101068d0 0x7fdd10109050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.674+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/440633643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd101068d0 msgr2=0x7fdd10109050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:55.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.674+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd101068d0 0x7fdd10109050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.674+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/440633643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd10070bc0 msgr2=0x7fdd10071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:55.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.674+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd10070bc0 0x7fdd10071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.674+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/440633643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd10071960 con 0x7fdd10101270 2024-09-19T09:55:55.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.675+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd10101270 0x7fdd10108b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000e9f0 tx=0x7fdd0000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.677+0000 7fdcf7fff640 1 -- 172.21.15.18:0/440633643 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0000cd80 con 0x7fdd10101270 2024-09-19T09:55:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.677+0000 7fdd14829640 1 -- 172.21.15.18:0/440633643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1010c800 con 0x7fdd10101270 2024-09-19T09:55:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.677+0000 7fdd14829640 1 -- 172.21.15.18:0/440633643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1010cd40 con 0x7fdd10101270 2024-09-19T09:55:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.677+0000 7fdcf7fff640 1 -- 172.21.15.18:0/440633643 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd00010910 con 0x7fdd10101270 2024-09-19T09:55:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.677+0000 7fdcf7fff640 1 -- 172.21.15.18:0/440633643 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd00018990 con 0x7fdd10101270 2024-09-19T09:55:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.687+0000 7fdd17403740 1 Processor -- start 2024-09-19T09:55:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.689+0000 7fdcf7fff640 1 -- 172.21.15.18:0/440633643 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdd00018b30 con 0x7fdd10101270 2024-09-19T09:55:55.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.693+0000 7fdcf7fff640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdcf80a3450 0x7fdcf80a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.693+0000 7fdcf7fff640 1 -- 172.21.15.18:0/440633643 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdd000cfaa0 con 0x7fdd10101270 2024-09-19T09:55:55.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.694+0000 7fdd17403740 1 -- start start 2024-09-19T09:55:55.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.695+0000 7fdd17403740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b0b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.695+0000 7fdd17403740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 0x55f791b0bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.696+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b0b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.696+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b0b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57118/0 (socket says 172.21.15.18:57118) 2024-09-19T09:55:55.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.696+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/926507900 learned_addr learned my addr 172.21.15.18:0/926507900 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:55.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.696+0000 7fdd0f59e640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdcf80a3450 0x7fdcf80a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.697+0000 7fdd0e59c640 1 --2- 172.21.15.18:0/926507900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 0x55f791b0bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.697+0000 7fdd17403740 1 --2- 172.21.15.18:0/926507900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b16520 0x55f791b18910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.697+0000 7fdd17403740 1 -- 172.21.15.18:0/926507900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f791a712f0 con 0x55f791b0ccf0 2024-09-19T09:55:55.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.697+0000 7fdd17403740 1 -- 172.21.15.18:0/926507900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f791a18cf0 con 0x55f791b0b780 2024-09-19T09:55:55.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.698+0000 7fdd17403740 1 -- 172.21.15.18:0/926507900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f791a6d2b0 con 0x55f791b16520 2024-09-19T09:55:55.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.698+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/926507900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b16520 msgr2=0x55f791b18910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:55:55.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.698+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/926507900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b16520 0x55f791b18910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.698+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/926507900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 msgr2=0x55f791b0bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:55.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.698+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/926507900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 0x55f791b0bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.699+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/926507900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7919fd3a0 con 0x55f791b0ccf0 2024-09-19T09:55:55.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.700+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/926507900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b0b240 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdd0009c020 tx=0x7fdd00098460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d624a5c6276feb07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:55.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.701+0000 7fdcf57fa640 1 -- 172.21.15.18:0/926507900 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd000a4d00 con 0x55f791b0ccf0 2024-09-19T09:55:55.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.702+0000 7fdcf57fa640 1 -- 172.21.15.18:0/926507900 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd000bc0b0 con 0x55f791b0ccf0 2024-09-19T09:55:55.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.704+0000 7fdd17403740 1 -- 172.21.15.18:0/926507900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 msgr2=0x55f791b0b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:55.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.704+0000 7fdd17403740 1 --2- 172.21.15.18:0/926507900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b0b240 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdd0009c020 tx=0x7fdd00098460 comp rx=0 tx=0).stop 2024-09-19T09:55:55.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.708+0000 7fdd17403740 1 -- 172.21.15.18:0/926507900 shutdown_connections 2024-09-19T09:55:55.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.708+0000 7fdd17403740 1 --2- 172.21.15.18:0/926507900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b16520 0x55f791b18910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.708+0000 7fdd17403740 1 --2- 172.21.15.18:0/926507900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 0x55f791b0bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.708+0000 7fdd17403740 1 --2- 172.21.15.18:0/926507900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b0b240 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.708+0000 7fdd17403740 1 -- 172.21.15.18:0/926507900 >> 172.21.15.18:0/926507900 conn(0x55f791ad4310 msgr2=0x55f791b07e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:55.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.709+0000 7fdd0f59e640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdcf80a3450 0x7fdcf80a5910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55f791b0c220 tx=0x7fdd0400b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:55.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.714+0000 7fdd17403740 1 -- 172.21.15.18:0/926507900 shutdown_connections 2024-09-19T09:55:55.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.718+0000 7fdd17403740 1 -- 172.21.15.18:0/926507900 wait complete. 2024-09-19T09:55:55.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.718+0000 7fdd17403740 1 -- start start 2024-09-19T09:55:55.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.719+0000 7fdd17403740 1 Processor -- start 2024-09-19T09:55:55.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.722+0000 7fdd17403740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 0x55f791b15f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.722+0000 7fdd17403740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b13220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.722+0000 7fdd17403740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b16520 0x55f791b139b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.723+0000 7fdd17403740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f791b19270 con 0x55f791b0ccf0 2024-09-19T09:55:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.723+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 0x55f791b15f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.723+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 0x55f791b15f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:45440/0 (socket says 172.21.15.18:45440) 2024-09-19T09:55:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.723+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/3001272159 learned_addr learned my addr 172.21.15.18:0/3001272159 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.723+0000 7fdd17403740 1 -- 172.21.15.18:0/3001272159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f791a2c060 con 0x55f791b0b780 2024-09-19T09:55:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.723+0000 7fdd17403740 1 -- 172.21.15.18:0/3001272159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f791b193f0 con 0x55f791b16520 2024-09-19T09:55:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.723+0000 7fdd0f59e640 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b16520 0x55f791b139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.724+0000 7fdd17403740 10 client.0 _ll_register_callbacks cb 0x55f79177f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.724+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/3001272159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b16520 msgr2=0x55f791b139b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.724+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b16520 0x55f791b139b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.724+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/3001272159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 msgr2=0x55f791b13220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.724+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b13220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.724+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/3001272159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7917e23c0 con 0x55f791b0b780 2024-09-19T09:55:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.724+0000 7fdd17403740 1 -- 172.21.15.18:0/3001272159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f791a7e860 con 0x55f791b0b780 2024-09-19T09:55:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.724+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 0x55f791b15f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd000a47d0 tx=0x7fdd000983a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5794df6c7f959dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.725+0000 7fdcf2ff5640 10 client.25889 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:55:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.731+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3001272159 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd00010430 con 0x55f791b0b780 2024-09-19T09:55:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.732+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3001272159 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdd000105d0 con 0x55f791b0b780 2024-09-19T09:55:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.732+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3001272159 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd00097de0 con 0x55f791b0b780 2024-09-19T09:55:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.732+0000 7fdd17403740 10 client.25889 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:55.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.732+0000 7fdd17403740 1 -- 172.21.15.18:0/3001272159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f791b24d10 con 0x55f791b0b780 2024-09-19T09:55:55.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.733+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3001272159 <== mon.2 v2:172.21.15.49:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd00097f80 con 0x55f791b0b780 2024-09-19T09:55:55.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.733+0000 7fdd17403740 10 client.25889 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:55.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.733+0000 7fdd17403740 10 client.25889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:55.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.733+0000 7fdd17403740 20 client.25889 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:55.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.733+0000 7fdd17403740 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f791b26060 0x55f791b28450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.733+0000 7fdd17403740 4 client.25889 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:55.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.733+0000 7fdd17403740 1 -- 172.21.15.18:0/3001272159 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f791a7e860 con 0x55f791b26060 2024-09-19T09:55:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.740+0000 7fdd0e59c640 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f791b26060 0x55f791b28450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.740+0000 7fdd0e59c640 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f791b26060 0x55f791b28450 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaa2b4fe95aa4fe1 server_cookie=34136b4ffd87add7 in_seq=0 out_seq=0 2024-09-19T09:55:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.740+0000 7fdcf2ff5640 10 client.25889 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:55.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.742+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3001272159 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f791a7e860 con 0x55f791b26060 2024-09-19T09:55:55.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.742+0000 7fdcf2ff5640 10 client.25889 handle_command_reply: tid=0 2024-09-19T09:55:55.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.742+0000 7fdd17403740 1 client.25889 shutdown 2024-09-19T09:55:55.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.742+0000 7fdd17403740 1 -- 172.21.15.18:0/3001272159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 msgr2=0x55f791b15f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:55.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.742+0000 7fdd17403740 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 0x55f791b15f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd000a47d0 tx=0x7fdd000983a0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.742+0000 7fdd17403740 1 -- 172.21.15.18:0/3001272159 shutdown_connections 2024-09-19T09:55:55.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.742+0000 7fdd17403740 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f791b26060 0x55f791b28450 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.742+0000 7fdcf2ff5640 0 client.25889 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.743+0000 7fdd17403740 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b16520 0x55f791b139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.743+0000 7fdd17403740 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b13220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.743+0000 7fdd17403740 1 --2- 172.21.15.18:0/3001272159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b0b780 0x55f791b15f70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.743+0000 7fdd17403740 1 -- 172.21.15.18:0/3001272159 >> 172.21.15.18:0/3001272159 conn(0x55f791ad4310 msgr2=0x55f791b0db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.743+0000 7fdd17403740 1 -- 172.21.15.18:0/3001272159 shutdown_connections 2024-09-19T09:55:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.743+0000 7fdd17403740 1 -- 172.21.15.18:0/3001272159 wait complete. 2024-09-19T09:55:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.743+0000 7fdd17403740 20 client.25889 trim_cache size 0 max 16384 2024-09-19T09:55:55.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.782+0000 7fdd17403740 1 Processor -- start 2024-09-19T09:55:55.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.782+0000 7fdd17403740 1 -- start start 2024-09-19T09:55:55.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.783+0000 7fdd17403740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0b780 0x55f791b12760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.783+0000 7fdd17403740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0ccf0 0x55f791b0e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.783+0000 7fdd17403740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b16520 0x55f791b0e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.783+0000 7fdd0e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0ccf0 0x55f791b0e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.783+0000 7fdd0e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0ccf0 0x55f791b0e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51900/0 (socket says 172.21.15.18:51900) 2024-09-19T09:55:55.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.783+0000 7fdd0e59c640 1 -- 172.21.15.18:0/2973232887 learned_addr learned my addr 172.21.15.18:0/2973232887 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:55.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.783+0000 7fdd0f59e640 1 --2- 172.21.15.18:0/2973232887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b16520 0x55f791b0e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.784+0000 7fdd17403740 1 -- 172.21.15.18:0/2973232887 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc00e3c0 con 0x55f791b0b780 2024-09-19T09:55:55.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.784+0000 7fdd17403740 1 -- 172.21.15.18:0/2973232887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc00ff00 con 0x55f791b16520 2024-09-19T09:55:55.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.784+0000 7fdd17403740 1 -- 172.21.15.18:0/2973232887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc00ea90 con 0x55f791b0ccf0 2024-09-19T09:55:55.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.786+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/2973232887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0b780 0x55f791b12760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.786+0000 7fdd0f59e640 1 -- 172.21.15.18:0/2973232887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0ccf0 msgr2=0x55f791b0e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:55.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.786+0000 7fdd0f59e640 1 --2- 172.21.15.18:0/2973232887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0ccf0 0x55f791b0e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.786+0000 7fdd0f59e640 1 -- 172.21.15.18:0/2973232887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0b780 msgr2=0x55f791b12760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:55.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.786+0000 7fdd0f59e640 1 --2- 172.21.15.18:0/2973232887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0b780 0x55f791b12760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.786+0000 7fdd0f59e640 1 -- 172.21.15.18:0/2973232887 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f791b18c80 con 0x55f791b16520 2024-09-19T09:55:55.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.787+0000 7fdd0f59e640 1 --2- 172.21.15.18:0/2973232887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b16520 0x55f791b0e810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd04003c60 tx=0x7fdd04013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f962ff15bf2c1f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:55.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.787+0000 7fdcf4ff9640 1 -- 172.21.15.18:0/2973232887 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04011c80 con 0x55f791b16520 2024-09-19T09:55:55.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.787+0000 7fdcf4ff9640 1 -- 172.21.15.18:0/2973232887 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd04011e20 con 0x55f791b16520 2024-09-19T09:55:55.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.789+0000 7fdd17403740 1 -- 172.21.15.18:0/2973232887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b16520 msgr2=0x55f791b0e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:55.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.789+0000 7fdd17403740 1 --2- 172.21.15.18:0/2973232887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b16520 0x55f791b0e810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd04003c60 tx=0x7fdd04013000 comp rx=0 tx=0).stop 2024-09-19T09:55:55.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.789+0000 7fdd17403740 1 -- 172.21.15.18:0/2973232887 shutdown_connections 2024-09-19T09:55:55.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.789+0000 7fdd17403740 1 --2- 172.21.15.18:0/2973232887 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b16520 0x55f791b0e810 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.789+0000 7fdd17403740 1 --2- 172.21.15.18:0/2973232887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0ccf0 0x55f791b0e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.789+0000 7fdd17403740 1 --2- 172.21.15.18:0/2973232887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0b780 0x55f791b12760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.789+0000 7fdd17403740 1 -- 172.21.15.18:0/2973232887 >> 172.21.15.18:0/2973232887 conn(0x55f791ad4310 msgr2=0x55f791b21f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:55.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.789+0000 7fdd17403740 1 -- 172.21.15.18:0/2973232887 shutdown_connections 2024-09-19T09:55:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.789+0000 7fdd17403740 1 -- 172.21.15.18:0/2973232887 wait complete. 2024-09-19T09:55:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.790+0000 7fdd17403740 1 -- start start 2024-09-19T09:55:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.790+0000 7fdd17403740 1 Processor -- start 2024-09-19T09:55:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.791+0000 7fdd17403740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0b780 0x55f791b2b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.791+0000 7fdd17403740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b28b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.791+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0b780 0x55f791b2b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.791+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0b780 0x55f791b2b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51910/0 (socket says 172.21.15.18:51910) 2024-09-19T09:55:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.791+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/3168053677 learned_addr learned my addr 172.21.15.18:0/3168053677 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.791+0000 7fdd17403740 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b26060 0x55f791b290d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.792+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc00f830 con 0x55f791b0ccf0 2024-09-19T09:55:55.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.792+0000 7fdd0f59e640 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b26060 0x55f791b290d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.792+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc00f160 con 0x55f791b26060 2024-09-19T09:55:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.792+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc00c3a0 con 0x55f791b0b780 2024-09-19T09:55:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.792+0000 7fdd17403740 10 client.0 _ll_register_callbacks cb 0x7fdd00005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.792+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/3168053677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b26060 msgr2=0x55f791b290d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.792+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b26060 0x55f791b290d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.792+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/3168053677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 msgr2=0x55f791b28b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:55.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.792+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b28b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.792+0000 7fdd0ed9d640 1 -- 172.21.15.18:0/3168053677 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f791b29610 con 0x55f791b0b780 2024-09-19T09:55:55.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.794+0000 7fdd0ed9d640 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0b780 0x55f791b2b8e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000e9c0 tx=0x7fdd00018420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d70b81990cca07f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:55.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.794+0000 7fdcf2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:55:55.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.796+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3168053677 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0009af50 con 0x55f791b0b780 2024-09-19T09:55:55.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.796+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3168053677 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdd0009b0f0 con 0x55f791b0b780 2024-09-19T09:55:55.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.798+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f791a78d70 con 0x55f791b0b780 2024-09-19T09:55:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.803+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3168053677 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd0009b2f0 con 0x55f791b0b780 2024-09-19T09:55:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.807+0000 7fdd17403740 10 client.25855 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:55.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.807+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f791b90720 con 0x55f791b0b780 2024-09-19T09:55:55.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.808+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3168053677 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd000b00d0 con 0x55f791b0b780 2024-09-19T09:55:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.809+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3168053677 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd00086b60 con 0x55f791b0b780 2024-09-19T09:55:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.809+0000 7fdd17403740 10 client.25855 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.809+0000 7fdd17403740 10 client.25855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.809+0000 7fdd17403740 20 client.25855 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.809+0000 7fdd17403740 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f791b90c40 0x55f791b93030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.810+0000 7fdd17403740 4 client.25855 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:55:55.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.810+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f791a78d70 con 0x55f791b90c40 2024-09-19T09:55:55.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.812+0000 7fdd0e59c640 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f791b90c40 0x55f791b93030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.814+0000 7fdcf2ff5640 10 client.25855 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:55.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.814+0000 7fdd0e59c640 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f791b90c40 0x55f791b93030 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=febafb5dd0b19a99 server_cookie=3dd2f13b506bf06a in_seq=0 out_seq=0 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.817+0000 7fdcf2ff5640 1 -- 172.21.15.18:0/3168053677 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f791a78d70 con 0x55f791b90c40 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.817+0000 7fdcf2ff5640 10 client.25855 handle_command_reply: tid=0 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.817+0000 7fdd17403740 1 client.25855 shutdown 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.818+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0b780 msgr2=0x55f791b2b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.818+0000 7fdd17403740 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0b780 0x55f791b2b8e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000e9c0 tx=0x7fdd00018420 comp rx=0 tx=0).stop 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.818+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 shutdown_connections 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.818+0000 7fdd17403740 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f791b90c40 0x55f791b93030 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.819+0000 7fdd17403740 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f791b26060 0x55f791b290d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.819+0000 7fdd17403740 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f791b0ccf0 0x55f791b28b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.819+0000 7fdd17403740 1 --2- 172.21.15.18:0/3168053677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f791b0b780 0x55f791b2b8e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.819+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 >> 172.21.15.18:0/3168053677 conn(0x55f791ad4310 msgr2=0x55f791b14a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.819+0000 7fdcf2ff5640 0 client.25855 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.819+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 shutdown_connections 2024-09-19T09:55:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.819+0000 7fdd17403740 1 -- 172.21.15.18:0/3168053677 wait complete. 2024-09-19T09:55:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.819+0000 7fdd17403740 20 client.25855 trim_cache size 0 max 16384 2024-09-19T09:55:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.822+0000 7fdd14829640 1 -- 172.21.15.18:0/440633643 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdcf80a3450 msgr2=0x7fdcf80a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.822+0000 7fdd14829640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdcf80a3450 0x7fdcf80a5910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55f791b0c220 tx=0x7fdd0400b2e0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.822+0000 7fdd14829640 1 -- 172.21.15.18:0/440633643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd10101270 msgr2=0x7fdd10108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:55.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.822+0000 7fdd14829640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd10101270 0x7fdd10108b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000e9f0 tx=0x7fdd0000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.822+0000 7fdd14829640 1 -- 172.21.15.18:0/440633643 shutdown_connections 2024-09-19T09:55:55.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.822+0000 7fdd14829640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdcf80a3450 0x7fdcf80a5910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.822+0000 7fdd14829640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd10070bc0 0x7fdd10071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.822+0000 7fdd14829640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd101068d0 0x7fdd10109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.823+0000 7fdd14829640 1 --2- 172.21.15.18:0/440633643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd10101270 0x7fdd10108b10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:55.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.823+0000 7fdd14829640 1 -- 172.21.15.18:0/440633643 >> 172.21.15.18:0/440633643 conn(0x7fdd100fc610 msgr2=0x7fdd101023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:55.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.823+0000 7fdd14829640 1 -- 172.21.15.18:0/440633643 shutdown_connections 2024-09-19T09:55:55.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:55.823+0000 7fdd14829640 1 -- 172.21.15.18:0/440633643 wait complete. 2024-09-19T09:55:56.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:55 smithi018 ceph-mon[30956]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 890 MiB/s wr, 2.03k op/s 2024-09-19T09:55:56.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:55 smithi049 ceph-mon[34858]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 890 MiB/s wr, 2.03k op/s 2024-09-19T09:55:56.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:55 smithi162 ceph-mon[35174]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 890 MiB/s wr, 2.03k op/s 2024-09-19T09:55:56.764 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:57.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.648+0000 7f562ffda640 1 -- 172.21.15.18:0/425481365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5628109830 msgr2=0x7f5628109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:57.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.648+0000 7f562ffda640 1 --2- 172.21.15.18:0/425481365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5628109830 0x7f5628109c90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5618009900 tx=0x7f561802a440 comp rx=0 tx=0).stop 2024-09-19T09:55:57.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.651+0000 7f562ffda640 1 -- 172.21.15.18:0/425481365 shutdown_connections 2024-09-19T09:55:57.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.651+0000 7f562ffda640 1 --2- 172.21.15.18:0/425481365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f562811b140 0x7f562811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.651+0000 7f562ffda640 1 --2- 172.21.15.18:0/425481365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5628109830 0x7f5628109c90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.651+0000 7f562ffda640 1 --2- 172.21.15.18:0/425481365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5628109450 0x7f5628110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.651+0000 7f562ffda640 1 -- 172.21.15.18:0/425481365 >> 172.21.15.18:0/425481365 conn(0x7f562806e140 msgr2=0x7f562806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:57.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.652+0000 7f562ffda640 1 -- 172.21.15.18:0/425481365 shutdown_connections 2024-09-19T09:55:57.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.652+0000 7f562ffda640 1 -- 172.21.15.18:0/425481365 wait complete. 2024-09-19T09:55:57.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.653+0000 7f562ffda640 1 Processor -- start 2024-09-19T09:55:57.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.653+0000 7f562ffda640 1 -- start start 2024-09-19T09:55:57.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.653+0000 7f562ffda640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628109450 0x7f56281a7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.653+0000 7f562ffda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5628109830 0x7f56281a7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.653+0000 7f562ffda640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f562811b140 0x7f56281abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.653+0000 7f562ffda640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5628120ed0 con 0x7f5628109830 2024-09-19T09:55:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.653+0000 7f562ffda640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5628120d50 con 0x7f5628109450 2024-09-19T09:55:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.653+0000 7f562ffda640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5628121050 con 0x7f562811b140 2024-09-19T09:55:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.655+0000 7f562dd76640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628109450 0x7f56281a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.655+0000 7f562dd76640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628109450 0x7f56281a7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34506/0 (socket says 172.21.15.18:34506) 2024-09-19T09:55:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.655+0000 7f562dd76640 1 -- 172.21.15.18:0/762733807 learned_addr learned my addr 172.21.15.18:0/762733807 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.655+0000 7f562d575640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5628109830 0x7f56281a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.655+0000 7f562e577640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f562811b140 0x7f56281abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.656+0000 7f562d575640 1 -- 172.21.15.18:0/762733807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f562811b140 msgr2=0x7f56281abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.656+0000 7f562d575640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f562811b140 0x7f56281abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.656+0000 7f562d575640 1 -- 172.21.15.18:0/762733807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628109450 msgr2=0x7f56281a7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.656+0000 7f562d575640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628109450 0x7f56281a7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.656+0000 7f562d575640 1 -- 172.21.15.18:0/762733807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56281ac2e0 con 0x7f5628109830 2024-09-19T09:55:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.656+0000 7f562d575640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5628109830 0x7f56281a7850 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5618009850 tx=0x7f5618039520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.657+0000 7f561effd640 1 -- 172.21.15.18:0/762733807 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618040070 con 0x7f5628109830 2024-09-19T09:55:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.657+0000 7f562ffda640 1 -- 172.21.15.18:0/762733807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56281ac570 con 0x7f5628109830 2024-09-19T09:55:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.657+0000 7f561effd640 1 -- 172.21.15.18:0/762733807 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5618030e60 con 0x7f5628109830 2024-09-19T09:55:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.657+0000 7f561effd640 1 -- 172.21.15.18:0/762733807 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618035030 con 0x7f5628109830 2024-09-19T09:55:57.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.657+0000 7f562ffda640 1 -- 172.21.15.18:0/762733807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5628110920 con 0x7f5628109830 2024-09-19T09:55:57.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.662+0000 7f56323b3740 1 Processor -- start 2024-09-19T09:55:57.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.663+0000 7f56323b3740 1 -- start start 2024-09-19T09:55:57.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.663+0000 7f56323b3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f20760 0x55ab16f20b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.663+0000 7f56323b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f21080 0x55ab16f2b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.663+0000 7f56323b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 0x55ab16f2dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.663+0000 7f56323b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ab16e862a0 con 0x55ab16f2b940 2024-09-19T09:55:57.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.663+0000 7f56323b3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ab16e2db10 con 0x55ab16f20760 2024-09-19T09:55:57.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.663+0000 7f56323b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ab16e82260 con 0x55ab16f21080 2024-09-19T09:55:57.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.664+0000 7f562e577640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f20760 0x55ab16f20b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.665+0000 7f562dd76640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f21080 0x55ab16f2b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.665+0000 7f562e577640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f20760 0x55ab16f20b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34520/0 (socket says 172.21.15.18:34520) 2024-09-19T09:55:57.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.665+0000 7f562e577640 1 -- 172.21.15.18:0/4082171089 learned_addr learned my addr 172.21.15.18:0/4082171089 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:57.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.666+0000 7f561effd640 1 -- 172.21.15.18:0/762733807 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5618043070 con 0x7f5628109830 2024-09-19T09:55:57.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.667+0000 7f562e577640 1 -- 172.21.15.18:0/4082171089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f21080 msgr2=0x55ab16f2b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.667+0000 7f562e577640 1 --2- 172.21.15.18:0/4082171089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f21080 0x55ab16f2b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.667+0000 7f562e577640 1 -- 172.21.15.18:0/4082171089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 msgr2=0x55ab16f2dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.667+0000 7f562e577640 1 --2- 172.21.15.18:0/4082171089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 0x55ab16f2dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.667+0000 7f562e577640 1 -- 172.21.15.18:0/4082171089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab16bf7b90 con 0x55ab16f20760 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.667+0000 7f561effd640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56140a3450 0x7f56140a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.668+0000 7f561effd640 1 -- 172.21.15.18:0/762733807 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f56180f0410 con 0x7f5628109830 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.669+0000 7f562dd76640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56140a3450 0x7f56140a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.670+0000 7f562e577640 1 --2- 172.21.15.18:0/4082171089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f20760 0x55ab16f20b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5620009e90 tx=0x7f562000c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d763c9d053217532 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.671+0000 7f562dd76640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56140a3450 0x7f56140a5910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55ab16f1db50 tx=0x7f5624008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.671+0000 7f5613fff640 1 -- 172.21.15.18:0/4082171089 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562001a070 con 0x55ab16f20760 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.671+0000 7f5613fff640 1 -- 172.21.15.18:0/4082171089 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f562000aad0 con 0x55ab16f20760 2024-09-19T09:55:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.671+0000 7f5613fff640 1 -- 172.21.15.18:0/4082171089 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620015c00 con 0x55ab16f20760 2024-09-19T09:55:57.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.680+0000 7f56323b3740 1 -- 172.21.15.18:0/4082171089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f20760 msgr2=0x55ab16f20b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:57.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.680+0000 7f56323b3740 1 --2- 172.21.15.18:0/4082171089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f20760 0x55ab16f20b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5620009e90 tx=0x7f562000c7d0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.680+0000 7f56323b3740 1 -- 172.21.15.18:0/4082171089 shutdown_connections 2024-09-19T09:55:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.680+0000 7f56323b3740 1 --2- 172.21.15.18:0/4082171089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 0x55ab16f2dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.680+0000 7f56323b3740 1 --2- 172.21.15.18:0/4082171089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f21080 0x55ab16f2b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.680+0000 7f56323b3740 1 --2- 172.21.15.18:0/4082171089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f20760 0x55ab16f20b40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.680+0000 7f56323b3740 1 -- 172.21.15.18:0/4082171089 >> 172.21.15.18:0/4082171089 conn(0x55ab16f1ccf0 msgr2=0x55ab16f1d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.681+0000 7f56323b3740 1 -- 172.21.15.18:0/4082171089 shutdown_connections 2024-09-19T09:55:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.681+0000 7f56323b3740 1 -- 172.21.15.18:0/4082171089 wait complete. 2024-09-19T09:55:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.682+0000 7f56323b3740 1 -- start start 2024-09-19T09:55:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.682+0000 7f56323b3740 1 Processor -- start 2024-09-19T09:55:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.683+0000 7f56323b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f20760 0x55ab16f288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.683+0000 7f56323b3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f21080 0x55ab16f28de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.683+0000 7f56323b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 0x55ab16f29320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.683+0000 7f56323b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ab16f2e510 con 0x55ab16f2b940 2024-09-19T09:55:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.683+0000 7f56323b3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ab16e0e6e0 con 0x55ab16f21080 2024-09-19T09:55:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.683+0000 7f56323b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ab16f2e690 con 0x55ab16f20760 2024-09-19T09:55:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.683+0000 7f562e577640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 0x55ab16f29320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.683+0000 7f562e577640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 0x55ab16f29320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36644/0 (socket says 172.21.15.18:36644) 2024-09-19T09:55:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.683+0000 7f562e577640 1 -- 172.21.15.18:0/1342209125 learned_addr learned my addr 172.21.15.18:0/1342209125 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.683+0000 7f56323b3740 10 client.0 _ll_register_callbacks cb 0x55ab16e32a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.684+0000 7f562e577640 1 -- 172.21.15.18:0/1342209125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f20760 msgr2=0x55ab16f288a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:55:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.684+0000 7f562e577640 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f20760 0x55ab16f288a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.684+0000 7f562e577640 1 -- 172.21.15.18:0/1342209125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f21080 msgr2=0x55ab16f28de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.684+0000 7f562e577640 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f21080 0x55ab16f28de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.684+0000 7f562e577640 1 -- 172.21.15.18:0/1342209125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab16f37b10 con 0x55ab16f2b940 2024-09-19T09:55:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.684+0000 7f562e577640 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 0x55ab16f29320 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5620018040 tx=0x7f562000aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffdac694e916a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.684+0000 7f56117fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:57.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.685+0000 7f56117fa640 1 -- 172.21.15.18:0/1342209125 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620045020 con 0x55ab16f2b940 2024-09-19T09:55:57.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.685+0000 7f56117fa640 1 -- 172.21.15.18:0/1342209125 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5620003ce0 con 0x55ab16f2b940 2024-09-19T09:55:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.685+0000 7f56323b3740 1 -- 172.21.15.18:0/1342209125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f562000aad0 con 0x55ab16f2b940 2024-09-19T09:55:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.685+0000 7f56117fa640 1 -- 172.21.15.18:0/1342209125 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5620015900 con 0x55ab16f2b940 2024-09-19T09:55:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.686+0000 7f56323b3740 10 client.16431 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.686+0000 7f56323b3740 1 -- 172.21.15.18:0/1342209125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ab16f3a4a0 con 0x55ab16f2b940 2024-09-19T09:55:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.686+0000 7f56117fa640 1 -- 172.21.15.18:0/1342209125 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f562000aad0 con 0x55ab16f2b940 2024-09-19T09:55:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.686+0000 7f56117fa640 1 -- 172.21.15.18:0/1342209125 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5620052080 con 0x55ab16f2b940 2024-09-19T09:55:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.687+0000 7f56323b3740 10 client.16431 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.687+0000 7f56323b3740 10 client.16431 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:55:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.687+0000 7f56323b3740 20 client.16431 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.687+0000 7f56323b3740 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab16f3b8b0 0x55ab16f3dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.687+0000 7f56323b3740 4 client.16431 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.687+0000 7f56323b3740 1 -- 172.21.15.18:0/1342209125 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab16e939d0 con 0x55ab16f3b8b0 2024-09-19T09:55:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.689+0000 7f562dd76640 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab16f3b8b0 0x55ab16f3dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.694+0000 7f562dd76640 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab16f3b8b0 0x55ab16f3dca0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffb2da9cef9560cd server_cookie=cf1553bd4607922f in_seq=0 out_seq=0 2024-09-19T09:55:57.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.694+0000 7f56117fa640 10 client.16431 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:57.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.698+0000 7f56117fa640 1 -- 172.21.15.18:0/1342209125 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab16e939d0 con 0x55ab16f3b8b0 2024-09-19T09:55:57.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.698+0000 7f56117fa640 10 client.16431 handle_command_reply: tid=0 2024-09-19T09:55:57.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.698+0000 7f56323b3740 1 client.16431 shutdown 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56323b3740 1 -- 172.21.15.18:0/1342209125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 msgr2=0x55ab16f29320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56323b3740 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 0x55ab16f29320 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5620018040 tx=0x7f562000aeb0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56323b3740 1 -- 172.21.15.18:0/1342209125 shutdown_connections 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56323b3740 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab16f3b8b0 0x55ab16f3dca0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56323b3740 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f2b940 0x55ab16f29320 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56323b3740 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f21080 0x55ab16f28de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56323b3740 1 --2- 172.21.15.18:0/1342209125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f20760 0x55ab16f288a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56323b3740 1 -- 172.21.15.18:0/1342209125 >> 172.21.15.18:0/1342209125 conn(0x55ab16f1ccf0 msgr2=0x55ab16f1be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56117fa640 0 client.16431 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56323b3740 1 -- 172.21.15.18:0/1342209125 shutdown_connections 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.699+0000 7f56323b3740 1 -- 172.21.15.18:0/1342209125 wait complete. 2024-09-19T09:55:57.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.700+0000 7f56323b3740 20 client.16431 trim_cache size 0 max 16384 2024-09-19T09:55:57.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.742+0000 7f56323b3740 1 Processor -- start 2024-09-19T09:55:57.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.742+0000 7f56323b3740 1 -- start start 2024-09-19T09:55:57.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.743+0000 7f56323b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f20760 0x55ab16f23df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.743+0000 7f56323b3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f21080 0x55ab16f228c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.744+0000 7f562dd76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f20760 0x55ab16f23df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.744+0000 7f562dd76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f20760 0x55ab16f23df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36646/0 (socket says 172.21.15.18:36646) 2024-09-19T09:55:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.744+0000 7f562dd76640 1 -- 172.21.15.18:0/1750428306 learned_addr learned my addr 172.21.15.18:0/1750428306 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.744+0000 7f56323b3740 1 --2- 172.21.15.18:0/1750428306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f2b940 0x55ab16f43390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.744+0000 7f56323b3740 1 -- 172.21.15.18:0/1750428306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f560c00e380 con 0x55ab16f20760 2024-09-19T09:55:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.744+0000 7f562d575640 1 --2- 172.21.15.18:0/1750428306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f21080 0x55ab16f228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.744+0000 7f56323b3740 1 -- 172.21.15.18:0/1750428306 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f560c00fec0 con 0x55ab16f21080 2024-09-19T09:55:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.745+0000 7f56323b3740 1 -- 172.21.15.18:0/1750428306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f560c00ea50 con 0x55ab16f2b940 2024-09-19T09:55:57.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.745+0000 7f562dd76640 1 -- 172.21.15.18:0/1750428306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f2b940 msgr2=0x55ab16f43390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:57.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.745+0000 7f562dd76640 1 --2- 172.21.15.18:0/1750428306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f2b940 0x55ab16f43390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.745+0000 7f562dd76640 1 -- 172.21.15.18:0/1750428306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f21080 msgr2=0x55ab16f228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:57.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.745+0000 7f562dd76640 1 --2- 172.21.15.18:0/1750428306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f21080 0x55ab16f228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.745+0000 7f562dd76640 1 -- 172.21.15.18:0/1750428306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab16f18260 con 0x55ab16f20760 2024-09-19T09:55:57.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.746+0000 7f562dd76640 1 --2- 172.21.15.18:0/1750428306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f20760 0x55ab16f23df0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5624011b90 tx=0x7f5624014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5516d88fc96da781 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:57.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.747+0000 7f56137fe640 1 -- 172.21.15.18:0/1750428306 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56240159d0 con 0x55ab16f20760 2024-09-19T09:55:57.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.747+0000 7f56137fe640 1 -- 172.21.15.18:0/1750428306 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5624030070 con 0x55ab16f20760 2024-09-19T09:55:57.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.747+0000 7f56137fe640 1 -- 172.21.15.18:0/1750428306 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562402b6a0 con 0x55ab16f20760 2024-09-19T09:55:57.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.748+0000 7f56323b3740 1 -- 172.21.15.18:0/1750428306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f20760 msgr2=0x55ab16f23df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:57.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.748+0000 7f56323b3740 1 --2- 172.21.15.18:0/1750428306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f20760 0x55ab16f23df0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5624011b90 tx=0x7f5624014000 comp rx=0 tx=0).stop 2024-09-19T09:55:57.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.749+0000 7f56323b3740 1 -- 172.21.15.18:0/1750428306 shutdown_connections 2024-09-19T09:55:57.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.749+0000 7f56323b3740 1 --2- 172.21.15.18:0/1750428306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f2b940 0x55ab16f43390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.749+0000 7f56323b3740 1 --2- 172.21.15.18:0/1750428306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f21080 0x55ab16f228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.749+0000 7f56323b3740 1 --2- 172.21.15.18:0/1750428306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f20760 0x55ab16f23df0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.750+0000 7f56323b3740 1 -- 172.21.15.18:0/1750428306 >> 172.21.15.18:0/1750428306 conn(0x55ab16f1ccf0 msgr2=0x55ab16f221b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.750+0000 7f56323b3740 1 -- 172.21.15.18:0/1750428306 shutdown_connections 2024-09-19T09:55:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.751+0000 7f56323b3740 1 -- 172.21.15.18:0/1750428306 wait complete. 2024-09-19T09:55:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.751+0000 7f56323b3740 1 -- start start 2024-09-19T09:55:57.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.752+0000 7f56323b3740 1 Processor -- start 2024-09-19T09:55:57.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.752+0000 7f56323b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f20760 0x55ab16f33970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.753+0000 7f56323b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f21080 0x55ab16f33eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.753+0000 7f56323b3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f2b940 0x55ab16f30940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.753+0000 7f56323b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f560c00f7f0 con 0x55ab16f21080 2024-09-19T09:55:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.753+0000 7f56323b3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f560c00f120 con 0x55ab16f2b940 2024-09-19T09:55:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.753+0000 7f56323b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f560c00c360 con 0x55ab16f20760 2024-09-19T09:55:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.753+0000 7f56323b3740 10 client.0 _ll_register_callbacks cb 0x7f562000a9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:57.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.754+0000 7f562d575640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f21080 0x55ab16f33eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.754+0000 7f562d575640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f21080 0x55ab16f33eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36658/0 (socket says 172.21.15.18:36658) 2024-09-19T09:55:57.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.754+0000 7f562d575640 1 -- 172.21.15.18:0/1242068021 learned_addr learned my addr 172.21.15.18:0/1242068021 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:57.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.754+0000 7f562e577640 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f2b940 0x55ab16f30940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.755+0000 7f562d575640 1 -- 172.21.15.18:0/1242068021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f20760 msgr2=0x55ab16f33970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:57.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.755+0000 7f562d575640 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f20760 0x55ab16f33970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.755+0000 7f562d575640 1 -- 172.21.15.18:0/1242068021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f2b940 msgr2=0x55ab16f30940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:57.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.755+0000 7f562d575640 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f2b940 0x55ab16f30940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:57.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.755+0000 7f562d575640 1 -- 172.21.15.18:0/1242068021 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab16f30e80 con 0x55ab16f21080 2024-09-19T09:55:57.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.756+0000 7f562d575640 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f21080 0x55ab16f33eb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f56180b8e60 tx=0x7f56180bc600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d09db75d0292e53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:57.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.756+0000 7f56117fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:57.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.756+0000 7f56117fa640 1 -- 172.21.15.18:0/1242068021 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56180317b0 con 0x55ab16f21080 2024-09-19T09:55:57.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.757+0000 7f56117fa640 1 -- 172.21.15.18:0/1242068021 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f56180bcc60 con 0x55ab16f21080 2024-09-19T09:55:57.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.757+0000 7f56323b3740 1 -- 172.21.15.18:0/1242068021 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5624030070 con 0x55ab16f21080 2024-09-19T09:55:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.757+0000 7f56117fa640 1 -- 172.21.15.18:0/1242068021 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5618004460 con 0x55ab16f21080 2024-09-19T09:55:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.758+0000 7f56323b3740 10 client.16437 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.758+0000 7f56323b3740 1 -- 172.21.15.18:0/1242068021 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ab16fa6ac0 con 0x55ab16f21080 2024-09-19T09:55:57.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.758+0000 7f56117fa640 1 -- 172.21.15.18:0/1242068021 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56180d5070 con 0x55ab16f21080 2024-09-19T09:55:57.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.763+0000 7f56117fa640 1 -- 172.21.15.18:0/1242068021 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f561803a040 con 0x55ab16f21080 2024-09-19T09:55:57.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.763+0000 7f56323b3740 10 client.16437 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:57.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.764+0000 7f56323b3740 10 client.16437 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:55:57.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.764+0000 7f56323b3740 20 client.16437 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:57.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.764+0000 7f56323b3740 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab16fa7230 0x55ab16fa9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:57.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.765+0000 7f56323b3740 4 client.16437 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T09:55:57.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.765+0000 7f56323b3740 1 -- 172.21.15.18:0/1242068021 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x7f5624030070 con 0x55ab16fa7230 2024-09-19T09:55:57.772 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:55:57.772 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:55:57.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.767+0000 7f562dd76640 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab16fa7230 0x55ab16fa9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:57.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.772+0000 7f562dd76640 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab16fa7230 0x55ab16fa9650 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3b187e849e00838 server_cookie=49dd54d09c628822 in_seq=0 out_seq=0 2024-09-19T09:55:57.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:57.772+0000 7f56117fa640 10 client.16437 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:58.205 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:55:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.321+0000 7f3016ffd640 1 -- 172.21.15.18:0/993287076 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c9b86d4820 con 0x55c9b8821370 2024-09-19T09:55:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3016ffd640 10 client.16407 handle_command_reply: tid=0 2024-09-19T09:55:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 client.16407 shutdown 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 -- 172.21.15.18:0/993287076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b879fb70 msgr2=0x55c9b87c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b879fb70 0x55c9b87c55e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3028031eb0 tx=0x7f302802abb0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 -- 172.21.15.18:0/993287076 shutdown_connections 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c9b8821370 0x55c9b8823790 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9b881ce20 0x55c9b881f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c9b87a5540 0x55c9b87c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 --2- 172.21.15.18:0/993287076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c9b879fb70 0x55c9b87c55e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3016ffd640 0 client.16407 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 -- 172.21.15.18:0/993287076 >> 172.21.15.18:0/993287076 conn(0x55c9b879b1e0 msgr2=0x55c9b87a9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 -- 172.21.15.18:0/993287076 shutdown_connections 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 1 -- 172.21.15.18:0/993287076 wait complete. 2024-09-19T09:55:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.322+0000 7f3040bc6740 20 client.16407 trim_cache size 0 max 16384 2024-09-19T09:55:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:55:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:55:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:55:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:55:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 -- 172.21.15.18:0/395463239 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30200a3380 msgr2=0x7f30200a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30200a3380 0x7f30200a5840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f30300075d0 tx=0x7f303000b040 comp rx=0 tx=0).stop 2024-09-19T09:55:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 -- 172.21.15.18:0/395463239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3038073680 msgr2=0x7f3038115db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3038073680 0x7f3038115db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f302c00b3c0 tx=0x7f302c00b880 comp rx=0 tx=0).stop 2024-09-19T09:55:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 -- 172.21.15.18:0/395463239 shutdown_connections 2024-09-19T09:55:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f30200a3380 0x7f30200a5840 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f303810dbb0 0x7f30381b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3038073680 0x7f3038115db0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 --2- 172.21.15.18:0/395463239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038072cb0 0x7f3038115870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 -- 172.21.15.18:0/395463239 >> 172.21.15.18:0/395463239 conn(0x7f303806eb50 msgr2=0x7f303806f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 -- 172.21.15.18:0/395463239 shutdown_connections 2024-09-19T09:55:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:55:58.323+0000 7f303cae9640 1 -- 172.21.15.18:0/395463239 wait complete. 2024-09-19T09:55:58.329 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:57 smithi018 ceph-mon[30956]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 890 MiB/s wr, 2.27k op/s 2024-09-19T09:55:58.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:57 smithi049 ceph-mon[34858]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 890 MiB/s wr, 2.27k op/s 2024-09-19T09:55:58.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:57 smithi162 ceph-mon[35174]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 890 MiB/s wr, 2.27k op/s 2024-09-19T09:55:58.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 -- 172.21.15.18:0/3278001407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8098103660 msgr2=0x7f809810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:58.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 --2- 172.21.15.18:0/3278001407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8098103660 0x7f809810bb50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f808c009900 tx=0x7f808c02a480 comp rx=0 tx=0).stop 2024-09-19T09:55:58.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 -- 172.21.15.18:0/3278001407 shutdown_connections 2024-09-19T09:55:58.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 --2- 172.21.15.18:0/3278001407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f809810c170 0x7f809810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 --2- 172.21.15.18:0/3278001407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8098103660 0x7f809810bb50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 --2- 172.21.15.18:0/3278001407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8098102d40 0x7f8098103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 -- 172.21.15.18:0/3278001407 >> 172.21.15.18:0/3278001407 conn(0x7f80980fc7a0 msgr2=0x7f80980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 -- 172.21.15.18:0/3278001407 shutdown_connections 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 -- 172.21.15.18:0/3278001407 wait complete. 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 Processor -- start 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.657+0000 7f809e43c640 1 -- start start 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f809e43c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8098102d40 0x7f80981983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f809e43c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8098103660 0x7f8098198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f809e43c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f809810c170 0x7f809819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f809e43c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8098111f70 con 0x7f8098102d40 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f809e43c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8098111df0 con 0x7f809810c170 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f809e43c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80981120f0 con 0x7f8098103660 2024-09-19T09:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f8097fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8098102d40 0x7f80981983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f8097fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8098102d40 0x7f80981983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36682/0 (socket says 172.21.15.18:36682) 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f809c9d9640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f809810c170 0x7f809819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f8097fff640 1 -- 172.21.15.18:0/3530442330 learned_addr learned my addr 172.21.15.18:0/3530442330 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f80977fe640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8098103660 0x7f8098198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f8097fff640 1 -- 172.21.15.18:0/3530442330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8098103660 msgr2=0x7f8098198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f8097fff640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8098103660 0x7f8098198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f8097fff640 1 -- 172.21.15.18:0/3530442330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f809810c170 msgr2=0x7f809819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f8097fff640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f809810c170 0x7f809819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f8097fff640 1 -- 172.21.15.18:0/3530442330 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809819d380 con 0x7f8098102d40 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f80977fe640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8098103660 0x7f8098198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.658+0000 7f8097fff640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8098102d40 0x7f80981983d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f808800c920 tx=0x7f808800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.659+0000 7f80957fa640 1 -- 172.21.15.18:0/3530442330 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088007c70 con 0x7f8098102d40 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.659+0000 7f80957fa640 1 -- 172.21.15.18:0/3530442330 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8088007e10 con 0x7f8098102d40 2024-09-19T09:55:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.659+0000 7f80957fa640 1 -- 172.21.15.18:0/3530442330 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088018890 con 0x7f8098102d40 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.659+0000 7f809e43c640 1 -- 172.21.15.18:0/3530442330 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809819d670 con 0x7f8098102d40 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.659+0000 7f809e43c640 1 -- 172.21.15.18:0/3530442330 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80981a4f50 con 0x7f8098102d40 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.661+0000 7f80957fa640 1 -- 172.21.15.18:0/3530442330 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8088018a70 con 0x7f8098102d40 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.661+0000 7f80a0815740 1 Processor -- start 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.661+0000 7f80a0815740 1 -- start start 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f80a0815740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x55827341ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f80957fa640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80800a3240 0x7f80800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f80a0815740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55827341f480 0x558273429800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f80a0815740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558273429d40 0x55827342c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f80a0815740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558273384280 con 0x558273429d40 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f80a0815740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55827332bb10 con 0x55827341eb60 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f80a0815740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558273380240 con 0x55827341f480 2024-09-19T09:55:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f8097fff640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80800a3240 0x7f80800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f809c9d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558273429d40 0x55827342c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f809c9d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x55827341ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f809c9d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x55827341ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34568/0 (socket says 172.21.15.18:34568) 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f809c9d9640 1 -- 172.21.15.18:0/2396665708 learned_addr learned my addr 172.21.15.18:0/2396665708 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f80977fe640 1 --2- 172.21.15.18:0/2396665708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55827341f480 0x558273429800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f80957fa640 1 -- 172.21.15.18:0/3530442330 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f80880cfa90 con 0x7f8098102d40 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f809c9d9640 1 -- 172.21.15.18:0/2396665708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55827341f480 msgr2=0x558273429800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f809c9d9640 1 --2- 172.21.15.18:0/2396665708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55827341f480 0x558273429800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f809c9d9640 1 -- 172.21.15.18:0/2396665708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558273429d40 msgr2=0x55827342c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f809c9d9640 1 --2- 172.21.15.18:0/2396665708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558273429d40 0x55827342c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f809c9d9640 1 -- 172.21.15.18:0/2396665708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582733381f0 con 0x55827341eb60 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f8097fff640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80800a3240 0x7f80800a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f808800c8f0 tx=0x7f80880bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.662+0000 7f809c9d9640 1 --2- 172.21.15.18:0/2396665708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x55827341ef40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f80900092f0 tx=0x7f8090009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a46eddae43a3c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f807e7fc640 1 -- 172.21.15.18:0/2396665708 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090004b20 con 0x55827341eb60 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f807e7fc640 1 -- 172.21.15.18:0/2396665708 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8090003e50 con 0x55827341eb60 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f807e7fc640 1 -- 172.21.15.18:0/2396665708 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090004030 con 0x55827341eb60 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f80a0815740 1 -- 172.21.15.18:0/2396665708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 msgr2=0x55827341ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f80a0815740 1 --2- 172.21.15.18:0/2396665708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x55827341ef40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f80900092f0 tx=0x7f8090009600 comp rx=0 tx=0).stop 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f80a0815740 1 -- 172.21.15.18:0/2396665708 shutdown_connections 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f80a0815740 1 --2- 172.21.15.18:0/2396665708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558273429d40 0x55827342c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f80a0815740 1 --2- 172.21.15.18:0/2396665708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55827341f480 0x558273429800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f80a0815740 1 --2- 172.21.15.18:0/2396665708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x55827341ef40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f80a0815740 1 -- 172.21.15.18:0/2396665708 >> 172.21.15.18:0/2396665708 conn(0x55827341b0f0 msgr2=0x55827341b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f80a0815740 1 -- 172.21.15.18:0/2396665708 shutdown_connections 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.663+0000 7f80a0815740 1 -- 172.21.15.18:0/2396665708 wait complete. 2024-09-19T09:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f80a0815740 1 -- start start 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f80a0815740 1 Processor -- start 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f80a0815740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x558273426bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f80a0815740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 0x558273427110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f80a0815740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558273429d40 0x558273427650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f80a0815740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55827342c910 con 0x55827341eb60 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f80a0815740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55827333ef10 con 0x55827341f480 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f80a0815740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55827342ca90 con 0x558273429d40 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f80a0815740 10 client.0 _ll_register_callbacks cb 0x558273307a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f809c9d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x558273426bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f809c9d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x558273426bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36688/0 (socket says 172.21.15.18:36688) 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f809c9d9640 1 -- 172.21.15.18:0/473115252 learned_addr learned my addr 172.21.15.18:0/473115252 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.664+0000 7f80977fe640 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 0x558273427110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f809c9d9640 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558273429d40 0x558273427650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f809c9d9640 1 -- 172.21.15.18:0/473115252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558273429d40 msgr2=0x558273427650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f809c9d9640 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558273429d40 0x558273427650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f809c9d9640 1 -- 172.21.15.18:0/473115252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 msgr2=0x558273427110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f809c9d9640 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 0x558273427110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f809c9d9640 1 -- 172.21.15.18:0/473115252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582730f56a0 con 0x55827341eb60 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f80977fe640 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 0x558273427110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f809c9d9640 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x558273426bd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f809000f850 tx=0x7f8090009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0810bffae748c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f80777fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f80777fe640 1 -- 172.21.15.18:0/473115252 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090029020 con 0x55827341eb60 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f80777fe640 1 -- 172.21.15.18:0/473115252 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8090005000 con 0x55827341eb60 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f80a0815740 1 -- 172.21.15.18:0/473115252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8090003e50 con 0x55827341eb60 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f80777fe640 1 -- 172.21.15.18:0/473115252 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8090005200 con 0x55827341eb60 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f80a0815740 10 client.16449 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.665+0000 7f80a0815740 1 -- 172.21.15.18:0/473115252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582734384c0 con 0x55827341eb60 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80777fe640 1 -- 172.21.15.18:0/473115252 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8090003e50 con 0x55827341eb60 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80777fe640 1 -- 172.21.15.18:0/473115252 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f809000f040 con 0x55827341eb60 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80a0815740 10 client.16449 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80a0815740 10 client.16449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80a0815740 20 client.16449 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80a0815740 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558273439870 0x55827343bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80a0815740 4 client.16449 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80a0815740 1 -- 172.21.15.18:0/473115252 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582733917f0 con 0x558273439870 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80977fe640 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558273439870 0x55827343bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80977fe640 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558273439870 0x55827343bc60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d5ce45765b7b4e server_cookie=fc6775ad6723a1b1 in_seq=0 out_seq=0 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.666+0000 7f80777fe640 10 client.16449 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.668+0000 7f80777fe640 1 -- 172.21.15.18:0/473115252 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582733917f0 con 0x558273439870 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.668+0000 7f80777fe640 10 client.16449 handle_command_reply: tid=0 2024-09-19T09:55:58.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.668+0000 7f80a0815740 1 client.16449 shutdown 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 1 -- 172.21.15.18:0/473115252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 msgr2=0x558273426bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x558273426bd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f809000f850 tx=0x7f8090009f90 comp rx=0 tx=0).stop 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 1 -- 172.21.15.18:0/473115252 shutdown_connections 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558273439870 0x55827343bc60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558273429d40 0x558273427650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 0x558273427110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 1 --2- 172.21.15.18:0/473115252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x558273426bd0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80777fe640 0 client.16449 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 1 -- 172.21.15.18:0/473115252 >> 172.21.15.18:0/473115252 conn(0x55827341b0f0 msgr2=0x558273420dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 1 -- 172.21.15.18:0/473115252 shutdown_connections 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 1 -- 172.21.15.18:0/473115252 wait complete. 2024-09-19T09:55:58.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.669+0000 7f80a0815740 20 client.16449 trim_cache size 0 max 16384 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f80a0815740 1 Processor -- start 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f80a0815740 1 -- start start 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f80a0815740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x5582734272a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f80a0815740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55827341f480 0x5582734277e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f80a0815740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558273429d40 0x5582734412c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f80a0815740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f80981ad530 con 0x558273429d40 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f80a0815740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f80981af070 con 0x55827341eb60 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f80a0815740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80981adc00 con 0x55827341f480 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f809c9d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558273429d40 0x5582734412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f809c9d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x5582734272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f809c9d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x5582734272a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34580/0 (socket says 172.21.15.18:34580) 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.686+0000 7f809c9d9640 1 -- 172.21.15.18:0/1432884891 learned_addr learned my addr 172.21.15.18:0/1432884891 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.687+0000 7f80977fe640 1 --2- 172.21.15.18:0/1432884891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55827341f480 0x5582734277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.687+0000 7f809c9d9640 1 -- 172.21.15.18:0/1432884891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55827341f480 msgr2=0x5582734277e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.687+0000 7f809c9d9640 1 --2- 172.21.15.18:0/1432884891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55827341f480 0x5582734277e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.687+0000 7f809c9d9640 1 -- 172.21.15.18:0/1432884891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558273429d40 msgr2=0x5582734412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.687+0000 7f809c9d9640 1 --2- 172.21.15.18:0/1432884891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558273429d40 0x5582734412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.687+0000 7f809c9d9640 1 -- 172.21.15.18:0/1432884891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558273429b70 con 0x55827341eb60 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.687+0000 7f809c9d9640 1 --2- 172.21.15.18:0/1432884891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x5582734272a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f80900124e0 tx=0x7f8090000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4104e8d04e8f056a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.687+0000 7f807dffb640 1 -- 172.21.15.18:0/1432884891 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090029030 con 0x55827341eb60 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.687+0000 7f807dffb640 1 -- 172.21.15.18:0/1432884891 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8090009600 con 0x55827341eb60 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.687+0000 7f807dffb640 1 -- 172.21.15.18:0/1432884891 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090005880 con 0x55827341eb60 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 -- 172.21.15.18:0/1432884891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 msgr2=0x5582734272a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 --2- 172.21.15.18:0/1432884891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x5582734272a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f80900124e0 tx=0x7f8090000f40 comp rx=0 tx=0).stop 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 -- 172.21.15.18:0/1432884891 shutdown_connections 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 --2- 172.21.15.18:0/1432884891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558273429d40 0x5582734412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 --2- 172.21.15.18:0/1432884891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55827341f480 0x5582734277e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 --2- 172.21.15.18:0/1432884891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341eb60 0x5582734272a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 -- 172.21.15.18:0/1432884891 >> 172.21.15.18:0/1432884891 conn(0x55827341b0f0 msgr2=0x558273426b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 -- 172.21.15.18:0/1432884891 shutdown_connections 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 -- 172.21.15.18:0/1432884891 wait complete. 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 -- start start 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.688+0000 7f80a0815740 1 Processor -- start 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f80a0815740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x55827342da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f80a0815740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 0x55827342dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f80a0815740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558273429d40 0x55827342e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f80a0815740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f80981ae9a0 con 0x55827341eb60 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f80a0815740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f80981ae2d0 con 0x55827341f480 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f80a0815740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80981ab510 con 0x558273429d40 2024-09-19T09:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f80a0815740 10 client.0 _ll_register_callbacks cb 0x7f8090012510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f809c9d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x55827342da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f809c9d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x55827342da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36702/0 (socket says 172.21.15.18:36702) 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f809c9d9640 1 -- 172.21.15.18:0/3002977212 learned_addr learned my addr 172.21.15.18:0/3002977212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f80977fe640 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 0x55827342dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f809c9d9640 1 -- 172.21.15.18:0/3002977212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558273429d40 msgr2=0x55827342e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f809c9d9640 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558273429d40 0x55827342e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f809c9d9640 1 -- 172.21.15.18:0/3002977212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 msgr2=0x55827342dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f809c9d9640 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 0x55827342dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f809c9d9640 1 -- 172.21.15.18:0/3002977212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582734219d0 con 0x55827341eb60 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f809c9d9640 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x55827342da60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8090004f40 tx=0x7f8090012440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354146594bdedc4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f80777fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.689+0000 7f80777fe640 1 -- 172.21.15.18:0/3002977212 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090024040 con 0x55827341eb60 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80a0815740 1 -- 172.21.15.18:0/3002977212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8090009600 con 0x55827341eb60 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80777fe640 1 -- 172.21.15.18:0/3002977212 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f809000f850 con 0x55827341eb60 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80777fe640 1 -- 172.21.15.18:0/3002977212 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80900125c0 con 0x55827341eb60 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80a0815740 10 client.16455 fetch_fsmap learned FSMap version 28 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80a0815740 1 -- 172.21.15.18:0/3002977212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55827341af20 con 0x55827341eb60 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80777fe640 1 -- 172.21.15.18:0/3002977212 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8090009600 con 0x55827341eb60 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80777fe640 1 -- 172.21.15.18:0/3002977212 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f80900474d0 con 0x55827341eb60 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80a0815740 10 client.16455 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80a0815740 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80a0815740 20 client.16455 populate_metadata read hostname 'smithi018' 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80a0815740 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5582734a4730 0x5582734a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80a0815740 4 client.16455 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80a0815740 1 -- 172.21.15.18:0/3002977212 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55827338bd00 con 0x5582734a4730 2024-09-19T09:55:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.690+0000 7f80977fe640 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5582734a4730 0x5582734a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:55:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.691+0000 7f80977fe640 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5582734a4730 0x5582734a6b20 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6746460ed02b5dde server_cookie=3873d1c295d1e6ed in_seq=0 out_seq=0 2024-09-19T09:55:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:58.691+0000 7f80777fe640 10 client.16455 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:59.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.491+0000 7f80777fe640 1 -- 172.21.15.18:0/3002977212 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55827338bd00 con 0x5582734a4730 2024-09-19T09:55:59.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.491+0000 7f80777fe640 10 client.16455 handle_command_reply: tid=0 2024-09-19T09:55:59.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.491+0000 7f80a0815740 1 client.16455 shutdown 2024-09-19T09:55:59.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.491+0000 7f80a0815740 1 -- 172.21.15.18:0/3002977212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 msgr2=0x55827342da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:59.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.491+0000 7f80a0815740 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x55827342da60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8090004f40 tx=0x7f8090012440 comp rx=0 tx=0).stop 2024-09-19T09:55:59.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.491+0000 7f80a0815740 1 -- 172.21.15.18:0/3002977212 shutdown_connections 2024-09-19T09:55:59.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.491+0000 7f80a0815740 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5582734a4730 0x5582734a6b20 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.491+0000 7f80a0815740 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558273429d40 0x55827342e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.491+0000 7f80a0815740 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55827341f480 0x55827342dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.492+0000 7f80a0815740 1 --2- 172.21.15.18:0/3002977212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55827341eb60 0x55827342da60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.492+0000 7f80777fe640 0 client.16455 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:59.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.492+0000 7f80a0815740 1 -- 172.21.15.18:0/3002977212 >> 172.21.15.18:0/3002977212 conn(0x55827341b0f0 msgr2=0x558273420dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:59.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.492+0000 7f80a0815740 1 -- 172.21.15.18:0/3002977212 shutdown_connections 2024-09-19T09:55:59.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.492+0000 7f80a0815740 1 -- 172.21.15.18:0/3002977212 wait complete. 2024-09-19T09:55:59.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.492+0000 7f80a0815740 20 client.16455 trim_cache size 0 max 16384 2024-09-19T09:55:59.496 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:55:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T09:55:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "f03c2f79-3511-467b-b385-cd60571e2dd8", 2024-09-19T09:55:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T09:55:59.497 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:55:59.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 -- 172.21.15.18:0/3530442330 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80800a3240 msgr2=0x7f80800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80800a3240 0x7f80800a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f808800c8f0 tx=0x7f80880bc040 comp rx=0 tx=0).stop 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 -- 172.21.15.18:0/3530442330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8098102d40 msgr2=0x7f80981983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8098102d40 0x7f80981983d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f808800c920 tx=0x7f808800cde0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 -- 172.21.15.18:0/3530442330 shutdown_connections 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80800a3240 0x7f80800a5700 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f809810c170 0x7f809819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8098103660 0x7f8098198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 --2- 172.21.15.18:0/3530442330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8098102d40 0x7f80981983d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 -- 172.21.15.18:0/3530442330 >> 172.21.15.18:0/3530442330 conn(0x7f80980fc7a0 msgr2=0x7f80980fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 -- 172.21.15.18:0/3530442330 shutdown_connections 2024-09-19T09:55:59.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.493+0000 7f809e43c640 1 -- 172.21.15.18:0/3530442330 wait complete. 2024-09-19T09:55:59.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56117fa640 1 -- 172.21.15.18:0/1242068021 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f5624030070 con 0x55ab16fa7230 2024-09-19T09:55:59.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56117fa640 10 client.16437 handle_command_reply: tid=0 2024-09-19T09:55:59.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 client.16437 shutdown 2024-09-19T09:55:59.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 -- 172.21.15.18:0/1242068021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f21080 msgr2=0x55ab16f33eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:59.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f21080 0x55ab16f33eb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f56180b8e60 tx=0x7f56180bc600 comp rx=0 tx=0).stop 2024-09-19T09:55:59.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 -- 172.21.15.18:0/1242068021 shutdown_connections 2024-09-19T09:55:59.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ab16fa7230 0x55ab16fa9650 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab16f2b940 0x55ab16f30940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab16f21080 0x55ab16f33eb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 --2- 172.21.15.18:0/1242068021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab16f20760 0x55ab16f33970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56117fa640 0 client.16437 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 -- 172.21.15.18:0/1242068021 >> 172.21.15.18:0/1242068021 conn(0x55ab16f1ccf0 msgr2=0x55ab16f1be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 -- 172.21.15.18:0/1242068021 shutdown_connections 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 1 -- 172.21.15.18:0/1242068021 wait complete. 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f56323b3740 20 client.16437 trim_cache size 0 max 16384 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 14, 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:55:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "d9ef7ae2": { 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 14, 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 136.6, 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:55:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:55:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:55:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:55:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:55:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:55:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:55:59.903 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:55:59.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 -- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56140a3450 msgr2=0x7f56140a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56140a3450 0x7f56140a5910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55ab16f1db50 tx=0x7f5624008040 comp rx=0 tx=0).stop 2024-09-19T09:55:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 -- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5628109830 msgr2=0x7f56281a7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:55:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5628109830 0x7f56281a7850 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5618009850 tx=0x7f5618039520 comp rx=0 tx=0).stop 2024-09-19T09:55:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 -- 172.21.15.18:0/762733807 shutdown_connections 2024-09-19T09:55:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f56140a3450 0x7f56140a5910 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f562811b140 0x7f56281abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5628109830 0x7f56281a7850 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 --2- 172.21.15.18:0/762733807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5628109450 0x7f56281a7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:55:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 -- 172.21.15.18:0/762733807 >> 172.21.15.18:0/762733807 conn(0x7f562806e140 msgr2=0x7f562811bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:55:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 -- 172.21.15.18:0/762733807 shutdown_connections 2024-09-19T09:55:59.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:55:59.897+0000 7f562ffda640 1 -- 172.21.15.18:0/762733807 wait complete. 2024-09-19T09:56:00.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:59 smithi018 ceph-mon[30956]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 807 MiB/s wr, 2.33k op/s 2024-09-19T09:56:00.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:59 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T09:56:00.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:59 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:00.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:55:59 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T09:56:00.325 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:56:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:59 smithi049 ceph-mon[34858]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 807 MiB/s wr, 2.33k op/s 2024-09-19T09:56:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:59 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T09:56:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:59 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:55:59 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T09:56:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:59 smithi162 ceph-mon[35174]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 807 MiB/s wr, 2.33k op/s 2024-09-19T09:56:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:59 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T09:56:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:59 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:55:59 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T09:56:00.985 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:00 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:01.013 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd9ef7ae2', quiesce took 11.3 seconds. Will release after: 5.300000000000001 2024-09-19T09:56:01.055 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:01.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:00 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:00 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:01.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.569+0000 7f3892300640 1 -- 172.21.15.18:0/3602611076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f388c102570 msgr2=0x7f388c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:01.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.569+0000 7f3892300640 1 --2- 172.21.15.18:0/3602611076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f388c102570 0x7f388c1029b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3874009900 tx=0x7f387402a480 comp rx=0 tx=0).stop 2024-09-19T09:56:01.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.569+0000 7f3892300640 1 -- 172.21.15.18:0/3602611076 shutdown_connections 2024-09-19T09:56:01.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.569+0000 7f3892300640 1 --2- 172.21.15.18:0/3602611076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c102ef0 0x7f388c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.569+0000 7f3892300640 1 --2- 172.21.15.18:0/3602611076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f388c102570 0x7f388c1029b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.569+0000 7f3892300640 1 --2- 172.21.15.18:0/3602611076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f388c100e20 0x7f388c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.569+0000 7f3892300640 1 -- 172.21.15.18:0/3602611076 >> 172.21.15.18:0/3602611076 conn(0x7f388c0fc7d0 msgr2=0x7f388c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.569+0000 7f3892300640 1 -- 172.21.15.18:0/3602611076 shutdown_connections 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.569+0000 7f3892300640 1 -- 172.21.15.18:0/3602611076 wait complete. 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f3892300640 1 Processor -- start 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f3892300640 1 -- start start 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f3892300640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f388c100e20 0x7f388c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f3892300640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f388c102570 0x7f388c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f3892300640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c102ef0 0x7f388c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f3892300640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f388c110f80 con 0x7f388c100e20 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f3892300640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f388c110e00 con 0x7f388c102ef0 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f3892300640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f388c111100 con 0x7f388c102570 2024-09-19T09:56:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f388bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f388c100e20 0x7f388c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f388bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f388c100e20 0x7f388c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36720/0 (socket says 172.21.15.18:36720) 2024-09-19T09:56:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f388bfff640 1 -- 172.21.15.18:0/3248534586 learned_addr learned my addr 172.21.15.18:0/3248534586 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f3883fff640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f388c102570 0x7f388c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f389089d640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c102ef0 0x7f388c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f388bfff640 1 -- 172.21.15.18:0/3248534586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f388c102570 msgr2=0x7f388c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f388bfff640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f388c102570 0x7f388c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f388bfff640 1 -- 172.21.15.18:0/3248534586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c102ef0 msgr2=0x7f388c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f388bfff640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c102ef0 0x7f388c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.570+0000 7f388bfff640 1 -- 172.21.15.18:0/3248534586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c1a6a20 con 0x7f388c100e20 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.571+0000 7f388bfff640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f388c100e20 0x7f388c0fcc80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f387c00d770 tx=0x7f387c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.571+0000 7f3889ffb640 1 -- 172.21.15.18:0/3248534586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c017070 con 0x7f388c100e20 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.571+0000 7f3889ffb640 1 -- 172.21.15.18:0/3248534586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f387c005500 con 0x7f388c100e20 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.571+0000 7f3892300640 1 -- 172.21.15.18:0/3248534586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388c1a6d10 con 0x7f388c100e20 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.571+0000 7f3889ffb640 1 -- 172.21.15.18:0/3248534586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c004e00 con 0x7f388c100e20 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.571+0000 7f3892300640 1 -- 172.21.15.18:0/3248534586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f388c1a71c0 con 0x7f388c100e20 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f3889ffb640 1 -- 172.21.15.18:0/3248534586 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f387c004fa0 con 0x7f388c100e20 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f38946d9740 1 Processor -- start 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f38946d9740 1 -- start start 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f38946d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904d4a0 0x56222904d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f38946d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904ddc0 0x562229058140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f38946d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 0x56222905aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f38946d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562228fb32e0 con 0x56222904ddc0 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f38946d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562228f5ace0 con 0x56222904d4a0 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f38946d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562228faf2a0 con 0x562229058680 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f388bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904ddc0 0x562229058140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f388bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904ddc0 0x562229058140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36730/0 (socket says 172.21.15.18:36730) 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f388bfff640 1 -- 172.21.15.18:0/478083761 learned_addr learned my addr 172.21.15.18:0/478083761 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f389089d640 1 --2- 172.21.15.18:0/478083761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904d4a0 0x56222904d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f3883fff640 1 --2- 172.21.15.18:0/478083761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 0x56222905aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f3889ffb640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f38780a32c0 0x7f38780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f388bfff640 1 -- 172.21.15.18:0/478083761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 msgr2=0x56222905aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f388bfff640 1 --2- 172.21.15.18:0/478083761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 0x56222905aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f388bfff640 1 -- 172.21.15.18:0/478083761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904d4a0 msgr2=0x56222904d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:01.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f388bfff640 1 --2- 172.21.15.18:0/478083761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904d4a0 0x56222904d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f388bfff640 1 -- 172.21.15.18:0/478083761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562228f3f440 con 0x56222904ddc0 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.574+0000 7f389089d640 1 --2- 172.21.15.18:0/478083761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904d4a0 0x56222904d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.575+0000 7f389089d640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f38780a32c0 0x7f38780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.575+0000 7f3889ffb640 1 -- 172.21.15.18:0/3248534586 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f387c0cf2f0 con 0x7f388c100e20 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.575+0000 7f388bfff640 1 --2- 172.21.15.18:0/478083761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904ddc0 0x562229058140 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f387c09c6a0 tx=0x7f387c0afaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9953f69c49b0251 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.575+0000 7f38827fc640 1 -- 172.21.15.18:0/478083761 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c020070 con 0x56222904ddc0 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.575+0000 7f38827fc640 1 -- 172.21.15.18:0/478083761 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f387c09b940 con 0x56222904ddc0 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.575+0000 7f38827fc640 1 -- 172.21.15.18:0/478083761 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c09bba0 con 0x56222904ddc0 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 -- 172.21.15.18:0/478083761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904ddc0 msgr2=0x562229058140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 --2- 172.21.15.18:0/478083761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904ddc0 0x562229058140 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f387c09c6a0 tx=0x7f387c0afaa0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f389089d640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f38780a32c0 0x7f38780a5780 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3884009fd0 tx=0x7f3884004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 -- 172.21.15.18:0/478083761 shutdown_connections 2024-09-19T09:56:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 --2- 172.21.15.18:0/478083761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 0x56222905aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 --2- 172.21.15.18:0/478083761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904ddc0 0x562229058140 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 --2- 172.21.15.18:0/478083761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904d4a0 0x56222904d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 -- 172.21.15.18:0/478083761 >> 172.21.15.18:0/478083761 conn(0x562229049a30 msgr2=0x562229049e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 -- 172.21.15.18:0/478083761 shutdown_connections 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 -- 172.21.15.18:0/478083761 wait complete. 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 -- start start 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.576+0000 7f38946d9740 1 Processor -- start 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f38946d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229057f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f38946d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904ddc0 0x562229055220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f38946d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562229058680 0x562229055760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f38946d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56222905b250 con 0x56222904d4a0 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f38946d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562228f6e050 con 0x562229058680 2024-09-19T09:56:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f38946d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56222905b3d0 con 0x56222904ddc0 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f38946d9740 10 client.0 _ll_register_callbacks cb 0x562228fae160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f388bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229057f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f388bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229057f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36732/0 (socket says 172.21.15.18:36732) 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f388bfff640 1 -- 172.21.15.18:0/2002611038 learned_addr learned my addr 172.21.15.18:0/2002611038 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f3883fff640 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904ddc0 0x562229055220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f389089d640 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562229058680 0x562229055760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f388bfff640 1 -- 172.21.15.18:0/2002611038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904ddc0 msgr2=0x562229055220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f388bfff640 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904ddc0 0x562229055220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f388bfff640 1 -- 172.21.15.18:0/2002611038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562229058680 msgr2=0x562229055760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f388bfff640 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562229058680 0x562229055760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f388bfff640 1 -- 172.21.15.18:0/2002611038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562228d243c0 con 0x56222904d4a0 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f388bfff640 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229057f70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f387c098310 tx=0x7f387c0048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5073bfe47d77b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.577+0000 7f386b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f386b7fe640 1 -- 172.21.15.18:0/2002611038 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c020070 con 0x56222904d4a0 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f386b7fe640 1 -- 172.21.15.18:0/2002611038 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f387c0999e0 con 0x56222904d4a0 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f38946d9740 1 -- 172.21.15.18:0/2002611038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562228fc0850 con 0x56222904d4a0 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f386b7fe640 1 -- 172.21.15.18:0/2002611038 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f387c09b480 con 0x56222904d4a0 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f38946d9740 10 client.16467 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f38946d9740 1 -- 172.21.15.18:0/2002611038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56222905b250 con 0x56222904d4a0 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f386b7fe640 1 -- 172.21.15.18:0/2002611038 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562228fc0850 con 0x56222904d4a0 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f386b7fe640 1 -- 172.21.15.18:0/2002611038 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f387c097fb0 con 0x56222904d4a0 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f38946d9740 10 client.16467 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f38946d9740 10 client.16467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:01.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f38946d9740 20 client.16467 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f38946d9740 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562229067d40 0x56222906a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f38946d9740 4 client.16467 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.578+0000 7f38946d9740 1 -- 172.21.15.18:0/2002611038 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562228fbad60 con 0x562229067d40 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.579+0000 7f3883fff640 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562229067d40 0x56222906a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.579+0000 7f3883fff640 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562229067d40 0x56222906a130 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84e2bf05f14d9d96 server_cookie=a8423a770712852e in_seq=0 out_seq=0 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.579+0000 7f386b7fe640 10 client.16467 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f386b7fe640 1 -- 172.21.15.18:0/2002611038 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562228fbad60 con 0x562229067d40 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f386b7fe640 10 client.16467 handle_command_reply: tid=0 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 client.16467 shutdown 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 -- 172.21.15.18:0/2002611038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 msgr2=0x562229057f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229057f70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f387c098310 tx=0x7f387c0048a0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 -- 172.21.15.18:0/2002611038 shutdown_connections 2024-09-19T09:56:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562229067d40 0x56222906a130 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562229058680 0x562229055760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904ddc0 0x562229055220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 --2- 172.21.15.18:0/2002611038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229057f70 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f386b7fe640 0 client.16467 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 -- 172.21.15.18:0/2002611038 >> 172.21.15.18:0/2002611038 conn(0x562229049a30 msgr2=0x56222904f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 -- 172.21.15.18:0/2002611038 shutdown_connections 2024-09-19T09:56:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 1 -- 172.21.15.18:0/2002611038 wait complete. 2024-09-19T09:56:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.580+0000 7f38946d9740 20 client.16467 trim_cache size 0 max 16384 2024-09-19T09:56:01.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.597+0000 7f38946d9740 1 Processor -- start 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f38946d9740 1 -- start start 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f38946d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229054b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f38946d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904ddc0 0x562229060620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f38946d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 0x562229060b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f38946d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1af6b0 con 0x56222904d4a0 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f38946d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1b11f0 con 0x56222904ddc0 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f38946d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1afd80 con 0x562229058680 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f388bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229054b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f388bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229054b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36740/0 (socket says 172.21.15.18:36740) 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f388bfff640 1 -- 172.21.15.18:0/44765201 learned_addr learned my addr 172.21.15.18:0/44765201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f389089d640 1 --2- 172.21.15.18:0/44765201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 0x562229060b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f388bfff640 1 -- 172.21.15.18:0/44765201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 msgr2=0x562229060b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f388bfff640 1 --2- 172.21.15.18:0/44765201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 0x562229060b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f388bfff640 1 -- 172.21.15.18:0/44765201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904ddc0 msgr2=0x562229060620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f388bfff640 1 --2- 172.21.15.18:0/44765201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904ddc0 0x562229060620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f388bfff640 1 -- 172.21.15.18:0/44765201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222904dbf0 con 0x56222904d4a0 2024-09-19T09:56:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f389089d640 1 --2- 172.21.15.18:0/44765201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 0x562229060b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:56:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.598+0000 7f388bfff640 1 --2- 172.21.15.18:0/44765201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229054b00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f387c00d740 tx=0x7f387c0cf5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95faaa629fda508 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f3881ffb640 1 -- 172.21.15.18:0/44765201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c020070 con 0x56222904d4a0 2024-09-19T09:56:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f3881ffb640 1 -- 172.21.15.18:0/44765201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f387c09c040 con 0x56222904d4a0 2024-09-19T09:56:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f3881ffb640 1 -- 172.21.15.18:0/44765201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c0ba2a0 con 0x56222904d4a0 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f38946d9740 1 -- 172.21.15.18:0/44765201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 msgr2=0x562229054b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f38946d9740 1 --2- 172.21.15.18:0/44765201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229054b00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f387c00d740 tx=0x7f387c0cf5b0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f38946d9740 1 -- 172.21.15.18:0/44765201 shutdown_connections 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f38946d9740 1 --2- 172.21.15.18:0/44765201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562229058680 0x562229060b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f38946d9740 1 --2- 172.21.15.18:0/44765201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904ddc0 0x562229060620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f38946d9740 1 --2- 172.21.15.18:0/44765201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56222904d4a0 0x562229054b00 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f38946d9740 1 -- 172.21.15.18:0/44765201 >> 172.21.15.18:0/44765201 conn(0x562229049a30 msgr2=0x5622290634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f38946d9740 1 -- 172.21.15.18:0/44765201 shutdown_connections 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.599+0000 7f38946d9740 1 -- 172.21.15.18:0/44765201 wait complete. 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f38946d9740 1 -- start start 2024-09-19T09:56:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f38946d9740 1 Processor -- start 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f38946d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904d4a0 0x562229060c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f38946d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904ddc0 0x56222905dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f38946d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562229058680 0x56222905e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f38946d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1b0b20 con 0x562229058680 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f38946d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1b0450 con 0x56222904ddc0 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f38946d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1ad6b0 con 0x56222904d4a0 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f38946d9740 10 client.0 _ll_register_callbacks cb 0x7f38840099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f389089d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562229058680 0x56222905e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f388bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904d4a0 0x562229060c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f389089d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562229058680 0x56222905e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36748/0 (socket says 172.21.15.18:36748) 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f388bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904d4a0 0x562229060c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45064/0 (socket says 172.21.15.18:45064) 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.600+0000 7f389089d640 1 -- 172.21.15.18:0/1729012724 learned_addr learned my addr 172.21.15.18:0/1729012724 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f3883fff640 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904ddc0 0x56222905dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f389089d640 1 -- 172.21.15.18:0/1729012724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904d4a0 msgr2=0x562229060c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f389089d640 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904d4a0 0x562229060c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f389089d640 1 -- 172.21.15.18:0/1729012724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904ddc0 msgr2=0x56222905dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f389089d640 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904ddc0 0x56222905dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f389089d640 1 -- 172.21.15.18:0/1729012724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56222905ec20 con 0x562229058680 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f389089d640 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562229058680 0x56222905e530 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3884005c00 tx=0x7f3884004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fa8bf40e0c0475 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f386b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f386b7fe640 1 -- 172.21.15.18:0/1729012724 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884003c40 con 0x562229058680 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f386b7fe640 1 -- 172.21.15.18:0/1729012724 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3884003de0 con 0x562229058680 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f38946d9740 1 -- 172.21.15.18:0/1729012724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f387c09c040 con 0x562229058680 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f386b7fe640 1 -- 172.21.15.18:0/1729012724 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f388402f070 con 0x562229058680 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f38946d9740 10 client.16473 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.601+0000 7f38946d9740 1 -- 172.21.15.18:0/1729012724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5622290d2660 con 0x562229058680 2024-09-19T09:56:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.602+0000 7f386b7fe640 1 -- 172.21.15.18:0/1729012724 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f387c09c040 con 0x562229058680 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.602+0000 7f386b7fe640 1 -- 172.21.15.18:0/1729012724 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3884026020 con 0x562229058680 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.602+0000 7f38946d9740 10 client.16473 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.602+0000 7f38946d9740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.602+0000 7f38946d9740 20 client.16473 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.602+0000 7f38946d9740 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5622290d2de0 0x5622290d5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.602+0000 7f38946d9740 4 client.16473 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.602+0000 7f38946d9740 1 -- 172.21.15.18:0/1729012724 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562228f37210 con 0x5622290d2de0 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.602+0000 7f388bfff640 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5622290d2de0 0x5622290d5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f388bfff640 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5622290d2de0 0x5622290d5200 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f96f431409a07fe server_cookie=4c7e5403c1836892 in_seq=0 out_seq=0 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f386b7fe640 10 client.16473 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f386b7fe640 1 -- 172.21.15.18:0/1729012724 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562228f37210 con 0x5622290d2de0 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f386b7fe640 10 client.16473 handle_command_reply: tid=0 2024-09-19T09:56:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 client.16473 shutdown 2024-09-19T09:56:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 -- 172.21.15.18:0/1729012724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562229058680 msgr2=0x56222905e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562229058680 0x56222905e530 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3884005c00 tx=0x7f3884004ab0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 -- 172.21.15.18:0/1729012724 shutdown_connections 2024-09-19T09:56:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5622290d2de0 0x5622290d5200 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f386b7fe640 0 client.16473 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562229058680 0x56222905e530 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56222904ddc0 0x56222905dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 --2- 172.21.15.18:0/1729012724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56222904d4a0 0x562229060c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 -- 172.21.15.18:0/1729012724 >> 172.21.15.18:0/1729012724 conn(0x562229049a30 msgr2=0x562229054310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 -- 172.21.15.18:0/1729012724 shutdown_connections 2024-09-19T09:56:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 1 -- 172.21.15.18:0/1729012724 wait complete. 2024-09-19T09:56:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.603+0000 7f38946d9740 20 client.16473 trim_cache size 0 max 16384 2024-09-19T09:56:01.611 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:56:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:56:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T09:56:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "f03c2f79-3511-467b-b385-cd60571e2dd8": { 2024-09-19T09:56:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T09:56:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "f03c2f79-3511-467b-b385-cd60571e2dd8", 2024-09-19T09:56:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T09:56:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:01.612 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:56:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 -- 172.21.15.18:0/3248534586 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f38780a32c0 msgr2=0x7f38780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f38780a32c0 0x7f38780a5780 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3884009fd0 tx=0x7f3884004a40 comp rx=0 tx=0).stop 2024-09-19T09:56:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 -- 172.21.15.18:0/3248534586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f388c100e20 msgr2=0x7f388c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f388c100e20 0x7f388c0fcc80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f387c00d770 tx=0x7f387c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:56:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 -- 172.21.15.18:0/3248534586 shutdown_connections 2024-09-19T09:56:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f38780a32c0 0x7f38780a5780 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c102ef0 0x7f388c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f388c102570 0x7f388c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 --2- 172.21.15.18:0/3248534586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f388c100e20 0x7f388c0fcc80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 -- 172.21.15.18:0/3248534586 >> 172.21.15.18:0/3248534586 conn(0x7f388c0fc7d0 msgr2=0x7f388c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 -- 172.21.15.18:0/3248534586 shutdown_connections 2024-09-19T09:56:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:01.604+0000 7f3892300640 1 -- 172.21.15.18:0/3248534586 wait complete. 2024-09-19T09:56:02.229 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:01 smithi018 ceph-mon[30956]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 830 MiB/s wr, 2.52k op/s 2024-09-19T09:56:02.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:01 smithi049 ceph-mon[34858]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 830 MiB/s wr, 2.52k op/s 2024-09-19T09:56:02.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:01 smithi162 ceph-mon[35174]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 830 MiB/s wr, 2.52k op/s 2024-09-19T09:56:02.467 INFO:tasks.cephfs.filesystem:scrub status for tag:f03c2f79-3511-467b-b385-cd60571e2dd8 - {'path': '/', 'tag': 'f03c2f79-3511-467b-b385-cd60571e2dd8', 'options': 'recursive,force'} 2024-09-19T09:56:04.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:03 smithi018 ceph-mon[30956]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 86 GiB used, 986 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 752 MiB/s wr, 2.22k op/s 2024-09-19T09:56:04.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:03 smithi049 ceph-mon[34858]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 86 GiB used, 986 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 752 MiB/s wr, 2.22k op/s 2024-09-19T09:56:04.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:03 smithi162 ceph-mon[35174]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 86 GiB used, 986 GiB / 1.0 TiB avail; 2.6 MiB/s rd, 752 MiB/s wr, 2.22k op/s 2024-09-19T09:56:05.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:04 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T09:56:05.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:04 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T09:56:05.412 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:04 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T09:56:06.315 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:56:06.342 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:05 smithi018 ceph-mon[30956]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 579 MiB/s wr, 1.77k op/s 2024-09-19T09:56:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:05 smithi049 ceph-mon[34858]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 579 MiB/s wr, 1.77k op/s 2024-09-19T09:56:06.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:05 smithi162 ceph-mon[35174]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 579 MiB/s wr, 1.77k op/s 2024-09-19T09:56:06.583 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:07.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.079+0000 7f7f57211640 1 -- 172.21.15.18:0/2086304244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f50102790 msgr2=0x7f7f501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:07.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.079+0000 7f7f57211640 1 --2- 172.21.15.18:0/2086304244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f50102790 0x7f7f501067e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009900 tx=0x7f7f3802a410 comp rx=0 tx=0).stop 2024-09-19T09:56:07.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.079+0000 7f7f57211640 1 -- 172.21.15.18:0/2086304244 shutdown_connections 2024-09-19T09:56:07.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.079+0000 7f7f57211640 1 --2- 172.21.15.18:0/2086304244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f50106f10 0x7f7f5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.079+0000 7f7f57211640 1 --2- 172.21.15.18:0/2086304244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f50102790 0x7f7f501067e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.079+0000 7f7f57211640 1 --2- 172.21.15.18:0/2086304244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50101de0 0x7f7f501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.079+0000 7f7f57211640 1 -- 172.21.15.18:0/2086304244 >> 172.21.15.18:0/2086304244 conn(0x7f7f500fd8c0 msgr2=0x7f7f500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.079+0000 7f7f57211640 1 -- 172.21.15.18:0/2086304244 shutdown_connections 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.079+0000 7f7f57211640 1 -- 172.21.15.18:0/2086304244 wait complete. 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f57211640 1 Processor -- start 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f57211640 1 -- start start 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f57211640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f50101de0 0x7f7f50198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f57211640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50102790 0x7f7f501989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f57211640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f50106f10 0x7f7f5019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f57211640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7f50111fb0 con 0x7f7f50106f10 2024-09-19T09:56:07.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f57211640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7f50111e30 con 0x7f7f50102790 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f57211640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f50112130 con 0x7f7f50101de0 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f557ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f50106f10 0x7f7f5019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f557ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f50106f10 0x7f7f5019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53906/0 (socket says 172.21.15.18:53906) 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f557ae640 1 -- 172.21.15.18:0/2041941890 learned_addr learned my addr 172.21.15.18:0/2041941890 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f54fad640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f50101de0 0x7f7f50198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f4ffff640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50102790 0x7f7f501989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f557ae640 1 -- 172.21.15.18:0/2041941890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f50101de0 msgr2=0x7f7f50198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f557ae640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f50101de0 0x7f7f50198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f557ae640 1 -- 172.21.15.18:0/2041941890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50102790 msgr2=0x7f7f501989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f557ae640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50102790 0x7f7f501989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f557ae640 1 -- 172.21.15.18:0/2041941890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5019d440 con 0x7f7f50106f10 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.080+0000 7f7f4ffff640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50102790 0x7f7f501989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:56:07.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.081+0000 7f7f557ae640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f50106f10 0x7f7f5019cd60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800eaa0 tx=0x7f7f4800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.081+0000 7f7f4dffb640 1 -- 172.21.15.18:0/2041941890 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48004d20 con 0x7f7f50106f10 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.081+0000 7f7f57211640 1 -- 172.21.15.18:0/2041941890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5019d730 con 0x7f7f50106f10 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.081+0000 7f7f4dffb640 1 -- 172.21.15.18:0/2041941890 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f48005020 con 0x7f7f50106f10 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.081+0000 7f7f4dffb640 1 -- 172.21.15.18:0/2041941890 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f480116d0 con 0x7f7f50106f10 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.081+0000 7f7f57211640 1 -- 172.21.15.18:0/2041941890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f501a5010 con 0x7f7f50106f10 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.082+0000 7f7f57211640 1 -- 172.21.15.18:0/2041941890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f501021c0 con 0x7f7f50106f10 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.083+0000 7f7f4dffb640 1 -- 172.21.15.18:0/2041941890 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7f480051d0 con 0x7f7f50106f10 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.084+0000 7f7f4dffb640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f3c0a3240 0x7f7f3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.084+0000 7f7f4dffb640 1 -- 172.21.15.18:0/2041941890 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7f480cfb60 con 0x7f7f50106f10 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.084+0000 7f7f54fad640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f3c0a3240 0x7f7f3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.085+0000 7f7f54fad640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f3c0a3240 0x7f7f3c0a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009990 tx=0x7f7f40009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.088+0000 7f7f4dffb640 1 -- 172.21.15.18:0/2041941890 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f48016030 con 0x7f7f50106f10 2024-09-19T09:56:07.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.300+0000 7f7f57211640 1 -- 172.21.15.18:0/2041941890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f5002d7c0 con 0x7f7f50106f10 2024-09-19T09:56:07.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.301+0000 7f7f4dffb640 1 -- 172.21.15.18:0/2041941890 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f7f4809c850 con 0x7f7f50106f10 2024-09-19T09:56:07.304 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:56:07.304 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:56:07.304 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:56:07.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 -- 172.21.15.18:0/2041941890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f3c0a3240 msgr2=0x7f7f3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:07.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f3c0a3240 0x7f7f3c0a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009990 tx=0x7f7f40009110 comp rx=0 tx=0).stop 2024-09-19T09:56:07.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 -- 172.21.15.18:0/2041941890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f50106f10 msgr2=0x7f7f5019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:07.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f50106f10 0x7f7f5019cd60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800eaa0 tx=0x7f7f4800eea0 comp rx=0 tx=0).stop 2024-09-19T09:56:07.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 -- 172.21.15.18:0/2041941890 shutdown_connections 2024-09-19T09:56:07.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f3c0a3240 0x7f7f3c0a5700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:07.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f50106f10 0x7f7f5019cd60 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:07.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f50102790 0x7f7f501989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:07.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 --2- 172.21.15.18:0/2041941890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f50101de0 0x7f7f50198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:07.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 -- 172.21.15.18:0/2041941890 >> 172.21.15.18:0/2041941890 conn(0x7f7f500fd8c0 msgr2=0x7f7f500fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:07.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 -- 172.21.15.18:0/2041941890 shutdown_connections 2024-09-19T09:56:07.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:07.305+0000 7f7f57211640 1 -- 172.21.15.18:0/2041941890 wait complete. 2024-09-19T09:56:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --set-id d9ef7ae2 --release --await' 2024-09-19T09:56:08.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --set-id d9ef7ae2 --release --await 2024-09-19T09:56:08.331 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:08.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:07 smithi018 ceph-mon[30956]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 441 MiB/s wr, 1.33k op/s 2024-09-19T09:56:08.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:07 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2041941890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:56:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:07 smithi049 ceph-mon[34858]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 441 MiB/s wr, 1.33k op/s 2024-09-19T09:56:08.535 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:07 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2041941890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:56:08.536 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:07 smithi162 ceph-mon[35174]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 441 MiB/s wr, 1.33k op/s 2024-09-19T09:56:08.536 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:07 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2041941890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:56:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2210159487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f18101de0 msgr2=0x7f5f181021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 --2- 172.21.15.18:0/2210159487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f18101de0 0x7f5f181021c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009900 tx=0x7f5f1002a410 comp rx=0 tx=0).stop 2024-09-19T09:56:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2210159487 shutdown_connections 2024-09-19T09:56:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 --2- 172.21.15.18:0/2210159487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f18106f10 0x7f5f1810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 --2- 172.21.15.18:0/2210159487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f18102790 0x7f5f181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 --2- 172.21.15.18:0/2210159487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f18101de0 0x7f5f181021c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2210159487 >> 172.21.15.18:0/2210159487 conn(0x7f5f180fd8c0 msgr2=0x7f5f180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2210159487 shutdown_connections 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2210159487 wait complete. 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 Processor -- start 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.820+0000 7f5f1eb25640 1 -- start start 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f1eb25640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f18101de0 0x7f5f18198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f1eb25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f18102790 0x7f5f18198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f1eb25640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f18106f10 0x7f5f1819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f1eb25640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18111fb0 con 0x7f5f18102790 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f1eb25640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18111e30 con 0x7f5f18101de0 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f1eb25640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18112130 con 0x7f5f18106f10 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f18102790 0x7f5f18198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f18102790 0x7f5f18198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53928/0 (socket says 172.21.15.18:53928) 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f17fff640 1 -- 172.21.15.18:0/2121299592 learned_addr learned my addr 172.21.15.18:0/2121299592 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f1d0c2640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f18106f10 0x7f5f1819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f1c8c1640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f18101de0 0x7f5f18198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f17fff640 1 -- 172.21.15.18:0/2121299592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f18106f10 msgr2=0x7f5f1819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f17fff640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f18106f10 0x7f5f1819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f17fff640 1 -- 172.21.15.18:0/2121299592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f18101de0 msgr2=0x7f5f18198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f17fff640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f18101de0 0x7f5f18198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f17fff640 1 -- 172.21.15.18:0/2121299592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1819d4e0 con 0x7f5f18102790 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f1c8c1640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f18101de0 0x7f5f18198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.821+0000 7f5f17fff640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f18102790 0x7f5f18198a70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000b4a0 tx=0x7f5f0000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.822+0000 7f5f15ffb640 1 -- 172.21.15.18:0/2121299592 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00014070 con 0x7f5f18102790 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.822+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2121299592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1819d7d0 con 0x7f5f18102790 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.822+0000 7f5f15ffb640 1 -- 172.21.15.18:0/2121299592 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f00010af0 con 0x7f5f18102790 2024-09-19T09:56:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.822+0000 7f5f15ffb640 1 -- 172.21.15.18:0/2121299592 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00017d10 con 0x7f5f18102790 2024-09-19T09:56:08.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.822+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2121299592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f181a50b0 con 0x7f5f18102790 2024-09-19T09:56:08.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.824+0000 7f5f15ffb640 1 -- 172.21.15.18:0/2121299592 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5f00017070 con 0x7f5f18102790 2024-09-19T09:56:08.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.824+0000 7f5f20efe740 1 Processor -- start 2024-09-19T09:56:08.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.824+0000 7f5f20efe740 1 -- start start 2024-09-19T09:56:08.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14627f20 0x55bd14628300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14628840 0x55bd14637110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14639a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f20efe740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bd1458d620 con 0x55bd14637650 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f20efe740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bd14534e50 con 0x55bd14627f20 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f20efe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bd145895e0 con 0x55bd14628840 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14639a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14639a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53940/0 (socket says 172.21.15.18:53940) 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f17fff640 1 -- 172.21.15.18:0/1143142068 learned_addr learned my addr 172.21.15.18:0/1143142068 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f1c8c1640 1 --2- 172.21.15.18:0/1143142068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14628840 0x55bd14637110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f1d0c2640 1 --2- 172.21.15.18:0/1143142068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14627f20 0x55bd14628300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f15ffb640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f040a3240 0x7f5f040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f1d0c2640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f040a3240 0x7f5f040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f17fff640 1 -- 172.21.15.18:0/1143142068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14628840 msgr2=0x55bd14637110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f17fff640 1 --2- 172.21.15.18:0/1143142068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14628840 0x55bd14637110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f17fff640 1 -- 172.21.15.18:0/1143142068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14627f20 msgr2=0x55bd14628300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f17fff640 1 --2- 172.21.15.18:0/1143142068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14627f20 0x55bd14628300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f15ffb640 1 -- 172.21.15.18:0/2121299592 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5f000cecb0 con 0x7f5f18102790 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f17fff640 1 -- 172.21.15.18:0/1143142068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd14525d40 con 0x55bd14637650 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.825+0000 7f5f1c8c1640 1 --2- 172.21.15.18:0/1143142068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14628840 0x55bd14637110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.826+0000 7f5f17fff640 1 --2- 172.21.15.18:0/1143142068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14639a40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5f0009b290 tx=0x7f5f000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9c60ebfece81ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.826+0000 7f5f1d0c2640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f040a3240 0x7f5f040a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5f080098b0 tx=0x7f5f08004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.826+0000 7f5f0effd640 1 -- 172.21.15.18:0/1143142068 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0001e020 con 0x55bd14637650 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.826+0000 7f5f0effd640 1 -- 172.21.15.18:0/1143142068 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f0009ba00 con 0x55bd14637650 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.826+0000 7f5f0effd640 1 -- 172.21.15.18:0/1143142068 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00010ca0 con 0x55bd14637650 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.826+0000 7f5f20efe740 1 -- 172.21.15.18:0/1143142068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 msgr2=0x55bd14639a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.826+0000 7f5f20efe740 1 --2- 172.21.15.18:0/1143142068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14639a40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5f0009b290 tx=0x7f5f000046c0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 -- 172.21.15.18:0/1143142068 shutdown_connections 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 --2- 172.21.15.18:0/1143142068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14639a40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 --2- 172.21.15.18:0/1143142068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14628840 0x55bd14637110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 --2- 172.21.15.18:0/1143142068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14627f20 0x55bd14628300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 -- 172.21.15.18:0/1143142068 >> 172.21.15.18:0/1143142068 conn(0x55bd146245f0 msgr2=0x55bd146249d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 -- 172.21.15.18:0/1143142068 shutdown_connections 2024-09-19T09:56:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 -- 172.21.15.18:0/1143142068 wait complete. 2024-09-19T09:56:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 -- start start 2024-09-19T09:56:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 Processor -- start 2024-09-19T09:56:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14627f20 0x55bd14634560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14628840 0x55bd14634aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14634fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.827+0000 7f5f20efe740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bd1463a1c0 con 0x55bd14637650 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f20efe740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bd14515f10 con 0x55bd14628840 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f20efe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bd1463a340 con 0x55bd14627f20 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f20efe740 10 client.0 _ll_register_callbacks cb 0x55bd14539db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f1d0c2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14634fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f1c8c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14627f20 0x55bd14634560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f1d0c2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14634fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53956/0 (socket says 172.21.15.18:53956) 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f1d0c2640 1 -- 172.21.15.18:0/728041242 learned_addr learned my addr 172.21.15.18:0/728041242 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f17fff640 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14628840 0x55bd14634aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f1d0c2640 1 -- 172.21.15.18:0/728041242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14627f20 msgr2=0x55bd14634560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f1d0c2640 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14627f20 0x55bd14634560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f1d0c2640 1 -- 172.21.15.18:0/728041242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14628840 msgr2=0x55bd14634aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f1d0c2640 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14628840 0x55bd14634aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f1d0c2640 1 -- 172.21.15.18:0/728041242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd1429c580 con 0x55bd14637650 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f17fff640 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14628840 0x55bd14634aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f1d0c2640 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14634fe0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5f08015010 tx=0x7f5f08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc607608104bea80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5ef7fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5ef7fff640 1 -- 172.21.15.18:0/728041242 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f08025020 con 0x55bd14637650 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5ef7fff640 1 -- 172.21.15.18:0/728041242 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5f080045b0 con 0x55bd14637650 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.828+0000 7f5f20efe740 1 -- 172.21.15.18:0/728041242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f0009ba00 con 0x55bd14637650 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5ef7fff640 1 -- 172.21.15.18:0/728041242 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f0801a040 con 0x55bd14637650 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5f20efe740 10 client.16491 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5f20efe740 1 -- 172.21.15.18:0/728041242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bd14366960 con 0x55bd14637650 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5ef7fff640 1 -- 172.21.15.18:0/728041242 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f0009ba00 con 0x55bd14637650 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5ef7fff640 1 -- 172.21.15.18:0/728041242 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f08020040 con 0x55bd14637650 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5f20efe740 10 client.16491 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5f20efe740 10 client.16491 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5f20efe740 20 client.16491 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5f20efe740 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bd146472d0 0x55bd146496c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5f20efe740 4 client.16491 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5f20efe740 1 -- 172.21.15.18:0/728041242 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd1459ab90 con 0x55bd146472d0 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.829+0000 7f5f1c8c1640 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bd146472d0 0x55bd146496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.830+0000 7f5f1c8c1640 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bd146472d0 0x55bd146496c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe0c7ae8d2849914 server_cookie=1143ed94c0363f6f in_seq=0 out_seq=0 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.830+0000 7f5ef7fff640 10 client.16491 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5ef7fff640 1 -- 172.21.15.18:0/728041242 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd1459ab90 con 0x55bd146472d0 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5ef7fff640 10 client.16491 handle_command_reply: tid=0 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 client.16491 shutdown 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 -- 172.21.15.18:0/728041242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 msgr2=0x55bd14634fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14634fe0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5f08015010 tx=0x7f5f08004a40 comp rx=0 tx=0).stop 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 -- 172.21.15.18:0/728041242 shutdown_connections 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bd146472d0 0x55bd146496c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14637650 0x55bd14634fe0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14628840 0x55bd14634aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 --2- 172.21.15.18:0/728041242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14627f20 0x55bd14634560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 -- 172.21.15.18:0/728041242 >> 172.21.15.18:0/728041242 conn(0x55bd146245f0 msgr2=0x55bd1462a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5ef7fff640 0 client.16491 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 -- 172.21.15.18:0/728041242 shutdown_connections 2024-09-19T09:56:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 1 -- 172.21.15.18:0/728041242 wait complete. 2024-09-19T09:56:08.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.831+0000 7f5f20efe740 20 client.16491 trim_cache size 0 max 16384 2024-09-19T09:56:08.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.848+0000 7f5f20efe740 1 Processor -- start 2024-09-19T09:56:08.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.848+0000 7f5f20efe740 1 -- start start 2024-09-19T09:56:08.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.848+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14627f20 0x55bd14636430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.848+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1464ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.848+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14637650 0x55bd1464f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.848+0000 7f5f20efe740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f181ab3e0 con 0x55bd14628840 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.848+0000 7f5f20efe740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f181acf20 con 0x55bd14627f20 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.848+0000 7f5f20efe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f181abab0 con 0x55bd14637650 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1464ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1464ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53970/0 (socket says 172.21.15.18:53970) 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f17fff640 1 -- 172.21.15.18:0/3027550297 learned_addr learned my addr 172.21.15.18:0/3027550297 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f1d0c2640 1 --2- 172.21.15.18:0/3027550297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14637650 0x55bd1464f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f1c8c1640 1 --2- 172.21.15.18:0/3027550297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14627f20 0x55bd14636430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f17fff640 1 -- 172.21.15.18:0/3027550297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14637650 msgr2=0x55bd1464f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f17fff640 1 --2- 172.21.15.18:0/3027550297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14637650 0x55bd1464f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f17fff640 1 -- 172.21.15.18:0/3027550297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14627f20 msgr2=0x55bd14636430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:08.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f17fff640 1 --2- 172.21.15.18:0/3027550297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14627f20 0x55bd14636430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f17fff640 1 -- 172.21.15.18:0/3027550297 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd14639de0 con 0x55bd14628840 2024-09-19T09:56:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f17fff640 1 --2- 172.21.15.18:0/3027550297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1464ef50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5f000cc830 tx=0x7f5f00017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4885f4e9830d98fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f0e7fc640 1 -- 172.21.15.18:0/3027550297 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0001e070 con 0x55bd14628840 2024-09-19T09:56:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f0e7fc640 1 -- 172.21.15.18:0/3027550297 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f0009ba00 con 0x55bd14628840 2024-09-19T09:56:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.849+0000 7f5f0e7fc640 1 -- 172.21.15.18:0/3027550297 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00097970 con 0x55bd14628840 2024-09-19T09:56:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 -- 172.21.15.18:0/3027550297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 msgr2=0x55bd1464ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 --2- 172.21.15.18:0/3027550297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1464ef50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5f000cc830 tx=0x7f5f00017730 comp rx=0 tx=0).stop 2024-09-19T09:56:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 -- 172.21.15.18:0/3027550297 shutdown_connections 2024-09-19T09:56:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 --2- 172.21.15.18:0/3027550297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14637650 0x55bd1464f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 --2- 172.21.15.18:0/3027550297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1464ef50 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 --2- 172.21.15.18:0/3027550297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14627f20 0x55bd14636430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 -- 172.21.15.18:0/3027550297 >> 172.21.15.18:0/3027550297 conn(0x55bd146245f0 msgr2=0x55bd14623750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 -- 172.21.15.18:0/3027550297 shutdown_connections 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 -- 172.21.15.18:0/3027550297 wait complete. 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 -- start start 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.850+0000 7f5f20efe740 1 Processor -- start 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14627f20 0x55bd1463fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1463c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f20efe740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14637650 0x55bd1463c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f20efe740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f181ac850 con 0x55bd14628840 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f20efe740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f181ac180 con 0x55bd14637650 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f20efe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f181a93e0 con 0x55bd14627f20 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f20efe740 10 client.0 _ll_register_callbacks cb 0x7f5f08003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1463c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1463c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53972/0 (socket says 172.21.15.18:53972) 2024-09-19T09:56:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f17fff640 1 -- 172.21.15.18:0/1704131270 learned_addr learned my addr 172.21.15.18:0/1704131270 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f1d0c2640 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14637650 0x55bd1463c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f1c8c1640 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14627f20 0x55bd1463fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f17fff640 1 -- 172.21.15.18:0/1704131270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14627f20 msgr2=0x55bd1463fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f17fff640 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14627f20 0x55bd1463fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f17fff640 1 -- 172.21.15.18:0/1704131270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14637650 msgr2=0x55bd1463c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f17fff640 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14637650 0x55bd1463c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f17fff640 1 -- 172.21.15.18:0/1704131270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd1463cec0 con 0x55bd14628840 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.851+0000 7f5f1d0c2640 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14637650 0x55bd1463c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5f17fff640 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1463c150 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5f0009b290 tx=0x7f5f00056330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9e12c5f5501f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5ef7fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5ef7fff640 1 -- 172.21.15.18:0/1704131270 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0001e040 con 0x55bd14628840 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5ef7fff640 1 -- 172.21.15.18:0/1704131270 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5f00097970 con 0x55bd14628840 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5f20efe740 1 -- 172.21.15.18:0/1704131270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f0009ba00 con 0x55bd14628840 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5ef7fff640 1 -- 172.21.15.18:0/1704131270 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f000a3f70 con 0x55bd14628840 2024-09-19T09:56:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5f20efe740 10 client.16497 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5f20efe740 1 -- 172.21.15.18:0/1704131270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bd146b2fd0 con 0x55bd14628840 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5ef7fff640 1 -- 172.21.15.18:0/1704131270 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f0009ba00 con 0x55bd14628840 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5ef7fff640 1 -- 172.21.15.18:0/1704131270 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f0009a750 con 0x55bd14628840 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5f20efe740 10 client.16497 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5f20efe740 10 client.16497 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.852+0000 7f5f20efe740 20 client.16497 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.853+0000 7f5f20efe740 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bd146b3200 0x55bd146b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.853+0000 7f5f20efe740 4 client.16497 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d9ef7ae2", "release": true, "await": true}] 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.853+0000 7f5f20efe740 1 -- 172.21.15.18:0/1704131270 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d9ef7ae2", "release": true, "await": true}) -- 0x55bd145950a0 con 0x55bd146b3200 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.853+0000 7f5f1c8c1640 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bd146b3200 0x55bd146b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.853+0000 7f5f1c8c1640 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bd146b3200 0x55bd146b55f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49a67905fa0e5fe1 server_cookie=b91f0e526751266d in_seq=0 out_seq=0 2024-09-19T09:56:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.853+0000 7f5ef7fff640 10 client.16497 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.876+0000 7f5ef7fff640 1 -- 172.21.15.18:0/1704131270 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55bd145950a0 con 0x55bd146b3200 2024-09-19T09:56:08.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.876+0000 7f5ef7fff640 10 client.16497 handle_command_reply: tid=0 2024-09-19T09:56:08.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.876+0000 7f5f20efe740 1 client.16497 shutdown 2024-09-19T09:56:08.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.885+0000 7f5f20efe740 1 -- 172.21.15.18:0/1704131270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 msgr2=0x55bd1463c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:08.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.885+0000 7f5f20efe740 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1463c150 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5f0009b290 tx=0x7f5f00056330 comp rx=0 tx=0).stop 2024-09-19T09:56:08.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.888+0000 7f5f20efe740 1 -- 172.21.15.18:0/1704131270 shutdown_connections 2024-09-19T09:56:08.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.888+0000 7f5f20efe740 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bd146b3200 0x55bd146b55f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.889+0000 7f5f20efe740 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bd14637650 0x55bd1463c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.889+0000 7f5f20efe740 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bd14628840 0x55bd1463c150 secure :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5f0009b290 tx=0x7f5f00056330 comp rx=0 tx=0).stop 2024-09-19T09:56:08.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.889+0000 7f5f20efe740 1 --2- 172.21.15.18:0/1704131270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd14627f20 0x55bd1463fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.889+0000 7f5ef7fff640 0 client.16497 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:08.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.889+0000 7f5f20efe740 1 -- 172.21.15.18:0/1704131270 >> 172.21.15.18:0/1704131270 conn(0x55bd146245f0 msgr2=0x55bd14622f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:08.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.905+0000 7f5f20efe740 1 -- 172.21.15.18:0/1704131270 shutdown_connections 2024-09-19T09:56:08.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.906+0000 7f5f20efe740 1 -- 172.21.15.18:0/1704131270 wait complete. 2024-09-19T09:56:08.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.906+0000 7f5f20efe740 20 client.16497 trim_cache size 0 max 16384 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 16, 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: "d9ef7ae2": { 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 16, 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:56:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 136.6, 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:08.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.914+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2121299592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f040a3240 msgr2=0x7f5f040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.914+0000 7f5f1eb25640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f040a3240 0x7f5f040a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5f080098b0 tx=0x7f5f08004ab0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.915+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2121299592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f18102790 msgr2=0x7f5f18198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.915+0000 7f5f1eb25640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f18102790 0x7f5f18198a70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000b4a0 tx=0x7f5f0000b960 comp rx=0 tx=0).stop 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.916+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2121299592 shutdown_connections 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.916+0000 7f5f1eb25640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f040a3240 0x7f5f040a5700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.916+0000 7f5f1eb25640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f18106f10 0x7f5f1819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.916+0000 7f5f1eb25640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f18102790 0x7f5f18198a70 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.916+0000 7f5f1eb25640 1 --2- 172.21.15.18:0/2121299592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f18101de0 0x7f5f18198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:08.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.916+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2121299592 >> 172.21.15.18:0/2121299592 conn(0x7f5f180fd8c0 msgr2=0x7f5f180fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:08.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.920+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2121299592 shutdown_connections 2024-09-19T09:56:08.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:08.920+0000 7f5f1eb25640 1 -- 172.21.15.18:0/2121299592 wait complete. 2024-09-19T09:56:09.982 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd9ef7ae2', total seconds elapsed: 20.3 2024-09-19T09:56:10.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:10 smithi018 ceph-mon[30956]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 308 MiB/s wr, 778 op/s 2024-09-19T09:56:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:10 smithi049 ceph-mon[34858]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 308 MiB/s wr, 778 op/s 2024-09-19T09:56:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:10 smithi162 ceph-mon[35174]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 308 MiB/s wr, 778 op/s 2024-09-19T09:56:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.648+0000 7f61caac4640 1 -- 172.21.15.18:0/3488249291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c4072cb0 msgr2=0x7f61c40730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.648+0000 7f61caac4640 1 --2- 172.21.15.18:0/3488249291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c4072cb0 0x7f61c40730b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009930 tx=0x7f61c002a440 comp rx=0 tx=0).stop 2024-09-19T09:56:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.653+0000 7f61caac4640 1 -- 172.21.15.18:0/3488249291 shutdown_connections 2024-09-19T09:56:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.653+0000 7f61caac4640 1 --2- 172.21.15.18:0/3488249291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c410dbb0 0x7f61c4110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.653+0000 7f61caac4640 1 --2- 172.21.15.18:0/3488249291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4073680 0x7f61c410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.653+0000 7f61caac4640 1 --2- 172.21.15.18:0/3488249291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c4072cb0 0x7f61c40730b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.653+0000 7f61caac4640 1 -- 172.21.15.18:0/3488249291 >> 172.21.15.18:0/3488249291 conn(0x7f61c406eb50 msgr2=0x7f61c4070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.662+0000 7f61caac4640 1 -- 172.21.15.18:0/3488249291 shutdown_connections 2024-09-19T09:56:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.662+0000 7f61caac4640 1 -- 172.21.15.18:0/3488249291 wait complete. 2024-09-19T09:56:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.664+0000 7f61caac4640 1 Processor -- start 2024-09-19T09:56:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.664+0000 7f61caac4640 1 -- start start 2024-09-19T09:56:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.665+0000 7f61caac4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4072cb0 0x7f61c4116870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.665+0000 7f61caac4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4073680 0x7f61c4116db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.665+0000 7f61caac4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410dbb0 0x7f61c4117df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.665+0000 7f61caac4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61c4110f30 con 0x7f61c4073680 2024-09-19T09:56:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.665+0000 7f61caac4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61c4110db0 con 0x7f61c410dbb0 2024-09-19T09:56:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.665+0000 7f61caac4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61c41110b0 con 0x7f61c4072cb0 2024-09-19T09:56:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.666+0000 7f61ca2c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410dbb0 0x7f61c4117df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.666+0000 7f61c9ac2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4072cb0 0x7f61c4116870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.666+0000 7f61ca2c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410dbb0 0x7f61c4117df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:36426/0 (socket says 172.21.15.18:36426) 2024-09-19T09:56:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.666+0000 7f61ca2c3640 1 -- 172.21.15.18:0/334653661 learned_addr learned my addr 172.21.15.18:0/334653661 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.667+0000 7f61c92c1640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4073680 0x7f61c4116db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.668+0000 7f61c9ac2640 1 -- 172.21.15.18:0/334653661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410dbb0 msgr2=0x7f61c4117df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.668+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410dbb0 0x7f61c4117df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.668+0000 7f61c9ac2640 1 -- 172.21.15.18:0/334653661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4073680 msgr2=0x7f61c4116db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.668+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4073680 0x7f61c4116db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.668+0000 7f61c9ac2640 1 -- 172.21.15.18:0/334653661 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c4118460 con 0x7f61c4072cb0 2024-09-19T09:56:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.671+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4072cb0 0x7f61c4116870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009850 tx=0x7f61c0030a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:11.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.672+0000 7f61baffd640 1 -- 172.21.15.18:0/334653661 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0040070 con 0x7f61c4072cb0 2024-09-19T09:56:11.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.672+0000 7f61caac4640 1 -- 172.21.15.18:0/334653661 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c41186f0 con 0x7f61c4072cb0 2024-09-19T09:56:11.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.672+0000 7f61caac4640 1 -- 172.21.15.18:0/334653661 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c4118bb0 con 0x7f61c4072cb0 2024-09-19T09:56:11.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.673+0000 7f61baffd640 1 -- 172.21.15.18:0/334653661 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c0004220 con 0x7f61c4072cb0 2024-09-19T09:56:11.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.673+0000 7f61baffd640 1 -- 172.21.15.18:0/334653661 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0035030 con 0x7f61c4072cb0 2024-09-19T09:56:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.687+0000 7f61baffd640 1 -- 172.21.15.18:0/334653661 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f61c00316e0 con 0x7f61c4072cb0 2024-09-19T09:56:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.688+0000 7f61baffd640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a3450 0x7f61b00a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.689+0000 7f61baffd640 1 -- 172.21.15.18:0/334653661 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f61c00f01b0 con 0x7f61c4072cb0 2024-09-19T09:56:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.689+0000 7f61ceab9740 1 Processor -- start 2024-09-19T09:56:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.690+0000 7f61ceab9740 1 -- start start 2024-09-19T09:56:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.690+0000 7f61c92c1640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a3450 0x7f61b00a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.690+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf15b70 0x55b56bf15f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.690+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf1af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.690+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf1da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.690+0000 7f61ceab9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b56be792f0 con 0x55b56bf1b540 2024-09-19T09:56:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61ceab9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b56be21270 con 0x55b56bf164b0 2024-09-19T09:56:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61ceab9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b56be752b0 con 0x55b56bf15b70 2024-09-19T09:56:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61ca2c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf1da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61ca2c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf1da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54016/0 (socket says 172.21.15.18:54016) 2024-09-19T09:56:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61ca2c3640 1 -- 172.21.15.18:0/2024203885 learned_addr learned my addr 172.21.15.18:0/2024203885 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61c92c1640 1 --2- 172.21.15.18:0/2024203885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf1af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61ca2c3640 1 -- 172.21.15.18:0/2024203885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf15b70 msgr2=0x55b56bf15f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:56:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61ca2c3640 1 --2- 172.21.15.18:0/2024203885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf15b70 0x55b56bf15f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61ca2c3640 1 -- 172.21.15.18:0/2024203885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 msgr2=0x55b56bf1af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61ca2c3640 1 --2- 172.21.15.18:0/2024203885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf1af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.691+0000 7f61ca2c3640 1 -- 172.21.15.18:0/2024203885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b56be20340 con 0x55b56bf1b540 2024-09-19T09:56:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.692+0000 7f61c92c1640 1 --2- 172.21.15.18:0/2024203885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf1af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:56:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.692+0000 7f61c92c1640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a3450 0x7f61b00a5910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f61b4005fd0 tx=0x7f61b40137d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.693+0000 7f61ca2c3640 1 --2- 172.21.15.18:0/2024203885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf1da00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f61bc011460 tx=0x7f61bc011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749ffdbf1519d615 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.693+0000 7f61affff640 1 -- 172.21.15.18:0/2024203885 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc012770 con 0x55b56bf1b540 2024-09-19T09:56:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.694+0000 7f61affff640 1 -- 172.21.15.18:0/2024203885 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61bc012df0 con 0x55b56bf1b540 2024-09-19T09:56:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.695+0000 7f61ceab9740 1 -- 172.21.15.18:0/2024203885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 msgr2=0x55b56bf1da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.695+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2024203885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf1da00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f61bc011460 tx=0x7f61bc011920 comp rx=0 tx=0).stop 2024-09-19T09:56:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.696+0000 7f61ceab9740 1 -- 172.21.15.18:0/2024203885 shutdown_connections 2024-09-19T09:56:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.696+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2024203885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf1da00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.696+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2024203885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf1af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.696+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2024203885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf15b70 0x55b56bf15f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.696+0000 7f61ceab9740 1 -- 172.21.15.18:0/2024203885 >> 172.21.15.18:0/2024203885 conn(0x55b56bf111e0 msgr2=0x55b56bf115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.697+0000 7f61ceab9740 1 -- 172.21.15.18:0/2024203885 shutdown_connections 2024-09-19T09:56:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.699+0000 7f61ceab9740 1 -- 172.21.15.18:0/2024203885 wait complete. 2024-09-19T09:56:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.700+0000 7f61ceab9740 1 -- start start 2024-09-19T09:56:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.700+0000 7f61ceab9740 1 Processor -- start 2024-09-19T09:56:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.701+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf15b70 0x55b56bf1fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.701+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf202f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.701+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf27330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.701+0000 7f61ceab9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b56bf1e560 con 0x55b56bf1b540 2024-09-19T09:56:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.701+0000 7f61ceab9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b56be02290 con 0x55b56bf164b0 2024-09-19T09:56:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.701+0000 7f61ceab9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b56bf1e6e0 con 0x55b56bf15b70 2024-09-19T09:56:11.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.701+0000 7f61ceab9740 10 client.0 _ll_register_callbacks cb 0x55b56be33140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:11.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.702+0000 7f61ca2c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf27330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.702+0000 7f61ca2c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf27330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54024/0 (socket says 172.21.15.18:54024) 2024-09-19T09:56:11.705 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.702+0000 7f61ca2c3640 1 -- 172.21.15.18:0/3011211117 learned_addr learned my addr 172.21.15.18:0/3011211117 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.703+0000 7f61ca2c3640 1 -- 172.21.15.18:0/3011211117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf15b70 msgr2=0x55b56bf1fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.703+0000 7f61ca2c3640 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf15b70 0x55b56bf1fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.703+0000 7f61ca2c3640 1 -- 172.21.15.18:0/3011211117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 msgr2=0x55b56bf202f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.703+0000 7f61ca2c3640 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.703+0000 7f61ca2c3640 1 -- 172.21.15.18:0/3011211117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b56bb8c210 con 0x55b56bf1b540 2024-09-19T09:56:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.705+0000 7f61ca2c3640 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf27330 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f61bc01c040 tx=0x7f61bc01a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512744828d69ef10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.705+0000 7f61ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.706+0000 7f61ad7fa640 1 -- 172.21.15.18:0/3011211117 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc028070 con 0x55b56bf1b540 2024-09-19T09:56:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.706+0000 7f61ceab9740 1 -- 172.21.15.18:0/3011211117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61bc012df0 con 0x55b56bf1b540 2024-09-19T09:56:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.706+0000 7f61ad7fa640 1 -- 172.21.15.18:0/3011211117 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f61bc012570 con 0x55b56bf1b540 2024-09-19T09:56:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.707+0000 7f61ad7fa640 1 -- 172.21.15.18:0/3011211117 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f61bc034050 con 0x55b56bf1b540 2024-09-19T09:56:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.707+0000 7f61ceab9740 10 client.16509 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.707+0000 7f61ceab9740 1 -- 172.21.15.18:0/3011211117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b56bc58620 con 0x55b56bf1b540 2024-09-19T09:56:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.708+0000 7f61ad7fa640 1 -- 172.21.15.18:0/3011211117 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61bc012df0 con 0x55b56bf1b540 2024-09-19T09:56:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.708+0000 7f61ad7fa640 1 -- 172.21.15.18:0/3011211117 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f61bc00f040 con 0x55b56bf1b540 2024-09-19T09:56:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.708+0000 7f61ceab9740 10 client.16509 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.708+0000 7f61ceab9740 10 client.16509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.708+0000 7f61ceab9740 20 client.16509 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.708+0000 7f61ceab9740 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b56bf2be60 0x55b56bf2e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.708+0000 7f61ceab9740 4 client.16509 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.708+0000 7f61ceab9740 1 -- 172.21.15.18:0/3011211117 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b56be86a20 con 0x55b56bf2be60 2024-09-19T09:56:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.712+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b56bf2be60 0x55b56bf2e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.918+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b56bf2be60 0x55b56bf2e300 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6464419a528e73bc server_cookie=4abb47636fad28d in_seq=0 out_seq=0 2024-09-19T09:56:11.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.918+0000 7f61ad7fa640 10 client.16509 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.921+0000 7f61ad7fa640 1 -- 172.21.15.18:0/3011211117 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b56be86a20 con 0x55b56bf2be60 2024-09-19T09:56:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.921+0000 7f61ad7fa640 10 client.16509 handle_command_reply: tid=0 2024-09-19T09:56:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.922+0000 7f61ceab9740 1 client.16509 shutdown 2024-09-19T09:56:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.922+0000 7f61ceab9740 1 -- 172.21.15.18:0/3011211117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 msgr2=0x55b56bf27330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.922+0000 7f61ceab9740 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf27330 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f61bc01c040 tx=0x7f61bc01a620 comp rx=0 tx=0).stop 2024-09-19T09:56:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.922+0000 7f61ceab9740 1 -- 172.21.15.18:0/3011211117 shutdown_connections 2024-09-19T09:56:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.922+0000 7f61ceab9740 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b56bf2be60 0x55b56bf2e300 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.922+0000 7f61ceab9740 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf1b540 0x55b56bf27330 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.922+0000 7f61ceab9740 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf202f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.922+0000 7f61ceab9740 1 --2- 172.21.15.18:0/3011211117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf15b70 0x55b56bf1fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.922+0000 7f61ceab9740 1 -- 172.21.15.18:0/3011211117 >> 172.21.15.18:0/3011211117 conn(0x55b56bf111e0 msgr2=0x55b56bf129f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.922+0000 7f61ad7fa640 0 client.16509 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.923+0000 7f61ceab9740 1 -- 172.21.15.18:0/3011211117 shutdown_connections 2024-09-19T09:56:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.923+0000 7f61ceab9740 1 -- 172.21.15.18:0/3011211117 wait complete. 2024-09-19T09:56:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.923+0000 7f61ceab9740 20 client.16509 trim_cache size 0 max 16384 2024-09-19T09:56:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.963+0000 7f61ceab9740 1 Processor -- start 2024-09-19T09:56:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.966+0000 7f61ceab9740 1 -- start start 2024-09-19T09:56:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.967+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf1fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.967+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf272f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.967+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf1b540 0x55b56bf202f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.968+0000 7f61ceab9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61a800e440 con 0x55b56bf15b70 2024-09-19T09:56:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.968+0000 7f61ceab9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61a800ff80 con 0x55b56bf164b0 2024-09-19T09:56:11.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.968+0000 7f61ceab9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61a800eb10 con 0x55b56bf1b540 2024-09-19T09:56:11.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.969+0000 7f61c9ac2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf1fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.969+0000 7f61c9ac2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf1fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54038/0 (socket says 172.21.15.18:54038) 2024-09-19T09:56:11.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.969+0000 7f61c9ac2640 1 -- 172.21.15.18:0/2605345036 learned_addr learned my addr 172.21.15.18:0/2605345036 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.971+0000 7f61c9ac2640 1 -- 172.21.15.18:0/2605345036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf1b540 msgr2=0x55b56bf202f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:56:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.971+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/2605345036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf1b540 0x55b56bf202f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.971+0000 7f61c9ac2640 1 -- 172.21.15.18:0/2605345036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 msgr2=0x55b56bf272f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.971+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/2605345036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.971+0000 7f61c9ac2640 1 -- 172.21.15.18:0/2605345036 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b56bf157b0 con 0x55b56bf15b70 2024-09-19T09:56:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.971+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/2605345036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf1fdb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f61c00bc4a0 tx=0x7f61c0046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ed190ef25c99a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.972+0000 7f61af7fe640 1 -- 172.21.15.18:0/2605345036 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c00bc7a0 con 0x55b56bf15b70 2024-09-19T09:56:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.972+0000 7f61af7fe640 1 -- 172.21.15.18:0/2605345036 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c00c0b50 con 0x55b56bf15b70 2024-09-19T09:56:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.972+0000 7f61af7fe640 1 -- 172.21.15.18:0/2605345036 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c00edd90 con 0x55b56bf15b70 2024-09-19T09:56:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.976+0000 7f61ceab9740 1 -- 172.21.15.18:0/2605345036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 msgr2=0x55b56bf1fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.976+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2605345036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf1fdb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f61c00bc4a0 tx=0x7f61c0046040 comp rx=0 tx=0).stop 2024-09-19T09:56:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.982+0000 7f61ceab9740 1 -- 172.21.15.18:0/2605345036 shutdown_connections 2024-09-19T09:56:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.982+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2605345036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf1b540 0x55b56bf202f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.982+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2605345036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf272f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.982+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2605345036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf1fdb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.982+0000 7f61ceab9740 1 -- 172.21.15.18:0/2605345036 >> 172.21.15.18:0/2605345036 conn(0x55b56bf111e0 msgr2=0x55b56bf175f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.982+0000 7f61ceab9740 1 -- 172.21.15.18:0/2605345036 shutdown_connections 2024-09-19T09:56:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.983+0000 7f61ceab9740 1 -- 172.21.15.18:0/2605345036 wait complete. 2024-09-19T09:56:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.984+0000 7f61ceab9740 1 -- start start 2024-09-19T09:56:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.984+0000 7f61ceab9740 1 Processor -- start 2024-09-19T09:56:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.985+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf26b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.989+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf270c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.989+0000 7f61ceab9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf1b540 0x55b56bf236c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.989+0000 7f61ceab9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61a800f8b0 con 0x55b56bf15b70 2024-09-19T09:56:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.989+0000 7f61ceab9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61a800f1e0 con 0x55b56bf164b0 2024-09-19T09:56:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.989+0000 7f61ceab9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61a800c420 con 0x55b56bf1b540 2024-09-19T09:56:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.990+0000 7f61ceab9740 10 client.0 _ll_register_callbacks cb 0x7f61bc009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.991+0000 7f61c92c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf270c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.991+0000 7f61c92c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf270c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:36470/0 (socket says 172.21.15.18:36470) 2024-09-19T09:56:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.991+0000 7f61c92c1640 1 -- 172.21.15.18:0/2767562209 learned_addr learned my addr 172.21.15.18:0/2767562209 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.992+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf26b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.993+0000 7f61ca2c3640 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf1b540 0x55b56bf236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.994+0000 7f61c9ac2640 1 -- 172.21.15.18:0/2767562209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf1b540 msgr2=0x55b56bf236c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.994+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf1b540 0x55b56bf236c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.994+0000 7f61c9ac2640 1 -- 172.21.15.18:0/2767562209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 msgr2=0x55b56bf270c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.994+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf270c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.994+0000 7f61c9ac2640 1 -- 172.21.15.18:0/2767562209 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b56bf23db0 con 0x55b56bf15b70 2024-09-19T09:56:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.996+0000 7f61c9ac2640 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf26b80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f61c00bc4a0 tx=0x7f61c0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82150bb65f4a679 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.996+0000 7f61ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.997+0000 7f61ad7fa640 1 -- 172.21.15.18:0/2767562209 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c00bc7a0 con 0x55b56bf15b70 2024-09-19T09:56:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.997+0000 7f61ad7fa640 1 -- 172.21.15.18:0/2767562209 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f61c00edd90 con 0x55b56bf15b70 2024-09-19T09:56:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.997+0000 7f61ceab9740 1 -- 172.21.15.18:0/2767562209 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61c00c0b50 con 0x55b56bf15b70 2024-09-19T09:56:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:11.999+0000 7f61ad7fa640 1 -- 172.21.15.18:0/2767562209 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f61c00b8e10 con 0x55b56bf15b70 2024-09-19T09:56:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.001+0000 7f61ceab9740 10 client.16515 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.001+0000 7f61ceab9740 1 -- 172.21.15.18:0/2767562209 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b56bf95800 con 0x55b56bf15b70 2024-09-19T09:56:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.005+0000 7f61ad7fa640 1 -- 172.21.15.18:0/2767562209 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c00c0b50 con 0x55b56bf15b70 2024-09-19T09:56:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.005+0000 7f61ad7fa640 1 -- 172.21.15.18:0/2767562209 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f61c003a040 con 0x55b56bf15b70 2024-09-19T09:56:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.005+0000 7f61ceab9740 10 client.16515 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.005+0000 7f61ceab9740 10 client.16515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.005+0000 7f61ceab9740 20 client.16515 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.005+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b56bf960c0 0x55b56bf984e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.005+0000 7f61ceab9740 4 client.16515 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:56:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.005+0000 7f61ceab9740 1 -- 172.21.15.18:0/2767562209 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b56be80d70 con 0x55b56bf960c0 2024-09-19T09:56:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.010+0000 7f61c92c1640 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b56bf960c0 0x55b56bf984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.023+0000 7f61c92c1640 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b56bf960c0 0x55b56bf984e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c91dc35b5d95a9bc server_cookie=470891936af9de99 in_seq=0 out_seq=0 2024-09-19T09:56:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:12.024+0000 7f61ad7fa640 10 client.16515 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:12.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:12 smithi018 ceph-mon[30956]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 257 MiB/s wr, 508 op/s 2024-09-19T09:56:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:12 smithi049 ceph-mon[34858]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 257 MiB/s wr, 508 op/s 2024-09-19T09:56:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:12 smithi162 ceph-mon[35174]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.1 MiB/s rd, 257 MiB/s wr, 508 op/s 2024-09-19T09:56:14.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:14 smithi018 ceph-mon[30956]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 503 KiB/s rd, 232 MiB/s wr, 318 op/s 2024-09-19T09:56:14.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:14 smithi049 ceph-mon[34858]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 503 KiB/s rd, 232 MiB/s wr, 318 op/s 2024-09-19T09:56:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:14 smithi162 ceph-mon[35174]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 503 KiB/s rd, 232 MiB/s wr, 318 op/s 2024-09-19T09:56:16.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:16 smithi049 ceph-mon[34858]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 291 MiB/s wr, 715 op/s 2024-09-19T09:56:16.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:16 smithi162 ceph-mon[35174]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 291 MiB/s wr, 715 op/s 2024-09-19T09:56:16.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:16 smithi018 ceph-mon[30956]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.0 MiB/s rd, 291 MiB/s wr, 715 op/s 2024-09-19T09:56:18.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:18 smithi018 ceph-mon[30956]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 908 KiB/s rd, 442 MiB/s wr, 1.26k op/s 2024-09-19T09:56:18.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:18 smithi049 ceph-mon[34858]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 908 KiB/s rd, 442 MiB/s wr, 1.26k op/s 2024-09-19T09:56:18.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:18 smithi162 ceph-mon[35174]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 908 KiB/s rd, 442 MiB/s wr, 1.26k op/s 2024-09-19T09:56:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.100+0000 7f61ad7fa640 1 -- 172.21.15.18:0/2767562209 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b56be80d70 con 0x55b56bf960c0 2024-09-19T09:56:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.100+0000 7f61ad7fa640 10 client.16515 handle_command_reply: tid=0 2024-09-19T09:56:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.100+0000 7f61ceab9740 1 client.16515 shutdown 2024-09-19T09:56:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.101+0000 7f61ceab9740 1 -- 172.21.15.18:0/2767562209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 msgr2=0x55b56bf26b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.101+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf26b80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f61c00bc4a0 tx=0x7f61c0005fd0 comp rx=0 tx=0).stop 2024-09-19T09:56:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.101+0000 7f61ceab9740 1 -- 172.21.15.18:0/2767562209 shutdown_connections 2024-09-19T09:56:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.101+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b56bf960c0 0x55b56bf984e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.101+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b56bf1b540 0x55b56bf236c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.101+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b56bf164b0 0x55b56bf270c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.101+0000 7f61ceab9740 1 --2- 172.21.15.18:0/2767562209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b56bf15b70 0x55b56bf26b80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.101+0000 7f61ceab9740 1 -- 172.21.15.18:0/2767562209 >> 172.21.15.18:0/2767562209 conn(0x55b56bf111e0 msgr2=0x55b56bf175f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.101+0000 7f61ad7fa640 0 client.16515 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:19.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.101+0000 7f61ceab9740 1 -- 172.21.15.18:0/2767562209 shutdown_connections 2024-09-19T09:56:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.102+0000 7f61ceab9740 1 -- 172.21.15.18:0/2767562209 wait complete. 2024-09-19T09:56:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.102+0000 7f61ceab9740 20 client.16515 trim_cache size 0 max 16384 2024-09-19T09:56:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:56:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:56:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:56:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:56:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.105+0000 7f61caac4640 1 -- 172.21.15.18:0/334653661 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a3450 msgr2=0x7f61b00a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.105+0000 7f61caac4640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a3450 0x7f61b00a5910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f61b4005fd0 tx=0x7f61b40137d0 comp rx=0 tx=0).stop 2024-09-19T09:56:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.105+0000 7f61caac4640 1 -- 172.21.15.18:0/334653661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4072cb0 msgr2=0x7f61c4116870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.105+0000 7f61caac4640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4072cb0 0x7f61c4116870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009850 tx=0x7f61c0030a80 comp rx=0 tx=0).stop 2024-09-19T09:56:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.109+0000 7f61caac4640 1 -- 172.21.15.18:0/334653661 shutdown_connections 2024-09-19T09:56:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.110+0000 7f61caac4640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f61b00a3450 0x7f61b00a5910 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.110+0000 7f61caac4640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c410dbb0 0x7f61c4117df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.110+0000 7f61caac4640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c4073680 0x7f61c4116db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.110+0000 7f61caac4640 1 --2- 172.21.15.18:0/334653661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4072cb0 0x7f61c4116870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.110+0000 7f61caac4640 1 -- 172.21.15.18:0/334653661 >> 172.21.15.18:0/334653661 conn(0x7f61c406eb50 msgr2=0x7f61c4070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.110+0000 7f61caac4640 1 -- 172.21.15.18:0/334653661 shutdown_connections 2024-09-19T09:56:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:19.110+0000 7f61caac4640 1 -- 172.21.15.18:0/334653661 wait complete. 2024-09-19T09:56:20.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:20 smithi018 ceph-mon[30956]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 907 KiB/s rd, 523 MiB/s wr, 1.52k op/s 2024-09-19T09:56:20.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:20 smithi049 ceph-mon[34858]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 907 KiB/s rd, 523 MiB/s wr, 1.52k op/s 2024-09-19T09:56:20.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:20 smithi162 ceph-mon[35174]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 907 KiB/s rd, 523 MiB/s wr, 1.52k op/s 2024-09-19T09:56:22.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:22 smithi018 ceph-mon[30956]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 658 MiB/s wr, 1.74k op/s 2024-09-19T09:56:22.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:22 smithi049 ceph-mon[34858]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 658 MiB/s wr, 1.74k op/s 2024-09-19T09:56:22.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:22 smithi162 ceph-mon[35174]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 658 MiB/s wr, 1.74k op/s 2024-09-19T09:56:24.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:24 smithi018 ceph-mon[30956]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 805 MiB/s wr, 2.08k op/s 2024-09-19T09:56:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:24 smithi049 ceph-mon[34858]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 805 MiB/s wr, 2.08k op/s 2024-09-19T09:56:24.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:24 smithi162 ceph-mon[35174]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 805 MiB/s wr, 2.08k op/s 2024-09-19T09:56:26.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:26 smithi018 ceph-mon[30956]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 857 MiB/s wr, 2.21k op/s 2024-09-19T09:56:26.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:26 smithi049 ceph-mon[34858]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 857 MiB/s wr, 2.21k op/s 2024-09-19T09:56:26.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:26 smithi162 ceph-mon[35174]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 857 MiB/s wr, 2.21k op/s 2024-09-19T09:56:28.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:28 smithi018 ceph-mon[30956]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 874 MiB/s wr, 1.98k op/s 2024-09-19T09:56:28.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:28 smithi049 ceph-mon[34858]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 874 MiB/s wr, 1.98k op/s 2024-09-19T09:56:28.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:28 smithi162 ceph-mon[35174]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 874 MiB/s wr, 1.98k op/s 2024-09-19T09:56:29.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:29 smithi018 ceph-mon[30956]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 798 MiB/s wr, 1.58k op/s 2024-09-19T09:56:29.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:29 smithi049 ceph-mon[34858]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 798 MiB/s wr, 1.58k op/s 2024-09-19T09:56:29.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:29 smithi162 ceph-mon[35174]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 798 MiB/s wr, 1.58k op/s 2024-09-19T09:56:32.144 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:31 smithi018 ceph-mon[30956]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 859 MiB/s wr, 1.82k op/s 2024-09-19T09:56:32.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:31 smithi049 ceph-mon[34858]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 859 MiB/s wr, 1.82k op/s 2024-09-19T09:56:32.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:31 smithi162 ceph-mon[35174]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 859 MiB/s wr, 1.82k op/s 2024-09-19T09:56:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.437+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3095032015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d8073980 msgr2=0x7fd6d807a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.437+0000 7fd6dcbd8640 1 --2- 172.21.15.18:0/3095032015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d8073980 0x7fd6d807a450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80074e0 tx=0x7fd6c802b0a0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.437+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3095032015 shutdown_connections 2024-09-19T09:56:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.437+0000 7fd6dcbd8640 1 --2- 172.21.15.18:0/3095032015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d8073980 0x7fd6d807a450 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.437+0000 7fd6dcbd8640 1 --2- 172.21.15.18:0/3095032015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d8072fc0 0x7fd6d8073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.437+0000 7fd6dcbd8640 1 --2- 172.21.15.18:0/3095032015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6d81096e0 0x7fd6d8109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.437+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3095032015 >> 172.21.15.18:0/3095032015 conn(0x7fd6d806ece0 msgr2=0x7fd6d8071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.439+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3095032015 shutdown_connections 2024-09-19T09:56:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.439+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3095032015 wait complete. 2024-09-19T09:56:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.440+0000 7fd6dcbd8640 1 Processor -- start 2024-09-19T09:56:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.440+0000 7fd6dcbd8640 1 -- start start 2024-09-19T09:56:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.440+0000 7fd6dcbd8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6d8072fc0 0x7fd6d8075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.440+0000 7fd6dcbd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d8073980 0x7fd6d80745b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.440+0000 7fd6dcbd8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d81096e0 0x7fd6d8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.440+0000 7fd6dcbd8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d807df30 con 0x7fd6d81096e0 2024-09-19T09:56:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.440+0000 7fd6dcbd8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d807ddb0 con 0x7fd6d8072fc0 2024-09-19T09:56:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.440+0000 7fd6dcbd8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d807e0b0 con 0x7fd6d8073980 2024-09-19T09:56:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.443+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d8073980 0x7fd6d80745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.443+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d8073980 0x7fd6d80745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50692/0 (socket says 172.21.15.18:50692) 2024-09-19T09:56:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.443+0000 7fd6d5d9b640 1 -- 172.21.15.18:0/3454830159 learned_addr learned my addr 172.21.15.18:0/3454830159 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.443+0000 7fd6d659c640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6d8072fc0 0x7fd6d8075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.444+0000 7fd6d5d9b640 1 -- 172.21.15.18:0/3454830159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6d8072fc0 msgr2=0x7fd6d8075f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.444+0000 7fd6d5d9b640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6d8072fc0 0x7fd6d8075f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.444+0000 7fd6d5d9b640 1 -- 172.21.15.18:0/3454830159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d81096e0 msgr2=0x7fd6d8074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.444+0000 7fd6d5d9b640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d81096e0 0x7fd6d8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.444+0000 7fd6d5d9b640 1 -- 172.21.15.18:0/3454830159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d81b55d0 con 0x7fd6d8073980 2024-09-19T09:56:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.445+0000 7fd6d5d9b640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d8073980 0x7fd6d80745b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000ba50 tx=0x7fd6d000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.446+0000 7fd6c77fe640 1 -- 172.21.15.18:0/3454830159 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0019070 con 0x7fd6d8073980 2024-09-19T09:56:32.455 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.446+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3454830159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d81b58c0 con 0x7fd6d8073980 2024-09-19T09:56:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.447+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3454830159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d81b5e60 con 0x7fd6d8073980 2024-09-19T09:56:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.451+0000 7fd6dfa49740 1 Processor -- start 2024-09-19T09:56:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.452+0000 7fd6dfa49740 1 -- start start 2024-09-19T09:56:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.452+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d285da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.452+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d28ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.453+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d28d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.453+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562e3d1e92f0 con 0x562e3d28b370 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.453+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562e3d191270 con 0x562e3d2862e0 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.453+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562e3d1e52b0 con 0x562e3d2859a0 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.455+0000 7fd6d6d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d285da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.455+0000 7fd6d6d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d285da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50696/0 (socket says 172.21.15.18:50696) 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.455+0000 7fd6d6d9d640 1 -- 172.21.15.18:0/1395453284 learned_addr learned my addr 172.21.15.18:0/1395453284 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.455+0000 7fd6c77fe640 1 -- 172.21.15.18:0/3454830159 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6d000cbe0 con 0x7fd6d8073980 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.455+0000 7fd6c77fe640 1 -- 172.21.15.18:0/3454830159 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0007730 con 0x7fd6d8073980 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.455+0000 7fd6d5d9b640 1 --2- 172.21.15.18:0/1395453284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d28d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.457+0000 7fd6d6d9d640 1 -- 172.21.15.18:0/1395453284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 msgr2=0x562e3d28ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.457+0000 7fd6d6d9d640 1 --2- 172.21.15.18:0/1395453284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d28ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.457+0000 7fd6d6d9d640 1 -- 172.21.15.18:0/1395453284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 msgr2=0x562e3d28d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.457+0000 7fd6d6d9d640 1 --2- 172.21.15.18:0/1395453284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d28d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.457+0000 7fd6d6d9d640 1 -- 172.21.15.18:0/1395453284 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e3d190340 con 0x562e3d2859a0 2024-09-19T09:56:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.457+0000 7fd6c77fe640 1 -- 172.21.15.18:0/3454830159 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd6d001c070 con 0x7fd6d8073980 2024-09-19T09:56:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.458+0000 7fd6d6d9d640 1 --2- 172.21.15.18:0/1395453284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d285da0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80074b0 tx=0x7fd6c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49e8fc6e16869435 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.459+0000 7fd6c77fe640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6c00a3440 0x7fd6c00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.463 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.460+0000 7fd6d659c640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6c00a3440 0x7fd6c00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.461+0000 7fd6c77fe640 1 -- 172.21.15.18:0/3454830159 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd6d00d20e0 con 0x7fd6d8073980 2024-09-19T09:56:32.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.462+0000 7fd6c4ff9640 1 -- 172.21.15.18:0/1395453284 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8041070 con 0x562e3d2859a0 2024-09-19T09:56:32.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.462+0000 7fd6c4ff9640 1 -- 172.21.15.18:0/1395453284 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6c8004b10 con 0x562e3d2859a0 2024-09-19T09:56:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.462+0000 7fd6c4ff9640 1 -- 172.21.15.18:0/1395453284 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80042b0 con 0x562e3d2859a0 2024-09-19T09:56:32.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.463+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1395453284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 msgr2=0x562e3d285da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:32.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.463+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/1395453284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d285da0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80074b0 tx=0x7fd6c80046c0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.463+0000 7fd6d659c640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6c00a3440 0x7fd6c00a5900 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc006fd0 tx=0x7fd6cc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:32.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.463+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1395453284 shutdown_connections 2024-09-19T09:56:32.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.463+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/1395453284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d28d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.463+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/1395453284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d28ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.463+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/1395453284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d285da0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.466 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.463+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1395453284 >> 172.21.15.18:0/1395453284 conn(0x562e3d281010 msgr2=0x562e3d281410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:32.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.464+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1395453284 shutdown_connections 2024-09-19T09:56:32.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.464+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1395453284 wait complete. 2024-09-19T09:56:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.464+0000 7fd6dfa49740 1 -- start start 2024-09-19T09:56:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.464+0000 7fd6dfa49740 1 Processor -- start 2024-09-19T09:56:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.465+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2859a0 0x562e3d2b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.465+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d2862e0 0x562e3d2b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:56:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.466+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d28b370 0x562e3d2b9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.466+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2859a0 0x562e3d2b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.466+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2859a0 0x562e3d2b1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:40764/0 (socket says 172.21.15.18:40764) 2024-09-19T09:56:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.466+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562e3d2b02f0 con 0x562e3d2862e0 2024-09-19T09:56:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.466+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562e3d172290 con 0x562e3d2859a0 2024-09-19T09:56:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.466+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562e3d2b0470 con 0x562e3d28b370 2024-09-19T09:56:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.466+0000 7fd6dfa49740 10 client.0 _ll_register_callbacks cb 0x562e3d1a3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.466+0000 7fd6d659c640 1 -- 172.21.15.18:0/1999000991 learned_addr learned my addr 172.21.15.18:0/1999000991 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.467+0000 7fd6d6d9d640 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d28b370 0x562e3d2b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.467+0000 7fd6d5d9b640 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d2862e0 0x562e3d2b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.474+0000 7fd6d6d9d640 1 -- 172.21.15.18:0/1999000991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2859a0 msgr2=0x562e3d2b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.474+0000 7fd6d6d9d640 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2859a0 0x562e3d2b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.475+0000 7fd6d6d9d640 1 -- 172.21.15.18:0/1999000991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d2862e0 msgr2=0x562e3d2b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.475+0000 7fd6d6d9d640 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d2862e0 0x562e3d2b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.475+0000 7fd6d6d9d640 1 -- 172.21.15.18:0/1999000991 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e3cefc210 con 0x562e3d28b370 2024-09-19T09:56:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.476+0000 7fd6d6d9d640 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d28b370 0x562e3d2b9210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80074e0 tx=0x7fd6c802bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fcb83f5d55c6ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.480+0000 7fd6bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:56:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.480+0000 7fd6bdffb640 1 -- 172.21.15.18:0/1999000991 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8041070 con 0x562e3d28b370 2024-09-19T09:56:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.480+0000 7fd6bdffb640 1 -- 172.21.15.18:0/1999000991 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd6c8004260 con 0x562e3d28b370 2024-09-19T09:56:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.484+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1999000991 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6c8004b10 con 0x562e3d28b370 2024-09-19T09:56:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.489+0000 7fd6bdffb640 1 -- 172.21.15.18:0/1999000991 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd6c8004460 con 0x562e3d28b370 2024-09-19T09:56:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.489+0000 7fd6dfa49740 10 client.25933 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.489+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1999000991 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e3cfc8620 con 0x562e3d28b370 2024-09-19T09:56:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.491+0000 7fd6bdffb640 1 -- 172.21.15.18:0/1999000991 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6c8004b10 con 0x562e3d28b370 2024-09-19T09:56:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.492+0000 7fd6bdffb640 1 -- 172.21.15.18:0/1999000991 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd6c8003ca0 con 0x562e3d28b370 2024-09-19T09:56:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.492+0000 7fd6dfa49740 10 client.25933 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.492+0000 7fd6dfa49740 10 client.25933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.492+0000 7fd6dfa49740 20 client.25933 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.492+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562e3d2bd510 0x562e3d2bf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.492+0000 7fd6dfa49740 4 client.25933 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.492+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1999000991 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e3d1f6a20 con 0x562e3d2bd510 2024-09-19T09:56:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.498+0000 7fd6d659c640 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562e3d2bd510 0x562e3d2bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.499+0000 7fd6d659c640 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562e3d2bd510 0x562e3d2bf900 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6176458931c6e0d1 server_cookie=8f9eb511ba8aaa6b in_seq=0 out_seq=0 2024-09-19T09:56:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.499+0000 7fd6bdffb640 10 client.25933 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.501+0000 7fd6bdffb640 1 -- 172.21.15.18:0/1999000991 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e3d1f6a20 con 0x562e3d2bd510 2024-09-19T09:56:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.501+0000 7fd6bdffb640 10 client.25933 handle_command_reply: tid=0 2024-09-19T09:56:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.501+0000 7fd6dfa49740 1 client.25933 shutdown 2024-09-19T09:56:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.504+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1999000991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d28b370 msgr2=0x562e3d2b9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.504+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d28b370 0x562e3d2b9210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80074e0 tx=0x7fd6c802bc10 comp rx=0 tx=0).stop 2024-09-19T09:56:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.505+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1999000991 shutdown_connections 2024-09-19T09:56:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.505+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562e3d2bd510 0x562e3d2bf900 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.505+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d28b370 0x562e3d2b9210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.505+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d2862e0 0x562e3d2b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.505+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/1999000991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2859a0 0x562e3d2b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.505+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1999000991 >> 172.21.15.18:0/1999000991 conn(0x562e3d281010 msgr2=0x562e3d282820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.505+0000 7fd6bdffb640 0 client.25933 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.505+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1999000991 shutdown_connections 2024-09-19T09:56:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.505+0000 7fd6dfa49740 1 -- 172.21.15.18:0/1999000991 wait complete. 2024-09-19T09:56:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.506+0000 7fd6dfa49740 20 client.25933 trim_cache size 0 max 16384 2024-09-19T09:56:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.582+0000 7fd6dfa49740 1 Processor -- start 2024-09-19T09:56:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.585+0000 7fd6dfa49740 1 -- start start 2024-09-19T09:56:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.586+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d2813f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.586+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d2b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.586+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d281930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.586+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b800e2a0 con 0x562e3d28b370 2024-09-19T09:56:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.586+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b800fde0 con 0x562e3d2862e0 2024-09-19T09:56:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.587+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b800e970 con 0x562e3d2859a0 2024-09-19T09:56:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.588+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d2813f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.588+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d2b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.588+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d2813f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50706/0 (socket says 172.21.15.18:50706) 2024-09-19T09:56:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.588+0000 7fd6d659c640 1 -- 172.21.15.18:0/728241315 learned_addr learned my addr 172.21.15.18:0/728241315 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.591+0000 7fd6d659c640 1 -- 172.21.15.18:0/728241315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 msgr2=0x562e3d2b91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.591+0000 7fd6d659c640 1 --2- 172.21.15.18:0/728241315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d2b91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.591+0000 7fd6d659c640 1 -- 172.21.15.18:0/728241315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 msgr2=0x562e3d281930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.591+0000 7fd6d659c640 1 --2- 172.21.15.18:0/728241315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d281930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.591+0000 7fd6d659c640 1 -- 172.21.15.18:0/728241315 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e3d2bfdd0 con 0x562e3d2859a0 2024-09-19T09:56:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.593+0000 7fd6d659c640 1 --2- 172.21.15.18:0/728241315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d2813f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc004790 tx=0x7fd6cc010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa9ff0682a437245 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.597+0000 7fd6bffff640 1 -- 172.21.15.18:0/728241315 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc014430 con 0x562e3d2859a0 2024-09-19T09:56:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.597+0000 7fd6bffff640 1 -- 172.21.15.18:0/728241315 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6cc014ab0 con 0x562e3d2859a0 2024-09-19T09:56:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.597+0000 7fd6bffff640 1 -- 172.21.15.18:0/728241315 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc022a60 con 0x562e3d2859a0 2024-09-19T09:56:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.598+0000 7fd6dfa49740 1 -- 172.21.15.18:0/728241315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 msgr2=0x562e3d2813f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.599+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/728241315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d2813f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc004790 tx=0x7fd6cc010000 comp rx=0 tx=0).stop 2024-09-19T09:56:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.599+0000 7fd6dfa49740 1 -- 172.21.15.18:0/728241315 shutdown_connections 2024-09-19T09:56:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.599+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/728241315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d281930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.599+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/728241315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d2b91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.599+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/728241315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d2813f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.599+0000 7fd6dfa49740 1 -- 172.21.15.18:0/728241315 >> 172.21.15.18:0/728241315 conn(0x562e3d281010 msgr2=0x562e3d287520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.603+0000 7fd6dfa49740 1 -- 172.21.15.18:0/728241315 shutdown_connections 2024-09-19T09:56:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.603+0000 7fd6dfa49740 1 -- 172.21.15.18:0/728241315 wait complete. 2024-09-19T09:56:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.604+0000 7fd6dfa49740 1 -- start start 2024-09-19T09:56:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.604+0000 7fd6dfa49740 1 Processor -- start 2024-09-19T09:56:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.605+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d2b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.605+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d2b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.605+0000 7fd6dfa49740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d326030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.605+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b800f710 con 0x562e3d28b370 2024-09-19T09:56:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.605+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b800f040 con 0x562e3d2862e0 2024-09-19T09:56:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.605+0000 7fd6dfa49740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b800c330 con 0x562e3d2859a0 2024-09-19T09:56:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.605+0000 7fd6dfa49740 10 client.0 _ll_register_callbacks cb 0x7fd6c803f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.608+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d2b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.608+0000 7fd6d6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d326030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.608+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d2b67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:40782/0 (socket says 172.21.15.18:40782) 2024-09-19T09:56:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.608+0000 7fd6d5d9b640 1 -- 172.21.15.18:0/310635959 learned_addr learned my addr 172.21.15.18:0/310635959 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.608+0000 7fd6d659c640 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d2b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.608+0000 7fd6d6d9d640 1 -- 172.21.15.18:0/310635959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 msgr2=0x562e3d2b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.608+0000 7fd6d6d9d640 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d2b6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.608+0000 7fd6d6d9d640 1 -- 172.21.15.18:0/310635959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 msgr2=0x562e3d2b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.608+0000 7fd6d6d9d640 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d2b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.608+0000 7fd6d6d9d640 1 -- 172.21.15.18:0/310635959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e3d3265f0 con 0x562e3d28b370 2024-09-19T09:56:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.609+0000 7fd6d6d9d640 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d326030 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8004940 tx=0x7fd6c802b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9170ce4ac42e6369 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.610+0000 7fd6bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.639+0000 7fd6bdffb640 1 -- 172.21.15.18:0/310635959 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8041040 con 0x562e3d28b370 2024-09-19T09:56:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.640+0000 7fd6dfa49740 1 -- 172.21.15.18:0/310635959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6cc014ab0 con 0x562e3d28b370 2024-09-19T09:56:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.640+0000 7fd6bdffb640 1 -- 172.21.15.18:0/310635959 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd6c8004260 con 0x562e3d28b370 2024-09-19T09:56:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.642+0000 7fd6bdffb640 1 -- 172.21.15.18:0/310635959 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd6c8004b10 con 0x562e3d28b370 2024-09-19T09:56:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.645+0000 7fd6dfa49740 10 client.16524 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.645+0000 7fd6dfa49740 1 -- 172.21.15.18:0/310635959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e3d327900 con 0x562e3d28b370 2024-09-19T09:56:32.654 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.651+0000 7fd6bdffb640 1 -- 172.21.15.18:0/310635959 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6cc014ab0 con 0x562e3d28b370 2024-09-19T09:56:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.651+0000 7fd6bdffb640 1 -- 172.21.15.18:0/310635959 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd6c80035f0 con 0x562e3d28b370 2024-09-19T09:56:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.652+0000 7fd6dfa49740 10 client.16524 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.652+0000 7fd6dfa49740 10 client.16524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.652+0000 7fd6dfa49740 20 client.16524 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.652+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562e3d328250 0x562e3d32a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.652+0000 7fd6dfa49740 4 client.16524 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:56:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.652+0000 7fd6dfa49740 1 -- 172.21.15.18:0/310635959 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e3d1f0d70 con 0x562e3d328250 2024-09-19T09:56:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.658+0000 7fd6d659c640 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562e3d328250 0x562e3d32a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.661+0000 7fd6d659c640 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562e3d328250 0x562e3d32a670 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f53c26e82b500665 server_cookie=ddb9b96e2196995e in_seq=0 out_seq=0 2024-09-19T09:56:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:32.661+0000 7fd6bdffb640 10 client.16524 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:33.718 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:34.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:34 smithi018 ceph-mon[30956]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 78 GiB used, 995 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 889 MiB/s wr, 2.32k op/s 2024-09-19T09:56:34.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:34 smithi049 ceph-mon[34858]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 78 GiB used, 995 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 889 MiB/s wr, 2.32k op/s 2024-09-19T09:56:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:34 smithi162 ceph-mon[35174]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 78 GiB used, 995 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 889 MiB/s wr, 2.32k op/s 2024-09-19T09:56:34.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.663+0000 7faa1ae1f640 1 -- 172.21.15.18:0/1478901334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14103550 msgr2=0x7faa1410ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.663+0000 7faa1ae1f640 1 --2- 172.21.15.18:0/1478901334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14103550 0x7faa1410ba40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7faa04009900 tx=0x7faa0402a4d0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.665+0000 7faa1ae1f640 1 -- 172.21.15.18:0/1478901334 shutdown_connections 2024-09-19T09:56:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.665+0000 7faa1ae1f640 1 --2- 172.21.15.18:0/1478901334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa1410bfd0 0x7faa1410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.665+0000 7faa1ae1f640 1 --2- 172.21.15.18:0/1478901334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14103550 0x7faa1410ba40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.665+0000 7faa1ae1f640 1 --2- 172.21.15.18:0/1478901334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa14102c30 0x7faa14103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.665+0000 7faa1ae1f640 1 -- 172.21.15.18:0/1478901334 >> 172.21.15.18:0/1478901334 conn(0x7faa140fc610 msgr2=0x7faa140fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.668+0000 7faa1ae1f640 1 -- 172.21.15.18:0/1478901334 shutdown_connections 2024-09-19T09:56:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.668+0000 7faa1ae1f640 1 -- 172.21.15.18:0/1478901334 wait complete. 2024-09-19T09:56:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.670+0000 7faa1ae1f640 1 Processor -- start 2024-09-19T09:56:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.670+0000 7faa1ae1f640 1 -- start start 2024-09-19T09:56:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.671+0000 7faa1ae1f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa14102c30 0x7faa1410b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.671+0000 7faa1ae1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14103550 0x7faa141056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.671+0000 7faa1ae1f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa1410bfd0 0x7faa14105c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.671+0000 7faa1ae1f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa1406c620 con 0x7faa14103550 2024-09-19T09:56:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.671+0000 7faa1ae1f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faa1406c4a0 con 0x7faa1410bfd0 2024-09-19T09:56:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.671+0000 7faa1ae1f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa1406c7a0 con 0x7faa14102c30 2024-09-19T09:56:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.672+0000 7faa1a61e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa1410bfd0 0x7faa14105c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.672+0000 7faa1a61e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa1410bfd0 0x7faa14105c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:40806/0 (socket says 172.21.15.18:40806) 2024-09-19T09:56:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.672+0000 7faa1a61e640 1 -- 172.21.15.18:0/2424172341 learned_addr learned my addr 172.21.15.18:0/2424172341 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.673+0000 7faa1961c640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14103550 0x7faa141056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.673+0000 7faa1a61e640 1 -- 172.21.15.18:0/2424172341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa14102c30 msgr2=0x7faa1410b650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:56:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.673+0000 7faa1a61e640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa14102c30 0x7faa1410b650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.673+0000 7faa1a61e640 1 -- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14103550 msgr2=0x7faa141056d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.673+0000 7faa1a61e640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14103550 0x7faa141056d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.673+0000 7faa1a61e640 1 -- 172.21.15.18:0/2424172341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa14106310 con 0x7faa1410bfd0 2024-09-19T09:56:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.674+0000 7faa1961c640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14103550 0x7faa141056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:56:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.674+0000 7faa1a61e640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa1410bfd0 0x7faa14105c10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00eaa0 tx=0x7faa0c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.675+0000 7faa0affd640 1 -- 172.21.15.18:0/2424172341 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00cdb0 con 0x7faa1410bfd0 2024-09-19T09:56:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.675+0000 7faa1ae1f640 1 -- 172.21.15.18:0/2424172341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa141af390 con 0x7faa1410bfd0 2024-09-19T09:56:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.675+0000 7faa1ae1f640 1 -- 172.21.15.18:0/2424172341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa141af790 con 0x7faa1410bfd0 2024-09-19T09:56:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.680+0000 7faa1e45a740 1 Processor -- start 2024-09-19T09:56:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.681+0000 7faa1e45a740 1 -- start start 2024-09-19T09:56:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.681+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 0x55b6d96eb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.681+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96eb960 0x55b6d96e6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.681+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d97011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.681+0000 7faa1e45a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b6d96482e0 con 0x55b6d96eb960 2024-09-19T09:56:34.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.681+0000 7faa1e45a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b6d95efce0 con 0x55b6d96fedd0 2024-09-19T09:56:34.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.681+0000 7faa1e45a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b6d96442a0 con 0x55b6d96eb040 2024-09-19T09:56:34.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.682+0000 7faa19e1d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96eb960 0x55b6d96e6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.682+0000 7faa19e1d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96eb960 0x55b6d96e6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37586/0 (socket says 172.21.15.18:37586) 2024-09-19T09:56:34.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.682+0000 7faa19e1d640 1 -- 172.21.15.18:0/2972245501 learned_addr learned my addr 172.21.15.18:0/2972245501 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:34.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.683+0000 7faa0affd640 1 -- 172.21.15.18:0/2424172341 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa0c005020 con 0x7faa1410bfd0 2024-09-19T09:56:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.683+0000 7faa0affd640 1 -- 172.21.15.18:0/2424172341 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0116b0 con 0x7faa1410bfd0 2024-09-19T09:56:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.684+0000 7faa1961c640 1 --2- 172.21.15.18:0/2972245501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d97011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.684+0000 7faa19e1d640 1 -- 172.21.15.18:0/2972245501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 msgr2=0x55b6d96eb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.684+0000 7faa19e1d640 1 --2- 172.21.15.18:0/2972245501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 0x55b6d96eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.684+0000 7faa19e1d640 1 -- 172.21.15.18:0/2972245501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 msgr2=0x55b6d97011c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.684+0000 7faa19e1d640 1 --2- 172.21.15.18:0/2972245501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d97011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.685+0000 7faa19e1d640 1 -- 172.21.15.18:0/2972245501 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d95d4440 con 0x55b6d96eb960 2024-09-19T09:56:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.693+0000 7faa0affd640 1 -- 172.21.15.18:0/2424172341 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faa0c0118f0 con 0x7faa1410bfd0 2024-09-19T09:56:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.694+0000 7faa19e1d640 1 --2- 172.21.15.18:0/2972245501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96eb960 0x55b6d96e6930 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7faa10009bd0 tx=0x7faa1000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a22ae6b4d4ffed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.695+0000 7faa0affd640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa000a3380 0x7faa000a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.695+0000 7faa0affd640 1 -- 172.21.15.18:0/2424172341 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7faa0c0cf9d0 con 0x7faa1410bfd0 2024-09-19T09:56:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.701+0000 7faa1961c640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa000a3380 0x7faa000a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.703+0000 7fa9ff7fe640 1 -- 172.21.15.18:0/2972245501 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10005020 con 0x55b6d96eb960 2024-09-19T09:56:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.703+0000 7fa9ff7fe640 1 -- 172.21.15.18:0/2972245501 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa100047a0 con 0x55b6d96eb960 2024-09-19T09:56:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.705+0000 7faa1e45a740 1 -- 172.21.15.18:0/2972245501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96eb960 msgr2=0x55b6d96e6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.705+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2972245501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96eb960 0x55b6d96e6930 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7faa10009bd0 tx=0x7faa1000e720 comp rx=0 tx=0).stop 2024-09-19T09:56:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.705+0000 7faa1e45a740 1 -- 172.21.15.18:0/2972245501 shutdown_connections 2024-09-19T09:56:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.705+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2972245501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d97011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.705+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2972245501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96eb960 0x55b6d96e6930 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.705+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2972245501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 0x55b6d96eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.705+0000 7faa1e45a740 1 -- 172.21.15.18:0/2972245501 >> 172.21.15.18:0/2972245501 conn(0x55b6d96e7710 msgr2=0x55b6d96e7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:34.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.709+0000 7faa1e45a740 1 -- 172.21.15.18:0/2972245501 shutdown_connections 2024-09-19T09:56:34.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.710+0000 7faa1e45a740 1 -- 172.21.15.18:0/2972245501 wait complete. 2024-09-19T09:56:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.710+0000 7faa1e45a740 1 -- start start 2024-09-19T09:56:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.711+0000 7faa1e45a740 1 Processor -- start 2024-09-19T09:56:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.713+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 0x55b6d96e6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.713+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d96e68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.713+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96e37e0 0x55b6d96e3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.713+0000 7faa1e45a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b6d9701700 con 0x55b6d96e37e0 2024-09-19T09:56:34.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.714+0000 7faa1e45a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b6d9603050 con 0x55b6d96fedd0 2024-09-19T09:56:34.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.715+0000 7faa1e45a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b6d9701880 con 0x55b6d96eb040 2024-09-19T09:56:34.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.715+0000 7faa1e45a740 10 client.0 _ll_register_callbacks cb 0x55b6d9643160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.717+0000 7faa1a61e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96e37e0 0x55b6d96e3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.720+0000 7faa19e1d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 0x55b6d96e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.720+0000 7faa1961c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d96e68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.721+0000 7faa19e1d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 0x55b6d96e6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50748/0 (socket says 172.21.15.18:50748) 2024-09-19T09:56:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.721+0000 7faa19e1d640 1 -- 172.21.15.18:0/2917526385 learned_addr learned my addr 172.21.15.18:0/2917526385 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.722+0000 7faa19e1d640 1 -- 172.21.15.18:0/2917526385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 msgr2=0x55b6d96e68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.722+0000 7faa19e1d640 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d96e68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.722+0000 7faa19e1d640 1 -- 172.21.15.18:0/2917526385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96e37e0 msgr2=0x55b6d96e3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.722+0000 7faa19e1d640 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96e37e0 0x55b6d96e3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.723+0000 7faa19e1d640 1 -- 172.21.15.18:0/2917526385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6d93b93c0 con 0x55b6d96eb040 2024-09-19T09:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.723+0000 7faa1961c640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa000a3380 0x7faa000a5840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55b6d96e8800 tx=0x7faa04000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.725+0000 7faa19e1d640 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 0x55b6d96e6380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faa1000f010 tx=0x7faa10009970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a04ee53cb629f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.725+0000 7fa9fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.726+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/2917526385 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10025020 con 0x55b6d96eb040 2024-09-19T09:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.727+0000 7faa1e45a740 1 -- 172.21.15.18:0/2917526385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6d9655850 con 0x55b6d96eb040 2024-09-19T09:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.727+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/2917526385 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7faa10011c10 con 0x55b6d96eb040 2024-09-19T09:56:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.729+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/2917526385 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa10011e10 con 0x55b6d96eb040 2024-09-19T09:56:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.729+0000 7faa1e45a740 10 client.25942 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.729+0000 7faa1e45a740 1 -- 172.21.15.18:0/2917526385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b6d970d230 con 0x55b6d96eb040 2024-09-19T09:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.730+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/2917526385 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b6d9655850 con 0x55b6d96eb040 2024-09-19T09:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.730+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/2917526385 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faa10018970 con 0x55b6d96eb040 2024-09-19T09:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.732+0000 7faa1e45a740 10 client.25942 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.732+0000 7faa1e45a740 10 client.25942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.732+0000 7faa1e45a740 20 client.25942 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.732+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6d970e950 0x55b6d9710d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.732+0000 7faa1e45a740 4 client.25942 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.732+0000 7faa1e45a740 1 -- 172.21.15.18:0/2917526385 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6d964fd60 con 0x55b6d970e950 2024-09-19T09:56:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.733+0000 7faa1961c640 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6d970e950 0x55b6d9710d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.743+0000 7fa9fd7fa640 10 client.25942 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:34.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.743+0000 7faa1961c640 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6d970e950 0x55b6d9710d90 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a842133cf2f4806a server_cookie=1be3d239a46ed107 in_seq=0 out_seq=0 2024-09-19T09:56:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.749+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/2917526385 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6d964fd60 con 0x55b6d970e950 2024-09-19T09:56:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.749+0000 7fa9fd7fa640 10 client.25942 handle_command_reply: tid=0 2024-09-19T09:56:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.749+0000 7faa1e45a740 1 client.25942 shutdown 2024-09-19T09:56:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.754+0000 7faa1e45a740 1 -- 172.21.15.18:0/2917526385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 msgr2=0x55b6d96e6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:34.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.754+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 0x55b6d96e6380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faa1000f010 tx=0x7faa10009970 comp rx=0 tx=0).stop 2024-09-19T09:56:34.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.754+0000 7faa1e45a740 1 -- 172.21.15.18:0/2917526385 shutdown_connections 2024-09-19T09:56:34.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.754+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6d970e950 0x55b6d9710d90 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.754+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96e37e0 0x55b6d96e3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.754+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d96e68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.754+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2917526385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96eb040 0x55b6d96e6380 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faa1000f010 tx=0x7faa10009970 comp rx=0 tx=0).stop 2024-09-19T09:56:34.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.754+0000 7faa1e45a740 1 -- 172.21.15.18:0/2917526385 >> 172.21.15.18:0/2917526385 conn(0x55b6d96e7710 msgr2=0x55b6d96ecc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:34.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.754+0000 7fa9fd7fa640 0 client.25942 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:34.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.756+0000 7faa1e45a740 1 -- 172.21.15.18:0/2917526385 shutdown_connections 2024-09-19T09:56:34.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.756+0000 7faa1e45a740 1 -- 172.21.15.18:0/2917526385 wait complete. 2024-09-19T09:56:34.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.756+0000 7faa1e45a740 20 client.25942 trim_cache size 0 max 16384 2024-09-19T09:56:34.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.818+0000 7faa1e45a740 1 Processor -- start 2024-09-19T09:56:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.819+0000 7faa1e45a740 1 -- start start 2024-09-19T09:56:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.820+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e37e0 0x55b6d96deaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.820+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96fedd0 0x55b6d97166a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.820+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96e69f0 0x55b6d9716be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.820+0000 7faa1e45a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f800e410 con 0x55b6d96fedd0 2024-09-19T09:56:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.820+0000 7faa1e45a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f800ff50 con 0x55b6d96e69f0 2024-09-19T09:56:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.820+0000 7faa1e45a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f800eae0 con 0x55b6d96e37e0 2024-09-19T09:56:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.821+0000 7faa19e1d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e37e0 0x55b6d96deaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.821+0000 7faa19e1d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e37e0 0x55b6d96deaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50754/0 (socket says 172.21.15.18:50754) 2024-09-19T09:56:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.821+0000 7faa19e1d640 1 -- 172.21.15.18:0/2905809980 learned_addr learned my addr 172.21.15.18:0/2905809980 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.821+0000 7faa1a61e640 1 --2- 172.21.15.18:0/2905809980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96e69f0 0x55b6d9716be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.823+0000 7faa19e1d640 1 -- 172.21.15.18:0/2905809980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96e69f0 msgr2=0x55b6d9716be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.823+0000 7faa19e1d640 1 --2- 172.21.15.18:0/2905809980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96e69f0 0x55b6d9716be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.823+0000 7faa19e1d640 1 -- 172.21.15.18:0/2905809980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96fedd0 msgr2=0x55b6d97166a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.823+0000 7faa19e1d640 1 --2- 172.21.15.18:0/2905809980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96fedd0 0x55b6d97166a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.823+0000 7faa19e1d640 1 -- 172.21.15.18:0/2905809980 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d96b11d0 con 0x55b6d96e37e0 2024-09-19T09:56:34.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.826+0000 7faa19e1d640 1 --2- 172.21.15.18:0/2905809980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e37e0 0x55b6d96deaf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa10018dc0 tx=0x7faa10005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7580c3ed5b7cebed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.828+0000 7fa9feffd640 1 -- 172.21.15.18:0/2905809980 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10025070 con 0x55b6d96e37e0 2024-09-19T09:56:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.828+0000 7fa9feffd640 1 -- 172.21.15.18:0/2905809980 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa10011c10 con 0x55b6d96e37e0 2024-09-19T09:56:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.828+0000 7fa9feffd640 1 -- 172.21.15.18:0/2905809980 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10021ab0 con 0x55b6d96e37e0 2024-09-19T09:56:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.829+0000 7faa1e45a740 1 -- 172.21.15.18:0/2905809980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e37e0 msgr2=0x55b6d96deaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.830+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2905809980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e37e0 0x55b6d96deaf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa10018dc0 tx=0x7faa10005850 comp rx=0 tx=0).stop 2024-09-19T09:56:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.831+0000 7faa1e45a740 1 -- 172.21.15.18:0/2905809980 shutdown_connections 2024-09-19T09:56:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.831+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2905809980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96e69f0 0x55b6d9716be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.831+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2905809980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96fedd0 0x55b6d97166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.831+0000 7faa1e45a740 1 --2- 172.21.15.18:0/2905809980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e37e0 0x55b6d96deaf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.831+0000 7faa1e45a740 1 -- 172.21.15.18:0/2905809980 >> 172.21.15.18:0/2905809980 conn(0x55b6d96e7710 msgr2=0x55b6d96ed390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:34.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.833+0000 7faa1e45a740 1 -- 172.21.15.18:0/2905809980 shutdown_connections 2024-09-19T09:56:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.835+0000 7faa1e45a740 1 -- 172.21.15.18:0/2905809980 wait complete. 2024-09-19T09:56:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.836+0000 7faa1e45a740 1 -- start start 2024-09-19T09:56:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.836+0000 7faa1e45a740 1 Processor -- start 2024-09-19T09:56:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.837+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96e37e0 0x55b6d97073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.837+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e69f0 0x55b6d96e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.837+0000 7faa1e45a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d96e0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.837+0000 7faa1e45a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f800f880 con 0x55b6d96e37e0 2024-09-19T09:56:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.837+0000 7faa1e45a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f800f1b0 con 0x55b6d96fedd0 2024-09-19T09:56:34.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.837+0000 7faa1e45a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f800c3f0 con 0x55b6d96e69f0 2024-09-19T09:56:34.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.837+0000 7faa1e45a740 10 client.0 _ll_register_callbacks cb 0x7faa10009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.839+0000 7faa1961c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e69f0 0x55b6d96e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.843+0000 7faa1a61e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d96e0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.843+0000 7faa1a61e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d96e0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:40848/0 (socket says 172.21.15.18:40848) 2024-09-19T09:56:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.843+0000 7faa1a61e640 1 -- 172.21.15.18:0/1806813782 learned_addr learned my addr 172.21.15.18:0/1806813782 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.844+0000 7faa1a61e640 1 -- 172.21.15.18:0/1806813782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e69f0 msgr2=0x55b6d96e06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.844+0000 7faa1a61e640 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e69f0 0x55b6d96e06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.844+0000 7faa1a61e640 1 -- 172.21.15.18:0/1806813782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96e37e0 msgr2=0x55b6d97073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.844+0000 7faa1a61e640 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96e37e0 0x55b6d97073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.844+0000 7faa1a61e640 1 -- 172.21.15.18:0/1806813782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6d96e14b0 con 0x55b6d96fedd0 2024-09-19T09:56:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.845+0000 7faa1a61e640 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d96e0cb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0059d0 tx=0x7faa0c09da10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3e8eda0d2f12b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.845+0000 7fa9fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:56:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.846+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/1806813782 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c01f040 con 0x55b6d96fedd0 2024-09-19T09:56:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.846+0000 7faa1e45a740 1 -- 172.21.15.18:0/1806813782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa10011c10 con 0x55b6d96fedd0 2024-09-19T09:56:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.846+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/1806813782 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7faa0c0a1170 con 0x55b6d96fedd0 2024-09-19T09:56:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.846+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/1806813782 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa0c0a1370 con 0x55b6d96fedd0 2024-09-19T09:56:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.846+0000 7faa1e45a740 10 client.25985 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.846+0000 7faa1e45a740 1 -- 172.21.15.18:0/1806813782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b6d97797b0 con 0x55b6d96fedd0 2024-09-19T09:56:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.849+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/1806813782 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa10011c10 con 0x55b6d96fedd0 2024-09-19T09:56:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.849+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/1806813782 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faa0c00f040 con 0x55b6d96fedd0 2024-09-19T09:56:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.854+0000 7faa1e45a740 10 client.25985 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.854+0000 7faa1e45a740 10 client.25985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.854+0000 7faa1e45a740 20 client.25985 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.854+0000 7faa1e45a740 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6d9779f50 0x55b6d977c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.854+0000 7faa1e45a740 4 client.25985 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:56:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.854+0000 7faa1e45a740 1 -- 172.21.15.18:0/1806813782 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b6d95cc210 con 0x55b6d9779f50 2024-09-19T09:56:34.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.859+0000 7faa19e1d640 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6d9779f50 0x55b6d977c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:34.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.865+0000 7faa19e1d640 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6d9779f50 0x55b6d977c370 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87248624c135ca37 server_cookie=240e4a25bc140ca in_seq=0 out_seq=0 2024-09-19T09:56:34.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.865+0000 7fa9fd7fa640 10 client.25985 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:34.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.870+0000 7fa9fd7fa640 1 -- 172.21.15.18:0/1806813782 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b6d95cc210 con 0x55b6d9779f50 2024-09-19T09:56:34.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.870+0000 7fa9fd7fa640 10 client.25985 handle_command_reply: tid=0 2024-09-19T09:56:34.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.870+0000 7faa1e45a740 1 client.25985 shutdown 2024-09-19T09:56:34.876 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:56:34.876 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T09:56:34.876 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T09:56:34.876 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:56:34.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.871+0000 7faa1e45a740 1 -- 172.21.15.18:0/1806813782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 msgr2=0x55b6d96e0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:34.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.871+0000 7faa1e45a740 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d96e0cb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0059d0 tx=0x7faa0c09da10 comp rx=0 tx=0).stop 2024-09-19T09:56:34.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.871+0000 7faa1e45a740 1 -- 172.21.15.18:0/1806813782 shutdown_connections 2024-09-19T09:56:34.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.871+0000 7faa1e45a740 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6d9779f50 0x55b6d977c370 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.871+0000 7faa1e45a740 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6d96fedd0 0x55b6d96e0cb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.871+0000 7faa1e45a740 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6d96e69f0 0x55b6d96e06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.871+0000 7faa1e45a740 1 --2- 172.21.15.18:0/1806813782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6d96e37e0 0x55b6d97073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.871+0000 7faa1e45a740 1 -- 172.21.15.18:0/1806813782 >> 172.21.15.18:0/1806813782 conn(0x55b6d96e7710 msgr2=0x55b6d96ed390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.872+0000 7fa9fd7fa640 0 client.25985 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.872+0000 7faa1e45a740 1 -- 172.21.15.18:0/1806813782 shutdown_connections 2024-09-19T09:56:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.872+0000 7faa1e45a740 1 -- 172.21.15.18:0/1806813782 wait complete. 2024-09-19T09:56:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.872+0000 7faa1e45a740 20 client.25985 trim_cache size 0 max 16384 2024-09-19T09:56:34.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.874+0000 7faa08ff9640 1 -- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa000a3380 msgr2=0x7faa000a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:34.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.874+0000 7faa08ff9640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa000a3380 0x7faa000a5840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55b6d96e8800 tx=0x7faa04000bc0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.874+0000 7faa08ff9640 1 -- 172.21.15.18:0/2424172341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa1410bfd0 msgr2=0x7faa14105c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.874+0000 7faa08ff9640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa1410bfd0 0x7faa14105c10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00eaa0 tx=0x7faa0c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:56:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.875+0000 7faa08ff9640 1 -- 172.21.15.18:0/2424172341 shutdown_connections 2024-09-19T09:56:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.875+0000 7faa08ff9640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa000a3380 0x7faa000a5840 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.875+0000 7faa08ff9640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa1410bfd0 0x7faa14105c10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.875+0000 7faa08ff9640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14103550 0x7faa141056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.875+0000 7faa08ff9640 1 --2- 172.21.15.18:0/2424172341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa14102c30 0x7faa1410b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.875+0000 7faa08ff9640 1 -- 172.21.15.18:0/2424172341 >> 172.21.15.18:0/2424172341 conn(0x7faa140fc610 msgr2=0x7faa140fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.875+0000 7faa08ff9640 1 -- 172.21.15.18:0/2424172341 shutdown_connections 2024-09-19T09:56:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:34.876+0000 7faa08ff9640 1 -- 172.21.15.18:0/2424172341 wait complete. 2024-09-19T09:56:36.576 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:36 smithi018 ceph-mon[30956]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 853 MiB/s wr, 2.72k op/s 2024-09-19T09:56:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:36 smithi049 ceph-mon[34858]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 853 MiB/s wr, 2.72k op/s 2024-09-19T09:56:36.771 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:56:36.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:56:36.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:36 smithi162 ceph-mon[35174]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 853 MiB/s wr, 2.72k op/s 2024-09-19T09:56:38.013 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:38.552 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:38 smithi018 ceph-mon[30956]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 858 MiB/s wr, 3.19k op/s 2024-09-19T09:56:38.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:38 smithi049 ceph-mon[34858]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 858 MiB/s wr, 3.19k op/s 2024-09-19T09:56:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:38 smithi162 ceph-mon[35174]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 858 MiB/s wr, 3.19k op/s 2024-09-19T09:56:39.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.419+0000 7f3cc9c25640 1 -- 172.21.15.18:0/1444698312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc410e090 msgr2=0x7f3cc410e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:39.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.419+0000 7f3cc9c25640 1 --2- 172.21.15.18:0/1444698312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc410e090 0x7f3cc410e470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009900 tx=0x7f3cb402b550 comp rx=0 tx=0).stop 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.419+0000 7f3cc9c25640 1 -- 172.21.15.18:0/1444698312 shutdown_connections 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.419+0000 7f3cc9c25640 1 --2- 172.21.15.18:0/1444698312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc406ee70 0x7f3cc407a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.419+0000 7f3cc9c25640 1 --2- 172.21.15.18:0/1444698312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cc406e4f0 0x7f3cc406e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.419+0000 7f3cc9c25640 1 --2- 172.21.15.18:0/1444698312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc410e090 0x7f3cc410e470 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.419+0000 7f3cc9c25640 1 -- 172.21.15.18:0/1444698312 >> 172.21.15.18:0/1444698312 conn(0x7f3cc4073180 msgr2=0x7f3cc4073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.420+0000 7f3cc9c25640 1 -- 172.21.15.18:0/1444698312 shutdown_connections 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.420+0000 7f3cc9c25640 1 -- 172.21.15.18:0/1444698312 wait complete. 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.421+0000 7f3cc9c25640 1 Processor -- start 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.421+0000 7f3cc9c25640 1 -- start start 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.421+0000 7f3cc9c25640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc406e4f0 0x7f3cc4084be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.421+0000 7f3cc9c25640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc406ee70 0x7f3cc407ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.422+0000 7f3cc9c25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cc407f1a0 0x7f3cc407f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.422+0000 7f3cc9c25640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc407dad0 con 0x7f3cc407f1a0 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.422+0000 7f3cc9c25640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc407d950 con 0x7f3cc406e4f0 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.422+0000 7f3cc9c25640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc407dc50 con 0x7f3cc406ee70 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.422+0000 7f3cc3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc406ee70 0x7f3cc407ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.422+0000 7f3cc3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc406ee70 0x7f3cc407ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47694/0 (socket says 172.21.15.18:47694) 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.422+0000 7f3cc3fff640 1 -- 172.21.15.18:0/2055844978 learned_addr learned my addr 172.21.15.18:0/2055844978 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.423+0000 7f3cc8c23640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc406e4f0 0x7f3cc4084be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.424+0000 7f3cc8c23640 1 -- 172.21.15.18:0/2055844978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc406ee70 msgr2=0x7f3cc407ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.424+0000 7f3cc8c23640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc406ee70 0x7f3cc407ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.424+0000 7f3cc8c23640 1 -- 172.21.15.18:0/2055844978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cc407f1a0 msgr2=0x7f3cc407f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.424+0000 7f3cc8c23640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cc407f1a0 0x7f3cc407f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.424+0000 7f3cc8c23640 1 -- 172.21.15.18:0/2055844978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc41b9ca0 con 0x7f3cc406e4f0 2024-09-19T09:56:39.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.427+0000 7f3cc8c23640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc406e4f0 0x7f3cc4084be0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4034040 tx=0x7f3cb4005230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:39.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.427+0000 7f3cc1ffb640 1 -- 172.21.15.18:0/2055844978 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4042020 con 0x7f3cc406e4f0 2024-09-19T09:56:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.427+0000 7f3cc9c25640 1 -- 172.21.15.18:0/2055844978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc41b9f30 con 0x7f3cc406e4f0 2024-09-19T09:56:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.428+0000 7f3cc9c25640 1 -- 172.21.15.18:0/2055844978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc41ba470 con 0x7f3cc406e4f0 2024-09-19T09:56:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.432+0000 7f3cc1ffb640 1 -- 172.21.15.18:0/2055844978 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb4005630 con 0x7f3cc406e4f0 2024-09-19T09:56:39.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.432+0000 7f3cab7fe640 1 -- 172.21.15.18:0/2055844978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb0005290 con 0x7f3cc406e4f0 2024-09-19T09:56:39.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.433+0000 7f3cc1ffb640 1 -- 172.21.15.18:0/2055844978 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40329d0 con 0x7f3cc406e4f0 2024-09-19T09:56:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.448+0000 7f3cc1ffb640 1 -- 172.21.15.18:0/2055844978 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3cb4045020 con 0x7f3cc406e4f0 2024-09-19T09:56:39.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.449+0000 7f3cc1ffb640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cac0a3480 0x7f3cac0a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:39.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.450+0000 7f3cc1ffb640 1 -- 172.21.15.18:0/2055844978 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3cb40f1b40 con 0x7f3cc406e4f0 2024-09-19T09:56:39.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.461+0000 7f3cc1ffb640 1 -- 172.21.15.18:0/2055844978 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3cb404c020 con 0x7f3cc406e4f0 2024-09-19T09:56:39.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.450+0000 7f3cc3fff640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cac0a3480 0x7f3cac0a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:39.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.487+0000 7f3cc3fff640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cac0a3480 0x7f3cac0a5940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4080420 tx=0x7f3cbc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:39.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.958+0000 7f3cab7fe640 1 -- 172.21.15.18:0/2055844978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cb0005580 con 0x7f3cc406e4f0 2024-09-19T09:56:39.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.961+0000 7f3cc1ffb640 1 -- 172.21.15.18:0/2055844978 <== mon.2 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f3cb40be8b0 con 0x7f3cc406e4f0 2024-09-19T09:56:39.968 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:56:39.968 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:56:39.968 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:56:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.966+0000 7f3cab7fe640 1 -- 172.21.15.18:0/2055844978 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cac0a3480 msgr2=0x7f3cac0a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.966+0000 7f3cab7fe640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cac0a3480 0x7f3cac0a5940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4080420 tx=0x7f3cbc009500 comp rx=0 tx=0).stop 2024-09-19T09:56:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.966+0000 7f3cab7fe640 1 -- 172.21.15.18:0/2055844978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc406e4f0 msgr2=0x7f3cc4084be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.966+0000 7f3cab7fe640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc406e4f0 0x7f3cc4084be0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4034040 tx=0x7f3cb4005230 comp rx=0 tx=0).stop 2024-09-19T09:56:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.966+0000 7f3cab7fe640 1 -- 172.21.15.18:0/2055844978 shutdown_connections 2024-09-19T09:56:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.967+0000 7f3cab7fe640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3cac0a3480 0x7f3cac0a5940 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.967+0000 7f3cab7fe640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cc407f1a0 0x7f3cc407f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.967+0000 7f3cab7fe640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc406ee70 0x7f3cc407ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.967+0000 7f3cab7fe640 1 --2- 172.21.15.18:0/2055844978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc406e4f0 0x7f3cc4084be0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4034040 tx=0x7f3cb4005230 comp rx=0 tx=0).stop 2024-09-19T09:56:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.967+0000 7f3cab7fe640 1 -- 172.21.15.18:0/2055844978 >> 172.21.15.18:0/2055844978 conn(0x7f3cc4073180 msgr2=0x7f3cc406cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.976+0000 7f3cab7fe640 1 -- 172.21.15.18:0/2055844978 shutdown_connections 2024-09-19T09:56:39.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:39.980+0000 7f3cab7fe640 1 -- 172.21.15.18:0/2055844978 wait complete. 2024-09-19T09:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6bdffb640 1 -- 172.21.15.18:0/310635959 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e3d1f0d70 con 0x562e3d328250 2024-09-19T09:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6bdffb640 10 client.16524 handle_command_reply: tid=0 2024-09-19T09:56:40.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6dfa49740 1 client.16524 shutdown 2024-09-19T09:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6dfa49740 1 -- 172.21.15.18:0/310635959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 msgr2=0x562e3d326030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d326030 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8004940 tx=0x7fd6c802b620 comp rx=0 tx=0).stop 2024-09-19T09:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6dfa49740 1 -- 172.21.15.18:0/310635959 shutdown_connections 2024-09-19T09:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562e3d328250 0x562e3d32a670 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e3d28b370 0x562e3d326030 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562e3d2862e0 0x562e3d2b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6dfa49740 1 --2- 172.21.15.18:0/310635959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e3d2859a0 0x562e3d2b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6dfa49740 1 -- 172.21.15.18:0/310635959 >> 172.21.15.18:0/310635959 conn(0x562e3d281010 msgr2=0x562e3d27f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6bdffb640 0 client.16524 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.218+0000 7fd6dfa49740 1 -- 172.21.15.18:0/310635959 shutdown_connections 2024-09-19T09:56:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.219+0000 7fd6dfa49740 1 -- 172.21.15.18:0/310635959 wait complete. 2024-09-19T09:56:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.219+0000 7fd6dfa49740 20 client.16524 trim_cache size 0 max 16384 2024-09-19T09:56:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:56:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:56:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:56:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3454830159 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6c00a3440 msgr2=0x7fd6c00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6c00a3440 0x7fd6c00a5900 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc006fd0 tx=0x7fd6cc008040 comp rx=0 tx=0).stop 2024-09-19T09:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3454830159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d8073980 msgr2=0x7fd6d80745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d8073980 0x7fd6d80745b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000ba50 tx=0x7fd6d000bf10 comp rx=0 tx=0).stop 2024-09-19T09:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3454830159 shutdown_connections 2024-09-19T09:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd6c00a3440 0x7fd6c00a5900 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d81096e0 0x7fd6d8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d8073980 0x7fd6d80745b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 --2- 172.21.15.18:0/3454830159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6d8072fc0 0x7fd6d8075f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3454830159 >> 172.21.15.18:0/3454830159 conn(0x7fd6d806ece0 msgr2=0x7fd6d8071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.225+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3454830159 shutdown_connections 2024-09-19T09:56:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:40.226+0000 7fd6dcbd8640 1 -- 172.21.15.18:0/3454830159 wait complete. 2024-09-19T09:56:40.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:40 smithi018 ceph-mon[30956]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 781 MiB/s wr, 3.25k op/s 2024-09-19T09:56:40.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:40 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2055844978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:56:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:40 smithi049 ceph-mon[34858]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 781 MiB/s wr, 3.25k op/s 2024-09-19T09:56:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:40 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2055844978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:56:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:40 smithi162 ceph-mon[35174]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 781 MiB/s wr, 3.25k op/s 2024-09-19T09:56:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:40 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2055844978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:56:40.812 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:56:40.813 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:56:40.813 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:56:41.366 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:56:41.827 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:42.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:42 smithi018 ceph-mon[30956]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 848 MiB/s wr, 3.55k op/s 2024-09-19T09:56:42.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:42 smithi049 ceph-mon[34858]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 848 MiB/s wr, 3.55k op/s 2024-09-19T09:56:42.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:42 smithi162 ceph-mon[35174]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 848 MiB/s wr, 3.55k op/s 2024-09-19T09:56:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.709+0000 7fe97be67640 1 -- 172.21.15.18:0/2821697533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe974109830 msgr2=0x7fe974109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.709+0000 7fe97be67640 1 --2- 172.21.15.18:0/2821697533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe974109830 0x7fe974109c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009900 tx=0x7fe96c02a440 comp rx=0 tx=0).stop 2024-09-19T09:56:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.710+0000 7fe97be67640 1 -- 172.21.15.18:0/2821697533 shutdown_connections 2024-09-19T09:56:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.710+0000 7fe97be67640 1 --2- 172.21.15.18:0/2821697533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97411b140 0x7fe97411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.710+0000 7fe97be67640 1 --2- 172.21.15.18:0/2821697533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe974109830 0x7fe974109c90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.710+0000 7fe97be67640 1 --2- 172.21.15.18:0/2821697533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe974109450 0x7fe974110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:42.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.710+0000 7fe97be67640 1 -- 172.21.15.18:0/2821697533 >> 172.21.15.18:0/2821697533 conn(0x7fe97406e140 msgr2=0x7fe97406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:42.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.710+0000 7fe97be67640 1 -- 172.21.15.18:0/2821697533 shutdown_connections 2024-09-19T09:56:42.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.712+0000 7fe97be67640 1 -- 172.21.15.18:0/2821697533 wait complete. 2024-09-19T09:56:42.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.713+0000 7fe97be67640 1 Processor -- start 2024-09-19T09:56:42.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.713+0000 7fe97be67640 1 -- start start 2024-09-19T09:56:42.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.713+0000 7fe97be67640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe974109450 0x7fe9741184b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:42.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.714+0000 7fe97be67640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe974109830 0x7fe9741189f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:42.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.714+0000 7fe97be67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97411b140 0x7fe974111540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:42.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.714+0000 7fe97be67640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe974120e10 con 0x7fe97411b140 2024-09-19T09:56:42.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.714+0000 7fe97be67640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe974120c90 con 0x7fe974109830 2024-09-19T09:56:42.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.714+0000 7fe97be67640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe974120f90 con 0x7fe974109450 2024-09-19T09:56:42.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.714+0000 7fe979402640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe974109830 0x7fe9741189f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:42.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.714+0000 7fe979402640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe974109830 0x7fe9741189f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43212/0 (socket says 172.21.15.18:43212) 2024-09-19T09:56:42.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.714+0000 7fe979402640 1 -- 172.21.15.18:0/532010865 learned_addr learned my addr 172.21.15.18:0/532010865 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:42.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.715+0000 7fe97a404640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97411b140 0x7fe974111540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:42.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.715+0000 7fe979402640 1 -- 172.21.15.18:0/532010865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe974109450 msgr2=0x7fe9741184b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:42.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.715+0000 7fe979402640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe974109450 0x7fe9741184b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:42.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.715+0000 7fe979402640 1 -- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97411b140 msgr2=0x7fe974111540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:42.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.715+0000 7fe979402640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97411b140 0x7fe974111540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:42.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.715+0000 7fe979402640 1 -- 172.21.15.18:0/532010865 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe974111de0 con 0x7fe974109830 2024-09-19T09:56:42.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.715+0000 7fe97a404640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97411b140 0x7fe974111540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:42.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.716+0000 7fe979402640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe974109830 0x7fe9741189f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe96c02aa30 tx=0x7fe96c003d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:42.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.718+0000 7fe972ffd640 1 -- 172.21.15.18:0/532010865 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c041020 con 0x7fe974109830 2024-09-19T09:56:42.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.718+0000 7fe972ffd640 1 -- 172.21.15.18:0/532010865 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe96c005160 con 0x7fe974109830 2024-09-19T09:56:42.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.719+0000 7fe972ffd640 1 -- 172.21.15.18:0/532010865 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c03db20 con 0x7fe974109830 2024-09-19T09:56:42.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.719+0000 7fe97be67640 1 -- 172.21.15.18:0/532010865 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe974112070 con 0x7fe974109830 2024-09-19T09:56:42.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.720+0000 7fe97be67640 1 -- 172.21.15.18:0/532010865 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe974115fe0 con 0x7fe974109830 2024-09-19T09:56:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.723+0000 7fe97be67640 1 -- 172.21.15.18:0/532010865 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe974073b00 con 0x7fe974109830 2024-09-19T09:56:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.726+0000 7fe972ffd640 1 -- 172.21.15.18:0/532010865 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe96c044020 con 0x7fe974109830 2024-09-19T09:56:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.728+0000 7fe972ffd640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe95c0a3180 0x7fe95c0a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.728+0000 7fe972ffd640 1 -- 172.21.15.18:0/532010865 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe96c0f07c0 con 0x7fe974109830 2024-09-19T09:56:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.733+0000 7fe979c03640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe95c0a3180 0x7fe95c0a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.734+0000 7fe979c03640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe95c0a3180 0x7fe95c0a5640 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe968009710 tx=0x7fe968006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:42.736+0000 7fe972ffd640 1 -- 172.21.15.18:0/532010865 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe96c0bd4b0 con 0x7fe974109830 2024-09-19T09:56:42.896 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.278+0000 7fe97be67640 1 -- 172.21.15.18:0/532010865 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe974116a60 con 0x7fe974109830 2024-09-19T09:56:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.280+0000 7fe972ffd640 1 -- 172.21.15.18:0/532010865 <== mon.2 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fe96c0bcdb0 con 0x7fe974109830 2024-09-19T09:56:43.286 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:56:43.287 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:56:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:56:43.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.289+0000 7fe970ff9640 1 -- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe95c0a3180 msgr2=0x7fe95c0a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:43.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.289+0000 7fe970ff9640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe95c0a3180 0x7fe95c0a5640 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe968009710 tx=0x7fe968006c90 comp rx=0 tx=0).stop 2024-09-19T09:56:43.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.289+0000 7fe970ff9640 1 -- 172.21.15.18:0/532010865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe974109830 msgr2=0x7fe9741189f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.289+0000 7fe970ff9640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe974109830 0x7fe9741189f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe96c02aa30 tx=0x7fe96c003d80 comp rx=0 tx=0).stop 2024-09-19T09:56:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.290+0000 7fe970ff9640 1 -- 172.21.15.18:0/532010865 shutdown_connections 2024-09-19T09:56:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.290+0000 7fe970ff9640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe95c0a3180 0x7fe95c0a5640 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.290+0000 7fe970ff9640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97411b140 0x7fe974111540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.290+0000 7fe970ff9640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe974109830 0x7fe9741189f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.290+0000 7fe970ff9640 1 --2- 172.21.15.18:0/532010865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe974109450 0x7fe9741184b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.290+0000 7fe970ff9640 1 -- 172.21.15.18:0/532010865 >> 172.21.15.18:0/532010865 conn(0x7fe97406e140 msgr2=0x7fe97411c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.290+0000 7fe970ff9640 1 -- 172.21.15.18:0/532010865 shutdown_connections 2024-09-19T09:56:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:43.290+0000 7fe970ff9640 1 -- 172.21.15.18:0/532010865 wait complete. 2024-09-19T09:56:43.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:43 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:56:43.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:43 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/532010865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:56:43.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:43 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:56:43.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:43 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/532010865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:56:43.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:43 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:56:43.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:43 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/532010865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:56:44.723 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:44 smithi018 ceph-mon[30956]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 863 MiB/s wr, 3.55k op/s 2024-09-19T09:56:44.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:44 smithi049 ceph-mon[34858]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 863 MiB/s wr, 3.55k op/s 2024-09-19T09:56:44.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:44 smithi162 ceph-mon[35174]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 863 MiB/s wr, 3.55k op/s 2024-09-19T09:56:44.941 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:56:44.942 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:56:45.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.452+0000 7fc8bf59e640 1 -- 172.21.15.18:0/1549716149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c011b140 msgr2=0x7fc8c011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:45.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.452+0000 7fc8bf59e640 1 --2- 172.21.15.18:0/1549716149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c011b140 0x7fc8c011d530 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009900 tx=0x7fc8b402a420 comp rx=0 tx=0).stop 2024-09-19T09:56:45.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.453+0000 7fc8bf59e640 1 -- 172.21.15.18:0/1549716149 shutdown_connections 2024-09-19T09:56:45.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.453+0000 7fc8bf59e640 1 --2- 172.21.15.18:0/1549716149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c011b140 0x7fc8c011d530 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.453+0000 7fc8bf59e640 1 --2- 172.21.15.18:0/1549716149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c006ea30 0x7fc8c006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.453+0000 7fc8bf59e640 1 --2- 172.21.15.18:0/1549716149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8c0110190 0x7fc8c006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.453+0000 7fc8bf59e640 1 -- 172.21.15.18:0/1549716149 >> 172.21.15.18:0/1549716149 conn(0x7fc8c0073180 msgr2=0x7fc8c0073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.454+0000 7fc8bf59e640 1 -- 172.21.15.18:0/1549716149 shutdown_connections 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.455+0000 7fc8bf59e640 1 -- 172.21.15.18:0/1549716149 wait complete. 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.456+0000 7fc8bf59e640 1 Processor -- start 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.456+0000 7fc8bf59e640 1 -- start start 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.457+0000 7fc8bf59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c006ea30 0x7fc8c0119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.457+0000 7fc8bf59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c0110190 0x7fc8c01127b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.457+0000 7fc8bf59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8c011b140 0x7fc8c0112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.458+0000 7fc8bf59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c0120bd0 con 0x7fc8c0110190 2024-09-19T09:56:45.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.458+0000 7fc8bf59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c0120a50 con 0x7fc8c006ea30 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.458+0000 7fc8bf59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c0120d50 con 0x7fc8c011b140 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.458+0000 7fc8be59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c006ea30 0x7fc8c0119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.458+0000 7fc8be59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c006ea30 0x7fc8c0119720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43226/0 (socket says 172.21.15.18:43226) 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.458+0000 7fc8be59c640 1 -- 172.21.15.18:0/3788875361 learned_addr learned my addr 172.21.15.18:0/3788875361 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.460+0000 7fc8be59c640 1 -- 172.21.15.18:0/3788875361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8c011b140 msgr2=0x7fc8c0112cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.460+0000 7fc8be59c640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8c011b140 0x7fc8c0112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.460+0000 7fc8be59c640 1 -- 172.21.15.18:0/3788875361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c0110190 msgr2=0x7fc8c01127b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.460+0000 7fc8be59c640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c0110190 0x7fc8c01127b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.460+0000 7fc8be59c640 1 -- 172.21.15.18:0/3788875361 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c01132b0 con 0x7fc8c006ea30 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.462+0000 7fc8be59c640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c006ea30 0x7fc8c0119720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800eab0 tx=0x7fc8b800ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.463+0000 7fc8af7fe640 1 -- 172.21.15.18:0/3788875361 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800ce40 con 0x7fc8c006ea30 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.463+0000 7fc8af7fe640 1 -- 172.21.15.18:0/3788875361 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8b8011950 con 0x7fc8c006ea30 2024-09-19T09:56:45.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.463+0000 7fc8af7fe640 1 -- 172.21.15.18:0/3788875361 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b801ab70 con 0x7fc8c006ea30 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.464+0000 7fc8bf59e640 1 -- 172.21.15.18:0/3788875361 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c01135a0 con 0x7fc8c006ea30 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.464+0000 7fc8bf59e640 1 -- 172.21.15.18:0/3788875361 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c0117570 con 0x7fc8c006ea30 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.468+0000 7fc8c72d9740 1 Processor -- start 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.469+0000 7fc8c72d9740 1 -- start start 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.469+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6be020 0x55a34a6bc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.469+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6bcab0 0x55a34a6bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.469+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.469+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a34a6222f0 con 0x55a34a6be020 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.469+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a34a5c9cf0 con 0x55a34a6bcab0 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.469+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a34a61e2b0 con 0x55a34a6c7850 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.472+0000 7fc8bdd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.473+0000 7fc8bdd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47736/0 (socket says 172.21.15.18:47736) 2024-09-19T09:56:45.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.473+0000 7fc8bdd9b640 1 -- 172.21.15.18:0/1663700408 learned_addr learned my addr 172.21.15.18:0/1663700408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.474+0000 7fc8be59c640 1 --2- 172.21.15.18:0/1663700408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6bcab0 0x55a34a6bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.476+0000 7fc8af7fe640 1 -- 172.21.15.18:0/3788875361 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc8b801ad10 con 0x7fc8c006ea30 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.477+0000 7fc8bdd9b640 1 -- 172.21.15.18:0/1663700408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6bcab0 msgr2=0x55a34a6bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.477+0000 7fc8bdd9b640 1 --2- 172.21.15.18:0/1663700408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6bcab0 0x55a34a6bcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.477+0000 7fc8bdd9b640 1 -- 172.21.15.18:0/1663700408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6be020 msgr2=0x55a34a6bc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.477+0000 7fc8bdd9b640 1 --2- 172.21.15.18:0/1663700408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6be020 0x55a34a6bc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.477+0000 7fc8bdd9b640 1 -- 172.21.15.18:0/1663700408 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34a5ae3a0 con 0x55a34a6c7850 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.478+0000 7fc8bdd9b640 1 --2- 172.21.15.18:0/1663700408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c9c40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00097b0 tx=0x7fc8b0009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42f634c9582f6862 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.479+0000 7fc8af7fe640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc8a80a3450 0x7fc8a80a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.480+0000 7fc8af7fe640 1 -- 172.21.15.18:0/3788875361 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc8b80d3180 con 0x7fc8c006ea30 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.482+0000 7fc8bed9d640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc8a80a3450 0x7fc8a80a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.498+0000 7fc8bed9d640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc8a80a3450 0x7fc8a80a5910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4031580 tx=0x7fc8b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:45.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.504+0000 7fc8a7fff640 1 -- 172.21.15.18:0/1663700408 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0015020 con 0x55a34a6c7850 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.504+0000 7fc8a7fff640 1 -- 172.21.15.18:0/1663700408 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8b0011420 con 0x55a34a6c7850 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.505+0000 7fc8c72d9740 1 -- 172.21.15.18:0/1663700408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 msgr2=0x55a34a6c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.505+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/1663700408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c9c40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00097b0 tx=0x7fc8b0009c70 comp rx=0 tx=0).stop 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.506+0000 7fc8c72d9740 1 -- 172.21.15.18:0/1663700408 shutdown_connections 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.506+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/1663700408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c9c40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.506+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/1663700408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6bcab0 0x55a34a6bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.506+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/1663700408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6be020 0x55a34a6bc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.506+0000 7fc8c72d9740 1 -- 172.21.15.18:0/1663700408 >> 172.21.15.18:0/1663700408 conn(0x55a34a685310 msgr2=0x55a34a6b9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.506+0000 7fc8c72d9740 1 -- 172.21.15.18:0/1663700408 shutdown_connections 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.506+0000 7fc8c72d9740 1 -- 172.21.15.18:0/1663700408 wait complete. 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.507+0000 7fc8c72d9740 1 -- start start 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.507+0000 7fc8c72d9740 1 Processor -- start 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.508+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 0x55a34a6c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.508+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6be020 0x55a34a6c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.508+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.508+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a34a6ca4c0 con 0x55a34a6bcab0 2024-09-19T09:56:45.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.508+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a34a5dd060 con 0x55a34a6be020 2024-09-19T09:56:45.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.508+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a34a6ca640 con 0x55a34a6c7850 2024-09-19T09:56:45.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.508+0000 7fc8c72d9740 10 client.0 _ll_register_callbacks cb 0x55a34a3308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:45.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.513+0000 7fc8bed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.513+0000 7fc8bdd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6be020 0x55a34a6c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.513+0000 7fc8bed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47742/0 (socket says 172.21.15.18:47742) 2024-09-19T09:56:45.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.513+0000 7fc8bed9d640 1 -- 172.21.15.18:0/2768570937 learned_addr learned my addr 172.21.15.18:0/2768570937 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:45.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.514+0000 7fc8be59c640 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 0x55a34a6c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.043 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:56:45.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.518+0000 7fc8bed9d640 1 -- 172.21.15.18:0/2768570937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6be020 msgr2=0x55a34a6c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:45.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.518+0000 7fc8bed9d640 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6be020 0x55a34a6c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.518+0000 7fc8bed9d640 1 -- 172.21.15.18:0/2768570937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 msgr2=0x55a34a6c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:45.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.518+0000 7fc8bed9d640 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 0x55a34a6c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.518+0000 7fc8bed9d640 1 -- 172.21.15.18:0/2768570937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34a3933c0 con 0x55a34a6c7850 2024-09-19T09:56:45.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.518+0000 7fc8bed9d640 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c4720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40044d0 tx=0x7fc8b4004500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f28c97290e0177c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:45.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.518+0000 7fc8a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.564+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/2768570937 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4040070 con 0x55a34a6c7850 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.565+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/2768570937 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc8b40037f0 con 0x55a34a6c7850 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.565+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2768570937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8b0011420 con 0x55a34a6c7850 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.565+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/2768570937 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc8b4035040 con 0x55a34a6c7850 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.565+0000 7fc8c72d9740 10 client.25960 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.565+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2768570937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a34a6d5d00 con 0x55a34a6c7850 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.566+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/2768570937 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8b0011420 con 0x55a34a6c7850 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.566+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/2768570937 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc8b4047c70 con 0x55a34a6c7850 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.566+0000 7fc8c72d9740 10 client.25960 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.566+0000 7fc8c72d9740 10 client.25960 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.566+0000 7fc8c72d9740 20 client.25960 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.566+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a34a6d71c0 0x55a34a6d95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.566+0000 7fc8c72d9740 4 client.25960 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.566+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2768570937 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a34a62f860 con 0x55a34a6d71c0 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.569+0000 7fc8be59c640 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a34a6d71c0 0x55a34a6d95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.571+0000 7fc8be59c640 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a34a6d71c0 0x55a34a6d95b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=adc5e02b7cebce83 server_cookie=c108f28960b58d18 in_seq=0 out_seq=0 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.571+0000 7fc8a5ffb640 10 client.25960 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.573+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/2768570937 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc8b809fe70 con 0x55a34a6d71c0 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.573+0000 7fc8a5ffb640 10 client.25960 handle_command_reply: tid=0 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.573+0000 7fc8c72d9740 1 client.25960 shutdown 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.573+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2768570937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 msgr2=0x55a34a6c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.573+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c4720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40044d0 tx=0x7fc8b4004500 comp rx=0 tx=0).stop 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.575+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2768570937 shutdown_connections 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.575+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a34a6d71c0 0x55a34a6d95b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.575+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6c4720 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.575+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6be020 0x55a34a6c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.575+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/2768570937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 0x55a34a6c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.575+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2768570937 >> 172.21.15.18:0/2768570937 conn(0x55a34a685310 msgr2=0x55a34a6bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.575+0000 7fc8a5ffb640 0 client.25960 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.575+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2768570937 shutdown_connections 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.575+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2768570937 wait complete. 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.576+0000 7fc8c72d9740 20 client.25960 trim_cache size 0 max 16384 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.625+0000 7fc8c72d9740 1 Processor -- start 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.633+0000 7fc8c72d9740 1 -- start start 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.634+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 0x55a34a6c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.634+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6be020 0x55a34a6dee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.634+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6c7850 0x55a34a6df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.635+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c01c4a10 con 0x55a34a6bcab0 2024-09-19T09:56:45.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.635+0000 7fc8bdd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6be020 0x55a34a6dee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.635+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c01c6550 con 0x55a34a6c7850 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.635+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c01c50e0 con 0x55a34a6be020 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.639+0000 7fc8bed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6c7850 0x55a34a6df3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.639+0000 7fc8bed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6c7850 0x55a34a6df3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43252/0 (socket says 172.21.15.18:43252) 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.639+0000 7fc8bed9d640 1 -- 172.21.15.18:0/2825308556 learned_addr learned my addr 172.21.15.18:0/2825308556 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.640+0000 7fc8be59c640 1 --2- 172.21.15.18:0/2825308556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 0x55a34a6c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.643+0000 7fc8be59c640 1 -- 172.21.15.18:0/2825308556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6be020 msgr2=0x55a34a6dee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.643+0000 7fc8be59c640 1 --2- 172.21.15.18:0/2825308556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6be020 0x55a34a6dee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.643+0000 7fc8be59c640 1 -- 172.21.15.18:0/2825308556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6c7850 msgr2=0x55a34a6df3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.643+0000 7fc8be59c640 1 --2- 172.21.15.18:0/2825308556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6c7850 0x55a34a6df3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.643+0000 7fc8be59c640 1 -- 172.21.15.18:0/2825308556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34a55d1e0 con 0x55a34a6bcab0 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.645+0000 7fc8be59c640 1 --2- 172.21.15.18:0/2825308556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 0x55a34a6c4710 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55a34a6b9fa0 tx=0x7fc8b808a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca92f6edc2ee8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.646+0000 7fc8a77fe640 1 -- 172.21.15.18:0/2825308556 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b809f0d0 con 0x55a34a6bcab0 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.646+0000 7fc8a77fe640 1 -- 172.21.15.18:0/2825308556 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a34a62f860 con 0x55a34a6bcab0 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.648+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2825308556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 msgr2=0x55a34a6c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.648+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/2825308556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 0x55a34a6c4710 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55a34a6b9fa0 tx=0x7fc8b808a040 comp rx=0 tx=0).stop 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.648+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2825308556 shutdown_connections 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.648+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/2825308556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6c7850 0x55a34a6df3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.648+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/2825308556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6be020 0x55a34a6dee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.648+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/2825308556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6bcab0 0x55a34a6c4710 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.648+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2825308556 >> 172.21.15.18:0/2825308556 conn(0x55a34a685310 msgr2=0x55a34a6c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.649+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2825308556 shutdown_connections 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.649+0000 7fc8c72d9740 1 -- 172.21.15.18:0/2825308556 wait complete. 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.650+0000 7fc8c72d9740 1 -- start start 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.650+0000 7fc8c72d9740 1 Processor -- start 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.651+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6be020 0x55a34a6cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.652+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.652+0000 7fc8c72d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6cb690 0x55a34a6cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.653+0000 7fc8bdd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.653+0000 7fc8bed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6cb690 0x55a34a6cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.653+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c01c5e80 con 0x55a34a6be020 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.653+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c01c57b0 con 0x55a34a6cb690 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.653+0000 7fc8c72d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c01c29f0 con 0x55a34a6c7850 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.653+0000 7fc8bdd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47764/0 (socket says 172.21.15.18:47764) 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.653+0000 7fc8bdd9b640 1 -- 172.21.15.18:0/3151489867 learned_addr learned my addr 172.21.15.18:0/3151489867 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.653+0000 7fc8c72d9740 10 client.0 _ll_register_callbacks cb 0x7fc8c00688b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.655+0000 7fc8bed9d640 1 -- 172.21.15.18:0/3151489867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 msgr2=0x55a34a6cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.655+0000 7fc8bed9d640 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.655+0000 7fc8bed9d640 1 -- 172.21.15.18:0/3151489867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6be020 msgr2=0x55a34a6cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:45.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.655+0000 7fc8bed9d640 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6be020 0x55a34a6cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.655+0000 7fc8bed9d640 1 -- 172.21.15.18:0/3151489867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34a740e50 con 0x55a34a6cb690 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.659+0000 7fc8bed9d640 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6cb690 0x55a34a6cbb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4006010 tx=0x7fc8b403ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf53ce56710e179 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.659+0000 7fc8a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.660+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/3151489867 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b405d060 con 0x55a34a6cb690 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.660+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/3151489867 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc8b4003a00 con 0x55a34a6cb690 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.661+0000 7fc8c72d9740 1 -- 172.21.15.18:0/3151489867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a34a629d70 con 0x55a34a6cb690 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.662+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/3151489867 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc8b4040070 con 0x55a34a6cb690 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.663+0000 7fc8c72d9740 10 client.26015 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.663+0000 7fc8c72d9740 1 -- 172.21.15.18:0/3151489867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a34a742040 con 0x55a34a6cb690 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.666+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/3151489867 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a34a629d70 con 0x55a34a6cb690 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.666+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/3151489867 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc8b4047b20 con 0x55a34a6cb690 2024-09-19T09:56:45.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.666+0000 7fc8c72d9740 10 client.26015 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.666+0000 7fc8c72d9740 10 client.26015 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.667+0000 7fc8c72d9740 20 client.26015 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.667+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a34a7425e0 0x55a34a744a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.667+0000 7fc8c72d9740 4 client.26015 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.667+0000 7fc8c72d9740 1 -- 172.21.15.18:0/3151489867 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a34a5a6170 con 0x55a34a7425e0 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.668+0000 7fc8be59c640 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a34a7425e0 0x55a34a744a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.672+0000 7fc8a5ffb640 10 client.26015 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.672+0000 7fc8be59c640 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a34a7425e0 0x55a34a744a40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4713fd5e466fa6ad server_cookie=b7f4691e3e73c833 in_seq=0 out_seq=0 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.673+0000 7fc8a5ffb640 1 -- 172.21.15.18:0/3151489867 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc8b809fe70 con 0x55a34a7425e0 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.673+0000 7fc8a5ffb640 10 client.26015 handle_command_reply: tid=0 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.673+0000 7fc8c72d9740 1 client.26015 shutdown 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.675+0000 7fc8c72d9740 1 -- 172.21.15.18:0/3151489867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6cb690 msgr2=0x55a34a6cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.675+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6cb690 0x55a34a6cbb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4006010 tx=0x7fc8b403ad10 comp rx=0 tx=0).stop 2024-09-19T09:56:45.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.675+0000 7fc8c72d9740 1 -- 172.21.15.18:0/3151489867 shutdown_connections 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.675+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a34a7425e0 0x55a34a744a40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.675+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a34a6cb690 0x55a34a6cbb10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.675+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34a6c7850 0x55a34a6cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.675+0000 7fc8c72d9740 1 --2- 172.21.15.18:0/3151489867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a34a6be020 0x55a34a6cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.675+0000 7fc8c72d9740 1 -- 172.21.15.18:0/3151489867 >> 172.21.15.18:0/3151489867 conn(0x55a34a685310 msgr2=0x55a34a6be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.675+0000 7fc8a5ffb640 0 client.26015 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.679+0000 7fc8c72d9740 1 -- 172.21.15.18:0/3151489867 shutdown_connections 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.679+0000 7fc8c72d9740 1 -- 172.21.15.18:0/3151489867 wait complete. 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.681+0000 7fc8c72d9740 20 client.26015 trim_cache size 0 max 16384 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.685+0000 7fc8ad7fa640 1 -- 172.21.15.18:0/3788875361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc8a80a3450 msgr2=0x7fc8a80a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.685+0000 7fc8ad7fa640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc8a80a3450 0x7fc8a80a5910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4031580 tx=0x7fc8b4005a20 comp rx=0 tx=0).stop 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.685+0000 7fc8ad7fa640 1 -- 172.21.15.18:0/3788875361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c006ea30 msgr2=0x7fc8c0119720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.685+0000 7fc8ad7fa640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c006ea30 0x7fc8c0119720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800eab0 tx=0x7fc8b800ef70 comp rx=0 tx=0).stop 2024-09-19T09:56:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.686+0000 7fc8ad7fa640 1 -- 172.21.15.18:0/3788875361 shutdown_connections 2024-09-19T09:56:45.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.686+0000 7fc8ad7fa640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc8a80a3450 0x7fc8a80a5910 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.686+0000 7fc8ad7fa640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8c011b140 0x7fc8c0112cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.686+0000 7fc8ad7fa640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c0110190 0x7fc8c01127b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.686+0000 7fc8ad7fa640 1 --2- 172.21.15.18:0/3788875361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8c006ea30 0x7fc8c0119720 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:45.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.686+0000 7fc8ad7fa640 1 -- 172.21.15.18:0/3788875361 >> 172.21.15.18:0/3788875361 conn(0x7fc8c0073180 msgr2=0x7fc8c006b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:45.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.686+0000 7fc8ad7fa640 1 -- 172.21.15.18:0/3788875361 shutdown_connections 2024-09-19T09:56:45.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:44.686+0000 7fc8ad7fa640 1 -- 172.21.15.18:0/3788875361 wait complete. 2024-09-19T09:56:45.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:56:46.092 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:46.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:45 smithi018 ceph-mon[30956]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 823 MiB/s wr, 3.11k op/s 2024-09-19T09:56:46.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:56:46.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:56:46.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:56:46.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:45 smithi049 ceph-mon[34858]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 823 MiB/s wr, 3.11k op/s 2024-09-19T09:56:46.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:56:46.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:56:46.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:56:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:45 smithi162 ceph-mon[35174]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 823 MiB/s wr, 3.11k op/s 2024-09-19T09:56:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:56:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:56:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:56:47.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.045+0000 7f5d1c937640 1 -- 172.21.15.18:0/3690056453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1806ea30 msgr2=0x7f5d1806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:47.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.046+0000 7f5d1c937640 1 --2- 172.21.15.18:0/3690056453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1806ea30 0x7f5d1806ee70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009900 tx=0x7f5d0c02a440 comp rx=0 tx=0).stop 2024-09-19T09:56:47.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.047+0000 7f5d1c937640 1 -- 172.21.15.18:0/3690056453 shutdown_connections 2024-09-19T09:56:47.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.047+0000 7f5d1c937640 1 --2- 172.21.15.18:0/3690056453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1811b140 0x7f5d1811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.047+0000 7f5d1c937640 1 --2- 172.21.15.18:0/3690056453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1806ea30 0x7f5d1806ee70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.047+0000 7f5d1c937640 1 --2- 172.21.15.18:0/3690056453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d18110190 0x7f5d1806e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.047+0000 7f5d1c937640 1 -- 172.21.15.18:0/3690056453 >> 172.21.15.18:0/3690056453 conn(0x7f5d18073180 msgr2=0x7f5d18073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:47.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.047+0000 7f5d1c937640 1 -- 172.21.15.18:0/3690056453 shutdown_connections 2024-09-19T09:56:47.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.047+0000 7f5d1c937640 1 -- 172.21.15.18:0/3690056453 wait complete. 2024-09-19T09:56:47.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.049+0000 7f5d1c937640 1 Processor -- start 2024-09-19T09:56:47.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.050+0000 7f5d1c937640 1 -- start start 2024-09-19T09:56:47.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.051+0000 7f5d1c937640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1806ea30 0x7f5d181a7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.051+0000 7f5d1c937640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d18110190 0x7f5d181a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.051+0000 7f5d1c937640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1811b140 0x7f5d181abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.051+0000 7f5d1c937640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d18120c40 con 0x7f5d1806ea30 2024-09-19T09:56:47.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.051+0000 7f5d1c937640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d18120ac0 con 0x7f5d18110190 2024-09-19T09:56:47.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.051+0000 7f5d1c937640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d18120dc0 con 0x7f5d1811b140 2024-09-19T09:56:47.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.052+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d18110190 0x7f5d181a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.052+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d18110190 0x7f5d181a77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60702/0 (socket says 172.21.15.18:60702) 2024-09-19T09:56:47.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.052+0000 7f5d1659c640 1 -- 172.21.15.18:0/3812358878 learned_addr learned my addr 172.21.15.18:0/3812358878 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:47.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.052+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1806ea30 0x7f5d181a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.054+0000 7f5d1759e640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1811b140 0x7f5d181abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.054+0000 7f5d1659c640 1 -- 172.21.15.18:0/3812358878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1811b140 msgr2=0x7f5d181abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:47.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.054+0000 7f5d1659c640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1811b140 0x7f5d181abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.054+0000 7f5d1659c640 1 -- 172.21.15.18:0/3812358878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1806ea30 msgr2=0x7f5d181a7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:47.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.054+0000 7f5d1659c640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1806ea30 0x7f5d181a7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.054+0000 7f5d1659c640 1 -- 172.21.15.18:0/3812358878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d181ac230 con 0x7f5d18110190 2024-09-19T09:56:47.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.055+0000 7f5d1659c640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d18110190 0x7f5d181a77c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c02a9b0 tx=0x7f5d0c031ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.057+0000 7f5cfffff640 1 -- 172.21.15.18:0/3812358878 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c041020 con 0x7f5d18110190 2024-09-19T09:56:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.057+0000 7f5cfffff640 1 -- 172.21.15.18:0/3812358878 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d0c0053c0 con 0x7f5d18110190 2024-09-19T09:56:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.057+0000 7f5cfffff640 1 -- 172.21.15.18:0/3812358878 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c036040 con 0x7f5d18110190 2024-09-19T09:56:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.058+0000 7f5d1c937640 1 -- 172.21.15.18:0/3812358878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d181ac4c0 con 0x7f5d18110190 2024-09-19T09:56:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.059+0000 7f5d1c937640 1 -- 172.21.15.18:0/3812358878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d181ac950 con 0x7f5d18110190 2024-09-19T09:56:47.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.063+0000 7f5d1f511740 1 Processor -- start 2024-09-19T09:56:47.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.063+0000 7f5d1f511740 1 -- start start 2024-09-19T09:56:47.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.064+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10bac00 0x55cfa10bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.064+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bb520 0x55cfa10c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.064+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 0x55cfa10c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.064+0000 7f5d1f511740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cfa10202a0 con 0x55cfa10bac00 2024-09-19T09:56:47.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.064+0000 7f5d1f511740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cfa0fc7b10 con 0x55cfa10c5de0 2024-09-19T09:56:47.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.064+0000 7f5d1f511740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cfa101c260 con 0x55cfa10bb520 2024-09-19T09:56:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.068+0000 7f5d1759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10bac00 0x55cfa10bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.068+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bb520 0x55cfa10c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.068+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bb520 0x55cfa10c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42346/0 (socket says 172.21.15.18:42346) 2024-09-19T09:56:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.068+0000 7f5d16d9d640 1 -- 172.21.15.18:0/601234408 learned_addr learned my addr 172.21.15.18:0/601234408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.068+0000 7f5d1659c640 1 --2- 172.21.15.18:0/601234408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 0x55cfa10c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.071+0000 7f5cfffff640 1 -- 172.21.15.18:0/3812358878 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5d0c044020 con 0x7f5d18110190 2024-09-19T09:56:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.072+0000 7f5d16d9d640 1 -- 172.21.15.18:0/601234408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 msgr2=0x55cfa10c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.072+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/601234408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 0x55cfa10c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.072+0000 7f5d16d9d640 1 -- 172.21.15.18:0/601234408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10bac00 msgr2=0x55cfa10bafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.072+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/601234408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10bac00 0x55cfa10bafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.072+0000 7f5d16d9d640 1 -- 172.21.15.18:0/601234408 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa0d91b90 con 0x55cfa10bb520 2024-09-19T09:56:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.073+0000 7f5d1659c640 1 --2- 172.21.15.18:0/601234408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 0x55cfa10c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:56:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.073+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/601234408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bb520 0x55cfa10c58a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009a70 tx=0x7f5d08009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfc3e7ed6e53092b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.073+0000 7f5cfffff640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5d000a3450 0x7f5d000a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.074+0000 7f5cfffff640 1 -- 172.21.15.18:0/3812358878 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5d0c0f3180 con 0x7f5d18110190 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.074+0000 7f5cfcff9640 1 -- 172.21.15.18:0/601234408 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08017070 con 0x55cfa10bb520 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.074+0000 7f5cfcff9640 1 -- 172.21.15.18:0/601234408 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d08013470 con 0x55cfa10bb520 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.076+0000 7f5d1f511740 1 -- 172.21.15.18:0/601234408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bb520 msgr2=0x55cfa10c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.076+0000 7f5d1f511740 1 --2- 172.21.15.18:0/601234408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bb520 0x55cfa10c58a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009a70 tx=0x7f5d08009f30 comp rx=0 tx=0).stop 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.076+0000 7f5d1f511740 1 -- 172.21.15.18:0/601234408 shutdown_connections 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.076+0000 7f5d1f511740 1 --2- 172.21.15.18:0/601234408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 0x55cfa10c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.076+0000 7f5d1f511740 1 --2- 172.21.15.18:0/601234408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bb520 0x55cfa10c58a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.076+0000 7f5d1f511740 1 --2- 172.21.15.18:0/601234408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10bac00 0x55cfa10bafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.076+0000 7f5d1f511740 1 -- 172.21.15.18:0/601234408 >> 172.21.15.18:0/601234408 conn(0x55cfa10b7190 msgr2=0x55cfa10b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:47.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.076+0000 7f5d1f511740 1 -- 172.21.15.18:0/601234408 shutdown_connections 2024-09-19T09:56:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.076+0000 7f5d1f511740 1 -- 172.21.15.18:0/601234408 wait complete. 2024-09-19T09:56:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.077+0000 7f5d1f511740 1 -- start start 2024-09-19T09:56:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.077+0000 7f5d1f511740 1 Processor -- start 2024-09-19T09:56:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.078+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 0x55cfa10c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.078+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 0x55cfa10c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.078+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10c2d60 0x55cfa10c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.078+0000 7f5d1f511740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cfa10c8970 con 0x55cfa10c2d60 2024-09-19T09:56:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.078+0000 7f5d1f511740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cfa0fa86e0 con 0x55cfa10c5de0 2024-09-19T09:56:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.078+0000 7f5d1f511740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cfa10c8af0 con 0x55cfa10bac00 2024-09-19T09:56:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.078+0000 7f5d1f511740 10 client.0 _ll_register_callbacks cb 0x55cfa0fcca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:47.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.083+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 0x55cfa10c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.083+0000 7f5d1759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10c2d60 0x55cfa10c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.083+0000 7f5d1759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10c2d60 0x55cfa10c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54798/0 (socket says 172.21.15.18:54798) 2024-09-19T09:56:47.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.083+0000 7f5d1759e640 1 -- 172.21.15.18:0/129642349 learned_addr learned my addr 172.21.15.18:0/129642349 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:47.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.083+0000 7f5d1759e640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5d000a3450 0x7f5d000a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.083+0000 7f5d1659c640 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 0x55cfa10c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.084+0000 7f5d16d9d640 1 -- 172.21.15.18:0/129642349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 msgr2=0x55cfa10c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:47.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.084+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 0x55cfa10c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.084+0000 7f5d16d9d640 1 -- 172.21.15.18:0/129642349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10c2d60 msgr2=0x55cfa10c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.084+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10c2d60 0x55cfa10c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.084+0000 7f5d16d9d640 1 -- 172.21.15.18:0/129642349 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa10e2e40 con 0x55cfa10bac00 2024-09-19T09:56:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.084+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 0x55cfa10c5570 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009a70 tx=0x7f5d0800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f8d6a19bc2cbe01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.085+0000 7f5cfaff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:56:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.085+0000 7f5cfaff5640 1 -- 172.21.15.18:0/129642349 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08017050 con 0x55cfa10bac00 2024-09-19T09:56:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.085+0000 7f5d1f511740 1 -- 172.21.15.18:0/129642349 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cfa102d9d0 con 0x55cfa10bac00 2024-09-19T09:56:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.086+0000 7f5cfaff5640 1 -- 172.21.15.18:0/129642349 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5d08012d20 con 0x55cfa10bac00 2024-09-19T09:56:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.086+0000 7f5cfaff5640 1 -- 172.21.15.18:0/129642349 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d08013470 con 0x55cfa10bac00 2024-09-19T09:56:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.086+0000 7f5d1f511740 10 client.25978 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:47.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.086+0000 7f5d1f511740 1 -- 172.21.15.18:0/129642349 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cfa10e57d0 con 0x55cfa10bac00 2024-09-19T09:56:47.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.087+0000 7f5cfaff5640 1 -- 172.21.15.18:0/129642349 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55cfa102d9d0 con 0x55cfa10bac00 2024-09-19T09:56:47.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.088+0000 7f5cfaff5640 1 -- 172.21.15.18:0/129642349 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5d0801c860 con 0x55cfa10bac00 2024-09-19T09:56:47.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.088+0000 7f5d1f511740 10 client.25978 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:47.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.088+0000 7f5d1f511740 10 client.25978 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:56:47.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.088+0000 7f5d1f511740 20 client.25978 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:47.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.089+0000 7f5d1f511740 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cfa10e6f70 0x55cfa10e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.089+0000 7f5d1f511740 4 client.25978 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:47.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.089+0000 7f5d1f511740 1 -- 172.21.15.18:0/129642349 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfa1027d20 con 0x55cfa10e6f70 2024-09-19T09:56:47.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.091+0000 7f5d1659c640 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cfa10e6f70 0x55cfa10e93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.093+0000 7f5d1659c640 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cfa10e6f70 0x55cfa10e93c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a02db351b002ab6 server_cookie=c421c2e978832dab in_seq=0 out_seq=0 2024-09-19T09:56:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.093+0000 7f5cfaff5640 10 client.25978 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.095+0000 7f5d1759e640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5d000a3450 0x7f5d000a5910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5d10013630 tx=0x7f5d10005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.096+0000 7f5cfaff5640 1 -- 172.21.15.18:0/129642349 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cfa1027d20 con 0x55cfa10e6f70 2024-09-19T09:56:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.096+0000 7f5cfaff5640 10 client.25978 handle_command_reply: tid=0 2024-09-19T09:56:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.096+0000 7f5d1f511740 1 client.25978 shutdown 2024-09-19T09:56:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5d1f511740 1 -- 172.21.15.18:0/129642349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 msgr2=0x55cfa10c5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5d1f511740 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 0x55cfa10c5570 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009a70 tx=0x7f5d0800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5d1f511740 1 -- 172.21.15.18:0/129642349 shutdown_connections 2024-09-19T09:56:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5d1f511740 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cfa10e6f70 0x55cfa10e93c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5d1f511740 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10c2d60 0x55cfa10c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5d1f511740 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c5de0 0x55cfa10c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5d1f511740 1 --2- 172.21.15.18:0/129642349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 0x55cfa10c5570 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5d1f511740 1 -- 172.21.15.18:0/129642349 >> 172.21.15.18:0/129642349 conn(0x55cfa10b7190 msgr2=0x55cfa10b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5cfaff5640 0 client.25978 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5d1f511740 1 -- 172.21.15.18:0/129642349 shutdown_connections 2024-09-19T09:56:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.097+0000 7f5d1f511740 1 -- 172.21.15.18:0/129642349 wait complete. 2024-09-19T09:56:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.098+0000 7f5d1f511740 20 client.25978 trim_cache size 0 max 16384 2024-09-19T09:56:47.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.141+0000 7f5d1f511740 1 Processor -- start 2024-09-19T09:56:47.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.141+0000 7f5d1f511740 1 -- start start 2024-09-19T09:56:47.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.141+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10b7190 0x55cfa10c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.142+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10bac00 0x55cfa10b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.142+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10b7190 0x55cfa10c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.142+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10b7190 0x55cfa10c27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42372/0 (socket says 172.21.15.18:42372) 2024-09-19T09:56:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.142+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10c2d60 0x55cfa10b6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.142+0000 7f5d16d9d640 1 -- 172.21.15.18:0/2856610073 learned_addr learned my addr 172.21.15.18:0/2856610073 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.142+0000 7f5d1659c640 1 --2- 172.21.15.18:0/2856610073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10bac00 0x55cfa10b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.142+0000 7f5d1f511740 1 -- 172.21.15.18:0/2856610073 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d18118c20 con 0x55cfa10c2d60 2024-09-19T09:56:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.143+0000 7f5d1f511740 1 -- 172.21.15.18:0/2856610073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181b5490 con 0x55cfa10bac00 2024-09-19T09:56:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.143+0000 7f5d1f511740 1 -- 172.21.15.18:0/2856610073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181b4020 con 0x55cfa10b7190 2024-09-19T09:56:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.143+0000 7f5d16d9d640 1 -- 172.21.15.18:0/2856610073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10bac00 msgr2=0x55cfa10b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.143+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/2856610073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10bac00 0x55cfa10b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.143+0000 7f5d16d9d640 1 -- 172.21.15.18:0/2856610073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10c2d60 msgr2=0x55cfa10b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.143+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/2856610073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10c2d60 0x55cfa10b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.143+0000 7f5d16d9d640 1 -- 172.21.15.18:0/2856610073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa10c17d0 con 0x55cfa10b7190 2024-09-19T09:56:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.144+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/2856610073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10b7190 0x55cfa10c27f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d08006b90 tx=0x7f5d08009110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e55f508e13d226e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.144+0000 7f5cfc7f8640 1 -- 172.21.15.18:0/2856610073 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08017070 con 0x55cfa10b7190 2024-09-19T09:56:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.144+0000 7f5cfc7f8640 1 -- 172.21.15.18:0/2856610073 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d08033020 con 0x55cfa10b7190 2024-09-19T09:56:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.145+0000 7f5cfc7f8640 1 -- 172.21.15.18:0/2856610073 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0802f890 con 0x55cfa10b7190 2024-09-19T09:56:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.146+0000 7f5d1f511740 1 -- 172.21.15.18:0/2856610073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10b7190 msgr2=0x55cfa10c27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.146+0000 7f5d1f511740 1 --2- 172.21.15.18:0/2856610073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10b7190 0x55cfa10c27f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d08006b90 tx=0x7f5d08009110 comp rx=0 tx=0).stop 2024-09-19T09:56:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.148+0000 7f5d1f511740 1 -- 172.21.15.18:0/2856610073 shutdown_connections 2024-09-19T09:56:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.148+0000 7f5d1f511740 1 --2- 172.21.15.18:0/2856610073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10c2d60 0x55cfa10b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.148+0000 7f5d1f511740 1 --2- 172.21.15.18:0/2856610073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10bac00 0x55cfa10b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.148+0000 7f5d1f511740 1 --2- 172.21.15.18:0/2856610073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10b7190 0x55cfa10c27f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.148+0000 7f5d1f511740 1 -- 172.21.15.18:0/2856610073 >> 172.21.15.18:0/2856610073 conn(0x55cfa10c8330 msgr2=0x55cfa10c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.148+0000 7f5d1f511740 1 -- 172.21.15.18:0/2856610073 shutdown_connections 2024-09-19T09:56:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.148+0000 7f5d1f511740 1 -- 172.21.15.18:0/2856610073 wait complete. 2024-09-19T09:56:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.149+0000 7f5d1f511740 1 -- start start 2024-09-19T09:56:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.149+0000 7f5d1f511740 1 Processor -- start 2024-09-19T09:56:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.150+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10b7190 0x55cfa10cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.150+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 0x55cfa10ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.150+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10b7190 0x55cfa10cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.150+0000 7f5d1f511740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c2d60 0x55cfa10c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.150+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10b7190 0x55cfa10cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54820/0 (socket says 172.21.15.18:54820) 2024-09-19T09:56:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.150+0000 7f5d16d9d640 1 -- 172.21.15.18:0/2278717359 learned_addr learned my addr 172.21.15.18:0/2278717359 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.151+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181b4dc0 con 0x55cfa10b7190 2024-09-19T09:56:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.151+0000 7f5d1759e640 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c2d60 0x55cfa10c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.151+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181b46f0 con 0x55cfa10c2d60 2024-09-19T09:56:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.151+0000 7f5d1659c640 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 0x55cfa10ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.151+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d18116cb0 con 0x55cfa10bac00 2024-09-19T09:56:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.151+0000 7f5d1f511740 10 client.0 _ll_register_callbacks cb 0x7f5d0800eb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.152+0000 7f5d16d9d640 1 -- 172.21.15.18:0/2278717359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 msgr2=0x55cfa10ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.152+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 0x55cfa10ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.152+0000 7f5d16d9d640 1 -- 172.21.15.18:0/2278717359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c2d60 msgr2=0x55cfa10c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.152+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c2d60 0x55cfa10c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.152+0000 7f5d16d9d640 1 -- 172.21.15.18:0/2278717359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa1025520 con 0x55cfa10b7190 2024-09-19T09:56:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.153+0000 7f5d16d9d640 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10b7190 0x55cfa10cdda0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800ec50 tx=0x7f5d08009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86333ca002d7bb73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.153+0000 7f5cfa7f4640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.154+0000 7f5cfa7f4640 1 -- 172.21.15.18:0/2278717359 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08017040 con 0x55cfa10b7190 2024-09-19T09:56:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.154+0000 7f5cfa7f4640 1 -- 172.21.15.18:0/2278717359 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5d08005bd0 con 0x55cfa10b7190 2024-09-19T09:56:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.155+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d08033020 con 0x55cfa10b7190 2024-09-19T09:56:47.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.157+0000 7f5cfa7f4640 1 -- 172.21.15.18:0/2278717359 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d08005e30 con 0x55cfa10b7190 2024-09-19T09:56:47.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.158+0000 7f5d1f511740 10 client.16554 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:47.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.159+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cfa1151fd0 con 0x55cfa10b7190 2024-09-19T09:56:47.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.163+0000 7f5cfa7f4640 1 -- 172.21.15.18:0/2278717359 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d0801c650 con 0x55cfa10b7190 2024-09-19T09:56:47.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.165+0000 7f5cfa7f4640 1 -- 172.21.15.18:0/2278717359 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5d08006600 con 0x55cfa10b7190 2024-09-19T09:56:47.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.165+0000 7f5d1f511740 10 client.16554 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:47.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.166+0000 7f5d1f511740 10 client.16554 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:56:47.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.166+0000 7f5d1f511740 20 client.16554 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:47.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.166+0000 7f5d1f511740 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cfa10c5de0 0x55cfa1154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:47.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.166+0000 7f5d1f511740 4 client.16554 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:56:47.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.166+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x7f5d08033020 con 0x55cfa10c5de0 2024-09-19T09:56:47.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.166+0000 7f5d1659c640 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cfa10c5de0 0x55cfa1154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:47.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.168+0000 7f5d1659c640 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cfa10c5de0 0x55cfa1154600 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99ca0554d52272dd server_cookie=657f5d8e03b26567 in_seq=0 out_seq=0 2024-09-19T09:56:47.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:47.169+0000 7f5cfa7f4640 10 client.16554 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:47.434 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:48.215 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:47 smithi162 ceph-mon[35174]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 821 MiB/s wr, 2.48k op/s 2024-09-19T09:56:48.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:47 smithi018 ceph-mon[30956]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 821 MiB/s wr, 2.48k op/s 2024-09-19T09:56:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:47 smithi049 ceph-mon[34858]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 821 MiB/s wr, 2.48k op/s 2024-09-19T09:56:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.716+0000 7f34ac693640 1 -- 172.21.15.18:0/2126888169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a410ddc0 msgr2=0x7f34a4115940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.716+0000 7f34ac693640 1 --2- 172.21.15.18:0/2126888169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a410ddc0 0x7f34a4115940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f349c009be0 tx=0x7f349c02a710 comp rx=0 tx=0).stop 2024-09-19T09:56:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.717+0000 7f34ac693640 1 -- 172.21.15.18:0/2126888169 shutdown_connections 2024-09-19T09:56:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.717+0000 7f34ac693640 1 --2- 172.21.15.18:0/2126888169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a410ddc0 0x7f34a4115940 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.717+0000 7f34ac693640 1 --2- 172.21.15.18:0/2126888169 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a4109e00 0x7f34a410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.717+0000 7f34ac693640 1 --2- 172.21.15.18:0/2126888169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34a4109450 0x7f34a4109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.717+0000 7f34ac693640 1 -- 172.21.15.18:0/2126888169 >> 172.21.15.18:0/2126888169 conn(0x7f34a406e140 msgr2=0x7f34a406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.718+0000 7f34ac693640 1 -- 172.21.15.18:0/2126888169 shutdown_connections 2024-09-19T09:56:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.718+0000 7f34ac693640 1 -- 172.21.15.18:0/2126888169 wait complete. 2024-09-19T09:56:48.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.719+0000 7f34ac693640 1 Processor -- start 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.722+0000 7f34ac693640 1 -- start start 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.723+0000 7f34ac693640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34a4109450 0x7f34a41a6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.723+0000 7f34ac693640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4109e00 0x7f34a41a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.723+0000 7f34ac693640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a41a0780 0x7f34a41a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.723+0000 7f34ac693640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34a411a7f0 con 0x7f34a4109450 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.723+0000 7f34ac693640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f34a411a670 con 0x7f34a41a0780 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.723+0000 7f34ac693640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34a411a970 con 0x7f34a4109e00 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.723+0000 7f34aa42f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34a4109450 0x7f34a41a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.727+0000 7f34a9c2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4109e00 0x7f34a41a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.727+0000 7f34aa42f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34a4109450 0x7f34a41a6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54846/0 (socket says 172.21.15.18:54846) 2024-09-19T09:56:48.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.727+0000 7f34aa42f640 1 -- 172.21.15.18:0/1356296503 learned_addr learned my addr 172.21.15.18:0/1356296503 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:48.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.728+0000 7f34aac30640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a41a0780 0x7f34a41a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.728+0000 7f34a9c2e640 1 -- 172.21.15.18:0/1356296503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a41a0780 msgr2=0x7f34a41a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:48.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.728+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a41a0780 0x7f34a41a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.728+0000 7f34a9c2e640 1 -- 172.21.15.18:0/1356296503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34a4109450 msgr2=0x7f34a41a6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:48.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.728+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34a4109450 0x7f34a41a6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.728+0000 7f34a9c2e640 1 -- 172.21.15.18:0/1356296503 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a41a11f0 con 0x7f34a4109e00 2024-09-19T09:56:48.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.729+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4109e00 0x7f34a41a6b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34a000e9c0 tx=0x7f34a000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:48.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.729+0000 7f349b7fe640 1 -- 172.21.15.18:0/1356296503 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a000ccc0 con 0x7f34a4109e00 2024-09-19T09:56:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.730+0000 7f34ac693640 1 -- 172.21.15.18:0/1356296503 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a41a14e0 con 0x7f34a4109e00 2024-09-19T09:56:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.730+0000 7f34ac693640 1 -- 172.21.15.18:0/1356296503 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a41ab6e0 con 0x7f34a4109e00 2024-09-19T09:56:48.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.737+0000 7f349b7fe640 1 -- 172.21.15.18:0/1356296503 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34a0010910 con 0x7f34a4109e00 2024-09-19T09:56:48.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.737+0000 7f349b7fe640 1 -- 172.21.15.18:0/1356296503 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a00188e0 con 0x7f34a4109e00 2024-09-19T09:56:48.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.741+0000 7f34aea6c740 1 Processor -- start 2024-09-19T09:56:48.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.744+0000 7f349b7fe640 1 -- 172.21.15.18:0/1356296503 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f34a0010ac0 con 0x7f34a4109e00 2024-09-19T09:56:48.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.746+0000 7f34aea6c740 1 -- start start 2024-09-19T09:56:48.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.746+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c04b50 0x55fc26c030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.747+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c035e0 0x55fc26c03a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.747+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c0e380 0x55fc26c10770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.747+0000 7f34aea6c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fc26b582f0 con 0x55fc26c04b50 2024-09-19T09:56:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.747+0000 7f34aea6c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fc26affcf0 con 0x55fc26c035e0 2024-09-19T09:56:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.747+0000 7f34aea6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fc26b542b0 con 0x55fc26c0e380 2024-09-19T09:56:48.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.752+0000 7f34aa42f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c04b50 0x55fc26c030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.752+0000 7f34aa42f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c04b50 0x55fc26c030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54852/0 (socket says 172.21.15.18:54852) 2024-09-19T09:56:48.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.752+0000 7f34aa42f640 1 -- 172.21.15.18:0/2683703037 learned_addr learned my addr 172.21.15.18:0/2683703037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:48.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.752+0000 7f34aac30640 1 --2- 172.21.15.18:0/2683703037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c0e380 0x55fc26c10770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.752+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/2683703037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c035e0 0x55fc26c03a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.752+0000 7f349b7fe640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34900a3380 0x7f34900a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.753+0000 7f349b7fe640 1 -- 172.21.15.18:0/1356296503 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f34a00cfb60 con 0x7f34a4109e00 2024-09-19T09:56:48.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.759+0000 7f34aac30640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34900a3380 0x7f34900a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.760+0000 7f34aa42f640 1 -- 172.21.15.18:0/2683703037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c0e380 msgr2=0x55fc26c10770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:48.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.760+0000 7f34aa42f640 1 --2- 172.21.15.18:0/2683703037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c0e380 0x55fc26c10770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.760+0000 7f34aa42f640 1 -- 172.21.15.18:0/2683703037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c035e0 msgr2=0x55fc26c03a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:48.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.760+0000 7f34aa42f640 1 --2- 172.21.15.18:0/2683703037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c035e0 0x55fc26c03a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.760+0000 7f34aa42f640 1 -- 172.21.15.18:0/2683703037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc26ae43a0 con 0x55fc26c04b50 2024-09-19T09:56:48.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.768+0000 7f34aa42f640 1 --2- 172.21.15.18:0/2683703037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c04b50 0x55fc26c030a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3494009d80 tx=0x7f3494011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53189ca21d4588a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:48.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.771+0000 7f3498ff9640 1 -- 172.21.15.18:0/2683703037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349401e070 con 0x55fc26c04b50 2024-09-19T09:56:48.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.771+0000 7f3498ff9640 1 -- 172.21.15.18:0/2683703037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3494019b10 con 0x55fc26c04b50 2024-09-19T09:56:48.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.771+0000 7f3498ff9640 1 -- 172.21.15.18:0/2683703037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349400eb80 con 0x55fc26c04b50 2024-09-19T09:56:48.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.772+0000 7f34aea6c740 1 -- 172.21.15.18:0/2683703037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c04b50 msgr2=0x55fc26c030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:48.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.772+0000 7f34aea6c740 1 --2- 172.21.15.18:0/2683703037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c04b50 0x55fc26c030a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3494009d80 tx=0x7f3494011810 comp rx=0 tx=0).stop 2024-09-19T09:56:48.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.778+0000 7f34aea6c740 1 -- 172.21.15.18:0/2683703037 shutdown_connections 2024-09-19T09:56:48.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.778+0000 7f34aea6c740 1 --2- 172.21.15.18:0/2683703037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c0e380 0x55fc26c10770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.778+0000 7f34aea6c740 1 --2- 172.21.15.18:0/2683703037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c035e0 0x55fc26c03a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.778+0000 7f34aea6c740 1 --2- 172.21.15.18:0/2683703037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c04b50 0x55fc26c030a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.778+0000 7f34aea6c740 1 -- 172.21.15.18:0/2683703037 >> 172.21.15.18:0/2683703037 conn(0x55fc26bbb310 msgr2=0x55fc26bffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:48.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.779+0000 7f34aac30640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34900a3380 0x7f34900a5840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55fc26c04080 tx=0x7f349c02a710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:48.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.780+0000 7f34aea6c740 1 -- 172.21.15.18:0/2683703037 shutdown_connections 2024-09-19T09:56:48.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.780+0000 7f34aea6c740 1 -- 172.21.15.18:0/2683703037 wait complete. 2024-09-19T09:56:48.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.780+0000 7f34aea6c740 1 -- start start 2024-09-19T09:56:48.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.780+0000 7f34aea6c740 1 Processor -- start 2024-09-19T09:56:48.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.781+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.781+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c04b50 0x55fc26c0b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.782+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c0e380 0x55fc26c0b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.782+0000 7f34aea6c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fc26c11080 con 0x55fc26c035e0 2024-09-19T09:56:48.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.782+0000 7f34aea6c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fc26b13060 con 0x55fc26c04b50 2024-09-19T09:56:48.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.782+0000 7f34aea6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fc26c11200 con 0x55fc26c0e380 2024-09-19T09:56:48.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.782+0000 7f34aea6c740 10 client.0 _ll_register_callbacks cb 0x55fc268668c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:48.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.782+0000 7f34a9c2e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c04b50 0x55fc26c0b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.782+0000 7f34a9c2e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c04b50 0x55fc26c0b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60748/0 (socket says 172.21.15.18:60748) 2024-09-19T09:56:48.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.782+0000 7f34a9c2e640 1 -- 172.21.15.18:0/3085855705 learned_addr learned my addr 172.21.15.18:0/3085855705 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:48.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.783+0000 7f34aa42f640 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.784+0000 7f34aac30640 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c0e380 0x55fc26c0b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.785+0000 7f34a9c2e640 1 -- 172.21.15.18:0/3085855705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c0e380 msgr2=0x55fc26c0b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:48.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.785+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c0e380 0x55fc26c0b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.785+0000 7f34a9c2e640 1 -- 172.21.15.18:0/3085855705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 msgr2=0x55fc26c0dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:48.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.785+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.785+0000 7f34a9c2e640 1 -- 172.21.15.18:0/3085855705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc268c93c0 con 0x55fc26c04b50 2024-09-19T09:56:48.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.786+0000 7f34aa42f640 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:48.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.790+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c04b50 0x55fc26c0b050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f34a0000c00 tx=0x7f34a000ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a20b901042128808 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:48.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.790+0000 7f348dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:56:48.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.792+0000 7f348dffb640 1 -- 172.21.15.18:0/3085855705 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a009c150 con 0x55fc26c04b50 2024-09-19T09:56:48.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.792+0000 7f34aea6c740 1 -- 172.21.15.18:0/3085855705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3494019b10 con 0x55fc26c04b50 2024-09-19T09:56:48.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.792+0000 7f348dffb640 1 -- 172.21.15.18:0/3085855705 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f34a00a0150 con 0x55fc26c04b50 2024-09-19T09:56:48.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.794+0000 7f348dffb640 1 -- 172.21.15.18:0/3085855705 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34a00a0500 con 0x55fc26c04b50 2024-09-19T09:56:48.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.794+0000 7f34aea6c740 10 client.26036 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:48.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.794+0000 7f34aea6c740 1 -- 172.21.15.18:0/3085855705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fc26c1cc00 con 0x55fc26c04b50 2024-09-19T09:56:48.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.797+0000 7f348dffb640 1 -- 172.21.15.18:0/3085855705 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3494019b10 con 0x55fc26c04b50 2024-09-19T09:56:48.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.797+0000 7f348dffb640 1 -- 172.21.15.18:0/3085855705 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34a00cdaf0 con 0x55fc26c04b50 2024-09-19T09:56:48.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.798+0000 7f34aea6c740 10 client.26036 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:48.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.798+0000 7f34aea6c740 10 client.26036 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:56:48.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.798+0000 7f34aea6c740 20 client.26036 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:48.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.799+0000 7f34aea6c740 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55fc26c1e550 0x55fc26c209d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.799+0000 7f34aea6c740 4 client.26036 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:48.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.799+0000 7f34aea6c740 1 -- 172.21.15.18:0/3085855705 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc26b65860 con 0x55fc26c1e550 2024-09-19T09:56:48.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.803+0000 7f34aa42f640 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55fc26c1e550 0x55fc26c209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.809+0000 7f34aa42f640 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55fc26c1e550 0x55fc26c209d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ea7dd92a2e85488 server_cookie=91452d2c641f34eb in_seq=0 out_seq=0 2024-09-19T09:56:48.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.810+0000 7f348dffb640 10 client.26036 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:56:48.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.811+0000 7f348dffb640 1 -- 172.21.15.18:0/3085855705 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc26b65860 con 0x55fc26c1e550 2024-09-19T09:56:48.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.811+0000 7f348dffb640 10 client.26036 handle_command_reply: tid=0 2024-09-19T09:56:48.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.811+0000 7f34aea6c740 1 client.26036 shutdown 2024-09-19T09:56:48.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f34aea6c740 1 -- 172.21.15.18:0/3085855705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c04b50 msgr2=0x55fc26c0b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f34aea6c740 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c04b50 0x55fc26c0b050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f34a0000c00 tx=0x7f34a000ce60 comp rx=0 tx=0).stop 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f34aea6c740 1 -- 172.21.15.18:0/3085855705 shutdown_connections 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f34aea6c740 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55fc26c1e550 0x55fc26c209d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f34aea6c740 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c0e380 0x55fc26c0b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f34aea6c740 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c04b50 0x55fc26c0b050 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f34aea6c740 1 --2- 172.21.15.18:0/3085855705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f34aea6c740 1 -- 172.21.15.18:0/3085855705 >> 172.21.15.18:0/3085855705 conn(0x55fc26bbb310 msgr2=0x55fc26c05940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f348dffb640 0 client.26036 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f34aea6c740 1 -- 172.21.15.18:0/3085855705 shutdown_connections 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.812+0000 7f34aea6c740 1 -- 172.21.15.18:0/3085855705 wait complete. 2024-09-19T09:56:48.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.813+0000 7f34aea6c740 20 client.26036 trim_cache size 0 max 16384 2024-09-19T09:56:48.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.854+0000 7f34aea6c740 1 Processor -- start 2024-09-19T09:56:48.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.854+0000 7f34aea6c740 1 -- start start 2024-09-19T09:56:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.855+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.856+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 0x55fc26c1a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.856+0000 7f34aa42f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.857+0000 7f34aa42f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54878/0 (socket says 172.21.15.18:54878) 2024-09-19T09:56:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.857+0000 7f34aa42f640 1 -- 172.21.15.18:0/4058371671 learned_addr learned my addr 172.21.15.18:0/4058371671 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.857+0000 7f34aea6c740 1 --2- 172.21.15.18:0/4058371671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c0e380 0x55fc26bff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.858+0000 7f34aea6c740 1 -- 172.21.15.18:0/4058371671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f348800e3a0 con 0x55fc26c035e0 2024-09-19T09:56:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.858+0000 7f34aea6c740 1 -- 172.21.15.18:0/4058371671 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f348800fee0 con 0x55fc26c0e380 2024-09-19T09:56:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.858+0000 7f34aea6c740 1 -- 172.21.15.18:0/4058371671 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f348800ea70 con 0x55fc26c04b50 2024-09-19T09:56:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.859+0000 7f34aac30640 1 --2- 172.21.15.18:0/4058371671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c0e380 0x55fc26bff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.859+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/4058371671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 0x55fc26c1a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.860+0000 7f34aa42f640 1 -- 172.21.15.18:0/4058371671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 msgr2=0x55fc26c1a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.860+0000 7f34aa42f640 1 --2- 172.21.15.18:0/4058371671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 0x55fc26c1a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.860+0000 7f34aa42f640 1 -- 172.21.15.18:0/4058371671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c0e380 msgr2=0x55fc26bff710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.860+0000 7f34aa42f640 1 --2- 172.21.15.18:0/4058371671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c0e380 0x55fc26bff710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.860+0000 7f34aa42f640 1 -- 172.21.15.18:0/4058371671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc26c095a0 con 0x55fc26c035e0 2024-09-19T09:56:48.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.866+0000 7f34aa42f640 1 --2- 172.21.15.18:0/4058371671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0b020 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3494009d80 tx=0x7f349400e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ca052f850d2221 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:48.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.866+0000 7f348ffff640 1 -- 172.21.15.18:0/4058371671 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349401e040 con 0x55fc26c035e0 2024-09-19T09:56:48.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.867+0000 7f348ffff640 1 -- 172.21.15.18:0/4058371671 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3494029070 con 0x55fc26c035e0 2024-09-19T09:56:48.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.868+0000 7f34aea6c740 1 -- 172.21.15.18:0/4058371671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 msgr2=0x55fc26c0b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:48.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.868+0000 7f34aea6c740 1 --2- 172.21.15.18:0/4058371671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0b020 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3494009d80 tx=0x7f349400e6e0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.868+0000 7f34aea6c740 1 -- 172.21.15.18:0/4058371671 shutdown_connections 2024-09-19T09:56:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.868+0000 7f34aea6c740 1 --2- 172.21.15.18:0/4058371671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c0e380 0x55fc26bff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.868+0000 7f34aea6c740 1 --2- 172.21.15.18:0/4058371671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 0x55fc26c1a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.868+0000 7f34aea6c740 1 --2- 172.21.15.18:0/4058371671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c035e0 0x55fc26c0b020 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.868+0000 7f34aea6c740 1 -- 172.21.15.18:0/4058371671 >> 172.21.15.18:0/4058371671 conn(0x55fc26bbb310 msgr2=0x55fc26c0a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:48.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.868+0000 7f34aea6c740 1 -- 172.21.15.18:0/4058371671 shutdown_connections 2024-09-19T09:56:48.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.868+0000 7f34aea6c740 1 -- 172.21.15.18:0/4058371671 wait complete. 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.869+0000 7f34aea6c740 1 -- start start 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.869+0000 7f34aea6c740 1 Processor -- start 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.870+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c035e0 0x55fc26c11870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.870+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 0x55fc26c11db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.870+0000 7f34aea6c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c0e380 0x55fc26c872a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.870+0000 7f34aea6c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f348800f810 con 0x55fc26c0e380 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.870+0000 7f34aea6c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f348800f140 con 0x55fc26c035e0 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.870+0000 7f34aea6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f348800c380 con 0x55fc26c04b50 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.870+0000 7f34aea6c740 10 client.0 _ll_register_callbacks cb 0x7f34a009bd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.871+0000 7f34a9c2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 0x55fc26c11db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.871+0000 7f34a9c2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 0x55fc26c11db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42452/0 (socket says 172.21.15.18:42452) 2024-09-19T09:56:48.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.871+0000 7f34a9c2e640 1 -- 172.21.15.18:0/17840884 learned_addr learned my addr 172.21.15.18:0/17840884 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:48.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.871+0000 7f34a9c2e640 1 -- 172.21.15.18:0/17840884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c035e0 msgr2=0x55fc26c11870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:56:48.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.871+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c035e0 0x55fc26c11870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.871+0000 7f34a9c2e640 1 -- 172.21.15.18:0/17840884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c0e380 msgr2=0x55fc26c872a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:48.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.871+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c0e380 0x55fc26c872a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.871+0000 7f34a9c2e640 1 -- 172.21.15.18:0/17840884 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc26c877e0 con 0x55fc26c04b50 2024-09-19T09:56:48.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.873+0000 7f34a9c2e640 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 0x55fc26c11db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c6a0 tx=0x7f34a00980d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25accca750ad4737 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:48.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.873+0000 7f348dffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:56:48.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.873+0000 7f348dffb640 1 -- 172.21.15.18:0/17840884 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a009c150 con 0x55fc26c04b50 2024-09-19T09:56:48.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.874+0000 7f348dffb640 1 -- 172.21.15.18:0/17840884 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f34a009b5a0 con 0x55fc26c04b50 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.874+0000 7f34aea6c740 1 -- 172.21.15.18:0/17840884 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fc26b5fd70 con 0x55fc26c04b50 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.874+0000 7f348dffb640 1 -- 172.21.15.18:0/17840884 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34a00a4dc0 con 0x55fc26c04b50 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.874+0000 7f34aea6c740 10 client.25999 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.874+0000 7f34aea6c740 1 -- 172.21.15.18:0/17840884 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fc26c88a50 con 0x55fc26c04b50 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.875+0000 7f348dffb640 1 -- 172.21.15.18:0/17840884 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55fc26b5fd70 con 0x55fc26c04b50 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.876+0000 7f348dffb640 1 -- 172.21.15.18:0/17840884 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34a00a1690 con 0x55fc26c04b50 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.877+0000 7f34aea6c740 10 client.25999 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.877+0000 7f34aea6c740 10 client.25999 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.877+0000 7f34aea6c740 20 client.25999 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.877+0000 7f34aea6c740 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55fc26c89010 0x55fc26c8b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.877+0000 7f34aea6c740 4 client.25999 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:56:48.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.877+0000 7f34aea6c740 1 -- 172.21.15.18:0/17840884 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fc26adc170 con 0x55fc26c89010 2024-09-19T09:56:48.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.878+0000 7f34aa42f640 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55fc26c89010 0x55fc26c8b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:48.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.891+0000 7f348dffb640 10 client.25999 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:56:48.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.891+0000 7f34aa42f640 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55fc26c89010 0x55fc26c8b450 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=927bb068a308d981 server_cookie=1913e4a5edc1655c in_seq=0 out_seq=0 2024-09-19T09:56:48.898 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f348dffb640 1 -- 172.21.15.18:0/17840884 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fc26adc170 con 0x55fc26c89010 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f348dffb640 10 client.25999 handle_command_reply: tid=0 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f34aea6c740 1 client.25999 shutdown 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f34aea6c740 1 -- 172.21.15.18:0/17840884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 msgr2=0x55fc26c11db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f34aea6c740 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 0x55fc26c11db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c6a0 tx=0x7f34a00980d0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f34aea6c740 1 -- 172.21.15.18:0/17840884 shutdown_connections 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f34aea6c740 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55fc26c89010 0x55fc26c8b450 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f34aea6c740 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fc26c0e380 0x55fc26c872a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f34aea6c740 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc26c04b50 0x55fc26c11db0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f34aea6c740 1 --2- 172.21.15.18:0/17840884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fc26c035e0 0x55fc26c11870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.892+0000 7f34aea6c740 1 -- 172.21.15.18:0/17840884 >> 172.21.15.18:0/17840884 conn(0x55fc26bbb310 msgr2=0x55fc26c0c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.893+0000 7f348dffb640 0 client.25999 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:56:48.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.893+0000 7f34aea6c740 1 -- 172.21.15.18:0/17840884 shutdown_connections 2024-09-19T09:56:48.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.893+0000 7f34aea6c740 1 -- 172.21.15.18:0/17840884 wait complete. 2024-09-19T09:56:48.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.893+0000 7f34aea6c740 20 client.25999 trim_cache size 0 max 16384 2024-09-19T09:56:48.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 -- 172.21.15.18:0/1356296503 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34900a3380 msgr2=0x7f34900a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:48.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34900a3380 0x7f34900a5840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55fc26c04080 tx=0x7f349c02a710 comp rx=0 tx=0).stop 2024-09-19T09:56:48.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 -- 172.21.15.18:0/1356296503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4109e00 msgr2=0x7f34a41a6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:48.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4109e00 0x7f34a41a6b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34a000e9c0 tx=0x7f34a000ee80 comp rx=0 tx=0).stop 2024-09-19T09:56:48.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 -- 172.21.15.18:0/1356296503 shutdown_connections 2024-09-19T09:56:48.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f34900a3380 0x7f34900a5840 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a41a0780 0x7f34a41a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4109e00 0x7f34a41a6b40 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34a000e9c0 tx=0x7f34a000ee80 comp rx=0 tx=0).stop 2024-09-19T09:56:48.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 --2- 172.21.15.18:0/1356296503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34a4109450 0x7f34a41a6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:48.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 -- 172.21.15.18:0/1356296503 >> 172.21.15.18:0/1356296503 conn(0x7f34a406e140 msgr2=0x7f34a4071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:48.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 -- 172.21.15.18:0/1356296503 shutdown_connections 2024-09-19T09:56:48.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:48.905+0000 7f34ac693640 1 -- 172.21.15.18:0/1356296503 wait complete. 2024-09-19T09:56:49.807 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:56:50.070 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:50.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:49 smithi018 ceph-mon[30956]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 758 MiB/s wr, 1.83k op/s 2024-09-19T09:56:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:49 smithi049 ceph-mon[34858]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 758 MiB/s wr, 1.83k op/s 2024-09-19T09:56:50.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:49 smithi162 ceph-mon[35174]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 758 MiB/s wr, 1.83k op/s 2024-09-19T09:56:50.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.647+0000 7f5cfa7f4640 1 -- 172.21.15.18:0/2278717359 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f5d08033020 con 0x55cfa10c5de0 2024-09-19T09:56:50.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5cfa7f4640 10 client.16554 handle_command_reply: tid=0 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 client.16554 shutdown 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10b7190 msgr2=0x55cfa10cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10b7190 0x55cfa10cdda0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800ec50 tx=0x7f5d08009470 comp rx=0 tx=0).stop 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 shutdown_connections 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cfa10c5de0 0x55cfa1154600 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cfa10c2d60 0x55cfa10c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfa10bac00 0x55cfa10ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 --2- 172.21.15.18:0/2278717359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfa10b7190 0x55cfa10cdda0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 >> 172.21.15.18:0/2278717359 conn(0x55cfa10c8330 msgr2=0x55cfa10b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5cfa7f4640 0 client.16554 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 shutdown_connections 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 1 -- 172.21.15.18:0/2278717359 wait complete. 2024-09-19T09:56:50.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.648+0000 7f5d1f511740 20 client.16554 trim_cache size 0 max 16384 2024-09-19T09:56:50.652 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:56:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:56:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:56:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 18, 2024-09-19T09:56:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:56:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "c7a0d0c3": { 2024-09-19T09:56:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 18, 2024-09-19T09:56:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:56:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 149.8, 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:56:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:50.654 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:56:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 -- 172.21.15.18:0/3812358878 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5d000a3450 msgr2=0x7f5d000a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5d000a3450 0x7f5d000a5910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5d10013630 tx=0x7f5d10005bd0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 -- 172.21.15.18:0/3812358878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d18110190 msgr2=0x7f5d181a77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d18110190 0x7f5d181a77c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c02a9b0 tx=0x7f5d0c031ab0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 -- 172.21.15.18:0/3812358878 shutdown_connections 2024-09-19T09:56:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5d000a3450 0x7f5d000a5910 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d1811b140 0x7f5d181abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d18110190 0x7f5d181a77c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 --2- 172.21.15.18:0/3812358878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1806ea30 0x7f5d181a7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 -- 172.21.15.18:0/3812358878 >> 172.21.15.18:0/3812358878 conn(0x7f5d18073180 msgr2=0x7f5d18119370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 -- 172.21.15.18:0/3812358878 shutdown_connections 2024-09-19T09:56:50.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.649+0000 7f5cfdffb640 1 -- 172.21.15.18:0/3812358878 wait complete. 2024-09-19T09:56:50.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.663+0000 7f0ed63b1640 1 -- 172.21.15.18:0/3934435211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ed0101df0 msgr2=0x7f0ed01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.663+0000 7f0ed63b1640 1 --2- 172.21.15.18:0/3934435211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ed0101df0 0x7f0ed01021d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009900 tx=0x7f0ec002a410 comp rx=0 tx=0).stop 2024-09-19T09:56:50.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.663+0000 7f0ed63b1640 1 -- 172.21.15.18:0/3934435211 shutdown_connections 2024-09-19T09:56:50.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.663+0000 7f0ed63b1640 1 --2- 172.21.15.18:0/3934435211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed0106f20 0x7f0ed010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.663+0000 7f0ed63b1640 1 --2- 172.21.15.18:0/3934435211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed01027a0 0x7f0ed01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.663+0000 7f0ed63b1640 1 --2- 172.21.15.18:0/3934435211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ed0101df0 0x7f0ed01021d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.663+0000 7f0ed63b1640 1 -- 172.21.15.18:0/3934435211 >> 172.21.15.18:0/3934435211 conn(0x7f0ed00fd8f0 msgr2=0x7f0ed00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:50.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.663+0000 7f0ed63b1640 1 -- 172.21.15.18:0/3934435211 shutdown_connections 2024-09-19T09:56:50.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.663+0000 7f0ed63b1640 1 -- 172.21.15.18:0/3934435211 wait complete. 2024-09-19T09:56:50.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.664+0000 7f0ed63b1640 1 Processor -- start 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.664+0000 7f0ed63b1640 1 -- start start 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.664+0000 7f0ed63b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ed0101df0 0x7f0ed0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.664+0000 7f0ed63b1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed01027a0 0x7f0ed01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.664+0000 7f0ed63b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed0106f20 0x7f0ed019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.664+0000 7f0ed63b1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0111f40 con 0x7f0ed0101df0 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.664+0000 7f0ed63b1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0111dc0 con 0x7f0ed0106f20 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.664+0000 7f0ed63b1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01120c0 con 0x7f0ed01027a0 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed01027a0 0x7f0ed01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ed0101df0 0x7f0ed0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed01027a0 0x7f0ed01989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42456/0 (socket says 172.21.15.18:42456) 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecf7fe640 1 -- 172.21.15.18:0/4238920733 learned_addr learned my addr 172.21.15.18:0/4238920733 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ed494e640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed0106f20 0x7f0ed019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecf7fe640 1 -- 172.21.15.18:0/4238920733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed0106f20 msgr2=0x7f0ed019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecf7fe640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed0106f20 0x7f0ed019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecf7fe640 1 -- 172.21.15.18:0/4238920733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ed0101df0 msgr2=0x7f0ed0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecf7fe640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ed0101df0 0x7f0ed0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecf7fe640 1 -- 172.21.15.18:0/4238920733 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed019d410 con 0x7f0ed01027a0 2024-09-19T09:56:50.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecf7fe640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed01027a0 0x7f0ed01989a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400e9f0 tx=0x7f0ec400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:50.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecd7fa640 1 -- 172.21.15.18:0/4238920733 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400cd80 con 0x7f0ed01027a0 2024-09-19T09:56:50.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecd7fa640 1 -- 172.21.15.18:0/4238920733 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec4010910 con 0x7f0ed01027a0 2024-09-19T09:56:50.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ed63b1640 1 -- 172.21.15.18:0/4238920733 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed019d700 con 0x7f0ed01027a0 2024-09-19T09:56:50.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.665+0000 7f0ecd7fa640 1 -- 172.21.15.18:0/4238920733 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4018990 con 0x7f0ed01027a0 2024-09-19T09:56:50.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.666+0000 7f0ed63b1640 1 -- 172.21.15.18:0/4238920733 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed0074420 con 0x7f0ed01027a0 2024-09-19T09:56:50.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.668+0000 7f0ed878a740 1 Processor -- start 2024-09-19T09:56:50.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.668+0000 7f0ecd7fa640 1 -- 172.21.15.18:0/4238920733 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0ec4010ac0 con 0x7f0ed01027a0 2024-09-19T09:56:50.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.668+0000 7f0ed878a740 1 -- start start 2024-09-19T09:56:50.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.668+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 0x55e5e7a3c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.668+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a3ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.668+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a49760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.668+0000 7f0ed878a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e5e79a22f0 con 0x55e5e7a47370 2024-09-19T09:56:50.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.668+0000 7f0ed878a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e5e7949cf0 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ed878a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e5e799e2b0 con 0x55e5e7a3db40 2024-09-19T09:56:50.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a49760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a3ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a3ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60796/0 (socket says 172.21.15.18:60796) 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ecffff640 1 -- 172.21.15.18:0/3997971944 learned_addr learned my addr 172.21.15.18:0/3997971944 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ed494e640 1 --2- 172.21.15.18:0/3997971944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 0x55e5e7a3c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ecd7fa640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0eb80a3240 0x7f0eb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ed494e640 1 -- 172.21.15.18:0/3997971944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 msgr2=0x55e5e7a3ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ed494e640 1 --2- 172.21.15.18:0/3997971944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a3ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ed494e640 1 -- 172.21.15.18:0/3997971944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 msgr2=0x55e5e7a49760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ed494e640 1 --2- 172.21.15.18:0/3997971944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a49760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ed494e640 1 -- 172.21.15.18:0/3997971944 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5e792e3a0 con 0x55e5e7a3db40 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ecffff640 1 --2- 172.21.15.18:0/3997971944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a3ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.669+0000 7f0ecd7fa640 1 -- 172.21.15.18:0/4238920733 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0ec40cfc10 con 0x7f0ed01027a0 2024-09-19T09:56:50.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.670+0000 7f0ed494e640 1 --2- 172.21.15.18:0/3997971944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 0x55e5e7a3c090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009f00 tx=0x7f0ec8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=159e70aed376776a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:50.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.670+0000 7f0ed494e640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0eb80a3240 0x7f0eb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.670+0000 7f0eb67fc640 1 -- 172.21.15.18:0/3997971944 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec801f070 con 0x55e5e7a3db40 2024-09-19T09:56:50.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.670+0000 7f0eb67fc640 1 -- 172.21.15.18:0/3997971944 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec8003cb0 con 0x55e5e7a3db40 2024-09-19T09:56:50.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.670+0000 7f0eb67fc640 1 -- 172.21.15.18:0/3997971944 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8019b90 con 0x55e5e7a3db40 2024-09-19T09:56:50.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.670+0000 7f0ed878a740 1 -- 172.21.15.18:0/3997971944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 msgr2=0x55e5e7a3c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.670+0000 7f0ed878a740 1 --2- 172.21.15.18:0/3997971944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 0x55e5e7a3c090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009f00 tx=0x7f0ec8011810 comp rx=0 tx=0).stop 2024-09-19T09:56:50.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.670+0000 7f0ed494e640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0eb80a3240 0x7f0eb80a5700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0ec801c000 tx=0x7f0ec8019e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:50.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.671+0000 7f0ed878a740 1 -- 172.21.15.18:0/3997971944 shutdown_connections 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.671+0000 7f0ed878a740 1 --2- 172.21.15.18:0/3997971944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a49760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.671+0000 7f0ed878a740 1 --2- 172.21.15.18:0/3997971944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a3ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.671+0000 7f0ed878a740 1 --2- 172.21.15.18:0/3997971944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 0x55e5e7a3c090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.671+0000 7f0ed878a740 1 -- 172.21.15.18:0/3997971944 >> 172.21.15.18:0/3997971944 conn(0x55e5e7a05310 msgr2=0x55e5e7a38c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.671+0000 7f0ed878a740 1 -- 172.21.15.18:0/3997971944 shutdown_connections 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.671+0000 7f0ed878a740 1 -- 172.21.15.18:0/3997971944 wait complete. 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.671+0000 7f0ed878a740 1 -- start start 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.672+0000 7f0ed878a740 1 Processor -- start 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a46d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a3db40 0x55e5e7a44040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a47370 0x55e5e7a44650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed878a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e5e7a4a070 con 0x55e5e7a3db40 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed878a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e5e795d060 con 0x55e5e7a47370 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed878a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e5e7a4a1f0 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a3db40 0x55e5e7a44040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed878a740 10 client.0 _ll_register_callbacks cb 0x55e5e76b08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a3db40 0x55e5e7a44040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54900/0 (socket says 172.21.15.18:54900) 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ecf7fe640 1 -- 172.21.15.18:0/3973708157 learned_addr learned my addr 172.21.15.18:0/3973708157 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed494e640 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a47370 0x55e5e7a44650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ecffff640 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a46d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed494e640 1 -- 172.21.15.18:0/3973708157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 msgr2=0x55e5e7a46d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed494e640 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a46d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed494e640 1 -- 172.21.15.18:0/3973708157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a3db40 msgr2=0x55e5e7a44040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed494e640 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a3db40 0x55e5e7a44040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.673+0000 7f0ed494e640 1 -- 172.21.15.18:0/3973708157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5e77133c0 con 0x55e5e7a47370 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.674+0000 7f0ed494e640 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a47370 0x55e5e7a44650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8006010 tx=0x7f0ec8019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5d49c761b8907ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.674+0000 7f0eaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.674+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/3973708157 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec801f040 con 0x55e5e7a47370 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.674+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/3973708157 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0ec8019aa0 con 0x55e5e7a47370 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.674+0000 7f0ed878a740 1 -- 172.21.15.18:0/3973708157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ec8003cb0 con 0x55e5e7a47370 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.674+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/3973708157 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0ec8003e60 con 0x55e5e7a47370 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.674+0000 7f0ed878a740 10 client.26051 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.674+0000 7f0ed878a740 1 -- 172.21.15.18:0/3973708157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e5e7a55b40 con 0x55e5e7a47370 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.674+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/3973708157 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec8003cb0 con 0x55e5e7a47370 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.674+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/3973708157 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0ec8004610 con 0x55e5e7a47370 2024-09-19T09:56:50.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.675+0000 7f0ed878a740 10 client.26051 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.675+0000 7f0ed878a740 10 client.26051 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.675+0000 7f0ed878a740 20 client.26051 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.675+0000 7f0ed878a740 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e5e7a56fa0 0x55e5e7a59390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.675+0000 7f0ed878a740 4 client.26051 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.675+0000 7f0ed878a740 1 -- 172.21.15.18:0/3973708157 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5e79af860 con 0x55e5e7a56fa0 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.675+0000 7f0ecffff640 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e5e7a56fa0 0x55e5e7a59390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.676+0000 7f0ecffff640 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e5e7a56fa0 0x55e5e7a59390 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5155795abfcfff55 server_cookie=f3d17e84ae502c08 in_seq=0 out_seq=0 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.676+0000 7f0eaf7fe640 10 client.26051 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.676+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/3973708157 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5e79af860 con 0x55e5e7a56fa0 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.676+0000 7f0eaf7fe640 10 client.26051 handle_command_reply: tid=0 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.676+0000 7f0ed878a740 1 client.26051 shutdown 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.676+0000 7f0ed878a740 1 -- 172.21.15.18:0/3973708157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a47370 msgr2=0x55e5e7a44650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.676+0000 7f0ed878a740 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a47370 0x55e5e7a44650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8006010 tx=0x7f0ec8019000 comp rx=0 tx=0).stop 2024-09-19T09:56:50.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.676+0000 7f0ed878a740 1 -- 172.21.15.18:0/3973708157 shutdown_connections 2024-09-19T09:56:50.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.676+0000 7f0ed878a740 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e5e7a56fa0 0x55e5e7a59390 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.677+0000 7f0ed878a740 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a47370 0x55e5e7a44650 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.677+0000 7f0ed878a740 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a3db40 0x55e5e7a44040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.677+0000 7f0ed878a740 1 --2- 172.21.15.18:0/3973708157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a46d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.677+0000 7f0ed878a740 1 -- 172.21.15.18:0/3973708157 >> 172.21.15.18:0/3973708157 conn(0x55e5e7a05310 msgr2=0x55e5e7a3e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:50.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.677+0000 7f0eaf7fe640 0 client.26051 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:56:50.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.677+0000 7f0ed878a740 1 -- 172.21.15.18:0/3973708157 shutdown_connections 2024-09-19T09:56:50.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.677+0000 7f0ed878a740 1 -- 172.21.15.18:0/3973708157 wait complete. 2024-09-19T09:56:50.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.677+0000 7f0ed878a740 20 client.26051 trim_cache size 0 max 16384 2024-09-19T09:56:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.691+0000 7f0ed878a740 1 Processor -- start 2024-09-19T09:56:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.691+0000 7f0ed878a740 1 -- start start 2024-09-19T09:56:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.691+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a53310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.691+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 0x55e5e7a3efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.691+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a3f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.691+0000 7f0ed878a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01ab410 con 0x55e5e7a47370 2024-09-19T09:56:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.691+0000 7f0ed878a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01acf50 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.691+0000 7f0ed878a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01abae0 con 0x55e5e7a3db40 2024-09-19T09:56:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ed494e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a3f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ed494e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a3f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54904/0 (socket says 172.21.15.18:54904) 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ed494e640 1 -- 172.21.15.18:0/2029236428 learned_addr learned my addr 172.21.15.18:0/2029236428 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ecffff640 1 --2- 172.21.15.18:0/2029236428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a53310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ecf7fe640 1 --2- 172.21.15.18:0/2029236428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 0x55e5e7a3efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ed494e640 1 -- 172.21.15.18:0/2029236428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 msgr2=0x55e5e7a3efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ed494e640 1 --2- 172.21.15.18:0/2029236428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 0x55e5e7a3efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ed494e640 1 -- 172.21.15.18:0/2029236428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 msgr2=0x55e5e7a53310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ed494e640 1 --2- 172.21.15.18:0/2029236428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a53310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ed494e640 1 -- 172.21.15.18:0/2029236428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5e7a49ad0 con 0x55e5e7a47370 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0ed494e640 1 --2- 172.21.15.18:0/2029236428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a3f500 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8002230 tx=0x7f0ec8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90ef3c185113509 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0eb5ffb640 1 -- 172.21.15.18:0/2029236428 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec801f040 con 0x55e5e7a47370 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0eb5ffb640 1 -- 172.21.15.18:0/2029236428 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec8003970 con 0x55e5e7a47370 2024-09-19T09:56:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.692+0000 7f0eb5ffb640 1 -- 172.21.15.18:0/2029236428 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80051c0 con 0x55e5e7a47370 2024-09-19T09:56:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.693+0000 7f0ed878a740 1 -- 172.21.15.18:0/2029236428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 msgr2=0x55e5e7a3f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.693+0000 7f0ed878a740 1 --2- 172.21.15.18:0/2029236428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a3f500 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8002230 tx=0x7f0ec8011dd0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.693+0000 7f0ed878a740 1 -- 172.21.15.18:0/2029236428 shutdown_connections 2024-09-19T09:56:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.693+0000 7f0ed878a740 1 --2- 172.21.15.18:0/2029236428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a3f500 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.693+0000 7f0ed878a740 1 --2- 172.21.15.18:0/2029236428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3db40 0x55e5e7a3efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.693+0000 7f0ed878a740 1 --2- 172.21.15.18:0/2029236428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a53310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.693+0000 7f0ed878a740 1 -- 172.21.15.18:0/2029236428 >> 172.21.15.18:0/2029236428 conn(0x55e5e7a05310 msgr2=0x55e5e7a43130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.693+0000 7f0ed878a740 1 -- 172.21.15.18:0/2029236428 shutdown_connections 2024-09-19T09:56:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.693+0000 7f0ed878a740 1 -- 172.21.15.18:0/2029236428 wait complete. 2024-09-19T09:56:50.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.694+0000 7f0ed878a740 1 -- start start 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.694+0000 7f0ed878a740 1 Processor -- start 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.694+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a4f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.694+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3db40 0x55e5e7a4abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.694+0000 7f0ed878a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a4b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.694+0000 7f0ed878a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01ac880 con 0x55e5e7a47370 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.694+0000 7f0ed878a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01ac1b0 con 0x55e5e7a3db40 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.694+0000 7f0ed878a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01a9410 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.694+0000 7f0ed494e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a4b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.694+0000 7f0ed494e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a4b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54908/0 (socket says 172.21.15.18:54908) 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ed494e640 1 -- 172.21.15.18:0/1025697691 learned_addr learned my addr 172.21.15.18:0/1025697691 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ecffff640 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a4f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ecf7fe640 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3db40 0x55e5e7a4abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ecffff640 1 -- 172.21.15.18:0/1025697691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3db40 msgr2=0x55e5e7a4abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ecffff640 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3db40 0x55e5e7a4abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ecffff640 1 -- 172.21.15.18:0/1025697691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 msgr2=0x55e5e7a4b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ecffff640 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a4b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ecffff640 1 -- 172.21.15.18:0/1025697691 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5e7a4b640 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ed494e640 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a4b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ed878a740 10 client.0 _ll_register_callbacks cb 0x7f0ec801d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ed878a740 1 -- 172.21.15.18:0/1025697691 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ec8003970 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0ecffff640 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a4f890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0000c00 tx=0x7f0ec002abc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fe5b51da42c9e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0eaf7fe640 10 client.26017 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/1025697691 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0055060 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.695+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/1025697691 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0ec0004240 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/1025697691 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0ec0035040 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0ed878a740 10 client.26017 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0ed878a740 1 -- 172.21.15.18:0/1025697691 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e5e7ac1570 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/1025697691 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0ec0005040 con 0x55e5e7a3c5d0 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0ed878a740 10 client.26017 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0ed878a740 10 client.26017 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0ed878a740 20 client.26017 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0ed878a740 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e5e7ac1bb0 0x55e5e7ac4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0ed878a740 4 client.26017 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0ed878a740 1 -- 172.21.15.18:0/1025697691 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e5e79a9d70 con 0x55e5e7ac1bb0 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.696+0000 7f0ecf7fe640 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e5e7ac1bb0 0x55e5e7ac4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0ecf7fe640 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e5e7ac1bb0 0x55e5e7ac4040 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9a7e0e612a086b4 server_cookie=1a79f8a4117e2837 in_seq=0 out_seq=0 2024-09-19T09:56:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0eaf7fe640 10 client.26017 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0eaf7fe640 1 -- 172.21.15.18:0/1025697691 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e5e79a9d70 con 0x55e5e7ac1bb0 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0eaf7fe640 10 client.26017 handle_command_reply: tid=0 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0ed878a740 1 client.26017 shutdown 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0ed878a740 1 -- 172.21.15.18:0/1025697691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 msgr2=0x55e5e7a4f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0ed878a740 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a4f890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0000c00 tx=0x7f0ec002abc0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0ed878a740 1 -- 172.21.15.18:0/1025697691 shutdown_connections 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0ed878a740 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e5e7ac1bb0 0x55e5e7ac4040 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0ed878a740 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5e7a47370 0x55e5e7a4b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0ed878a740 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5e7a3db40 0x55e5e7a4abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0ed878a740 1 --2- 172.21.15.18:0/1025697691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5e7a3c5d0 0x55e5e7a4f890 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0eaf7fe640 0 client.26017 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.697+0000 7f0ed878a740 1 -- 172.21.15.18:0/1025697691 >> 172.21.15.18:0/1025697691 conn(0x55e5e7a05310 msgr2=0x55e5e7a458a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:50.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed878a740 1 -- 172.21.15.18:0/1025697691 shutdown_connections 2024-09-19T09:56:50.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed878a740 1 -- 172.21.15.18:0/1025697691 wait complete. 2024-09-19T09:56:50.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed878a740 20 client.26017 trim_cache size 0 max 16384 2024-09-19T09:56:50.707 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:56:50.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed63b1640 1 -- 172.21.15.18:0/4238920733 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0eb80a3240 msgr2=0x7f0eb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed63b1640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0eb80a3240 0x7f0eb80a5700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0ec801c000 tx=0x7f0ec8019e10 comp rx=0 tx=0).stop 2024-09-19T09:56:50.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed63b1640 1 -- 172.21.15.18:0/4238920733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed01027a0 msgr2=0x7f0ed01989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:50.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed63b1640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed01027a0 0x7f0ed01989a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400e9f0 tx=0x7f0ec400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed63b1640 1 -- 172.21.15.18:0/4238920733 shutdown_connections 2024-09-19T09:56:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed63b1640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0eb80a3240 0x7f0eb80a5700 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed63b1640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed0106f20 0x7f0ed019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed63b1640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed01027a0 0x7f0ed01989a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.698+0000 7f0ed63b1640 1 --2- 172.21.15.18:0/4238920733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ed0101df0 0x7f0ed0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.699+0000 7f0ed63b1640 1 -- 172.21.15.18:0/4238920733 >> 172.21.15.18:0/4238920733 conn(0x7f0ed00fd8f0 msgr2=0x7f0ed00fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.699+0000 7f0ed63b1640 1 -- 172.21.15.18:0/4238920733 shutdown_connections 2024-09-19T09:56:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:50.699+0000 7f0ed63b1640 1 -- 172.21.15.18:0/4238920733 wait complete. 2024-09-19T09:56:51.828 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c7a0d0c3', quiesce took 11.0 seconds. Will release after: 18.8 2024-09-19T09:56:52.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:51 smithi018 ceph-mon[30956]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 809 MiB/s wr, 1.87k op/s 2024-09-19T09:56:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:51 smithi049 ceph-mon[34858]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 809 MiB/s wr, 1.87k op/s 2024-09-19T09:56:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:51 smithi162 ceph-mon[35174]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 809 MiB/s wr, 1.87k op/s 2024-09-19T09:56:52.418 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:56:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:53.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.298+0000 7fb70b8d9640 1 -- 172.21.15.18:0/1656360822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb704101de0 msgr2=0x7fb7041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.298+0000 7fb70b8d9640 1 --2- 172.21.15.18:0/1656360822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb704101de0 0x7fb7041021c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb700009900 tx=0x7fb70002a410 comp rx=0 tx=0).stop 2024-09-19T09:56:53.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.298+0000 7fb70b8d9640 1 -- 172.21.15.18:0/1656360822 shutdown_connections 2024-09-19T09:56:53.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.298+0000 7fb70b8d9640 1 --2- 172.21.15.18:0/1656360822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb704106f10 0x7fb70410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.298+0000 7fb70b8d9640 1 --2- 172.21.15.18:0/1656360822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb704102790 0x7fb7041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.298+0000 7fb70b8d9640 1 --2- 172.21.15.18:0/1656360822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb704101de0 0x7fb7041021c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.298+0000 7fb70b8d9640 1 -- 172.21.15.18:0/1656360822 >> 172.21.15.18:0/1656360822 conn(0x7fb7040fd8c0 msgr2=0x7fb7040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.298+0000 7fb70b8d9640 1 -- 172.21.15.18:0/1656360822 shutdown_connections 2024-09-19T09:56:53.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.298+0000 7fb70b8d9640 1 -- 172.21.15.18:0/1656360822 wait complete. 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb70b8d9640 1 Processor -- start 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb70b8d9640 1 -- start start 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb70b8d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb704101de0 0x7fb704198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb70b8d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb704102790 0x7fb704198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb70b8d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb704106f10 0x7fb70419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb70b8d9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb704111f70 con 0x7fb704102790 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb70b8d9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb704111df0 con 0x7fb704101de0 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb70b8d9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041120f0 con 0x7fb704106f10 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb708e74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb704102790 0x7fb704198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb708e74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb704102790 0x7fb704198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54924/0 (socket says 172.21.15.18:54924) 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb708e74640 1 -- 172.21.15.18:0/140811 learned_addr learned my addr 172.21.15.18:0/140811 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.299+0000 7fb709675640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb704101de0 0x7fb704198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb709e76640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb704106f10 0x7fb70419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb708e74640 1 -- 172.21.15.18:0/140811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb704106f10 msgr2=0x7fb70419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb708e74640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb704106f10 0x7fb70419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb708e74640 1 -- 172.21.15.18:0/140811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb704101de0 msgr2=0x7fb704198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb708e74640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb704101de0 0x7fb704198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb708e74640 1 -- 172.21.15.18:0/140811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70419d400 con 0x7fb704102790 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb708e74640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb704102790 0x7fb704198990 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400d950 tx=0x7fb6f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb6fa7fc640 1 -- 172.21.15.18:0/140811 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4017030 con 0x7fb704102790 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb6fa7fc640 1 -- 172.21.15.18:0/140811 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6f4004020 con 0x7fb704102790 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb70b8d9640 1 -- 172.21.15.18:0/140811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70419d6f0 con 0x7fb704102790 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb6fa7fc640 1 -- 172.21.15.18:0/140811 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f40047a0 con 0x7fb704102790 2024-09-19T09:56:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.300+0000 7fb70b8d9640 1 -- 172.21.15.18:0/140811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7041a4fd0 con 0x7fb704102790 2024-09-19T09:56:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.303+0000 7fb6fa7fc640 1 -- 172.21.15.18:0/140811 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb6f40041d0 con 0x7fb704102790 2024-09-19T09:56:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.303+0000 7fb6fa7fc640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6f00a32c0 0x7fb6f00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.303+0000 7fb6fa7fc640 1 -- 172.21.15.18:0/140811 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb6f40cf1a0 con 0x7fb704102790 2024-09-19T09:56:53.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.303+0000 7fb709675640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6f00a32c0 0x7fb6f00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.304+0000 7fb709675640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6f00a32c0 0x7fb6f00a5780 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb700009230 tx=0x7fb7000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.304+0000 7fb70dcb2740 1 Processor -- start 2024-09-19T09:56:53.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.304+0000 7fb70dcb2740 1 -- start start 2024-09-19T09:56:53.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c326c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 0x5633c326ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c3279760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5633c31d22f0 con 0x5633c3277370 2024-09-19T09:56:53.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb709e76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c3279760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5633c3179cf0 con 0x5633c326db40 2024-09-19T09:56:53.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5633c31ce2b0 con 0x5633c326c5d0 2024-09-19T09:56:53.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb709e76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c3279760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54938/0 (socket says 172.21.15.18:54938) 2024-09-19T09:56:53.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb709e76640 1 -- 172.21.15.18:0/3684645962 learned_addr learned my addr 172.21.15.18:0/3684645962 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb709675640 1 --2- 172.21.15.18:0/3684645962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c326c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb708e74640 1 --2- 172.21.15.18:0/3684645962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 0x5633c326ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb709e76640 1 -- 172.21.15.18:0/3684645962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 msgr2=0x5633c326ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb709e76640 1 --2- 172.21.15.18:0/3684645962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 0x5633c326ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb709e76640 1 -- 172.21.15.18:0/3684645962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 msgr2=0x5633c326c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb709e76640 1 --2- 172.21.15.18:0/3684645962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c326c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb709e76640 1 -- 172.21.15.18:0/3684645962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c315e3a0 con 0x5633c3277370 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.305+0000 7fb709e76640 1 --2- 172.21.15.18:0/3684645962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c3279760 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00ae10 tx=0x7fb6fc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20533cedf03dc99b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.306+0000 7fb6ef7fe640 1 -- 172.21.15.18:0/3684645962 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc003b70 con 0x5633c3277370 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.306+0000 7fb6ef7fe640 1 -- 172.21.15.18:0/3684645962 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6fc003d10 con 0x5633c3277370 2024-09-19T09:56:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.306+0000 7fb6ef7fe640 1 -- 172.21.15.18:0/3684645962 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc010ae0 con 0x5633c3277370 2024-09-19T09:56:53.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.306+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3684645962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 msgr2=0x5633c3279760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.306+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/3684645962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c3279760 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00ae10 tx=0x7fb6fc00f790 comp rx=0 tx=0).stop 2024-09-19T09:56:53.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.307+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3684645962 shutdown_connections 2024-09-19T09:56:53.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.307+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/3684645962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c3279760 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.307+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/3684645962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 0x5633c326ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.307+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/3684645962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c326c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.307+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3684645962 >> 172.21.15.18:0/3684645962 conn(0x5633c3235310 msgr2=0x5633c3268c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.307+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3684645962 shutdown_connections 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.307+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3684645962 wait complete. 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.307+0000 7fb70dcb2740 1 -- start start 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.307+0000 7fb70dcb2740 1 Processor -- start 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 0x5633c3276d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c3273fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c3274570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5633c327a070 con 0x5633c3277370 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5633c318d060 con 0x5633c326db40 2024-09-19T09:56:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5633c327a1f0 con 0x5633c326c5d0 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb70dcb2740 10 client.0 _ll_register_callbacks cb 0x5633c2ee08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb709675640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 0x5633c3276d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb709675640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 0x5633c3276d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42546/0 (socket says 172.21.15.18:42546) 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb709675640 1 -- 172.21.15.18:0/2725622472 learned_addr learned my addr 172.21.15.18:0/2725622472 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb708e74640 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c3273fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb709675640 1 -- 172.21.15.18:0/2725622472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 msgr2=0x5633c3273fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb709675640 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c3273fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb709675640 1 -- 172.21.15.18:0/2725622472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 msgr2=0x5633c3274570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb709675640 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c3274570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.308+0000 7fb709675640 1 -- 172.21.15.18:0/2725622472 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633c2f433c0 con 0x5633c326c5d0 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.309+0000 7fb709675640 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 0x5633c3276d20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb70002a930 tx=0x7fb700009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf2488b07284a5c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.309+0000 7fb6ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.309+0000 7fb6ecff9640 1 -- 172.21.15.18:0/2725622472 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700035040 con 0x5633c326c5d0 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.309+0000 7fb6ecff9640 1 -- 172.21.15.18:0/2725622472 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb7000035f0 con 0x5633c326c5d0 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.309+0000 7fb70dcb2740 1 -- 172.21.15.18:0/2725622472 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6fc003d10 con 0x5633c326c5d0 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.309+0000 7fb6ecff9640 1 -- 172.21.15.18:0/2725622472 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb700059070 con 0x5633c326c5d0 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.309+0000 7fb70dcb2740 10 client.26029 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.309+0000 7fb70dcb2740 1 -- 172.21.15.18:0/2725622472 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5633c3285ac0 con 0x5633c326c5d0 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.309+0000 7fb6ecff9640 1 -- 172.21.15.18:0/2725622472 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6fc003d10 con 0x5633c326c5d0 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.310+0000 7fb6ecff9640 1 -- 172.21.15.18:0/2725622472 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb70003c9a0 con 0x5633c326c5d0 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.310+0000 7fb70dcb2740 10 client.26029 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.310+0000 7fb70dcb2740 10 client.26029 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.310+0000 7fb70dcb2740 20 client.26029 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.310+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5633c3286f80 0x5633c32893d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.310+0000 7fb70dcb2740 4 client.26029 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:53.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.310+0000 7fb70dcb2740 1 -- 172.21.15.18:0/2725622472 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633c31df860 con 0x5633c3286f80 2024-09-19T09:56:53.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.310+0000 7fb708e74640 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5633c3286f80 0x5633c32893d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.310+0000 7fb708e74640 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5633c3286f80 0x5633c32893d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be2bf7ba787cdbab server_cookie=4a9efc7ded2ac990 in_seq=0 out_seq=0 2024-09-19T09:56:53.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.310+0000 7fb6ecff9640 10 client.26029 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:56:53.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb6ecff9640 1 -- 172.21.15.18:0/2725622472 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633c31df860 con 0x5633c3286f80 2024-09-19T09:56:53.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb6ecff9640 10 client.26029 handle_command_reply: tid=0 2024-09-19T09:56:53.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb70dcb2740 1 client.26029 shutdown 2024-09-19T09:56:53.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb70dcb2740 1 -- 172.21.15.18:0/2725622472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 msgr2=0x5633c3276d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 0x5633c3276d20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb70002a930 tx=0x7fb700009260 comp rx=0 tx=0).stop 2024-09-19T09:56:53.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb70dcb2740 1 -- 172.21.15.18:0/2725622472 shutdown_connections 2024-09-19T09:56:53.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5633c3286f80 0x5633c32893d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c3274570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c3273fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb6ecff9640 0 client.26029 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:56:53.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/2725622472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326c5d0 0x5633c3276d20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.311+0000 7fb70dcb2740 1 -- 172.21.15.18:0/2725622472 >> 172.21.15.18:0/2725622472 conn(0x5633c3235310 msgr2=0x5633c326e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.312+0000 7fb70dcb2740 1 -- 172.21.15.18:0/2725622472 shutdown_connections 2024-09-19T09:56:53.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.312+0000 7fb70dcb2740 1 -- 172.21.15.18:0/2725622472 wait complete. 2024-09-19T09:56:53.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.312+0000 7fb70dcb2740 20 client.26029 trim_cache size 0 max 16384 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb70dcb2740 1 Processor -- start 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb70dcb2740 1 -- start start 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326c5d0 0x5633c3283310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326db40 0x5633c326e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c328eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041ad510 con 0x5633c3277370 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041af050 con 0x5633c326c5d0 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041adbe0 con 0x5633c326db40 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb709e76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c328eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb708e74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326db40 0x5633c326e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb709e76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c328eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54962/0 (socket says 172.21.15.18:54962) 2024-09-19T09:56:53.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb708e74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326db40 0x5633c326e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42548/0 (socket says 172.21.15.18:42548) 2024-09-19T09:56:53.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb709e76640 1 -- 172.21.15.18:0/1869957818 learned_addr learned my addr 172.21.15.18:0/1869957818 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:53.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.325+0000 7fb709675640 1 --2- 172.21.15.18:0/1869957818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326c5d0 0x5633c3283310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.326+0000 7fb709e76640 1 -- 172.21.15.18:0/1869957818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326db40 msgr2=0x5633c326e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.326+0000 7fb709e76640 1 --2- 172.21.15.18:0/1869957818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326db40 0x5633c326e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.326+0000 7fb709e76640 1 -- 172.21.15.18:0/1869957818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326c5d0 msgr2=0x5633c3283310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.326+0000 7fb709e76640 1 --2- 172.21.15.18:0/1869957818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326c5d0 0x5633c3283310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.326+0000 7fb709e76640 1 -- 172.21.15.18:0/1869957818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c3268ed0 con 0x5633c3277370 2024-09-19T09:56:53.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.326+0000 7fb709e76640 1 --2- 172.21.15.18:0/1869957818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c328eca0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00ada0 tx=0x7fb6fc00aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ddc1df0054716 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.326+0000 7fb6eeffd640 1 -- 172.21.15.18:0/1869957818 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc026070 con 0x5633c3277370 2024-09-19T09:56:53.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.326+0000 7fb6eeffd640 1 -- 172.21.15.18:0/1869957818 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6fc00a7f0 con 0x5633c3277370 2024-09-19T09:56:53.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.326+0000 7fb6eeffd640 1 -- 172.21.15.18:0/1869957818 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc005280 con 0x5633c3277370 2024-09-19T09:56:53.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 -- 172.21.15.18:0/1869957818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 msgr2=0x5633c328eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/1869957818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c328eca0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00ada0 tx=0x7fb6fc00aa40 comp rx=0 tx=0).stop 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 -- 172.21.15.18:0/1869957818 shutdown_connections 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/1869957818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c3277370 0x5633c328eca0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/1869957818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c326db40 0x5633c326e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/1869957818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326c5d0 0x5633c3283310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 -- 172.21.15.18:0/1869957818 >> 172.21.15.18:0/1869957818 conn(0x5633c3235310 msgr2=0x5633c326e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 -- 172.21.15.18:0/1869957818 shutdown_connections 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 -- 172.21.15.18:0/1869957818 wait complete. 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 -- start start 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.327+0000 7fb70dcb2740 1 Processor -- start 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c326c5d0 0x5633c327fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c3270df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb70dcb2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c3277370 0x5633c32713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041ae980 con 0x5633c326c5d0 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041ae2b0 con 0x5633c326db40 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb70dcb2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041ab4f0 con 0x5633c3277370 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb70dcb2740 10 client.0 _ll_register_callbacks cb 0x7fb700031970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb709675640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c326c5d0 0x5633c327fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb709675640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c326c5d0 0x5633c327fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54966/0 (socket says 172.21.15.18:54966) 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb709675640 1 -- 172.21.15.18:0/3667071957 learned_addr learned my addr 172.21.15.18:0/3667071957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb709e76640 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c3277370 0x5633c32713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb708e74640 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c3270df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb709675640 1 -- 172.21.15.18:0/3667071957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c3277370 msgr2=0x5633c32713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb709675640 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c3277370 0x5633c32713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb709675640 1 -- 172.21.15.18:0/3667071957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 msgr2=0x5633c3270df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb709675640 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c3270df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb709675640 1 -- 172.21.15.18:0/3667071957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633c3271bf0 con 0x5633c326c5d0 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.328+0000 7fb708e74640 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c3270df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb709675640 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c326c5d0 0x5633c327fcd0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb70003cdc0 tx=0x7fb700005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d61c81ec7d372d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb6ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb6ecff9640 1 -- 172.21.15.18:0/3667071957 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700035040 con 0x5633c326c5d0 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb6ecff9640 1 -- 172.21.15.18:0/3667071957 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb70003c990 con 0x5633c326c5d0 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3667071957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6fc00a7f0 con 0x5633c326c5d0 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb6ecff9640 1 -- 172.21.15.18:0/3667071957 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb70003cb90 con 0x5633c326c5d0 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb70dcb2740 10 client.16602 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3667071957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5633c32f6180 con 0x5633c326c5d0 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb6ecff9640 1 -- 172.21.15.18:0/3667071957 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6fc00a7f0 con 0x5633c326c5d0 2024-09-19T09:56:53.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb6ecff9640 1 -- 172.21.15.18:0/3667071957 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb70005e6c0 con 0x5633c326c5d0 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb70dcb2740 10 client.16602 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb70dcb2740 10 client.16602 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb70dcb2740 20 client.16602 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5633c32f68c0 0x5633c32f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb70dcb2740 4 client.16602 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.329+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3667071957 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633c31d9d70 con 0x5633c32f68c0 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.330+0000 7fb708e74640 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5633c32f68c0 0x5633c32f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.330+0000 7fb708e74640 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5633c32f68c0 0x5633c32f8ce0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d16c931b18acbe1c server_cookie=8a4c59ed0c189ee9 in_seq=0 out_seq=0 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.330+0000 7fb6ecff9640 10 client.16602 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.330+0000 7fb6ecff9640 1 -- 172.21.15.18:0/3667071957 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633c31d9d70 con 0x5633c32f68c0 2024-09-19T09:56:53.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.330+0000 7fb6ecff9640 10 client.16602 handle_command_reply: tid=0 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.330+0000 7fb70dcb2740 1 client.16602 shutdown 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3667071957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c326c5d0 msgr2=0x5633c327fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c326c5d0 0x5633c327fcd0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb70003cdc0 tx=0x7fb700005dc0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3667071957 shutdown_connections 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5633c32f68c0 0x5633c32f8ce0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb6ecff9640 0 client.16602 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633c3277370 0x5633c32713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633c326db40 0x5633c3270df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 1 --2- 172.21.15.18:0/3667071957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633c326c5d0 0x5633c327fcd0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3667071957 >> 172.21.15.18:0/3667071957 conn(0x5633c3235310 msgr2=0x5633c3272460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3667071957 shutdown_connections 2024-09-19T09:56:53.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 1 -- 172.21.15.18:0/3667071957 wait complete. 2024-09-19T09:56:53.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70dcb2740 20 client.16602 trim_cache size 0 max 16384 2024-09-19T09:56:53.339 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:56:53.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70b8d9640 1 -- 172.21.15.18:0/140811 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6f00a32c0 msgr2=0x7fb6f00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70b8d9640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6f00a32c0 0x7fb6f00a5780 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb700009230 tx=0x7fb7000058d0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.331+0000 7fb70b8d9640 1 -- 172.21.15.18:0/140811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb704102790 msgr2=0x7fb704198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.332+0000 7fb70b8d9640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb704102790 0x7fb704198990 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400d950 tx=0x7fb6f400de10 comp rx=0 tx=0).stop 2024-09-19T09:56:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.332+0000 7fb70b8d9640 1 -- 172.21.15.18:0/140811 shutdown_connections 2024-09-19T09:56:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.332+0000 7fb70b8d9640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6f00a32c0 0x7fb6f00a5780 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.332+0000 7fb70b8d9640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb704106f10 0x7fb70419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.332+0000 7fb70b8d9640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb704102790 0x7fb704198990 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.332+0000 7fb70b8d9640 1 --2- 172.21.15.18:0/140811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb704101de0 0x7fb704198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.332+0000 7fb70b8d9640 1 -- 172.21.15.18:0/140811 >> 172.21.15.18:0/140811 conn(0x7fb7040fd8c0 msgr2=0x7fb7040feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.332+0000 7fb70b8d9640 1 -- 172.21.15.18:0/140811 shutdown_connections 2024-09-19T09:56:53.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:53.332+0000 7fb70b8d9640 1 -- 172.21.15.18:0/140811 wait complete. 2024-09-19T09:56:53.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.379+0000 7fc25b92c640 1 -- 172.21.15.18:0/4103911517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2541013c0 msgr2=0x7fc254101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.379+0000 7fc25b92c640 1 --2- 172.21.15.18:0/4103911517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2541013c0 0x7fc254101840 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc244009900 tx=0x7fc24402a410 comp rx=0 tx=0).stop 2024-09-19T09:56:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.379+0000 7fc25b92c640 1 -- 172.21.15.18:0/4103911517 shutdown_connections 2024-09-19T09:56:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.379+0000 7fc25b92c640 1 --2- 172.21.15.18:0/4103911517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc254101d80 0x7fc254108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.379+0000 7fc25b92c640 1 --2- 172.21.15.18:0/4103911517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2541013c0 0x7fc254101840 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.379+0000 7fc25b92c640 1 --2- 172.21.15.18:0/4103911517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2541001d0 0x7fc2541005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.379+0000 7fc25b92c640 1 -- 172.21.15.18:0/4103911517 >> 172.21.15.18:0/4103911517 conn(0x7fc2540fb930 msgr2=0x7fc2540fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc25b92c640 1 -- 172.21.15.18:0/4103911517 shutdown_connections 2024-09-19T09:56:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc25b92c640 1 -- 172.21.15.18:0/4103911517 wait complete. 2024-09-19T09:56:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc25b92c640 1 Processor -- start 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc25b92c640 1 -- start start 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc25b92c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2541001d0 0x7fc254197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc25b92c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2541013c0 0x7fc254198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc25b92c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc254101d80 0x7fc25419f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc25b92c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc25410c740 con 0x7fc2541013c0 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc25b92c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc25410c5c0 con 0x7fc2541001d0 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc25b92c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc25410c8c0 con 0x7fc254101d80 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.380+0000 7fc258ec7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2541013c0 0x7fc254198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc258ec7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2541013c0 0x7fc254198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54980/0 (socket says 172.21.15.18:54980) 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc258ec7640 1 -- 172.21.15.18:0/502375112 learned_addr learned my addr 172.21.15.18:0/502375112 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc2596c8640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2541001d0 0x7fc254197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc259ec9640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc254101d80 0x7fc25419f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc258ec7640 1 -- 172.21.15.18:0/502375112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc254101d80 msgr2=0x7fc25419f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc258ec7640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc254101d80 0x7fc25419f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc258ec7640 1 -- 172.21.15.18:0/502375112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2541001d0 msgr2=0x7fc254197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc258ec7640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2541001d0 0x7fc254197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc258ec7640 1 -- 172.21.15.18:0/502375112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25419fa50 con 0x7fc2541013c0 2024-09-19T09:56:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc258ec7640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2541013c0 0x7fc254198370 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc244031440 tx=0x7fc244032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc24a7fc640 1 -- 172.21.15.18:0/502375112 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24403f030 con 0x7fc2541013c0 2024-09-19T09:56:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc24a7fc640 1 -- 172.21.15.18:0/502375112 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc244003ce0 con 0x7fc2541013c0 2024-09-19T09:56:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc24a7fc640 1 -- 172.21.15.18:0/502375112 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244035070 con 0x7fc2541013c0 2024-09-19T09:56:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc25b92c640 1 -- 172.21.15.18:0/502375112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25419fce0 con 0x7fc2541013c0 2024-09-19T09:56:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.381+0000 7fc25b92c640 1 -- 172.21.15.18:0/502375112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2541a01d0 con 0x7fc2541013c0 2024-09-19T09:56:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.384+0000 7fc24a7fc640 1 -- 172.21.15.18:0/502375112 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc244042030 con 0x7fc2541013c0 2024-09-19T09:56:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.384+0000 7fc25e6bd740 1 Processor -- start 2024-09-19T09:56:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.384+0000 7fc25e6bd740 1 -- start start 2024-09-19T09:56:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.384+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 0x55a714d78da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.384+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d792e0 0x55a714d7dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.384+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714d80830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.384+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a714cdc2f0 con 0x55a714d792e0 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.384+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a714c84270 con 0x55a714d7e370 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.384+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a714cd82b0 con 0x55a714d789a0 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc2596c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d792e0 0x55a714d7dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc259ec9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 0x55a714d78da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc2596c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d792e0 0x55a714d7dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54984/0 (socket says 172.21.15.18:54984) 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc2596c8640 1 -- 172.21.15.18:0/3118413184 learned_addr learned my addr 172.21.15.18:0/3118413184 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc258ec7640 1 --2- 172.21.15.18:0/3118413184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714d80830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc2596c8640 1 -- 172.21.15.18:0/3118413184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 msgr2=0x55a714d78da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc2596c8640 1 --2- 172.21.15.18:0/3118413184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 0x55a714d78da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc2596c8640 1 -- 172.21.15.18:0/3118413184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 msgr2=0x55a714d80830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc2596c8640 1 --2- 172.21.15.18:0/3118413184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714d80830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc2596c8640 1 -- 172.21.15.18:0/3118413184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a714c83340 con 0x55a714d792e0 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc259ec9640 1 --2- 172.21.15.18:0/3118413184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 0x55a714d78da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc24a7fc640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc2400a3370 0x7fc2400a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc2596c8640 1 --2- 172.21.15.18:0/3118413184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d792e0 0x55a714d7dda0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc250009ca0 tx=0x7fc250011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8001ba05e2b261b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc24a7fc640 1 -- 172.21.15.18:0/502375112 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc2440efcf0 con 0x7fc2541013c0 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc23f7fe640 1 -- 172.21.15.18:0/3118413184 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250004220 con 0x55a714d792e0 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc259ec9640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc2400a3370 0x7fc2400a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc23f7fe640 1 -- 172.21.15.18:0/3118413184 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2500043c0 con 0x55a714d792e0 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.385+0000 7fc23f7fe640 1 -- 172.21.15.18:0/3118413184 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250019900 con 0x55a714d792e0 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.386+0000 7fc25e6bd740 1 -- 172.21.15.18:0/3118413184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d792e0 msgr2=0x55a714d7dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.386+0000 7fc259ec9640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc2400a3370 0x7fc2400a5830 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009fd0 tx=0x7fc24c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.386+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/3118413184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d792e0 0x55a714d7dda0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc250009ca0 tx=0x7fc250011810 comp rx=0 tx=0).stop 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.386+0000 7fc25e6bd740 1 -- 172.21.15.18:0/3118413184 shutdown_connections 2024-09-19T09:56:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.386+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/3118413184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714d80830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.386+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/3118413184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d792e0 0x55a714d7dda0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.386+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/3118413184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 0x55a714d78da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.386+0000 7fc25e6bd740 1 -- 172.21.15.18:0/3118413184 >> 172.21.15.18:0/3118413184 conn(0x55a714d74010 msgr2=0x55a714d74410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.386+0000 7fc25e6bd740 1 -- 172.21.15.18:0/3118413184 shutdown_connections 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.386+0000 7fc25e6bd740 1 -- 172.21.15.18:0/3118413184 wait complete. 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc25e6bd740 1 -- start start 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc25e6bd740 1 Processor -- start 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 0x55a714d82bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d792e0 0x55a714d83130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d7e370 0x55a714d8a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a714d81340 con 0x55a714d7e370 2024-09-19T09:56:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a714c65290 con 0x55a714d792e0 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a714d814c0 con 0x55a714d789a0 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc25e6bd740 10 client.0 _ll_register_callbacks cb 0x55a714c96140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc259ec9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d7e370 0x55a714d8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc259ec9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d7e370 0x55a714d8a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54988/0 (socket says 172.21.15.18:54988) 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc2596c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 0x55a714d82bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc259ec9640 1 -- 172.21.15.18:0/2886909911 learned_addr learned my addr 172.21.15.18:0/2886909911 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.387+0000 7fc258ec7640 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d792e0 0x55a714d83130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc259ec9640 1 -- 172.21.15.18:0/2886909911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 msgr2=0x55a714d82bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc259ec9640 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 0x55a714d82bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc259ec9640 1 -- 172.21.15.18:0/2886909911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d792e0 msgr2=0x55a714d83130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc259ec9640 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d792e0 0x55a714d83130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc259ec9640 1 -- 172.21.15.18:0/2886909911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7149ef210 con 0x55a714d7e370 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc259ec9640 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d7e370 0x55a714d8a100 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc24c011e30 tx=0x7fc24c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86a0ce4d3476b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc23cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc23cff9640 1 -- 172.21.15.18:0/2886909911 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c01f9b0 con 0x55a714d7e370 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc23cff9640 1 -- 172.21.15.18:0/2886909911 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc24c01fb50 con 0x55a714d7e370 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc25e6bd740 1 -- 172.21.15.18:0/2886909911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2500043c0 con 0x55a714d7e370 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc23cff9640 1 -- 172.21.15.18:0/2886909911 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc24c01fd50 con 0x55a714d7e370 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc25e6bd740 10 client.16614 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc25e6bd740 1 -- 172.21.15.18:0/2886909911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a714abb620 con 0x55a714d7e370 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.388+0000 7fc23cff9640 1 -- 172.21.15.18:0/2886909911 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2500043c0 con 0x55a714d7e370 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.389+0000 7fc23cff9640 1 -- 172.21.15.18:0/2886909911 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc24c026070 con 0x55a714d7e370 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.389+0000 7fc25e6bd740 10 client.16614 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.389+0000 7fc25e6bd740 10 client.16614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.389+0000 7fc25e6bd740 20 client.16614 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.389+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a714d8e8c0 0x55a714d90cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.389+0000 7fc25e6bd740 4 client.16614 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.389+0000 7fc25e6bd740 1 -- 172.21.15.18:0/2886909911 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a714ce9a20 con 0x55a714d8e8c0 2024-09-19T09:56:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.389+0000 7fc2596c8640 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a714d8e8c0 0x55a714d90cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.389+0000 7fc2596c8640 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a714d8e8c0 0x55a714d90cf0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d1fb61a855b88de server_cookie=d74b64d450675041 in_seq=0 out_seq=0 2024-09-19T09:56:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.389+0000 7fc23cff9640 10 client.16614 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc23cff9640 1 -- 172.21.15.18:0/2886909911 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a714ce9a20 con 0x55a714d8e8c0 2024-09-19T09:56:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc23cff9640 10 client.16614 handle_command_reply: tid=0 2024-09-19T09:56:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 client.16614 shutdown 2024-09-19T09:56:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 -- 172.21.15.18:0/2886909911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d7e370 msgr2=0x55a714d8a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d7e370 0x55a714d8a100 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc24c011e30 tx=0x7fc24c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 -- 172.21.15.18:0/2886909911 shutdown_connections 2024-09-19T09:56:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a714d8e8c0 0x55a714d90cf0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d7e370 0x55a714d8a100 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d792e0 0x55a714d83130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/2886909911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d789a0 0x55a714d82bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 -- 172.21.15.18:0/2886909911 >> 172.21.15.18:0/2886909911 conn(0x55a714d74010 msgr2=0x55a714d75820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc23cff9640 0 client.16614 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 -- 172.21.15.18:0/2886909911 shutdown_connections 2024-09-19T09:56:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.390+0000 7fc25e6bd740 1 -- 172.21.15.18:0/2886909911 wait complete. 2024-09-19T09:56:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.391+0000 7fc25e6bd740 20 client.16614 trim_cache size 0 max 16384 2024-09-19T09:56:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc25e6bd740 1 Processor -- start 2024-09-19T09:56:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc25e6bd740 1 -- start start 2024-09-19T09:56:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714d730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 0x55a714d955f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714d95b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc2541a8ec0 con 0x55a714d789a0 2024-09-19T09:56:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc2541aaa00 con 0x55a714d7e370 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2541a9590 con 0x55a714d792e0 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc2596c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714d730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc2596c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714d730b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55004/0 (socket says 172.21.15.18:55004) 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc2596c8640 1 -- 172.21.15.18:0/322480481 learned_addr learned my addr 172.21.15.18:0/322480481 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc259ec9640 1 --2- 172.21.15.18:0/322480481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714d95b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.405+0000 7fc258ec7640 1 --2- 172.21.15.18:0/322480481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 0x55a714d955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.406+0000 7fc2596c8640 1 -- 172.21.15.18:0/322480481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 msgr2=0x55a714d955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.406+0000 7fc2596c8640 1 --2- 172.21.15.18:0/322480481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 0x55a714d955f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.406+0000 7fc2596c8640 1 -- 172.21.15.18:0/322480481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 msgr2=0x55a714d95b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.406+0000 7fc2596c8640 1 --2- 172.21.15.18:0/322480481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714d95b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.406+0000 7fc2596c8640 1 -- 172.21.15.18:0/322480481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a714d73e30 con 0x55a714d789a0 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.406+0000 7fc258ec7640 1 --2- 172.21.15.18:0/322480481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 0x55a714d955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:56:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.406+0000 7fc2596c8640 1 --2- 172.21.15.18:0/322480481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714d730b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x55a714d79d10 tx=0x7fc250011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5689c61f8472831 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.406+0000 7fc23effd640 1 -- 172.21.15.18:0/322480481 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25002f020 con 0x55a714d789a0 2024-09-19T09:56:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.406+0000 7fc23effd640 1 -- 172.21.15.18:0/322480481 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc250005520 con 0x55a714d789a0 2024-09-19T09:56:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.406+0000 7fc23effd640 1 -- 172.21.15.18:0/322480481 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25002b2c0 con 0x55a714d789a0 2024-09-19T09:56:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 -- 172.21.15.18:0/322480481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 msgr2=0x55a714d730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/322480481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714d730b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x55a714d79d10 tx=0x7fc250011810 comp rx=0 tx=0).stop 2024-09-19T09:56:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 -- 172.21.15.18:0/322480481 shutdown_connections 2024-09-19T09:56:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/322480481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714d95b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/322480481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 0x55a714d955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/322480481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714d730b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 -- 172.21.15.18:0/322480481 >> 172.21.15.18:0/322480481 conn(0x55a714d74010 msgr2=0x55a714d729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 -- 172.21.15.18:0/322480481 shutdown_connections 2024-09-19T09:56:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 -- 172.21.15.18:0/322480481 wait complete. 2024-09-19T09:56:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 -- start start 2024-09-19T09:56:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 Processor -- start 2024-09-19T09:56:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714df4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 0x55a714df5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714dfc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc2541aa330 con 0x55a714d789a0 2024-09-19T09:56:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc2541a9c60 con 0x55a714d7e370 2024-09-19T09:56:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2541a6ea0 con 0x55a714d792e0 2024-09-19T09:56:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc25e6bd740 10 client.0 _ll_register_callbacks cb 0x7fc24c009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.407+0000 7fc2596c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714df4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc2596c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714df4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55010/0 (socket says 172.21.15.18:55010) 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc2596c8640 1 -- 172.21.15.18:0/4181507994 learned_addr learned my addr 172.21.15.18:0/4181507994 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc258ec7640 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 0x55a714df5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc259ec9640 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714dfc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc2596c8640 1 -- 172.21.15.18:0/4181507994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 msgr2=0x55a714df5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc2596c8640 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 0x55a714df5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc2596c8640 1 -- 172.21.15.18:0/4181507994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 msgr2=0x55a714dfc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc2596c8640 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714dfc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc2596c8640 1 -- 172.21.15.18:0/4181507994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a714dfc660 con 0x55a714d789a0 2024-09-19T09:56:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc2596c8640 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714df4ad0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc250009bc0 tx=0x7fc250009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41135a6db6df7580 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc23cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc23cff9640 1 -- 172.21.15.18:0/4181507994 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25002f070 con 0x55a714d789a0 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc23cff9640 1 -- 172.21.15.18:0/4181507994 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc2500035f0 con 0x55a714d789a0 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc25e6bd740 1 -- 172.21.15.18:0/4181507994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc250005520 con 0x55a714d789a0 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc23cff9640 1 -- 172.21.15.18:0/4181507994 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc250044070 con 0x55a714d789a0 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc25e6bd740 10 client.16620 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc25e6bd740 1 -- 172.21.15.18:0/4181507994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a714dfd970 con 0x55a714d789a0 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.408+0000 7fc23cff9640 1 -- 172.21.15.18:0/4181507994 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc250005520 con 0x55a714d789a0 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.409+0000 7fc23cff9640 1 -- 172.21.15.18:0/4181507994 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc25003dc30 con 0x55a714d789a0 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.409+0000 7fc25e6bd740 10 client.16620 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.409+0000 7fc25e6bd740 10 client.16620 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.409+0000 7fc25e6bd740 20 client.16620 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.409+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a714dfe130 0x55a714e00550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.409+0000 7fc25e6bd740 4 client.16620 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:56:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.409+0000 7fc25e6bd740 1 -- 172.21.15.18:0/4181507994 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a714ce3d70 con 0x55a714dfe130 2024-09-19T09:56:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.409+0000 7fc258ec7640 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a714dfe130 0x55a714e00550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.410+0000 7fc23cff9640 10 client.16620 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.410+0000 7fc258ec7640 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a714dfe130 0x55a714e00550 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=389cb7ad0f4b5c60 server_cookie=30d29a84e1f36ed3 in_seq=0 out_seq=0 2024-09-19T09:56:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.422+0000 7fc23cff9640 1 -- 172.21.15.18:0/4181507994 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a714ce3d70 con 0x55a714dfe130 2024-09-19T09:56:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.422+0000 7fc23cff9640 10 client.16620 handle_command_reply: tid=0 2024-09-19T09:56:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.422+0000 7fc25e6bd740 1 client.16620 shutdown 2024-09-19T09:56:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.423+0000 7fc25e6bd740 1 -- 172.21.15.18:0/4181507994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 msgr2=0x55a714df4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.423+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714df4ad0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc250009bc0 tx=0x7fc250009f10 comp rx=0 tx=0).stop 2024-09-19T09:56:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.424+0000 7fc25e6bd740 1 -- 172.21.15.18:0/4181507994 shutdown_connections 2024-09-19T09:56:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.424+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a714dfe130 0x55a714e00550 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.424+0000 7fc23cff9640 0 client.16620 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.424+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a714d7e370 0x55a714dfc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.424+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a714d792e0 0x55a714df5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.424+0000 7fc25e6bd740 1 --2- 172.21.15.18:0/4181507994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a714d789a0 0x55a714df4ad0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.424+0000 7fc25e6bd740 1 -- 172.21.15.18:0/4181507994 >> 172.21.15.18:0/4181507994 conn(0x55a714d74010 msgr2=0x55a714d756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.425+0000 7fc25e6bd740 1 -- 172.21.15.18:0/4181507994 shutdown_connections 2024-09-19T09:56:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.425+0000 7fc25e6bd740 1 -- 172.21.15.18:0/4181507994 wait complete. 2024-09-19T09:56:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.426+0000 7fc25e6bd740 20 client.16620 trim_cache size 0 max 16384 2024-09-19T09:56:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:56:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:56:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:56:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:56:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.427+0000 7fc25b92c640 1 -- 172.21.15.18:0/502375112 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc2400a3370 msgr2=0x7fc2400a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.427+0000 7fc25b92c640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc2400a3370 0x7fc2400a5830 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009fd0 tx=0x7fc24c009500 comp rx=0 tx=0).stop 2024-09-19T09:56:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.427+0000 7fc25b92c640 1 -- 172.21.15.18:0/502375112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2541013c0 msgr2=0x7fc254198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.427+0000 7fc25b92c640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2541013c0 0x7fc254198370 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc244031440 tx=0x7fc244032ce0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.427+0000 7fc25b92c640 1 -- 172.21.15.18:0/502375112 shutdown_connections 2024-09-19T09:56:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.427+0000 7fc25b92c640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc2400a3370 0x7fc2400a5830 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.427+0000 7fc25b92c640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc254101d80 0x7fc25419f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.427+0000 7fc25b92c640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2541013c0 0x7fc254198370 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.427+0000 7fc25b92c640 1 --2- 172.21.15.18:0/502375112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2541001d0 0x7fc254197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.427+0000 7fc25b92c640 1 -- 172.21.15.18:0/502375112 >> 172.21.15.18:0/502375112 conn(0x7fc2540fb930 msgr2=0x7fc2540fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.428+0000 7fc25b92c640 1 -- 172.21.15.18:0/502375112 shutdown_connections 2024-09-19T09:56:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:56:53.428+0000 7fc25b92c640 1 -- 172.21.15.18:0/502375112 wait complete. 2024-09-19T09:56:54.078 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:53 smithi018 ceph-mon[30956]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 771 MiB/s wr, 1.79k op/s 2024-09-19T09:56:54.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:56:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:53 smithi049 ceph-mon[34858]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 771 MiB/s wr, 1.79k op/s 2024-09-19T09:56:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:53 smithi162 ceph-mon[35174]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 771 MiB/s wr, 1.79k op/s 2024-09-19T09:56:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.813+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/2451621324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4106f20 msgr2=0x7ff7b410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.813+0000 7ff7bb5e6640 1 --2- 172.21.15.18:0/2451621324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4106f20 0x7ff7b410eaa0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009ca0 tx=0x7ff7ac02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.813+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/2451621324 shutdown_connections 2024-09-19T09:56:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.813+0000 7ff7bb5e6640 1 --2- 172.21.15.18:0/2451621324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4106f20 0x7ff7b410eaa0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.813+0000 7ff7bb5e6640 1 --2- 172.21.15.18:0/2451621324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b41027a0 0x7ff7b41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.813+0000 7ff7bb5e6640 1 --2- 172.21.15.18:0/2451621324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7b4101df0 0x7ff7b41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.813+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/2451621324 >> 172.21.15.18:0/2451621324 conn(0x7ff7b40fd8f0 msgr2=0x7ff7b40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.813+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/2451621324 shutdown_connections 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.813+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/2451621324 wait complete. 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7bb5e6640 1 Processor -- start 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7bb5e6640 1 -- start start 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7bb5e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4101df0 0x7ff7b419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7bb5e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b41027a0 0x7ff7b419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7bb5e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7b4106f20 0x7ff7b419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7bb5e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b4111f80 con 0x7ff7b4101df0 2024-09-19T09:56:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7bb5e6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b4111e00 con 0x7ff7b41027a0 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7bb5e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b4112100 con 0x7ff7b4106f20 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7b9382640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4101df0 0x7ff7b419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7b9382640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4101df0 0x7ff7b419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55024/0 (socket says 172.21.15.18:55024) 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7b9382640 1 -- 172.21.15.18:0/1906110812 learned_addr learned my addr 172.21.15.18:0/1906110812 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7b9b83640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7b4106f20 0x7ff7b419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b41027a0 0x7ff7b419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7b9382640 1 -- 172.21.15.18:0/1906110812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7b4106f20 msgr2=0x7ff7b419eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7b9382640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7b4106f20 0x7ff7b419eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7b9382640 1 -- 172.21.15.18:0/1906110812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b41027a0 msgr2=0x7ff7b419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7b9382640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b41027a0 0x7ff7b419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.814+0000 7ff7b9382640 1 -- 172.21.15.18:0/1906110812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b419f580 con 0x7ff7b4101df0 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.815+0000 7ff7b9382640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4101df0 0x7ff7b419a5d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000e9f0 tx=0x7ff7b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:54.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.815+0000 7ff7aa7fc640 1 -- 172.21.15.18:0/1906110812 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000cd80 con 0x7ff7b4101df0 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.815+0000 7ff7aa7fc640 1 -- 172.21.15.18:0/1906110812 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b0005500 con 0x7ff7b4101df0 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.815+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/1906110812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b419f870 con 0x7ff7b4101df0 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.815+0000 7ff7aa7fc640 1 -- 172.21.15.18:0/1906110812 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0010690 con 0x7ff7b4101df0 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.815+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/1906110812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b41a7150 con 0x7ff7b4101df0 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.817+0000 7ff7aa7fc640 1 -- 172.21.15.18:0/1906110812 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff7b00046c0 con 0x7ff7b4101df0 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7bd9bf740 1 Processor -- start 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7bd9bf740 1 -- start start 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b7367ab40 0x559b73679090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 0x559b73679a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b73684370 0x559b73686760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559b735df2f0 con 0x559b73684370 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559b73586cf0 con 0x559b736795d0 2024-09-19T09:56:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559b735db2b0 con 0x559b7367ab40 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7b8b81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b73684370 0x559b73686760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7b8b81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b73684370 0x559b73686760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55030/0 (socket says 172.21.15.18:55030) 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7b8b81640 1 -- 172.21.15.18:0/2614895699 learned_addr learned my addr 172.21.15.18:0/2614895699 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7b9b83640 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b7367ab40 0x559b73679090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7b9382640 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 0x559b73679a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7aa7fc640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7a00a32c0 0x7ff7a00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.818+0000 7ff7b8b81640 1 -- 172.21.15.18:0/2614895699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b7367ab40 msgr2=0x559b73679090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b7367ab40 0x559b73679090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff7b8b81640 1 -- 172.21.15.18:0/2614895699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 msgr2=0x559b73679a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 0x559b73679a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff7b8b81640 1 -- 172.21.15.18:0/2614895699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b7356b3a0 con 0x559b73684370 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff7b9b83640 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b7367ab40 0x559b73679090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff7b9382640 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 0x559b73679a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff7b9b83640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7a00a32c0 0x7ff7a00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff7aa7fc640 1 -- 172.21.15.18:0/1906110812 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff7b00cfc80 con 0x7ff7b4101df0 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b73684370 0x559b73686760 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400bc30 tx=0x7ff7a40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ddb277926d4b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff79f7fe640 1 -- 172.21.15.18:0/2614895699 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a401c480 con 0x559b73684370 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff79f7fe640 1 -- 172.21.15.18:0/2614895699 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a401cb00 con 0x559b73684370 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.819+0000 7ff79f7fe640 1 -- 172.21.15.18:0/2614895699 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4011b50 con 0x559b73684370 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/2614895699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b73684370 msgr2=0x559b73686760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b73684370 0x559b73686760 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400bc30 tx=0x7ff7a40107a0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7b9b83640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7a00a32c0 0x7ff7a00a5780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac004af0 tx=0x7ff7ac0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/2614895699 shutdown_connections 2024-09-19T09:56:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b73684370 0x559b73686760 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 0x559b73679a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/2614895699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b7367ab40 0x559b73679090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/2614895699 >> 172.21.15.18:0/2614895699 conn(0x559b73642310 msgr2=0x559b73675c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/2614895699 shutdown_connections 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/2614895699 wait complete. 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 -- start start 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.820+0000 7ff7bd9bf740 1 Processor -- start 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73683d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 0x559b73681010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b73681620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559b73687070 con 0x559b736795d0 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559b7359a060 con 0x559b7367ab40 2024-09-19T09:56:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559b736871f0 con 0x559b73684370 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7b9382640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73683d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7bd9bf740 10 client.0 _ll_register_callbacks cb 0x559b732ed8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7b9382640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73683d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55042/0 (socket says 172.21.15.18:55042) 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7b9382640 1 -- 172.21.15.18:0/1798824819 learned_addr learned my addr 172.21.15.18:0/1798824819 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 0x559b73681010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7b9b83640 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b73681620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7b9382640 1 -- 172.21.15.18:0/1798824819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 msgr2=0x559b73681620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7b9382640 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b73681620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7b9382640 1 -- 172.21.15.18:0/1798824819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 msgr2=0x559b73681010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7b9382640 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 0x559b73681010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.821+0000 7ff7b9382640 1 -- 172.21.15.18:0/1798824819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b733503c0 con 0x559b736795d0 2024-09-19T09:56:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.822+0000 7ff7b9382640 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73683d10 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00cd7b0 tx=0x7ff7b009bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c0789a475d165 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.822+0000 7ff79cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.822+0000 7ff79cff9640 1 -- 172.21.15.18:0/1798824819 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00b5060 con 0x559b736795d0 2024-09-19T09:56:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.822+0000 7ff79cff9640 1 -- 172.21.15.18:0/1798824819 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff7b009a5d0 con 0x559b736795d0 2024-09-19T09:56:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.822+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/1798824819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7a401cb00 con 0x559b736795d0 2024-09-19T09:56:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.822+0000 7ff79cff9640 1 -- 172.21.15.18:0/1798824819 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff7b009c2d0 con 0x559b736795d0 2024-09-19T09:56:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.822+0000 7ff7bd9bf740 10 client.16632 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.822+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/1798824819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b73692b00 con 0x559b736795d0 2024-09-19T09:56:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.822+0000 7ff79cff9640 1 -- 172.21.15.18:0/1798824819 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a401cb00 con 0x559b736795d0 2024-09-19T09:56:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.822+0000 7ff79cff9640 1 -- 172.21.15.18:0/1798824819 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff7b009d9d0 con 0x559b736795d0 2024-09-19T09:56:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.823+0000 7ff7bd9bf740 10 client.16632 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.823+0000 7ff7bd9bf740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.823+0000 7ff7bd9bf740 20 client.16632 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.823+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559b73693f10 0x559b73696340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.823+0000 7ff7bd9bf740 4 client.16632 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.823+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/1798824819 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b735ec860 con 0x559b73693f10 2024-09-19T09:56:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.823+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559b73693f10 0x559b73696340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.823+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559b73693f10 0x559b73696340 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6312569f05a214d4 server_cookie=5d111abe27a29ca1 in_seq=0 out_seq=0 2024-09-19T09:56:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.823+0000 7ff79cff9640 10 client.16632 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff79cff9640 1 -- 172.21.15.18:0/1798824819 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b735ec860 con 0x559b73693f10 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff79cff9640 10 client.16632 handle_command_reply: tid=0 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 client.16632 shutdown 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/1798824819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 msgr2=0x559b73683d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73683d10 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00cd7b0 tx=0x7ff7b009bc30 comp rx=0 tx=0).stop 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/1798824819 shutdown_connections 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559b73693f10 0x559b73696340 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b73681620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 0x559b73681010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/1798824819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73683d10 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/1798824819 >> 172.21.15.18:0/1798824819 conn(0x559b73642310 msgr2=0x559b7367b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff79cff9640 0 client.16632 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/1798824819 shutdown_connections 2024-09-19T09:56:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.824+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/1798824819 wait complete. 2024-09-19T09:56:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.825+0000 7ff7bd9bf740 20 client.16632 trim_cache size 0 max 16384 2024-09-19T09:56:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7bd9bf740 1 Processor -- start 2024-09-19T09:56:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7bd9bf740 1 -- start start 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 0x559b73690310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b7367ab40 0x559b73695f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b7369bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41af760 con 0x559b7367ab40 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41b12a0 con 0x559b736795d0 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41afe30 con 0x559b73684370 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7b8b81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b7367ab40 0x559b73695f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7b8b81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b7367ab40 0x559b73695f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55044/0 (socket says 172.21.15.18:55044) 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.841+0000 7ff7b8b81640 1 -- 172.21.15.18:0/2528258281 learned_addr learned my addr 172.21.15.18:0/2528258281 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff7b9b83640 1 --2- 172.21.15.18:0/2528258281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b7369bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff7b8b81640 1 -- 172.21.15.18:0/2528258281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 msgr2=0x559b7369bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff7b9382640 1 --2- 172.21.15.18:0/2528258281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 0x559b73690310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/2528258281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b7369bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff7b8b81640 1 -- 172.21.15.18:0/2528258281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 msgr2=0x559b73690310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/2528258281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 0x559b73690310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff7b8b81640 1 -- 172.21.15.18:0/2528258281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b73681990 con 0x559b7367ab40 2024-09-19T09:56:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff7b9b83640 1 --2- 172.21.15.18:0/2528258281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b7369bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:56:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/2528258281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b7367ab40 0x559b73695f20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400bc30 tx=0x7ff7a401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f6ba7b46bfd2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff79effd640 1 -- 172.21.15.18:0/2528258281 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4005040 con 0x559b7367ab40 2024-09-19T09:56:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff79effd640 1 -- 172.21.15.18:0/2528258281 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a401c480 con 0x559b7367ab40 2024-09-19T09:56:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.842+0000 7ff79effd640 1 -- 172.21.15.18:0/2528258281 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40118e0 con 0x559b7367ab40 2024-09-19T09:56:54.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/2528258281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b7367ab40 msgr2=0x559b73695f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:54.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/2528258281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b7367ab40 0x559b73695f20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400bc30 tx=0x7ff7a401e040 comp rx=0 tx=0).stop 2024-09-19T09:56:54.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/2528258281 shutdown_connections 2024-09-19T09:56:54.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/2528258281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b7369bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/2528258281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b7367ab40 0x559b73695f20 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/2528258281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b736795d0 0x559b73690310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/2528258281 >> 172.21.15.18:0/2528258281 conn(0x559b73642310 msgr2=0x559b73680100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/2528258281 shutdown_connections 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/2528258281 wait complete. 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 -- start start 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.843+0000 7ff7bd9bf740 1 Processor -- start 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73688450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 0x559b73688990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7bd9bf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b73688ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41b0bd0 con 0x559b736795d0 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41b0500 con 0x559b7367ab40 2024-09-19T09:56:54.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7bd9bf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41ad740 con 0x559b73684370 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7bd9bf740 10 client.0 _ll_register_callbacks cb 0x7ff7b000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b9382640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73688450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b9382640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73688450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55046/0 (socket says 172.21.15.18:55046) 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b9382640 1 -- 172.21.15.18:0/3212754104 learned_addr learned my addr 172.21.15.18:0/3212754104 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b9b83640 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b73688ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 0x559b73688990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b9382640 1 -- 172.21.15.18:0/3212754104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 msgr2=0x559b73688ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b9382640 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b73688ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b9382640 1 -- 172.21.15.18:0/3212754104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 msgr2=0x559b73688990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b9382640 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 0x559b73688990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b9382640 1 -- 172.21.15.18:0/3212754104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b736fde30 con 0x559b736795d0 2024-09-19T09:56:54.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 0x559b73688990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff7b9382640 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73688450 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00bc0d0 tx=0x7ff7b000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b9d2eb14a79d07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff79cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.844+0000 7ff79cff9640 1 -- 172.21.15.18:0/3212754104 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00b5040 con 0x559b736795d0 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff79cff9640 1 -- 172.21.15.18:0/3212754104 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff7b00b51e0 con 0x559b736795d0 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/3212754104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7a401c480 con 0x559b736795d0 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff79cff9640 1 -- 172.21.15.18:0/3212754104 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff7b009d600 con 0x559b736795d0 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff7bd9bf740 10 client.16638 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/3212754104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b736ff0a0 con 0x559b736795d0 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff79cff9640 1 -- 172.21.15.18:0/3212754104 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a401c480 con 0x559b736795d0 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff79cff9640 1 -- 172.21.15.18:0/3212754104 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff7b009b720 con 0x559b736795d0 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff7bd9bf740 10 client.16638 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff7bd9bf740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff7bd9bf740 20 client.16638 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559b736ff7c0 0x559b73701bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff7bd9bf740 4 client.16638 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/3212754104 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b735e6d70 con 0x559b736ff7c0 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.845+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559b736ff7c0 0x559b73701bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7b8b81640 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559b736ff7c0 0x559b73701bd0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37b2d64f1d5d1c44 server_cookie=f766e356aa170c0f in_seq=0 out_seq=0 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff79cff9640 10 client.16638 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff79cff9640 1 -- 172.21.15.18:0/3212754104 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b735e6d70 con 0x559b736ff7c0 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff79cff9640 10 client.16638 handle_command_reply: tid=0 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 client.16638 shutdown 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/3212754104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 msgr2=0x559b73688450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73688450 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00bc0d0 tx=0x7ff7b000c7d0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/3212754104 shutdown_connections 2024-09-19T09:56:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559b736ff7c0 0x559b73701bd0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b73684370 0x559b73688ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b7367ab40 0x559b73688990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 --2- 172.21.15.18:0/3212754104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b736795d0 0x559b73688450 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/3212754104 >> 172.21.15.18:0/3212754104 conn(0x559b73642310 msgr2=0x559b7367b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff79cff9640 0 client.16638 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/3212754104 shutdown_connections 2024-09-19T09:56:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 1 -- 172.21.15.18:0/3212754104 wait complete. 2024-09-19T09:56:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.846+0000 7ff7bd9bf740 20 client.16638 trim_cache size 0 max 16384 2024-09-19T09:56:54.859 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:56:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/1906110812 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7a00a32c0 msgr2=0x7ff7a00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7a00a32c0 0x7ff7a00a5780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac004af0 tx=0x7ff7ac0095c0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/1906110812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4101df0 msgr2=0x7ff7b419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4101df0 0x7ff7b419a5d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000e9f0 tx=0x7ff7b000edf0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/1906110812 shutdown_connections 2024-09-19T09:56:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff7a00a32c0 0x7ff7a00a5780 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7b4106f20 0x7ff7b419eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b41027a0 0x7ff7b419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 --2- 172.21.15.18:0/1906110812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4101df0 0x7ff7b419a5d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/1906110812 >> 172.21.15.18:0/1906110812 conn(0x7ff7b40fd8f0 msgr2=0x7ff7b40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/1906110812 shutdown_connections 2024-09-19T09:56:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:54.847+0000 7ff7bb5e6640 1 -- 172.21.15.18:0/1906110812 wait complete. 2024-09-19T09:56:56.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:55 smithi018 ceph-mon[30956]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 627 MiB/s wr, 1.32k op/s 2024-09-19T09:56:56.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:55 smithi049 ceph-mon[34858]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 627 MiB/s wr, 1.32k op/s 2024-09-19T09:56:56.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:55 smithi162 ceph-mon[35174]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 627 MiB/s wr, 1.32k op/s 2024-09-19T09:56:56.727 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:56:56.728 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:56:56.999 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:57.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.601+0000 7f5ec660d640 1 -- 172.21.15.18:0/400621998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec0102790 msgr2=0x7f5ec01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:57.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.601+0000 7f5ec660d640 1 --2- 172.21.15.18:0/400621998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec0102790 0x7f5ec01067e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009900 tx=0x7f5eb402a410 comp rx=0 tx=0).stop 2024-09-19T09:56:57.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.601+0000 7f5ec660d640 1 -- 172.21.15.18:0/400621998 shutdown_connections 2024-09-19T09:56:57.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.601+0000 7f5ec660d640 1 --2- 172.21.15.18:0/400621998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec0106f10 0x7f5ec010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.601+0000 7f5ec660d640 1 --2- 172.21.15.18:0/400621998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec0102790 0x7f5ec01067e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.601+0000 7f5ec660d640 1 --2- 172.21.15.18:0/400621998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec0101de0 0x7f5ec01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.601+0000 7f5ec660d640 1 -- 172.21.15.18:0/400621998 >> 172.21.15.18:0/400621998 conn(0x7f5ec00fd8c0 msgr2=0x7f5ec00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.601+0000 7f5ec660d640 1 -- 172.21.15.18:0/400621998 shutdown_connections 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.601+0000 7f5ec660d640 1 -- 172.21.15.18:0/400621998 wait complete. 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.602+0000 7f5ec660d640 1 Processor -- start 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.602+0000 7f5ec660d640 1 -- start start 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec660d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec0101de0 0x7f5ec0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec660d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec0102790 0x7f5ec0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec660d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec0106f10 0x7f5ec019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec660d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0111f30 con 0x7f5ec0106f10 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec660d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0111db0 con 0x7f5ec0101de0 2024-09-19T09:56:57.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec660d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01120b0 con 0x7f5ec0102790 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec4baa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec0106f10 0x7f5ec019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec4baa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec0106f10 0x7f5ec019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49750/0 (socket says 172.21.15.18:49750) 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec4baa640 1 -- 172.21.15.18:0/2885307547 learned_addr learned my addr 172.21.15.18:0/2885307547 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ebf7fe640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec0102790 0x7f5ec0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ebffff640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec0101de0 0x7f5ec0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec4baa640 1 -- 172.21.15.18:0/2885307547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec0102790 msgr2=0x7f5ec0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec4baa640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec0102790 0x7f5ec0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec4baa640 1 -- 172.21.15.18:0/2885307547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec0101de0 msgr2=0x7f5ec0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec4baa640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec0101de0 0x7f5ec0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec4baa640 1 -- 172.21.15.18:0/2885307547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec019d3e0 con 0x7f5ec0106f10 2024-09-19T09:56:57.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.603+0000 7f5ec4baa640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec0106f10 0x7f5ec019cd00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800eaa0 tx=0x7f5eb800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:57.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.604+0000 7f5ebd7fa640 1 -- 172.21.15.18:0/2885307547 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800cdb0 con 0x7f5ec0106f10 2024-09-19T09:56:57.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.604+0000 7f5ec660d640 1 -- 172.21.15.18:0/2885307547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec019d6d0 con 0x7f5ec0106f10 2024-09-19T09:56:57.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.604+0000 7f5ebd7fa640 1 -- 172.21.15.18:0/2885307547 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eb8005020 con 0x7f5ec0106f10 2024-09-19T09:56:57.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.604+0000 7f5ebd7fa640 1 -- 172.21.15.18:0/2885307547 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80116b0 con 0x7f5ec0106f10 2024-09-19T09:56:57.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.604+0000 7f5ec660d640 1 -- 172.21.15.18:0/2885307547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec01a4fb0 con 0x7f5ec0106f10 2024-09-19T09:56:57.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.606+0000 7f5ebd7fa640 1 -- 172.21.15.18:0/2885307547 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5eb8005560 con 0x7f5ec0106f10 2024-09-19T09:56:57.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.606+0000 7f5ec89e6740 1 Processor -- start 2024-09-19T09:56:57.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ec89e6740 1 -- start start 2024-09-19T09:56:57.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebd7fa640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5ea80a3240 0x7f5ea80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492ea40 0x55610492ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492f360 0x55610493dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x556104940540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556104894280 con 0x55610492ea40 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55610483bb10 con 0x55610492f360 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556104890240 con 0x55610493e150 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492ea40 0x55610492ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebd7fa640 1 -- 172.21.15.18:0/2885307547 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5eb80cfb20 con 0x7f5ec0106f10 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492ea40 0x55610492ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49762/0 (socket says 172.21.15.18:49762) 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebffff640 1 -- 172.21.15.18:0/3999502799 learned_addr learned my addr 172.21.15.18:0/3999502799 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebf7fe640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5ea80a3240 0x7f5ea80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ec4baa640 1 --2- 172.21.15.18:0/3999502799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x556104940540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebffff640 1 -- 172.21.15.18:0/3999502799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 msgr2=0x556104940540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebffff640 1 --2- 172.21.15.18:0/3999502799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x556104940540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebffff640 1 -- 172.21.15.18:0/3999502799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492f360 msgr2=0x55610493dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebffff640 1 --2- 172.21.15.18:0/3999502799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492f360 0x55610493dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.607+0000 7f5ebffff640 1 -- 172.21.15.18:0/3999502799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561048481f0 con 0x55610492ea40 2024-09-19T09:56:57.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.608+0000 7f5ebffff640 1 --2- 172.21.15.18:0/3999502799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492ea40 0x55610492ee20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009c80 tx=0x7f5eb00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80c5a9585f08049 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:57.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.608+0000 7f5ebf7fe640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5ea80a3240 0x7f5ea80a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009230 tx=0x7f5eb4005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:57.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.608+0000 7f5ea67fc640 1 -- 172.21.15.18:0/3999502799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0012450 con 0x55610492ea40 2024-09-19T09:56:57.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.608+0000 7f5ea67fc640 1 -- 172.21.15.18:0/3999502799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eb0012ad0 con 0x55610492ea40 2024-09-19T09:56:57.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.608+0000 7f5ea67fc640 1 -- 172.21.15.18:0/3999502799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000fbf0 con 0x55610492ea40 2024-09-19T09:56:57.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3999502799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492ea40 msgr2=0x55610492ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:57.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/3999502799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492ea40 0x55610492ee20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009c80 tx=0x7f5eb00117b0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3999502799 shutdown_connections 2024-09-19T09:56:57.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/3999502799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x556104940540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/3999502799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492f360 0x55610493dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/3999502799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492ea40 0x55610492ee20 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3999502799 >> 172.21.15.18:0/3999502799 conn(0x55610492b0f0 msgr2=0x55610492b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:57.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3999502799 shutdown_connections 2024-09-19T09:56:57.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3999502799 wait complete. 2024-09-19T09:56:57.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 -- start start 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.609+0000 7f5ec89e6740 1 Processor -- start 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610492ea40 0x55610493b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x55610493b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610493e150 0x55610493baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556104940d20 con 0x55610492f360 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55610484ef10 con 0x55610493e150 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556104940ea0 con 0x55610492ea40 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ec89e6740 10 client.0 _ll_register_callbacks cb 0x556104817a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ebf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x55610493b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ebf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x55610493b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49768/0 (socket says 172.21.15.18:49768) 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ebf7fe640 1 -- 172.21.15.18:0/3750953151 learned_addr learned my addr 172.21.15.18:0/3750953151 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:57.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ebffff640 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610492ea40 0x55610493b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ec4baa640 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610493e150 0x55610493baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ebf7fe640 1 -- 172.21.15.18:0/3750953151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610492ea40 msgr2=0x55610493b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ebf7fe640 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610492ea40 0x55610493b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ebf7fe640 1 -- 172.21.15.18:0/3750953151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610493e150 msgr2=0x55610493baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ebf7fe640 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610493e150 0x55610493baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ebf7fe640 1 -- 172.21.15.18:0/3750953151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561046056a0 con 0x55610492f360 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5ebf7fe640 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x55610493b560 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4033000 tx=0x7f5eb4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b454ebd595418e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5e9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.610+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/3750953151 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb404d020 con 0x55610492f360 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3750953151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5eb0012ad0 con 0x55610492f360 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/3750953151 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5eb40035f0 con 0x55610492f360 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/3750953151 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5eb4035040 con 0x55610492f360 2024-09-19T09:56:57.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5ec89e6740 10 client.16650 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3750953151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55610494c960 con 0x55610492f360 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/3750953151 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eb0012ad0 con 0x55610492f360 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/3750953151 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5eb40497e0 con 0x55610492f360 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5ec89e6740 10 client.16650 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5ec89e6740 10 client.16650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5ec89e6740 20 client.16650 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55610494ddc0 0x556104950220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5ec89e6740 4 client.16650 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.611+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3750953151 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561048a17f0 con 0x55610494ddc0 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.612+0000 7f5ebffff640 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55610494ddc0 0x556104950220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.612+0000 7f5e9f7fe640 10 client.16650 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.612+0000 7f5ebffff640 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55610494ddc0 0x556104950220 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c0c3744bbe7ed0 server_cookie=c9088d177caf2dfe in_seq=0 out_seq=0 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/3750953151 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5561048a17f0 con 0x55610494ddc0 2024-09-19T09:56:57.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5e9f7fe640 10 client.16650 handle_command_reply: tid=0 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 client.16650 shutdown 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3750953151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 msgr2=0x55610493b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x55610493b560 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4033000 tx=0x7f5eb4009260 comp rx=0 tx=0).stop 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3750953151 shutdown_connections 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55610494ddc0 0x556104950220 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610493e150 0x55610493baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x55610493b560 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5e9f7fe640 0 client.16650 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/3750953151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610492ea40 0x55610493b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3750953151 >> 172.21.15.18:0/3750953151 conn(0x55610492b0f0 msgr2=0x55610492a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3750953151 shutdown_connections 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 1 -- 172.21.15.18:0/3750953151 wait complete. 2024-09-19T09:56:57.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.613+0000 7f5ec89e6740 20 client.16650 trim_cache size 0 max 16384 2024-09-19T09:56:57.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.630+0000 7f5ec89e6740 1 Processor -- start 2024-09-19T09:56:57.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.630+0000 7f5ec89e6740 1 -- start start 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492ea40 0x556104939ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x556104955af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x556104956030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01ab2e0 con 0x55610492f360 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01ace20 con 0x55610492ea40 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01ab9b0 con 0x55610493e150 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ebf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x556104955af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ebf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x556104955af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49774/0 (socket says 172.21.15.18:49774) 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ebf7fe640 1 -- 172.21.15.18:0/380982574 learned_addr learned my addr 172.21.15.18:0/380982574 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ebffff640 1 --2- 172.21.15.18:0/380982574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492ea40 0x556104939ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ec4baa640 1 --2- 172.21.15.18:0/380982574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x556104956030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ebf7fe640 1 -- 172.21.15.18:0/380982574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 msgr2=0x556104956030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:57.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ebf7fe640 1 --2- 172.21.15.18:0/380982574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x556104956030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ebf7fe640 1 -- 172.21.15.18:0/380982574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492ea40 msgr2=0x556104939ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:57.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ebf7fe640 1 --2- 172.21.15.18:0/380982574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492ea40 0x556104939ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.631+0000 7f5ebf7fe640 1 -- 172.21.15.18:0/380982574 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556104935de0 con 0x55610492f360 2024-09-19T09:56:57.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ebf7fe640 1 --2- 172.21.15.18:0/380982574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x556104955af0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4056040 tx=0x7f5eb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5022b84aee90e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ea5ffb640 1 -- 172.21.15.18:0/380982574 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb404d040 con 0x55610492f360 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ea5ffb640 1 -- 172.21.15.18:0/380982574 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eb4063070 con 0x55610492f360 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ea5ffb640 1 -- 172.21.15.18:0/380982574 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4003b30 con 0x55610492f360 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ec89e6740 1 -- 172.21.15.18:0/380982574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 msgr2=0x556104955af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/380982574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x556104955af0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4056040 tx=0x7f5eb4009780 comp rx=0 tx=0).stop 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ec89e6740 1 -- 172.21.15.18:0/380982574 shutdown_connections 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/380982574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x556104956030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/380982574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55610492f360 0x556104955af0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/380982574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492ea40 0x556104939ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.632+0000 7f5ec89e6740 1 -- 172.21.15.18:0/380982574 >> 172.21.15.18:0/380982574 conn(0x55610492b0f0 msgr2=0x5561049397c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:57.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.633+0000 7f5ec89e6740 1 -- 172.21.15.18:0/380982574 shutdown_connections 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.633+0000 7f5ec89e6740 1 -- 172.21.15.18:0/380982574 wait complete. 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.633+0000 7f5ec89e6740 1 -- start start 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.633+0000 7f5ec89e6740 1 Processor -- start 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.633+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492ea40 0x556104946290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.633+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x5561049467d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.633+0000 7f5ec89e6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556104942610 0x556104942a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01ac750 con 0x556104942610 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01ac080 con 0x55610492ea40 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec89e6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01a92c0 con 0x55610493e150 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec4baa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556104942610 0x556104942a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec4baa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556104942610 0x556104942a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49782/0 (socket says 172.21.15.18:49782) 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ebf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x5561049467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec4baa640 1 -- 172.21.15.18:0/47051087 learned_addr learned my addr 172.21.15.18:0/47051087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec89e6740 10 client.0 _ll_register_callbacks cb 0x7f5eb4040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ebffff640 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492ea40 0x556104946290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec4baa640 1 -- 172.21.15.18:0/47051087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 msgr2=0x5561049467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec4baa640 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x5561049467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec4baa640 1 -- 172.21.15.18:0/47051087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492ea40 msgr2=0x556104946290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec4baa640 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492ea40 0x556104946290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec4baa640 1 -- 172.21.15.18:0/47051087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556104943270 con 0x556104942610 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ebf7fe640 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x5561049467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec4baa640 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556104942610 0x556104942a70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5eb809be10 tx=0x7f5eb8015300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4f9ef80b5de193 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5e9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/47051087 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb801f040 con 0x556104942610 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/47051087 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5eb80051d0 con 0x556104942610 2024-09-19T09:56:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.634+0000 7f5ec89e6740 1 -- 172.21.15.18:0/47051087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5eb4063070 con 0x556104942610 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/47051087 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5eb8055170 con 0x556104942610 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5ec89e6740 10 client.16656 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5ec89e6740 1 -- 172.21.15.18:0/47051087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5561049b9980 con 0x556104942610 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/47051087 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eb4063070 con 0x556104942610 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/47051087 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5eb800f040 con 0x556104942610 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5ec89e6740 10 client.16656 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5ec89e6740 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5ec89e6740 20 client.16656 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5561049ba0a0 0x5561049bc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5ec89e6740 4 client.16656 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5ec89e6740 1 -- 172.21.15.18:0/47051087 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55610489bd00 con 0x5561049ba0a0 2024-09-19T09:56:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.635+0000 7f5ebffff640 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5561049ba0a0 0x5561049bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:57.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.636+0000 7f5ebffff640 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5561049ba0a0 0x5561049bc490 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=433ae01d0fb4eaf1 server_cookie=e5526b0b769d0df in_seq=0 out_seq=0 2024-09-19T09:56:57.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.636+0000 7f5e9f7fe640 10 client.16656 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5e9f7fe640 1 -- 172.21.15.18:0/47051087 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55610489bd00 con 0x5561049ba0a0 2024-09-19T09:56:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5e9f7fe640 10 client.16656 handle_command_reply: tid=0 2024-09-19T09:56:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5ec89e6740 1 client.16656 shutdown 2024-09-19T09:56:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5ec89e6740 1 -- 172.21.15.18:0/47051087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556104942610 msgr2=0x556104942a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556104942610 0x556104942a70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5eb809be10 tx=0x7f5eb8015300 comp rx=0 tx=0).stop 2024-09-19T09:56:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5ec89e6740 1 -- 172.21.15.18:0/47051087 shutdown_connections 2024-09-19T09:56:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5561049ba0a0 0x5561049bc490 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556104942610 0x556104942a70 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55610493e150 0x5561049467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5ec89e6740 1 --2- 172.21.15.18:0/47051087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55610492ea40 0x556104946290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5e9f7fe640 0 client.16656 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5ec89e6740 1 -- 172.21.15.18:0/47051087 >> 172.21.15.18:0/47051087 conn(0x55610492b0f0 msgr2=0x55610492a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.637+0000 7f5ec89e6740 1 -- 172.21.15.18:0/47051087 shutdown_connections 2024-09-19T09:56:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.638+0000 7f5ec89e6740 1 -- 172.21.15.18:0/47051087 wait complete. 2024-09-19T09:56:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.638+0000 7f5ec89e6740 20 client.16656 trim_cache size 0 max 16384 2024-09-19T09:56:57.644 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:56:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T09:56:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "11758f8a-fafe-46db-b16b-9a7128465fa4", 2024-09-19T09:56:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T09:56:57.645 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:56:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.638+0000 7f5ec660d640 1 -- 172.21.15.18:0/2885307547 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5ea80a3240 msgr2=0x7f5ea80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.638+0000 7f5ec660d640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5ea80a3240 0x7f5ea80a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009230 tx=0x7f5eb4005df0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.638+0000 7f5ec660d640 1 -- 172.21.15.18:0/2885307547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec0106f10 msgr2=0x7f5ec019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.638+0000 7f5ec660d640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec0106f10 0x7f5ec019cd00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800eaa0 tx=0x7f5eb800ef60 comp rx=0 tx=0).stop 2024-09-19T09:56:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.639+0000 7f5ec660d640 1 -- 172.21.15.18:0/2885307547 shutdown_connections 2024-09-19T09:56:57.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.639+0000 7f5ec660d640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5ea80a3240 0x7f5ea80a5700 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.639+0000 7f5ec660d640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec0106f10 0x7f5ec019cd00 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.639+0000 7f5ec660d640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ec0102790 0x7f5ec0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.639+0000 7f5ec660d640 1 --2- 172.21.15.18:0/2885307547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ec0101de0 0x7f5ec0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:57.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.639+0000 7f5ec660d640 1 -- 172.21.15.18:0/2885307547 >> 172.21.15.18:0/2885307547 conn(0x7f5ec00fd8c0 msgr2=0x7f5ec00fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:57.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.639+0000 7f5ec660d640 1 -- 172.21.15.18:0/2885307547 shutdown_connections 2024-09-19T09:56:57.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:57.639+0000 7f5ec660d640 1 -- 172.21.15.18:0/2885307547 wait complete. 2024-09-19T09:56:58.315 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:57 smithi018 ceph-mon[30956]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 503 MiB/s wr, 1.05k op/s 2024-09-19T09:56:58.315 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:57 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T09:56:58.315 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:57 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:58.315 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:57 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T09:56:58.315 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:57 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:58.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:56:58.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:57 smithi049 ceph-mon[34858]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 503 MiB/s wr, 1.05k op/s 2024-09-19T09:56:58.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:57 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T09:56:58.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:57 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:58.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:57 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T09:56:58.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:57 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:58.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:57 smithi162 ceph-mon[35174]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 503 MiB/s wr, 1.05k op/s 2024-09-19T09:56:58.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:57 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T09:56:58.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:57 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:58.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:57 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T09:56:58.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:57 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:56:58.612 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:56:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.050+0000 7ffb6a86b640 1 -- 172.21.15.18:0/821041666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb641002f0 msgr2=0x7ffb641006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.050+0000 7ffb6a86b640 1 --2- 172.21.15.18:0/821041666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb641002f0 0x7ffb641006d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009930 tx=0x7ffb5402a420 comp rx=0 tx=0).stop 2024-09-19T09:56:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.050+0000 7ffb6a86b640 1 -- 172.21.15.18:0/821041666 shutdown_connections 2024-09-19T09:56:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.051+0000 7ffb6a86b640 1 --2- 172.21.15.18:0/821041666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb64106f50 0x7ffb6410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.051+0000 7ffb6a86b640 1 --2- 172.21.15.18:0/821041666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb64100ca0 0x7ffb64106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.051+0000 7ffb6a86b640 1 --2- 172.21.15.18:0/821041666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb641002f0 0x7ffb641006d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.051+0000 7ffb6a86b640 1 -- 172.21.15.18:0/821041666 >> 172.21.15.18:0/821041666 conn(0x7ffb64077210 msgr2=0x7ffb640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.051+0000 7ffb6a86b640 1 -- 172.21.15.18:0/821041666 shutdown_connections 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.051+0000 7ffb6a86b640 1 -- 172.21.15.18:0/821041666 wait complete. 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.051+0000 7ffb6a86b640 1 Processor -- start 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.051+0000 7ffb6a86b640 1 -- start start 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb6a86b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb641002f0 0x7ffb6419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb6a86b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64100ca0 0x7ffb6419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb6a86b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb64106f50 0x7ffb6419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb6a86b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64111fa0 con 0x7ffb64100ca0 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb6a86b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64111e20 con 0x7ffb64106f50 2024-09-19T09:56:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb6a86b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64112120 con 0x7ffb641002f0 2024-09-19T09:56:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64100ca0 0x7ffb6419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64100ca0 0x7ffb6419ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49802/0 (socket says 172.21.15.18:49802) 2024-09-19T09:56:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb637fe640 1 -- 172.21.15.18:0/3006906207 learned_addr learned my addr 172.21.15.18:0/3006906207 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb63fff640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb641002f0 0x7ffb6419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb68e08640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb64106f50 0x7ffb6419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb637fe640 1 -- 172.21.15.18:0/3006906207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb641002f0 msgr2=0x7ffb6419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb637fe640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb641002f0 0x7ffb6419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb637fe640 1 -- 172.21.15.18:0/3006906207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb64106f50 msgr2=0x7ffb6419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:59.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb637fe640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb64106f50 0x7ffb6419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb637fe640 1 -- 172.21.15.18:0/3006906207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6419f5f0 con 0x7ffb64100ca0 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb68e08640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb64106f50 0x7ffb6419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.052+0000 7ffb637fe640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64100ca0 0x7ffb6419ab80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00c970 tx=0x7ffb4c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.053+0000 7ffb617fa640 1 -- 172.21.15.18:0/3006906207 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c014070 con 0x7ffb64100ca0 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.053+0000 7ffb6a86b640 1 -- 172.21.15.18:0/3006906207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6419f8e0 con 0x7ffb64100ca0 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.053+0000 7ffb617fa640 1 -- 172.21.15.18:0/3006906207 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb4c004440 con 0x7ffb64100ca0 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.053+0000 7ffb617fa640 1 -- 172.21.15.18:0/3006906207 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c00f450 con 0x7ffb64100ca0 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.053+0000 7ffb6a86b640 1 -- 172.21.15.18:0/3006906207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb641a71c0 con 0x7ffb64100ca0 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.055+0000 7ffb617fa640 1 -- 172.21.15.18:0/3006906207 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffb4c017070 con 0x7ffb64100ca0 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.055+0000 7ffb6cc44740 1 Processor -- start 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.055+0000 7ffb6cc44740 1 -- start start 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.055+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61ead4a0 0x564e61ead880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eaddc0 0x564e61eb8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564e61e132e0 con 0x564e61eb8680 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564e61dbace0 con 0x564e61eaddc0 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564e61e0f2a0 con 0x564e61ead4a0 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb68e08640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61ead4a0 0x564e61ead880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb68e08640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61ead4a0 0x564e61ead880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33092/0 (socket says 172.21.15.18:33092) 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb68e08640 1 -- 172.21.15.18:0/4093323479 learned_addr learned my addr 172.21.15.18:0/4093323479 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb617fa640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb500a3240 0x7ffb500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb63fff640 1 --2- 172.21.15.18:0/4093323479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eaddc0 0x564e61eb8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb68e08640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb500a3240 0x7ffb500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb617fa640 1 -- 172.21.15.18:0/3006906207 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ffb4c0cf780 con 0x7ffb64100ca0 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb637fe640 1 -- 172.21.15.18:0/4093323479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61ead4a0 msgr2=0x564e61ead880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb637fe640 1 --2- 172.21.15.18:0/4093323479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61ead4a0 0x564e61ead880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb637fe640 1 -- 172.21.15.18:0/4093323479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eaddc0 msgr2=0x564e61eb8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb637fe640 1 --2- 172.21.15.18:0/4093323479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eaddc0 0x564e61eb8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb637fe640 1 -- 172.21.15.18:0/4093323479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e61d9f440 con 0x564e61eb8680 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.056+0000 7ffb637fe640 1 --2- 172.21.15.18:0/4093323479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebaa70 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c09ba70 tx=0x7ffb4c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57e0ab8f5ee8bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb5a7fc640 1 -- 172.21.15.18:0/4093323479 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c09c470 con 0x564e61eb8680 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb68e08640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb500a3240 0x7ffb500a5700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009fd0 tx=0x7ffb5c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb5a7fc640 1 -- 172.21.15.18:0/4093323479 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb4c09bd70 con 0x564e61eb8680 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb5a7fc640 1 -- 172.21.15.18:0/4093323479 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c09b1c0 con 0x564e61eb8680 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4093323479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 msgr2=0x564e61ebaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/4093323479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebaa70 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c09ba70 tx=0x7ffb4c007f60 comp rx=0 tx=0).stop 2024-09-19T09:56:59.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4093323479 shutdown_connections 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/4093323479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebaa70 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/4093323479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eaddc0 0x564e61eb8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/4093323479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61ead4a0 0x564e61ead880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4093323479 >> 172.21.15.18:0/4093323479 conn(0x564e61ea9a30 msgr2=0x564e61ea9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4093323479 shutdown_connections 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.057+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4093323479 wait complete. 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.058+0000 7ffb6cc44740 1 -- start start 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.058+0000 7ffb6cc44740 1 Processor -- start 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.058+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61ead4a0 0x564e61eb8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.058+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 0x564e61eb52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.058+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eb8680 0x564e61eb5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.058+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564e61ebb250 con 0x564e61ead4a0 2024-09-19T09:56:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.058+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564e61dce050 con 0x564e61eb8680 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.058+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564e61ebb3d0 con 0x564e61eaddc0 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.058+0000 7ffb63fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61ead4a0 0x564e61eb8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb637fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 0x564e61eb52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb63fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61ead4a0 0x564e61eb8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49822/0 (socket says 172.21.15.18:49822) 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb63fff640 1 -- 172.21.15.18:0/2000323822 learned_addr learned my addr 172.21.15.18:0/2000323822 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb6cc44740 10 client.0 _ll_register_callbacks cb 0x564e61e0e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb637fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 0x564e61eb52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33104/0 (socket says 172.21.15.18:33104) 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb68e08640 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eb8680 0x564e61eb5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb63fff640 1 -- 172.21.15.18:0/2000323822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 msgr2=0x564e61eb52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb63fff640 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 0x564e61eb52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb63fff640 1 -- 172.21.15.18:0/2000323822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eb8680 msgr2=0x564e61eb5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb63fff640 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eb8680 0x564e61eb5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb63fff640 1 -- 172.21.15.18:0/2000323822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e61b843c0 con 0x564e61ead4a0 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb68e08640 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eb8680 0x564e61eb5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb637fe640 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 0x564e61eb52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb63fff640 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61ead4a0 0x564e61eb8030 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ffb54000c00 tx=0x7ffb540319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432f1d41879844f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb437fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb437fe640 1 -- 172.21.15.18:0/2000323822 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54035040 con 0x564e61ead4a0 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb437fe640 1 -- 172.21.15.18:0/2000323822 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ffb54004300 con 0x564e61ead4a0 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.059+0000 7ffb6cc44740 1 -- 172.21.15.18:0/2000323822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb4c09bd70 con 0x564e61ead4a0 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb437fe640 1 -- 172.21.15.18:0/2000323822 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb5404d070 con 0x564e61ead4a0 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb6cc44740 10 client.16668 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb6cc44740 1 -- 172.21.15.18:0/2000323822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564e61ec6c60 con 0x564e61ead4a0 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb437fe640 1 -- 172.21.15.18:0/2000323822 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb4c09bd70 con 0x564e61ead4a0 2024-09-19T09:56:59.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb437fe640 1 -- 172.21.15.18:0/2000323822 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb54004cc0 con 0x564e61ead4a0 2024-09-19T09:56:59.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb6cc44740 10 client.16668 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:59.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb6cc44740 10 client.16668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:59.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb6cc44740 20 client.16668 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:59.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564e61ec8120 0x564e61eca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb6cc44740 4 client.16668 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:56:59.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.060+0000 7ffb6cc44740 1 -- 172.21.15.18:0/2000323822 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e61e20850 con 0x564e61ec8120 2024-09-19T09:56:59.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.061+0000 7ffb637fe640 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564e61ec8120 0x564e61eca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.061+0000 7ffb437fe640 10 client.16668 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:59.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.061+0000 7ffb637fe640 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564e61ec8120 0x564e61eca510 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3c8a01921eede6c server_cookie=ef88261e68e06827 in_seq=0 out_seq=0 2024-09-19T09:56:59.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb437fe640 1 -- 172.21.15.18:0/2000323822 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e61e20850 con 0x564e61ec8120 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb437fe640 10 client.16668 handle_command_reply: tid=0 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 client.16668 shutdown 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 -- 172.21.15.18:0/2000323822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61ead4a0 msgr2=0x564e61eb8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61ead4a0 0x564e61eb8030 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ffb54000c00 tx=0x7ffb540319b0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 -- 172.21.15.18:0/2000323822 shutdown_connections 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564e61ec8120 0x564e61eca510 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61eb8680 0x564e61eb5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 0x564e61eb52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/2000323822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61ead4a0 0x564e61eb8030 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 -- 172.21.15.18:0/2000323822 >> 172.21.15.18:0/2000323822 conn(0x564e61ea9a30 msgr2=0x564e61eaf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb437fe640 0 client.16668 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 -- 172.21.15.18:0/2000323822 shutdown_connections 2024-09-19T09:56:59.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 1 -- 172.21.15.18:0/2000323822 wait complete. 2024-09-19T09:56:59.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.062+0000 7ffb6cc44740 20 client.16668 trim_cache size 0 max 16384 2024-09-19T09:56:59.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.079+0000 7ffb6cc44740 1 Processor -- start 2024-09-19T09:56:59.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.079+0000 7ffb6cc44740 1 -- start start 2024-09-19T09:56:59.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 0x564e61ec44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eaddc0 0x564e61ecfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eb8680 0x564e61ed0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb641af750 con 0x564e61eaddc0 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffb641b1290 con 0x564e61ead4a0 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb641afe20 con 0x564e61eb8680 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eaddc0 0x564e61ecfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eaddc0 0x564e61ecfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49830/0 (socket says 172.21.15.18:49830) 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb637fe640 1 -- 172.21.15.18:0/1256671283 learned_addr learned my addr 172.21.15.18:0/1256671283 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb68e08640 1 --2- 172.21.15.18:0/1256671283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eb8680 0x564e61ed0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb63fff640 1 --2- 172.21.15.18:0/1256671283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 0x564e61ec44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb637fe640 1 -- 172.21.15.18:0/1256671283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eb8680 msgr2=0x564e61ed0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb637fe640 1 --2- 172.21.15.18:0/1256671283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eb8680 0x564e61ed0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb637fe640 1 -- 172.21.15.18:0/1256671283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 msgr2=0x564e61ec44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:59.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb637fe640 1 --2- 172.21.15.18:0/1256671283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 0x564e61ec44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb637fe640 1 -- 172.21.15.18:0/1256671283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e61eb4290 con 0x564e61eaddc0 2024-09-19T09:56:59.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb637fe640 1 --2- 172.21.15.18:0/1256671283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eaddc0 0x564e61ecfdc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c09a020 tx=0x7ffb4c0d5260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e77744a4f0c1ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:59.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.080+0000 7ffb59ffb640 1 -- 172.21.15.18:0/1256671283 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0d5020 con 0x564e61eaddc0 2024-09-19T09:56:59.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb59ffb640 1 -- 172.21.15.18:0/1256671283 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb4c0a49e0 con 0x564e61eaddc0 2024-09-19T09:56:59.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb59ffb640 1 -- 172.21.15.18:0/1256671283 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0b8070 con 0x564e61eaddc0 2024-09-19T09:56:59.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb6cc44740 1 -- 172.21.15.18:0/1256671283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eaddc0 msgr2=0x564e61ecfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/1256671283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eaddc0 0x564e61ecfdc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c09a020 tx=0x7ffb4c0d5260 comp rx=0 tx=0).stop 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb6cc44740 1 -- 172.21.15.18:0/1256671283 shutdown_connections 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/1256671283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eb8680 0x564e61ed0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/1256671283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eaddc0 0x564e61ecfdc0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/1256671283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 0x564e61ec44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb6cc44740 1 -- 172.21.15.18:0/1256671283 >> 172.21.15.18:0/1256671283 conn(0x564e61ea9a30 msgr2=0x564e61eb08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb6cc44740 1 -- 172.21.15.18:0/1256671283 shutdown_connections 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.081+0000 7ffb6cc44740 1 -- 172.21.15.18:0/1256671283 wait complete. 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb6cc44740 1 -- start start 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb6cc44740 1 Processor -- start 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 0x564e61ec0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 0x564e61ebc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb6cc44740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb641b0bc0 con 0x564e61eb8680 2024-09-19T09:56:59.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffb641b04f0 con 0x564e61ead4a0 2024-09-19T09:56:59.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb6cc44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb641ad730 con 0x564e61eaddc0 2024-09-19T09:56:59.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb6cc44740 10 client.0 _ll_register_callbacks cb 0x7ffb54009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:56:59.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb68e08640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb68e08640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49842/0 (socket says 172.21.15.18:49842) 2024-09-19T09:56:59.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb68e08640 1 -- 172.21.15.18:0/4045886867 learned_addr learned my addr 172.21.15.18:0/4045886867 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb63fff640 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 0x564e61ec0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.082+0000 7ffb637fe640 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 0x564e61ebc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb68e08640 1 -- 172.21.15.18:0/4045886867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 msgr2=0x564e61ebc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb68e08640 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 0x564e61ebc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb68e08640 1 -- 172.21.15.18:0/4045886867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 msgr2=0x564e61ec0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb68e08640 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 0x564e61ec0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb68e08640 1 -- 172.21.15.18:0/4045886867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e61eb5bf0 con 0x564e61eb8680 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb63fff640 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 0x564e61ec0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb68e08640 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebc5b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c012010 tx=0x7ffb5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a453f84278596d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb437fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb437fe640 1 -- 172.21.15.18:0/4045886867 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c02f060 con 0x564e61eb8680 2024-09-19T09:56:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb437fe640 1 -- 172.21.15.18:0/4045886867 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ffb5c01d410 con 0x564e61eb8680 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4045886867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb4c0a49e0 con 0x564e61eb8680 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb437fe640 1 -- 172.21.15.18:0/4045886867 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb5c01d610 con 0x564e61eb8680 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb6cc44740 10 client.16674 fetch_fsmap learned FSMap version 28 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.083+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4045886867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564e61f32c00 con 0x564e61eb8680 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.084+0000 7ffb437fe640 1 -- 172.21.15.18:0/4045886867 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb4c0a49e0 con 0x564e61eb8680 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.084+0000 7ffb437fe640 1 -- 172.21.15.18:0/4045886867 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb5c029030 con 0x564e61eb8680 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.084+0000 7ffb6cc44740 10 client.16674 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.084+0000 7ffb6cc44740 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.084+0000 7ffb6cc44740 20 client.16674 populate_metadata read hostname 'smithi018' 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.084+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564e61f33380 0x564e61f357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.084+0000 7ffb6cc44740 4 client.16674 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.084+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4045886867 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564e61e1ad60 con 0x564e61f33380 2024-09-19T09:56:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.084+0000 7ffb63fff640 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564e61f33380 0x564e61f357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb63fff640 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564e61f33380 0x564e61f357a0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a2c1e1aa429e7e6 server_cookie=7cc2593883d77c0c in_seq=0 out_seq=0 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb437fe640 10 client.16674 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb437fe640 1 -- 172.21.15.18:0/4045886867 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564e61e1ad60 con 0x564e61f33380 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb437fe640 10 client.16674 handle_command_reply: tid=0 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 client.16674 shutdown 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4045886867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 msgr2=0x564e61ebc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebc5b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c012010 tx=0x7ffb5c004a40 comp rx=0 tx=0).stop 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4045886867 shutdown_connections 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564e61f33380 0x564e61f357a0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e61eb8680 0x564e61ebc5b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e61eaddc0 0x564e61ebc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 --2- 172.21.15.18:0/4045886867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e61ead4a0 0x564e61ec0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb437fe640 0 client.16674 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:56:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4045886867 >> 172.21.15.18:0/4045886867 conn(0x564e61ea9a30 msgr2=0x564e61eaff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4045886867 shutdown_connections 2024-09-19T09:56:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 1 -- 172.21.15.18:0/4045886867 wait complete. 2024-09-19T09:56:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.085+0000 7ffb6cc44740 20 client.16674 trim_cache size 0 max 16384 2024-09-19T09:56:59.093 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:56:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:56:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T09:56:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "11758f8a-fafe-46db-b16b-9a7128465fa4": { 2024-09-19T09:56:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T09:56:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "11758f8a-fafe-46db-b16b-9a7128465fa4", 2024-09-19T09:56:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T09:56:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:56:59.094 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:56:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 -- 172.21.15.18:0/3006906207 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb500a3240 msgr2=0x7ffb500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb500a3240 0x7ffb500a5700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009fd0 tx=0x7ffb5c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 -- 172.21.15.18:0/3006906207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64100ca0 msgr2=0x7ffb6419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:56:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64100ca0 0x7ffb6419ab80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00c970 tx=0x7ffb4c00ce30 comp rx=0 tx=0).stop 2024-09-19T09:56:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 -- 172.21.15.18:0/3006906207 shutdown_connections 2024-09-19T09:56:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ffb500a3240 0x7ffb500a5700 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb64106f50 0x7ffb6419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64100ca0 0x7ffb6419ab80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 --2- 172.21.15.18:0/3006906207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb641002f0 0x7ffb6419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:56:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 -- 172.21.15.18:0/3006906207 >> 172.21.15.18:0/3006906207 conn(0x7ffb64077210 msgr2=0x7ffb641056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:56:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 -- 172.21.15.18:0/3006906207 shutdown_connections 2024-09-19T09:56:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:56:59.086+0000 7ffb6a86b640 1 -- 172.21.15.18:0/3006906207 wait complete. 2024-09-19T09:56:59.752 INFO:tasks.cephfs.filesystem:scrub status for tag:11758f8a-fafe-46db-b16b-9a7128465fa4 - {'path': '/', 'tag': '11758f8a-fafe-46db-b16b-9a7128465fa4', 'options': 'recursive,force'} 2024-09-19T09:57:00.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:59 smithi018 ceph-mon[30956]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 375 MiB/s wr, 919 op/s 2024-09-19T09:57:00.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:56:59 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T09:57:00.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:59 smithi049 ceph-mon[34858]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 375 MiB/s wr, 919 op/s 2024-09-19T09:57:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:56:59 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T09:57:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:59 smithi162 ceph-mon[35174]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 375 MiB/s wr, 919 op/s 2024-09-19T09:57:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:56:59 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T09:57:02.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:02 smithi018 ceph-mon[30956]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 1007 KiB/s rd, 304 MiB/s wr, 825 op/s 2024-09-19T09:57:02.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:02 smithi049 ceph-mon[34858]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 1007 KiB/s rd, 304 MiB/s wr, 825 op/s 2024-09-19T09:57:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:02 smithi162 ceph-mon[35174]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 1007 KiB/s rd, 304 MiB/s wr, 825 op/s 2024-09-19T09:57:04.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:04 smithi018 ceph-mon[30956]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 789 KiB/s rd, 186 MiB/s wr, 499 op/s 2024-09-19T09:57:04.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:04 smithi049 ceph-mon[34858]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 789 KiB/s rd, 186 MiB/s wr, 499 op/s 2024-09-19T09:57:04.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:04 smithi162 ceph-mon[35174]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 789 KiB/s rd, 186 MiB/s wr, 499 op/s 2024-09-19T09:57:06.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:06 smithi018 ceph-mon[30956]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 448 KiB/s rd, 82 MiB/s wr, 143 op/s 2024-09-19T09:57:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:06 smithi049 ceph-mon[34858]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 448 KiB/s rd, 82 MiB/s wr, 143 op/s 2024-09-19T09:57:06.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:06 smithi162 ceph-mon[35174]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 448 KiB/s rd, 82 MiB/s wr, 143 op/s 2024-09-19T09:57:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.518+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2676264190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc01056b0 msgr2=0x7fbfc0105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.518+0000 7fbfc4ddf640 1 --2- 172.21.15.18:0/2676264190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc01056b0 0x7fbfc0105b60 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009ca0 tx=0x7fbfb802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.518+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2676264190 shutdown_connections 2024-09-19T09:57:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.518+0000 7fbfc4ddf640 1 --2- 172.21.15.18:0/2676264190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc01056b0 0x7fbfc0105b60 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.518+0000 7fbfc4ddf640 1 --2- 172.21.15.18:0/2676264190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc0102d00 0x7fbfc0105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.518+0000 7fbfc4ddf640 1 --2- 172.21.15.18:0/2676264190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfc01003b0 0x7fbfc01027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.518+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2676264190 >> 172.21.15.18:0/2676264190 conn(0x7fbfc00fc1e0 msgr2=0x7fbfc00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.518+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2676264190 shutdown_connections 2024-09-19T09:57:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.518+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2676264190 wait complete. 2024-09-19T09:57:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfc4ddf640 1 Processor -- start 2024-09-19T09:57:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfc4ddf640 1 -- start start 2024-09-19T09:57:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfc4ddf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc01003b0 0x7fbfc019e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfc4ddf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc0102d00 0x7fbfc019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfc4ddf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfc01056b0 0x7fbfc01a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfc4ddf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0113e40 con 0x7fbfc01003b0 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfc4ddf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0113cc0 con 0x7fbfc01056b0 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfc4ddf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0113fc0 con 0x7fbfc0102d00 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfbe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc01003b0 0x7fbfc019e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfbe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc01003b0 0x7fbfc019e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35242/0 (socket says 172.21.15.18:35242) 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfbe59c640 1 -- 172.21.15.18:0/2362034874 learned_addr learned my addr 172.21.15.18:0/2362034874 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfbdd9b640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc0102d00 0x7fbfc019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfc01056b0 0x7fbfc01a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfbe59c640 1 -- 172.21.15.18:0/2362034874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc0102d00 msgr2=0x7fbfc019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc0102d00 0x7fbfc019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfbe59c640 1 -- 172.21.15.18:0/2362034874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfc01056b0 msgr2=0x7fbfc01a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfc01056b0 0x7fbfc01a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.519+0000 7fbfbe59c640 1 -- 172.21.15.18:0/2362034874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc01a5f70 con 0x7fbfc01003b0 2024-09-19T09:57:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.520+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc01003b0 0x7fbfc019e350 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000d950 tx=0x7fbfb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.520+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2362034874 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0017030 con 0x7fbfc01003b0 2024-09-19T09:57:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.520+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2362034874 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb0004020 con 0x7fbfc01003b0 2024-09-19T09:57:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.520+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2362034874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc01a6260 con 0x7fbfc01003b0 2024-09-19T09:57:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.520+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2362034874 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00047a0 con 0x7fbfc01003b0 2024-09-19T09:57:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.520+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2362034874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc01a67b0 con 0x7fbfc01003b0 2024-09-19T09:57:06.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.522+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2362034874 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbfb00041d0 con 0x7fbfc01003b0 2024-09-19T09:57:06.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.522+0000 7fbfc7c54740 1 Processor -- start 2024-09-19T09:57:06.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfc7c54740 1 -- start start 2024-09-19T09:57:06.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a81fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a824da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a825370 0x55809a827830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55809a7832f0 con 0x55809a8202e0 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55809a72b270 con 0x55809a81f9a0 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55809a77f2b0 con 0x55809a825370 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a824da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a824da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35250/0 (socket says 172.21.15.18:35250) 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a81fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbe59c640 1 -- 172.21.15.18:0/394713604 learned_addr learned my addr 172.21.15.18:0/394713604 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfaf7fe640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbfa80a32f0 0x7fbfa80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbdd9b640 1 --2- 172.21.15.18:0/394713604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a825370 0x55809a827830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbe59c640 1 -- 172.21.15.18:0/394713604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a825370 msgr2=0x55809a827830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/394713604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a825370 0x55809a827830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbe59c640 1 -- 172.21.15.18:0/394713604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 msgr2=0x55809a81fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/394713604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a81fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbe59c640 1 -- 172.21.15.18:0/394713604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55809a72a340 con 0x55809a8202e0 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/394713604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a81fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.523+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbfa80a32f0 0x7fbfa80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.524+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2362034874 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbfb00cf300 con 0x7fbfc01003b0 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.524+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/394713604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a824da0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbfb004da30 tx=0x7fbfb005b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58331b61a5f47fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.524+0000 7fbfacff9640 1 -- 172.21.15.18:0/394713604 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb009b6c0 con 0x55809a8202e0 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.524+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbfa80a32f0 0x7fbfa80a57b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8005e30 tx=0x7fbfb80095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.524+0000 7fbfacff9640 1 -- 172.21.15.18:0/394713604 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb004d870 con 0x55809a8202e0 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.524+0000 7fbfacff9640 1 -- 172.21.15.18:0/394713604 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb009b250 con 0x55809a8202e0 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 -- 172.21.15.18:0/394713604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 msgr2=0x55809a824da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/394713604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a824da0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbfb004da30 tx=0x7fbfb005b7d0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 -- 172.21.15.18:0/394713604 shutdown_connections 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/394713604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a825370 0x55809a827830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/394713604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a824da0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/394713604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a81fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 -- 172.21.15.18:0/394713604 >> 172.21.15.18:0/394713604 conn(0x55809a81b010 msgr2=0x55809a81b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 -- 172.21.15.18:0/394713604 shutdown_connections 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 -- 172.21.15.18:0/394713604 wait complete. 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 -- start start 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 Processor -- start 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a829b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a8202e0 0x55809a82a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a831090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55809a8282e0 con 0x55809a825370 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55809a70c290 con 0x55809a81f9a0 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55809a828460 con 0x55809a8202e0 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.525+0000 7fbfc7c54740 10 client.0 _ll_register_callbacks cb 0x55809a73d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a831090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a831090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35260/0 (socket says 172.21.15.18:35260) 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbed9d640 1 -- 172.21.15.18:0/364164767 learned_addr learned my addr 172.21.15.18:0/364164767 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a829b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbdd9b640 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a8202e0 0x55809a82a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbed9d640 1 -- 172.21.15.18:0/364164767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a8202e0 msgr2=0x55809a82a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a8202e0 0x55809a82a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbed9d640 1 -- 172.21.15.18:0/364164767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 msgr2=0x55809a829b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a829b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbed9d640 1 -- 172.21.15.18:0/364164767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55809a496210 con 0x55809a825370 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a829b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a831090 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009ca0 tx=0x7fbfb802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4fe76cc88710c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfa5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/364164767 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8003c40 con 0x55809a825370 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/364164767 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbfb8003de0 con 0x55809a825370 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfc7c54740 1 -- 172.21.15.18:0/364164767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55809a790a20 con 0x55809a825370 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/364164767 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbfb802f6d0 con 0x55809a825370 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfc7c54740 10 client.16686 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.526+0000 7fbfc7c54740 1 -- 172.21.15.18:0/364164767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55809a562620 con 0x55809a825370 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/364164767 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55809a790a20 con 0x55809a825370 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/364164767 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbfb8004650 con 0x55809a825370 2024-09-19T09:57:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfc7c54740 10 client.16686 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfc7c54740 10 client.16686 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfc7c54740 20 client.16686 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55809a8357a0 0x55809a837bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfc7c54740 4 client.16686 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfc7c54740 1 -- 172.21.15.18:0/364164767 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55809a78ad70 con 0x55809a8357a0 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55809a8357a0 0x55809a837bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55809a8357a0 0x55809a837bf0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30f1a894cf1faf93 server_cookie=5c23104113759c8b in_seq=0 out_seq=0 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.527+0000 7fbfa5ffb640 10 client.16686 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/364164767 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55809a78ad70 con 0x55809a8357a0 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfa5ffb640 10 client.16686 handle_command_reply: tid=0 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 client.16686 shutdown 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 -- 172.21.15.18:0/364164767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 msgr2=0x55809a831090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a831090 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009ca0 tx=0x7fbfb802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 -- 172.21.15.18:0/364164767 shutdown_connections 2024-09-19T09:57:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55809a8357a0 0x55809a837bf0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a831090 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a8202e0 0x55809a82a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfa5ffb640 0 client.16686 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/364164767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a829b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 -- 172.21.15.18:0/364164767 >> 172.21.15.18:0/364164767 conn(0x55809a81b010 msgr2=0x55809a81c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 -- 172.21.15.18:0/364164767 shutdown_connections 2024-09-19T09:57:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 1 -- 172.21.15.18:0/364164767 wait complete. 2024-09-19T09:57:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.528+0000 7fbfc7c54740 20 client.16686 trim_cache size 0 max 16384 2024-09-19T09:57:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfc7c54740 1 Processor -- start 2024-09-19T09:57:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfc7c54740 1 -- start start 2024-09-19T09:57:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a81fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a8202e0 0x55809a831050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a824ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01af550 con 0x55809a825370 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01b1090 con 0x55809a81f9a0 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01afc20 con 0x55809a8202e0 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a824ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a824ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35276/0 (socket says 172.21.15.18:35276) 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbed9d640 1 -- 172.21.15.18:0/2887654807 learned_addr learned my addr 172.21.15.18:0/2887654807 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbdd9b640 1 --2- 172.21.15.18:0/2887654807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a8202e0 0x55809a831050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/2887654807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a81fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbed9d640 1 -- 172.21.15.18:0/2887654807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a8202e0 msgr2=0x55809a831050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/2887654807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a8202e0 0x55809a831050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbed9d640 1 -- 172.21.15.18:0/2887654807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 msgr2=0x55809a81fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/2887654807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a81fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbed9d640 1 -- 172.21.15.18:0/2887654807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55809a81ae30 con 0x55809a825370 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/2887654807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a81fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.543+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/2887654807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a824ab0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbfb802ade0 tx=0x7fbfb8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b29ab434cbd115 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfa7fff640 1 -- 172.21.15.18:0/2887654807 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8061030 con 0x55809a825370 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfa7fff640 1 -- 172.21.15.18:0/2887654807 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb8036040 con 0x55809a825370 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfa7fff640 1 -- 172.21.15.18:0/2887654807 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8030880 con 0x55809a825370 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfc7c54740 1 -- 172.21.15.18:0/2887654807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 msgr2=0x55809a824ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/2887654807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a824ab0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbfb802ade0 tx=0x7fbfb8009360 comp rx=0 tx=0).stop 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfc7c54740 1 -- 172.21.15.18:0/2887654807 shutdown_connections 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/2887654807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a825370 0x55809a824ab0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/2887654807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a8202e0 0x55809a831050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/2887654807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a81f9a0 0x55809a81fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfc7c54740 1 -- 172.21.15.18:0/2887654807 >> 172.21.15.18:0/2887654807 conn(0x55809a81b010 msgr2=0x55809a829b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfc7c54740 1 -- 172.21.15.18:0/2887654807 shutdown_connections 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfc7c54740 1 -- 172.21.15.18:0/2887654807 wait complete. 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.544+0000 7fbfc7c54740 1 -- start start 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfc7c54740 1 Processor -- start 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a81f9a0 0x55809a831060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a82dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfc7c54740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a825370 0x55809a82e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01b09c0 con 0x55809a8202e0 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01b02f0 con 0x55809a825370 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfc7c54740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01ad530 con 0x55809a81f9a0 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfc7c54740 10 client.0 _ll_register_callbacks cb 0x7fbfb8031980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a82dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a82dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35284/0 (socket says 172.21.15.18:35284) 2024-09-19T09:57:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbdd9b640 1 -- 172.21.15.18:0/3788177537 learned_addr learned my addr 172.21.15.18:0/3788177537 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a81f9a0 0x55809a831060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbed9d640 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a825370 0x55809a82e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbdd9b640 1 -- 172.21.15.18:0/3788177537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a81f9a0 msgr2=0x55809a831060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbdd9b640 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a81f9a0 0x55809a831060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbdd9b640 1 -- 172.21.15.18:0/3788177537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a825370 msgr2=0x55809a82e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbdd9b640 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a825370 0x55809a82e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbdd9b640 1 -- 172.21.15.18:0/3788177537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55809a89e590 con 0x55809a8202e0 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfbdd9b640 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a82dbc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009fd0 tx=0x7fbfb4012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bc257c57950bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.545+0000 7fbfa5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/3788177537 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4023060 con 0x55809a8202e0 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/3788177537 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbfb4004250 con 0x55809a8202e0 2024-09-19T09:57:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfc7c54740 1 -- 172.21.15.18:0/3788177537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfb8036040 con 0x55809a8202e0 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/3788177537 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbfb4004450 con 0x55809a8202e0 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfc7c54740 10 client.16692 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfc7c54740 1 -- 172.21.15.18:0/3788177537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55809a89f910 con 0x55809a8202e0 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/3788177537 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb8036040 con 0x55809a8202e0 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/3788177537 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbfb4010430 con 0x55809a8202e0 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfc7c54740 10 client.16692 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfc7c54740 10 client.16692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfc7c54740 20 client.16692 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55809a8a0320 0x55809a8a2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfc7c54740 4 client.16692 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfc7c54740 1 -- 172.21.15.18:0/3788177537 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55809a707900 con 0x55809a8a0320 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.546+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55809a8a0320 0x55809a8a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.547+0000 7fbfbe59c640 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55809a8a0320 0x55809a8a2740 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c96ed099eee18e0 server_cookie=1e8525f674ea7db6 in_seq=0 out_seq=0 2024-09-19T09:57:06.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.547+0000 7fbfa5ffb640 10 client.16692 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfa5ffb640 1 -- 172.21.15.18:0/3788177537 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55809a707900 con 0x55809a8a0320 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfa5ffb640 10 client.16692 handle_command_reply: tid=0 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 client.16692 shutdown 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 -- 172.21.15.18:0/3788177537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 msgr2=0x55809a82dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a82dbc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009fd0 tx=0x7fbfb4012b60 comp rx=0 tx=0).stop 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 -- 172.21.15.18:0/3788177537 shutdown_connections 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55809a8a0320 0x55809a8a2740 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55809a825370 0x55809a82e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55809a8202e0 0x55809a82dbc0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 --2- 172.21.15.18:0/3788177537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55809a81f9a0 0x55809a831060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfa5ffb640 0 client.16692 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 -- 172.21.15.18:0/3788177537 >> 172.21.15.18:0/3788177537 conn(0x55809a81b010 msgr2=0x55809a829ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 -- 172.21.15.18:0/3788177537 shutdown_connections 2024-09-19T09:57:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.556+0000 7fbfc7c54740 1 -- 172.21.15.18:0/3788177537 wait complete. 2024-09-19T09:57:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc7c54740 20 client.16692 trim_cache size 0 max 16384 2024-09-19T09:57:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:57:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:57:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:57:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2362034874 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbfa80a32f0 msgr2=0x7fbfa80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbfa80a32f0 0x7fbfa80a57b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8005e30 tx=0x7fbfb80095c0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2362034874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc01003b0 msgr2=0x7fbfc019e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc01003b0 0x7fbfc019e350 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000d950 tx=0x7fbfb000de10 comp rx=0 tx=0).stop 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2362034874 shutdown_connections 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbfa80a32f0 0x7fbfa80a57b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfc01056b0 0x7fbfc01a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfc0102d00 0x7fbfc019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 --2- 172.21.15.18:0/2362034874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfc01003b0 0x7fbfc019e350 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2362034874 >> 172.21.15.18:0/2362034874 conn(0x7fbfc00fc1e0 msgr2=0x7fbfc0103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2362034874 shutdown_connections 2024-09-19T09:57:06.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:06.557+0000 7fbfc4ddf640 1 -- 172.21.15.18:0/2362034874 wait complete. 2024-09-19T09:57:08.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:08 smithi018 ceph-mon[30956]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 71 MiB/s wr, 131 op/s 2024-09-19T09:57:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:08 smithi049 ceph-mon[34858]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 71 MiB/s wr, 131 op/s 2024-09-19T09:57:08.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:08 smithi162 ceph-mon[35174]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 71 MiB/s wr, 131 op/s 2024-09-19T09:57:10.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:10 smithi018 ceph-mon[30956]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 67 MiB/s wr, 127 op/s 2024-09-19T09:57:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:10 smithi049 ceph-mon[34858]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 67 MiB/s wr, 127 op/s 2024-09-19T09:57:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:10 smithi162 ceph-mon[35174]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 67 MiB/s wr, 127 op/s 2024-09-19T09:57:10.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:57:11.065 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:11.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.724+0000 7fde8a883640 1 -- 172.21.15.18:0/3623784552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde84100a80 msgr2=0x7fde84100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.724+0000 7fde8a883640 1 --2- 172.21.15.18:0/3623784552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde84100a80 0x7fde84100ee0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fde78009930 tx=0x7fde7802a420 comp rx=0 tx=0).stop 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.724+0000 7fde8a883640 1 -- 172.21.15.18:0/3623784552 shutdown_connections 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.724+0000 7fde8a883640 1 --2- 172.21.15.18:0/3623784552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84101420 0x7fde8410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.724+0000 7fde8a883640 1 --2- 172.21.15.18:0/3623784552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde84100a80 0x7fde84100ee0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.724+0000 7fde8a883640 1 --2- 172.21.15.18:0/3623784552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde84106a80 0x7fde84106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.724+0000 7fde8a883640 1 -- 172.21.15.18:0/3623784552 >> 172.21.15.18:0/3623784552 conn(0x7fde840fc7a0 msgr2=0x7fde840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.724+0000 7fde8a883640 1 -- 172.21.15.18:0/3623784552 shutdown_connections 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.724+0000 7fde8a883640 1 -- 172.21.15.18:0/3623784552 wait complete. 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.725+0000 7fde8a883640 1 Processor -- start 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.725+0000 7fde8a883640 1 -- start start 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde8a883640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde84100a80 0x7fde84197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde8a883640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde84101420 0x7fde84197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde8a883640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84106a80 0x7fde8419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde8a883640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fde84110e80 con 0x7fde84101420 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde8a883640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fde84110d00 con 0x7fde84106a80 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde8a883640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde84111000 con 0x7fde84100a80 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde84101420 0x7fde84197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde84101420 0x7fde84197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35296/0 (socket says 172.21.15.18:35296) 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde837fe640 1 -- 172.21.15.18:0/3629476903 learned_addr learned my addr 172.21.15.18:0/3629476903 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde83fff640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde84100a80 0x7fde84197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde88e20640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84106a80 0x7fde8419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde837fe640 1 -- 172.21.15.18:0/3629476903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde84100a80 msgr2=0x7fde84197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde837fe640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde84100a80 0x7fde84197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde837fe640 1 -- 172.21.15.18:0/3629476903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84106a80 msgr2=0x7fde8419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde837fe640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84106a80 0x7fde8419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde837fe640 1 -- 172.21.15.18:0/3629476903 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8419c2b0 con 0x7fde84101420 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde88e20640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84106a80 0x7fde8419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde837fe640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde84101420 0x7fde84197840 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fde78009230 tx=0x7fde78004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.726+0000 7fde817fa640 1 -- 172.21.15.18:0/3629476903 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7803f030 con 0x7fde84101420 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.727+0000 7fde8a883640 1 -- 172.21.15.18:0/3629476903 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8419c540 con 0x7fde84101420 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.727+0000 7fde817fa640 1 -- 172.21.15.18:0/3629476903 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde78003ad0 con 0x7fde84101420 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.727+0000 7fde817fa640 1 -- 172.21.15.18:0/3629476903 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78035070 con 0x7fde84101420 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.727+0000 7fde8a883640 1 -- 172.21.15.18:0/3629476903 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde841a3e80 con 0x7fde84101420 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.728+0000 7fde8a883640 1 -- 172.21.15.18:0/3629476903 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde841021c0 con 0x7fde84101420 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.729+0000 7fde817fa640 1 -- 172.21.15.18:0/3629476903 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fde78042030 con 0x7fde84101420 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.729+0000 7fde817fa640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fde6c0a3240 0x7fde6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.729+0000 7fde83fff640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fde6c0a3240 0x7fde6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:11.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.729+0000 7fde817fa640 1 -- 172.21.15.18:0/3629476903 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fde780efe30 con 0x7fde84101420 2024-09-19T09:57:11.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.730+0000 7fde83fff640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fde6c0a3240 0x7fde6c0a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fde74005fd0 tx=0x7fde7400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:11.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.734+0000 7fde817fa640 1 -- 172.21.15.18:0/3629476903 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde780bcb20 con 0x7fde84101420 2024-09-19T09:57:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.948+0000 7fde8a883640 1 -- 172.21.15.18:0/3629476903 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde84108ff0 con 0x7fde84101420 2024-09-19T09:57:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.949+0000 7fde817fa640 1 -- 172.21.15.18:0/3629476903 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fde780bc420 con 0x7fde84101420 2024-09-19T09:57:11.952 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:57:11.953 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:57:11.953 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:57:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 -- 172.21.15.18:0/3629476903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fde6c0a3240 msgr2=0x7fde6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fde6c0a3240 0x7fde6c0a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fde74005fd0 tx=0x7fde7400b390 comp rx=0 tx=0).stop 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 -- 172.21.15.18:0/3629476903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde84101420 msgr2=0x7fde84197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde84101420 0x7fde84197840 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fde78009230 tx=0x7fde78004270 comp rx=0 tx=0).stop 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 -- 172.21.15.18:0/3629476903 shutdown_connections 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fde6c0a3240 0x7fde6c0a5700 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde84106a80 0x7fde8419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde84101420 0x7fde84197840 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 --2- 172.21.15.18:0/3629476903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde84100a80 0x7fde84197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 -- 172.21.15.18:0/3629476903 >> 172.21.15.18:0/3629476903 conn(0x7fde840fc7a0 msgr2=0x7fde840fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 -- 172.21.15.18:0/3629476903 shutdown_connections 2024-09-19T09:57:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:11.951+0000 7fde8a883640 1 -- 172.21.15.18:0/3629476903 wait complete. 2024-09-19T09:57:12.364 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:12 smithi018 ceph-mon[30956]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 72 MiB/s wr, 142 op/s 2024-09-19T09:57:12.364 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:12 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3629476903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:12 smithi049 ceph-mon[34858]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 72 MiB/s wr, 142 op/s 2024-09-19T09:57:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:12 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3629476903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:12 smithi162 ceph-mon[35174]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 72 MiB/s wr, 142 op/s 2024-09-19T09:57:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:12 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3629476903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:12.750 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --set-id c7a0d0c3 --release --await' 2024-09-19T09:57:12.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --set-id c7a0d0c3 --release --await 2024-09-19T09:57:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:13.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.564+0000 7f535a28e640 1 -- 172.21.15.18:0/2871313466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5354101de0 msgr2=0x7f53541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:13.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.564+0000 7f535a28e640 1 --2- 172.21.15.18:0/2871313466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5354101de0 0x7f53541021c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5344009900 tx=0x7f534402a410 comp rx=0 tx=0).stop 2024-09-19T09:57:13.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.564+0000 7f535a28e640 1 -- 172.21.15.18:0/2871313466 shutdown_connections 2024-09-19T09:57:13.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.564+0000 7f535a28e640 1 --2- 172.21.15.18:0/2871313466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5354106f10 0x7f535410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.564+0000 7f535a28e640 1 --2- 172.21.15.18:0/2871313466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354102790 0x7f53541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.564+0000 7f535a28e640 1 --2- 172.21.15.18:0/2871313466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5354101de0 0x7f53541021c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.564+0000 7f535a28e640 1 -- 172.21.15.18:0/2871313466 >> 172.21.15.18:0/2871313466 conn(0x7f53540fd8c0 msgr2=0x7f53540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.564+0000 7f535a28e640 1 -- 172.21.15.18:0/2871313466 shutdown_connections 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.564+0000 7f535a28e640 1 -- 172.21.15.18:0/2871313466 wait complete. 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.565+0000 7f535a28e640 1 Processor -- start 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.565+0000 7f535a28e640 1 -- start start 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.565+0000 7f535a28e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5354101de0 0x7f53541983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.565+0000 7f535a28e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5354102790 0x7f5354198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.565+0000 7f535a28e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354106f10 0x7f535419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.565+0000 7f535a28e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5354111f70 con 0x7f5354101de0 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.565+0000 7f535a28e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5354111df0 con 0x7f5354106f10 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f535a28e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53541120f0 con 0x7f5354102790 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f5353fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5354101de0 0x7f53541983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f5353fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5354101de0 0x7f53541983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35320/0 (socket says 172.21.15.18:35320) 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f5353fff640 1 -- 172.21.15.18:0/2501261968 learned_addr learned my addr 172.21.15.18:0/2501261968 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:13.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f53537fe640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5354102790 0x7f5354198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f535882b640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354106f10 0x7f535419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f5353fff640 1 -- 172.21.15.18:0/2501261968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5354102790 msgr2=0x7f5354198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:13.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f5353fff640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5354102790 0x7f5354198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f5353fff640 1 -- 172.21.15.18:0/2501261968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354106f10 msgr2=0x7f535419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:13.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f5353fff640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354106f10 0x7f535419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f5353fff640 1 -- 172.21.15.18:0/2501261968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535419d3a0 con 0x7f5354101de0 2024-09-19T09:57:13.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.566+0000 7f5353fff640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5354101de0 0x7f53541983f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5344006010 tx=0x7f53440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:13.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.567+0000 7f53517fa640 1 -- 172.21.15.18:0/2501261968 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534403f030 con 0x7f5354101de0 2024-09-19T09:57:13.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.567+0000 7f53517fa640 1 -- 172.21.15.18:0/2501261968 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5344003ce0 con 0x7f5354101de0 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.567+0000 7f535a28e640 1 -- 172.21.15.18:0/2501261968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535419d630 con 0x7f5354101de0 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.567+0000 7f53517fa640 1 -- 172.21.15.18:0/2501261968 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344035070 con 0x7f5354101de0 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.567+0000 7f535a28e640 1 -- 172.21.15.18:0/2501261968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53541a4f70 con 0x7f5354101de0 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f53517fa640 1 -- 172.21.15.18:0/2501261968 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5344042030 con 0x7f5354101de0 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f535c667740 1 Processor -- start 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f535c667740 1 -- start start 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f535c667740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99060 0x55f2fac99440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f535c667740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fac99980 0x55f2faca3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f535c667740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2faca4240 0x55f2faca6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f535c667740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f2fabfe620 con 0x55f2fac99060 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f535c667740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f2faba5e50 con 0x55f2fac99980 2024-09-19T09:57:13.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f535c667740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f2fabfa5e0 con 0x55f2faca4240 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f53517fa640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53400a32c0 0x7f53400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f535882b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99060 0x55f2fac99440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.570+0000 7f535882b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99060 0x55f2fac99440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35332/0 (socket says 172.21.15.18:35332) 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f535882b640 1 -- 172.21.15.18:0/3154315434 learned_addr learned my addr 172.21.15.18:0/3154315434 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f5353fff640 1 --2- 172.21.15.18:0/3154315434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fac99980 0x55f2faca3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f535882b640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53400a32c0 0x7f53400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f53517fa640 1 -- 172.21.15.18:0/2501261968 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f53440efa50 con 0x7f5354101de0 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f53537fe640 1 --2- 172.21.15.18:0/3154315434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2faca4240 0x55f2faca6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f535882b640 1 -- 172.21.15.18:0/3154315434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2faca4240 msgr2=0x55f2faca6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f535882b640 1 --2- 172.21.15.18:0/3154315434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2faca4240 0x55f2faca6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f535882b640 1 -- 172.21.15.18:0/3154315434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fac99980 msgr2=0x55f2faca3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f535882b640 1 --2- 172.21.15.18:0/3154315434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fac99980 0x55f2faca3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f535882b640 1 -- 172.21.15.18:0/3154315434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2fab96d40 con 0x55f2fac99060 2024-09-19T09:57:13.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f535882b640 1 --2- 172.21.15.18:0/3154315434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99060 0x55f2fac99440 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f534c012c50 tx=0x7f534c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a30576d4ebd559 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:13.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f535882b640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53400a32c0 0x7f53400a5780 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f534c010c40 tx=0x7f534c017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:13.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f534a7fc640 1 -- 172.21.15.18:0/3154315434 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c012e00 con 0x55f2fac99060 2024-09-19T09:57:13.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f534a7fc640 1 -- 172.21.15.18:0/3154315434 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f534c009c00 con 0x55f2fac99060 2024-09-19T09:57:13.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.571+0000 7f534a7fc640 1 -- 172.21.15.18:0/3154315434 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c005390 con 0x55f2fac99060 2024-09-19T09:57:13.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.572+0000 7f535c667740 1 -- 172.21.15.18:0/3154315434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99060 msgr2=0x55f2fac99440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:13.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.572+0000 7f535c667740 1 --2- 172.21.15.18:0/3154315434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99060 0x55f2fac99440 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f534c012c50 tx=0x7f534c010740 comp rx=0 tx=0).stop 2024-09-19T09:57:13.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.572+0000 7f535c667740 1 -- 172.21.15.18:0/3154315434 shutdown_connections 2024-09-19T09:57:13.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.572+0000 7f535c667740 1 --2- 172.21.15.18:0/3154315434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2faca4240 0x55f2faca6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.572+0000 7f535c667740 1 --2- 172.21.15.18:0/3154315434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fac99980 0x55f2faca3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.572+0000 7f535c667740 1 --2- 172.21.15.18:0/3154315434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99060 0x55f2fac99440 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.572+0000 7f535c667740 1 -- 172.21.15.18:0/3154315434 >> 172.21.15.18:0/3154315434 conn(0x55f2fac955f0 msgr2=0x55f2fac959d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.572+0000 7f535c667740 1 -- 172.21.15.18:0/3154315434 shutdown_connections 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.572+0000 7f535c667740 1 -- 172.21.15.18:0/3154315434 wait complete. 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f535c667740 1 -- start start 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f535c667740 1 Processor -- start 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f535c667740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fac99060 0x55f2faca11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f535c667740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f535c667740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2faca4240 0x55f2faca1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f535c667740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f2faca6e10 con 0x55f2fac99980 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f535c667740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f2fab86f10 con 0x55f2fac99060 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f535c667740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f2faca6f90 con 0x55f2faca4240 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f535c667740 10 client.0 _ll_register_callbacks cb 0x55f2fabaadb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f53537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f53537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35346/0 (socket says 172.21.15.18:35346) 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f53537fe640 1 -- 172.21.15.18:0/1123346153 learned_addr learned my addr 172.21.15.18:0/1123346153 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f5353fff640 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fac99060 0x55f2faca11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.573+0000 7f535882b640 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2faca4240 0x55f2faca1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53537fe640 1 -- 172.21.15.18:0/1123346153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2faca4240 msgr2=0x55f2faca1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53537fe640 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2faca4240 0x55f2faca1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53537fe640 1 -- 172.21.15.18:0/1123346153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fac99060 msgr2=0x55f2faca11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53537fe640 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fac99060 0x55f2faca11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53537fe640 1 -- 172.21.15.18:0/1123346153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2fa90d580 con 0x55f2fac99980 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53537fe640 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca1730 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f533c00bad0 tx=0x7f533c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6ceedd95b91565 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53337fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53337fe640 1 -- 172.21.15.18:0/1123346153 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c003da0 con 0x55f2fac99980 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53337fe640 1 -- 172.21.15.18:0/1123346153 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f533c011440 con 0x55f2fac99980 2024-09-19T09:57:13.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f535c667740 1 -- 172.21.15.18:0/1123346153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f2fac0bb90 con 0x55f2fac99980 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53337fe640 1 -- 172.21.15.18:0/1123346153 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f533c005020 con 0x55f2fac99980 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f535c667740 10 client.16710 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f535c667740 1 -- 172.21.15.18:0/1123346153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f2fa9d7960 con 0x55f2fac99980 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.574+0000 7f53337fe640 1 -- 172.21.15.18:0/1123346153 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f2fac0bb90 con 0x55f2fac99980 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.575+0000 7f53337fe640 1 -- 172.21.15.18:0/1123346153 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f533c011680 con 0x55f2fac99980 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.575+0000 7f535c667740 10 client.16710 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.575+0000 7f535c667740 10 client.16710 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.575+0000 7f535c667740 20 client.16710 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.575+0000 7f535c667740 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f2facb3ed0 0x55f2facb6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.575+0000 7f535c667740 4 client.16710 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.575+0000 7f535c667740 1 -- 172.21.15.18:0/1123346153 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2fac060a0 con 0x55f2facb3ed0 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.575+0000 7f5353fff640 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f2facb3ed0 0x55f2facb6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.575+0000 7f53337fe640 10 client.16710 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:13.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.575+0000 7f5353fff640 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f2facb3ed0 0x55f2facb6350 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3312edb4731ccb5d server_cookie=6effca67fa85742a in_seq=0 out_seq=0 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f53337fe640 1 -- 172.21.15.18:0/1123346153 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2fac060a0 con 0x55f2facb3ed0 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f53337fe640 10 client.16710 handle_command_reply: tid=0 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f535c667740 1 client.16710 shutdown 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f535c667740 1 -- 172.21.15.18:0/1123346153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 msgr2=0x55f2faca1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f535c667740 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca1730 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f533c00bad0 tx=0x7f533c00bf90 comp rx=0 tx=0).stop 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f535c667740 1 -- 172.21.15.18:0/1123346153 shutdown_connections 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f535c667740 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f2facb3ed0 0x55f2facb6350 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f535c667740 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2faca4240 0x55f2faca1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f535c667740 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca1730 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f535c667740 1 --2- 172.21.15.18:0/1123346153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fac99060 0x55f2faca11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f535c667740 1 -- 172.21.15.18:0/1123346153 >> 172.21.15.18:0/1123346153 conn(0x55f2fac955f0 msgr2=0x55f2fac94750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f53337fe640 0 client.16710 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:13.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.576+0000 7f535c667740 1 -- 172.21.15.18:0/1123346153 shutdown_connections 2024-09-19T09:57:13.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.577+0000 7f535c667740 1 -- 172.21.15.18:0/1123346153 wait complete. 2024-09-19T09:57:13.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.577+0000 7f535c667740 20 client.16710 trim_cache size 0 max 16384 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.593+0000 7f535c667740 1 Processor -- start 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.593+0000 7f535c667740 1 -- start start 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f535c667740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 0x55f2fac9bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f535c667740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2fac95c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f535c667740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2faca4240 0x55f2faca18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f535c667740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f53541ad4c0 con 0x55f2fac99980 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f535c667740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f53541af000 con 0x55f2faca4240 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f535c667740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53541adb90 con 0x55f2fac99060 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f53537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2fac95c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f53537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2fac95c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35358/0 (socket says 172.21.15.18:35358) 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f53537fe640 1 -- 172.21.15.18:0/2830518470 learned_addr learned my addr 172.21.15.18:0/2830518470 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f5353fff640 1 --2- 172.21.15.18:0/2830518470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 0x55f2fac9bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f53537fe640 1 -- 172.21.15.18:0/2830518470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 msgr2=0x55f2fac9bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f53537fe640 1 --2- 172.21.15.18:0/2830518470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 0x55f2fac9bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f53537fe640 1 -- 172.21.15.18:0/2830518470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2faca4240 msgr2=0x55f2faca18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f53537fe640 1 --2- 172.21.15.18:0/2830518470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2faca4240 0x55f2faca18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f53537fe640 1 -- 172.21.15.18:0/2830518470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2fac94610 con 0x55f2fac99980 2024-09-19T09:57:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f5353fff640 1 --2- 172.21.15.18:0/2830518470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 0x55f2fac9bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:57:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f53537fe640 1 --2- 172.21.15.18:0/2830518470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2fac95c00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f533c0044d0 tx=0x7f533c005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71754c1b51dbcf13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f5349ffb640 1 -- 172.21.15.18:0/2830518470 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c003da0 con 0x55f2fac99980 2024-09-19T09:57:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f5349ffb640 1 -- 172.21.15.18:0/2830518470 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c011440 con 0x55f2fac99980 2024-09-19T09:57:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.594+0000 7f5349ffb640 1 -- 172.21.15.18:0/2830518470 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c004820 con 0x55f2fac99980 2024-09-19T09:57:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.595+0000 7f535c667740 1 -- 172.21.15.18:0/2830518470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 msgr2=0x55f2fac95c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.595+0000 7f535c667740 1 --2- 172.21.15.18:0/2830518470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2fac95c00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f533c0044d0 tx=0x7f533c005cd0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.595+0000 7f535c667740 1 -- 172.21.15.18:0/2830518470 shutdown_connections 2024-09-19T09:57:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.595+0000 7f535c667740 1 --2- 172.21.15.18:0/2830518470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2faca4240 0x55f2faca18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.595+0000 7f535c667740 1 --2- 172.21.15.18:0/2830518470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2fac95c00 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.595+0000 7f535c667740 1 --2- 172.21.15.18:0/2830518470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 0x55f2fac9bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.595+0000 7f535c667740 1 -- 172.21.15.18:0/2830518470 >> 172.21.15.18:0/2830518470 conn(0x55f2fac955f0 msgr2=0x55f2faca11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.595+0000 7f535c667740 1 -- 172.21.15.18:0/2830518470 shutdown_connections 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.595+0000 7f535c667740 1 -- 172.21.15.18:0/2830518470 wait complete. 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.595+0000 7f535c667740 1 -- start start 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f535c667740 1 Processor -- start 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f535c667740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 0x55f2faca80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f535c667740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f535c667740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2faca4240 0x55f2faca8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f535c667740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f53541ae930 con 0x55f2fac99980 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f535c667740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f53541ae260 con 0x55f2faca4240 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f535c667740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53541ab4a0 con 0x55f2fac99060 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f535c667740 10 client.0 _ll_register_callbacks cb 0x7f533c0043c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f53537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f53537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35364/0 (socket says 172.21.15.18:35364) 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f53537fe640 1 -- 172.21.15.18:0/2819244749 learned_addr learned my addr 172.21.15.18:0/2819244749 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f535882b640 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2faca4240 0x55f2faca8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f5353fff640 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 0x55f2faca80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f53537fe640 1 -- 172.21.15.18:0/2819244749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 msgr2=0x55f2faca80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f53537fe640 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 0x55f2faca80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f53537fe640 1 -- 172.21.15.18:0/2819244749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2faca4240 msgr2=0x55f2faca8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f53537fe640 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2faca4240 0x55f2faca8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f53537fe640 1 -- 172.21.15.18:0/2819244749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2fad1dd90 con 0x55f2fac99980 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.596+0000 7f5353fff640 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 0x55f2faca80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f53537fe640 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca8600 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f533c005d80 tx=0x7f533c003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ea679d10c7f8ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f53337fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f53337fe640 1 -- 172.21.15.18:0/2819244749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c005510 con 0x55f2fac99980 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f535c667740 1 -- 172.21.15.18:0/2819244749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f533c011440 con 0x55f2fac99980 2024-09-19T09:57:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f53337fe640 1 -- 172.21.15.18:0/2819244749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f533c0045c0 con 0x55f2fac99980 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f53337fe640 1 -- 172.21.15.18:0/2819244749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f533c0047e0 con 0x55f2fac99980 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f535c667740 10 client.16716 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f535c667740 1 -- 172.21.15.18:0/2819244749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f2fad1f000 con 0x55f2fac99980 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f53337fe640 1 -- 172.21.15.18:0/2819244749 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c011440 con 0x55f2fac99980 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f53337fe640 1 -- 172.21.15.18:0/2819244749 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f533c026bd0 con 0x55f2fac99980 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f535c667740 10 client.16716 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f535c667740 10 client.16716 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f535c667740 20 client.16716 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f535c667740 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f2fad1f6a0 0x55f2fad21a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f535c667740 4 client.16716 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c7a0d0c3", "release": true, "await": true}] 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.597+0000 7f535c667740 1 -- 172.21.15.18:0/2819244749 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c7a0d0c3", "release": true, "await": true}) -- 0x55f2fab825a0 con 0x55f2fad1f6a0 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.598+0000 7f5353fff640 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f2fad1f6a0 0x55f2fad21a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.598+0000 7f5353fff640 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f2fad1f6a0 0x55f2fad21a90 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6176d227fa1f1a0 server_cookie=a8d2c1a926083036 in_seq=0 out_seq=0 2024-09-19T09:57:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.598+0000 7f53337fe640 10 client.16716 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f53337fe640 1 -- 172.21.15.18:0/2819244749 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f2fab825a0 con 0x55f2fad1f6a0 2024-09-19T09:57:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f53337fe640 10 client.16716 handle_command_reply: tid=0 2024-09-19T09:57:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f535c667740 1 client.16716 shutdown 2024-09-19T09:57:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f535c667740 1 -- 172.21.15.18:0/2819244749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 msgr2=0x55f2faca8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f535c667740 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca8600 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f533c005d80 tx=0x7f533c003fd0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f535c667740 1 -- 172.21.15.18:0/2819244749 shutdown_connections 2024-09-19T09:57:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f535c667740 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55f2fad1f6a0 0x55f2fad21a90 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f535c667740 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2faca4240 0x55f2faca8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f535c667740 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f2fac99980 0x55f2faca8600 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f535c667740 1 --2- 172.21.15.18:0/2819244749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2fac99060 0x55f2faca80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f535c667740 1 -- 172.21.15.18:0/2819244749 >> 172.21.15.18:0/2819244749 conn(0x55f2fac955f0 msgr2=0x55f2faca19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.604+0000 7f53337fe640 0 client.16716 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.605+0000 7f535c667740 1 -- 172.21.15.18:0/2819244749 shutdown_connections 2024-09-19T09:57:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.605+0000 7f535c667740 1 -- 172.21.15.18:0/2819244749 wait complete. 2024-09-19T09:57:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.605+0000 7f535c667740 20 client.16716 trim_cache size 0 max 16384 2024-09-19T09:57:13.609 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 20, 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "c7a0d0c3": { 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 20, 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 149.8, 2024-09-19T09:57:13.610 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:13.611 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.612+0000 7f535a28e640 1 -- 172.21.15.18:0/2501261968 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53400a32c0 msgr2=0x7f53400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.612+0000 7f535a28e640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53400a32c0 0x7f53400a5780 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f534c010c40 tx=0x7f534c017000 comp rx=0 tx=0).stop 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.612+0000 7f535a28e640 1 -- 172.21.15.18:0/2501261968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5354101de0 msgr2=0x7f53541983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.612+0000 7f535a28e640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5354101de0 0x7f53541983f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5344006010 tx=0x7f53440042f0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.612+0000 7f535a28e640 1 -- 172.21.15.18:0/2501261968 shutdown_connections 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.612+0000 7f535a28e640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53400a32c0 0x7f53400a5780 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.612+0000 7f535a28e640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354106f10 0x7f535419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.612+0000 7f535a28e640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5354102790 0x7f5354198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.612+0000 7f535a28e640 1 --2- 172.21.15.18:0/2501261968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5354101de0 0x7f53541983f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.612+0000 7f535a28e640 1 -- 172.21.15.18:0/2501261968 >> 172.21.15.18:0/2501261968 conn(0x7f53540fd8c0 msgr2=0x7f53540fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.613+0000 7f535a28e640 1 -- 172.21.15.18:0/2501261968 shutdown_connections 2024-09-19T09:57:13.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:13.613+0000 7f535a28e640 1 -- 172.21.15.18:0/2501261968 wait complete. 2024-09-19T09:57:14.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:14 smithi018 ceph-mon[30956]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 77 MiB/s wr, 159 op/s 2024-09-19T09:57:14.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:14 smithi049 ceph-mon[34858]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 77 MiB/s wr, 159 op/s 2024-09-19T09:57:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:14 smithi162 ceph-mon[35174]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 77 MiB/s wr, 159 op/s 2024-09-19T09:57:15.077 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c7a0d0c3', total seconds elapsed: 34.3 2024-09-19T09:57:15.078 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:57:15.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:57:16.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:16 smithi049 ceph-mon[34858]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 87 MiB/s wr, 183 op/s 2024-09-19T09:57:16.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:16 smithi162 ceph-mon[35174]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 87 MiB/s wr, 183 op/s 2024-09-19T09:57:16.439 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:16.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:16 smithi018 ceph-mon[30956]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 87 MiB/s wr, 183 op/s 2024-09-19T09:57:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.946+0000 7f7c51535640 1 -- 172.21.15.18:0/560112718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c4c109450 msgr2=0x7f7c4c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.946+0000 7f7c51535640 1 --2- 172.21.15.18:0/560112718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c4c109450 0x7f7c4c110250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c01a910 tx=0x7f7c3c03b470 comp rx=0 tx=0).stop 2024-09-19T09:57:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.946+0000 7f7c51535640 1 -- 172.21.15.18:0/560112718 shutdown_connections 2024-09-19T09:57:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.946+0000 7f7c51535640 1 --2- 172.21.15.18:0/560112718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4c11b140 0x7f7c4c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.946+0000 7f7c51535640 1 --2- 172.21.15.18:0/560112718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c4c109830 0x7f7c4c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.946+0000 7f7c51535640 1 --2- 172.21.15.18:0/560112718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c4c109450 0x7f7c4c110250 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.946+0000 7f7c51535640 1 -- 172.21.15.18:0/560112718 >> 172.21.15.18:0/560112718 conn(0x7f7c4c06e140 msgr2=0x7f7c4c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.948+0000 7f7c51535640 1 -- 172.21.15.18:0/560112718 shutdown_connections 2024-09-19T09:57:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.948+0000 7f7c51535640 1 -- 172.21.15.18:0/560112718 wait complete. 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.949+0000 7f7c51535640 1 Processor -- start 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.950+0000 7f7c51535640 1 -- start start 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.950+0000 7f7c51535640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c4c109450 0x7f7c4c11a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.950+0000 7f7c51535640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c4c109830 0x7f7c4c1168b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.950+0000 7f7c51535640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4c11b140 0x7f7c4c116df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.950+0000 7f7c51535640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c113300 con 0x7f7c4c11b140 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.950+0000 7f7c51535640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c113180 con 0x7f7c4c109450 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.950+0000 7f7c51535640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c113480 con 0x7f7c4c109830 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.951+0000 7f7c4a7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c4c109830 0x7f7c4c1168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.951+0000 7f7c4a7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c4c109830 0x7f7c4c1168b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51264/0 (socket says 172.21.15.18:51264) 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.951+0000 7f7c4a7fc640 1 -- 172.21.15.18:0/2038988242 learned_addr learned my addr 172.21.15.18:0/2038988242 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.951+0000 7f7c4affd640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c4c109450 0x7f7c4c11a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.958+0000 7f7c4b7fe640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4c11b140 0x7f7c4c116df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.958+0000 7f7c4a7fc640 1 -- 172.21.15.18:0/2038988242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c4c109450 msgr2=0x7f7c4c11a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.958+0000 7f7c4a7fc640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c4c109450 0x7f7c4c11a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.958+0000 7f7c4a7fc640 1 -- 172.21.15.18:0/2038988242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4c11b140 msgr2=0x7f7c4c116df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.958+0000 7f7c4a7fc640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4c11b140 0x7f7c4c116df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.958+0000 7f7c4a7fc640 1 -- 172.21.15.18:0/2038988242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c117520 con 0x7f7c4c109830 2024-09-19T09:57:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.958+0000 7f7c4a7fc640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c4c109830 0x7f7c4c1168b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000e9f0 tx=0x7f7c4000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.958+0000 7f7c33fff640 1 -- 172.21.15.18:0/2038988242 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000cd80 con 0x7f7c4c109830 2024-09-19T09:57:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.959+0000 7f7c51535640 1 -- 172.21.15.18:0/2038988242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c1cd180 con 0x7f7c4c109830 2024-09-19T09:57:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.959+0000 7f7c51535640 1 -- 172.21.15.18:0/2038988242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c1cd580 con 0x7f7c4c109830 2024-09-19T09:57:17.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.961+0000 7f7c33fff640 1 -- 172.21.15.18:0/2038988242 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c40010910 con 0x7f7c4c109830 2024-09-19T09:57:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.965+0000 7f7c33fff640 1 -- 172.21.15.18:0/2038988242 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40018990 con 0x7f7c4c109830 2024-09-19T09:57:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.965+0000 7f7c33fff640 1 -- 172.21.15.18:0/2038988242 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7c40018bf0 con 0x7f7c4c109830 2024-09-19T09:57:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.966+0000 7f7c31ffb640 1 -- 172.21.15.18:0/2038988242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c38005290 con 0x7f7c4c109830 2024-09-19T09:57:17.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.966+0000 7f7c33fff640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c340a3290 0x7f7c340a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.968+0000 7f7c33fff640 1 -- 172.21.15.18:0/2038988242 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7c400d0d40 con 0x7f7c4c109830 2024-09-19T09:57:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.968+0000 7f7c4affd640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c340a3290 0x7f7c340a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:17.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.975+0000 7f7c33fff640 1 -- 172.21.15.18:0/2038988242 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c4009dab0 con 0x7f7c4c109830 2024-09-19T09:57:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:17.982+0000 7f7c4affd640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c340a3290 0x7f7c340a5750 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c005ab0 tx=0x7f7c3c005a00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:18.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.539+0000 7f7c31ffb640 1 -- 172.21.15.18:0/2038988242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c38005580 con 0x7f7c4c109830 2024-09-19T09:57:18.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.553+0000 7f7c33fff640 1 -- 172.21.15.18:0/2038988242 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f7c4009d3b0 con 0x7f7c4c109830 2024-09-19T09:57:18.558 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:18 smithi018 ceph-mon[30956]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 148 MiB/s wr, 343 op/s 2024-09-19T09:57:18.563 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:57:18.563 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:57:18.563 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:57:18.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.560+0000 7f7c31ffb640 1 -- 172.21.15.18:0/2038988242 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c340a3290 msgr2=0x7f7c340a5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:18.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.560+0000 7f7c31ffb640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c340a3290 0x7f7c340a5750 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c005ab0 tx=0x7f7c3c005a00 comp rx=0 tx=0).stop 2024-09-19T09:57:18.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.560+0000 7f7c31ffb640 1 -- 172.21.15.18:0/2038988242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c4c109830 msgr2=0x7f7c4c1168b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:18.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.560+0000 7f7c31ffb640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c4c109830 0x7f7c4c1168b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000e9f0 tx=0x7f7c4000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:57:18.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.560+0000 7f7c31ffb640 1 -- 172.21.15.18:0/2038988242 shutdown_connections 2024-09-19T09:57:18.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.561+0000 7f7c31ffb640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7c340a3290 0x7f7c340a5750 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:18.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.561+0000 7f7c31ffb640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c4c11b140 0x7f7c4c116df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:18.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.561+0000 7f7c31ffb640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c4c109830 0x7f7c4c1168b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:18.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.561+0000 7f7c31ffb640 1 --2- 172.21.15.18:0/2038988242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c4c109450 0x7f7c4c11a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:18.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.561+0000 7f7c31ffb640 1 -- 172.21.15.18:0/2038988242 >> 172.21.15.18:0/2038988242 conn(0x7f7c4c06e140 msgr2=0x7f7c4c072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:18.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.561+0000 7f7c31ffb640 1 -- 172.21.15.18:0/2038988242 shutdown_connections 2024-09-19T09:57:18.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:18.561+0000 7f7c31ffb640 1 -- 172.21.15.18:0/2038988242 wait complete. 2024-09-19T09:57:18.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:18 smithi049 ceph-mon[34858]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 148 MiB/s wr, 343 op/s 2024-09-19T09:57:18.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:18 smithi162 ceph-mon[35174]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 148 MiB/s wr, 343 op/s 2024-09-19T09:57:19.630 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:19 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2038988242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:19.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:19 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2038988242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:19.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:19 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2038988242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:19.780 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:57:19.780 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:57:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.830+0000 7faa4993d640 1 -- 172.21.15.18:0/3350337033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa441095e0 msgr2=0x7faa441099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.830+0000 7faa4993d640 1 --2- 172.21.15.18:0/3350337033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa441095e0 0x7faa441099e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7faa38009860 tx=0x7faa3802a340 comp rx=0 tx=0).stop 2024-09-19T09:57:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.831+0000 7faa4993d640 1 -- 172.21.15.18:0/3350337033 shutdown_connections 2024-09-19T09:57:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.831+0000 7faa4993d640 1 --2- 172.21.15.18:0/3350337033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa440737f0 0x7faa4407a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.831+0000 7faa4993d640 1 --2- 172.21.15.18:0/3350337033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa44072e30 0x7faa440732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.831+0000 7faa4993d640 1 --2- 172.21.15.18:0/3350337033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa441095e0 0x7faa441099e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.831+0000 7faa4993d640 1 -- 172.21.15.18:0/3350337033 >> 172.21.15.18:0/3350337033 conn(0x7faa4406eb50 msgr2=0x7faa44070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.831+0000 7faa4993d640 1 -- 172.21.15.18:0/3350337033 shutdown_connections 2024-09-19T09:57:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.831+0000 7faa4993d640 1 -- 172.21.15.18:0/3350337033 wait complete. 2024-09-19T09:57:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.832+0000 7faa4993d640 1 Processor -- start 2024-09-19T09:57:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.832+0000 7faa4993d640 1 -- start start 2024-09-19T09:57:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.833+0000 7faa4993d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa44072e30 0x7faa44084dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.833+0000 7faa4993d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa440737f0 0x7faa44083400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.833+0000 7faa4993d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa441095e0 0x7faa44083940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.833+0000 7faa4993d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa4407dd30 con 0x7faa441095e0 2024-09-19T09:57:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.833+0000 7faa4993d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faa4407dbb0 con 0x7faa440737f0 2024-09-19T09:57:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.833+0000 7faa4993d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa4407deb0 con 0x7faa44072e30 2024-09-19T09:57:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.834+0000 7faa4893b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa44072e30 0x7faa44084dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.834+0000 7faa4893b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa44072e30 0x7faa44084dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51296/0 (socket says 172.21.15.18:51296) 2024-09-19T09:57:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.834+0000 7faa4893b640 1 -- 172.21.15.18:0/2656596397 learned_addr learned my addr 172.21.15.18:0/2656596397 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.835+0000 7faa43fff640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa440737f0 0x7faa44083400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.835+0000 7faa4913c640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa441095e0 0x7faa44083940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.836+0000 7faa4893b640 1 -- 172.21.15.18:0/2656596397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa440737f0 msgr2=0x7faa44083400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.836+0000 7faa4893b640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa440737f0 0x7faa44083400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.836+0000 7faa4893b640 1 -- 172.21.15.18:0/2656596397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa441095e0 msgr2=0x7faa44083940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.836+0000 7faa4893b640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa441095e0 0x7faa44083940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.836+0000 7faa4893b640 1 -- 172.21.15.18:0/2656596397 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa44084200 con 0x7faa44072e30 2024-09-19T09:57:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.837+0000 7faa4893b640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa44072e30 0x7faa44084dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa38000c00 tx=0x7faa38033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.839+0000 7faa41ffb640 1 -- 172.21.15.18:0/2656596397 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38037040 con 0x7faa44072e30 2024-09-19T09:57:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.839+0000 7faa4993d640 1 -- 172.21.15.18:0/2656596397 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa441b7220 con 0x7faa44072e30 2024-09-19T09:57:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.839+0000 7faa4993d640 1 -- 172.21.15.18:0/2656596397 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa441b76e0 con 0x7faa44072e30 2024-09-19T09:57:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.846+0000 7faa4da16740 1 Processor -- start 2024-09-19T09:57:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.848+0000 7faa4da16740 1 -- start start 2024-09-19T09:57:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.849+0000 7faa4da16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa30b70 0x55b86fa30f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.851+0000 7faa4da16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa314b0 0x55b86fa35f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.851+0000 7faa4da16740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa36540 0x55b86fa38a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.851+0000 7faa4da16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b86f9942f0 con 0x55b86fa30b70 2024-09-19T09:57:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.851+0000 7faa4da16740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b86f93c270 con 0x55b86fa36540 2024-09-19T09:57:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.851+0000 7faa4da16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b86f9902b0 con 0x55b86fa314b0 2024-09-19T09:57:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.852+0000 7faa43fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa36540 0x55b86fa38a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.852+0000 7faa43fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa36540 0x55b86fa38a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34618/0 (socket says 172.21.15.18:34618) 2024-09-19T09:57:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.852+0000 7faa43fff640 1 -- 172.21.15.18:0/1539844128 learned_addr learned my addr 172.21.15.18:0/1539844128 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.852+0000 7faa4913c640 1 --2- 172.21.15.18:0/1539844128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa30b70 0x55b86fa30f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.853+0000 7faa43fff640 1 -- 172.21.15.18:0/1539844128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa314b0 msgr2=0x55b86fa35f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.853+0000 7faa43fff640 1 --2- 172.21.15.18:0/1539844128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa314b0 0x55b86fa35f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.853+0000 7faa43fff640 1 -- 172.21.15.18:0/1539844128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa30b70 msgr2=0x55b86fa30f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.853+0000 7faa43fff640 1 --2- 172.21.15.18:0/1539844128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa30b70 0x55b86fa30f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.853+0000 7faa43fff640 1 -- 172.21.15.18:0/1539844128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86f93b340 con 0x55b86fa36540 2024-09-19T09:57:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.854+0000 7faa43fff640 1 --2- 172.21.15.18:0/1539844128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa36540 0x55b86fa38a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00e550 tx=0x7faa3c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=422ec8b5123bedce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.854+0000 7faa41ffb640 1 -- 172.21.15.18:0/2656596397 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa38030850 con 0x7faa44072e30 2024-09-19T09:57:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.856+0000 7faa41ffb640 1 -- 172.21.15.18:0/2656596397 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38003d20 con 0x7faa44072e30 2024-09-19T09:57:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.856+0000 7faa41ffb640 1 -- 172.21.15.18:0/2656596397 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faa3804c430 con 0x7faa44072e30 2024-09-19T09:57:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.858+0000 7faa41ffb640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa2c0a32c0 0x7faa2c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.859+0000 7faa4913c640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa2c0a32c0 0x7faa2c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.860+0000 7faa41ffb640 1 -- 172.21.15.18:0/2656596397 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7faa38101720 con 0x7faa44072e30 2024-09-19T09:57:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.860+0000 7faa2affd640 1 -- 172.21.15.18:0/1539844128 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c003970 con 0x55b86fa36540 2024-09-19T09:57:19.864 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.861+0000 7faa2affd640 1 -- 172.21.15.18:0/1539844128 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa3c00d7d0 con 0x55b86fa36540 2024-09-19T09:57:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.862+0000 7faa4da16740 1 -- 172.21.15.18:0/1539844128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa36540 msgr2=0x55b86fa38a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.862+0000 7faa4da16740 1 --2- 172.21.15.18:0/1539844128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa36540 0x55b86fa38a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00e550 tx=0x7faa3c0095c0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.862+0000 7faa4da16740 1 -- 172.21.15.18:0/1539844128 shutdown_connections 2024-09-19T09:57:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.862+0000 7faa4da16740 1 --2- 172.21.15.18:0/1539844128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa36540 0x55b86fa38a00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.862+0000 7faa4da16740 1 --2- 172.21.15.18:0/1539844128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa314b0 0x55b86fa35f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.862+0000 7faa4da16740 1 --2- 172.21.15.18:0/1539844128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa30b70 0x55b86fa30f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.862+0000 7faa4da16740 1 -- 172.21.15.18:0/1539844128 >> 172.21.15.18:0/1539844128 conn(0x55b86fa2c1e0 msgr2=0x55b86fa2c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.863+0000 7faa4da16740 1 -- 172.21.15.18:0/1539844128 shutdown_connections 2024-09-19T09:57:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.863+0000 7faa4da16740 1 -- 172.21.15.18:0/1539844128 wait complete. 2024-09-19T09:57:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.864+0000 7faa4da16740 1 -- start start 2024-09-19T09:57:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.864+0000 7faa4da16740 1 Processor -- start 2024-09-19T09:57:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.865+0000 7faa4da16740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 0x55b86fa3ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.865+0000 7faa4da16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa314b0 0x55b86fa3b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.865+0000 7faa4da16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa40310 0x55b86fa42700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.865+0000 7faa4da16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b86fa39560 con 0x55b86fa40310 2024-09-19T09:57:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.865+0000 7faa4da16740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b86f91d290 con 0x55b86fa30b70 2024-09-19T09:57:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.865+0000 7faa4da16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b86fa396e0 con 0x55b86fa314b0 2024-09-19T09:57:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.866+0000 7faa4da16740 10 client.0 _ll_register_callbacks cb 0x55b86f94e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.866+0000 7faa4913c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa40310 0x55b86fa42700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.866+0000 7faa4913c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa40310 0x55b86fa42700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42616/0 (socket says 172.21.15.18:42616) 2024-09-19T09:57:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.866+0000 7faa4913c640 1 -- 172.21.15.18:0/1260880972 learned_addr learned my addr 172.21.15.18:0/1260880972 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.866+0000 7faa4893b640 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 0x55b86fa3ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.867+0000 7faa43fff640 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa314b0 0x55b86fa3b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.868+0000 7faa4913c640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa2c0a32c0 0x7faa2c0a5780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa34005fd0 tx=0x7faa34013400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.868+0000 7faa4913c640 1 -- 172.21.15.18:0/1260880972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa314b0 msgr2=0x55b86fa3b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.868+0000 7faa4913c640 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa314b0 0x55b86fa3b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.868+0000 7faa4913c640 1 -- 172.21.15.18:0/1260880972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 msgr2=0x55b86fa3ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.868+0000 7faa4913c640 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 0x55b86fa3ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.868+0000 7faa4913c640 1 -- 172.21.15.18:0/1260880972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86f6a7210 con 0x55b86fa40310 2024-09-19T09:57:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.868+0000 7faa4913c640 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa40310 0x55b86fa42700 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7faa3401d5e0 tx=0x7faa34015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1de87e64a1c3c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.869+0000 7faa23fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.869+0000 7faa23fff640 1 -- 172.21.15.18:0/1260880972 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3401e8f0 con 0x55b86fa40310 2024-09-19T09:57:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.869+0000 7faa23fff640 1 -- 172.21.15.18:0/1260880972 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7faa3401ea90 con 0x55b86fa40310 2024-09-19T09:57:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.869+0000 7faa4da16740 1 -- 172.21.15.18:0/1260880972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b86f9a1a20 con 0x55b86fa40310 2024-09-19T09:57:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.870+0000 7faa23fff640 1 -- 172.21.15.18:0/1260880972 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa3401ec90 con 0x55b86fa40310 2024-09-19T09:57:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.870+0000 7faa4da16740 10 client.16734 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:19.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.870+0000 7faa4da16740 1 -- 172.21.15.18:0/1260880972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b86f773620 con 0x55b86fa40310 2024-09-19T09:57:19.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.872+0000 7faa23fff640 1 -- 172.21.15.18:0/1260880972 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b86f9a1a20 con 0x55b86fa40310 2024-09-19T09:57:19.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.873+0000 7faa23fff640 1 -- 172.21.15.18:0/1260880972 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faa3400f040 con 0x55b86fa40310 2024-09-19T09:57:19.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.874+0000 7faa4da16740 10 client.16734 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:19.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.874+0000 7faa4da16740 10 client.16734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:19.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.874+0000 7faa4da16740 20 client.16734 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:19.877 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.874+0000 7faa4da16740 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b86fa47350 0x55b86fa497f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.874+0000 7faa4da16740 4 client.16734 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.874+0000 7faa4da16740 1 -- 172.21.15.18:0/1260880972 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b86f99bd70 con 0x55b86fa47350 2024-09-19T09:57:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.878+0000 7faa4893b640 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b86fa47350 0x55b86fa497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.884+0000 7faa4893b640 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b86fa47350 0x55b86fa497f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91b97f460bc1fd41 server_cookie=3878e7563155217 in_seq=0 out_seq=0 2024-09-19T09:57:19.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.884+0000 7faa23fff640 10 client.16734 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.889+0000 7faa23fff640 1 -- 172.21.15.18:0/1260880972 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b86f99bd70 con 0x55b86fa47350 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.889+0000 7faa23fff640 10 client.16734 handle_command_reply: tid=0 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa4da16740 1 client.16734 shutdown 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa4da16740 1 -- 172.21.15.18:0/1260880972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa40310 msgr2=0x55b86fa42700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa4da16740 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa40310 0x55b86fa42700 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7faa3401d5e0 tx=0x7faa34015040 comp rx=0 tx=0).stop 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa4da16740 1 -- 172.21.15.18:0/1260880972 shutdown_connections 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa4da16740 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b86fa47350 0x55b86fa497f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa4da16740 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa40310 0x55b86fa42700 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa4da16740 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa314b0 0x55b86fa3b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa4da16740 1 --2- 172.21.15.18:0/1260880972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 0x55b86fa3ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa4da16740 1 -- 172.21.15.18:0/1260880972 >> 172.21.15.18:0/1260880972 conn(0x55b86fa2c1e0 msgr2=0x55b86fa2da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa23fff640 0 client.16734 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.890+0000 7faa4da16740 1 -- 172.21.15.18:0/1260880972 shutdown_connections 2024-09-19T09:57:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.891+0000 7faa4da16740 1 -- 172.21.15.18:0/1260880972 wait complete. 2024-09-19T09:57:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.891+0000 7faa4da16740 20 client.16734 trim_cache size 0 max 16384 2024-09-19T09:57:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.991+0000 7faa4da16740 1 Processor -- start 2024-09-19T09:57:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.991+0000 7faa4da16740 1 -- start start 2024-09-19T09:57:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.992+0000 7faa4da16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa30b70 0x55b86fa39f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.992+0000 7faa4da16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 0x55b86fa2aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.992+0000 7faa4da16740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa40310 0x55b86fa2afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.992+0000 7faa4da16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa3000e380 con 0x55b86fa314b0 2024-09-19T09:57:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.992+0000 7faa4da16740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faa3000fec0 con 0x55b86fa40310 2024-09-19T09:57:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.992+0000 7faa4da16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa3000ea50 con 0x55b86fa30b70 2024-09-19T09:57:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.992+0000 7faa43fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 0x55b86fa2aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.992+0000 7faa43fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 0x55b86fa2aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42630/0 (socket says 172.21.15.18:42630) 2024-09-19T09:57:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.992+0000 7faa43fff640 1 -- 172.21.15.18:0/638229507 learned_addr learned my addr 172.21.15.18:0/638229507 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.994+0000 7faa4913c640 1 --2- 172.21.15.18:0/638229507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa40310 0x55b86fa2afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.995+0000 7faa4913c640 1 -- 172.21.15.18:0/638229507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa30b70 msgr2=0x55b86fa39f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:57:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.995+0000 7faa4913c640 1 --2- 172.21.15.18:0/638229507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa30b70 0x55b86fa39f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.995+0000 7faa4913c640 1 -- 172.21.15.18:0/638229507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 msgr2=0x55b86fa2aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.995+0000 7faa4913c640 1 --2- 172.21.15.18:0/638229507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 0x55b86fa2aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.995+0000 7faa4913c640 1 -- 172.21.15.18:0/638229507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86fa3a8e0 con 0x55b86fa40310 2024-09-19T09:57:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:19.996+0000 7faa4913c640 1 --2- 172.21.15.18:0/638229507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa40310 0x55b86fa2afd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa34004d20 tx=0x7faa340059a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f566c647072f7361 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.009+0000 7faa2a7fc640 1 -- 172.21.15.18:0/638229507 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3401ee30 con 0x55b86fa40310 2024-09-19T09:57:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.010+0000 7faa2a7fc640 1 -- 172.21.15.18:0/638229507 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa34022070 con 0x55b86fa40310 2024-09-19T09:57:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.011+0000 7faa4da16740 1 -- 172.21.15.18:0/638229507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa40310 msgr2=0x55b86fa2afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.011+0000 7faa4da16740 1 --2- 172.21.15.18:0/638229507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa40310 0x55b86fa2afd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa34004d20 tx=0x7faa340059a0 comp rx=0 tx=0).stop 2024-09-19T09:57:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.011+0000 7faa4da16740 1 -- 172.21.15.18:0/638229507 shutdown_connections 2024-09-19T09:57:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.011+0000 7faa4da16740 1 --2- 172.21.15.18:0/638229507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa40310 0x55b86fa2afd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.011+0000 7faa4da16740 1 --2- 172.21.15.18:0/638229507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 0x55b86fa2aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.011+0000 7faa4da16740 1 --2- 172.21.15.18:0/638229507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa30b70 0x55b86fa39f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.011+0000 7faa4da16740 1 -- 172.21.15.18:0/638229507 >> 172.21.15.18:0/638229507 conn(0x55b86fa2c1e0 msgr2=0x55b86fa3ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.013+0000 7faa4da16740 1 -- 172.21.15.18:0/638229507 shutdown_connections 2024-09-19T09:57:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.013+0000 7faa4da16740 1 -- 172.21.15.18:0/638229507 wait complete. 2024-09-19T09:57:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.013+0000 7faa4da16740 1 -- start start 2024-09-19T09:57:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.013+0000 7faa4da16740 1 Processor -- start 2024-09-19T09:57:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.014+0000 7faa4da16740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 0x55b86fa58d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.014+0000 7faa4da16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 0x55b86fa59240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.014+0000 7faa4da16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa5a1e0 0x55b86fa5a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.014+0000 7faa4da16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa3000f7f0 con 0x55b86fa314b0 2024-09-19T09:57:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.014+0000 7faa4da16740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faa3000f120 con 0x55b86fa30b70 2024-09-19T09:57:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.014+0000 7faa4da16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa3000c410 con 0x55b86fa5a1e0 2024-09-19T09:57:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.014+0000 7faa4da16740 10 client.0 _ll_register_callbacks cb 0x7faa34009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.015+0000 7faa4893b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 0x55b86fa58d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.015+0000 7faa4893b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 0x55b86fa58d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34658/0 (socket says 172.21.15.18:34658) 2024-09-19T09:57:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.015+0000 7faa4893b640 1 -- 172.21.15.18:0/3683061156 learned_addr learned my addr 172.21.15.18:0/3683061156 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.016+0000 7faa43fff640 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 0x55b86fa59240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.016+0000 7faa4913c640 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa5a1e0 0x55b86fa5a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.017+0000 7faa4893b640 1 -- 172.21.15.18:0/3683061156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa5a1e0 msgr2=0x55b86fa5a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.017+0000 7faa4893b640 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa5a1e0 0x55b86fa5a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.017+0000 7faa4893b640 1 -- 172.21.15.18:0/3683061156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 msgr2=0x55b86fa59240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.017+0000 7faa4893b640 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 0x55b86fa59240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.017+0000 7faa4893b640 1 -- 172.21.15.18:0/3683061156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86fa5abd0 con 0x55b86fa30b70 2024-09-19T09:57:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.018+0000 7faa4893b640 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 0x55b86fa58d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa380037b0 tx=0x7faa38009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34f16a08570bb990 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.018+0000 7faa23fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:57:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.019+0000 7faa23fff640 1 -- 172.21.15.18:0/3683061156 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa380ce490 con 0x55b86fa30b70 2024-09-19T09:57:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.021+0000 7faa4da16740 1 -- 172.21.15.18:0/3683061156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b86f918900 con 0x55b86fa30b70 2024-09-19T09:57:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.021+0000 7faa23fff640 1 -- 172.21.15.18:0/3683061156 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7faa380ca400 con 0x55b86fa30b70 2024-09-19T09:57:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.022+0000 7faa23fff640 1 -- 172.21.15.18:0/3683061156 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa380cdd90 con 0x55b86fa30b70 2024-09-19T09:57:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.023+0000 7faa4da16740 10 client.26186 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.023+0000 7faa4da16740 1 -- 172.21.15.18:0/3683061156 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b86fab2330 con 0x55b86fa30b70 2024-09-19T09:57:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.024+0000 7faa23fff640 1 -- 172.21.15.18:0/3683061156 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b86f918900 con 0x55b86fa30b70 2024-09-19T09:57:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.025+0000 7faa23fff640 1 -- 172.21.15.18:0/3683061156 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faa380cd1e0 con 0x55b86fa30b70 2024-09-19T09:57:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.027+0000 7faa4da16740 10 client.26186 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.027+0000 7faa4da16740 10 client.26186 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.027+0000 7faa4da16740 20 client.26186 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.027+0000 7faa4da16740 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b86fab2c60 0x55b86fab5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.027+0000 7faa4da16740 4 client.26186 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:57:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.027+0000 7faa4da16740 1 -- 172.21.15.18:0/3683061156 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b86f965820 con 0x55b86fab2c60 2024-09-19T09:57:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.029+0000 7faa43fff640 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b86fab2c60 0x55b86fab5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.036+0000 7faa43fff640 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b86fab2c60 0x55b86fab5080 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21a704aa31ad8d8 server_cookie=2e0b38cc0d4f817f in_seq=0 out_seq=0 2024-09-19T09:57:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:20.036+0000 7faa23fff640 10 client.26186 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:20 smithi049 ceph-mon[34858]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 199 MiB/s wr, 507 op/s 2024-09-19T09:57:20.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:20 smithi018 ceph-mon[30956]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 199 MiB/s wr, 507 op/s 2024-09-19T09:57:20.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:20 smithi162 ceph-mon[35174]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 199 MiB/s wr, 507 op/s 2024-09-19T09:57:21.062 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.944+0000 7f9ca1808640 1 -- 172.21.15.18:0/1672141724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c9c109450 msgr2=0x7f9c9c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.944+0000 7f9ca1808640 1 --2- 172.21.15.18:0/1672141724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c9c109450 0x7f9c9c110250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009900 tx=0x7f9c8c02a420 comp rx=0 tx=0).stop 2024-09-19T09:57:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.945+0000 7f9ca1808640 1 -- 172.21.15.18:0/1672141724 shutdown_connections 2024-09-19T09:57:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.945+0000 7f9ca1808640 1 --2- 172.21.15.18:0/1672141724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9c11b140 0x7f9c9c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.945+0000 7f9ca1808640 1 --2- 172.21.15.18:0/1672141724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c9c109830 0x7f9c9c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.945+0000 7f9ca1808640 1 --2- 172.21.15.18:0/1672141724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c9c109450 0x7f9c9c110250 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.945+0000 7f9ca1808640 1 -- 172.21.15.18:0/1672141724 >> 172.21.15.18:0/1672141724 conn(0x7f9c9c06e140 msgr2=0x7f9c9c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.947+0000 7f9ca1808640 1 -- 172.21.15.18:0/1672141724 shutdown_connections 2024-09-19T09:57:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.947+0000 7f9ca1808640 1 -- 172.21.15.18:0/1672141724 wait complete. 2024-09-19T09:57:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.948+0000 7f9ca1808640 1 Processor -- start 2024-09-19T09:57:21.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.948+0000 7f9ca1808640 1 -- start start 2024-09-19T09:57:21.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.949+0000 7f9ca1808640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c9c109450 0x7f9c9c11a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:21.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.949+0000 7f9ca1808640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c9c109830 0x7f9c9c114920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:21.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.949+0000 7f9ca1808640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9c11b140 0x7f9c9c114e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:21.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.949+0000 7f9ca1808640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c111350 con 0x7f9c9c109450 2024-09-19T09:57:21.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.949+0000 7f9ca1808640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c1111d0 con 0x7f9c9c109830 2024-09-19T09:57:21.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.949+0000 7f9ca1808640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c1114d0 con 0x7f9c9c11b140 2024-09-19T09:57:21.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.955+0000 7f9c9a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c9c109830 0x7f9c9c114920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:21.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.955+0000 7f9c9a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c9c109830 0x7f9c9c114920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34672/0 (socket says 172.21.15.18:34672) 2024-09-19T09:57:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.955+0000 7f9c9a7fc640 1 -- 172.21.15.18:0/1858847634 learned_addr learned my addr 172.21.15.18:0/1858847634 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.955+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9c11b140 0x7f9c9c114e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.958+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/1858847634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c9c109830 msgr2=0x7f9c9c114920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.958+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c9c109830 0x7f9c9c114920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.958+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/1858847634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c9c109450 msgr2=0x7f9c9c11a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.958+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c9c109450 0x7f9c9c11a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.958+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/1858847634 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9c1155e0 con 0x7f9c9c11b140 2024-09-19T09:57:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.961+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9c11b140 0x7f9c9c114e60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c90005fd0 tx=0x7f9c9000dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.962+0000 7f9ca0806640 1 -- 172.21.15.18:0/1858847634 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90017070 con 0x7f9c9c11b140 2024-09-19T09:57:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.962+0000 7f9ca1808640 1 -- 172.21.15.18:0/1858847634 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9c1bc130 con 0x7f9c9c11b140 2024-09-19T09:57:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.962+0000 7f9ca1808640 1 -- 172.21.15.18:0/1858847634 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9c1bc5e0 con 0x7f9c9c11b140 2024-09-19T09:57:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.975+0000 7f9ca0806640 1 -- 172.21.15.18:0/1858847634 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c90005500 con 0x7f9c9c11b140 2024-09-19T09:57:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.975+0000 7f9ca0806640 1 -- 172.21.15.18:0/1858847634 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90009780 con 0x7f9c9c11b140 2024-09-19T09:57:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.975+0000 7f9ca0806640 1 -- 172.21.15.18:0/1858847634 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9c900099e0 con 0x7f9c9c11b140 2024-09-19T09:57:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.984+0000 7f9ca0806640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c840a3480 0x7f9c840a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.985+0000 7f9ca0806640 1 -- 172.21.15.18:0/1858847634 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9c900d04e0 con 0x7f9c9c11b140 2024-09-19T09:57:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.986+0000 7f9c9affd640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c840a3480 0x7f9c840a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.988+0000 7f9ca3be1740 1 Processor -- start 2024-09-19T09:57:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.988+0000 7f9ca3be1740 1 -- start start 2024-09-19T09:57:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.989+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f226f760 0x5651f226fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.989+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f2270080 0x5651f227a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:21.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.989+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f227a940 0x5651f227cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:21.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.989+0000 7f9ca3be1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5651f21d52a0 con 0x5651f227a940 2024-09-19T09:57:21.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.989+0000 7f9ca3be1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5651f217cb10 con 0x5651f226f760 2024-09-19T09:57:21.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.989+0000 7f9ca3be1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5651f21d1260 con 0x5651f2270080 2024-09-19T09:57:21.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.989+0000 7f9c9a7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f2270080 0x5651f227a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:21.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.989+0000 7f9c9a7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f2270080 0x5651f227a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51364/0 (socket says 172.21.15.18:51364) 2024-09-19T09:57:21.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.989+0000 7f9c9a7fc640 1 -- 172.21.15.18:0/1840217658 learned_addr learned my addr 172.21.15.18:0/1840217658 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:21.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.990+0000 7f9c9affd640 1 --2- 172.21.15.18:0/1840217658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f226f760 0x5651f226fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.990+0000 7f9c9a7fc640 1 -- 172.21.15.18:0/1840217658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f226f760 msgr2=0x5651f226fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.990+0000 7f9c9a7fc640 1 --2- 172.21.15.18:0/1840217658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f226f760 0x5651f226fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.990+0000 7f9c9a7fc640 1 -- 172.21.15.18:0/1840217658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f227a940 msgr2=0x5651f227cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.990+0000 7f9c9a7fc640 1 --2- 172.21.15.18:0/1840217658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f227a940 0x5651f227cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.990+0000 7f9c9a7fc640 1 -- 172.21.15.18:0/1840217658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651f1f46b90 con 0x5651f2270080 2024-09-19T09:57:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.991+0000 7f9c9a7fc640 1 --2- 172.21.15.18:0/1840217658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f2270080 0x5651f227a400 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400e270 tx=0x7f9c94009790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a63341ca458a693 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.993+0000 7f9c81ffb640 1 -- 172.21.15.18:0/1840217658 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94018020 con 0x5651f2270080 2024-09-19T09:57:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.993+0000 7f9c81ffb640 1 -- 172.21.15.18:0/1840217658 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c9400ee90 con 0x5651f2270080 2024-09-19T09:57:21.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.993+0000 7f9c81ffb640 1 -- 172.21.15.18:0/1840217658 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94013d10 con 0x5651f2270080 2024-09-19T09:57:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.994+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1840217658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f2270080 msgr2=0x5651f227a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.994+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/1840217658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f2270080 0x5651f227a400 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400e270 tx=0x7f9c94009790 comp rx=0 tx=0).stop 2024-09-19T09:57:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.994+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1840217658 shutdown_connections 2024-09-19T09:57:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.995+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/1840217658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f227a940 0x5651f227cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.995+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/1840217658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f2270080 0x5651f227a400 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.995+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/1840217658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f226f760 0x5651f226fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.995+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1840217658 >> 172.21.15.18:0/1840217658 conn(0x5651f226bcf0 msgr2=0x5651f226c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.995+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1840217658 shutdown_connections 2024-09-19T09:57:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.995+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1840217658 wait complete. 2024-09-19T09:57:22.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.999+0000 7f9ca3be1740 1 -- start start 2024-09-19T09:57:22.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:21.999+0000 7f9ca3be1740 1 Processor -- start 2024-09-19T09:57:22.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.000+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f226f760 0x5651f2277850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.001+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f2277d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.001+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22782d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.001+0000 7f9ca3be1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5651f227d510 con 0x5651f226f760 2024-09-19T09:57:22.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.001+0000 7f9ca3be1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5651f215d6e0 con 0x5651f2270080 2024-09-19T09:57:22.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.002+0000 7f9ca3be1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5651f227d690 con 0x5651f227a940 2024-09-19T09:57:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.003+0000 7f9c9b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22782d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.007+0000 7f9c9b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22782d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51378/0 (socket says 172.21.15.18:51378) 2024-09-19T09:57:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.007+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/1249044276 learned_addr learned my addr 172.21.15.18:0/1249044276 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.003+0000 7f9c9a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f2277d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.007+0000 7f9ca3be1740 10 client.0 _ll_register_callbacks cb 0x5651f2181a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.012+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/1249044276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 msgr2=0x5651f2277d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.012+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f2277d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.012+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/1249044276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f226f760 msgr2=0x5651f2277850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.012+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f226f760 0x5651f2277850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.012+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/1249044276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651f2286ac0 con 0x5651f227a940 2024-09-19T09:57:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.012+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22782d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9c900ce030 tx=0x7f9c9009d390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c71f7e6ead20b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.013+0000 7f9c7affd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:57:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.013+0000 7f9c7affd640 1 -- 172.21.15.18:0/1249044276 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90014030 con 0x5651f227a940 2024-09-19T09:57:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.013+0000 7f9c7affd640 1 -- 172.21.15.18:0/1249044276 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9c900991c0 con 0x5651f227a940 2024-09-19T09:57:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.013+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1249044276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c9400ee90 con 0x5651f227a940 2024-09-19T09:57:22.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.014+0000 7f9c7affd640 1 -- 172.21.15.18:0/1249044276 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9c900046c0 con 0x5651f227a940 2024-09-19T09:57:22.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.017+0000 7f9c9affd640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c840a3480 0x7f9c840a5940 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0096c0 tx=0x7f9c8c009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:22.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.017+0000 7f9ca3be1740 10 client.26170 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:22.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.017+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1249044276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5651f2289430 con 0x5651f227a940 2024-09-19T09:57:22.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.018+0000 7f9c7affd640 1 -- 172.21.15.18:0/1249044276 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c90004860 con 0x5651f227a940 2024-09-19T09:57:22.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.018+0000 7f9c7affd640 1 -- 172.21.15.18:0/1249044276 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9c900bb2a0 con 0x5651f227a940 2024-09-19T09:57:22.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.019+0000 7f9ca3be1740 10 client.26170 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:22.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.019+0000 7f9ca3be1740 10 client.26170 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:57:22.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.020+0000 7f9ca3be1740 20 client.26170 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:22.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.020+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5651f228a7d0 0x5651f228cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.020+0000 7f9ca3be1740 4 client.26170 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:22.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.020+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1249044276 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9c9400ee90 con 0x5651f228a7d0 2024-09-19T09:57:22.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.027+0000 7f9c9affd640 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5651f228a7d0 0x5651f228cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.029+0000 7f9c7affd640 10 client.26170 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:22.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.029+0000 7f9c9affd640 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5651f228a7d0 0x5651f228cbf0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd7a0736b6fb110a server_cookie=a47c630532a2e45b in_seq=0 out_seq=0 2024-09-19T09:57:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.032+0000 7f9c7affd640 1 -- 172.21.15.18:0/1249044276 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9c9400ee90 con 0x5651f228a7d0 2024-09-19T09:57:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.033+0000 7f9c7affd640 10 client.26170 handle_command_reply: tid=0 2024-09-19T09:57:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.033+0000 7f9ca3be1740 1 client.26170 shutdown 2024-09-19T09:57:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.033+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1249044276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 msgr2=0x5651f22782d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:22.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.033+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22782d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9c900ce030 tx=0x7f9c9009d390 comp rx=0 tx=0).stop 2024-09-19T09:57:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.034+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1249044276 shutdown_connections 2024-09-19T09:57:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.034+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5651f228a7d0 0x5651f228cbf0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.034+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22782d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.034+0000 7f9c7affd640 0 client.26170 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.034+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f2277d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.034+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/1249044276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f226f760 0x5651f2277850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.034+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1249044276 >> 172.21.15.18:0/1249044276 conn(0x5651f226bcf0 msgr2=0x5651f226ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.034+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1249044276 shutdown_connections 2024-09-19T09:57:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.034+0000 7f9ca3be1740 1 -- 172.21.15.18:0/1249044276 wait complete. 2024-09-19T09:57:22.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.035+0000 7f9ca3be1740 20 client.26170 trim_cache size 0 max 16384 2024-09-19T09:57:22.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.077+0000 7f9ca3be1740 1 Processor -- start 2024-09-19T09:57:22.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.077+0000 7f9ca3be1740 1 -- start start 2024-09-19T09:57:22.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.078+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f226f760 0x5651f2278120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.078+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f226ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.079+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22924c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.079+0000 7f9c9a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f226ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:22.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.079+0000 7f9c9a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f226ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34700/0 (socket says 172.21.15.18:34700) 2024-09-19T09:57:22.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.079+0000 7f9c9a7fc640 1 -- 172.21.15.18:0/196776856 learned_addr learned my addr 172.21.15.18:0/196776856 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:22.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.079+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/196776856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:22.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.079+0000 7f9ca3be1740 1 -- 172.21.15.18:0/196776856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8800e430 con 0x5651f226f760 2024-09-19T09:57:22.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.079+0000 7f9ca3be1740 1 -- 172.21.15.18:0/196776856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8800ff70 con 0x5651f2270080 2024-09-19T09:57:22.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.079+0000 7f9ca3be1740 1 -- 172.21.15.18:0/196776856 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8800eb00 con 0x5651f227a940 2024-09-19T09:57:22.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.080+0000 7f9c9affd640 1 --2- 172.21.15.18:0/196776856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f226f760 0x5651f2278120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.080+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/196776856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 msgr2=0x5651f226ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.080+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/196776856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f226ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.080+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/196776856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f226f760 msgr2=0x5651f2278120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.080+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/196776856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f226f760 0x5651f2278120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.080+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/196776856 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651f2267260 con 0x5651f227a940 2024-09-19T09:57:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.082+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/196776856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22924c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009240 tx=0x7f9c9009ccd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f48c86fa99c56a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:22.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.082+0000 7f9c817fa640 1 -- 172.21.15.18:0/196776856 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90014030 con 0x5651f227a940 2024-09-19T09:57:22.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.083+0000 7f9c817fa640 1 -- 172.21.15.18:0/196776856 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c90004860 con 0x5651f227a940 2024-09-19T09:57:22.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.086+0000 7f9ca3be1740 1 -- 172.21.15.18:0/196776856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 msgr2=0x5651f22924c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:22.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.086+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/196776856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22924c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009240 tx=0x7f9c9009ccd0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.087+0000 7f9ca3be1740 1 -- 172.21.15.18:0/196776856 shutdown_connections 2024-09-19T09:57:22.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.087+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/196776856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f227a940 0x5651f22924c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.087+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/196776856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f226ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.087+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/196776856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f226f760 0x5651f2278120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.087+0000 7f9ca3be1740 1 -- 172.21.15.18:0/196776856 >> 172.21.15.18:0/196776856 conn(0x5651f226bcf0 msgr2=0x5651f226a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:22.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.087+0000 7f9ca3be1740 1 -- 172.21.15.18:0/196776856 shutdown_connections 2024-09-19T09:57:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.087+0000 7f9ca3be1740 1 -- 172.21.15.18:0/196776856 wait complete. 2024-09-19T09:57:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.088+0000 7f9ca3be1740 1 -- start start 2024-09-19T09:57:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.089+0000 7f9ca3be1740 1 Processor -- start 2024-09-19T09:57:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.090+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f226f760 0x5651f2282970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.090+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f2282eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.090+0000 7f9ca3be1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f228a7d0 0x5651f227f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.090+0000 7f9ca3be1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8800f8a0 con 0x5651f228a7d0 2024-09-19T09:57:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.090+0000 7f9ca3be1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8800f1d0 con 0x5651f2270080 2024-09-19T09:57:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.090+0000 7f9ca3be1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8800c410 con 0x5651f226f760 2024-09-19T09:57:22.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.090+0000 7f9ca3be1740 10 client.0 _ll_register_callbacks cb 0x7f9c9009d250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:22.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.092+0000 7f9c9b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f228a7d0 0x5651f227f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:22.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.092+0000 7f9c9b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f228a7d0 0x5651f227f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42682/0 (socket says 172.21.15.18:42682) 2024-09-19T09:57:22.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.092+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/4129182279 learned_addr learned my addr 172.21.15.18:0/4129182279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:22.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.093+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/4129182279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f226f760 msgr2=0x5651f2282970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:57:22.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.093+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f226f760 0x5651f2282970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.093+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/4129182279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 msgr2=0x5651f2282eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:57:22.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.093+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f2282eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:22.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.093+0000 7f9c9b7fe640 1 -- 172.21.15.18:0/4129182279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651f226c980 con 0x5651f228a7d0 2024-09-19T09:57:22.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.094+0000 7f9c9b7fe640 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f228a7d0 0x5651f227f940 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9c900a5570 tx=0x7f9c90098ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9d232bf86e1bef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:22.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.094+0000 7f9c7affd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.101+0000 7f9c7affd640 1 -- 172.21.15.18:0/4129182279 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9007f020 con 0x5651f228a7d0 2024-09-19T09:57:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.101+0000 7f9ca3be1740 1 -- 172.21.15.18:0/4129182279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5651f21e29d0 con 0x5651f228a7d0 2024-09-19T09:57:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.101+0000 7f9c7affd640 1 -- 172.21.15.18:0/4129182279 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9c9009bc20 con 0x5651f228a7d0 2024-09-19T09:57:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.103+0000 7f9c7affd640 1 -- 172.21.15.18:0/4129182279 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9c90014030 con 0x5651f228a7d0 2024-09-19T09:57:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.110+0000 7f9ca3be1740 10 client.16746 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.110+0000 7f9ca3be1740 1 -- 172.21.15.18:0/4129182279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5651f226c980 con 0x5651f228a7d0 2024-09-19T09:57:22.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.122+0000 7f9c7affd640 1 -- 172.21.15.18:0/4129182279 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5651f21e29d0 con 0x5651f228a7d0 2024-09-19T09:57:22.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.123+0000 7f9c7affd640 1 -- 172.21.15.18:0/4129182279 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9c90087120 con 0x5651f228a7d0 2024-09-19T09:57:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.124+0000 7f9ca3be1740 10 client.16746 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.124+0000 7f9ca3be1740 10 client.16746 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:57:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.124+0000 7f9ca3be1740 20 client.16746 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.124+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5651f22f5ce0 0x5651f22f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.124+0000 7f9ca3be1740 4 client.16746 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:57:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.124+0000 7f9ca3be1740 1 -- 172.21.15.18:0/4129182279 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x5651f21dcd20 con 0x5651f22f5ce0 2024-09-19T09:57:22.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.125+0000 7f9c9affd640 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5651f22f5ce0 0x5651f22f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:22.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.129+0000 7f9c9affd640 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5651f22f5ce0 0x5651f22f80d0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec3b42ba9c610ef server_cookie=e250b197363754ed in_seq=0 out_seq=0 2024-09-19T09:57:22.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:22.129+0000 7f9c7affd640 10 client.16746 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:22.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:22 smithi018 ceph-mon[30956]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 313 MiB/s wr, 889 op/s 2024-09-19T09:57:22.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:22 smithi049 ceph-mon[34858]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 313 MiB/s wr, 889 op/s 2024-09-19T09:57:22.662 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:22 smithi162 ceph-mon[35174]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 313 MiB/s wr, 889 op/s 2024-09-19T09:57:23.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.838+0000 7f9c7affd640 1 -- 172.21.15.18:0/4129182279 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5651f21dcd20 con 0x5651f22f5ce0 2024-09-19T09:57:23.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.838+0000 7f9c7affd640 10 client.16746 handle_command_reply: tid=0 2024-09-19T09:57:23.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.838+0000 7f9ca3be1740 1 client.16746 shutdown 2024-09-19T09:57:23.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.838+0000 7f9ca3be1740 1 -- 172.21.15.18:0/4129182279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f228a7d0 msgr2=0x5651f227f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:23.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.838+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f228a7d0 0x5651f227f940 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9c900a5570 tx=0x7f9c90098ad0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.839+0000 7f9ca3be1740 1 -- 172.21.15.18:0/4129182279 shutdown_connections 2024-09-19T09:57:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.839+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5651f22f5ce0 0x5651f22f80d0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.839+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5651f228a7d0 0x5651f227f940 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.839+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651f2270080 0x5651f2282eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.839+0000 7f9ca3be1740 1 --2- 172.21.15.18:0/4129182279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5651f226f760 0x5651f2282970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.839+0000 7f9c7affd640 0 client.16746 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.839+0000 7f9ca3be1740 1 -- 172.21.15.18:0/4129182279 >> 172.21.15.18:0/4129182279 conn(0x5651f226bcf0 msgr2=0x5651f22719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.839+0000 7f9ca3be1740 1 -- 172.21.15.18:0/4129182279 shutdown_connections 2024-09-19T09:57:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.839+0000 7f9ca3be1740 1 -- 172.21.15.18:0/4129182279 wait complete. 2024-09-19T09:57:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.839+0000 7f9ca3be1740 20 client.16746 trim_cache size 0 max 16384 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 22, 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout: "df64d7a0": { 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 22, 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:57:23.843 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 149.8, 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:23.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:23.845 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:23.845 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:23.845 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:57:23.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 -- 172.21.15.18:0/1858847634 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c840a3480 msgr2=0x7f9c840a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:23.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c840a3480 0x7f9c840a5940 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0096c0 tx=0x7f9c8c009580 comp rx=0 tx=0).stop 2024-09-19T09:57:23.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 -- 172.21.15.18:0/1858847634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9c11b140 msgr2=0x7f9c9c114e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:23.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9c11b140 0x7f9c9c114e60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c90005fd0 tx=0x7f9c9000dae0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 -- 172.21.15.18:0/1858847634 shutdown_connections 2024-09-19T09:57:23.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9c840a3480 0x7f9c840a5940 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c9c11b140 0x7f9c9c114e60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c9c109830 0x7f9c9c114920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 --2- 172.21.15.18:0/1858847634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c9c109450 0x7f9c9c11a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 -- 172.21.15.18:0/1858847634 >> 172.21.15.18:0/1858847634 conn(0x7f9c9c06e140 msgr2=0x7f9c9c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:23.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 -- 172.21.15.18:0/1858847634 shutdown_connections 2024-09-19T09:57:23.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:23.840+0000 7f9ca1808640 1 -- 172.21.15.18:0/1858847634 wait complete. 2024-09-19T09:57:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa23fff640 1 -- 172.21.15.18:0/3683061156 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b86f965820 con 0x55b86fab2c60 2024-09-19T09:57:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa23fff640 10 client.26186 handle_command_reply: tid=0 2024-09-19T09:57:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa4da16740 1 client.26186 shutdown 2024-09-19T09:57:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa4da16740 1 -- 172.21.15.18:0/3683061156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 msgr2=0x55b86fa58d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa4da16740 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 0x55b86fa58d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa380037b0 tx=0x7faa38009580 comp rx=0 tx=0).stop 2024-09-19T09:57:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa4da16740 1 -- 172.21.15.18:0/3683061156 shutdown_connections 2024-09-19T09:57:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa4da16740 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b86fab2c60 0x55b86fab5080 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa4da16740 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b86fa5a1e0 0x55b86fa5a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa4da16740 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b86fa314b0 0x55b86fa59240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa4da16740 1 --2- 172.21.15.18:0/3683061156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b86fa30b70 0x55b86fa58d00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa4da16740 1 -- 172.21.15.18:0/3683061156 >> 172.21.15.18:0/3683061156 conn(0x55b86fa2c1e0 msgr2=0x55b86fa2d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.841+0000 7faa23fff640 0 client.26186 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.842+0000 7faa4da16740 1 -- 172.21.15.18:0/3683061156 shutdown_connections 2024-09-19T09:57:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.842+0000 7faa4da16740 1 -- 172.21.15.18:0/3683061156 wait complete. 2024-09-19T09:57:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.842+0000 7faa4da16740 20 client.26186 trim_cache size 0 max 16384 2024-09-19T09:57:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:57:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:57:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:57:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:57:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.843+0000 7faa4993d640 1 -- 172.21.15.18:0/2656596397 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa2c0a32c0 msgr2=0x7faa2c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.843+0000 7faa4993d640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa2c0a32c0 0x7faa2c0a5780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa34005fd0 tx=0x7faa34013400 comp rx=0 tx=0).stop 2024-09-19T09:57:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.844+0000 7faa4993d640 1 -- 172.21.15.18:0/2656596397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa44072e30 msgr2=0x7faa44084dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.844+0000 7faa4993d640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa44072e30 0x7faa44084dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa38000c00 tx=0x7faa38033d10 comp rx=0 tx=0).stop 2024-09-19T09:57:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.844+0000 7faa4993d640 1 -- 172.21.15.18:0/2656596397 shutdown_connections 2024-09-19T09:57:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.844+0000 7faa4993d640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faa2c0a32c0 0x7faa2c0a5780 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.844+0000 7faa4993d640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa441095e0 0x7faa44083940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.844+0000 7faa4993d640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa440737f0 0x7faa44083400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.844+0000 7faa4993d640 1 --2- 172.21.15.18:0/2656596397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa44072e30 0x7faa44084dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.844+0000 7faa4993d640 1 -- 172.21.15.18:0/2656596397 >> 172.21.15.18:0/2656596397 conn(0x7faa4406eb50 msgr2=0x7faa44076500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.844+0000 7faa4993d640 1 -- 172.21.15.18:0/2656596397 shutdown_connections 2024-09-19T09:57:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:23.844+0000 7faa4993d640 1 -- 172.21.15.18:0/2656596397 wait complete. 2024-09-19T09:57:24.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:24 smithi018 ceph-mon[30956]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 522 MiB/s wr, 1.50k op/s 2024-09-19T09:57:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:24 smithi049 ceph-mon[34858]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 522 MiB/s wr, 1.50k op/s 2024-09-19T09:57:24.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:24 smithi162 ceph-mon[35174]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 522 MiB/s wr, 1.50k op/s 2024-09-19T09:57:24.893 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'df64d7a0', quiesce took 9.8 seconds. Will release after: 20.0 2024-09-19T09:57:26.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:26 smithi018 ceph-mon[30956]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 611 MiB/s wr, 1.65k op/s 2024-09-19T09:57:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:26 smithi049 ceph-mon[34858]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 611 MiB/s wr, 1.65k op/s 2024-09-19T09:57:26.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:26 smithi162 ceph-mon[35174]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 611 MiB/s wr, 1.65k op/s 2024-09-19T09:57:28.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:28 smithi018 ceph-mon[30956]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 640 MiB/s wr, 1.68k op/s 2024-09-19T09:57:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:28 smithi049 ceph-mon[34858]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 640 MiB/s wr, 1.68k op/s 2024-09-19T09:57:28.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:28 smithi162 ceph-mon[35174]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 640 MiB/s wr, 1.68k op/s 2024-09-19T09:57:29.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:57:30.012 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:30.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:30 smithi018 ceph-mon[30956]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 579 MiB/s wr, 1.51k op/s 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.468+0000 7f32e139d640 1 -- 172.21.15.18:0/2975721464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32dc102790 msgr2=0x7f32dc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.468+0000 7f32e139d640 1 --2- 172.21.15.18:0/2975721464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32dc102790 0x7f32dc1067e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009900 tx=0x7f32d002a410 comp rx=0 tx=0).stop 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.468+0000 7f32e139d640 1 -- 172.21.15.18:0/2975721464 shutdown_connections 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.468+0000 7f32e139d640 1 --2- 172.21.15.18:0/2975721464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32dc106f10 0x7f32dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.468+0000 7f32e139d640 1 --2- 172.21.15.18:0/2975721464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32dc102790 0x7f32dc1067e0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.468+0000 7f32e139d640 1 --2- 172.21.15.18:0/2975721464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32dc101de0 0x7f32dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.468+0000 7f32e139d640 1 -- 172.21.15.18:0/2975721464 >> 172.21.15.18:0/2975721464 conn(0x7f32dc0fd8c0 msgr2=0x7f32dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.468+0000 7f32e139d640 1 -- 172.21.15.18:0/2975721464 shutdown_connections 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.468+0000 7f32e139d640 1 -- 172.21.15.18:0/2975721464 wait complete. 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.469+0000 7f32e139d640 1 Processor -- start 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.469+0000 7f32e139d640 1 -- start start 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.469+0000 7f32e139d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32dc101de0 0x7f32dc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.469+0000 7f32e139d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32dc102790 0x7f32dc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.469+0000 7f32e139d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32dc106f10 0x7f32dc19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.469+0000 7f32e139d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc111fc0 con 0x7f32dc102790 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.469+0000 7f32e139d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc111e40 con 0x7f32dc101de0 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.469+0000 7f32e139d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc112140 con 0x7f32dc106f10 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.469+0000 7f32da7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32dc102790 0x7f32dc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.469+0000 7f32da7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32dc102790 0x7f32dc1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53432/0 (socket says 172.21.15.18:53432) 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32da7fc640 1 -- 172.21.15.18:0/26505855 learned_addr learned my addr 172.21.15.18:0/26505855 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32db7fe640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32dc106f10 0x7f32dc19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32daffd640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32dc101de0 0x7f32dc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32da7fc640 1 -- 172.21.15.18:0/26505855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32dc106f10 msgr2=0x7f32dc19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32da7fc640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32dc106f10 0x7f32dc19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32da7fc640 1 -- 172.21.15.18:0/26505855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32dc101de0 msgr2=0x7f32dc198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:30.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32da7fc640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32dc101de0 0x7f32dc198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32da7fc640 1 -- 172.21.15.18:0/26505855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc19d410 con 0x7f32dc102790 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32daffd640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32dc101de0 0x7f32dc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32da7fc640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32dc102790 0x7f32dc1989a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f32d0006010 tx=0x7f32d0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32c3fff640 1 -- 172.21.15.18:0/26505855 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d003f070 con 0x7f32dc102790 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32e139d640 1 -- 172.21.15.18:0/26505855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32dc19d6a0 con 0x7f32dc102790 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32c3fff640 1 -- 172.21.15.18:0/26505855 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32d0031c90 con 0x7f32dc102790 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32c3fff640 1 -- 172.21.15.18:0/26505855 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0035030 con 0x7f32dc102790 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.470+0000 7f32e139d640 1 -- 172.21.15.18:0/26505855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32dc1a4fe0 con 0x7f32dc102790 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32c3fff640 1 -- 172.21.15.18:0/26505855 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f32d0042070 con 0x7f32dc102790 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32e3776740 1 Processor -- start 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32e3776740 1 -- start start 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32e3776740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dceb6380 0x55b4dceb6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32e3776740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32e3776740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dcec5a90 0x55b4dcec7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32e3776740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b4dce1c2e0 con 0x55b4dceb6ca0 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32e3776740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b4dcdc3ce0 con 0x55b4dcec5a90 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32e3776740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b4dce182a0 con 0x55b4dceb6380 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53442/0 (socket says 172.21.15.18:53442) 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.473+0000 7f32daffd640 1 -- 172.21.15.18:0/309814138 learned_addr learned my addr 172.21.15.18:0/309814138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32db7fe640 1 --2- 172.21.15.18:0/309814138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dceb6380 0x55b4dceb6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32da7fc640 1 --2- 172.21.15.18:0/309814138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dcec5a90 0x55b4dcec7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32c3fff640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32c40a3240 0x7f32c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32db7fe640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32c40a3240 0x7f32c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32daffd640 1 -- 172.21.15.18:0/309814138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dceb6380 msgr2=0x55b4dceb6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32daffd640 1 --2- 172.21.15.18:0/309814138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dceb6380 0x55b4dceb6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32daffd640 1 -- 172.21.15.18:0/309814138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dcec5a90 msgr2=0x55b4dcec7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32daffd640 1 --2- 172.21.15.18:0/309814138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dcec5a90 0x55b4dcec7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32daffd640 1 -- 172.21.15.18:0/309814138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4dcda8440 con 0x55b4dceb6ca0 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32c3fff640 1 -- 172.21.15.18:0/26505855 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f32d00f01c0 con 0x7f32dc102790 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32daffd640 1 --2- 172.21.15.18:0/309814138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec5550 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00cca0 tx=0x7f32cc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfc6783dff02f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32db7fe640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32c40a3240 0x7f32c40a5700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f32d400a2c0 tx=0x7f32d4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32c17fa640 1 -- 172.21.15.18:0/309814138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc005220 con 0x55b4dceb6ca0 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32c17fa640 1 -- 172.21.15.18:0/309814138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32cc004c80 con 0x55b4dceb6ca0 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.474+0000 7f32c17fa640 1 -- 172.21.15.18:0/309814138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0108f0 con 0x55b4dceb6ca0 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.475+0000 7f32e3776740 1 -- 172.21.15.18:0/309814138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 msgr2=0x55b4dcec5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.475+0000 7f32e3776740 1 --2- 172.21.15.18:0/309814138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec5550 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00cca0 tx=0x7f32cc00e720 comp rx=0 tx=0).stop 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.475+0000 7f32e3776740 1 -- 172.21.15.18:0/309814138 shutdown_connections 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.475+0000 7f32e3776740 1 --2- 172.21.15.18:0/309814138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dcec5a90 0x55b4dcec7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.475+0000 7f32e3776740 1 --2- 172.21.15.18:0/309814138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec5550 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.475+0000 7f32e3776740 1 --2- 172.21.15.18:0/309814138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dceb6380 0x55b4dceb6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.475+0000 7f32e3776740 1 -- 172.21.15.18:0/309814138 >> 172.21.15.18:0/309814138 conn(0x55b4dceb2a30 msgr2=0x55b4dceb2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.475+0000 7f32e3776740 1 -- 172.21.15.18:0/309814138 shutdown_connections 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.475+0000 7f32e3776740 1 -- 172.21.15.18:0/309814138 wait complete. 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32e3776740 1 -- start start 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32e3776740 1 Processor -- start 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32e3776740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dceb6380 0x55b4dcec53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32e3776740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32e3776740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dcec5a90 0x55b4dcec2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32e3776740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b4dcec8660 con 0x55b4dceb6ca0 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32e3776740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b4dcdd7050 con 0x55b4dcec5a90 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32e3776740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b4dcec87e0 con 0x55b4dceb6380 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32e3776740 10 client.0 _ll_register_callbacks cb 0x55b4dce17160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32da7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32da7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53446/0 (socket says 172.21.15.18:53446) 2024-09-19T09:57:30.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32da7fc640 1 -- 172.21.15.18:0/3883640794 learned_addr learned my addr 172.21.15.18:0/3883640794 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:30.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32daffd640 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dceb6380 0x55b4dcec53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32db7fe640 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dcec5a90 0x55b4dcec2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.476+0000 7f32da7fc640 1 -- 172.21.15.18:0/3883640794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dceb6380 msgr2=0x55b4dcec53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:30.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32da7fc640 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dceb6380 0x55b4dcec53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32da7fc640 1 -- 172.21.15.18:0/3883640794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dcec5a90 msgr2=0x55b4dcec2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:30.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32da7fc640 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dcec5a90 0x55b4dcec2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32da7fc640 1 -- 172.21.15.18:0/3883640794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4dcb8d3c0 con 0x55b4dceb6ca0 2024-09-19T09:57:30.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32da7fc640 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec26a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f32d00bc7a0 tx=0x7f32d0005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672bef6bce38e9a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:30.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32beff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:30.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32beff5640 1 -- 172.21.15.18:0/3883640794 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0049070 con 0x55b4dceb6ca0 2024-09-19T09:57:30.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32beff5640 1 -- 172.21.15.18:0/3883640794 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f32d003b5f0 con 0x55b4dceb6ca0 2024-09-19T09:57:30.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32e3776740 1 -- 172.21.15.18:0/3883640794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32cc004c80 con 0x55b4dceb6ca0 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32beff5640 1 -- 172.21.15.18:0/3883640794 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f32d00da050 con 0x55b4dceb6ca0 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32e3776740 10 client.16758 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32e3776740 1 -- 172.21.15.18:0/3883640794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4dced4070 con 0x55b4dceb6ca0 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32beff5640 1 -- 172.21.15.18:0/3883640794 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32cc004c80 con 0x55b4dceb6ca0 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32beff5640 1 -- 172.21.15.18:0/3883640794 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f32d00bca70 con 0x55b4dceb6ca0 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32e3776740 10 client.16758 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.477+0000 7f32e3776740 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.478+0000 7f32e3776740 20 client.16758 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.478+0000 7f32e3776740 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b4dced5410 0x55b4dced7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.478+0000 7f32e3776740 4 client.16758 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.478+0000 7f32e3776740 1 -- 172.21.15.18:0/3883640794 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4dce29850 con 0x55b4dced5410 2024-09-19T09:57:30.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.478+0000 7f32daffd640 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b4dced5410 0x55b4dced7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.478+0000 7f32daffd640 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b4dced5410 0x55b4dced7880 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82569207f9c4ee7 server_cookie=13123b94d7c2cd49 in_seq=0 out_seq=0 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.478+0000 7f32beff5640 10 client.16758 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32beff5640 1 -- 172.21.15.18:0/3883640794 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4dce29850 con 0x55b4dced5410 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32beff5640 10 client.16758 handle_command_reply: tid=0 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 client.16758 shutdown 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 -- 172.21.15.18:0/3883640794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 msgr2=0x55b4dcec26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec26a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f32d00bc7a0 tx=0x7f32d0005d50 comp rx=0 tx=0).stop 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 -- 172.21.15.18:0/3883640794 shutdown_connections 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b4dced5410 0x55b4dced7880 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dcec5a90 0x55b4dcec2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6ca0 0x55b4dcec26a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 --2- 172.21.15.18:0/3883640794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dceb6380 0x55b4dcec53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 -- 172.21.15.18:0/3883640794 >> 172.21.15.18:0/3883640794 conn(0x55b4dceb2a30 msgr2=0x55b4dceb8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:30.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32beff5640 0 client.16758 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:30.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 -- 172.21.15.18:0/3883640794 shutdown_connections 2024-09-19T09:57:30.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 1 -- 172.21.15.18:0/3883640794 wait complete. 2024-09-19T09:57:30.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.479+0000 7f32e3776740 20 client.16758 trim_cache size 0 max 16384 2024-09-19T09:57:30.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.496+0000 7f32e3776740 1 Processor -- start 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.496+0000 7f32e3776740 1 -- start start 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32e3776740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dced1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32e3776740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 0x55b4dcebdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32e3776740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dcec5a90 0x55b4dcedd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32e3776740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc1ab2e0 con 0x55b4dceb6380 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32e3776740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc1ace20 con 0x55b4dceb6ca0 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32e3776740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc1ab9b0 con 0x55b4dcec5a90 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dced1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dced1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53460/0 (socket says 172.21.15.18:53460) 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32daffd640 1 -- 172.21.15.18:0/2900089726 learned_addr learned my addr 172.21.15.18:0/2900089726 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:30.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32db7fe640 1 --2- 172.21.15.18:0/2900089726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dcec5a90 0x55b4dcedd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32da7fc640 1 --2- 172.21.15.18:0/2900089726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 0x55b4dcebdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32daffd640 1 -- 172.21.15.18:0/2900089726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dcec5a90 msgr2=0x55b4dcedd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32daffd640 1 --2- 172.21.15.18:0/2900089726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dcec5a90 0x55b4dcedd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32daffd640 1 -- 172.21.15.18:0/2900089726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 msgr2=0x55b4dcebdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32daffd640 1 --2- 172.21.15.18:0/2900089726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 0x55b4dcebdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32daffd640 1 -- 172.21.15.18:0/2900089726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4dcec5710 con 0x55b4dceb6380 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32da7fc640 1 --2- 172.21.15.18:0/2900089726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 0x55b4dcebdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.497+0000 7f32daffd640 1 --2- 172.21.15.18:0/2900089726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dced1900 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f32cc0104a0 tx=0x7f32cc00c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4eda743294d0d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32c0ff9640 1 -- 172.21.15.18:0/2900089726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc004860 con 0x55b4dceb6380 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32c0ff9640 1 -- 172.21.15.18:0/2900089726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32cc0054e0 con 0x55b4dceb6380 2024-09-19T09:57:30.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32c0ff9640 1 -- 172.21.15.18:0/2900089726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc010960 con 0x55b4dceb6380 2024-09-19T09:57:30.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32e3776740 1 -- 172.21.15.18:0/2900089726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 msgr2=0x55b4dced1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:30.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32e3776740 1 --2- 172.21.15.18:0/2900089726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dced1900 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f32cc0104a0 tx=0x7f32cc00c590 comp rx=0 tx=0).stop 2024-09-19T09:57:30.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32e3776740 1 -- 172.21.15.18:0/2900089726 shutdown_connections 2024-09-19T09:57:30.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32e3776740 1 --2- 172.21.15.18:0/2900089726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dcec5a90 0x55b4dcedd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32e3776740 1 --2- 172.21.15.18:0/2900089726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 0x55b4dcebdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32e3776740 1 --2- 172.21.15.18:0/2900089726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dced1900 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32e3776740 1 -- 172.21.15.18:0/2900089726 >> 172.21.15.18:0/2900089726 conn(0x55b4dceb2a30 msgr2=0x55b4dcebd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32e3776740 1 -- 172.21.15.18:0/2900089726 shutdown_connections 2024-09-19T09:57:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.498+0000 7f32e3776740 1 -- 172.21.15.18:0/2900089726 wait complete. 2024-09-19T09:57:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32e3776740 1 -- start start 2024-09-19T09:57:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32e3776740 1 Processor -- start 2024-09-19T09:57:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32e3776740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dcecde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32e3776740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 0x55b4dcebf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32e3776740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dcec5a90 0x55b4dcebf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32e3776740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc1ac750 con 0x55b4dceb6380 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32e3776740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc1ac080 con 0x55b4dceb6ca0 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32e3776740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc1a92c0 con 0x55b4dcec5a90 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32e3776740 10 client.0 _ll_register_callbacks cb 0x7f32d0005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dcecde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dcecde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53464/0 (socket says 172.21.15.18:53464) 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32daffd640 1 -- 172.21.15.18:0/1592298493 learned_addr learned my addr 172.21.15.18:0/1592298493 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32db7fe640 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dcec5a90 0x55b4dcebf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32da7fc640 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 0x55b4dcebf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32daffd640 1 -- 172.21.15.18:0/1592298493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dcec5a90 msgr2=0x55b4dcebf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32daffd640 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dcec5a90 0x55b4dcebf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32daffd640 1 -- 172.21.15.18:0/1592298493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 msgr2=0x55b4dcebf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:30.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32daffd640 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 0x55b4dcebf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.499+0000 7f32daffd640 1 -- 172.21.15.18:0/1592298493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4dcebfb00 con 0x55b4dceb6380 2024-09-19T09:57:30.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.500+0000 7f32daffd640 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dcecde70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00f010 tx=0x7f32cc00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb46d637c21c1603 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:30.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.500+0000 7f32beff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:30.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.500+0000 7f32beff5640 1 -- 172.21.15.18:0/1592298493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc005690 con 0x55b4dceb6380 2024-09-19T09:57:30.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.500+0000 7f32beff5640 1 -- 172.21.15.18:0/1592298493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f32cc004660 con 0x55b4dceb6380 2024-09-19T09:57:30.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.500+0000 7f32e3776740 1 -- 172.21.15.18:0/1592298493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32cc0054e0 con 0x55b4dceb6380 2024-09-19T09:57:30.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.500+0000 7f32beff5640 1 -- 172.21.15.18:0/1592298493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f32cc004860 con 0x55b4dceb6380 2024-09-19T09:57:30.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.500+0000 7f32e3776740 10 client.16764 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:30.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.500+0000 7f32e3776740 1 -- 172.21.15.18:0/1592298493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4dcf3fdb0 con 0x55b4dceb6380 2024-09-19T09:57:30.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.500+0000 7f32beff5640 1 -- 172.21.15.18:0/1592298493 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32cc0054e0 con 0x55b4dceb6380 2024-09-19T09:57:30.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.501+0000 7f32beff5640 1 -- 172.21.15.18:0/1592298493 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f32cc026480 con 0x55b4dceb6380 2024-09-19T09:57:30.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.501+0000 7f32e3776740 10 client.16764 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:30.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.501+0000 7f32e3776740 10 client.16764 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:30.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.501+0000 7f32e3776740 20 client.16764 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:30.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.501+0000 7f32e3776740 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b4dcf402c0 0x55b4dcf426b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:30.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.501+0000 7f32e3776740 4 client.16764 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:57:30.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.501+0000 7f32e3776740 1 -- 172.21.15.18:0/1592298493 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b4dce23d60 con 0x55b4dcf402c0 2024-09-19T09:57:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.501+0000 7f32da7fc640 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b4dcf402c0 0x55b4dcf426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32da7fc640 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b4dcf402c0 0x55b4dcf426b0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb2dbec06411d33 server_cookie=1fa0b863e2d0db00 in_seq=0 out_seq=0 2024-09-19T09:57:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32beff5640 10 client.16764 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32beff5640 1 -- 172.21.15.18:0/1592298493 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b4dce23d60 con 0x55b4dcf402c0 2024-09-19T09:57:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32beff5640 10 client.16764 handle_command_reply: tid=0 2024-09-19T09:57:30.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 client.16764 shutdown 2024-09-19T09:57:30.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 -- 172.21.15.18:0/1592298493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 msgr2=0x55b4dcecde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:30.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dcecde70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00f010 tx=0x7f32cc00c750 comp rx=0 tx=0).stop 2024-09-19T09:57:30.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 -- 172.21.15.18:0/1592298493 shutdown_connections 2024-09-19T09:57:30.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b4dcf402c0 0x55b4dcf426b0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4dcec5a90 0x55b4dcebf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b4dceb6ca0 0x55b4dcebf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32beff5640 0 client.16764 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:30.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 --2- 172.21.15.18:0/1592298493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4dceb6380 0x55b4dcecde70 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 -- 172.21.15.18:0/1592298493 >> 172.21.15.18:0/1592298493 conn(0x55b4dceb2a30 msgr2=0x55b4dcebdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:30.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 -- 172.21.15.18:0/1592298493 shutdown_connections 2024-09-19T09:57:30.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 1 -- 172.21.15.18:0/1592298493 wait complete. 2024-09-19T09:57:30.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.502+0000 7f32e3776740 20 client.16764 trim_cache size 0 max 16384 2024-09-19T09:57:30.513 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:57:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T09:57:30.514 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T09:57:30.514 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:57:30.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 -- 172.21.15.18:0/26505855 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32c40a3240 msgr2=0x7f32c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:30.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32c40a3240 0x7f32c40a5700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f32d400a2c0 tx=0x7f32d4004ab0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 -- 172.21.15.18:0/26505855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32dc102790 msgr2=0x7f32dc1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32dc102790 0x7f32dc1989a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f32d0006010 tx=0x7f32d0003ba0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 -- 172.21.15.18:0/26505855 shutdown_connections 2024-09-19T09:57:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f32c40a3240 0x7f32c40a5700 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32dc106f10 0x7f32dc19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32dc102790 0x7f32dc1989a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 --2- 172.21.15.18:0/26505855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32dc101de0 0x7f32dc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 -- 172.21.15.18:0/26505855 >> 172.21.15.18:0/26505855 conn(0x7f32dc0fd8c0 msgr2=0x7f32dc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 -- 172.21.15.18:0/26505855 shutdown_connections 2024-09-19T09:57:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:30.503+0000 7f32e139d640 1 -- 172.21.15.18:0/26505855 wait complete. 2024-09-19T09:57:30.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:30 smithi049 ceph-mon[34858]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 579 MiB/s wr, 1.51k op/s 2024-09-19T09:57:30.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:30 smithi162 ceph-mon[35174]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 579 MiB/s wr, 1.51k op/s 2024-09-19T09:57:31.269 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:57:31.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:57:31.529 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:31.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.975+0000 7fce016da640 1 -- 172.21.15.18:0/4067286097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc101de0 msgr2=0x7fcdfc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:31.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.975+0000 7fce016da640 1 --2- 172.21.15.18:0/4067286097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc101de0 0x7fcdfc1021c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009900 tx=0x7fcdec02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:57:31.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.975+0000 7fce016da640 1 -- 172.21.15.18:0/4067286097 shutdown_connections 2024-09-19T09:57:31.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.975+0000 7fce016da640 1 --2- 172.21.15.18:0/4067286097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc106f10 0x7fcdfc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:31.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.975+0000 7fce016da640 1 --2- 172.21.15.18:0/4067286097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc102790 0x7fcdfc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:31.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.975+0000 7fce016da640 1 --2- 172.21.15.18:0/4067286097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc101de0 0x7fcdfc1021c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:31.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.975+0000 7fce016da640 1 -- 172.21.15.18:0/4067286097 >> 172.21.15.18:0/4067286097 conn(0x7fcdfc0fd8c0 msgr2=0x7fcdfc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.975+0000 7fce016da640 1 -- 172.21.15.18:0/4067286097 shutdown_connections 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.975+0000 7fce016da640 1 -- 172.21.15.18:0/4067286097 wait complete. 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.975+0000 7fce016da640 1 Processor -- start 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fce016da640 1 -- start start 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fce016da640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc101de0 0x7fcdfc198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fce016da640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc102790 0x7fcdfc198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fce016da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc106f10 0x7fcdfc19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fce016da640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc111f30 con 0x7fcdfc102790 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fce016da640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc111db0 con 0x7fcdfc101de0 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fce016da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc1120b0 con 0x7fcdfc106f10 2024-09-19T09:57:31.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfa7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc102790 0x7fcdfc198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfa7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc102790 0x7fcdfc198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53494/0 (socket says 172.21.15.18:53494) 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfa7fc640 1 -- 172.21.15.18:0/3732802443 learned_addr learned my addr 172.21.15.18:0/3732802443 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfaffd640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc101de0 0x7fcdfc198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfb7fe640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc106f10 0x7fcdfc19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfa7fc640 1 -- 172.21.15.18:0/3732802443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc106f10 msgr2=0x7fcdfc19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfa7fc640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc106f10 0x7fcdfc19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfa7fc640 1 -- 172.21.15.18:0/3732802443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc101de0 msgr2=0x7fcdfc198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfa7fc640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc101de0 0x7fcdfc198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfa7fc640 1 -- 172.21.15.18:0/3732802443 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdfc19d3e0 con 0x7fcdfc102790 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.976+0000 7fcdfb7fe640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc106f10 0x7fcdfc19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.977+0000 7fcdfa7fc640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc102790 0x7fcdfc198970 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000c920 tx=0x7fcdf000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.977+0000 7fcde3fff640 1 -- 172.21.15.18:0/3732802443 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0007c70 con 0x7fcdfc102790 2024-09-19T09:57:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.977+0000 7fce016da640 1 -- 172.21.15.18:0/3732802443 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdfc19d6d0 con 0x7fcdfc102790 2024-09-19T09:57:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.977+0000 7fcde3fff640 1 -- 172.21.15.18:0/3732802443 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdf0007e10 con 0x7fcdfc102790 2024-09-19T09:57:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.977+0000 7fcde3fff640 1 -- 172.21.15.18:0/3732802443 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0018890 con 0x7fcdfc102790 2024-09-19T09:57:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.977+0000 7fce016da640 1 -- 172.21.15.18:0/3732802443 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdfc1a4fb0 con 0x7fcdfc102790 2024-09-19T09:57:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.978+0000 7fce016da640 1 -- 172.21.15.18:0/3732802443 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdfc1021c0 con 0x7fcdfc102790 2024-09-19T09:57:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.979+0000 7fcde3fff640 1 -- 172.21.15.18:0/3732802443 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcdf0018a50 con 0x7fcdfc102790 2024-09-19T09:57:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.980+0000 7fcde3fff640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcde40a3240 0x7fcde40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.980+0000 7fcdfaffd640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcde40a3240 0x7fcde40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.980+0000 7fcde3fff640 1 -- 172.21.15.18:0/3732802443 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcdf00cfcc0 con 0x7fcdfc102790 2024-09-19T09:57:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.980+0000 7fcdfaffd640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcde40a3240 0x7fcde40a5700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcdec000c00 tx=0x7fcdec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:31.983+0000 7fcde3fff640 1 -- 172.21.15.18:0/3732802443 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcdf0014030 con 0x7fcdfc102790 2024-09-19T09:57:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.195+0000 7fce016da640 1 -- 172.21.15.18:0/3732802443 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcdfc10a120 con 0x7fcdfc102790 2024-09-19T09:57:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.196+0000 7fcde3fff640 1 -- 172.21.15.18:0/3732802443 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fcdf009caa0 con 0x7fcdfc102790 2024-09-19T09:57:32.199 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:57:32.199 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:57:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:57:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.198+0000 7fce016da640 1 -- 172.21.15.18:0/3732802443 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcde40a3240 msgr2=0x7fcde40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.198+0000 7fce016da640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcde40a3240 0x7fcde40a5700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcdec000c00 tx=0x7fcdec0058d0 comp rx=0 tx=0).stop 2024-09-19T09:57:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.198+0000 7fce016da640 1 -- 172.21.15.18:0/3732802443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc102790 msgr2=0x7fcdfc198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.198+0000 7fce016da640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc102790 0x7fcdfc198970 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000c920 tx=0x7fcdf000cde0 comp rx=0 tx=0).stop 2024-09-19T09:57:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.198+0000 7fce016da640 1 -- 172.21.15.18:0/3732802443 shutdown_connections 2024-09-19T09:57:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.198+0000 7fce016da640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcde40a3240 0x7fcde40a5700 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.198+0000 7fce016da640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc106f10 0x7fcdfc19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.198+0000 7fce016da640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc102790 0x7fcdfc198970 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.198+0000 7fce016da640 1 --2- 172.21.15.18:0/3732802443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc101de0 0x7fcdfc198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.198+0000 7fce016da640 1 -- 172.21.15.18:0/3732802443 >> 172.21.15.18:0/3732802443 conn(0x7fcdfc0fd8c0 msgr2=0x7fcdfc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.199+0000 7fce016da640 1 -- 172.21.15.18:0/3732802443 shutdown_connections 2024-09-19T09:57:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:32.199+0000 7fce016da640 1 -- 172.21.15.18:0/3732802443 wait complete. 2024-09-19T09:57:32.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:32 smithi018 ceph-mon[30956]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 525 MiB/s wr, 1.34k op/s 2024-09-19T09:57:32.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:32 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3732802443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:32.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:32 smithi049 ceph-mon[34858]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 525 MiB/s wr, 1.34k op/s 2024-09-19T09:57:32.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:32 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3732802443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:32.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:32 smithi162 ceph-mon[35174]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 525 MiB/s wr, 1.34k op/s 2024-09-19T09:57:32.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:32 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3732802443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:33.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:57:33.376 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:33.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.985+0000 7f99074f9640 1 -- 172.21.15.18:0/1551336452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99001002f0 msgr2=0x7f99001006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:33.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.985+0000 7f99074f9640 1 --2- 172.21.15.18:0/1551336452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99001002f0 0x7f99001006d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009930 tx=0x7f98fc02a420 comp rx=0 tx=0).stop 2024-09-19T09:57:33.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.985+0000 7f99074f9640 1 -- 172.21.15.18:0/1551336452 shutdown_connections 2024-09-19T09:57:33.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.985+0000 7f99074f9640 1 --2- 172.21.15.18:0/1551336452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9900106f50 0x7f990010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:33.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.985+0000 7f99074f9640 1 --2- 172.21.15.18:0/1551336452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9900100ca0 0x7f9900106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:33.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.985+0000 7f99074f9640 1 --2- 172.21.15.18:0/1551336452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99001002f0 0x7f99001006d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:33.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.985+0000 7f99074f9640 1 -- 172.21.15.18:0/1551336452 >> 172.21.15.18:0/1551336452 conn(0x7f9900077210 msgr2=0x7f99000fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:33.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.986+0000 7f99074f9640 1 -- 172.21.15.18:0/1551336452 shutdown_connections 2024-09-19T09:57:33.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.986+0000 7f99074f9640 1 -- 172.21.15.18:0/1551336452 wait complete. 2024-09-19T09:57:33.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.986+0000 7f99074f9640 1 Processor -- start 2024-09-19T09:57:33.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.986+0000 7f99074f9640 1 -- start start 2024-09-19T09:57:33.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.986+0000 7f99074f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99001002f0 0x7f99001985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:33.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.986+0000 7f99074f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9900100ca0 0x7f9900198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:33.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.986+0000 7f99074f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9900106f50 0x7f990019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.986+0000 7f99074f9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9900112000 con 0x7f99001002f0 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.986+0000 7f99074f9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9900111e80 con 0x7f9900106f50 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.986+0000 7f99074f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9900112180 con 0x7f9900100ca0 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9905295640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99001002f0 0x7f99001985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9905295640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99001002f0 0x7f99001985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53512/0 (socket says 172.21.15.18:53512) 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9905295640 1 -- 172.21.15.18:0/290230398 learned_addr learned my addr 172.21.15.18:0/290230398 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9905a96640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9900106f50 0x7f990019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9904a94640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9900100ca0 0x7f9900198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9905295640 1 -- 172.21.15.18:0/290230398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9900100ca0 msgr2=0x7f9900198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9905295640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9900100ca0 0x7f9900198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9905295640 1 -- 172.21.15.18:0/290230398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9900106f50 msgr2=0x7f990019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9905295640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9900106f50 0x7f990019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:33.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9905295640 1 -- 172.21.15.18:0/290230398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990019d550 con 0x7f99001002f0 2024-09-19T09:57:33.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f9905295640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99001002f0 0x7f99001985a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009a50 tx=0x7f98fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:33.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f98f67fc640 1 -- 172.21.15.18:0/290230398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc03f030 con 0x7f99001002f0 2024-09-19T09:57:33.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f98f67fc640 1 -- 172.21.15.18:0/290230398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98fc003ce0 con 0x7f99001002f0 2024-09-19T09:57:33.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f99074f9640 1 -- 172.21.15.18:0/290230398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990019d7e0 con 0x7f99001002f0 2024-09-19T09:57:33.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.987+0000 7f98f67fc640 1 -- 172.21.15.18:0/290230398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc035070 con 0x7f99001002f0 2024-09-19T09:57:33.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.988+0000 7f99074f9640 1 -- 172.21.15.18:0/290230398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99001a5120 con 0x7f99001002f0 2024-09-19T09:57:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.990+0000 7f98f67fc640 1 -- 172.21.15.18:0/290230398 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f98fc042030 con 0x7f99001002f0 2024-09-19T09:57:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.990+0000 7f99098d2740 1 Processor -- start 2024-09-19T09:57:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.990+0000 7f99098d2740 1 -- start start 2024-09-19T09:57:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f99098d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082904090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f99098d2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f082904a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f99098d2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082911760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f99098d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f08286a2f0 con 0x55f082905b40 2024-09-19T09:57:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f99098d2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f082811cf0 con 0x55f0829045d0 2024-09-19T09:57:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f99098d2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f0828662b0 con 0x55f08290f370 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f98f67fc640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98ec0a3240 0x7f98ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9905a96640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082904090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9905a96640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082904090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53518/0 (socket says 172.21.15.18:53518) 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9905a96640 1 -- 172.21.15.18:0/4123431262 learned_addr learned my addr 172.21.15.18:0/4123431262 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9905295640 1 --2- 172.21.15.18:0/4123431262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f082904a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9904a94640 1 --2- 172.21.15.18:0/4123431262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082911760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9905a96640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98ec0a3240 0x7f98ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f98f67fc640 1 -- 172.21.15.18:0/290230398 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f98fc0efad0 con 0x7f99001002f0 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9905a96640 1 -- 172.21.15.18:0/4123431262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 msgr2=0x55f082911760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9905a96640 1 --2- 172.21.15.18:0/4123431262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082911760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9905a96640 1 -- 172.21.15.18:0/4123431262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 msgr2=0x55f082904a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:33.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9905a96640 1 --2- 172.21.15.18:0/4123431262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f082904a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:33.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9905a96640 1 -- 172.21.15.18:0/4123431262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0827f63a0 con 0x55f082905b40 2024-09-19T09:57:33.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.991+0000 7f9904a94640 1 --2- 172.21.15.18:0/4123431262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082911760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:33.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.992+0000 7f9905a96640 1 --2- 172.21.15.18:0/4123431262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082904090 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f98f800a5a0 tx=0x7f98f800ae20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d41463f3c0e247 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:33.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.992+0000 7f9905a96640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98ec0a3240 0x7f98ec0a5700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f98f801e000 tx=0x7f98f8020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:33.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.992+0000 7f98eb7fe640 1 -- 172.21.15.18:0/4123431262 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8027070 con 0x55f082905b40 2024-09-19T09:57:33.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.992+0000 7f98eb7fe640 1 -- 172.21.15.18:0/4123431262 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f801e030 con 0x55f082905b40 2024-09-19T09:57:33.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.992+0000 7f98eb7fe640 1 -- 172.21.15.18:0/4123431262 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8022d20 con 0x55f082905b40 2024-09-19T09:57:33.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.992+0000 7f99098d2740 1 -- 172.21.15.18:0/4123431262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 msgr2=0x55f082904090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.992+0000 7f99098d2740 1 --2- 172.21.15.18:0/4123431262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082904090 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f98f800a5a0 tx=0x7f98f800ae20 comp rx=0 tx=0).stop 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.993+0000 7f99098d2740 1 -- 172.21.15.18:0/4123431262 shutdown_connections 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.993+0000 7f99098d2740 1 --2- 172.21.15.18:0/4123431262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082911760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.993+0000 7f99098d2740 1 --2- 172.21.15.18:0/4123431262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f082904a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.993+0000 7f99098d2740 1 --2- 172.21.15.18:0/4123431262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082904090 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.993+0000 7f99098d2740 1 -- 172.21.15.18:0/4123431262 >> 172.21.15.18:0/4123431262 conn(0x55f0828cd310 msgr2=0x55f082900c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.993+0000 7f99098d2740 1 -- 172.21.15.18:0/4123431262 shutdown_connections 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.993+0000 7f99098d2740 1 -- 172.21.15.18:0/4123431262 wait complete. 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.993+0000 7f99098d2740 1 -- start start 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.993+0000 7f99098d2740 1 Processor -- start 2024-09-19T09:57:34.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.993+0000 7f99098d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0829045d0 0x55f08290ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f99098d2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f082905b40 0x55f08290c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f99098d2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f08290f370 0x55f08290c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f99098d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f082912010 con 0x55f0829045d0 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f99098d2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f082825060 con 0x55f08290f370 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f99098d2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f082912190 con 0x55f082905b40 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f99098d2740 10 client.0 _ll_register_callbacks cb 0x55f0825788c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9905295640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0829045d0 0x55f08290ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9905295640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0829045d0 0x55f08290ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53520/0 (socket says 172.21.15.18:53520) 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9905295640 1 -- 172.21.15.18:0/2412066482 learned_addr learned my addr 172.21.15.18:0/2412066482 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9905a96640 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f08290f370 0x55f08290c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9904a94640 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f082905b40 0x55f08290c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9905295640 1 -- 172.21.15.18:0/2412066482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f082905b40 msgr2=0x55f08290c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9905295640 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f082905b40 0x55f08290c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9905295640 1 -- 172.21.15.18:0/2412066482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f08290f370 msgr2=0x55f08290c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9905295640 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f08290f370 0x55f08290c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9905295640 1 -- 172.21.15.18:0/2412066482 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0825db3c0 con 0x55f0829045d0 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f9905295640 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0829045d0 0x55f08290ede0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0b8b40 tx=0x7f98fc08aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71e6108ba7314c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f98e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f98e8ff9640 1 -- 172.21.15.18:0/2412066482 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc049070 con 0x55f0829045d0 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f98e8ff9640 1 -- 172.21.15.18:0/2412066482 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f98fc03bd00 con 0x55f0829045d0 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.994+0000 7f99098d2740 1 -- 172.21.15.18:0/2412066482 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98f801e030 con 0x55f0829045d0 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f98e8ff9640 1 -- 172.21.15.18:0/2412066482 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f98fc08ce60 con 0x55f0829045d0 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f99098d2740 10 client.16782 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f99098d2740 1 -- 172.21.15.18:0/2412066482 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f08291db40 con 0x55f0829045d0 2024-09-19T09:57:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f98e8ff9640 1 -- 172.21.15.18:0/2412066482 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f801e030 con 0x55f0829045d0 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f98e8ff9640 1 -- 172.21.15.18:0/2412066482 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f98fc0b6ce0 con 0x55f0829045d0 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f99098d2740 10 client.16782 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f99098d2740 10 client.16782 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f99098d2740 20 client.16782 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f99098d2740 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f08291ef30 0x55f082921320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f99098d2740 4 client.16782 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f99098d2740 1 -- 172.21.15.18:0/2412066482 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f082877860 con 0x55f08291ef30 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.995+0000 7f9904a94640 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f08291ef30 0x55f082921320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f9904a94640 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f08291ef30 0x55f082921320 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=87e7ac25d6114a49 server_cookie=c77912e99db05118 in_seq=0 out_seq=0 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f98e8ff9640 10 client.16782 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f98e8ff9640 1 -- 172.21.15.18:0/2412066482 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f082877860 con 0x55f08291ef30 2024-09-19T09:57:34.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f98e8ff9640 10 client.16782 handle_command_reply: tid=0 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f99098d2740 1 client.16782 shutdown 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f99098d2740 1 -- 172.21.15.18:0/2412066482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0829045d0 msgr2=0x55f08290ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f99098d2740 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0829045d0 0x55f08290ede0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0b8b40 tx=0x7f98fc08aeb0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f99098d2740 1 -- 172.21.15.18:0/2412066482 shutdown_connections 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f99098d2740 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f08291ef30 0x55f082921320 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f99098d2740 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f08290f370 0x55f08290c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f99098d2740 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f082905b40 0x55f08290c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f99098d2740 1 --2- 172.21.15.18:0/2412066482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0829045d0 0x55f08290ede0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f99098d2740 1 -- 172.21.15.18:0/2412066482 >> 172.21.15.18:0/2412066482 conn(0x55f0828cd310 msgr2=0x55f082906930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.996+0000 7f98e8ff9640 0 client.16782 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.997+0000 7f99098d2740 1 -- 172.21.15.18:0/2412066482 shutdown_connections 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.997+0000 7f99098d2740 1 -- 172.21.15.18:0/2412066482 wait complete. 2024-09-19T09:57:34.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:33.997+0000 7f99098d2740 20 client.16782 trim_cache size 0 max 16384 2024-09-19T09:57:34.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f99098d2740 1 Processor -- start 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f99098d2740 1 -- start start 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f99098d2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f08291b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f99098d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f08290b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f99098d2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082926c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f99098d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f99001ab410 con 0x55f082905b40 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f99098d2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99001acf50 con 0x55f0829045d0 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f99098d2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f99001abae0 con 0x55f08290f370 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f9904a94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f08290b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f9904a94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f08290b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53532/0 (socket says 172.21.15.18:53532) 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f9904a94640 1 -- 172.21.15.18:0/2191795585 learned_addr learned my addr 172.21.15.18:0/2191795585 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f9905295640 1 --2- 172.21.15.18:0/2191795585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f08291b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f9905a96640 1 --2- 172.21.15.18:0/2191795585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082926c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f9904a94640 1 -- 172.21.15.18:0/2191795585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 msgr2=0x55f082926c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:34.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f9904a94640 1 --2- 172.21.15.18:0/2191795585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082926c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f9904a94640 1 -- 172.21.15.18:0/2191795585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 msgr2=0x55f08291b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:34.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f9904a94640 1 --2- 172.21.15.18:0/2191795585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f08291b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.010+0000 7f9904a94640 1 -- 172.21.15.18:0/2191795585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f082901960 con 0x55f082905b40 2024-09-19T09:57:34.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f9904a94640 1 --2- 172.21.15.18:0/2191795585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f08290b070 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f99000ff880 tx=0x7f98f0013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fda186f4f8c810e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f98eaffd640 1 -- 172.21.15.18:0/2191795585 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00130d0 con 0x55f082905b40 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f98eaffd640 1 -- 172.21.15.18:0/2191795585 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f0013270 con 0x55f082905b40 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f98eaffd640 1 -- 172.21.15.18:0/2191795585 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f001c460 con 0x55f082905b40 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f99098d2740 1 -- 172.21.15.18:0/2191795585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 msgr2=0x55f08290b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f99098d2740 1 --2- 172.21.15.18:0/2191795585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f08290b070 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f99000ff880 tx=0x7f98f0013830 comp rx=0 tx=0).stop 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f99098d2740 1 -- 172.21.15.18:0/2191795585 shutdown_connections 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f99098d2740 1 --2- 172.21.15.18:0/2191795585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082926c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f99098d2740 1 --2- 172.21.15.18:0/2191795585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f08290b070 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f99098d2740 1 --2- 172.21.15.18:0/2191795585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f08291b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.011+0000 7f99098d2740 1 -- 172.21.15.18:0/2191795585 >> 172.21.15.18:0/2191795585 conn(0x55f0828cd310 msgr2=0x55f08290a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.012+0000 7f99098d2740 1 -- 172.21.15.18:0/2191795585 shutdown_connections 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.012+0000 7f99098d2740 1 -- 172.21.15.18:0/2191795585 wait complete. 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.012+0000 7f99098d2740 1 -- start start 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.012+0000 7f99098d2740 1 Processor -- start 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.012+0000 7f99098d2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f082913220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.012+0000 7f99098d2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082913760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.012+0000 7f99098d2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082913ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.012+0000 7f99098d2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f99001ac880 con 0x55f082905b40 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.012+0000 7f99098d2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99001ac1b0 con 0x55f0829045d0 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.012+0000 7f99098d2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f99001a93f0 con 0x55f08290f370 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9904a94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082913760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f99098d2740 10 client.0 _ll_register_callbacks cb 0x7f98fc003f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9905295640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f082913220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9904a94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082913760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53542/0 (socket says 172.21.15.18:53542) 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9904a94640 1 -- 172.21.15.18:0/3459814828 learned_addr learned my addr 172.21.15.18:0/3459814828 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9905a96640 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082913ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9905295640 1 -- 172.21.15.18:0/3459814828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 msgr2=0x55f082913ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9905295640 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082913ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9905295640 1 -- 172.21.15.18:0/3459814828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 msgr2=0x55f082913760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9905295640 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082913760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9905295640 1 -- 172.21.15.18:0/3459814828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f082988cb0 con 0x55f0829045d0 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f9905295640 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f082913220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0ba420 tx=0x7f98fc03b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=473014f82ea2474e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f98e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f98e8ff9640 1 -- 172.21.15.18:0/3459814828 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc049070 con 0x55f0829045d0 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f98e8ff9640 1 -- 172.21.15.18:0/3459814828 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f98fc0c48a0 con 0x55f0829045d0 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f99098d2740 1 -- 172.21.15.18:0/3459814828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98f0013270 con 0x55f0829045d0 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f98e8ff9640 1 -- 172.21.15.18:0/3459814828 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f98fc0bbf40 con 0x55f0829045d0 2024-09-19T09:57:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f99098d2740 10 client.26231 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.013+0000 7f99098d2740 1 -- 172.21.15.18:0/3459814828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f082989f50 con 0x55f0829045d0 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f98e8ff9640 1 -- 172.21.15.18:0/3459814828 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f0013270 con 0x55f0829045d0 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f98e8ff9640 1 -- 172.21.15.18:0/3459814828 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f98fc0b6ce0 con 0x55f0829045d0 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f99098d2740 10 client.26231 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f99098d2740 10 client.26231 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f99098d2740 20 client.26231 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f99098d2740 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f08298a4f0 0x55f08298c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f99098d2740 4 client.26231 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f99098d2740 1 -- 172.21.15.18:0/3459814828 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f082871d70 con 0x55f08298a4f0 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f9904a94640 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f08298a4f0 0x55f08298c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f9904a94640 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f08298a4f0 0x55f08298c930 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=74cbe17f97552d67 server_cookie=7d8fd4d0e57c4074 in_seq=0 out_seq=0 2024-09-19T09:57:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.014+0000 7f98e8ff9640 10 client.26231 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f98e8ff9640 1 -- 172.21.15.18:0/3459814828 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f082871d70 con 0x55f08298a4f0 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f98e8ff9640 10 client.26231 handle_command_reply: tid=0 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 client.26231 shutdown 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 -- 172.21.15.18:0/3459814828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 msgr2=0x55f082913220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f082913220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0ba420 tx=0x7f98fc03b800 comp rx=0 tx=0).stop 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 -- 172.21.15.18:0/3459814828 shutdown_connections 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55f08298a4f0 0x55f08298c930 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f08290f370 0x55f082913ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f082905b40 0x55f082913760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f98e8ff9640 0 client.26231 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 --2- 172.21.15.18:0/3459814828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0829045d0 0x55f082913220 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 -- 172.21.15.18:0/3459814828 >> 172.21.15.18:0/3459814828 conn(0x55f0828cd310 msgr2=0x55f08290b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 -- 172.21.15.18:0/3459814828 shutdown_connections 2024-09-19T09:57:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 1 -- 172.21.15.18:0/3459814828 wait complete. 2024-09-19T09:57:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.015+0000 7f99098d2740 20 client.26231 trim_cache size 0 max 16384 2024-09-19T09:57:34.025 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:57:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 -- 172.21.15.18:0/290230398 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98ec0a3240 msgr2=0x7f98ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98ec0a3240 0x7f98ec0a5700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f98f801e000 tx=0x7f98f8020000 comp rx=0 tx=0).stop 2024-09-19T09:57:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 -- 172.21.15.18:0/290230398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99001002f0 msgr2=0x7f99001985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99001002f0 0x7f99001985a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009a50 tx=0x7f98fc004270 comp rx=0 tx=0).stop 2024-09-19T09:57:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 -- 172.21.15.18:0/290230398 shutdown_connections 2024-09-19T09:57:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f98ec0a3240 0x7f98ec0a5700 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9900106f50 0x7f990019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9900100ca0 0x7f9900198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 --2- 172.21.15.18:0/290230398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99001002f0 0x7f99001985a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 -- 172.21.15.18:0/290230398 >> 172.21.15.18:0/290230398 conn(0x7f9900077210 msgr2=0x7f99001052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 -- 172.21.15.18:0/290230398 shutdown_connections 2024-09-19T09:57:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:34.016+0000 7f99074f9640 1 -- 172.21.15.18:0/290230398 wait complete. 2024-09-19T09:57:34.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:34 smithi018 ceph-mon[30956]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 422 MiB/s wr, 985 op/s 2024-09-19T09:57:34.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:34 smithi049 ceph-mon[34858]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 422 MiB/s wr, 985 op/s 2024-09-19T09:57:34.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:34 smithi162 ceph-mon[35174]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 422 MiB/s wr, 985 op/s 2024-09-19T09:57:34.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:57:35.219 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.738+0000 7f3369ec3640 1 -- 172.21.15.18:0/2628321555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364106f10 msgr2=0x7f336410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.738+0000 7f3369ec3640 1 --2- 172.21.15.18:0/2628321555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364106f10 0x7f336410ea90 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f335c009ca0 tx=0x7f335c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.738+0000 7f3369ec3640 1 -- 172.21.15.18:0/2628321555 shutdown_connections 2024-09-19T09:57:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.738+0000 7f3369ec3640 1 --2- 172.21.15.18:0/2628321555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364106f10 0x7f336410ea90 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.738+0000 7f3369ec3640 1 --2- 172.21.15.18:0/2628321555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3364102790 0x7f33641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.738+0000 7f3369ec3640 1 --2- 172.21.15.18:0/2628321555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3364101de0 0x7f33641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.738+0000 7f3369ec3640 1 -- 172.21.15.18:0/2628321555 >> 172.21.15.18:0/2628321555 conn(0x7f33640fd8c0 msgr2=0x7f33640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.738+0000 7f3369ec3640 1 -- 172.21.15.18:0/2628321555 shutdown_connections 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.738+0000 7f3369ec3640 1 -- 172.21.15.18:0/2628321555 wait complete. 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.738+0000 7f3369ec3640 1 Processor -- start 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f3369ec3640 1 -- start start 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f3369ec3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3364101de0 0x7f3364198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f3369ec3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364102790 0x7f3364198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f3369ec3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3364106f10 0x7f336419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f3369ec3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3364111f70 con 0x7f3364102790 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f3369ec3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3364111df0 con 0x7f3364101de0 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f3369ec3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33641120f0 con 0x7f3364106f10 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f335affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364102790 0x7f3364198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f335affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364102790 0x7f3364198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53562/0 (socket says 172.21.15.18:53562) 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f335affd640 1 -- 172.21.15.18:0/710090984 learned_addr learned my addr 172.21.15.18:0/710090984 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f33637fe640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3364101de0 0x7f3364198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f3363fff640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3364106f10 0x7f336419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f335affd640 1 -- 172.21.15.18:0/710090984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3364106f10 msgr2=0x7f336419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f335affd640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3364106f10 0x7f336419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f335affd640 1 -- 172.21.15.18:0/710090984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3364101de0 msgr2=0x7f3364198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f335affd640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3364101de0 0x7f3364198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.739+0000 7f335affd640 1 -- 172.21.15.18:0/710090984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336419d2e0 con 0x7f3364102790 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.740+0000 7f335affd640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364102790 0x7f3364198870 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f334c00d770 tx=0x7f334c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.740+0000 7f33617fa640 1 -- 172.21.15.18:0/710090984 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c017070 con 0x7f3364102790 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.740+0000 7f33617fa640 1 -- 172.21.15.18:0/710090984 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f334c009820 con 0x7f3364102790 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.740+0000 7f3369ec3640 1 -- 172.21.15.18:0/710090984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336419d5d0 con 0x7f3364102790 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.740+0000 7f33617fa640 1 -- 172.21.15.18:0/710090984 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c004cd0 con 0x7f3364102790 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.740+0000 7f3369ec3640 1 -- 172.21.15.18:0/710090984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33641a4eb0 con 0x7f3364102790 2024-09-19T09:57:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.742+0000 7f33617fa640 1 -- 172.21.15.18:0/710090984 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f334c0099d0 con 0x7f3364102790 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.742+0000 7f336c29c740 1 Processor -- start 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f336c29c740 1 -- start start 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f336c29c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3d8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f336c29c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3d85d0 0x564dcf3d8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f336c29c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3e7780 0x564dcf3e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f336c29c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564dcf33e2f0 con 0x564dcf3d85d0 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f336c29c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564dcf2e5cf0 con 0x564dcf3d9b40 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f336c29c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564dcf33a2b0 con 0x564dcf3e7780 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f33637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3d85d0 0x564dcf3d8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f33637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3d85d0 0x564dcf3d8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53572/0 (socket says 172.21.15.18:53572) 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f33637fe640 1 -- 172.21.15.18:0/3891781462 learned_addr learned my addr 172.21.15.18:0/3891781462 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f335affd640 1 --2- 172.21.15.18:0/3891781462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3e7780 0x564dcf3e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f3363fff640 1 --2- 172.21.15.18:0/3891781462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3d8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f33637fe640 1 -- 172.21.15.18:0/3891781462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3e7780 msgr2=0x564dcf3e9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f33637fe640 1 --2- 172.21.15.18:0/3891781462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3e7780 0x564dcf3e9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f33637fe640 1 -- 172.21.15.18:0/3891781462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 msgr2=0x564dcf3d8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f33637fe640 1 --2- 172.21.15.18:0/3891781462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3d8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f33637fe640 1 -- 172.21.15.18:0/3891781462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dcf2ca3a0 con 0x564dcf3d85d0 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f33617fa640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33500a32c0 0x7f33500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.743+0000 7f3363fff640 1 --2- 172.21.15.18:0/3891781462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3d8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.744+0000 7f3363fff640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33500a32c0 0x7f33500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.744+0000 7f33637fe640 1 --2- 172.21.15.18:0/3891781462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3d85d0 0x564dcf3d8a10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f335400ad00 tx=0x7f335400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5630072cfd8f7903 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.744+0000 7f33617fa640 1 -- 172.21.15.18:0/710090984 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f334c0cf1f0 con 0x7f3364102790 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.744+0000 7f3359ffb640 1 -- 172.21.15.18:0/3891781462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335401d070 con 0x564dcf3d85d0 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.744+0000 7f3359ffb640 1 -- 172.21.15.18:0/3891781462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3354018b20 con 0x564dcf3d85d0 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.744+0000 7f3359ffb640 1 -- 172.21.15.18:0/3891781462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354010bc0 con 0x564dcf3d85d0 2024-09-19T09:57:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 -- 172.21.15.18:0/3891781462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3d85d0 msgr2=0x564dcf3d8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f3363fff640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33500a32c0 0x7f33500a5780 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f335c004af0 tx=0x7f335c004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 --2- 172.21.15.18:0/3891781462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3d85d0 0x564dcf3d8a10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f335400ad00 tx=0x7f335400f790 comp rx=0 tx=0).stop 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 -- 172.21.15.18:0/3891781462 shutdown_connections 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 --2- 172.21.15.18:0/3891781462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3e7780 0x564dcf3e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 --2- 172.21.15.18:0/3891781462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3d85d0 0x564dcf3d8a10 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 --2- 172.21.15.18:0/3891781462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3d8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 -- 172.21.15.18:0/3891781462 >> 172.21.15.18:0/3891781462 conn(0x564dcf3a1310 msgr2=0x564dcf3d4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 -- 172.21.15.18:0/3891781462 shutdown_connections 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 -- 172.21.15.18:0/3891781462 wait complete. 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 -- start start 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.745+0000 7f336c29c740 1 Processor -- start 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f336c29c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 0x564dcf3e7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f336c29c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3e43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f336c29c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3e4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f336c29c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564dcf3ea480 con 0x564dcf3e7780 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f336c29c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564dcf2f9060 con 0x564dcf3d9b40 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f336c29c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564dcf3ea600 con 0x564dcf3d85d0 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f336c29c740 10 client.0 _ll_register_callbacks cb 0x564dcf04c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f3363fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f3363fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3e4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53586/0 (socket says 172.21.15.18:53586) 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f3363fff640 1 -- 172.21.15.18:0/4238135282 learned_addr learned my addr 172.21.15.18:0/4238135282 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f335affd640 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3e43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f33637fe640 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 0x564dcf3e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f3363fff640 1 -- 172.21.15.18:0/4238135282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 msgr2=0x564dcf3e7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f3363fff640 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 0x564dcf3e7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f3363fff640 1 -- 172.21.15.18:0/4238135282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 msgr2=0x564dcf3e43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f3363fff640 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3e43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f3363fff640 1 -- 172.21.15.18:0/4238135282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dcf0af3c0 con 0x564dcf3e7780 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f33637fe640 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 0x564dcf3e7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f3363fff640 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3e4940 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f335c035000 tx=0x7f335c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27828d6d3a53b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.746+0000 7f3342ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f3342ffd640 1 -- 172.21.15.18:0/4238135282 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c0319a0 con 0x564dcf3e7780 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f3342ffd640 1 -- 172.21.15.18:0/4238135282 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f335c0045c0 con 0x564dcf3e7780 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f336c29c740 1 -- 172.21.15.18:0/4238135282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3354018b20 con 0x564dcf3e7780 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f3342ffd640 1 -- 172.21.15.18:0/4238135282 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f335c059070 con 0x564dcf3e7780 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f336c29c740 10 client.16800 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f336c29c740 1 -- 172.21.15.18:0/4238135282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564dcf3f5eb0 con 0x564dcf3e7780 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f3342ffd640 1 -- 172.21.15.18:0/4238135282 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3354018b20 con 0x564dcf3e7780 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f3342ffd640 1 -- 172.21.15.18:0/4238135282 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f335c0305c0 con 0x564dcf3e7780 2024-09-19T09:57:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f336c29c740 10 client.16800 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f336c29c740 10 client.16800 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f336c29c740 20 client.16800 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f336c29c740 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564dcf3f7370 0x564dcf3f97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f336c29c740 4 client.16800 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.747+0000 7f336c29c740 1 -- 172.21.15.18:0/4238135282 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dcf34b860 con 0x564dcf3f7370 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.748+0000 7f33637fe640 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564dcf3f7370 0x564dcf3f97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.748+0000 7f3342ffd640 10 client.16800 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.748+0000 7f33637fe640 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564dcf3f7370 0x564dcf3f97a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=17425d46aeeaa509 server_cookie=d57516e71e943f37 in_seq=0 out_seq=0 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f3342ffd640 1 -- 172.21.15.18:0/4238135282 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564dcf34b860 con 0x564dcf3f7370 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f3342ffd640 10 client.16800 handle_command_reply: tid=0 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 client.16800 shutdown 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 -- 172.21.15.18:0/4238135282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 msgr2=0x564dcf3e4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3e4940 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f335c035000 tx=0x7f335c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 -- 172.21.15.18:0/4238135282 shutdown_connections 2024-09-19T09:57:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564dcf3f7370 0x564dcf3f97a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3e4940 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3e43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 --2- 172.21.15.18:0/4238135282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 0x564dcf3e7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 -- 172.21.15.18:0/4238135282 >> 172.21.15.18:0/4238135282 conn(0x564dcf3a1310 msgr2=0x564dcf3da930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f3342ffd640 0 client.16800 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:57:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 -- 172.21.15.18:0/4238135282 shutdown_connections 2024-09-19T09:57:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 1 -- 172.21.15.18:0/4238135282 wait complete. 2024-09-19T09:57:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.749+0000 7f336c29c740 20 client.16800 trim_cache size 0 max 16384 2024-09-19T09:57:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f336c29c740 1 Processor -- start 2024-09-19T09:57:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f336c29c740 1 -- start start 2024-09-19T09:57:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f336c29c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d85d0 0x564dcf3f3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f336c29c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d9b40 0x564dcf3d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f336c29c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3d4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f336c29c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33641ab060 con 0x564dcf3e7780 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f336c29c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f33641acba0 con 0x564dcf3d85d0 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f336c29c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33641ab730 con 0x564dcf3d9b40 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f3363fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3d4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f335affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d9b40 0x564dcf3d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f3363fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3d4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53594/0 (socket says 172.21.15.18:53594) 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f3363fff640 1 -- 172.21.15.18:0/2088450946 learned_addr learned my addr 172.21.15.18:0/2088450946 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f33637fe640 1 --2- 172.21.15.18:0/2088450946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d85d0 0x564dcf3f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f3363fff640 1 -- 172.21.15.18:0/2088450946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d9b40 msgr2=0x564dcf3d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f3363fff640 1 --2- 172.21.15.18:0/2088450946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d9b40 0x564dcf3d4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f3363fff640 1 -- 172.21.15.18:0/2088450946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d85d0 msgr2=0x564dcf3f3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f3363fff640 1 --2- 172.21.15.18:0/2088450946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d85d0 0x564dcf3f3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.763+0000 7f3363fff640 1 -- 172.21.15.18:0/2088450946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dcf3d5180 con 0x564dcf3e7780 2024-09-19T09:57:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f3363fff640 1 --2- 172.21.15.18:0/2088450946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3d4c40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f335c030a30 tx=0x7f335c031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a471212becaf8ef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f33597fa640 1 -- 172.21.15.18:0/2088450946 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c063070 con 0x564dcf3e7780 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f33597fa640 1 -- 172.21.15.18:0/2088450946 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c04e070 con 0x564dcf3e7780 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f33597fa640 1 -- 172.21.15.18:0/2088450946 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c02f870 con 0x564dcf3e7780 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f336c29c740 1 -- 172.21.15.18:0/2088450946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 msgr2=0x564dcf3d4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f336c29c740 1 --2- 172.21.15.18:0/2088450946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3d4c40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f335c030a30 tx=0x7f335c031bb0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f336c29c740 1 -- 172.21.15.18:0/2088450946 shutdown_connections 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f336c29c740 1 --2- 172.21.15.18:0/2088450946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3d4c40 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f336c29c740 1 --2- 172.21.15.18:0/2088450946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d9b40 0x564dcf3d4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f336c29c740 1 --2- 172.21.15.18:0/2088450946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d85d0 0x564dcf3f3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.764+0000 7f336c29c740 1 -- 172.21.15.18:0/2088450946 >> 172.21.15.18:0/2088450946 conn(0x564dcf3a1310 msgr2=0x564dcf3e4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 1 -- 172.21.15.18:0/2088450946 shutdown_connections 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 1 -- 172.21.15.18:0/2088450946 wait complete. 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 1 -- start start 2024-09-19T09:57:35.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 1 Processor -- start 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 0x564dcf3eff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3eb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3eb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33641ac4d0 con 0x564dcf3e7780 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f33641abe00 con 0x564dcf3d9b40 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33641a9040 con 0x564dcf3d85d0 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.765+0000 7f336c29c740 10 client.0 _ll_register_callbacks cb 0x7f335c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3363fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3eb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3363fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3eb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53596/0 (socket says 172.21.15.18:53596) 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3363fff640 1 -- 172.21.15.18:0/778199612 learned_addr learned my addr 172.21.15.18:0/778199612 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f335affd640 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f33637fe640 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 0x564dcf3eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3363fff640 1 -- 172.21.15.18:0/778199612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 msgr2=0x564dcf3eff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3363fff640 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 0x564dcf3eff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3363fff640 1 -- 172.21.15.18:0/778199612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 msgr2=0x564dcf3eb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3363fff640 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3eb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3363fff640 1 -- 172.21.15.18:0/778199612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dcf3ebf70 con 0x564dcf3e7780 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f335affd640 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3eb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3363fff640 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3eb790 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f335c009ca0 tx=0x7f335c031c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36895a280cd742cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3342ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3342ffd640 1 -- 172.21.15.18:0/778199612 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c063070 con 0x564dcf3e7780 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3342ffd640 1 -- 172.21.15.18:0/778199612 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f335c004610 con 0x564dcf3e7780 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f336c29c740 1 -- 172.21.15.18:0/778199612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f335c04e070 con 0x564dcf3e7780 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f3342ffd640 1 -- 172.21.15.18:0/778199612 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f335c06e070 con 0x564dcf3e7780 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f336c29c740 10 client.16806 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:35.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.766+0000 7f336c29c740 1 -- 172.21.15.18:0/778199612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564dcf461f90 con 0x564dcf3e7780 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.767+0000 7f3342ffd640 1 -- 172.21.15.18:0/778199612 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c04e070 con 0x564dcf3e7780 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.767+0000 7f3342ffd640 1 -- 172.21.15.18:0/778199612 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f335c05e440 con 0x564dcf3e7780 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.767+0000 7f336c29c740 10 client.16806 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.767+0000 7f336c29c740 10 client.16806 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.767+0000 7f336c29c740 20 client.16806 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.767+0000 7f336c29c740 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564dcf4625f0 0x564dcf4649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.767+0000 7f336c29c740 4 client.16806 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.767+0000 7f336c29c740 1 -- 172.21.15.18:0/778199612 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564dcf345d70 con 0x564dcf4625f0 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.767+0000 7f33637fe640 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564dcf4625f0 0x564dcf4649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f33637fe640 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564dcf4625f0 0x564dcf4649e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e529d16f24461449 server_cookie=5dbd74dc0b9203fe in_seq=0 out_seq=0 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f3342ffd640 10 client.16806 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f3342ffd640 1 -- 172.21.15.18:0/778199612 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564dcf345d70 con 0x564dcf4625f0 2024-09-19T09:57:35.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f3342ffd640 10 client.16806 handle_command_reply: tid=0 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 client.16806 shutdown 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 -- 172.21.15.18:0/778199612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 msgr2=0x564dcf3eb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3eb790 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f335c009ca0 tx=0x7f335c031c40 comp rx=0 tx=0).stop 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 -- 172.21.15.18:0/778199612 shutdown_connections 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x564dcf4625f0 0x564dcf4649e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564dcf3e7780 0x564dcf3eb790 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dcf3d9b40 0x564dcf3eb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 --2- 172.21.15.18:0/778199612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dcf3d85d0 0x564dcf3eff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f3342ffd640 0 client.16806 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 -- 172.21.15.18:0/778199612 >> 172.21.15.18:0/778199612 conn(0x564dcf3a1310 msgr2=0x564dcf3e4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 -- 172.21.15.18:0/778199612 shutdown_connections 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 1 -- 172.21.15.18:0/778199612 wait complete. 2024-09-19T09:57:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.768+0000 7f336c29c740 20 client.16806 trim_cache size 0 max 16384 2024-09-19T09:57:35.778 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:57:35.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 -- 172.21.15.18:0/710090984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33500a32c0 msgr2=0x7f33500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:35.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33500a32c0 0x7f33500a5780 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f335c004af0 tx=0x7f335c004a80 comp rx=0 tx=0).stop 2024-09-19T09:57:35.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 -- 172.21.15.18:0/710090984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364102790 msgr2=0x7f3364198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:35.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364102790 0x7f3364198870 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f334c00d770 tx=0x7f334c00db70 comp rx=0 tx=0).stop 2024-09-19T09:57:35.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 -- 172.21.15.18:0/710090984 shutdown_connections 2024-09-19T09:57:35.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33500a32c0 0x7f33500a5780 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3364106f10 0x7f336419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3364102790 0x7f3364198870 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 --2- 172.21.15.18:0/710090984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3364101de0 0x7f3364198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:35.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 -- 172.21.15.18:0/710090984 >> 172.21.15.18:0/710090984 conn(0x7f33640fd8c0 msgr2=0x7f33640febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:35.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 -- 172.21.15.18:0/710090984 shutdown_connections 2024-09-19T09:57:35.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:35.769+0000 7f3369ec3640 1 -- 172.21.15.18:0/710090984 wait complete. 2024-09-19T09:57:36.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:36 smithi018 ceph-mon[30956]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 213 MiB/s wr, 373 op/s 2024-09-19T09:57:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:36 smithi049 ceph-mon[34858]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 213 MiB/s wr, 373 op/s 2024-09-19T09:57:36.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:36 smithi162 ceph-mon[35174]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 213 MiB/s wr, 373 op/s 2024-09-19T09:57:36.728 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:57:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.945+0000 7f057b5cd640 1 -- 172.21.15.18:0/1419268035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05741025f0 msgr2=0x7f0574108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.945+0000 7f057b5cd640 1 --2- 172.21.15.18:0/1419268035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05741025f0 0x7f0574108e80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f056c009ca0 tx=0x7f056c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.945+0000 7f057b5cd640 1 -- 172.21.15.18:0/1419268035 shutdown_connections 2024-09-19T09:57:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.945+0000 7f057b5cd640 1 --2- 172.21.15.18:0/1419268035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05741025f0 0x7f0574108e80 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.945+0000 7f057b5cd640 1 --2- 172.21.15.18:0/1419268035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0574101c30 0x7f05741020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.945+0000 7f057b5cd640 1 --2- 172.21.15.18:0/1419268035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0574100a40 0x7f0574100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.945+0000 7f057b5cd640 1 -- 172.21.15.18:0/1419268035 >> 172.21.15.18:0/1419268035 conn(0x7f05740fc1e0 msgr2=0x7f05740fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.946+0000 7f057b5cd640 1 -- 172.21.15.18:0/1419268035 shutdown_connections 2024-09-19T09:57:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.946+0000 7f057b5cd640 1 -- 172.21.15.18:0/1419268035 wait complete. 2024-09-19T09:57:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.946+0000 7f057b5cd640 1 Processor -- start 2024-09-19T09:57:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.946+0000 7f057b5cd640 1 -- start start 2024-09-19T09:57:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f057b5cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0574100a40 0x7f057406a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f057b5cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0574101c30 0x7f057419ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f057b5cd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05741025f0 0x7f057419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f057b5cd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f057410c6a0 con 0x7f0574101c30 2024-09-19T09:57:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f057b5cd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f057410c520 con 0x7f0574100a40 2024-09-19T09:57:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f057b5cd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f057410c820 con 0x7f05741025f0 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0578b68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0574101c30 0x7f057419ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0578b68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0574101c30 0x7f057419ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54076/0 (socket says 172.21.15.18:54076) 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0578b68640 1 -- 172.21.15.18:0/3641287386 learned_addr learned my addr 172.21.15.18:0/3641287386 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0579b6a640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05741025f0 0x7f057419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0579369640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0574100a40 0x7f057406a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0578b68640 1 -- 172.21.15.18:0/3641287386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05741025f0 msgr2=0x7f057419f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0578b68640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05741025f0 0x7f057419f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0578b68640 1 -- 172.21.15.18:0/3641287386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0574100a40 msgr2=0x7f057406a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0578b68640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0574100a40 0x7f057406a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0578b68640 1 -- 172.21.15.18:0/3641287386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057419f9b0 con 0x7f0574101c30 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.947+0000 7f0578b68640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0574101c30 0x7f057419ca80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f056400e9f0 tx=0x7f056400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.948+0000 7f056a7fc640 1 -- 172.21.15.18:0/3641287386 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056400cd80 con 0x7f0574101c30 2024-09-19T09:57:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.948+0000 7f057b5cd640 1 -- 172.21.15.18:0/3641287386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057419fc40 con 0x7f0574101c30 2024-09-19T09:57:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.948+0000 7f056a7fc640 1 -- 172.21.15.18:0/3641287386 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0564010910 con 0x7f0574101c30 2024-09-19T09:57:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.948+0000 7f056a7fc640 1 -- 172.21.15.18:0/3641287386 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640188f0 con 0x7f0574101c30 2024-09-19T09:57:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.948+0000 7f057b5cd640 1 -- 172.21.15.18:0/3641287386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05741a0190 con 0x7f0574101c30 2024-09-19T09:57:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f056a7fc640 1 -- 172.21.15.18:0/3641287386 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0564010ac0 con 0x7f0574101c30 2024-09-19T09:57:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f057e442740 1 Processor -- start 2024-09-19T09:57:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f057e442740 1 -- start start 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f057e442740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dc6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f057e442740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 0x564821dc9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f057e442740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821dd72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f057e442740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564821d2a2f0 con 0x564821dc6920 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f057e442740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564821cd2270 con 0x564821dc7260 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f057e442740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564821d262b0 con 0x564821dca330 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f0579b6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dc6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f0579369640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 0x564821dc9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f0579b6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dc6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54084/0 (socket says 172.21.15.18:54084) 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f0579b6a640 1 -- 172.21.15.18:0/4212999181 learned_addr learned my addr 172.21.15.18:0/4212999181 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f0578b68640 1 --2- 172.21.15.18:0/4212999181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821dd72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f0579b6a640 1 -- 172.21.15.18:0/4212999181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 msgr2=0x564821dd72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f0579b6a640 1 --2- 172.21.15.18:0/4212999181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821dd72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f0579b6a640 1 -- 172.21.15.18:0/4212999181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 msgr2=0x564821dc9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.951+0000 7f0579b6a640 1 --2- 172.21.15.18:0/4212999181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 0x564821dc9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.952+0000 7f0579b6a640 1 -- 172.21.15.18:0/4212999181 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564821cd1340 con 0x564821dc6920 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.952+0000 7f0579369640 1 --2- 172.21.15.18:0/4212999181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 0x564821dc9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.952+0000 7f056a7fc640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05600a32f0 0x7f05600a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.952+0000 7f0579b6a640 1 --2- 172.21.15.18:0/4212999181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dc6d20 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f056c035000 tx=0x7f056c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9611730c509ef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.952+0000 7f0579369640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05600a32f0 0x7f05600a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.952+0000 7f056a7fc640 1 -- 172.21.15.18:0/3641287386 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f05640cfd40 con 0x7f0574101c30 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.952+0000 7f055f7fe640 1 -- 172.21.15.18:0/4212999181 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c0098c0 con 0x564821dc6920 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.952+0000 7f055f7fe640 1 -- 172.21.15.18:0/4212999181 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f056c036040 con 0x564821dc6920 2024-09-19T09:57:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.952+0000 7f055f7fe640 1 -- 172.21.15.18:0/4212999181 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c004230 con 0x564821dc6920 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.953+0000 7f057e442740 1 -- 172.21.15.18:0/4212999181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 msgr2=0x564821dc6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.953+0000 7f0579369640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05600a32f0 0x7f05600a57b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x564821dc7c90 tx=0x7f057000b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.953+0000 7f057e442740 1 --2- 172.21.15.18:0/4212999181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dc6d20 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f056c035000 tx=0x7f056c009360 comp rx=0 tx=0).stop 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.953+0000 7f057e442740 1 -- 172.21.15.18:0/4212999181 shutdown_connections 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.953+0000 7f057e442740 1 --2- 172.21.15.18:0/4212999181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821dd72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.953+0000 7f057e442740 1 --2- 172.21.15.18:0/4212999181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 0x564821dc9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.953+0000 7f057e442740 1 --2- 172.21.15.18:0/4212999181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dc6d20 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.953+0000 7f057e442740 1 -- 172.21.15.18:0/4212999181 >> 172.21.15.18:0/4212999181 conn(0x564821dc2010 msgr2=0x564821dc2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.953+0000 7f057e442740 1 -- 172.21.15.18:0/4212999181 shutdown_connections 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.953+0000 7f057e442740 1 -- 172.21.15.18:0/4212999181 wait complete. 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f057e442740 1 -- start start 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f057e442740 1 Processor -- start 2024-09-19T09:57:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f057e442740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 0x564821dd9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f057e442740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dc7260 0x564821dd96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f057e442740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dca330 0x564821de0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f057e442740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564821dd7930 con 0x564821dca330 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f057e442740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564821cb3290 con 0x564821dc6920 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f057e442740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564821dd7ab0 con 0x564821dc7260 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f057e442740 10 client.0 _ll_register_callbacks cb 0x564821ce4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f0579b6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dca330 0x564821de0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f0579b6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dca330 0x564821de0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54096/0 (socket says 172.21.15.18:54096) 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.954+0000 7f0579b6a640 1 -- 172.21.15.18:0/1072995033 learned_addr learned my addr 172.21.15.18:0/1072995033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f0579369640 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 0x564821dd9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f0578b68640 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dc7260 0x564821dd96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f0579b6a640 1 -- 172.21.15.18:0/1072995033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dc7260 msgr2=0x564821dd96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f0579b6a640 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dc7260 0x564821dd96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f0579b6a640 1 -- 172.21.15.18:0/1072995033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 msgr2=0x564821dd9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f0579b6a640 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 0x564821dd9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f0579b6a640 1 -- 172.21.15.18:0/1072995033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564821a3d210 con 0x564821dca330 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f0579369640 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 0x564821dd9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f0579b6a640 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dca330 0x564821de0700 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f056c006010 tx=0x7f056c02f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205e7300b0272425 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f055cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f055cff9640 1 -- 172.21.15.18:0/1072995033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c0098c0 con 0x564821dca330 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f055cff9640 1 -- 172.21.15.18:0/1072995033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f056c02fcc0 con 0x564821dca330 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f057e442740 1 -- 172.21.15.18:0/1072995033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f056c036040 con 0x564821dca330 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f055cff9640 1 -- 172.21.15.18:0/1072995033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f056c02fec0 con 0x564821dca330 2024-09-19T09:57:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f057e442740 10 client.16818 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.955+0000 7f057e442740 1 -- 172.21.15.18:0/1072995033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564821b09620 con 0x564821dca330 2024-09-19T09:57:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.956+0000 7f055cff9640 1 -- 172.21.15.18:0/1072995033 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f056c036040 con 0x564821dca330 2024-09-19T09:57:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.956+0000 7f055cff9640 1 -- 172.21.15.18:0/1072995033 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f056c030aa0 con 0x564821dca330 2024-09-19T09:57:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.956+0000 7f057e442740 10 client.16818 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.956+0000 7f057e442740 10 client.16818 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.956+0000 7f057e442740 20 client.16818 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.956+0000 7f057e442740 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564821de4b30 0x564821de6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.956+0000 7f057e442740 4 client.16818 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.956+0000 7f057e442740 1 -- 172.21.15.18:0/1072995033 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564821d37a20 con 0x564821de4b30 2024-09-19T09:57:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.956+0000 7f0579369640 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564821de4b30 0x564821de6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.957+0000 7f0579369640 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564821de4b30 0x564821de6fb0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9efe9b7a3f5d52b server_cookie=a2dd3ff44bb10cc7 in_seq=0 out_seq=0 2024-09-19T09:57:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.957+0000 7f055cff9640 10 client.16818 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f055cff9640 1 -- 172.21.15.18:0/1072995033 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564821d37a20 con 0x564821de4b30 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f055cff9640 10 client.16818 handle_command_reply: tid=0 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 client.16818 shutdown 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 -- 172.21.15.18:0/1072995033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dca330 msgr2=0x564821de0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dca330 0x564821de0700 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f056c006010 tx=0x7f056c02f8c0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 -- 172.21.15.18:0/1072995033 shutdown_connections 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564821de4b30 0x564821de6fb0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dca330 0x564821de0700 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dc7260 0x564821dd96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 --2- 172.21.15.18:0/1072995033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 0x564821dd9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f055cff9640 0 client.16818 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 -- 172.21.15.18:0/1072995033 >> 172.21.15.18:0/1072995033 conn(0x564821dc2010 msgr2=0x564821dc3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 -- 172.21.15.18:0/1072995033 shutdown_connections 2024-09-19T09:57:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 1 -- 172.21.15.18:0/1072995033 wait complete. 2024-09-19T09:57:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.958+0000 7f057e442740 20 client.16818 trim_cache size 0 max 16384 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.975+0000 7f057e442740 1 Processor -- start 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.975+0000 7f057e442740 1 -- start start 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f057e442740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 0x564821dd85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f057e442740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc7260 0x564821de0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f057e442740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821dc09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f057e442740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05741a6bd0 con 0x564821dc7260 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f057e442740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05741a8710 con 0x564821dc6920 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f057e442740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05741a72a0 con 0x564821dca330 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0578b68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc7260 0x564821de0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0578b68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc7260 0x564821de0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54106/0 (socket says 172.21.15.18:54106) 2024-09-19T09:57:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0578b68640 1 -- 172.21.15.18:0/2211152307 learned_addr learned my addr 172.21.15.18:0/2211152307 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0579b6a640 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821dc09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0579369640 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 0x564821dd85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0578b68640 1 -- 172.21.15.18:0/2211152307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 msgr2=0x564821dc09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0578b68640 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821dc09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0578b68640 1 -- 172.21.15.18:0/2211152307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 msgr2=0x564821dd85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0578b68640 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 0x564821dd85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0578b68640 1 -- 172.21.15.18:0/2211152307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564821dd7c30 con 0x564821dc7260 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0579b6a640 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821dc09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0579369640 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 0x564821dd85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.976+0000 7f0578b68640 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc7260 0x564821de0620 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f05640987f0 tx=0x7f05640d3550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7af30387e54478f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f055effd640 1 -- 172.21.15.18:0/2211152307 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056409c390 con 0x564821dc7260 2024-09-19T09:57:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f055effd640 1 -- 172.21.15.18:0/2211152307 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05640a0740 con 0x564821dc7260 2024-09-19T09:57:36.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f055effd640 1 -- 172.21.15.18:0/2211152307 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640980e0 con 0x564821dc7260 2024-09-19T09:57:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f057e442740 1 -- 172.21.15.18:0/2211152307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc7260 msgr2=0x564821de0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f057e442740 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc7260 0x564821de0620 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f05640987f0 tx=0x7f05640d3550 comp rx=0 tx=0).stop 2024-09-19T09:57:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f057e442740 1 -- 172.21.15.18:0/2211152307 shutdown_connections 2024-09-19T09:57:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f057e442740 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821dc09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f057e442740 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc7260 0x564821de0620 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f057e442740 1 --2- 172.21.15.18:0/2211152307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc6920 0x564821dd85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f057e442740 1 -- 172.21.15.18:0/2211152307 >> 172.21.15.18:0/2211152307 conn(0x564821dc2010 msgr2=0x564821dd7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f057e442740 1 -- 172.21.15.18:0/2211152307 shutdown_connections 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.977+0000 7f057e442740 1 -- 172.21.15.18:0/2211152307 wait complete. 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.978+0000 7f057e442740 1 -- start start 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.978+0000 7f057e442740 1 Processor -- start 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.978+0000 7f057e442740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dddb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f057e442740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 0x564821dde070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f057e442740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821ddf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f057e442740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05741a8040 con 0x564821dc6920 2024-09-19T09:57:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f057e442740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05741a7970 con 0x564821dc7260 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f057e442740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05741a4bb0 con 0x564821dca330 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f057e442740 10 client.0 _ll_register_callbacks cb 0x7f057000b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0579369640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dddb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0579369640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dddb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54122/0 (socket says 172.21.15.18:54122) 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0579369640 1 -- 172.21.15.18:0/1663336716 learned_addr learned my addr 172.21.15.18:0/1663336716 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0579b6a640 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821ddf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0578b68640 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 0x564821dde070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0579369640 1 -- 172.21.15.18:0/1663336716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 msgr2=0x564821ddf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0579369640 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821ddf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0579369640 1 -- 172.21.15.18:0/1663336716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 msgr2=0x564821dde070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0579369640 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 0x564821dde070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0579369640 1 -- 172.21.15.18:0/1663336716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564821ddf690 con 0x564821dc6920 2024-09-19T09:57:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f0579369640 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dddb30 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f057001f4a0 tx=0x7f05700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2beb17387ed7502e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.979+0000 7f055cff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f055cff9640 1 -- 172.21.15.18:0/1663336716 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05700297d0 con 0x564821dc6920 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f055cff9640 1 -- 172.21.15.18:0/1663336716 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0570029970 con 0x564821dc6920 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f057e442740 1 -- 172.21.15.18:0/1663336716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05640a0740 con 0x564821dc6920 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f055cff9640 1 -- 172.21.15.18:0/1663336716 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0570029b70 con 0x564821dc6920 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f057e442740 10 client.16824 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f057e442740 1 -- 172.21.15.18:0/1663336716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564821e4f850 con 0x564821dc6920 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f055cff9640 1 -- 172.21.15.18:0/1663336716 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05640a0740 con 0x564821dc6920 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f055cff9640 1 -- 172.21.15.18:0/1663336716 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0570030070 con 0x564821dc6920 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f057e442740 10 client.16824 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f057e442740 10 client.16824 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f057e442740 20 client.16824 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f057e442740 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564821e50070 0x564821e52490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f057e442740 4 client.16824 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:57:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.980+0000 7f057e442740 1 -- 172.21.15.18:0/1663336716 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564821d31d70 con 0x564821e50070 2024-09-19T09:57:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.981+0000 7f0578b68640 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564821e50070 0x564821e52490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.981+0000 7f055cff9640 10 client.16824 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.981+0000 7f0578b68640 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564821e50070 0x564821e52490 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36d89a07316f183a server_cookie=29dd7d7071378243 in_seq=0 out_seq=0 2024-09-19T09:57:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.991+0000 7f055cff9640 1 -- 172.21.15.18:0/1663336716 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564821d31d70 con 0x564821e50070 2024-09-19T09:57:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.991+0000 7f055cff9640 10 client.16824 handle_command_reply: tid=0 2024-09-19T09:57:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.991+0000 7f057e442740 1 client.16824 shutdown 2024-09-19T09:57:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.992+0000 7f057e442740 1 -- 172.21.15.18:0/1663336716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 msgr2=0x564821dddb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.992+0000 7f057e442740 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dddb30 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f057001f4a0 tx=0x7f05700046c0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.992+0000 7f057e442740 1 -- 172.21.15.18:0/1663336716 shutdown_connections 2024-09-19T09:57:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.992+0000 7f057e442740 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564821e50070 0x564821e52490 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.992+0000 7f057e442740 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564821dca330 0x564821ddf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.992+0000 7f055cff9640 0 client.16824 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.992+0000 7f057e442740 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564821dc7260 0x564821dde070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.992+0000 7f057e442740 1 --2- 172.21.15.18:0/1663336716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564821dc6920 0x564821dddb30 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.993+0000 7f057e442740 1 -- 172.21.15.18:0/1663336716 >> 172.21.15.18:0/1663336716 conn(0x564821dc2010 msgr2=0x564821dd86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.993+0000 7f057e442740 1 -- 172.21.15.18:0/1663336716 shutdown_connections 2024-09-19T09:57:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.993+0000 7f057e442740 1 -- 172.21.15.18:0/1663336716 wait complete. 2024-09-19T09:57:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.993+0000 7f057e442740 20 client.16824 trim_cache size 0 max 16384 2024-09-19T09:57:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:57:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:57:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:57:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:57:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.994+0000 7f057b5cd640 1 -- 172.21.15.18:0/3641287386 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05600a32f0 msgr2=0x7f05600a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.994+0000 7f057b5cd640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05600a32f0 0x7f05600a57b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x564821dc7c90 tx=0x7f057000b4d0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.994+0000 7f057b5cd640 1 -- 172.21.15.18:0/3641287386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0574101c30 msgr2=0x7f057419ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.994+0000 7f057b5cd640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0574101c30 0x7f057419ca80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f056400e9f0 tx=0x7f056400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.994+0000 7f057b5cd640 1 -- 172.21.15.18:0/3641287386 shutdown_connections 2024-09-19T09:57:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.994+0000 7f057b5cd640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f05600a32f0 0x7f05600a57b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.994+0000 7f057b5cd640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05741025f0 0x7f057419f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.994+0000 7f057b5cd640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0574101c30 0x7f057419ca80 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.994+0000 7f057b5cd640 1 --2- 172.21.15.18:0/3641287386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0574100a40 0x7f057406a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.994+0000 7f057b5cd640 1 -- 172.21.15.18:0/3641287386 >> 172.21.15.18:0/3641287386 conn(0x7f05740fc1e0 msgr2=0x7f0574104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.995+0000 7f057b5cd640 1 -- 172.21.15.18:0/3641287386 shutdown_connections 2024-09-19T09:57:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:36.995+0000 7f057b5cd640 1 -- 172.21.15.18:0/3641287386 wait complete. 2024-09-19T09:57:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.472+0000 7fe38415b640 1 -- 172.21.15.18:0/366200314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c1008d0 msgr2=0x7fe37c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.472+0000 7fe38415b640 1 --2- 172.21.15.18:0/366200314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c1008d0 0x7fe37c100cb0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe378009900 tx=0x7fe37802a410 comp rx=0 tx=0).stop 2024-09-19T09:57:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.472+0000 7fe38415b640 1 -- 172.21.15.18:0/366200314 shutdown_connections 2024-09-19T09:57:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.472+0000 7fe38415b640 1 --2- 172.21.15.18:0/366200314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c10e480 0x7fe37c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.472+0000 7fe38415b640 1 --2- 172.21.15.18:0/366200314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe37c101280 0x7fe37c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.472+0000 7fe38415b640 1 --2- 172.21.15.18:0/366200314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c1008d0 0x7fe37c100cb0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.472+0000 7fe38415b640 1 -- 172.21.15.18:0/366200314 >> 172.21.15.18:0/366200314 conn(0x7fe37c0fc7a0 msgr2=0x7fe37c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.472+0000 7fe38415b640 1 -- 172.21.15.18:0/366200314 shutdown_connections 2024-09-19T09:57:37.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.472+0000 7fe38415b640 1 -- 172.21.15.18:0/366200314 wait complete. 2024-09-19T09:57:37.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.473+0000 7fe38415b640 1 Processor -- start 2024-09-19T09:57:37.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.473+0000 7fe38415b640 1 -- start start 2024-09-19T09:57:37.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.473+0000 7fe38415b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe37c1008d0 0x7fe37c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.473+0000 7fe38415b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c101280 0x7fe37c19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.473+0000 7fe38415b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c10e480 0x7fe37c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.473+0000 7fe38415b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1141b0 con 0x7fe37c10e480 2024-09-19T09:57:37.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.473+0000 7fe38415b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c114030 con 0x7fe37c1008d0 2024-09-19T09:57:37.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.473+0000 7fe38415b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c114330 con 0x7fe37c101280 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe3826f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c10e480 0x7fe37c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe3826f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c10e480 0x7fe37c19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54148/0 (socket says 172.21.15.18:54148) 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe3826f8640 1 -- 172.21.15.18:0/2513645925 learned_addr learned my addr 172.21.15.18:0/2513645925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe381ef7640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe37c1008d0 0x7fe37c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe3816f6640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c101280 0x7fe37c19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe3826f8640 1 -- 172.21.15.18:0/2513645925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c101280 msgr2=0x7fe37c19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe3826f8640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c101280 0x7fe37c19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe3826f8640 1 -- 172.21.15.18:0/2513645925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe37c1008d0 msgr2=0x7fe37c19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe3826f8640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe37c1008d0 0x7fe37c19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe3826f8640 1 -- 172.21.15.18:0/2513645925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c19f680 con 0x7fe37c10e480 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe3826f8640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c10e480 0x7fe37c19efa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe374009fd0 tx=0x7fe37400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe372ffd640 1 -- 172.21.15.18:0/2513645925 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374004d20 con 0x7fe37c10e480 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe372ffd640 1 -- 172.21.15.18:0/2513645925 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe374005020 con 0x7fe37c10e480 2024-09-19T09:57:37.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe38415b640 1 -- 172.21.15.18:0/2513645925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37c19f970 con 0x7fe37c10e480 2024-09-19T09:57:37.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.474+0000 7fe372ffd640 1 -- 172.21.15.18:0/2513645925 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3740116d0 con 0x7fe37c10e480 2024-09-19T09:57:37.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.475+0000 7fe38415b640 1 -- 172.21.15.18:0/2513645925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37c1a7250 con 0x7fe37c10e480 2024-09-19T09:57:37.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.477+0000 7fe372ffd640 1 -- 172.21.15.18:0/2513645925 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe3740051d0 con 0x7fe37c10e480 2024-09-19T09:57:37.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.477+0000 7fe386534740 1 Processor -- start 2024-09-19T09:57:37.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.477+0000 7fe386534740 1 -- start start 2024-09-19T09:57:37.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe386534740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11db40 0x561edc11c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe386534740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11c5d0 0x561edc11ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe386534740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc127370 0x561edc129760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe386534740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561edc0822f0 con 0x561edc11db40 2024-09-19T09:57:37.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe386534740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561edc029cf0 con 0x561edc127370 2024-09-19T09:57:37.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe386534740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561edc07e2b0 con 0x561edc11c5d0 2024-09-19T09:57:37.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe3816f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11db40 0x561edc11c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe372ffd640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3680a32c0 0x7fe3680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe3816f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11db40 0x561edc11c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54150/0 (socket says 172.21.15.18:54150) 2024-09-19T09:57:37.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe3816f6640 1 -- 172.21.15.18:0/2719912452 learned_addr learned my addr 172.21.15.18:0/2719912452 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe381ef7640 1 --2- 172.21.15.18:0/2719912452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11c5d0 0x561edc11ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe3826f8640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3680a32c0 0x7fe3680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe372ffd640 1 -- 172.21.15.18:0/2513645925 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe3740cfdb0 con 0x7fe37c10e480 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe3816f6640 1 -- 172.21.15.18:0/2719912452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11c5d0 msgr2=0x561edc11ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe3816f6640 1 --2- 172.21.15.18:0/2719912452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11c5d0 0x561edc11ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe3816f6640 1 -- 172.21.15.18:0/2719912452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc127370 msgr2=0x561edc129760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe3816f6640 1 --2- 172.21.15.18:0/2719912452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc127370 0x561edc129760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.478+0000 7fe3816f6640 1 -- 172.21.15.18:0/2719912452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561edc00e3a0 con 0x561edc11db40 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.479+0000 7fe3816f6640 1 --2- 172.21.15.18:0/2719912452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11db40 0x561edc11c090 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe36c004650 tx=0x7fe36c0137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe883db2cb1ebd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.479+0000 7fe367fff640 1 -- 172.21.15.18:0/2719912452 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c013070 con 0x561edc11db40 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.479+0000 7fe367fff640 1 -- 172.21.15.18:0/2719912452 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe36c017030 con 0x561edc11db40 2024-09-19T09:57:37.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.479+0000 7fe3826f8640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3680a32c0 0x7fe3680a5780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe374098800 tx=0x7fe374066de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:37.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.479+0000 7fe367fff640 1 -- 172.21.15.18:0/2719912452 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c01b610 con 0x561edc11db40 2024-09-19T09:57:37.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.479+0000 7fe386534740 1 -- 172.21.15.18:0/2719912452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11db40 msgr2=0x561edc11c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:37.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.479+0000 7fe386534740 1 --2- 172.21.15.18:0/2719912452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11db40 0x561edc11c090 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe36c004650 tx=0x7fe36c0137d0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.480+0000 7fe386534740 1 -- 172.21.15.18:0/2719912452 shutdown_connections 2024-09-19T09:57:37.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.480+0000 7fe386534740 1 --2- 172.21.15.18:0/2719912452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc127370 0x561edc129760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.480+0000 7fe386534740 1 --2- 172.21.15.18:0/2719912452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11c5d0 0x561edc11ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.480+0000 7fe386534740 1 --2- 172.21.15.18:0/2719912452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11db40 0x561edc11c090 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.480+0000 7fe386534740 1 -- 172.21.15.18:0/2719912452 >> 172.21.15.18:0/2719912452 conn(0x561edc0e5310 msgr2=0x561edc118c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.480+0000 7fe386534740 1 -- 172.21.15.18:0/2719912452 shutdown_connections 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.480+0000 7fe386534740 1 -- 172.21.15.18:0/2719912452 wait complete. 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.480+0000 7fe386534740 1 -- start start 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.480+0000 7fe386534740 1 Processor -- start 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.480+0000 7fe386534740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc11c5d0 0x561edc126d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe386534740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc123fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe386534740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc1245d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe386534740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561edc12a070 con 0x561edc127370 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe386534740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561edc03d060 con 0x561edc11c5d0 2024-09-19T09:57:37.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe386534740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561edc12a1f0 con 0x561edc11db40 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe386534740 10 client.0 _ll_register_callbacks cb 0x561edbd908c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3816f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc1245d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3816f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc1245d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54154/0 (socket says 172.21.15.18:54154) 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3816f6640 1 -- 172.21.15.18:0/219281519 learned_addr learned my addr 172.21.15.18:0/219281519 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe381ef7640 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc123fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3816f6640 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc11c5d0 0x561edc126d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3816f6640 1 -- 172.21.15.18:0/219281519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 msgr2=0x561edc123fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3816f6640 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc123fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3816f6640 1 -- 172.21.15.18:0/219281519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc11c5d0 msgr2=0x561edc126d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3816f6640 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc11c5d0 0x561edc126d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3816f6640 1 -- 172.21.15.18:0/219281519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561edbdf33c0 con 0x561edc127370 2024-09-19T09:57:37.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3816f6640 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc1245d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009e30 tx=0x7fe36c00fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed0fdc87a48af5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3657fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3657fa640 1 -- 172.21.15.18:0/219281519 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c009980 con 0x561edc127370 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe3657fa640 1 -- 172.21.15.18:0/219281519 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe36c0130f0 con 0x561edc127370 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.481+0000 7fe386534740 1 -- 172.21.15.18:0/219281519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe36c017030 con 0x561edc127370 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe3657fa640 1 -- 172.21.15.18:0/219281519 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe36c011440 con 0x561edc127370 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe386534740 10 client.16836 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe386534740 1 -- 172.21.15.18:0/219281519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561edc135ad0 con 0x561edc127370 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe3657fa640 1 -- 172.21.15.18:0/219281519 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe36c017030 con 0x561edc127370 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe3657fa640 1 -- 172.21.15.18:0/219281519 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe36c01c540 con 0x561edc127370 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe386534740 10 client.16836 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe386534740 10 client.16836 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe386534740 20 client.16836 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:37.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe386534740 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x561edc136e20 0x561edc139210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe386534740 4 client.16836 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe386534740 1 -- 172.21.15.18:0/219281519 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561edc08f860 con 0x561edc136e20 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.482+0000 7fe381ef7640 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x561edc136e20 0x561edc139210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.483+0000 7fe381ef7640 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x561edc136e20 0x561edc139210 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be7e9cdd5ae1811e server_cookie=fa456fbf60451eb5 in_seq=0 out_seq=0 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.483+0000 7fe3657fa640 10 client.16836 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe3657fa640 1 -- 172.21.15.18:0/219281519 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561edc08f860 con 0x561edc136e20 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe3657fa640 10 client.16836 handle_command_reply: tid=0 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 client.16836 shutdown 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 -- 172.21.15.18:0/219281519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 msgr2=0x561edc1245d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc1245d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009e30 tx=0x7fe36c00fe60 comp rx=0 tx=0).stop 2024-09-19T09:57:37.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 -- 172.21.15.18:0/219281519 shutdown_connections 2024-09-19T09:57:37.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x561edc136e20 0x561edc139210 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc1245d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc123fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe3657fa640 0 client.16836 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:57:37.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 --2- 172.21.15.18:0/219281519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc11c5d0 0x561edc126d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 -- 172.21.15.18:0/219281519 >> 172.21.15.18:0/219281519 conn(0x561edc0e5310 msgr2=0x561edc11e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:37.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 -- 172.21.15.18:0/219281519 shutdown_connections 2024-09-19T09:57:37.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 1 -- 172.21.15.18:0/219281519 wait complete. 2024-09-19T09:57:37.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.484+0000 7fe386534740 20 client.16836 trim_cache size 0 max 16384 2024-09-19T09:57:37.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.497+0000 7fe386534740 1 Processor -- start 2024-09-19T09:57:37.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.497+0000 7fe386534740 1 -- start start 2024-09-19T09:57:37.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.497+0000 7fe386534740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11c5d0 0x561edc133310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.497+0000 7fe386534740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc1238c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.497+0000 7fe386534740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc127370 0x561edc125f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.497+0000 7fe386534740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1af710 con 0x561edc11c5d0 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.497+0000 7fe386534740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1b1250 con 0x561edc127370 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.497+0000 7fe386534740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1afde0 con 0x561edc11db40 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3816f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11c5d0 0x561edc133310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3816f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11c5d0 0x561edc133310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54164/0 (socket says 172.21.15.18:54164) 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3816f6640 1 -- 172.21.15.18:0/2275916009 learned_addr learned my addr 172.21.15.18:0/2275916009 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe381ef7640 1 --2- 172.21.15.18:0/2275916009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc1238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3816f6640 1 --2- 172.21.15.18:0/2275916009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc127370 0x561edc125f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3816f6640 1 -- 172.21.15.18:0/2275916009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 msgr2=0x561edc1238c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3816f6640 1 --2- 172.21.15.18:0/2275916009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc1238c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3816f6640 1 -- 172.21.15.18:0/2275916009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc127370 msgr2=0x561edc125f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3816f6640 1 --2- 172.21.15.18:0/2275916009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc127370 0x561edc125f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3816f6640 1 -- 172.21.15.18:0/2275916009 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561edc119960 con 0x561edc11c5d0 2024-09-19T09:57:37.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3816f6640 1 --2- 172.21.15.18:0/2275916009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11c5d0 0x561edc133310 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe36c01ca80 tx=0x7fe36c009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6acb4b28e984cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:37.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3677fe640 1 -- 172.21.15.18:0/2275916009 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0130f0 con 0x561edc11c5d0 2024-09-19T09:57:37.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3677fe640 1 -- 172.21.15.18:0/2275916009 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe36c017070 con 0x561edc11c5d0 2024-09-19T09:57:37.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.498+0000 7fe3677fe640 1 -- 172.21.15.18:0/2275916009 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0115e0 con 0x561edc11c5d0 2024-09-19T09:57:37.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 -- 172.21.15.18:0/2275916009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11c5d0 msgr2=0x561edc133310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:37.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 --2- 172.21.15.18:0/2275916009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11c5d0 0x561edc133310 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe36c01ca80 tx=0x7fe36c009bc0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 -- 172.21.15.18:0/2275916009 shutdown_connections 2024-09-19T09:57:37.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 --2- 172.21.15.18:0/2275916009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc127370 0x561edc125f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 --2- 172.21.15.18:0/2275916009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc1238c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 --2- 172.21.15.18:0/2275916009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc11c5d0 0x561edc133310 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 -- 172.21.15.18:0/2275916009 >> 172.21.15.18:0/2275916009 conn(0x561edc0e5310 msgr2=0x561edc125840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 -- 172.21.15.18:0/2275916009 shutdown_connections 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 -- 172.21.15.18:0/2275916009 wait complete. 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 -- start start 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.499+0000 7fe386534740 1 Processor -- start 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe386534740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc11c5d0 0x561edc12f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe386534740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc12fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe386534740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc12adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe386534740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1b0b80 con 0x561edc127370 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe386534740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1b04b0 con 0x561edc11c5d0 2024-09-19T09:57:37.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe386534740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1ad6f0 con 0x561edc11db40 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe386534740 10 client.0 _ll_register_callbacks cb 0x7fe378009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe3816f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc12adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe3816f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc12adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54180/0 (socket says 172.21.15.18:54180) 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe3816f6640 1 -- 172.21.15.18:0/1627939707 learned_addr learned my addr 172.21.15.18:0/1627939707 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe381ef7640 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc12fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe3816f6640 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc11c5d0 0x561edc12f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe381ef7640 1 -- 172.21.15.18:0/1627939707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc11c5d0 msgr2=0x561edc12f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe381ef7640 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc11c5d0 0x561edc12f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe381ef7640 1 -- 172.21.15.18:0/1627939707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 msgr2=0x561edc12adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe381ef7640 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc12adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.500+0000 7fe381ef7640 1 -- 172.21.15.18:0/1627939707 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561edc12b5e0 con 0x561edc11db40 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe381ef7640 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc12fd90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe378005940 tx=0x7fe378031bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4663f19e7d89421e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe3657fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:57:37.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe3657fa640 1 -- 172.21.15.18:0/1627939707 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378035040 con 0x561edc11db40 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe386534740 1 -- 172.21.15.18:0/1627939707 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe36c017070 con 0x561edc11db40 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe3657fa640 1 -- 172.21.15.18:0/1627939707 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe378005020 con 0x561edc11db40 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe3657fa640 1 -- 172.21.15.18:0/1627939707 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe378005220 con 0x561edc11db40 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe386534740 10 client.26257 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe386534740 1 -- 172.21.15.18:0/1627939707 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561edc1a1640 con 0x561edc11db40 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe3657fa640 1 -- 172.21.15.18:0/1627939707 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe36c017070 con 0x561edc11db40 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe3657fa640 1 -- 172.21.15.18:0/1627939707 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe3780035f0 con 0x561edc11db40 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.501+0000 7fe386534740 10 client.26257 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe386534740 10 client.26257 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe386534740 20 client.26257 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:37.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe386534740 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x561edc1a1df0 0x561edc1a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe386534740 4 client.26257 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe386534740 1 -- 172.21.15.18:0/1627939707 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561edc089d70 con 0x561edc1a1df0 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe3816f6640 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x561edc1a1df0 0x561edc1a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe3816f6640 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x561edc1a1df0 0x561edc1a4210 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=18f66f0ad20f1570 server_cookie=f833adc630e09f9c in_seq=0 out_seq=0 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe3657fa640 10 client.26257 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe3657fa640 1 -- 172.21.15.18:0/1627939707 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561edc089d70 con 0x561edc1a1df0 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe3657fa640 10 client.26257 handle_command_reply: tid=0 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.502+0000 7fe386534740 1 client.26257 shutdown 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 1 -- 172.21.15.18:0/1627939707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 msgr2=0x561edc12fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc12fd90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe378005940 tx=0x7fe378031bb0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 1 -- 172.21.15.18:0/1627939707 shutdown_connections 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x561edc1a1df0 0x561edc1a4210 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561edc127370 0x561edc12adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe3657fa640 0 client.26257 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:57:37.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561edc11db40 0x561edc12fd90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 1 --2- 172.21.15.18:0/1627939707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561edc11c5d0 0x561edc12f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 1 -- 172.21.15.18:0/1627939707 >> 172.21.15.18:0/1627939707 conn(0x561edc0e5310 msgr2=0x561edc126060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:37.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 1 -- 172.21.15.18:0/1627939707 shutdown_connections 2024-09-19T09:57:37.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 1 -- 172.21.15.18:0/1627939707 wait complete. 2024-09-19T09:57:37.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe386534740 20 client.26257 trim_cache size 0 max 16384 2024-09-19T09:57:37.510 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:57:37.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe38415b640 1 -- 172.21.15.18:0/2513645925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3680a32c0 msgr2=0x7fe3680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:37.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe38415b640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3680a32c0 0x7fe3680a5780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe374098800 tx=0x7fe374066de0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe38415b640 1 -- 172.21.15.18:0/2513645925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c10e480 msgr2=0x7fe37c19efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:37.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.503+0000 7fe38415b640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c10e480 0x7fe37c19efa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe374009fd0 tx=0x7fe37400ee60 comp rx=0 tx=0).stop 2024-09-19T09:57:37.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.504+0000 7fe38415b640 1 -- 172.21.15.18:0/2513645925 shutdown_connections 2024-09-19T09:57:37.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.504+0000 7fe38415b640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3680a32c0 0x7fe3680a5780 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.504+0000 7fe38415b640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c10e480 0x7fe37c19efa0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.504+0000 7fe38415b640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c101280 0x7fe37c19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.504+0000 7fe38415b640 1 --2- 172.21.15.18:0/2513645925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe37c1008d0 0x7fe37c19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:37.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.504+0000 7fe38415b640 1 -- 172.21.15.18:0/2513645925 >> 172.21.15.18:0/2513645925 conn(0x7fe37c0fc7a0 msgr2=0x7fe37c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:37.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.504+0000 7fe38415b640 1 -- 172.21.15.18:0/2513645925 shutdown_connections 2024-09-19T09:57:37.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:37.504+0000 7fe38415b640 1 -- 172.21.15.18:0/2513645925 wait complete. 2024-09-19T09:57:38.323 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:57:38.580 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:38.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:38 smithi018 ceph-mon[30956]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 123 MiB/s wr, 212 op/s 2024-09-19T09:57:38.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:38 smithi049 ceph-mon[34858]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 123 MiB/s wr, 212 op/s 2024-09-19T09:57:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:38 smithi162 ceph-mon[35174]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 123 MiB/s wr, 212 op/s 2024-09-19T09:57:39.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.047+0000 7f73cf98d640 1 -- 172.21.15.18:0/1975803778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c8074590 msgr2=0x7f73c8074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:39.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.047+0000 7f73cf98d640 1 --2- 172.21.15.18:0/1975803778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c8074590 0x7f73c8074970 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009900 tx=0x7f73c402a480 comp rx=0 tx=0).stop 2024-09-19T09:57:39.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.047+0000 7f73cf98d640 1 -- 172.21.15.18:0/1975803778 shutdown_connections 2024-09-19T09:57:39.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.047+0000 7f73cf98d640 1 --2- 172.21.15.18:0/1975803778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8112b90 0x7f73c8114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.047+0000 7f73cf98d640 1 --2- 172.21.15.18:0/1975803778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73c8074eb0 0x7f73c8112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.047+0000 7f73cf98d640 1 --2- 172.21.15.18:0/1975803778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c8074590 0x7f73c8074970 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.047+0000 7f73cf98d640 1 -- 172.21.15.18:0/1975803778 >> 172.21.15.18:0/1975803778 conn(0x7f73c80fd8c0 msgr2=0x7f73c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:39.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.047+0000 7f73cf98d640 1 -- 172.21.15.18:0/1975803778 shutdown_connections 2024-09-19T09:57:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.047+0000 7f73cf98d640 1 -- 172.21.15.18:0/1975803778 wait complete. 2024-09-19T09:57:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cf98d640 1 Processor -- start 2024-09-19T09:57:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cf98d640 1 -- start start 2024-09-19T09:57:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cf98d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8074590 0x7f73c81a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cf98d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73c8074eb0 0x7f73c81a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cf98d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c8112b90 0x7f73c819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cf98d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8118570 con 0x7f73c8112b90 2024-09-19T09:57:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cf98d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81183f0 con 0x7f73c8074eb0 2024-09-19T09:57:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cf98d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81186f0 con 0x7f73c8074590 2024-09-19T09:57:39.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cdf2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c8112b90 0x7f73c819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cdf2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c8112b90 0x7f73c819e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54198/0 (socket says 172.21.15.18:54198) 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.048+0000 7f73cdf2a640 1 -- 172.21.15.18:0/4205192519 learned_addr learned my addr 172.21.15.18:0/4205192519 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73cd729640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8074590 0x7f73c81a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73ccf28640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73c8074eb0 0x7f73c81a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73cdf2a640 1 -- 172.21.15.18:0/4205192519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8074590 msgr2=0x7f73c81a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73cdf2a640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8074590 0x7f73c81a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73cdf2a640 1 -- 172.21.15.18:0/4205192519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73c8074eb0 msgr2=0x7f73c81a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73cdf2a640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73c8074eb0 0x7f73c81a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73cdf2a640 1 -- 172.21.15.18:0/4205192519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c819f070 con 0x7f73c8112b90 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73ccf28640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73c8074eb0 0x7f73c81a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73cdf2a640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c8112b90 0x7f73c819e940 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f73c000eb40 tx=0x7f73c000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:39.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73be7fc640 1 -- 172.21.15.18:0/4205192519 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0004b20 con 0x7f73c8112b90 2024-09-19T09:57:39.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73cf98d640 1 -- 172.21.15.18:0/4205192519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c819f360 con 0x7f73c8112b90 2024-09-19T09:57:39.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73be7fc640 1 -- 172.21.15.18:0/4205192519 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73c0004cc0 con 0x7f73c8112b90 2024-09-19T09:57:39.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73be7fc640 1 -- 172.21.15.18:0/4205192519 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0010850 con 0x7f73c8112b90 2024-09-19T09:57:39.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.049+0000 7f73cf98d640 1 -- 172.21.15.18:0/4205192519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c81ab650 con 0x7f73c8112b90 2024-09-19T09:57:39.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73be7fc640 1 -- 172.21.15.18:0/4205192519 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f73c0005020 con 0x7f73c8112b90 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73d1d66740 1 Processor -- start 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73d1d66740 1 -- start start 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4a65d0 0x556acf4a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4b1370 0x556acf4b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73d1d66740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556acf40c2f0 con 0x556acf4a7b40 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73d1d66740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556acf3b3cf0 con 0x556acf4b1370 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73d1d66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556acf4082b0 con 0x556acf4a65d0 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73ccf28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73ccf28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54204/0 (socket says 172.21.15.18:54204) 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73ccf28640 1 -- 172.21.15.18:0/869669267 learned_addr learned my addr 172.21.15.18:0/869669267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:39.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73cd729640 1 --2- 172.21.15.18:0/869669267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4a65d0 0x556acf4a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.053+0000 7f73ccf28640 1 --2- 172.21.15.18:0/869669267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4b1370 0x556acf4b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73ccf28640 1 -- 172.21.15.18:0/869669267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4a65d0 msgr2=0x556acf4a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73ccf28640 1 --2- 172.21.15.18:0/869669267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4a65d0 0x556acf4a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73ccf28640 1 -- 172.21.15.18:0/869669267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4b1370 msgr2=0x556acf4b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73ccf28640 1 --2- 172.21.15.18:0/869669267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4b1370 0x556acf4b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73ccf28640 1 -- 172.21.15.18:0/869669267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556acf3983a0 con 0x556acf4a7b40 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73be7fc640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f73b40a3240 0x7f73b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73ccf28640 1 --2- 172.21.15.18:0/869669267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a6090 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f73b8004620 tx=0x7f73b800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f837f92e64c8210 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73cd729640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f73b40a3240 0x7f73b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73be7fc640 1 -- 172.21.15.18:0/4205192519 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f73c00d0090 con 0x7f73c8112b90 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73b37fe640 1 -- 172.21.15.18:0/869669267 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b800f3f0 con 0x556acf4a7b40 2024-09-19T09:57:39.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73b37fe640 1 -- 172.21.15.18:0/869669267 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b800fa70 con 0x556acf4a7b40 2024-09-19T09:57:39.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.054+0000 7f73b37fe640 1 -- 172.21.15.18:0/869669267 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8012a50 con 0x556acf4a7b40 2024-09-19T09:57:39.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 -- 172.21.15.18:0/869669267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 msgr2=0x556acf4a6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:39.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 --2- 172.21.15.18:0/869669267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a6090 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f73b8004620 tx=0x7f73b800b6f0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73cd729640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f73b40a3240 0x7f73b40a5700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f73c819fa80 tx=0x7f73c40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:39.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 -- 172.21.15.18:0/869669267 shutdown_connections 2024-09-19T09:57:39.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 --2- 172.21.15.18:0/869669267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4b1370 0x556acf4b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 --2- 172.21.15.18:0/869669267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4a65d0 0x556acf4a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 --2- 172.21.15.18:0/869669267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a6090 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 -- 172.21.15.18:0/869669267 >> 172.21.15.18:0/869669267 conn(0x556acf46f310 msgr2=0x556acf4a2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:39.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 -- 172.21.15.18:0/869669267 shutdown_connections 2024-09-19T09:57:39.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 -- 172.21.15.18:0/869669267 wait complete. 2024-09-19T09:57:39.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 -- start start 2024-09-19T09:57:39.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.055+0000 7f73d1d66740 1 Processor -- start 2024-09-19T09:57:39.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a65d0 0x556acf4b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4a7b40 0x556acf4ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4b1370 0x556acf4ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73d1d66740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556acf4b4070 con 0x556acf4a65d0 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73d1d66740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556acf3c7060 con 0x556acf4b1370 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73d1d66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556acf4b41f0 con 0x556acf4a7b40 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73d1d66740 10 client.0 _ll_register_callbacks cb 0x556acf11a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73cd729640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a65d0 0x556acf4b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73cd729640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a65d0 0x556acf4b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54218/0 (socket says 172.21.15.18:54218) 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73cd729640 1 -- 172.21.15.18:0/3066257494 learned_addr learned my addr 172.21.15.18:0/3066257494 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73cdf2a640 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4b1370 0x556acf4ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73ccf28640 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4a7b40 0x556acf4ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73cd729640 1 -- 172.21.15.18:0/3066257494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4a7b40 msgr2=0x556acf4ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:39.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73cd729640 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4a7b40 0x556acf4ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73cd729640 1 -- 172.21.15.18:0/3066257494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4b1370 msgr2=0x556acf4ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73cd729640 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4b1370 0x556acf4ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.056+0000 7f73cd729640 1 -- 172.21.15.18:0/3066257494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556acf17d3c0 con 0x556acf4a65d0 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73cd729640 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a65d0 0x556acf4b0d80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f73c4033000 tx=0x7f73c4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86894f8da768bcf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73b0ff9640 1 -- 172.21.15.18:0/3066257494 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c404e070 con 0x556acf4a65d0 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73b0ff9640 1 -- 172.21.15.18:0/3066257494 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f73c4003bf0 con 0x556acf4a65d0 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73d1d66740 1 -- 172.21.15.18:0/3066257494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b800fa70 con 0x556acf4a65d0 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73b0ff9640 1 -- 172.21.15.18:0/3066257494 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f73c405a050 con 0x556acf4a65d0 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73d1d66740 10 client.16854 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73d1d66740 1 -- 172.21.15.18:0/3066257494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556acf4bfb40 con 0x556acf4a65d0 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73b0ff9640 1 -- 172.21.15.18:0/3066257494 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b800fa70 con 0x556acf4a65d0 2024-09-19T09:57:39.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73b0ff9640 1 -- 172.21.15.18:0/3066257494 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f73c403d4e0 con 0x556acf4a65d0 2024-09-19T09:57:39.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73d1d66740 10 client.16854 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:39.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73d1d66740 10 client.16854 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:57:39.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73d1d66740 20 client.16854 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:39.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.057+0000 7f73d1d66740 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x556acf4c0fa0 0x556acf4c3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.058+0000 7f73d1d66740 4 client.16854 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:39.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.058+0000 7f73d1d66740 1 -- 172.21.15.18:0/3066257494 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556acf419860 con 0x556acf4c0fa0 2024-09-19T09:57:39.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.058+0000 7f73ccf28640 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x556acf4c0fa0 0x556acf4c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.058+0000 7f73ccf28640 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x556acf4c0fa0 0x556acf4c3400 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d278f9d8bee71c4 server_cookie=2a910a3a062951ba in_seq=0 out_seq=0 2024-09-19T09:57:39.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.058+0000 7f73b0ff9640 10 client.16854 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73b0ff9640 1 -- 172.21.15.18:0/3066257494 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556acf419860 con 0x556acf4c0fa0 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73b0ff9640 10 client.16854 handle_command_reply: tid=0 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 client.16854 shutdown 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 -- 172.21.15.18:0/3066257494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a65d0 msgr2=0x556acf4b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a65d0 0x556acf4b0d80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f73c4033000 tx=0x7f73c4009260 comp rx=0 tx=0).stop 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 -- 172.21.15.18:0/3066257494 shutdown_connections 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x556acf4c0fa0 0x556acf4c3400 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4b1370 0x556acf4ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4a7b40 0x556acf4ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73b0ff9640 0 client.16854 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 --2- 172.21.15.18:0/3066257494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a65d0 0x556acf4b0d80 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 -- 172.21.15.18:0/3066257494 >> 172.21.15.18:0/3066257494 conn(0x556acf46f310 msgr2=0x556acf4a8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:39.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 -- 172.21.15.18:0/3066257494 shutdown_connections 2024-09-19T09:57:39.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 1 -- 172.21.15.18:0/3066257494 wait complete. 2024-09-19T09:57:39.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.059+0000 7f73d1d66740 20 client.16854 trim_cache size 0 max 16384 2024-09-19T09:57:39.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73d1d66740 1 Processor -- start 2024-09-19T09:57:39.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73d1d66740 1 -- start start 2024-09-19T09:57:39.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 0x556acf4ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 0x556acf4a9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73d1d66740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81b3ac0 con 0x556acf4a7b40 2024-09-19T09:57:39.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73d1d66740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81b5600 con 0x556acf4a65d0 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73d1d66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81b4190 con 0x556acf4b1370 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73ccf28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73ccf28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54224/0 (socket says 172.21.15.18:54224) 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73ccf28640 1 -- 172.21.15.18:0/901919944 learned_addr learned my addr 172.21.15.18:0/901919944 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73cdf2a640 1 --2- 172.21.15.18:0/901919944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 0x556acf4a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73cd729640 1 --2- 172.21.15.18:0/901919944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 0x556acf4ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73ccf28640 1 -- 172.21.15.18:0/901919944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 msgr2=0x556acf4a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73ccf28640 1 --2- 172.21.15.18:0/901919944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 0x556acf4a9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73ccf28640 1 -- 172.21.15.18:0/901919944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 msgr2=0x556acf4ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73ccf28640 1 --2- 172.21.15.18:0/901919944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 0x556acf4ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73ccf28640 1 -- 172.21.15.18:0/901919944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556acf4acfe0 con 0x556acf4a7b40 2024-09-19T09:57:39.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.073+0000 7f73cdf2a640 1 --2- 172.21.15.18:0/901919944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 0x556acf4a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:39.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73ccf28640 1 --2- 172.21.15.18:0/901919944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a9120 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f73b800bc50 tx=0x7f73b8012590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45b3f07d3a41681 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:39.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73b2ffd640 1 -- 172.21.15.18:0/901919944 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8005030 con 0x556acf4a7b40 2024-09-19T09:57:39.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73b2ffd640 1 -- 172.21.15.18:0/901919944 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b800f3f0 con 0x556acf4a7b40 2024-09-19T09:57:39.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73b2ffd640 1 -- 172.21.15.18:0/901919944 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8012970 con 0x556acf4a7b40 2024-09-19T09:57:39.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73d1d66740 1 -- 172.21.15.18:0/901919944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 msgr2=0x556acf4a9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:39.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73d1d66740 1 --2- 172.21.15.18:0/901919944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a9120 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f73b800bc50 tx=0x7f73b8012590 comp rx=0 tx=0).stop 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73d1d66740 1 -- 172.21.15.18:0/901919944 shutdown_connections 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73d1d66740 1 --2- 172.21.15.18:0/901919944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 0x556acf4a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73d1d66740 1 --2- 172.21.15.18:0/901919944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4a9120 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73d1d66740 1 --2- 172.21.15.18:0/901919944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 0x556acf4ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.074+0000 7f73d1d66740 1 -- 172.21.15.18:0/901919944 >> 172.21.15.18:0/901919944 conn(0x556acf46f310 msgr2=0x556acf4a1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 1 -- 172.21.15.18:0/901919944 shutdown_connections 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 1 -- 172.21.15.18:0/901919944 wait complete. 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 1 -- start start 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 1 Processor -- start 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 0x556acf4b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4b5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 0x556acf4b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81b4f30 con 0x556acf4a7b40 2024-09-19T09:57:39.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81b4860 con 0x556acf4a65d0 2024-09-19T09:57:39.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81b1aa0 con 0x556acf4b1370 2024-09-19T09:57:39.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.075+0000 7f73d1d66740 10 client.0 _ll_register_callbacks cb 0x7f73c4031780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:39.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73ccf28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73cd729640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 0x556acf4b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73cd729640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 0x556acf4b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:57982/0 (socket says 172.21.15.18:57982) 2024-09-19T09:57:39.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73ccf28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4b5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54228/0 (socket says 172.21.15.18:54228) 2024-09-19T09:57:39.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73cd729640 1 -- 172.21.15.18:0/2795533698 learned_addr learned my addr 172.21.15.18:0/2795533698 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73cdf2a640 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 0x556acf4b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73ccf28640 1 -- 172.21.15.18:0/2795533698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 msgr2=0x556acf4b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73ccf28640 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 0x556acf4b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73ccf28640 1 -- 172.21.15.18:0/2795533698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 msgr2=0x556acf4b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73ccf28640 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 0x556acf4b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73ccf28640 1 -- 172.21.15.18:0/2795533698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556acf52ad80 con 0x556acf4a7b40 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73cd729640 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 0x556acf4b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73ccf28640 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4b5860 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f73b800b940 tx=0x7f73b8011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbf17b0785f8d07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73b0ff9640 1 -- 172.21.15.18:0/2795533698 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b800f5a0 con 0x556acf4a7b40 2024-09-19T09:57:39.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73b0ff9640 1 -- 172.21.15.18:0/2795533698 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f73b800f740 con 0x556acf4a7b40 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.076+0000 7f73d1d66740 1 -- 172.21.15.18:0/2795533698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b800f3f0 con 0x556acf4a7b40 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73b0ff9640 1 -- 172.21.15.18:0/2795533698 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f73b800f940 con 0x556acf4a7b40 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73d1d66740 10 client.16860 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73d1d66740 1 -- 172.21.15.18:0/2795533698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556acf52c060 con 0x556acf4a7b40 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73b0ff9640 1 -- 172.21.15.18:0/2795533698 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b800f3f0 con 0x556acf4a7b40 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73b0ff9640 1 -- 172.21.15.18:0/2795533698 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f73b8025070 con 0x556acf4a7b40 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73d1d66740 10 client.16860 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73d1d66740 10 client.16860 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73d1d66740 20 client.16860 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73d1d66740 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x556acf52c4b0 0x556acf52e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73d1d66740 4 client.16860 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:57:39.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73d1d66740 1 -- 172.21.15.18:0/2795533698 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556acf413d70 con 0x556acf52c4b0 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.077+0000 7f73cd729640 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x556acf52c4b0 0x556acf52e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73b0ff9640 10 client.16860 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73cd729640 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x556acf52c4b0 0x556acf52e8d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1fe2e112d0c22ada server_cookie=d8282c808a660cdb in_seq=0 out_seq=0 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73b0ff9640 1 -- 172.21.15.18:0/2795533698 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556acf413d70 con 0x556acf52c4b0 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73b0ff9640 10 client.16860 handle_command_reply: tid=0 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 client.16860 shutdown 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 -- 172.21.15.18:0/2795533698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 msgr2=0x556acf4b5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4b5860 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f73b800b940 tx=0x7f73b8011cd0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 -- 172.21.15.18:0/2795533698 shutdown_connections 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x556acf52c4b0 0x556acf52e8d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556acf4b1370 0x556acf4b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556acf4a7b40 0x556acf4b5860 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73b0ff9640 0 client.16860 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:57:39.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 --2- 172.21.15.18:0/2795533698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556acf4a65d0 0x556acf4b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 -- 172.21.15.18:0/2795533698 >> 172.21.15.18:0/2795533698 conn(0x556acf46f310 msgr2=0x556acf4af890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:39.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 -- 172.21.15.18:0/2795533698 shutdown_connections 2024-09-19T09:57:39.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.078+0000 7f73d1d66740 1 -- 172.21.15.18:0/2795533698 wait complete. 2024-09-19T09:57:39.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73d1d66740 20 client.16860 trim_cache size 0 max 16384 2024-09-19T09:57:39.087 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:57:39.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 -- 172.21.15.18:0/4205192519 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f73b40a3240 msgr2=0x7f73b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:39.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f73b40a3240 0x7f73b40a5700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f73c819fa80 tx=0x7f73c40058d0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 -- 172.21.15.18:0/4205192519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c8112b90 msgr2=0x7f73c819e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:39.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c8112b90 0x7f73c819e940 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f73c000eb40 tx=0x7f73c000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 -- 172.21.15.18:0/4205192519 shutdown_connections 2024-09-19T09:57:39.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f73b40a3240 0x7f73b40a5700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c8112b90 0x7f73c819e940 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73c8074eb0 0x7f73c81a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 --2- 172.21.15.18:0/4205192519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8074590 0x7f73c81a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:39.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 -- 172.21.15.18:0/4205192519 >> 172.21.15.18:0/4205192519 conn(0x7f73c80fd8c0 msgr2=0x7f73c80ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:39.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 -- 172.21.15.18:0/4205192519 shutdown_connections 2024-09-19T09:57:39.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:39.079+0000 7f73cf98d640 1 -- 172.21.15.18:0/4205192519 wait complete. 2024-09-19T09:57:39.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:57:40.184 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:40.630 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:40 smithi018 ceph-mon[30956]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 75 MiB/s wr, 147 op/s 2024-09-19T09:57:40.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.628+0000 7f3afc23b640 1 -- 172.21.15.18:0/3170071077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af41036e0 msgr2=0x7f3af4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:40.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.628+0000 7f3afc23b640 1 --2- 172.21.15.18:0/3170071077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af41036e0 0x7f3af4107b90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009930 tx=0x7f3ae402a420 comp rx=0 tx=0).stop 2024-09-19T09:57:40.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.628+0000 7f3afc23b640 1 -- 172.21.15.18:0/3170071077 shutdown_connections 2024-09-19T09:57:40.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.628+0000 7f3afc23b640 1 --2- 172.21.15.18:0/3170071077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3af41082a0 0x7f3af410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.628+0000 7f3afc23b640 1 --2- 172.21.15.18:0/3170071077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af41036e0 0x7f3af4107b90 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.628+0000 7f3afc23b640 1 --2- 172.21.15.18:0/3170071077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af4102d30 0x7f3af4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.628+0000 7f3afc23b640 1 -- 172.21.15.18:0/3170071077 >> 172.21.15.18:0/3170071077 conn(0x7f3af40fc7d0 msgr2=0x7f3af40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.629+0000 7f3afc23b640 1 -- 172.21.15.18:0/3170071077 shutdown_connections 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.629+0000 7f3afc23b640 1 -- 172.21.15.18:0/3170071077 wait complete. 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3afc23b640 1 Processor -- start 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3afc23b640 1 -- start start 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3afc23b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af4102d30 0x7f3af41985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3afc23b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3af41036e0 0x7f3af4198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3afc23b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af41082a0 0x7f3af419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3afc23b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4112060 con 0x7f3af4102d30 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3afc23b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4111ee0 con 0x7f3af41036e0 2024-09-19T09:57:40.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3afc23b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41121e0 con 0x7f3af41082a0 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3af9fd7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af4102d30 0x7f3af41985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3af9fd7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af4102d30 0x7f3af41985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54248/0 (socket says 172.21.15.18:54248) 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3af9fd7640 1 -- 172.21.15.18:0/500514797 learned_addr learned my addr 172.21.15.18:0/500514797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3af97d6640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3af41036e0 0x7f3af4198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af41082a0 0x7f3af419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3af9fd7640 1 -- 172.21.15.18:0/500514797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af41082a0 msgr2=0x7f3af419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3af9fd7640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af41082a0 0x7f3af419ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3af9fd7640 1 -- 172.21.15.18:0/500514797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3af41036e0 msgr2=0x7f3af4198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.630+0000 7f3af9fd7640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3af41036e0 0x7f3af4198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.631+0000 7f3af9fd7640 1 -- 172.21.15.18:0/500514797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af419d550 con 0x7f3af4102d30 2024-09-19T09:57:40.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.631+0000 7f3af9fd7640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af4102d30 0x7f3af41985a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3af000d950 tx=0x7f3af000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.631+0000 7f3aeaffd640 1 -- 172.21.15.18:0/500514797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0017030 con 0x7f3af4102d30 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.631+0000 7f3aeaffd640 1 -- 172.21.15.18:0/500514797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3af0004020 con 0x7f3af4102d30 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.631+0000 7f3aeaffd640 1 -- 172.21.15.18:0/500514797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af00047a0 con 0x7f3af4102d30 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.631+0000 7f3afc23b640 1 -- 172.21.15.18:0/500514797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af419d840 con 0x7f3af4102d30 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.631+0000 7f3afc23b640 1 -- 172.21.15.18:0/500514797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af41a5120 con 0x7f3af4102d30 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.634+0000 7f3afe614740 1 Processor -- start 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.634+0000 7f3afe614740 1 -- start start 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.634+0000 7f3afe614740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad24090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.634+0000 7f3afe614740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad245d0 0x55a79ad24a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.634+0000 7f3afe614740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad2f370 0x55a79ad31760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.634+0000 7f3afe614740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a79ac8a2f0 con 0x55a79ad25b40 2024-09-19T09:57:40.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.634+0000 7f3afe614740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a79ac31cf0 con 0x55a79ad245d0 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.634+0000 7f3afe614740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a79ac862b0 con 0x55a79ad2f370 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3afa7d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad24090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3afa7d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad24090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54256/0 (socket says 172.21.15.18:54256) 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3afa7d8640 1 -- 172.21.15.18:0/865045495 learned_addr learned my addr 172.21.15.18:0/865045495 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3af97d6640 1 --2- 172.21.15.18:0/865045495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad2f370 0x55a79ad31760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3aeaffd640 1 -- 172.21.15.18:0/500514797 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3af00041d0 con 0x7f3af4102d30 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3afa7d8640 1 -- 172.21.15.18:0/865045495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad2f370 msgr2=0x55a79ad31760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/865045495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad2f370 0x55a79ad31760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3afa7d8640 1 -- 172.21.15.18:0/865045495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad245d0 msgr2=0x55a79ad24a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/865045495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad245d0 0x55a79ad24a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3afa7d8640 1 -- 172.21.15.18:0/865045495 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a79ac163a0 con 0x55a79ad25b40 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/865045495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad24090 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009e30 tx=0x7f3aec00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da8c21e6e1e1864 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3adffff640 1 -- 172.21.15.18:0/865045495 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec011640 con 0x55a79ad25b40 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3adffff640 1 -- 172.21.15.18:0/865045495 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aec011cc0 con 0x55a79ad25b40 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.635+0000 7f3adffff640 1 -- 172.21.15.18:0/865045495 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec01bd00 con 0x55a79ad25b40 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3aeaffd640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ae00a3240 0x7f3ae00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3af9fd7640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ae00a3240 0x7f3ae00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3aeaffd640 1 -- 172.21.15.18:0/500514797 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3af00cf360 con 0x7f3af4102d30 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3afe614740 1 -- 172.21.15.18:0/865045495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 msgr2=0x55a79ad24090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3afe614740 1 --2- 172.21.15.18:0/865045495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad24090 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009e30 tx=0x7f3aec00f730 comp rx=0 tx=0).stop 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3af9fd7640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ae00a3240 0x7f3ae00a5700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3af00a4090 tx=0x7f3af00207f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3afe614740 1 -- 172.21.15.18:0/865045495 shutdown_connections 2024-09-19T09:57:40.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3afe614740 1 --2- 172.21.15.18:0/865045495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad2f370 0x55a79ad31760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3afe614740 1 --2- 172.21.15.18:0/865045495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad245d0 0x55a79ad24a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3afe614740 1 --2- 172.21.15.18:0/865045495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad24090 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3afe614740 1 -- 172.21.15.18:0/865045495 >> 172.21.15.18:0/865045495 conn(0x55a79aced310 msgr2=0x55a79ad20c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3afe614740 1 -- 172.21.15.18:0/865045495 shutdown_connections 2024-09-19T09:57:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.636+0000 7f3afe614740 1 -- 172.21.15.18:0/865045495 wait complete. 2024-09-19T09:57:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.637+0000 7f3afe614740 1 -- start start 2024-09-19T09:57:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.637+0000 7f3afe614740 1 Processor -- start 2024-09-19T09:57:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.637+0000 7f3afe614740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad245d0 0x55a79ad2edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.637+0000 7f3afe614740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad2c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.637+0000 7f3afe614740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 0x55a79ad2c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.637+0000 7f3afe614740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a79ad36480 con 0x55a79ad25b40 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.637+0000 7f3afe614740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a79ac45060 con 0x55a79ad2f370 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.637+0000 7f3afe614740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a79ad36600 con 0x55a79ad245d0 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.637+0000 7f3afe614740 10 client.0 _ll_register_callbacks cb 0x55a79a9988c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.637+0000 7f3af97d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad2c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3af97d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad2c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54270/0 (socket says 172.21.15.18:54270) 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3af97d6640 1 -- 172.21.15.18:0/3021045182 learned_addr learned my addr 172.21.15.18:0/3021045182 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 0x55a79ad2c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad245d0 0x55a79ad2edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3af97d6640 1 -- 172.21.15.18:0/3021045182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad245d0 msgr2=0x55a79ad2edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3af97d6640 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad245d0 0x55a79ad2edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3af97d6640 1 -- 172.21.15.18:0/3021045182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 msgr2=0x55a79ad2c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:40.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3af97d6640 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 0x55a79ad2c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3af97d6640 1 -- 172.21.15.18:0/3021045182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a79a9fb3c0 con 0x55a79ad25b40 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 0x55a79ad2c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3af97d6640 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad2c060 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4000c00 tx=0x7f3ae4032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc077a4bedc1b027 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3add7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3add7fa640 1 -- 172.21.15.18:0/3021045182 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4035040 con 0x55a79ad25b40 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3add7fa640 1 -- 172.21.15.18:0/3021045182 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3ae4031970 con 0x55a79ad25b40 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.638+0000 7f3afe614740 1 -- 172.21.15.18:0/3021045182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aec011cc0 con 0x55a79ad25b40 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3add7fa640 1 -- 172.21.15.18:0/3021045182 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ae4004040 con 0x55a79ad25b40 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3afe614740 10 client.16872 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3afe614740 1 -- 172.21.15.18:0/3021045182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a79ad41f70 con 0x55a79ad25b40 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3add7fa640 1 -- 172.21.15.18:0/3021045182 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aec011cc0 con 0x55a79ad25b40 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3add7fa640 1 -- 172.21.15.18:0/3021045182 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3ae4004800 con 0x55a79ad25b40 2024-09-19T09:57:40.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3afe614740 10 client.16872 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3afe614740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3afe614740 20 client.16872 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3afe614740 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a79ad43430 0x55a79ad45850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3afe614740 4 client.16872 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3afe614740 1 -- 172.21.15.18:0/3021045182 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a79ac97860 con 0x55a79ad43430 2024-09-19T09:57:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.639+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a79ad43430 0x55a79ad45850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.640+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a79ad43430 0x55a79ad45850 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=613adddd3a9e91 server_cookie=68cc4879d424d35c in_seq=0 out_seq=0 2024-09-19T09:57:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.640+0000 7f3add7fa640 10 client.16872 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.640+0000 7f3add7fa640 1 -- 172.21.15.18:0/3021045182 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a79ac97860 con 0x55a79ad43430 2024-09-19T09:57:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.640+0000 7f3add7fa640 10 client.16872 handle_command_reply: tid=0 2024-09-19T09:57:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 client.16872 shutdown 2024-09-19T09:57:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 -- 172.21.15.18:0/3021045182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 msgr2=0x55a79ad2c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad2c060 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4000c00 tx=0x7f3ae4032ed0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 -- 172.21.15.18:0/3021045182 shutdown_connections 2024-09-19T09:57:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a79ad43430 0x55a79ad45850 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3add7fa640 0 client.16872 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:40.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 0x55a79ad2c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad2c060 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 --2- 172.21.15.18:0/3021045182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad245d0 0x55a79ad2edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 -- 172.21.15.18:0/3021045182 >> 172.21.15.18:0/3021045182 conn(0x55a79aced310 msgr2=0x55a79ad26960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:40.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 -- 172.21.15.18:0/3021045182 shutdown_connections 2024-09-19T09:57:40.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 1 -- 172.21.15.18:0/3021045182 wait complete. 2024-09-19T09:57:40.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.641+0000 7f3afe614740 20 client.16872 trim_cache size 0 max 16384 2024-09-19T09:57:40.659 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:40 smithi049 ceph-mon[34858]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 75 MiB/s wr, 147 op/s 2024-09-19T09:57:40.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afe614740 1 Processor -- start 2024-09-19T09:57:40.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afe614740 1 -- start start 2024-09-19T09:57:40.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afe614740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad245d0 0x55a79ad2edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afe614740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad25b40 0x55a79ad2b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afe614740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad2f370 0x55a79ad4b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afe614740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41ab300 con 0x55a79ad2f370 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afe614740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41ace40 con 0x55a79ad245d0 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afe614740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41ab9d0 con 0x55a79ad25b40 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afa7d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad2f370 0x55a79ad4b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afa7d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad2f370 0x55a79ad4b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54284/0 (socket says 172.21.15.18:54284) 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afa7d8640 1 -- 172.21.15.18:0/3290778798 learned_addr learned my addr 172.21.15.18:0/3290778798 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/3290778798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad245d0 0x55a79ad2edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3af97d6640 1 --2- 172.21.15.18:0/3290778798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad25b40 0x55a79ad2b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afa7d8640 1 -- 172.21.15.18:0/3290778798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad25b40 msgr2=0x55a79ad2b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/3290778798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad25b40 0x55a79ad2b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afa7d8640 1 -- 172.21.15.18:0/3290778798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad245d0 msgr2=0x55a79ad2edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/3290778798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad245d0 0x55a79ad2edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.655+0000 7f3afa7d8640 1 -- 172.21.15.18:0/3290778798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a79ad2cb60 con 0x55a79ad2f370 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.656+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/3290778798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad2f370 0x55a79ad4b120 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3aec01f010 tx=0x7f3aec01b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e80d82cbfdf2d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.656+0000 7f3adf7fe640 1 -- 172.21.15.18:0/3290778798 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec004ba0 con 0x55a79ad2f370 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.656+0000 7f3adf7fe640 1 -- 172.21.15.18:0/3290778798 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aec003e50 con 0x55a79ad2f370 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.656+0000 7f3adf7fe640 1 -- 172.21.15.18:0/3290778798 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec004020 con 0x55a79ad2f370 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.656+0000 7f3afe614740 1 -- 172.21.15.18:0/3290778798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad2f370 msgr2=0x55a79ad4b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.656+0000 7f3afe614740 1 --2- 172.21.15.18:0/3290778798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad2f370 0x55a79ad4b120 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3aec01f010 tx=0x7f3aec01b8e0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.657+0000 7f3afe614740 1 -- 172.21.15.18:0/3290778798 shutdown_connections 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.657+0000 7f3afe614740 1 --2- 172.21.15.18:0/3290778798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad2f370 0x55a79ad4b120 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.657+0000 7f3afe614740 1 --2- 172.21.15.18:0/3290778798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad25b40 0x55a79ad2b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.657+0000 7f3afe614740 1 --2- 172.21.15.18:0/3290778798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad245d0 0x55a79ad2edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.657+0000 7f3afe614740 1 -- 172.21.15.18:0/3290778798 >> 172.21.15.18:0/3290778798 conn(0x55a79aced310 msgr2=0x55a79ad2a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:40.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.657+0000 7f3afe614740 1 -- 172.21.15.18:0/3290778798 shutdown_connections 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.657+0000 7f3afe614740 1 -- 172.21.15.18:0/3290778798 wait complete. 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.657+0000 7f3afe614740 1 -- start start 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.657+0000 7f3afe614740 1 Processor -- start 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3afe614740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad245d0 0x55a79ad3bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3afe614740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad3c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3afe614740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 0x55a79ad36ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3afe614740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41ac770 con 0x55a79ad25b40 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3afe614740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41ac0a0 con 0x55a79ad2f370 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3afe614740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41a92e0 con 0x55a79ad245d0 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3afe614740 10 client.0 _ll_register_callbacks cb 0x7f3ae4009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:40.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3af97d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad3c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3af97d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad3c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54288/0 (socket says 172.21.15.18:54288) 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3af97d6640 1 -- 172.21.15.18:0/1332992622 learned_addr learned my addr 172.21.15.18:0/1332992622 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad245d0 0x55a79ad3bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 0x55a79ad36ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3af97d6640 1 -- 172.21.15.18:0/1332992622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad245d0 msgr2=0x55a79ad3bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3af97d6640 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad245d0 0x55a79ad3bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3af97d6640 1 -- 172.21.15.18:0/1332992622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 msgr2=0x55a79ad36ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3af97d6640 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 0x55a79ad36ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3af97d6640 1 -- 172.21.15.18:0/1332992622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a79ad37720 con 0x55a79ad25b40 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 0x55a79ad36ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:40.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3af97d6640 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad3c0a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009850 tx=0x7f3ae40329b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888bf21715581741 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.658+0000 7f3add7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3add7fa640 1 -- 172.21.15.18:0/1332992622 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4035070 con 0x55a79ad25b40 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3add7fa640 1 -- 172.21.15.18:0/1332992622 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3ae40038a0 con 0x55a79ad25b40 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3afe614740 1 -- 172.21.15.18:0/1332992622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aec003e50 con 0x55a79ad25b40 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3add7fa640 1 -- 172.21.15.18:0/1332992622 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ae4061050 con 0x55a79ad25b40 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3afe614740 10 client.16878 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3afe614740 1 -- 172.21.15.18:0/1332992622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a79adadc70 con 0x55a79ad25b40 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3add7fa640 1 -- 172.21.15.18:0/1332992622 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aec003e50 con 0x55a79ad25b40 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3add7fa640 1 -- 172.21.15.18:0/1332992622 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3ae4004df0 con 0x55a79ad25b40 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3afe614740 10 client.16878 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3afe614740 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3afe614740 20 client.16878 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:40.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3afe614740 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a79ad43430 0x55a79adb0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3afe614740 4 client.16878 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.659+0000 7f3afe614740 1 -- 172.21.15.18:0/1332992622 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a79ac91d70 con 0x55a79ad43430 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a79ad43430 0x55a79adb0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afa7d8640 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a79ad43430 0x55a79adb0430 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e631555548f0e7d3 server_cookie=75b05909c28b9bdb in_seq=0 out_seq=0 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3add7fa640 10 client.16878 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3add7fa640 1 -- 172.21.15.18:0/1332992622 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a79ac91d70 con 0x55a79ad43430 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3add7fa640 10 client.16878 handle_command_reply: tid=0 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afe614740 1 client.16878 shutdown 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afe614740 1 -- 172.21.15.18:0/1332992622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 msgr2=0x55a79ad3c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afe614740 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad3c0a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009850 tx=0x7f3ae40329b0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afe614740 1 -- 172.21.15.18:0/1332992622 shutdown_connections 2024-09-19T09:57:40.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afe614740 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a79ad43430 0x55a79adb0430 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afe614740 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a79ad2f370 0x55a79ad36ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afe614740 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a79ad25b40 0x55a79ad3c0a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3add7fa640 0 client.16878 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:40.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afe614740 1 --2- 172.21.15.18:0/1332992622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a79ad245d0 0x55a79ad3bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.660+0000 7f3afe614740 1 -- 172.21.15.18:0/1332992622 >> 172.21.15.18:0/1332992622 conn(0x55a79aced310 msgr2=0x55a79ad2b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:40.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afe614740 1 -- 172.21.15.18:0/1332992622 shutdown_connections 2024-09-19T09:57:40.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afe614740 1 -- 172.21.15.18:0/1332992622 wait complete. 2024-09-19T09:57:40.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afe614740 20 client.16878 trim_cache size 0 max 16384 2024-09-19T09:57:40.673 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:40 smithi162 ceph-mon[35174]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 75 MiB/s wr, 147 op/s 2024-09-19T09:57:40.674 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:57:40.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afc23b640 1 -- 172.21.15.18:0/500514797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ae00a3240 msgr2=0x7f3ae00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:40.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afc23b640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ae00a3240 0x7f3ae00a5700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3af00a4090 tx=0x7f3af00207f0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afc23b640 1 -- 172.21.15.18:0/500514797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af4102d30 msgr2=0x7f3af41985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:40.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afc23b640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af4102d30 0x7f3af41985a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3af000d950 tx=0x7f3af000de10 comp rx=0 tx=0).stop 2024-09-19T09:57:40.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afc23b640 1 -- 172.21.15.18:0/500514797 shutdown_connections 2024-09-19T09:57:40.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afc23b640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ae00a3240 0x7f3ae00a5700 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afc23b640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af41082a0 0x7f3af419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afc23b640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3af41036e0 0x7f3af4198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afc23b640 1 --2- 172.21.15.18:0/500514797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af4102d30 0x7f3af41985a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:40.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.661+0000 7f3afc23b640 1 -- 172.21.15.18:0/500514797 >> 172.21.15.18:0/500514797 conn(0x7f3af40fc7d0 msgr2=0x7f3af4105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:40.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.662+0000 7f3afc23b640 1 -- 172.21.15.18:0/500514797 shutdown_connections 2024-09-19T09:57:40.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:40.662+0000 7f3afc23b640 1 -- 172.21.15.18:0/500514797 wait complete. 2024-09-19T09:57:42.624 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:57:42.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:57:42.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:42 smithi018 ceph-mon[30956]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 72 MiB/s wr, 147 op/s 2024-09-19T09:57:42.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:42 smithi049 ceph-mon[34858]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 72 MiB/s wr, 147 op/s 2024-09-19T09:57:42.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:42 smithi162 ceph-mon[35174]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 72 MiB/s wr, 147 op/s 2024-09-19T09:57:42.898 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.470+0000 7fb6303f3640 1 -- 172.21.15.18:0/1313422967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb628102ef0 msgr2=0x7fb62810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.470+0000 7fb6303f3640 1 --2- 172.21.15.18:0/1313422967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb628102ef0 0x7fb62810da40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb620009ca0 tx=0x7fb62002a950 comp rx=0 tx=0).stop 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.470+0000 7fb6303f3640 1 -- 172.21.15.18:0/1313422967 shutdown_connections 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.470+0000 7fb6303f3640 1 --2- 172.21.15.18:0/1313422967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb628102ef0 0x7fb62810da40 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.470+0000 7fb6303f3640 1 --2- 172.21.15.18:0/1313422967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb628102570 0x7fb6281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.470+0000 7fb6303f3640 1 --2- 172.21.15.18:0/1313422967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628100e20 0x7fb628101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.470+0000 7fb6303f3640 1 -- 172.21.15.18:0/1313422967 >> 172.21.15.18:0/1313422967 conn(0x7fb6280fc7d0 msgr2=0x7fb6280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.470+0000 7fb6303f3640 1 -- 172.21.15.18:0/1313422967 shutdown_connections 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.470+0000 7fb6303f3640 1 -- 172.21.15.18:0/1313422967 wait complete. 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb6303f3640 1 Processor -- start 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb6303f3640 1 -- start start 2024-09-19T09:57:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb6303f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628100e20 0x7fb62810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb6303f3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb628102570 0x7fb62810ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb6303f3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb628102ef0 0x7fb62810ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb6303f3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281120d0 con 0x7fb628102ef0 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb6303f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb628111f50 con 0x7fb628100e20 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb6303f3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb628112250 con 0x7fb628102570 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb62e990640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb628102ef0 0x7fb62810ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb62e18f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628100e20 0x7fb62810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb62e990640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb628102ef0 0x7fb62810ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54318/0 (socket says 172.21.15.18:54318) 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb62e990640 1 -- 172.21.15.18:0/1866494528 learned_addr learned my addr 172.21.15.18:0/1866494528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb62e18f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628100e20 0x7fb62810e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:58054/0 (socket says 172.21.15.18:58054) 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb62d98e640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb628102570 0x7fb62810ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb62e990640 1 -- 172.21.15.18:0/1866494528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb628102570 msgr2=0x7fb62810ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb62e990640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb628102570 0x7fb62810ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.471+0000 7fb62e990640 1 -- 172.21.15.18:0/1866494528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628100e20 msgr2=0x7fb62810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.472+0000 7fb62e990640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628100e20 0x7fb62810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.472+0000 7fb62e990640 1 -- 172.21.15.18:0/1866494528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6281a6960 con 0x7fb628102ef0 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.472+0000 7fb62e990640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb628102ef0 0x7fb62810ef50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb620009dc0 tx=0x7fb620003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.472+0000 7fb61f7fe640 1 -- 172.21.15.18:0/1866494528 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620034040 con 0x7fb628102ef0 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.472+0000 7fb6303f3640 1 -- 172.21.15.18:0/1866494528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6281a6bf0 con 0x7fb628102ef0 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.472+0000 7fb61f7fe640 1 -- 172.21.15.18:0/1866494528 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb62002fe10 con 0x7fb628102ef0 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.472+0000 7fb61f7fe640 1 -- 172.21.15.18:0/1866494528 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6200047b0 con 0x7fb628102ef0 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.472+0000 7fb6303f3640 1 -- 172.21.15.18:0/1866494528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6281a70d0 con 0x7fb628102ef0 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.474+0000 7fb61f7fe640 1 -- 172.21.15.18:0/1866494528 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb620037020 con 0x7fb628102ef0 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.474+0000 7fb6327cc740 1 Processor -- start 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb6327cc740 1 -- start start 2024-09-19T09:57:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612aa7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612aa8480 0x55e612ab2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612ab2d40 0x55e612ab5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb6327cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e612a0d280 con 0x55e612aa7b60 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb6327cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e6129b4b10 con 0x55e612aa8480 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb6327cc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e612a09240 con 0x55e612ab2d40 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb62d98e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612aa7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb62d98e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612aa7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54322/0 (socket says 172.21.15.18:54322) 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb62d98e640 1 -- 172.21.15.18:0/2599330757 learned_addr learned my addr 172.21.15.18:0/2599330757 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb61f7fe640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6140a3240 0x7fb6140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb62e18f640 1 --2- 172.21.15.18:0/2599330757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612aa8480 0x55e612ab2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb62e990640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6140a3240 0x7fb6140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb62d98e640 1 -- 172.21.15.18:0/2599330757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612ab2d40 msgr2=0x55e612ab5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb62d98e640 1 --2- 172.21.15.18:0/2599330757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612ab2d40 0x55e612ab5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb62d98e640 1 -- 172.21.15.18:0/2599330757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612aa8480 msgr2=0x55e612ab2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb62d98e640 1 --2- 172.21.15.18:0/2599330757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612aa8480 0x55e612ab2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb62d98e640 1 -- 172.21.15.18:0/2599330757 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6129c11f0 con 0x55e612aa7b60 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.475+0000 7fb61f7fe640 1 -- 172.21.15.18:0/1866494528 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb6200f07f0 con 0x7fb628102ef0 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.476+0000 7fb62d98e640 1 --2- 172.21.15.18:0/2599330757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612aa7f40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb61800abf0 tx=0x7fb6180117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757ab30e3f19ee71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.476+0000 7fb61cdea640 1 -- 172.21.15.18:0/2599330757 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618005020 con 0x55e612aa7b60 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.476+0000 7fb61cdea640 1 -- 172.21.15.18:0/2599330757 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6180047a0 con 0x55e612aa7b60 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.476+0000 7fb62e990640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6140a3240 0x7fb6140a5700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb6200b97b0 tx=0x7fb62008bb20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.476+0000 7fb61cdea640 1 -- 172.21.15.18:0/2599330757 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6180126b0 con 0x55e612aa7b60 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 -- 172.21.15.18:0/2599330757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 msgr2=0x55e612aa7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 --2- 172.21.15.18:0/2599330757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612aa7f40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb61800abf0 tx=0x7fb6180117b0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 -- 172.21.15.18:0/2599330757 shutdown_connections 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 --2- 172.21.15.18:0/2599330757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612ab2d40 0x55e612ab5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 --2- 172.21.15.18:0/2599330757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612aa8480 0x55e612ab2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 --2- 172.21.15.18:0/2599330757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612aa7f40 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 -- 172.21.15.18:0/2599330757 >> 172.21.15.18:0/2599330757 conn(0x55e612aa40f0 msgr2=0x55e612aa44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 -- 172.21.15.18:0/2599330757 shutdown_connections 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 -- 172.21.15.18:0/2599330757 wait complete. 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 -- start start 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 Processor -- start 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa7b60 0x55e612aafb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612ab00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612ab05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e612ab5910 con 0x55e612aa8480 2024-09-19T09:57:43.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e6129c7f10 con 0x55e612ab2d40 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e612ab5a90 con 0x55e612aa7b60 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb6327cc740 10 client.0 _ll_register_callbacks cb 0x55e612990a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.477+0000 7fb62e18f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612ab00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62e18f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612ab00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54324/0 (socket says 172.21.15.18:54324) 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62e18f640 1 -- 172.21.15.18:0/3425895700 learned_addr learned my addr 172.21.15.18:0/3425895700 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62d98e640 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa7b60 0x55e612aafb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62e18f640 1 -- 172.21.15.18:0/3425895700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa7b60 msgr2=0x55e612aafb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62e18f640 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa7b60 0x55e612aafb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62e18f640 1 -- 172.21.15.18:0/3425895700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 msgr2=0x55e612ab05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62d98e640 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612ab05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62e18f640 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612ab05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62e18f640 1 -- 172.21.15.18:0/3425895700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e61277e6a0 con 0x55e612aa8480 2024-09-19T09:57:43.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62d98e640 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612ab05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb62e18f640 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612ab00a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb62400bad0 tx=0x7fb62400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b899a3cb7b3d45de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb611ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb611ffb640 1 -- 172.21.15.18:0/3425895700 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624005020 con 0x55e612aa8480 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb611ffb640 1 -- 172.21.15.18:0/3425895700 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb6240051c0 con 0x55e612aa8480 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb6327cc740 1 -- 172.21.15.18:0/3425895700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6180047a0 con 0x55e612aa8480 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb611ffb640 1 -- 172.21.15.18:0/3425895700 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb624005400 con 0x55e612aa8480 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb6327cc740 10 client.16890 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.478+0000 7fb6327cc740 1 -- 172.21.15.18:0/3425895700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e612ac14f0 con 0x55e612aa8480 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb611ffb640 1 -- 172.21.15.18:0/3425895700 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6180047a0 con 0x55e612aa8480 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb611ffb640 1 -- 172.21.15.18:0/3425895700 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb62401b740 con 0x55e612aa8480 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb6327cc740 10 client.16890 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:43.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb6327cc740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb6327cc740 20 client.16890 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e612ac2a00 0x55e612ac4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb6327cc740 4 client.16890 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb6327cc740 1 -- 172.21.15.18:0/3425895700 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e612a1a7f0 con 0x55e612ac2a00 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb62d98e640 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e612ac2a00 0x55e612ac4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb62d98e640 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e612ac2a00 0x55e612ac4e20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e727e621bc4f696d server_cookie=2f2c856ceb260c32 in_seq=0 out_seq=0 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.479+0000 7fb611ffb640 10 client.16890 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb611ffb640 1 -- 172.21.15.18:0/3425895700 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e612a1a7f0 con 0x55e612ac2a00 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb611ffb640 10 client.16890 handle_command_reply: tid=0 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb6327cc740 1 client.16890 shutdown 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb6327cc740 1 -- 172.21.15.18:0/3425895700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 msgr2=0x55e612ab00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612ab00a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb62400bad0 tx=0x7fb62400bed0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb6327cc740 1 -- 172.21.15.18:0/3425895700 shutdown_connections 2024-09-19T09:57:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e612ac2a00 0x55e612ac4e20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612ab05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612ab00a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3425895700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa7b60 0x55e612aafb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb611ffb640 0 client.16890 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.480+0000 7fb6327cc740 1 -- 172.21.15.18:0/3425895700 >> 172.21.15.18:0/3425895700 conn(0x55e612aa40f0 msgr2=0x55e612aa9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.481+0000 7fb6327cc740 1 -- 172.21.15.18:0/3425895700 shutdown_connections 2024-09-19T09:57:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.481+0000 7fb6327cc740 1 -- 172.21.15.18:0/3425895700 wait complete. 2024-09-19T09:57:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.481+0000 7fb6327cc740 20 client.16890 trim_cache size 0 max 16384 2024-09-19T09:57:43.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb6327cc740 1 Processor -- start 2024-09-19T09:57:43.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb6327cc740 1 -- start start 2024-09-19T09:57:43.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612ab0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa8480 0x55e612aca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612acac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb6327cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281af680 con 0x55e612aa7b60 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb6327cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281b11c0 con 0x55e612ab2d40 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb6327cc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281afd50 con 0x55e612aa8480 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb62d98e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612ab0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb62d98e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612ab0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54328/0 (socket says 172.21.15.18:54328) 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb62d98e640 1 -- 172.21.15.18:0/2491588520 learned_addr learned my addr 172.21.15.18:0/2491588520 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.498+0000 7fb62e18f640 1 --2- 172.21.15.18:0/2491588520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa8480 0x55e612aca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.499+0000 7fb62d98e640 1 --2- 172.21.15.18:0/2491588520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612acac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.499+0000 7fb62d98e640 1 -- 172.21.15.18:0/2491588520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa8480 msgr2=0x55e612aca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.499+0000 7fb62d98e640 1 --2- 172.21.15.18:0/2491588520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa8480 0x55e612aca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.499+0000 7fb62d98e640 1 -- 172.21.15.18:0/2491588520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 msgr2=0x55e612acac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.499+0000 7fb62d98e640 1 --2- 172.21.15.18:0/2491588520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612acac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.499+0000 7fb62d98e640 1 -- 172.21.15.18:0/2491588520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e612ac5190 con 0x55e612aa7b60 2024-09-19T09:57:43.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.499+0000 7fb62d98e640 1 --2- 172.21.15.18:0/2491588520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612ab0430 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x55e612aa3cb0 tx=0x7fb6180117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb01fc78b2cf74e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:43.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.499+0000 7fb613fff640 1 -- 172.21.15.18:0/2491588520 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618005030 con 0x55e612aa7b60 2024-09-19T09:57:43.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.499+0000 7fb613fff640 1 -- 172.21.15.18:0/2491588520 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb618004660 con 0x55e612aa7b60 2024-09-19T09:57:43.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.499+0000 7fb613fff640 1 -- 172.21.15.18:0/2491588520 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6180286d0 con 0x55e612aa7b60 2024-09-19T09:57:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 -- 172.21.15.18:0/2491588520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 msgr2=0x55e612ab0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 --2- 172.21.15.18:0/2491588520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612ab0430 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x55e612aa3cb0 tx=0x7fb6180117b0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 -- 172.21.15.18:0/2491588520 shutdown_connections 2024-09-19T09:57:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 --2- 172.21.15.18:0/2491588520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612acac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 --2- 172.21.15.18:0/2491588520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa8480 0x55e612aca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 --2- 172.21.15.18:0/2491588520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa7b60 0x55e612ab0430 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 -- 172.21.15.18:0/2491588520 >> 172.21.15.18:0/2491588520 conn(0x55e612aa40f0 msgr2=0x55e612aaeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 -- 172.21.15.18:0/2491588520 shutdown_connections 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 -- 172.21.15.18:0/2491588520 wait complete. 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 -- start start 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.500+0000 7fb6327cc740 1 Processor -- start 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa7b60 0x55e612aacb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612aad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb6327cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612aad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb6327cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281b0af0 con 0x55e612aa8480 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb6327cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281b0420 con 0x55e612ab2d40 2024-09-19T09:57:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb6327cc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281ad660 con 0x55e612aa7b60 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb6327cc740 10 client.0 _ll_register_callbacks cb 0x7fb6240040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62e18f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612aad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62e18f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612aad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54338/0 (socket says 172.21.15.18:54338) 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62e18f640 1 -- 172.21.15.18:0/3053452620 learned_addr learned my addr 172.21.15.18:0/3053452620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62d98e640 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa7b60 0x55e612aacb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62d98e640 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612aad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62e18f640 1 -- 172.21.15.18:0/3053452620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa7b60 msgr2=0x55e612aacb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62e18f640 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa7b60 0x55e612aacb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62e18f640 1 -- 172.21.15.18:0/3053452620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 msgr2=0x55e612aad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62e18f640 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612aad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62e18f640 1 -- 172.21.15.18:0/3053452620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e612b2c6a0 con 0x55e612aa8480 2024-09-19T09:57:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62d98e640 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612aad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb62e18f640 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612aad080 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x55e612ab11a0 tx=0x7fb624004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a569b3a6e822b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb611ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb611ffb640 1 -- 172.21.15.18:0/3053452620 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624031450 con 0x55e612aa8480 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb6327cc740 1 -- 172.21.15.18:0/3053452620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb618004660 con 0x55e612aa8480 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.501+0000 7fb611ffb640 1 -- 172.21.15.18:0/3053452620 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb6240315f0 con 0x55e612aa8480 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb611ffb640 1 -- 172.21.15.18:0/3053452620 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb624038070 con 0x55e612aa8480 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb6327cc740 10 client.16896 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb6327cc740 1 -- 172.21.15.18:0/3053452620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e612b2d9a0 con 0x55e612aa8480 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb611ffb640 1 -- 172.21.15.18:0/3053452620 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb618004660 con 0x55e612aa8480 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb611ffb640 1 -- 172.21.15.18:0/3053452620 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb624011790 con 0x55e612aa8480 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb6327cc740 10 client.16896 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb6327cc740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb6327cc740 20 client.16896 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e612b2e0f0 0x55e612b30510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb6327cc740 4 client.16896 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb6327cc740 1 -- 172.21.15.18:0/3053452620 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e612a14d00 con 0x55e612b2e0f0 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.502+0000 7fb62d98e640 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e612b2e0f0 0x55e612b30510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.503+0000 7fb611ffb640 10 client.16896 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.503+0000 7fb62d98e640 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e612b2e0f0 0x55e612b30510 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40bd5eee9e52c572 server_cookie=ebaa17a429478546 in_seq=0 out_seq=0 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb611ffb640 1 -- 172.21.15.18:0/3053452620 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e612a14d00 con 0x55e612b2e0f0 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb611ffb640 10 client.16896 handle_command_reply: tid=0 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 client.16896 shutdown 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 -- 172.21.15.18:0/3053452620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 msgr2=0x55e612aad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612aad080 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x55e612ab11a0 tx=0x7fb624004500 comp rx=0 tx=0).stop 2024-09-19T09:57:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 -- 172.21.15.18:0/3053452620 shutdown_connections 2024-09-19T09:57:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e612b2e0f0 0x55e612b30510 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e612ab2d40 0x55e612aad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e612aa8480 0x55e612aad080 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb611ffb640 0 client.16896 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 --2- 172.21.15.18:0/3053452620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e612aa7b60 0x55e612aacb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 -- 172.21.15.18:0/3053452620 >> 172.21.15.18:0/3053452620 conn(0x55e612aa40f0 msgr2=0x55e612aa2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 -- 172.21.15.18:0/3053452620 shutdown_connections 2024-09-19T09:57:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 1 -- 172.21.15.18:0/3053452620 wait complete. 2024-09-19T09:57:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.504+0000 7fb6327cc740 20 client.16896 trim_cache size 0 max 16384 2024-09-19T09:57:43.511 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:57:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T09:57:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "893c6403-5080-41c3-a3a5-63525b0d5481", 2024-09-19T09:57:43.512 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T09:57:43.512 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:57:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 -- 172.21.15.18:0/1866494528 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6140a3240 msgr2=0x7fb6140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6140a3240 0x7fb6140a5700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb6200b97b0 tx=0x7fb62008bb20 comp rx=0 tx=0).stop 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 -- 172.21.15.18:0/1866494528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb628102ef0 msgr2=0x7fb62810ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb628102ef0 0x7fb62810ef50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb620009dc0 tx=0x7fb620003d00 comp rx=0 tx=0).stop 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 -- 172.21.15.18:0/1866494528 shutdown_connections 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6140a3240 0x7fb6140a5700 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb628102ef0 0x7fb62810ef50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb628102570 0x7fb62810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 --2- 172.21.15.18:0/1866494528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb628100e20 0x7fb62810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 -- 172.21.15.18:0/1866494528 >> 172.21.15.18:0/1866494528 conn(0x7fb6280fc7d0 msgr2=0x7fb6280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 -- 172.21.15.18:0/1866494528 shutdown_connections 2024-09-19T09:57:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:43.505+0000 7fb6303f3640 1 -- 172.21.15.18:0/1866494528 wait complete. 2024-09-19T09:57:44.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:57:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:44.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:44 smithi018 ceph-mon[30956]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 MiB/s wr, 174 op/s 2024-09-19T09:57:44.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:44 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T09:57:44.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:44 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:57:44.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:44 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T09:57:44.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:44 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:57:44.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:44 smithi049 ceph-mon[34858]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 MiB/s wr, 174 op/s 2024-09-19T09:57:44.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:44 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T09:57:44.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:44 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:57:44.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:44 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T09:57:44.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:44 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:57:44.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:44 smithi162 ceph-mon[35174]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 MiB/s wr, 174 op/s 2024-09-19T09:57:44.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:44 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T09:57:44.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:44 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:57:44.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:44 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T09:57:44.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:44 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:57:44.895 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:57:45.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.179+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2395717716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f88074510 msgr2=0x7f5f880748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:45.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.179+0000 7f5f8d63f640 1 --2- 172.21.15.18:0/2395717716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f88074510 0x7f5f880748f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009900 tx=0x7f5f7802a480 comp rx=0 tx=0).stop 2024-09-19T09:57:45.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.179+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2395717716 shutdown_connections 2024-09-19T09:57:45.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.179+0000 7f5f8d63f640 1 --2- 172.21.15.18:0/2395717716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f8810e440 0x7f5f88110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.179+0000 7f5f8d63f640 1 --2- 172.21.15.18:0/2395717716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88074e30 0x7f5f8810df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.179+0000 7f5f8d63f640 1 --2- 172.21.15.18:0/2395717716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f88074510 0x7f5f880748f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.179+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2395717716 >> 172.21.15.18:0/2395717716 conn(0x7f5f880fd8c0 msgr2=0x7f5f880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.179+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2395717716 shutdown_connections 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.179+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2395717716 wait complete. 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.180+0000 7f5f8d63f640 1 Processor -- start 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.180+0000 7f5f8d63f640 1 -- start start 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f8d63f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88074510 0x7f5f8819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f8d63f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f88074e30 0x7f5f8819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f8d63f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f8810e440 0x7f5f8819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f8d63f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881141a0 con 0x7f5f8810e440 2024-09-19T09:57:45.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f8d63f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88114020 con 0x7f5f88074510 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f8d63f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88114320 con 0x7f5f88074e30 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f8810e440 0x7f5f8819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f8810e440 0x7f5f8819ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54354/0 (socket says 172.21.15.18:54354) 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f877fe640 1 -- 172.21.15.18:0/2904362713 learned_addr learned my addr 172.21.15.18:0/2904362713 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f867fc640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f88074e30 0x7f5f8819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88074510 0x7f5f8819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f877fe640 1 -- 172.21.15.18:0/2904362713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f88074e30 msgr2=0x7f5f8819abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f877fe640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f88074e30 0x7f5f8819abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f877fe640 1 -- 172.21.15.18:0/2904362713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88074510 msgr2=0x7f5f8819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f877fe640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88074510 0x7f5f8819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f877fe640 1 -- 172.21.15.18:0/2904362713 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8819f630 con 0x7f5f8810e440 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f867fc640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f88074e30 0x7f5f8819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:45.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.181+0000 7f5f877fe640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f8810e440 0x7f5f8819ef50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000e970 tx=0x7f5f8000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.182+0000 7f5f6ffff640 1 -- 172.21.15.18:0/2904362713 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000ccc0 con 0x7f5f8810e440 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.182+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2904362713 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f8819f920 con 0x7f5f8810e440 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.182+0000 7f5f6ffff640 1 -- 172.21.15.18:0/2904362713 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f80005500 con 0x7f5f8810e440 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.182+0000 7f5f6ffff640 1 -- 172.21.15.18:0/2904362713 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80010690 con 0x7f5f8810e440 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.182+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2904362713 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f881a7200 con 0x7f5f8810e440 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.184+0000 7f5f6ffff640 1 -- 172.21.15.18:0/2904362713 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5f800046c0 con 0x7f5f8810e440 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.184+0000 7f5f8fa18740 1 Processor -- start 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.184+0000 7f5f8fa18740 1 -- start start 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9909974a0 0x55e990997880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f6ffff640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f700a32c0 0x7f5f700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909a2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e9908fd2e0 con 0x55e990997dc0 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e9908a4ce0 con 0x55e9909a2680 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e9908f92a0 con 0x55e9909974a0 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f700a32c0 0x7f5f700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f6ffff640 1 -- 172.21.15.18:0/2904362713 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5f800cfc10 con 0x7f5f8810e440 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f867fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909a4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:58104/0 (socket says 172.21.15.18:58104) 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f877fe640 1 -- 172.21.15.18:0/782400879 learned_addr learned my addr 172.21.15.18:0/782400879 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f867fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909a2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54364/0 (socket says 172.21.15.18:54364) 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f867fc640 1 --2- 172.21.15.18:0/782400879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9909974a0 0x55e990997880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f877fe640 1 -- 172.21.15.18:0/782400879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9909974a0 msgr2=0x55e990997880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:45.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f877fe640 1 --2- 172.21.15.18:0/782400879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9909974a0 0x55e990997880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f877fe640 1 -- 172.21.15.18:0/782400879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 msgr2=0x55e9909a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f877fe640 1 --2- 172.21.15.18:0/782400879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f877fe640 1 -- 172.21.15.18:0/782400879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e990889440 con 0x55e9909a2680 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f877fe640 1 --2- 172.21.15.18:0/782400879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909a4a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5f80098bd0 tx=0x7f5f8009bd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7faf00a075ea1b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.185+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f700a32c0 0x7f5f700a5780 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5f78000c00 tx=0x7f5f78005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.186+0000 7f5f6d7fa640 1 -- 172.21.15.18:0/782400879 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800a9880 con 0x55e9909a2680 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.186+0000 7f5f6d7fa640 1 -- 172.21.15.18:0/782400879 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f800a5d30 con 0x55e9909a2680 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.186+0000 7f5f6d7fa640 1 -- 172.21.15.18:0/782400879 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800bc0d0 con 0x55e9909a2680 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.186+0000 7f5f8fa18740 1 -- 172.21.15.18:0/782400879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 msgr2=0x55e9909a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.186+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/782400879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909a4a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5f80098bd0 tx=0x7f5f8009bd40 comp rx=0 tx=0).stop 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.186+0000 7f5f8fa18740 1 -- 172.21.15.18:0/782400879 shutdown_connections 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.186+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/782400879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909a4a70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.186+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/782400879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.186+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/782400879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9909974a0 0x55e990997880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.186+0000 7f5f8fa18740 1 -- 172.21.15.18:0/782400879 >> 172.21.15.18:0/782400879 conn(0x55e990993a30 msgr2=0x55e990993e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 1 -- 172.21.15.18:0/782400879 shutdown_connections 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 1 -- 172.21.15.18:0/782400879 wait complete. 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 1 -- start start 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 1 Processor -- start 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909974a0 0x55e9909a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e990997dc0 0x55e99099f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909a2680 0x55e99099f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e9909a5250 con 0x55e9909a2680 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e9908b8050 con 0x55e9909974a0 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e9909a53d0 con 0x55e990997dc0 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f8fa18740 10 client.0 _ll_register_callbacks cb 0x55e9908f8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909a2680 0x55e99099f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909a2680 0x55e99099f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54372/0 (socket says 172.21.15.18:54372) 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f877fe640 1 -- 172.21.15.18:0/67403039 learned_addr learned my addr 172.21.15.18:0/67403039 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909974a0 0x55e9909a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.187+0000 7f5f867fc640 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e990997dc0 0x55e99099f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f877fe640 1 -- 172.21.15.18:0/67403039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e990997dc0 msgr2=0x55e99099f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f877fe640 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e990997dc0 0x55e99099f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f877fe640 1 -- 172.21.15.18:0/67403039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909974a0 msgr2=0x55e9909a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f877fe640 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909974a0 0x55e9909a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f877fe640 1 -- 172.21.15.18:0/67403039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e99066e3c0 con 0x55e9909a2680 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f877fe640 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909a2680 0x55e99099f7a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000c6a0 tx=0x7f5f80004aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0a6be7e63db61c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f6aff5640 1 -- 172.21.15.18:0/67403039 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800a9020 con 0x55e9909a2680 2024-09-19T09:57:45.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f6aff5640 1 -- 172.21.15.18:0/67403039 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5f800a0330 con 0x55e9909a2680 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f8fa18740 1 -- 172.21.15.18:0/67403039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f800a5d30 con 0x55e9909a2680 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f6aff5640 1 -- 172.21.15.18:0/67403039 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f800b5200 con 0x55e9909a2680 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f8fa18740 10 client.16908 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f8fa18740 1 -- 172.21.15.18:0/67403039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9909b0c00 con 0x55e9909a2680 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.188+0000 7f5f6aff5640 1 -- 172.21.15.18:0/67403039 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f800a5d30 con 0x55e9909a2680 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.189+0000 7f5f6aff5640 1 -- 172.21.15.18:0/67403039 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f800cdba0 con 0x55e9909a2680 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.189+0000 7f5f8fa18740 10 client.16908 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.189+0000 7f5f8fa18740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.189+0000 7f5f8fa18740 20 client.16908 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.189+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e9909b1f50 0x55e9909b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.189+0000 7f5f8fa18740 4 client.16908 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.189+0000 7f5f8fa18740 1 -- 172.21.15.18:0/67403039 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e99090a850 con 0x55e9909b1f50 2024-09-19T09:57:45.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.189+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e9909b1f50 0x55e9909b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.189+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e9909b1f50 0x55e9909b4340 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=729629d776d31c93 server_cookie=b7502dd284a2bf92 in_seq=0 out_seq=0 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.189+0000 7f5f6aff5640 10 client.16908 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f6aff5640 1 -- 172.21.15.18:0/67403039 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e99090a850 con 0x55e9909b1f50 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f6aff5640 10 client.16908 handle_command_reply: tid=0 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 client.16908 shutdown 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 -- 172.21.15.18:0/67403039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909a2680 msgr2=0x55e99099f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909a2680 0x55e99099f7a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000c6a0 tx=0x7f5f80004aa0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 -- 172.21.15.18:0/67403039 shutdown_connections 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e9909b1f50 0x55e9909b4340 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f6aff5640 0 client.16908 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:45.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909a2680 0x55e99099f7a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e990997dc0 0x55e99099f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/67403039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909974a0 0x55e9909a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 -- 172.21.15.18:0/67403039 >> 172.21.15.18:0/67403039 conn(0x55e990993a30 msgr2=0x55e990999760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 -- 172.21.15.18:0/67403039 shutdown_connections 2024-09-19T09:57:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 1 -- 172.21.15.18:0/67403039 wait complete. 2024-09-19T09:57:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.190+0000 7f5f8fa18740 20 client.16908 trim_cache size 0 max 16384 2024-09-19T09:57:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f8fa18740 1 Processor -- start 2024-09-19T09:57:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f8fa18740 1 -- start start 2024-09-19T09:57:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909974a0 0x55e9909b7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e990997dc0 0x55e9909b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e99099c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88073fd0 con 0x55e9909974a0 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881a8b20 con 0x55e9909a2680 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881a76b0 con 0x55e990997dc0 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f86ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909974a0 0x55e9909b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e99099c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f86ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909974a0 0x55e9909b7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54380/0 (socket says 172.21.15.18:54380) 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e99099c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:58132/0 (socket says 172.21.15.18:58132) 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.208+0000 7f5f86ffd640 1 -- 172.21.15.18:0/3101967483 learned_addr learned my addr 172.21.15.18:0/3101967483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f867fc640 1 --2- 172.21.15.18:0/3101967483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e990997dc0 0x55e9909b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f86ffd640 1 -- 172.21.15.18:0/3101967483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e990997dc0 msgr2=0x55e9909b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/3101967483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e990997dc0 0x55e9909b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f86ffd640 1 -- 172.21.15.18:0/3101967483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 msgr2=0x55e99099c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/3101967483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e99099c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f86ffd640 1 -- 172.21.15.18:0/3101967483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9909946c0 con 0x55e9909974a0 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f877fe640 1 --2- 172.21.15.18:0/3101967483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e99099c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/3101967483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909974a0 0x55e9909b7360 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5f78031550 tx=0x7f5f78040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1275256148335e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f6cff9640 1 -- 172.21.15.18:0/3101967483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78057070 con 0x55e9909974a0 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f6cff9640 1 -- 172.21.15.18:0/3101967483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f78005590 con 0x55e9909974a0 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.209+0000 7f5f6cff9640 1 -- 172.21.15.18:0/3101967483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78035040 con 0x55e9909974a0 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 -- 172.21.15.18:0/3101967483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909974a0 msgr2=0x55e9909b7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/3101967483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909974a0 0x55e9909b7360 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5f78031550 tx=0x7f5f78040000 comp rx=0 tx=0).stop 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 -- 172.21.15.18:0/3101967483 shutdown_connections 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/3101967483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e99099c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/3101967483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e990997dc0 0x55e9909b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/3101967483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e9909974a0 0x55e9909b7360 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 -- 172.21.15.18:0/3101967483 >> 172.21.15.18:0/3101967483 conn(0x55e990993a30 msgr2=0x55e99099e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 -- 172.21.15.18:0/3101967483 shutdown_connections 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 -- 172.21.15.18:0/3101967483 wait complete. 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 -- start start 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.210+0000 7f5f8fa18740 1 Processor -- start 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9909974a0 0x55e9909b7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f8fa18740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909b5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881a8450 con 0x55e990997dc0 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881a7d80 con 0x55e9909a2680 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f8fa18740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88071fb0 con 0x55e9909974a0 2024-09-19T09:57:45.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f8fa18740 10 client.0 _ll_register_callbacks cb 0x7f5f7c009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f867fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f867fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54390/0 (socket says 172.21.15.18:54390) 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f867fc640 1 -- 172.21.15.18:0/797132159 learned_addr learned my addr 172.21.15.18:0/797132159 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9909974a0 0x55e9909b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f877fe640 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f867fc640 1 -- 172.21.15.18:0/797132159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9909974a0 msgr2=0x55e9909b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f867fc640 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9909974a0 0x55e9909b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f867fc640 1 -- 172.21.15.18:0/797132159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 msgr2=0x55e9909b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f867fc640 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f867fc640 1 -- 172.21.15.18:0/797132159 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9909b56e0 con 0x55e990997dc0 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f877fe640 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f867fc640 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909b4be0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c005fd0 tx=0x7f5f7c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0f171d61327c10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:45.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.211+0000 7f5f6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f6aff5640 1 -- 172.21.15.18:0/797132159 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c003b80 con 0x55e990997dc0 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f6aff5640 1 -- 172.21.15.18:0/797132159 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5f7c003d20 con 0x55e990997dc0 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f8fa18740 1 -- 172.21.15.18:0/797132159 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f78005590 con 0x55e990997dc0 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f6aff5640 1 -- 172.21.15.18:0/797132159 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f7c004b20 con 0x55e990997dc0 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f8fa18740 10 client.16914 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f8fa18740 1 -- 172.21.15.18:0/797132159 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e990a1c700 con 0x55e990997dc0 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f6aff5640 1 -- 172.21.15.18:0/797132159 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f78005590 con 0x55e990997dc0 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f6aff5640 1 -- 172.21.15.18:0/797132159 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f7c005020 con 0x55e990997dc0 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f8fa18740 10 client.16914 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f8fa18740 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f8fa18740 20 client.16914 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e990a1cf00 0x55e990a1f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:45.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f8fa18740 4 client.16914 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.212+0000 7f5f8fa18740 1 -- 172.21.15.18:0/797132159 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e990904d60 con 0x55e990a1cf00 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e990a1cf00 0x55e990a1f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f86ffd640 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e990a1cf00 0x55e990a1f320 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c7a26a55d53d74 server_cookie=409ba75e53a4c40a in_seq=0 out_seq=0 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f6aff5640 10 client.16914 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f6aff5640 1 -- 172.21.15.18:0/797132159 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e990904d60 con 0x55e990a1cf00 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f6aff5640 10 client.16914 handle_command_reply: tid=0 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f8fa18740 1 client.16914 shutdown 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f8fa18740 1 -- 172.21.15.18:0/797132159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 msgr2=0x55e9909b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909b4be0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c005fd0 tx=0x7f5f7c009500 comp rx=0 tx=0).stop 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f8fa18740 1 -- 172.21.15.18:0/797132159 shutdown_connections 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e990a1cf00 0x55e990a1f320 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e9909a2680 0x55e9909b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e990997dc0 0x55e9909b4be0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f8fa18740 1 --2- 172.21.15.18:0/797132159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9909974a0 0x55e9909b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f8fa18740 1 -- 172.21.15.18:0/797132159 >> 172.21.15.18:0/797132159 conn(0x55e990993a30 msgr2=0x55e99099a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:45.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.213+0000 7f5f6aff5640 0 client.16914 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:45.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8fa18740 1 -- 172.21.15.18:0/797132159 shutdown_connections 2024-09-19T09:57:45.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8fa18740 1 -- 172.21.15.18:0/797132159 wait complete. 2024-09-19T09:57:45.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8fa18740 20 client.16914 trim_cache size 0 max 16384 2024-09-19T09:57:45.237 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:57:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T09:57:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T09:57:45.238 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:57:45.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2904362713 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f700a32c0 msgr2=0x7f5f700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:45.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f700a32c0 0x7f5f700a5780 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5f78000c00 tx=0x7f5f78005b50 comp rx=0 tx=0).stop 2024-09-19T09:57:45.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2904362713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f8810e440 msgr2=0x7f5f8819ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:45.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f8810e440 0x7f5f8819ef50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000e970 tx=0x7f5f8000ee30 comp rx=0 tx=0).stop 2024-09-19T09:57:45.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2904362713 shutdown_connections 2024-09-19T09:57:45.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5f700a32c0 0x7f5f700a5780 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f8810e440 0x7f5f8819ef50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f88074e30 0x7f5f8819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 --2- 172.21.15.18:0/2904362713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88074510 0x7f5f8819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:45.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2904362713 >> 172.21.15.18:0/2904362713 conn(0x7f5f880fd8c0 msgr2=0x7f5f880fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:45.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.214+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2904362713 shutdown_connections 2024-09-19T09:57:45.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:45.215+0000 7f5f8d63f640 1 -- 172.21.15.18:0/2904362713 wait complete. 2024-09-19T09:57:45.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:45 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T09:57:45.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:57:45.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:45 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T09:57:45.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:57:45.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:45 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T09:57:45.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:57:46.137 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:57:46.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:57:46.141 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:46.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:46 smithi018 ceph-mon[30956]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 76 MiB/s wr, 158 op/s 2024-09-19T09:57:46.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:57:46.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:57:46.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:46 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:57:46.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:46 smithi049 ceph-mon[34858]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 76 MiB/s wr, 158 op/s 2024-09-19T09:57:46.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:57:46.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:57:46.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:46 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:57:46.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:46 smithi162 ceph-mon[35174]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 76 MiB/s wr, 158 op/s 2024-09-19T09:57:46.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:57:46.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:57:46.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:46 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:57:46.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.711+0000 7f3b7939e640 1 -- 172.21.15.18:0/2211740226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b741008d0 msgr2=0x7f3b74100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:46.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.711+0000 7f3b7939e640 1 --2- 172.21.15.18:0/2211740226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b741008d0 0x7f3b74100d30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009930 tx=0x7f3b6802a420 comp rx=0 tx=0).stop 2024-09-19T09:57:46.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.711+0000 7f3b7939e640 1 -- 172.21.15.18:0/2211740226 shutdown_connections 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.711+0000 7f3b7939e640 1 --2- 172.21.15.18:0/2211740226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b74101270 0x7f3b7410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.711+0000 7f3b7939e640 1 --2- 172.21.15.18:0/2211740226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b741008d0 0x7f3b74100d30 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.711+0000 7f3b7939e640 1 --2- 172.21.15.18:0/2211740226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b741068d0 0x7f3b74106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.711+0000 7f3b7939e640 1 -- 172.21.15.18:0/2211740226 >> 172.21.15.18:0/2211740226 conn(0x7f3b740fc610 msgr2=0x7f3b740fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.711+0000 7f3b7939e640 1 -- 172.21.15.18:0/2211740226 shutdown_connections 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.711+0000 7f3b7939e640 1 -- 172.21.15.18:0/2211740226 wait complete. 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.712+0000 7f3b7939e640 1 Processor -- start 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.712+0000 7f3b7939e640 1 -- start start 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.712+0000 7f3b7939e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b741008d0 0x7f3b741982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.712+0000 7f3b7939e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b74101270 0x7f3b741987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.712+0000 7f3b7939e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b741068d0 0x7f3b7419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.712+0000 7f3b7939e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b74110c90 con 0x7f3b741068d0 2024-09-19T09:57:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.712+0000 7f3b7939e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3b74110b10 con 0x7f3b741008d0 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.712+0000 7f3b7939e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b74110e10 con 0x7f3b74101270 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b78b9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b741068d0 0x7f3b7419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b78b9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b741068d0 0x7f3b7419cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42782/0 (socket says 172.21.15.18:42782) 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b78b9d640 1 -- 172.21.15.18:0/1218127815 learned_addr learned my addr 172.21.15.18:0/1218127815 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b737fe640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b74101270 0x7f3b741987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b73fff640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b741008d0 0x7f3b741982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b78b9d640 1 -- 172.21.15.18:0/1218127815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b74101270 msgr2=0x7f3b741987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b78b9d640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b74101270 0x7f3b741987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b78b9d640 1 -- 172.21.15.18:0/1218127815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b741008d0 msgr2=0x7f3b741982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b78b9d640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b741008d0 0x7f3b741982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b78b9d640 1 -- 172.21.15.18:0/1218127815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7419d250 con 0x7f3b741068d0 2024-09-19T09:57:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b73fff640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b741008d0 0x7f3b741982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b78b9d640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b741068d0 0x7f3b7419cb70 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00eaa0 tx=0x7f3b6c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b717fa640 1 -- 172.21.15.18:0/1218127815 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00cdb0 con 0x7f3b741068d0 2024-09-19T09:57:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b7939e640 1 -- 172.21.15.18:0/1218127815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7419d540 con 0x7f3b741068d0 2024-09-19T09:57:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b717fa640 1 -- 172.21.15.18:0/1218127815 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b6c005020 con 0x7f3b741068d0 2024-09-19T09:57:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b717fa640 1 -- 172.21.15.18:0/1218127815 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0116b0 con 0x7f3b741068d0 2024-09-19T09:57:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.713+0000 7f3b7939e640 1 -- 172.21.15.18:0/1218127815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b741a4e20 con 0x7f3b741068d0 2024-09-19T09:57:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.715+0000 7f3b7939e640 1 -- 172.21.15.18:0/1218127815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b74100d30 con 0x7f3b741068d0 2024-09-19T09:57:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.716+0000 7f3b717fa640 1 -- 172.21.15.18:0/1218127815 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3b6c005560 con 0x7f3b741068d0 2024-09-19T09:57:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.717+0000 7f3b717fa640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b5c0a3240 0x7f3b5c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.717+0000 7f3b73fff640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b5c0a3240 0x7f3b5c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.717+0000 7f3b717fa640 1 -- 172.21.15.18:0/1218127815 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3b6c0cfb60 con 0x7f3b741068d0 2024-09-19T09:57:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.717+0000 7f3b73fff640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b5c0a3240 0x7f3b5c0a5700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009ba0 tx=0x7f3b64005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.721+0000 7f3b717fa640 1 -- 172.21.15.18:0/1218127815 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b6c016030 con 0x7f3b741068d0 2024-09-19T09:57:46.798 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:46.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.948+0000 7f3b7939e640 1 -- 172.21.15.18:0/1218127815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b741a5050 con 0x7f3b741068d0 2024-09-19T09:57:46.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.949+0000 7f3b717fa640 1 -- 172.21.15.18:0/1218127815 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f3b6c09c8b0 con 0x7f3b741068d0 2024-09-19T09:57:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:57:46.951 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:57:46.951 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:57:46.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.950+0000 7f3b7939e640 1 -- 172.21.15.18:0/1218127815 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b5c0a3240 msgr2=0x7f3b5c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:46.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.950+0000 7f3b7939e640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b5c0a3240 0x7f3b5c0a5700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009ba0 tx=0x7f3b64005f90 comp rx=0 tx=0).stop 2024-09-19T09:57:46.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.950+0000 7f3b7939e640 1 -- 172.21.15.18:0/1218127815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b741068d0 msgr2=0x7f3b7419cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:46.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.950+0000 7f3b7939e640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b741068d0 0x7f3b7419cb70 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00eaa0 tx=0x7f3b6c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:57:46.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.951+0000 7f3b7939e640 1 -- 172.21.15.18:0/1218127815 shutdown_connections 2024-09-19T09:57:46.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.951+0000 7f3b7939e640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3b5c0a3240 0x7f3b5c0a5700 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:46.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.951+0000 7f3b7939e640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b741068d0 0x7f3b7419cb70 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:46.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.951+0000 7f3b7939e640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b74101270 0x7f3b741987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:46.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.951+0000 7f3b7939e640 1 --2- 172.21.15.18:0/1218127815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b741008d0 0x7f3b741982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:46.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.951+0000 7f3b7939e640 1 -- 172.21.15.18:0/1218127815 >> 172.21.15.18:0/1218127815 conn(0x7f3b740fc610 msgr2=0x7f3b741046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:46.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.951+0000 7f3b7939e640 1 -- 172.21.15.18:0/1218127815 shutdown_connections 2024-09-19T09:57:46.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:46.951+0000 7f3b7939e640 1 -- 172.21.15.18:0/1218127815 wait complete. 2024-09-19T09:57:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.415+0000 7fce3f84e640 1 -- 172.21.15.18:0/2537235899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce38106f20 msgr2=0x7fce3810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.415+0000 7fce3f84e640 1 --2- 172.21.15.18:0/2537235899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce38106f20 0x7fce3810eaa0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fce30009900 tx=0x7fce3002a410 comp rx=0 tx=0).stop 2024-09-19T09:57:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.415+0000 7fce3f84e640 1 -- 172.21.15.18:0/2537235899 shutdown_connections 2024-09-19T09:57:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.415+0000 7fce3f84e640 1 --2- 172.21.15.18:0/2537235899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce38106f20 0x7fce3810eaa0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.415+0000 7fce3f84e640 1 --2- 172.21.15.18:0/2537235899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce381027a0 0x7fce381067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.415+0000 7fce3f84e640 1 --2- 172.21.15.18:0/2537235899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce38101df0 0x7fce381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.415+0000 7fce3f84e640 1 -- 172.21.15.18:0/2537235899 >> 172.21.15.18:0/2537235899 conn(0x7fce380fd8f0 msgr2=0x7fce380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.415+0000 7fce3f84e640 1 -- 172.21.15.18:0/2537235899 shutdown_connections 2024-09-19T09:57:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.415+0000 7fce3f84e640 1 -- 172.21.15.18:0/2537235899 wait complete. 2024-09-19T09:57:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.415+0000 7fce3f84e640 1 Processor -- start 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3f84e640 1 -- start start 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3f84e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce38101df0 0x7fce381983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3f84e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce381027a0 0x7fce38198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3f84e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce38106f20 0x7fce3819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3f84e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fce38111f80 con 0x7fce38101df0 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3f84e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fce38111e00 con 0x7fce381027a0 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3f84e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce38112100 con 0x7fce38106f20 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3d5ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce38101df0 0x7fce381983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3d5ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce38101df0 0x7fce381983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42800/0 (socket says 172.21.15.18:42800) 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3d5ea640 1 -- 172.21.15.18:0/2990685729 learned_addr learned my addr 172.21.15.18:0/2990685729 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3ddeb640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce38106f20 0x7fce3819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:47.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3cde9640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce381027a0 0x7fce38198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3d5ea640 1 -- 172.21.15.18:0/2990685729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce38106f20 msgr2=0x7fce3819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3d5ea640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce38106f20 0x7fce3819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3d5ea640 1 -- 172.21.15.18:0/2990685729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce381027a0 msgr2=0x7fce38198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3d5ea640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce381027a0 0x7fce38198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3d5ea640 1 -- 172.21.15.18:0/2990685729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3819d390 con 0x7fce38101df0 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3ddeb640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce38106f20 0x7fce3819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.416+0000 7fce3d5ea640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce38101df0 0x7fce381983e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fce2800eab0 tx=0x7fce2800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.417+0000 7fce367fc640 1 -- 172.21.15.18:0/2990685729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2800ce40 con 0x7fce38101df0 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.417+0000 7fce367fc640 1 -- 172.21.15.18:0/2990685729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce28011950 con 0x7fce38101df0 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.417+0000 7fce367fc640 1 -- 172.21.15.18:0/2990685729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28010ae0 con 0x7fce38101df0 2024-09-19T09:57:47.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.417+0000 7fce3f84e640 1 -- 172.21.15.18:0/2990685729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3819d680 con 0x7fce38101df0 2024-09-19T09:57:47.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.417+0000 7fce3f84e640 1 -- 172.21.15.18:0/2990685729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce381a4f60 con 0x7fce38101df0 2024-09-19T09:57:47.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.418+0000 7fce3f84e640 1 -- 172.21.15.18:0/2990685729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce381021d0 con 0x7fce38101df0 2024-09-19T09:57:47.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.419+0000 7fce367fc640 1 -- 172.21.15.18:0/2990685729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fce28011b00 con 0x7fce38101df0 2024-09-19T09:57:47.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.420+0000 7fce367fc640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fce200a3240 0x7fce200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:47.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.420+0000 7fce3cde9640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fce200a3240 0x7fce200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:47.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.420+0000 7fce367fc640 1 -- 172.21.15.18:0/2990685729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fce280d0120 con 0x7fce38101df0 2024-09-19T09:57:47.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.420+0000 7fce3cde9640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fce200a3240 0x7fce200a5700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fce2c005d80 tx=0x7fce2c005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:47.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.424+0000 7fce367fc640 1 -- 172.21.15.18:0/2990685729 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce28016030 con 0x7fce38101df0 2024-09-19T09:57:47.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:47 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1218127815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:47.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.638+0000 7fce3f84e640 1 -- 172.21.15.18:0/2990685729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce38199740 con 0x7fce38101df0 2024-09-19T09:57:47.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.639+0000 7fce367fc640 1 -- 172.21.15.18:0/2990685729 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fce2809ce10 con 0x7fce38101df0 2024-09-19T09:57:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:57:47.641 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:57:47.642 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:57:47.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.641+0000 7fce3f84e640 1 -- 172.21.15.18:0/2990685729 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fce200a3240 msgr2=0x7fce200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:47.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.641+0000 7fce3f84e640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fce200a3240 0x7fce200a5700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fce2c005d80 tx=0x7fce2c005c90 comp rx=0 tx=0).stop 2024-09-19T09:57:47.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.641+0000 7fce3f84e640 1 -- 172.21.15.18:0/2990685729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce38101df0 msgr2=0x7fce381983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:47.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.641+0000 7fce3f84e640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce38101df0 0x7fce381983e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fce2800eab0 tx=0x7fce2800ef70 comp rx=0 tx=0).stop 2024-09-19T09:57:47.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.641+0000 7fce3f84e640 1 -- 172.21.15.18:0/2990685729 shutdown_connections 2024-09-19T09:57:47.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.641+0000 7fce3f84e640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fce200a3240 0x7fce200a5700 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:47.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.641+0000 7fce3f84e640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce38106f20 0x7fce3819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:47.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.641+0000 7fce3f84e640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce381027a0 0x7fce38198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:47.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.641+0000 7fce3f84e640 1 --2- 172.21.15.18:0/2990685729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce38101df0 0x7fce381983e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:47.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.641+0000 7fce3f84e640 1 -- 172.21.15.18:0/2990685729 >> 172.21.15.18:0/2990685729 conn(0x7fce380fd8f0 msgr2=0x7fce380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:47.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.642+0000 7fce3f84e640 1 -- 172.21.15.18:0/2990685729 shutdown_connections 2024-09-19T09:57:47.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:47.642+0000 7fce3f84e640 1 -- 172.21.15.18:0/2990685729 wait complete. 2024-09-19T09:57:47.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:47 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1218127815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:47.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:47 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1218127815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:48.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:48 smithi018 ceph-mon[30956]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 73 MiB/s wr, 152 op/s 2024-09-19T09:57:48.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:48 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2990685729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:48.434 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:57:48.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:48 smithi049 ceph-mon[34858]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 73 MiB/s wr, 152 op/s 2024-09-19T09:57:48.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:48 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2990685729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:48.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:48 smithi162 ceph-mon[35174]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 73 MiB/s wr, 152 op/s 2024-09-19T09:57:48.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:48 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2990685729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:57:48.971 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --set-id df64d7a0 --release --await' 2024-09-19T09:57:48.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --set-id df64d7a0 --release --await 2024-09-19T09:57:49.078 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:49.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.606+0000 7fa39805d640 1 -- 172.21.15.18:0/1000697238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa390101de0 msgr2=0x7fa3901021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:49.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.606+0000 7fa39805d640 1 --2- 172.21.15.18:0/1000697238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa390101de0 0x7fa3901021c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009ca0 tx=0x7fa38c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.606+0000 7fa39805d640 1 -- 172.21.15.18:0/1000697238 shutdown_connections 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.606+0000 7fa39805d640 1 --2- 172.21.15.18:0/1000697238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390106f10 0x7fa39010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.606+0000 7fa39805d640 1 --2- 172.21.15.18:0/1000697238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa390102790 0x7fa3901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.606+0000 7fa39805d640 1 --2- 172.21.15.18:0/1000697238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa390101de0 0x7fa3901021c0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.606+0000 7fa39805d640 1 -- 172.21.15.18:0/1000697238 >> 172.21.15.18:0/1000697238 conn(0x7fa3900fd880 msgr2=0x7fa3900ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.606+0000 7fa39805d640 1 -- 172.21.15.18:0/1000697238 shutdown_connections 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.606+0000 7fa39805d640 1 -- 172.21.15.18:0/1000697238 wait complete. 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.607+0000 7fa39805d640 1 Processor -- start 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.607+0000 7fa39805d640 1 -- start start 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.607+0000 7fa39805d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101de0 0x7fa3900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.607+0000 7fa39805d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa390102790 0x7fa390074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.607+0000 7fa39805d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa390106f10 0x7fa390074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.607+0000 7fa39805d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa390111f70 con 0x7fa390106f10 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.607+0000 7fa39805d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa390111df0 con 0x7fa390101de0 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.607+0000 7fa39805d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901120f0 con 0x7fa390102790 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.607+0000 7fa3965fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa390106f10 0x7fa390074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.607+0000 7fa3965fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa390106f10 0x7fa390074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42808/0 (socket says 172.21.15.18:42808) 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa3965fa640 1 -- 172.21.15.18:0/821662953 learned_addr learned my addr 172.21.15.18:0/821662953 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa3955f8640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa390102790 0x7fa390074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa395df9640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101de0 0x7fa3900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa3965fa640 1 -- 172.21.15.18:0/821662953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa390102790 msgr2=0x7fa390074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa3965fa640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa390102790 0x7fa390074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa3965fa640 1 -- 172.21.15.18:0/821662953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101de0 msgr2=0x7fa3900744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa3965fa640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101de0 0x7fa3900744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa3965fa640 1 -- 172.21.15.18:0/821662953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3901a6710 con 0x7fa390106f10 2024-09-19T09:57:49.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa3965fa640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa390106f10 0x7fa390074f70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa38800e970 tx=0x7fa38800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa386ffd640 1 -- 172.21.15.18:0/821662953 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38800ccc0 con 0x7fa390106f10 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa386ffd640 1 -- 172.21.15.18:0/821662953 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa38800ce60 con 0x7fa390106f10 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa39805d640 1 -- 172.21.15.18:0/821662953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3901a6a00 con 0x7fa390106f10 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa386ffd640 1 -- 172.21.15.18:0/821662953 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388010490 con 0x7fa390106f10 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.608+0000 7fa39805d640 1 -- 172.21.15.18:0/821662953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3901a6ef0 con 0x7fa390106f10 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.611+0000 7fa386ffd640 1 -- 172.21.15.18:0/821662953 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa388005020 con 0x7fa390106f10 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.611+0000 7fa39a436740 1 Processor -- start 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.611+0000 7fa39a436740 1 -- start start 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.611+0000 7fa39a436740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 0x55e4eaef3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.611+0000 7fa39a436740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaef3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.611+0000 7fa39a436740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaf00760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.611+0000 7fa39a436740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e4eae592f0 con 0x55e4eaef35d0 2024-09-19T09:57:49.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.611+0000 7fa39a436740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e4eae00cf0 con 0x55e4eaef4b40 2024-09-19T09:57:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.611+0000 7fa39a436740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e4eae552b0 con 0x55e4eaefe370 2024-09-19T09:57:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.611+0000 7fa395df9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaef3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa386ffd640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa37c0a3240 0x7fa37c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa3955f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 0x55e4eaef3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa395df9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaef3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42810/0 (socket says 172.21.15.18:42810) 2024-09-19T09:57:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa395df9640 1 -- 172.21.15.18:0/3346810614 learned_addr learned my addr 172.21.15.18:0/3346810614 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa3955f8640 1 --2- 172.21.15.18:0/3346810614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaf00760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa3965fa640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa37c0a3240 0x7fa37c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa386ffd640 1 -- 172.21.15.18:0/821662953 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa3880cfd40 con 0x7fa390106f10 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa395df9640 1 -- 172.21.15.18:0/3346810614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 msgr2=0x55e4eaf00760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa395df9640 1 --2- 172.21.15.18:0/3346810614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaf00760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa395df9640 1 -- 172.21.15.18:0/3346810614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 msgr2=0x55e4eaef3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa395df9640 1 --2- 172.21.15.18:0/3346810614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 0x55e4eaef3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa395df9640 1 -- 172.21.15.18:0/3346810614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4eade53a0 con 0x55e4eaef35d0 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa3955f8640 1 --2- 172.21.15.18:0/3346810614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 0x55e4eaef3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa3965fa640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa37c0a3240 0x7fa37c0a5700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa388098d60 tx=0x7fa38807c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa395df9640 1 --2- 172.21.15.18:0/3346810614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaef3a10 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa38c02f530 tx=0x7fa38c009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1856a30f5ea3663 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa37bfff640 1 -- 172.21.15.18:0/3346810614 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c003b70 con 0x55e4eaef35d0 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.612+0000 7fa37bfff640 1 -- 172.21.15.18:0/3346810614 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa38c036050 con 0x55e4eaef35d0 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.613+0000 7fa37bfff640 1 -- 172.21.15.18:0/3346810614 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0042a0 con 0x55e4eaef35d0 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.613+0000 7fa39a436740 1 -- 172.21.15.18:0/3346810614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 msgr2=0x55e4eaef3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.613+0000 7fa39a436740 1 --2- 172.21.15.18:0/3346810614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaef3a10 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa38c02f530 tx=0x7fa38c009540 comp rx=0 tx=0).stop 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.613+0000 7fa39a436740 1 -- 172.21.15.18:0/3346810614 shutdown_connections 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.613+0000 7fa39a436740 1 --2- 172.21.15.18:0/3346810614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaf00760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.613+0000 7fa39a436740 1 --2- 172.21.15.18:0/3346810614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaef3a10 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.613+0000 7fa39a436740 1 --2- 172.21.15.18:0/3346810614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 0x55e4eaef3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.613+0000 7fa39a436740 1 -- 172.21.15.18:0/3346810614 >> 172.21.15.18:0/3346810614 conn(0x55e4eaebc310 msgr2=0x55e4eaeefc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.613+0000 7fa39a436740 1 -- 172.21.15.18:0/3346810614 shutdown_connections 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.613+0000 7fa39a436740 1 -- 172.21.15.18:0/3346810614 wait complete. 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa39a436740 1 -- start start 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa39a436740 1 Processor -- start 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa39a436740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef35d0 0x55e4eaefdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa39a436740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef4b40 0x55e4eaefaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa39a436740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaefb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa39a436740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e4eaf00e90 con 0x55e4eaef4b40 2024-09-19T09:57:49.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa39a436740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e4eae14060 con 0x55e4eaef35d0 2024-09-19T09:57:49.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa39a436740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e4eaf01010 con 0x55e4eaefe370 2024-09-19T09:57:49.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa39a436740 10 client.0 _ll_register_callbacks cb 0x55e4eab678c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:49.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa395df9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef4b40 0x55e4eaefaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa395df9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef4b40 0x55e4eaefaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42818/0 (socket says 172.21.15.18:42818) 2024-09-19T09:57:49.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa395df9640 1 -- 172.21.15.18:0/3730318302 learned_addr learned my addr 172.21.15.18:0/3730318302 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:49.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.614+0000 7fa3955f8640 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef35d0 0x55e4eaefdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa3955f8640 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaefb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa395df9640 1 -- 172.21.15.18:0/3730318302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 msgr2=0x55e4eaefb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa395df9640 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaefb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa395df9640 1 -- 172.21.15.18:0/3730318302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef35d0 msgr2=0x55e4eaefdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa395df9640 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef35d0 0x55e4eaefdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa395df9640 1 -- 172.21.15.18:0/3730318302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4eabca3c0 con 0x55e4eaef4b40 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa3955f8640 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaefb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa395df9640 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef4b40 0x55e4eaefaf60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009bf0 tx=0x7fa38c031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4483931122f12c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa3797fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa3797fa640 1 -- 172.21.15.18:0/3730318302 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c031dc0 con 0x55e4eaef4b40 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa3797fa640 1 -- 172.21.15.18:0/3730318302 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa38c02f610 con 0x55e4eaef4b40 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa39a436740 1 -- 172.21.15.18:0/3730318302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa38c036050 con 0x55e4eaef4b40 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa3797fa640 1 -- 172.21.15.18:0/3730318302 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa38c02f850 con 0x55e4eaef4b40 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa39a436740 10 client.16938 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:49.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.615+0000 7fa39a436740 1 -- 172.21.15.18:0/3730318302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e4eaf00e90 con 0x55e4eaef4b40 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa3797fa640 1 -- 172.21.15.18:0/3730318302 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa38c036050 con 0x55e4eaef4b40 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa3797fa640 1 -- 172.21.15.18:0/3730318302 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa38c042070 con 0x55e4eaef4b40 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa39a436740 10 client.16938 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa39a436740 10 client.16938 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa39a436740 20 client.16938 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa39a436740 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55e4eaf0dab0 0x55e4eaf0fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa39a436740 4 client.16938 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa39a436740 1 -- 172.21.15.18:0/3730318302 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4eae66860 con 0x55e4eaf0dab0 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa3955f8640 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55e4eaf0dab0 0x55e4eaf0fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa3797fa640 10 client.16938 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.616+0000 7fa3955f8640 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55e4eaf0dab0 0x55e4eaf0fef0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d007ea5b2f39b52e server_cookie=5c729528db747e47 in_seq=0 out_seq=0 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa3797fa640 1 -- 172.21.15.18:0/3730318302 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4eae66860 con 0x55e4eaf0dab0 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa3797fa640 10 client.16938 handle_command_reply: tid=0 2024-09-19T09:57:49.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 client.16938 shutdown 2024-09-19T09:57:49.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 -- 172.21.15.18:0/3730318302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef4b40 msgr2=0x55e4eaefaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:49.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef4b40 0x55e4eaefaf60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009bf0 tx=0x7fa38c031700 comp rx=0 tx=0).stop 2024-09-19T09:57:49.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 -- 172.21.15.18:0/3730318302 shutdown_connections 2024-09-19T09:57:49.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55e4eaf0dab0 0x55e4eaf0fef0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaefb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef4b40 0x55e4eaefaf60 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 --2- 172.21.15.18:0/3730318302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef35d0 0x55e4eaefdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa3797fa640 0 client.16938 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:57:49.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 -- 172.21.15.18:0/3730318302 >> 172.21.15.18:0/3730318302 conn(0x55e4eaebc310 msgr2=0x55e4eaef5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 -- 172.21.15.18:0/3730318302 shutdown_connections 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 1 -- 172.21.15.18:0/3730318302 wait complete. 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.617+0000 7fa39a436740 20 client.16938 trim_cache size 0 max 16384 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.630+0000 7fa39a436740 1 Processor -- start 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.630+0000 7fa39a436740 1 -- start start 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.630+0000 7fa39a436740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef35d0 0x55e4eaf0a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.630+0000 7fa39a436740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaef4b40 0x55e4eaefced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.630+0000 7fa39a436740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaefe370 0x55e4eaeff760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.630+0000 7fa39a436740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901af410 con 0x55e4eaefe370 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.630+0000 7fa39a436740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901b0f50 con 0x55e4eaef35d0 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.630+0000 7fa39a436740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901afae0 con 0x55e4eaef4b40 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa3955f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaefe370 0x55e4eaeff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa3955f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaefe370 0x55e4eaeff760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42832/0 (socket says 172.21.15.18:42832) 2024-09-19T09:57:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa3955f8640 1 -- 172.21.15.18:0/2493401867 learned_addr learned my addr 172.21.15.18:0/2493401867 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa395df9640 1 --2- 172.21.15.18:0/2493401867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaef4b40 0x55e4eaefced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa3955f8640 1 --2- 172.21.15.18:0/2493401867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef35d0 0x55e4eaf0a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa3955f8640 1 -- 172.21.15.18:0/2493401867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaef4b40 msgr2=0x55e4eaefced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa3955f8640 1 --2- 172.21.15.18:0/2493401867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaef4b40 0x55e4eaefced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa3955f8640 1 -- 172.21.15.18:0/2493401867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef35d0 msgr2=0x55e4eaf0a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa3955f8640 1 --2- 172.21.15.18:0/2493401867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef35d0 0x55e4eaf0a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa3955f8640 1 -- 172.21.15.18:0/2493401867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4eaeee310 con 0x55e4eaefe370 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa3955f8640 1 --2- 172.21.15.18:0/2493401867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaefe370 0x55e4eaeff760 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x55e4eaef4070 tx=0x7fa3800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f91ba335269e813 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa37b7fe640 1 -- 172.21.15.18:0/2493401867 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380024070 con 0x55e4eaefe370 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa37b7fe640 1 -- 172.21.15.18:0/2493401867 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa380005610 con 0x55e4eaefe370 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.631+0000 7fa37b7fe640 1 -- 172.21.15.18:0/2493401867 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380004ab0 con 0x55e4eaefe370 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 -- 172.21.15.18:0/2493401867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaefe370 msgr2=0x55e4eaeff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 --2- 172.21.15.18:0/2493401867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaefe370 0x55e4eaeff760 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x55e4eaef4070 tx=0x7fa3800046c0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 -- 172.21.15.18:0/2493401867 shutdown_connections 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 --2- 172.21.15.18:0/2493401867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaefe370 0x55e4eaeff760 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 --2- 172.21.15.18:0/2493401867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaef4b40 0x55e4eaefced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 --2- 172.21.15.18:0/2493401867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef35d0 0x55e4eaf0a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 -- 172.21.15.18:0/2493401867 >> 172.21.15.18:0/2493401867 conn(0x55e4eaebc310 msgr2=0x55e4eaefc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 -- 172.21.15.18:0/2493401867 shutdown_connections 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 -- 172.21.15.18:0/2493401867 wait complete. 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 -- start start 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.632+0000 7fa39a436740 1 Processor -- start 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa39a436740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaf068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa39a436740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 0x55e4eaefefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa39a436740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaeff510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa39a436740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901b0880 con 0x55e4eaef35d0 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa39a436740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901b01b0 con 0x55e4eaef4b40 2024-09-19T09:57:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa39a436740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901ad3f0 con 0x55e4eaefe370 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa39a436740 10 client.0 _ll_register_callbacks cb 0x7fa380009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa3955f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaf068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa3955f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaf068f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42844/0 (socket says 172.21.15.18:42844) 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa3955f8640 1 -- 172.21.15.18:0/3741244134 learned_addr learned my addr 172.21.15.18:0/3741244134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa395df9640 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 0x55e4eaefefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa3955f8640 1 -- 172.21.15.18:0/3741244134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 msgr2=0x55e4eaeff510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa3955f8640 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaeff510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa3955f8640 1 -- 172.21.15.18:0/3741244134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 msgr2=0x55e4eaefefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa3955f8640 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 0x55e4eaefefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa3955f8640 1 -- 172.21.15.18:0/3741244134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4eaeffb80 con 0x55e4eaef35d0 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa3955f8640 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaf068f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa380009fa0 tx=0x7fa380005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201d507248a43b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.633+0000 7fa3797fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa3797fa640 1 -- 172.21.15.18:0/3741244134 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380024070 con 0x55e4eaef35d0 2024-09-19T09:57:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa3797fa640 1 -- 172.21.15.18:0/3741244134 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa380004230 con 0x55e4eaef35d0 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa39a436740 1 -- 172.21.15.18:0/3741244134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa380005610 con 0x55e4eaef35d0 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa3797fa640 1 -- 172.21.15.18:0/3741244134 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa380004430 con 0x55e4eaef35d0 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa39a436740 10 client.16944 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa39a436740 1 -- 172.21.15.18:0/3741244134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e4eaf78790 con 0x55e4eaef35d0 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa3797fa640 1 -- 172.21.15.18:0/3741244134 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa380005610 con 0x55e4eaef35d0 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa3797fa640 1 -- 172.21.15.18:0/3741244134 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa380003a00 con 0x55e4eaef35d0 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa39a436740 10 client.16944 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa39a436740 10 client.16944 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa39a436740 20 client.16944 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa39a436740 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55e4eaf78d00 0x55e4eaf7b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa39a436740 4 client.16944 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:57:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa39a436740 1 -- 172.21.15.18:0/3741244134 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e4eae60d70 con 0x55e4eaf78d00 2024-09-19T09:57:49.758 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:57:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.634+0000 7fa395df9640 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55e4eaf78d00 0x55e4eaf7b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa395df9640 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55e4eaf78d00 0x55e4eaf7b120 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a1f6d82a21faad77 server_cookie=e0f0edf4cf6c9f0b in_seq=0 out_seq=0 2024-09-19T09:57:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa3797fa640 10 client.16944 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:57:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa3797fa640 1 -- 172.21.15.18:0/3741244134 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e4eae60d70 con 0x55e4eaf78d00 2024-09-19T09:57:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa3797fa640 10 client.16944 handle_command_reply: tid=0 2024-09-19T09:57:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 client.16944 shutdown 2024-09-19T09:57:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 -- 172.21.15.18:0/3741244134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 msgr2=0x55e4eaf068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaf068f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa380009fa0 tx=0x7fa380005970 comp rx=0 tx=0).stop 2024-09-19T09:57:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 -- 172.21.15.18:0/3741244134 shutdown_connections 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55e4eaf78d00 0x55e4eaf7b120 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e4eaefe370 0x55e4eaeff510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e4eaef4b40 0x55e4eaefefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 --2- 172.21.15.18:0/3741244134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4eaef35d0 0x55e4eaf068f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa3797fa640 0 client.16944 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 -- 172.21.15.18:0/3741244134 >> 172.21.15.18:0/3741244134 conn(0x55e4eaebc310 msgr2=0x55e4eaefcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 -- 172.21.15.18:0/3741244134 shutdown_connections 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 1 -- 172.21.15.18:0/3741244134 wait complete. 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.635+0000 7fa39a436740 20 client.16944 trim_cache size 0 max 16384 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 -- 172.21.15.18:0/821662953 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa37c0a3240 msgr2=0x7fa37c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa37c0a3240 0x7fa37c0a5700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa388098d60 tx=0x7fa38807c040 comp rx=0 tx=0).stop 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 -- 172.21.15.18:0/821662953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa390106f10 msgr2=0x7fa390074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa390106f10 0x7fa390074f70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa38800e970 tx=0x7fa38800ed70 comp rx=0 tx=0).stop 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 -- 172.21.15.18:0/821662953 shutdown_connections 2024-09-19T09:57:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa37c0a3240 0x7fa37c0a5700 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa390106f10 0x7fa390074f70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa390102790 0x7fa390074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 --2- 172.21.15.18:0/821662953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101de0 0x7fa3900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 -- 172.21.15.18:0/821662953 >> 172.21.15.18:0/821662953 conn(0x7fa3900fd880 msgr2=0x7fa3900fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 -- 172.21.15.18:0/821662953 shutdown_connections 2024-09-19T09:57:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:49.636+0000 7fa39805d640 1 -- 172.21.15.18:0/821662953 wait complete. 2024-09-19T09:57:50.012 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.144+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3605175436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c98101c40 msgr2=0x7f0c981020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.144+0000 7f0c9f5c6640 1 --2- 172.21.15.18:0/3605175436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c98101c40 0x7f0c981020c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009900 tx=0x7f0c8c02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.144+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3605175436 shutdown_connections 2024-09-19T09:57:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.144+0000 7f0c9f5c6640 1 --2- 172.21.15.18:0/3605175436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98102600 0x7f0c98108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.144+0000 7f0c9f5c6640 1 --2- 172.21.15.18:0/3605175436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c98101c40 0x7f0c981020c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.144+0000 7f0c9f5c6640 1 --2- 172.21.15.18:0/3605175436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c98100a50 0x7f0c98100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.144+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3605175436 >> 172.21.15.18:0/3605175436 conn(0x7f0c980fc1b0 msgr2=0x7f0c980fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.144+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3605175436 shutdown_connections 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.144+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3605175436 wait complete. 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9f5c6640 1 Processor -- start 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9f5c6640 1 -- start start 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9f5c6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c98100a50 0x7f0c98199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9f5c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c98101c40 0x7f0c9819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9f5c6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98102600 0x7f0c981a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9f5c6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9810b650 con 0x7f0c98100a50 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9f5c6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9810b4d0 con 0x7f0c98102600 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9f5c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9810b7d0 con 0x7f0c98101c40 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9d362640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c98100a50 0x7f0c98199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9d362640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c98100a50 0x7f0c98199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42864/0 (socket says 172.21.15.18:42864) 2024-09-19T09:57:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9d362640 1 -- 172.21.15.18:0/3482323891 learned_addr learned my addr 172.21.15.18:0/3482323891 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.145+0000 7f0c9db63640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98102600 0x7f0c981a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c9db63640 1 -- 172.21.15.18:0/3482323891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c98101c40 msgr2=0x7f0c9819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c9db63640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c98101c40 0x7f0c9819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c9db63640 1 -- 172.21.15.18:0/3482323891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c98100a50 msgr2=0x7f0c98199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c9db63640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c98100a50 0x7f0c98199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c9db63640 1 -- 172.21.15.18:0/3482323891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c981a1b90 con 0x7f0c98102600 2024-09-19T09:57:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c9d362640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c98100a50 0x7f0c98199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c9db63640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98102600 0x7f0c981a1520 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000e970 tx=0x7f0c9000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c967fc640 1 -- 172.21.15.18:0/3482323891 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000ccc0 con 0x7f0c98102600 2024-09-19T09:57:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c967fc640 1 -- 172.21.15.18:0/3482323891 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c90005020 con 0x7f0c98102600 2024-09-19T09:57:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3482323891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c981a1e80 con 0x7f0c98102600 2024-09-19T09:57:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.146+0000 7f0c967fc640 1 -- 172.21.15.18:0/3482323891 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90004a00 con 0x7f0c98102600 2024-09-19T09:57:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.147+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3482323891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c981a23a0 con 0x7f0c98102600 2024-09-19T09:57:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.150+0000 7f0c967fc640 1 -- 172.21.15.18:0/3482323891 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0c900051d0 con 0x7f0c98102600 2024-09-19T09:57:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.150+0000 7f0ca2436740 1 Processor -- start 2024-09-19T09:57:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0ca2436740 1 -- start start 2024-09-19T09:57:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c15412f9a0 0x55c15412fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 0x55c154134da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c154135370 0x55c154137830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0ca2436740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c1540932f0 con 0x55c15412f9a0 2024-09-19T09:57:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0ca2436740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c15403b270 con 0x55c154135370 2024-09-19T09:57:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0ca2436740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c15408f2b0 con 0x55c1541302e0 2024-09-19T09:57:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0c9cb61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c15412f9a0 0x55c15412fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0c9cb61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c15412f9a0 0x55c15412fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42872/0 (socket says 172.21.15.18:42872) 2024-09-19T09:57:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0c9cb61640 1 -- 172.21.15.18:0/3128742759 learned_addr learned my addr 172.21.15.18:0/3128742759 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:50.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.151+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/3128742759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c154135370 0x55c154137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.152+0000 7f0c967fc640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0c800a3370 0x7f0c800a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.152+0000 7f0c9db63640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0c800a3370 0x7f0c800a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.152+0000 7f0c9cb61640 1 -- 172.21.15.18:0/3128742759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 msgr2=0x55c154134da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.152+0000 7f0c967fc640 1 -- 172.21.15.18:0/3482323891 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0c900cf8d0 con 0x7f0c98102600 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.152+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/3128742759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 0x55c154134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.152+0000 7f0c9cb61640 1 -- 172.21.15.18:0/3128742759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c154135370 msgr2=0x55c154137830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.152+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/3128742759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c154135370 0x55c154137830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.152+0000 7f0c9cb61640 1 -- 172.21.15.18:0/3128742759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c15403a340 con 0x55c15412f9a0 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.152+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/3128742759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c15412f9a0 0x55c15412fda0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0057c0 tx=0x7f0c8c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9694ec213be3cc30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.152+0000 7f0c9db63640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0c800a3370 0x7f0c800a5830 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0c9009be50 tx=0x7f0c90005750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.153+0000 7f0c7f7fe640 1 -- 172.21.15.18:0/3128742759 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c044070 con 0x55c15412f9a0 2024-09-19T09:57:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.153+0000 7f0c7f7fe640 1 -- 172.21.15.18:0/3128742759 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c8c031d90 con 0x55c15412f9a0 2024-09-19T09:57:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.153+0000 7f0c7f7fe640 1 -- 172.21.15.18:0/3128742759 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c035070 con 0x55c15412f9a0 2024-09-19T09:57:50.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.153+0000 7f0ca2436740 1 -- 172.21.15.18:0/3128742759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c15412f9a0 msgr2=0x55c15412fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:50.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.153+0000 7f0ca2436740 1 --2- 172.21.15.18:0/3128742759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c15412f9a0 0x55c15412fda0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0057c0 tx=0x7f0c8c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.154+0000 7f0ca2436740 1 -- 172.21.15.18:0/3128742759 shutdown_connections 2024-09-19T09:57:50.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.154+0000 7f0ca2436740 1 --2- 172.21.15.18:0/3128742759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c154135370 0x55c154137830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.154+0000 7f0ca2436740 1 --2- 172.21.15.18:0/3128742759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 0x55c154134da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.154+0000 7f0ca2436740 1 --2- 172.21.15.18:0/3128742759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c15412f9a0 0x55c15412fda0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.154+0000 7f0ca2436740 1 -- 172.21.15.18:0/3128742759 >> 172.21.15.18:0/3128742759 conn(0x55c15412b010 msgr2=0x55c15412b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.154+0000 7f0ca2436740 1 -- 172.21.15.18:0/3128742759 shutdown_connections 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.154+0000 7f0ca2436740 1 -- 172.21.15.18:0/3128742759 wait complete. 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.154+0000 7f0ca2436740 1 -- start start 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.154+0000 7f0ca2436740 1 Processor -- start 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 0x55c154139c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 0x55c15413a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c1541411f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0ca2436740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c154138380 con 0x55c154135370 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0ca2436740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c15401c290 con 0x55c1541302e0 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0ca2436740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c154138500 con 0x55c15412f9a0 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0ca2436740 10 client.0 _ll_register_callbacks cb 0x55c15404d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0c9cb61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c1541411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0c9cb61640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 0x55c154139c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0c9cb61640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 0x55c154139c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:43734/0 (socket says 172.21.15.18:43734) 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0c9cb61640 1 -- 172.21.15.18:0/2604374175 learned_addr learned my addr 172.21.15.18:0/2604374175 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0c9d362640 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 0x55c15413a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0c9d362640 1 -- 172.21.15.18:0/2604374175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 msgr2=0x55c154139c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0c9d362640 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 0x55c154139c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0c9d362640 1 -- 172.21.15.18:0/2604374175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 msgr2=0x55c1541411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.155+0000 7f0c9d362640 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c1541411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.156+0000 7f0c9d362640 1 -- 172.21.15.18:0/2604374175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c153da6210 con 0x55c1541302e0 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.156+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c1541411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.156+0000 7f0c9d362640 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 0x55c15413a1b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55c15412be90 tx=0x7f0c88011e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c7b0a0af1b6501c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.156+0000 7f0c7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.156+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2604374175 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800fe00 con 0x55c1541302e0 2024-09-19T09:57:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.156+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2604374175 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0c88004b20 con 0x55c1541302e0 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.156+0000 7f0ca2436740 1 -- 172.21.15.18:0/2604374175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c8c031d90 con 0x55c1541302e0 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.157+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2604374175 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0c88004d20 con 0x55c1541302e0 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.157+0000 7f0ca2436740 10 client.26378 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.157+0000 7f0ca2436740 1 -- 172.21.15.18:0/2604374175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c153e72620 con 0x55c1541302e0 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.157+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2604374175 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c8c031d90 con 0x55c1541302e0 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.157+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2604374175 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0c8800f040 con 0x55c1541302e0 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.157+0000 7f0ca2436740 10 client.26378 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.157+0000 7f0ca2436740 10 client.26378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.157+0000 7f0ca2436740 20 client.26378 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.157+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c154145e50 0x55c154148270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.158+0000 7f0ca2436740 4 client.26378 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.158+0000 7f0ca2436740 1 -- 172.21.15.18:0/2604374175 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1540a0a20 con 0x55c154145e50 2024-09-19T09:57:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.158+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c154145e50 0x55c154148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.158+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c154145e50 0x55c154148270 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae8fc575879cf4b6 server_cookie=2ed6d3aef86c70ee in_seq=0 out_seq=0 2024-09-19T09:57:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.158+0000 7f0c7cff9640 10 client.26378 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2604374175 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1540a0a20 con 0x55c154145e50 2024-09-19T09:57:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0c7cff9640 10 client.26378 handle_command_reply: tid=0 2024-09-19T09:57:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 client.26378 shutdown 2024-09-19T09:57:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 -- 172.21.15.18:0/2604374175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 msgr2=0x55c15413a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 0x55c15413a1b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55c15412be90 tx=0x7f0c88011e90 comp rx=0 tx=0).stop 2024-09-19T09:57:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 -- 172.21.15.18:0/2604374175 shutdown_connections 2024-09-19T09:57:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c154145e50 0x55c154148270 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c1541411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0c7cff9640 0 client.26378 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 0x55c15413a1b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2604374175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 0x55c154139c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 -- 172.21.15.18:0/2604374175 >> 172.21.15.18:0/2604374175 conn(0x55c15412b010 msgr2=0x55c15412c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 -- 172.21.15.18:0/2604374175 shutdown_connections 2024-09-19T09:57:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 1 -- 172.21.15.18:0/2604374175 wait complete. 2024-09-19T09:57:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.159+0000 7f0ca2436740 20 client.26378 trim_cache size 0 max 16384 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.175+0000 7f0ca2436740 1 Processor -- start 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.175+0000 7f0ca2436740 1 -- start start 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 0x55c15412bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 0x55c1541411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c15412c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0ca2436740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981ab040 con 0x55c154135370 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0ca2436740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981acb80 con 0x55c1541302e0 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0ca2436740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981ab710 con 0x55c15412f9a0 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9cb61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c15412c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9cb61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c15412c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42882/0 (socket says 172.21.15.18:42882) 2024-09-19T09:57:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9cb61640 1 -- 172.21.15.18:0/179673337 learned_addr learned my addr 172.21.15.18:0/179673337 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9d362640 1 --2- 172.21.15.18:0/179673337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 0x55c1541411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/179673337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 0x55c15412bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9cb61640 1 -- 172.21.15.18:0/179673337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 msgr2=0x55c15412bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/179673337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 0x55c15412bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9cb61640 1 -- 172.21.15.18:0/179673337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 msgr2=0x55c1541411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/179673337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 0x55c1541411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9cb61640 1 -- 172.21.15.18:0/179673337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1541262d0 con 0x55c154135370 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.176+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/179673337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c15412c400 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009a20 tx=0x7f0c8c04c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecabb59847c58fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0c7effd640 1 -- 172.21.15.18:0/179673337 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c035040 con 0x55c154135370 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0c7effd640 1 -- 172.21.15.18:0/179673337 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c8c003f10 con 0x55c154135370 2024-09-19T09:57:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0c7effd640 1 -- 172.21.15.18:0/179673337 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c041040 con 0x55c154135370 2024-09-19T09:57:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0ca2436740 1 -- 172.21.15.18:0/179673337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 msgr2=0x55c15412c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0ca2436740 1 --2- 172.21.15.18:0/179673337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c15412c400 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009a20 tx=0x7f0c8c04c040 comp rx=0 tx=0).stop 2024-09-19T09:57:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0ca2436740 1 -- 172.21.15.18:0/179673337 shutdown_connections 2024-09-19T09:57:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0ca2436740 1 --2- 172.21.15.18:0/179673337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c15412c400 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0ca2436740 1 --2- 172.21.15.18:0/179673337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c1541302e0 0x55c1541411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0ca2436740 1 --2- 172.21.15.18:0/179673337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c15412f9a0 0x55c15412bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0ca2436740 1 -- 172.21.15.18:0/179673337 >> 172.21.15.18:0/179673337 conn(0x55c15412b010 msgr2=0x55c154139c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0ca2436740 1 -- 172.21.15.18:0/179673337 shutdown_connections 2024-09-19T09:57:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.177+0000 7f0ca2436740 1 -- 172.21.15.18:0/179673337 wait complete. 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0ca2436740 1 -- start start 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0ca2436740 1 Processor -- start 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c15412f9a0 0x55c15413e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 0x55c15413ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0ca2436740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c15413fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0ca2436740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981ac4b0 con 0x55c154135370 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0ca2436740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981abde0 con 0x55c15412f9a0 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0ca2436740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981a9020 con 0x55c1541302e0 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0ca2436740 10 client.0 _ll_register_callbacks cb 0x7f0c88009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0c9cb61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c15413fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0c9d362640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 0x55c15413ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0c9cb61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c15412f9a0 0x55c15413e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0c9cb61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c15412f9a0 0x55c15413e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50328/0 (socket says 172.21.15.18:50328) 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0c9cb61640 1 -- 172.21.15.18:0/2014632722 learned_addr learned my addr 172.21.15.18:0/2014632722 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.178+0000 7f0c9d362640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 0x55c15413ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:43746/0 (socket says 172.21.15.18:43746) 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c9cb61640 1 -- 172.21.15.18:0/2014632722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 msgr2=0x55c15413ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 0x55c15413ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c9cb61640 1 -- 172.21.15.18:0/2014632722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 msgr2=0x55c15413fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c15413fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c9cb61640 1 -- 172.21.15.18:0/2014632722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c154140320 con 0x55c15412f9a0 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c9d362640 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 0x55c15413ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c9cb61640 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c15412f9a0 0x55c15413e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009900 tx=0x7f0c8c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=678c793250a150e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2014632722 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c05d040 con 0x55c15412f9a0 2024-09-19T09:57:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2014632722 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0c8c0316b0 con 0x55c15412f9a0 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0ca2436740 1 -- 172.21.15.18:0/2014632722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c8c003f10 con 0x55c15412f9a0 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2014632722 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0c8c041040 con 0x55c15412f9a0 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0ca2436740 10 client.26384 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.179+0000 7f0ca2436740 1 -- 172.21.15.18:0/2014632722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1541b0b50 con 0x55c15412f9a0 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2014632722 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c8c003f10 con 0x55c15412f9a0 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2014632722 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0c8c063040 con 0x55c15412f9a0 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0ca2436740 10 client.26384 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0ca2436740 10 client.26384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0ca2436740 20 client.26384 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c1541b0e70 0x55c1541b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0ca2436740 4 client.26384 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:57:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0ca2436740 1 -- 172.21.15.18:0/2014632722 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c15409ad70 con 0x55c1541b0e70 2024-09-19T09:57:50.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0c9d362640 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c1541b0e70 0x55c1541b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:50.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0c7cff9640 10 client.26384 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:50.188 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.180+0000 7f0c9d362640 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c1541b0e70 0x55c1541b3290 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d36bc64ec3a52931 server_cookie=b80ea133b0baff05 in_seq=0 out_seq=0 2024-09-19T09:57:50.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0c7cff9640 1 -- 172.21.15.18:0/2014632722 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c15409ad70 con 0x55c1541b0e70 2024-09-19T09:57:50.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0c7cff9640 10 client.26384 handle_command_reply: tid=0 2024-09-19T09:57:50.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 client.26384 shutdown 2024-09-19T09:57:50.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 -- 172.21.15.18:0/2014632722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c15412f9a0 msgr2=0x55c15413e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:50.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c15412f9a0 0x55c15413e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009900 tx=0x7f0c8c005fd0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 -- 172.21.15.18:0/2014632722 shutdown_connections 2024-09-19T09:57:50.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c1541b0e70 0x55c1541b3290 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c154135370 0x55c15413fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c1541302e0 0x55c15413ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 --2- 172.21.15.18:0/2014632722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c15412f9a0 0x55c15413e7c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0c7cff9640 0 client.26384 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:50.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 -- 172.21.15.18:0/2014632722 >> 172.21.15.18:0/2014632722 conn(0x55c15412b010 msgr2=0x55c1541299a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:50.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 -- 172.21.15.18:0/2014632722 shutdown_connections 2024-09-19T09:57:50.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 1 -- 172.21.15.18:0/2014632722 wait complete. 2024-09-19T09:57:50.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0ca2436740 20 client.26384 trim_cache size 0 max 16384 2024-09-19T09:57:50.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:57:50.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:57:50.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:57:50.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:57:50.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3482323891 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0c800a3370 msgr2=0x7f0c800a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:50.191 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0c9f5c6640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0c800a3370 0x7f0c800a5830 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0c9009be50 tx=0x7f0c90005750 comp rx=0 tx=0).stop 2024-09-19T09:57:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3482323891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98102600 msgr2=0x7f0c981a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0c9f5c6640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98102600 0x7f0c981a1520 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000e970 tx=0x7f0c9000ee30 comp rx=0 tx=0).stop 2024-09-19T09:57:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.185+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3482323891 shutdown_connections 2024-09-19T09:57:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.186+0000 7f0c9f5c6640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0c800a3370 0x7f0c800a5830 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.186+0000 7f0c9f5c6640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c98102600 0x7f0c981a1520 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.186+0000 7f0c9f5c6640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c98101c40 0x7f0c9819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.186+0000 7f0c9f5c6640 1 --2- 172.21.15.18:0/3482323891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c98100a50 0x7f0c98199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.186+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3482323891 >> 172.21.15.18:0/3482323891 conn(0x7f0c980fc1b0 msgr2=0x7f0c98104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.186+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3482323891 shutdown_connections 2024-09-19T09:57:50.192 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:57:50.186+0000 7f0c9f5c6640 1 -- 172.21.15.18:0/3482323891 wait complete. 2024-09-19T09:57:50.572 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:50 smithi018 ceph-mon[30956]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 64 MiB/s wr, 137 op/s 2024-09-19T09:57:50.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:57:50.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:50 smithi049 ceph-mon[34858]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 64 MiB/s wr, 137 op/s 2024-09-19T09:57:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:50 smithi162 ceph-mon[35174]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 64 MiB/s wr, 137 op/s 2024-09-19T09:57:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.069+0000 7f379eabd640 1 -- 172.21.15.18:0/2088989679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3798102d30 msgr2=0x7f3798103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.069+0000 7f379eabd640 1 --2- 172.21.15.18:0/2088989679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3798102d30 0x7f3798103110 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f378c009930 tx=0x7f378c02a420 comp rx=0 tx=0).stop 2024-09-19T09:57:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.069+0000 7f379eabd640 1 -- 172.21.15.18:0/2088989679 shutdown_connections 2024-09-19T09:57:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.069+0000 7f379eabd640 1 --2- 172.21.15.18:0/2088989679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37981082a0 0x7f379810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.069+0000 7f379eabd640 1 --2- 172.21.15.18:0/2088989679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37981036e0 0x7f3798107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.069+0000 7f379eabd640 1 --2- 172.21.15.18:0/2088989679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3798102d30 0x7f3798103110 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.069+0000 7f379eabd640 1 -- 172.21.15.18:0/2088989679 >> 172.21.15.18:0/2088989679 conn(0x7f37980fc7d0 msgr2=0x7f37980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:51.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.069+0000 7f379eabd640 1 -- 172.21.15.18:0/2088989679 shutdown_connections 2024-09-19T09:57:51.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.069+0000 7f379eabd640 1 -- 172.21.15.18:0/2088989679 wait complete. 2024-09-19T09:57:51.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379eabd640 1 Processor -- start 2024-09-19T09:57:51.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379eabd640 1 -- start start 2024-09-19T09:57:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379eabd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798102d30 0x7f3798198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379eabd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37981036e0 0x7f3798198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379eabd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37981082a0 0x7f379819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379eabd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37981120a0 con 0x7f37981036e0 2024-09-19T09:57:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379eabd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3798111f20 con 0x7f3798102d30 2024-09-19T09:57:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379eabd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3798112220 con 0x7f37981082a0 2024-09-19T09:57:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f3797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37981036e0 0x7f3798198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379c859640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798102d30 0x7f3798198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379c859640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798102d30 0x7f3798198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50346/0 (socket says 172.21.15.18:50346) 2024-09-19T09:57:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f3797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37981036e0 0x7f3798198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42908/0 (socket says 172.21.15.18:42908) 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.070+0000 7f379c859640 1 -- 172.21.15.18:0/2520408759 learned_addr learned my addr 172.21.15.18:0/2520408759 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.071+0000 7f379d05a640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37981082a0 0x7f379819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.071+0000 7f379c859640 1 -- 172.21.15.18:0/2520408759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37981082a0 msgr2=0x7f379819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.071+0000 7f379c859640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37981082a0 0x7f379819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.071+0000 7f379c859640 1 -- 172.21.15.18:0/2520408759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37981036e0 msgr2=0x7f3798198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.071+0000 7f379c859640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37981036e0 0x7f3798198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.071+0000 7f379c859640 1 -- 172.21.15.18:0/2520408759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379819d4e0 con 0x7f3798102d30 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.071+0000 7f3797fff640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37981036e0 0x7f3798198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.071+0000 7f379c859640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798102d30 0x7f3798198530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f378c009230 tx=0x7f378c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.071+0000 7f3795ffb640 1 -- 172.21.15.18:0/2520408759 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c03f030 con 0x7f3798102d30 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.071+0000 7f379eabd640 1 -- 172.21.15.18:0/2520408759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379819d770 con 0x7f3798102d30 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.072+0000 7f3795ffb640 1 -- 172.21.15.18:0/2520408759 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f378c003ad0 con 0x7f3798102d30 2024-09-19T09:57:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.072+0000 7f3795ffb640 1 -- 172.21.15.18:0/2520408759 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c035070 con 0x7f3798102d30 2024-09-19T09:57:51.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.072+0000 7f379eabd640 1 -- 172.21.15.18:0/2520408759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37981008c0 con 0x7f3798102d30 2024-09-19T09:57:51.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.074+0000 7f37a0e96740 1 Processor -- start 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.074+0000 7f37a0e96740 1 -- start start 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.074+0000 7f3795ffb640 1 -- 172.21.15.18:0/2520408759 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f378c042030 con 0x7f3798102d30 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc9567440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc9571d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc9574630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f37a0e96740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fbc94cc620 con 0x55fbc9567060 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f37a0e96740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fbc9473e50 con 0x55fbc9567980 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f37a0e96740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fbc94c85e0 con 0x55fbc9572240 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f379d05a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc9567440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f379d05a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc9567440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42918/0 (socket says 172.21.15.18:42918) 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f379d05a640 1 -- 172.21.15.18:0/629589640 learned_addr learned my addr 172.21.15.18:0/629589640 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:51.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f379c859640 1 --2- 172.21.15.18:0/629589640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc9571d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.075+0000 7f3797fff640 1 --2- 172.21.15.18:0/629589640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc9574630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f379d05a640 1 -- 172.21.15.18:0/629589640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 msgr2=0x55fbc9574630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f379d05a640 1 --2- 172.21.15.18:0/629589640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc9574630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f379d05a640 1 -- 172.21.15.18:0/629589640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 msgr2=0x55fbc9571d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f379d05a640 1 --2- 172.21.15.18:0/629589640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc9571d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f379d05a640 1 -- 172.21.15.18:0/629589640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc9464d40 con 0x55fbc9567060 2024-09-19T09:57:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f3795ffb640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f37880a32c0 0x7f37880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f379d05a640 1 --2- 172.21.15.18:0/629589640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc9567440 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3790009f40 tx=0x7f3790010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef32c4af9f5670b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f379c859640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f37880a32c0 0x7f37880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f3795ffb640 1 -- 172.21.15.18:0/2520408759 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f378c0eff10 con 0x7f3798102d30 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f3782ffd640 1 -- 172.21.15.18:0/629589640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790003b70 con 0x55fbc9567060 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.076+0000 7f3782ffd640 1 -- 172.21.15.18:0/629589640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3790003d10 con 0x55fbc9567060 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f3782ffd640 1 -- 172.21.15.18:0/629589640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790011af0 con 0x55fbc9567060 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f37a0e96740 1 -- 172.21.15.18:0/629589640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 msgr2=0x55fbc9567440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f37a0e96740 1 --2- 172.21.15.18:0/629589640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc9567440 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3790009f40 tx=0x7f3790010860 comp rx=0 tx=0).stop 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f379c859640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f37880a32c0 0x7f37880a5780 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f378c009a50 tx=0x7f378c02a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f37a0e96740 1 -- 172.21.15.18:0/629589640 shutdown_connections 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f37a0e96740 1 --2- 172.21.15.18:0/629589640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc9574630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f37a0e96740 1 --2- 172.21.15.18:0/629589640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc9571d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f37a0e96740 1 --2- 172.21.15.18:0/629589640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc9567440 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f37a0e96740 1 -- 172.21.15.18:0/629589640 >> 172.21.15.18:0/629589640 conn(0x55fbc95635f0 msgr2=0x55fbc95639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f37a0e96740 1 -- 172.21.15.18:0/629589640 shutdown_connections 2024-09-19T09:57:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.077+0000 7f37a0e96740 1 -- 172.21.15.18:0/629589640 wait complete. 2024-09-19T09:57:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.078+0000 7f37a0e96740 1 -- start start 2024-09-19T09:57:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.078+0000 7f37a0e96740 1 Processor -- start 2024-09-19T09:57:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.078+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567060 0x55fbc956f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.078+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567980 0x55fbc956f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.078+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc956fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.078+0000 7f37a0e96740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fbc9574eb0 con 0x55fbc9567980 2024-09-19T09:57:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.078+0000 7f37a0e96740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fbc9454f10 con 0x55fbc9567060 2024-09-19T09:57:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.078+0000 7f37a0e96740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fbc9575030 con 0x55fbc9572240 2024-09-19T09:57:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.078+0000 7f37a0e96740 10 client.0 _ll_register_callbacks cb 0x55fbc9478db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f3797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567980 0x55fbc956f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f3797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567980 0x55fbc956f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42924/0 (socket says 172.21.15.18:42924) 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f3797fff640 1 -- 172.21.15.18:0/4257186789 learned_addr learned my addr 172.21.15.18:0/4257186789 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f379d05a640 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc956fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f379d05a640 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567060 0x55fbc956f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f3797fff640 1 -- 172.21.15.18:0/4257186789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 msgr2=0x55fbc956fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f3797fff640 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc956fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f3797fff640 1 -- 172.21.15.18:0/4257186789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567060 msgr2=0x55fbc956f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f3797fff640 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567060 0x55fbc956f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f3797fff640 1 -- 172.21.15.18:0/4257186789 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc91db580 con 0x55fbc9567980 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f3797fff640 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567980 0x55fbc956f690 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3784016d40 tx=0x7f3784007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2833a7598d91d8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.079+0000 7f3777fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f3777fff640 1 -- 172.21.15.18:0/4257186789 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378401e030 con 0x55fbc9567980 2024-09-19T09:57:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f3777fff640 1 -- 172.21.15.18:0/4257186789 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3784007db0 con 0x55fbc9567980 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f37a0e96740 1 -- 172.21.15.18:0/4257186789 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3790003d10 con 0x55fbc9567980 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f3777fff640 1 -- 172.21.15.18:0/4257186789 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f378400e0d0 con 0x55fbc9567980 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f37a0e96740 10 client.16974 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f37a0e96740 1 -- 172.21.15.18:0/4257186789 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fbc92a5960 con 0x55fbc9567980 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f3777fff640 1 -- 172.21.15.18:0/4257186789 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3790003d10 con 0x55fbc9567980 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f3777fff640 1 -- 172.21.15.18:0/4257186789 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3784004b40 con 0x55fbc9567980 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f37a0e96740 10 client.16974 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f37a0e96740 10 client.16974 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f37a0e96740 20 client.16974 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f37a0e96740 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fbc9581f10 0x55fbc9584370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f37a0e96740 4 client.16974 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.080+0000 7f37a0e96740 1 -- 172.21.15.18:0/4257186789 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbc94d9b90 con 0x55fbc9581f10 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.081+0000 7f379d05a640 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fbc9581f10 0x55fbc9584370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.081+0000 7f3777fff640 10 client.16974 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:51.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.081+0000 7f379d05a640 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fbc9581f10 0x55fbc9584370 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1339eca7b2d8744a server_cookie=8a74298b76d8be63 in_seq=0 out_seq=0 2024-09-19T09:57:51.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f3777fff640 1 -- 172.21.15.18:0/4257186789 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbc94d9b90 con 0x55fbc9581f10 2024-09-19T09:57:51.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f3777fff640 10 client.16974 handle_command_reply: tid=0 2024-09-19T09:57:51.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 client.16974 shutdown 2024-09-19T09:57:51.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 -- 172.21.15.18:0/4257186789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567980 msgr2=0x55fbc956f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:51.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567980 0x55fbc956f690 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3784016d40 tx=0x7f3784007590 comp rx=0 tx=0).stop 2024-09-19T09:57:51.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 -- 172.21.15.18:0/4257186789 shutdown_connections 2024-09-19T09:57:51.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fbc9581f10 0x55fbc9584370 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc956fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567980 0x55fbc956f690 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 --2- 172.21.15.18:0/4257186789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567060 0x55fbc956f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 -- 172.21.15.18:0/4257186789 >> 172.21.15.18:0/4257186789 conn(0x55fbc95635f0 msgr2=0x55fbc9569320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:51.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f3777fff640 0 client.16974 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:51.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 -- 172.21.15.18:0/4257186789 shutdown_connections 2024-09-19T09:57:51.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 1 -- 172.21.15.18:0/4257186789 wait complete. 2024-09-19T09:57:51.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.082+0000 7f37a0e96740 20 client.16974 trim_cache size 0 max 16384 2024-09-19T09:57:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f37a0e96740 1 Processor -- start 2024-09-19T09:57:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f37a0e96740 1 -- start start 2024-09-19T09:57:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9567060 0x55fbc9569ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc9562640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9572240 0x55fbc9589c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f37a0e96740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37981ab260 con 0x55fbc9572240 2024-09-19T09:57:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f37a0e96740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f37981acda0 con 0x55fbc9567980 2024-09-19T09:57:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f37a0e96740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37981ab930 con 0x55fbc9567060 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f379d05a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9572240 0x55fbc9589c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f379d05a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9572240 0x55fbc9589c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42936/0 (socket says 172.21.15.18:42936) 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.101+0000 7f379d05a640 1 -- 172.21.15.18:0/2844047143 learned_addr learned my addr 172.21.15.18:0/2844047143 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f3797fff640 1 --2- 172.21.15.18:0/2844047143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc9562640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f379d05a640 1 --2- 172.21.15.18:0/2844047143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9567060 0x55fbc9569ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f379d05a640 1 -- 172.21.15.18:0/2844047143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9567060 msgr2=0x55fbc9569ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f379d05a640 1 --2- 172.21.15.18:0/2844047143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9567060 0x55fbc9569ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f379d05a640 1 -- 172.21.15.18:0/2844047143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 msgr2=0x55fbc9562640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f379d05a640 1 --2- 172.21.15.18:0/2844047143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc9562640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f379d05a640 1 -- 172.21.15.18:0/2844047143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc95646a0 con 0x55fbc9572240 2024-09-19T09:57:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f3797fff640 1 --2- 172.21.15.18:0/2844047143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc9562640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f379d05a640 1 --2- 172.21.15.18:0/2844047143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9572240 0x55fbc9589c40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3790009aa0 tx=0x7f3790009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b233a093ee1aead server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f37827fc640 1 -- 172.21.15.18:0/2844047143 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790024040 con 0x55fbc9572240 2024-09-19T09:57:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f37827fc640 1 -- 172.21.15.18:0/2844047143 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3790012d50 con 0x55fbc9572240 2024-09-19T09:57:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.102+0000 7f37827fc640 1 -- 172.21.15.18:0/2844047143 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790005840 con 0x55fbc9572240 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.103+0000 7f37a0e96740 1 -- 172.21.15.18:0/2844047143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9572240 msgr2=0x55fbc9589c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.103+0000 7f37a0e96740 1 --2- 172.21.15.18:0/2844047143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9572240 0x55fbc9589c40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3790009aa0 tx=0x7f3790009500 comp rx=0 tx=0).stop 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.103+0000 7f37a0e96740 1 -- 172.21.15.18:0/2844047143 shutdown_connections 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.103+0000 7f37a0e96740 1 --2- 172.21.15.18:0/2844047143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9572240 0x55fbc9589c40 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.103+0000 7f37a0e96740 1 --2- 172.21.15.18:0/2844047143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc9562640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.103+0000 7f37a0e96740 1 --2- 172.21.15.18:0/2844047143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9567060 0x55fbc9569ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.103+0000 7f37a0e96740 1 -- 172.21.15.18:0/2844047143 >> 172.21.15.18:0/2844047143 conn(0x55fbc95635f0 msgr2=0x55fbc9561f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.103+0000 7f37a0e96740 1 -- 172.21.15.18:0/2844047143 shutdown_connections 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.103+0000 7f37a0e96740 1 -- 172.21.15.18:0/2844047143 wait complete. 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f37a0e96740 1 -- start start 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f37a0e96740 1 Processor -- start 2024-09-19T09:57:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc957a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc957a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f37a0e96740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc9577280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f37a0e96740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37981ac6d0 con 0x55fbc9567060 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f37a0e96740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f37981ac000 con 0x55fbc9567980 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f37a0e96740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37981a9240 con 0x55fbc9572240 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f37a0e96740 10 client.0 _ll_register_callbacks cb 0x7f3784016950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f379d05a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc957a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f379d05a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc957a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42946/0 (socket says 172.21.15.18:42946) 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f379d05a640 1 -- 172.21.15.18:0/3200392533 learned_addr learned my addr 172.21.15.18:0/3200392533 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.104+0000 7f3797fff640 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc957a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f379d05a640 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc9577280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f3797fff640 1 -- 172.21.15.18:0/3200392533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 msgr2=0x55fbc9577280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f3797fff640 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc9577280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f3797fff640 1 -- 172.21.15.18:0/3200392533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 msgr2=0x55fbc957a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f3797fff640 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc957a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f3797fff640 1 -- 172.21.15.18:0/3200392533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc95777c0 con 0x55fbc9567980 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f379d05a640 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc957a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f3797fff640 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc957a7f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3784016d10 tx=0x7f378400cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c44c6469d57a5cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f3777fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f3777fff640 1 -- 172.21.15.18:0/3200392533 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378401e070 con 0x55fbc9567980 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f3777fff640 1 -- 172.21.15.18:0/3200392533 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f378400e470 con 0x55fbc9567980 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.105+0000 7f37a0e96740 1 -- 172.21.15.18:0/3200392533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3790012d50 con 0x55fbc9567980 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f3777fff640 1 -- 172.21.15.18:0/3200392533 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3784004660 con 0x55fbc9567980 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f37a0e96740 10 client.26399 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f37a0e96740 1 -- 172.21.15.18:0/3200392533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fbc95ed340 con 0x55fbc9567980 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f3777fff640 1 -- 172.21.15.18:0/3200392533 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3790012d50 con 0x55fbc9567980 2024-09-19T09:57:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f3777fff640 1 -- 172.21.15.18:0/3200392533 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3784005360 con 0x55fbc9567980 2024-09-19T09:57:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f37a0e96740 10 client.26399 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f37a0e96740 10 client.26399 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:57:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f37a0e96740 20 client.26399 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f37a0e96740 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fbc95edb40 0x55fbc95eff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f37a0e96740 4 client.26399 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "df64d7a0", "release": true, "await": true}] 2024-09-19T09:57:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f37a0e96740 1 -- 172.21.15.18:0/3200392533 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "set_id": "df64d7a0", "release": true, "await": true}) -- 0x55fbc94d40a0 con 0x55fbc95edb40 2024-09-19T09:57:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.106+0000 7f379d05a640 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fbc95edb40 0x55fbc95eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.107+0000 7f379d05a640 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fbc95edb40 0x55fbc95eff60 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d0d03ceaeb676b3 server_cookie=e63a1a66485191c6 in_seq=0 out_seq=0 2024-09-19T09:57:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.107+0000 7f3777fff640 10 client.26399 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:51.113 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:51.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.110+0000 7f3777fff640 1 -- 172.21.15.18:0/3200392533 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fbc94d40a0 con 0x55fbc95edb40 2024-09-19T09:57:51.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.110+0000 7f3777fff640 10 client.26399 handle_command_reply: tid=0 2024-09-19T09:57:51.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.110+0000 7f37a0e96740 1 client.26399 shutdown 2024-09-19T09:57:51.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 1 -- 172.21.15.18:0/3200392533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 msgr2=0x55fbc957a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:51.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc957a7f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3784016d10 tx=0x7f378400cf50 comp rx=0 tx=0).stop 2024-09-19T09:57:51.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 1 -- 172.21.15.18:0/3200392533 shutdown_connections 2024-09-19T09:57:51.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55fbc95edb40 0x55fbc95eff60 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fbc9572240 0x55fbc9577280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fbc9567980 0x55fbc957a7f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 1 --2- 172.21.15.18:0/3200392533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbc9567060 0x55fbc957a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f3777fff640 0 client.26399 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 1 -- 172.21.15.18:0/3200392533 >> 172.21.15.18:0/3200392533 conn(0x55fbc95635f0 msgr2=0x55fbc956f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 1 -- 172.21.15.18:0/3200392533 shutdown_connections 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 1 -- 172.21.15.18:0/3200392533 wait complete. 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.111+0000 7f37a0e96740 20 client.26399 trim_cache size 0 max 16384 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 24, 2024-09-19T09:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "df64d7a0": { 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 24, 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 149.8, 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T09:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T09:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T09:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:57:51.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 -- 172.21.15.18:0/2520408759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f37880a32c0 msgr2=0x7f37880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f37880a32c0 0x7f37880a5780 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f378c009a50 tx=0x7f378c02a420 comp rx=0 tx=0).stop 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 -- 172.21.15.18:0/2520408759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798102d30 msgr2=0x7f3798198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798102d30 0x7f3798198530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f378c009230 tx=0x7f378c004270 comp rx=0 tx=0).stop 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 -- 172.21.15.18:0/2520408759 shutdown_connections 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f37880a32c0 0x7f37880a5780 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37981082a0 0x7f379819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37981036e0 0x7f3798198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 --2- 172.21.15.18:0/2520408759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3798102d30 0x7f3798198530 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 -- 172.21.15.18:0/2520408759 >> 172.21.15.18:0/2520408759 conn(0x7f37980fc7d0 msgr2=0x7f3798105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 -- 172.21.15.18:0/2520408759 shutdown_connections 2024-09-19T09:57:51.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:51.112+0000 7f379eabd640 1 -- 172.21.15.18:0/2520408759 wait complete. 2024-09-19T09:57:52.641 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:52 smithi018 ceph-mon[30956]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 64 MiB/s wr, 138 op/s 2024-09-19T09:57:52.665 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:52 smithi162 ceph-mon[35174]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 64 MiB/s wr, 138 op/s 2024-09-19T09:57:52.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.641+0000 7f1ca524e640 1 -- 172.21.15.18:0/2362011138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca0109830 msgr2=0x7f1ca0109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:52.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.641+0000 7f1ca524e640 1 --2- 172.21.15.18:0/2362011138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca0109830 0x7f1ca0109c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009ca0 tx=0x7f1c9802a8f0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.641+0000 7f1ca524e640 1 -- 172.21.15.18:0/2362011138 shutdown_connections 2024-09-19T09:57:52.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.641+0000 7f1ca524e640 1 --2- 172.21.15.18:0/2362011138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca011b140 0x7f1ca011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.641+0000 7f1ca524e640 1 --2- 172.21.15.18:0/2362011138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca0109830 0x7f1ca0109c90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.641+0000 7f1ca524e640 1 --2- 172.21.15.18:0/2362011138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ca0109450 0x7f1ca0110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.641+0000 7f1ca524e640 1 -- 172.21.15.18:0/2362011138 >> 172.21.15.18:0/2362011138 conn(0x7f1ca006e140 msgr2=0x7f1ca006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:52.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.641+0000 7f1ca524e640 1 -- 172.21.15.18:0/2362011138 shutdown_connections 2024-09-19T09:57:52.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.642+0000 7f1ca524e640 1 -- 172.21.15.18:0/2362011138 wait complete. 2024-09-19T09:57:52.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.645+0000 7f1ca524e640 1 Processor -- start 2024-09-19T09:57:52.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.645+0000 7f1ca524e640 1 -- start start 2024-09-19T09:57:52.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.648+0000 7f1ca524e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca0109450 0x7f1ca01a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.648+0000 7f1ca524e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca011b140 0x7f1ca01a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.648+0000 7f1ca524e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ca01ab970 0x7f1ca01abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.648+0000 7f1ca524e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0120e10 con 0x7f1ca01ab970 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.648+0000 7f1ca524e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0120c90 con 0x7f1ca011b140 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.648+0000 7f1ca524e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0120f90 con 0x7f1ca0109450 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.651+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca011b140 0x7f1ca01a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.651+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca011b140 0x7f1ca01a75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50376/0 (socket says 172.21.15.18:50376) 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.651+0000 7f1c9e59c640 1 -- 172.21.15.18:0/1481615814 learned_addr learned my addr 172.21.15.18:0/1481615814 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.653+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ca01ab970 0x7f1ca01abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.653+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca0109450 0x7f1ca01a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.655+0000 7f1c9e59c640 1 -- 172.21.15.18:0/1481615814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca0109450 msgr2=0x7f1ca01a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.655+0000 7f1c9e59c640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca0109450 0x7f1ca01a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.655+0000 7f1c9e59c640 1 -- 172.21.15.18:0/1481615814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ca01ab970 msgr2=0x7f1ca01abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:52.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.655+0000 7f1c9e59c640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ca01ab970 0x7f1ca01abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.655+0000 7f1c9e59c640 1 -- 172.21.15.18:0/1481615814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca01ac4c0 con 0x7f1ca011b140 2024-09-19T09:57:52.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.655+0000 7f1c9e59c640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca011b140 0x7f1ca01a75e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c9802ae60 tx=0x7f1c98030820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:52.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.655+0000 7f1c87fff640 1 -- 172.21.15.18:0/1481615814 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98030e20 con 0x7f1ca011b140 2024-09-19T09:57:52.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.656+0000 7f1c87fff640 1 -- 172.21.15.18:0/1481615814 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c98036040 con 0x7f1ca011b140 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.656+0000 7f1c87fff640 1 -- 172.21.15.18:0/1481615814 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9803b8e0 con 0x7f1ca011b140 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.657+0000 7f1ca524e640 1 -- 172.21.15.18:0/1481615814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca01ac750 con 0x7f1ca011b140 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.657+0000 7f1ca524e640 1 -- 172.21.15.18:0/1481615814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca01b3ee0 con 0x7f1ca011b140 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.680+0000 7f1ca7627740 1 Processor -- start 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.680+0000 7f1ca7627740 1 -- start start 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.688+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e87b40 0x561879e86090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.688+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e865d0 0x561879e86a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.688+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e91370 0x561879e93760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.688+0000 7f1ca7627740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561879dec2f0 con 0x561879e87b40 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.688+0000 7f1ca7627740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561879d93cf0 con 0x561879e865d0 2024-09-19T09:57:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.688+0000 7f1ca7627740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561879de82b0 con 0x561879e91370 2024-09-19T09:57:52.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.693+0000 7f1c87fff640 1 -- 172.21.15.18:0/1481615814 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1c98043030 con 0x7f1ca011b140 2024-09-19T09:57:52.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.694+0000 7f1c87fff640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1c880a3450 0x7f1c880a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.694+0000 7f1c9f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e87b40 0x561879e86090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.694+0000 7f1c9f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e87b40 0x561879e86090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42982/0 (socket says 172.21.15.18:42982) 2024-09-19T09:57:52.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.695+0000 7f1c9f59e640 1 -- 172.21.15.18:0/2433695058 learned_addr learned my addr 172.21.15.18:0/2433695058 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:52.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.695+0000 7f1c87fff640 1 -- 172.21.15.18:0/1481615814 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1c980f03f0 con 0x7f1ca011b140 2024-09-19T09:57:52.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.695+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/2433695058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e865d0 0x561879e86a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.695+0000 7f1c9e59c640 1 --2- 172.21.15.18:0/2433695058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e91370 0x561879e93760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.699+0000 7f1c9ed9d640 1 -- 172.21.15.18:0/2433695058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e91370 msgr2=0x561879e93760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.699+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/2433695058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e91370 0x561879e93760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.699+0000 7f1c9ed9d640 1 -- 172.21.15.18:0/2433695058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e87b40 msgr2=0x561879e86090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.699+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/2433695058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e87b40 0x561879e86090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.699+0000 7f1c9ed9d640 1 -- 172.21.15.18:0/2433695058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561879d783a0 con 0x561879e865d0 2024-09-19T09:57:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.699+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/2433695058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e865d0 0x561879e86a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000b760 tx=0x7f1c9000bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2606ec4208e6bb62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.699+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1c880a3450 0x7f1c880a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.700+0000 7f1c857fa640 1 -- 172.21.15.18:0/2433695058 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000d950 con 0x561879e865d0 2024-09-19T09:57:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.700+0000 7f1c857fa640 1 -- 172.21.15.18:0/2433695058 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c90019070 con 0x561879e865d0 2024-09-19T09:57:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.701+0000 7f1ca7627740 1 -- 172.21.15.18:0/2433695058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e865d0 msgr2=0x561879e86a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.701+0000 7f1ca7627740 1 --2- 172.21.15.18:0/2433695058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e865d0 0x561879e86a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000b760 tx=0x7f1c9000bc20 comp rx=0 tx=0).stop 2024-09-19T09:57:52.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.702+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1c880a3450 0x7f1c880a5910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009e20 tx=0x7f1c940046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:52.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.703+0000 7f1ca7627740 1 -- 172.21.15.18:0/2433695058 shutdown_connections 2024-09-19T09:57:52.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.703+0000 7f1ca7627740 1 --2- 172.21.15.18:0/2433695058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e91370 0x561879e93760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.703+0000 7f1ca7627740 1 --2- 172.21.15.18:0/2433695058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e865d0 0x561879e86a10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.703+0000 7f1ca7627740 1 --2- 172.21.15.18:0/2433695058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e87b40 0x561879e86090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.703+0000 7f1ca7627740 1 -- 172.21.15.18:0/2433695058 >> 172.21.15.18:0/2433695058 conn(0x561879e4f310 msgr2=0x561879e82c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:52.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.703+0000 7f1ca7627740 1 -- 172.21.15.18:0/2433695058 shutdown_connections 2024-09-19T09:57:52.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.703+0000 7f1ca7627740 1 -- 172.21.15.18:0/2433695058 wait complete. 2024-09-19T09:57:52.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.704+0000 7f1ca7627740 1 -- start start 2024-09-19T09:57:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.704+0000 7f1ca7627740 1 Processor -- start 2024-09-19T09:57:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.705+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e865d0 0x561879e90c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.705+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e87b40 0x561879e8dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.705+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e91370 0x561879e8e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.706+0000 7f1ca7627740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561879e940c0 con 0x561879e865d0 2024-09-19T09:57:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.706+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e87b40 0x561879e8dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.706+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e87b40 0x561879e8dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:43866/0 (socket says 172.21.15.18:43866) 2024-09-19T09:57:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.706+0000 7f1c9e59c640 1 -- 172.21.15.18:0/1865082800 learned_addr learned my addr 172.21.15.18:0/1865082800 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.706+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e91370 0x561879e8e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.706+0000 7f1ca7627740 1 -- 172.21.15.18:0/1865082800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561879da7060 con 0x561879e91370 2024-09-19T09:57:52.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.706+0000 7f1ca7627740 1 -- 172.21.15.18:0/1865082800 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561879e94240 con 0x561879e87b40 2024-09-19T09:57:52.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.706+0000 7f1ca7627740 10 client.0 _ll_register_callbacks cb 0x561879afa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:52.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.707+0000 7f1c9f59e640 1 -- 172.21.15.18:0/1865082800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e87b40 msgr2=0x561879e8dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:52.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.707+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e87b40 0x561879e8dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.707+0000 7f1c9f59e640 1 -- 172.21.15.18:0/1865082800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e865d0 msgr2=0x561879e90c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:52.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.707+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e865d0 0x561879e90c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.707+0000 7f1c9f59e640 1 -- 172.21.15.18:0/1865082800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561879b5d3c0 con 0x561879e91370 2024-09-19T09:57:52.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.707+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e91370 0x561879e8e420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c9401fc10 tx=0x7f1c94004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4122ab6311ba7d07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:52.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.709+0000 7f1c82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:57:52.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.709+0000 7f1c82ff5640 1 -- 172.21.15.18:0/1865082800 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c94028640 con 0x561879e91370 2024-09-19T09:57:52.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.709+0000 7f1c82ff5640 1 -- 172.21.15.18:0/1865082800 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1c9401c410 con 0x561879e91370 2024-09-19T09:57:52.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.709+0000 7f1ca7627740 1 -- 172.21.15.18:0/1865082800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c90019070 con 0x561879e91370 2024-09-19T09:57:52.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.710+0000 7f1c82ff5640 1 -- 172.21.15.18:0/1865082800 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1c94009e50 con 0x561879e91370 2024-09-19T09:57:52.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.710+0000 7f1ca7627740 10 client.26411 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:52.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.710+0000 7f1ca7627740 1 -- 172.21.15.18:0/1865082800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561879e9fb50 con 0x561879e91370 2024-09-19T09:57:52.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.711+0000 7f1c82ff5640 1 -- 172.21.15.18:0/1865082800 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c90019070 con 0x561879e91370 2024-09-19T09:57:52.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.713+0000 7f1c82ff5640 1 -- 172.21.15.18:0/1865082800 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1c94026070 con 0x561879e91370 2024-09-19T09:57:52.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.713+0000 7f1ca7627740 10 client.26411 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:52.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.713+0000 7f1ca7627740 10 client.26411 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:57:52.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.713+0000 7f1ca7627740 20 client.26411 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:52.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.713+0000 7f1ca7627740 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x561879ea13f0 0x561879ea3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.713+0000 7f1ca7627740 4 client.26411 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:52.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.713+0000 7f1ca7627740 1 -- 172.21.15.18:0/1865082800 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1c90014e50 con 0x561879ea13f0 2024-09-19T09:57:52.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.717+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x561879ea13f0 0x561879ea3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.738+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x561879ea13f0 0x561879ea3880 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=433c0b3aa91b79f9 server_cookie=41ffa9b267be6dbf in_seq=0 out_seq=0 2024-09-19T09:57:52.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.738+0000 7f1c82ff5640 10 client.26411 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:57:52.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.742+0000 7f1c82ff5640 1 -- 172.21.15.18:0/1865082800 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1c9000be70 con 0x561879ea13f0 2024-09-19T09:57:52.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.742+0000 7f1c82ff5640 10 client.26411 handle_command_reply: tid=0 2024-09-19T09:57:52.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.742+0000 7f1ca7627740 1 client.26411 shutdown 2024-09-19T09:57:52.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.743+0000 7f1ca7627740 1 -- 172.21.15.18:0/1865082800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e91370 msgr2=0x561879e8e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:52.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.743+0000 7f1ca7627740 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e91370 0x561879e8e420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c9401fc10 tx=0x7f1c94004730 comp rx=0 tx=0).stop 2024-09-19T09:57:52.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.743+0000 7f1ca7627740 1 -- 172.21.15.18:0/1865082800 shutdown_connections 2024-09-19T09:57:52.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.743+0000 7f1ca7627740 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x561879ea13f0 0x561879ea3880 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.743+0000 7f1ca7627740 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e91370 0x561879e8e420 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.743+0000 7f1ca7627740 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e87b40 0x561879e8dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.743+0000 7f1ca7627740 1 --2- 172.21.15.18:0/1865082800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e865d0 0x561879e90c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.743+0000 7f1ca7627740 1 -- 172.21.15.18:0/1865082800 >> 172.21.15.18:0/1865082800 conn(0x561879e4f310 msgr2=0x561879e88960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:52.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.743+0000 7f1c82ff5640 0 client.26411 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:57:52.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.744+0000 7f1ca7627740 1 -- 172.21.15.18:0/1865082800 shutdown_connections 2024-09-19T09:57:52.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.744+0000 7f1ca7627740 1 -- 172.21.15.18:0/1865082800 wait complete. 2024-09-19T09:57:52.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.744+0000 7f1ca7627740 20 client.26411 trim_cache size 0 max 16384 2024-09-19T09:57:52.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.787+0000 7f1ca7627740 1 Processor -- start 2024-09-19T09:57:52.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.789+0000 7f1ca7627740 1 -- start start 2024-09-19T09:57:52.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.789+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e4f310 0x561879e82e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.790+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e9d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.790+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 0x561879e89120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.790+0000 7f1ca7627740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca01bc550 con 0x561879e4f310 2024-09-19T09:57:52.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.790+0000 7f1ca7627740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca01be090 con 0x561879e87b40 2024-09-19T09:57:52.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.790+0000 7f1ca7627740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca01bcc20 con 0x561879e865d0 2024-09-19T09:57:52.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.792+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e9d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.792+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e9d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:43878/0 (socket says 172.21.15.18:43878) 2024-09-19T09:57:52.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.792+0000 7f1c9e59c640 1 -- 172.21.15.18:0/1032473177 learned_addr learned my addr 172.21.15.18:0/1032473177 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:52.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.792+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/1032473177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 0x561879e89120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.794+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/1032473177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e4f310 0x561879e82e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.794+0000 7f1c9e59c640 1 -- 172.21.15.18:0/1032473177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 msgr2=0x561879e89120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:52.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.794+0000 7f1c9e59c640 1 --2- 172.21.15.18:0/1032473177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 0x561879e89120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.794+0000 7f1c9e59c640 1 -- 172.21.15.18:0/1032473177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e4f310 msgr2=0x561879e82e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:52.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.794+0000 7f1c9e59c640 1 --2- 172.21.15.18:0/1032473177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e4f310 0x561879e82e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.794+0000 7f1c9e59c640 1 -- 172.21.15.18:0/1032473177 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561879e83dd0 con 0x561879e865d0 2024-09-19T09:57:52.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.795+0000 7f1c9e59c640 1 --2- 172.21.15.18:0/1032473177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e9d3b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c98006010 tx=0x7f1c980edd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c8ea0cf3d861005 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:52.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.797+0000 7f1c84ff9640 1 -- 172.21.15.18:0/1032473177 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c980da070 con 0x561879e865d0 2024-09-19T09:57:52.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.797+0000 7f1c84ff9640 1 -- 172.21.15.18:0/1032473177 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c9802d070 con 0x561879e865d0 2024-09-19T09:57:52.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.797+0000 7f1c84ff9640 1 -- 172.21.15.18:0/1032473177 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9802fc10 con 0x561879e865d0 2024-09-19T09:57:52.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.798+0000 7f1ca7627740 1 -- 172.21.15.18:0/1032473177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 msgr2=0x561879e9d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:52.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.799+0000 7f1ca7627740 1 --2- 172.21.15.18:0/1032473177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e9d3b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c98006010 tx=0x7f1c980edd90 comp rx=0 tx=0).stop 2024-09-19T09:57:52.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.799+0000 7f1ca7627740 1 -- 172.21.15.18:0/1032473177 shutdown_connections 2024-09-19T09:57:52.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.799+0000 7f1ca7627740 1 --2- 172.21.15.18:0/1032473177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 0x561879e89120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.799+0000 7f1ca7627740 1 --2- 172.21.15.18:0/1032473177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e9d3b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.799+0000 7f1ca7627740 1 --2- 172.21.15.18:0/1032473177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e4f310 0x561879e82e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.799+0000 7f1ca7627740 1 -- 172.21.15.18:0/1032473177 >> 172.21.15.18:0/1032473177 conn(0x561879e8e580 msgr2=0x561879e82700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:52.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.807+0000 7f1ca7627740 1 -- 172.21.15.18:0/1032473177 shutdown_connections 2024-09-19T09:57:52.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.807+0000 7f1ca7627740 1 -- 172.21.15.18:0/1032473177 wait complete. 2024-09-19T09:57:52.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.808+0000 7f1ca7627740 1 -- start start 2024-09-19T09:57:52.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.808+0000 7f1ca7627740 1 Processor -- start 2024-09-19T09:57:52.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.809+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e4f310 0x561879e99700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.809+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e99c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.810+0000 7f1ca7627740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 0x561879e8a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.810+0000 7f1ca7627740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca01bd9c0 con 0x561879e4f310 2024-09-19T09:57:52.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.810+0000 7f1ca7627740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca01bd2f0 con 0x561879e87b40 2024-09-19T09:57:52.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.810+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e99c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.810+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e99c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:43882/0 (socket says 172.21.15.18:43882) 2024-09-19T09:57:52.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.810+0000 7f1c9e59c640 1 -- 172.21.15.18:0/2166298500 learned_addr learned my addr 172.21.15.18:0/2166298500 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:52.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.810+0000 7f1ca7627740 1 -- 172.21.15.18:0/2166298500 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca01ba530 con 0x561879e865d0 2024-09-19T09:57:52.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.810+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 0x561879e8a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.811+0000 7f1ca7627740 10 client.0 _ll_register_callbacks cb 0x7f1ca0110870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:52.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.815+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e4f310 0x561879e99700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.819+0000 7f1c9f59e640 1 -- 172.21.15.18:0/2166298500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 msgr2=0x561879e99c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:52.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.819+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e99c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.819+0000 7f1c9f59e640 1 -- 172.21.15.18:0/2166298500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e4f310 msgr2=0x561879e99700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:52.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.819+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e4f310 0x561879e99700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.819+0000 7f1c9f59e640 1 -- 172.21.15.18:0/2166298500 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561879e8af20 con 0x561879e87b40 2024-09-19T09:57:52.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.820+0000 7f1c9f59e640 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 0x561879e8a710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c94005850 tx=0x7f1c9401fe50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87aafb56b60c4135 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:52.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.821+0000 7f1c82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:57:52.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.824+0000 7f1c82ff5640 1 -- 172.21.15.18:0/2166298500 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c94028d80 con 0x561879e87b40 2024-09-19T09:57:52.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.824+0000 7f1c82ff5640 1 -- 172.21.15.18:0/2166298500 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1c94028440 con 0x561879e87b40 2024-09-19T09:57:52.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.827+0000 7f1ca7627740 1 -- 172.21.15.18:0/2166298500 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c9802d070 con 0x561879e87b40 2024-09-19T09:57:52.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.831+0000 7f1c82ff5640 1 -- 172.21.15.18:0/2166298500 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1c94009e50 con 0x561879e87b40 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.831+0000 7f1ca7627740 10 client.26414 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.831+0000 7f1ca7627740 1 -- 172.21.15.18:0/2166298500 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561879f0bc60 con 0x561879e87b40 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.834+0000 7f1c82ff5640 1 -- 172.21.15.18:0/2166298500 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c94032b60 con 0x561879e87b40 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.834+0000 7f1c82ff5640 1 -- 172.21.15.18:0/2166298500 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1c94026070 con 0x561879e87b40 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.835+0000 7f1ca7627740 10 client.26414 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.835+0000 7f1ca7627740 10 client.26414 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.835+0000 7f1ca7627740 20 client.26414 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.835+0000 7f1ca7627740 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x561879e91370 0x561879f0e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.835+0000 7f1ca7627740 4 client.26414 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.835+0000 7f1ca7627740 1 -- 172.21.15.18:0/2166298500 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f1c9802d070 con 0x561879e91370 2024-09-19T09:57:52.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.836+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x561879e91370 0x561879f0e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:52.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.838+0000 7f1c82ff5640 10 client.26414 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:57:52.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.839+0000 7f1c9ed9d640 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x561879e91370 0x561879f0e3f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=807f2f54b9fe3b46 server_cookie=f4c14e062ad16ced in_seq=0 out_seq=0 2024-09-19T09:57:52.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.842+0000 7f1c82ff5640 1 -- 172.21.15.18:0/2166298500 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f1c9802d070 con 0x561879e91370 2024-09-19T09:57:52.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.842+0000 7f1c82ff5640 10 client.26414 handle_command_reply: tid=0 2024-09-19T09:57:52.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.842+0000 7f1ca7627740 1 client.26414 shutdown 2024-09-19T09:57:52.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.844+0000 7f1ca7627740 1 -- 172.21.15.18:0/2166298500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 msgr2=0x561879e8a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:52.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.844+0000 7f1ca7627740 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 0x561879e8a710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c94005850 tx=0x7f1c9401fe50 comp rx=0 tx=0).stop 2024-09-19T09:57:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.848+0000 7f1ca7627740 1 -- 172.21.15.18:0/2166298500 shutdown_connections 2024-09-19T09:57:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.848+0000 7f1ca7627740 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x561879e91370 0x561879f0e3f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.848+0000 7f1ca7627740 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561879e87b40 0x561879e8a710 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.848+0000 7f1ca7627740 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561879e865d0 0x561879e99c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.848+0000 7f1ca7627740 1 --2- 172.21.15.18:0/2166298500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879e4f310 0x561879e99700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.848+0000 7f1ca7627740 1 -- 172.21.15.18:0/2166298500 >> 172.21.15.18:0/2166298500 conn(0x561879e8e580 msgr2=0x561879e8ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.848+0000 7f1c82ff5640 0 client.26414 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:57:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.849+0000 7f1ca7627740 1 -- 172.21.15.18:0/2166298500 shutdown_connections 2024-09-19T09:57:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.849+0000 7f1ca7627740 1 -- 172.21.15.18:0/2166298500 wait complete. 2024-09-19T09:57:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.849+0000 7f1ca7627740 20 client.26414 trim_cache size 0 max 16384 2024-09-19T09:57:52.855 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.853+0000 7f1ca524e640 1 -- 172.21.15.18:0/1481615814 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1c880a3450 msgr2=0x7f1c880a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1c880a3450 0x7f1c880a5910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009e20 tx=0x7f1c940046c0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 -- 172.21.15.18:0/1481615814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca011b140 msgr2=0x7f1ca01a75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca011b140 0x7f1ca01a75e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c9802ae60 tx=0x7f1c98030820 comp rx=0 tx=0).stop 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 -- 172.21.15.18:0/1481615814 shutdown_connections 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1c880a3450 0x7f1c880a5910 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ca01ab970 0x7f1ca01abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ca011b140 0x7f1ca01a75e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 --2- 172.21.15.18:0/1481615814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca0109450 0x7f1ca01a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 -- 172.21.15.18:0/1481615814 >> 172.21.15.18:0/1481615814 conn(0x7f1ca006e140 msgr2=0x7f1ca011b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 -- 172.21.15.18:0/1481615814 shutdown_connections 2024-09-19T09:57:52.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:52.854+0000 7f1ca524e640 1 -- 172.21.15.18:0/1481615814 wait complete. 2024-09-19T09:57:52.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:52 smithi049 ceph-mon[34858]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 64 MiB/s wr, 138 op/s 2024-09-19T09:57:53.885 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'df64d7a0', total seconds elapsed: 38.8 2024-09-19T09:57:54.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:54 smithi018 ceph-mon[30956]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 82 MiB/s wr, 311 op/s 2024-09-19T09:57:54.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:54 smithi049 ceph-mon[34858]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 82 MiB/s wr, 311 op/s 2024-09-19T09:57:54.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:57:54.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:54 smithi162 ceph-mon[35174]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 82 MiB/s wr, 311 op/s 2024-09-19T09:57:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:56.732 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:56 smithi018 ceph-mon[30956]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 118 MiB/s wr, 706 op/s 2024-09-19T09:57:56.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.820+0000 7f418f59e640 1 -- 172.21.15.18:0/4104323800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4190110190 msgr2=0x7f419006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:56.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.820+0000 7f418f59e640 1 --2- 172.21.15.18:0/4104323800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4190110190 0x7f419006e4f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4180009900 tx=0x7f418002a420 comp rx=0 tx=0).stop 2024-09-19T09:57:56.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.823+0000 7f418f59e640 1 -- 172.21.15.18:0/4104323800 shutdown_connections 2024-09-19T09:57:56.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.823+0000 7f418f59e640 1 --2- 172.21.15.18:0/4104323800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f419011b140 0x7f419011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.823+0000 7f418f59e640 1 --2- 172.21.15.18:0/4104323800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f419006ea30 0x7f419006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.823+0000 7f418f59e640 1 --2- 172.21.15.18:0/4104323800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4190110190 0x7f419006e4f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.823+0000 7f418f59e640 1 -- 172.21.15.18:0/4104323800 >> 172.21.15.18:0/4104323800 conn(0x7f4190073180 msgr2=0x7f4190073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:56.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.823+0000 7f418f59e640 1 -- 172.21.15.18:0/4104323800 shutdown_connections 2024-09-19T09:57:56.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.823+0000 7f418f59e640 1 -- 172.21.15.18:0/4104323800 wait complete. 2024-09-19T09:57:56.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.825+0000 7f418f59e640 1 Processor -- start 2024-09-19T09:57:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.826+0000 7f418f59e640 1 -- start start 2024-09-19T09:57:56.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.830+0000 7f418f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f419006ea30 0x7f41901a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.830+0000 7f418f59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4190110190 0x7f41901a7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.830+0000 7f418f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f419011b140 0x7f41901ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.830+0000 7f418f59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4190120c60 con 0x7f419011b140 2024-09-19T09:57:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.830+0000 7f418f59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4190120ae0 con 0x7f419006ea30 2024-09-19T09:57:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.830+0000 7f418f59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4190120de0 con 0x7f4190110190 2024-09-19T09:57:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.832+0000 7f418ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f419011b140 0x7f41901ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.832+0000 7f418ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f419011b140 0x7f41901ab9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57766/0 (socket says 172.21.15.18:57766) 2024-09-19T09:57:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.832+0000 7f418ed9d640 1 -- 172.21.15.18:0/5381297 learned_addr learned my addr 172.21.15.18:0/5381297 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.834+0000 7f418dd9b640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4190110190 0x7f41901a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.834+0000 7f418e59c640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f419006ea30 0x7f41901a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.835+0000 7f418dd9b640 1 -- 172.21.15.18:0/5381297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f419006ea30 msgr2=0x7f41901a7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.835+0000 7f418dd9b640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f419006ea30 0x7f41901a7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.835+0000 7f418dd9b640 1 -- 172.21.15.18:0/5381297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f419011b140 msgr2=0x7f41901ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.835+0000 7f418dd9b640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f419011b140 0x7f41901ab9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.835+0000 7f418dd9b640 1 -- 172.21.15.18:0/5381297 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41901ac150 con 0x7f4190110190 2024-09-19T09:57:56.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.837+0000 7f418dd9b640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4190110190 0x7f41901a7640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4184009fd0 tx=0x7f418400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:56.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.840+0000 7f417f7fe640 1 -- 172.21.15.18:0/5381297 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184015020 con 0x7f4190110190 2024-09-19T09:57:56.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.840+0000 7f418f59e640 1 -- 172.21.15.18:0/5381297 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41901ac440 con 0x7f4190110190 2024-09-19T09:57:56.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.840+0000 7f418f59e640 1 -- 172.21.15.18:0/5381297 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41901b3c80 con 0x7f4190110190 2024-09-19T09:57:56.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.843+0000 7f417f7fe640 1 -- 172.21.15.18:0/5381297 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4184011d10 con 0x7f4190110190 2024-09-19T09:57:56.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.843+0000 7f417f7fe640 1 -- 172.21.15.18:0/5381297 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418400f2e0 con 0x7f4190110190 2024-09-19T09:57:56.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.854+0000 7f4196ca7740 1 Processor -- start 2024-09-19T09:57:56.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.855+0000 7f4196ca7740 1 -- start start 2024-09-19T09:57:56.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.856+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564978059d20 0x564978058270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.856+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x564978058bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.856+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978065940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.856+0000 7f4196ca7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564977fbe2f0 con 0x564978063550 2024-09-19T09:57:56.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.856+0000 7f4196ca7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564977f65cf0 con 0x564978059d20 2024-09-19T09:57:56.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.856+0000 7f4196ca7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564977fba2b0 con 0x5649780587b0 2024-09-19T09:57:56.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.858+0000 7f418e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x564978058bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.858+0000 7f418e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x564978058bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54204/0 (socket says 172.21.15.18:54204) 2024-09-19T09:57:56.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.858+0000 7f418e59c640 1 -- 172.21.15.18:0/503654424 learned_addr learned my addr 172.21.15.18:0/503654424 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:56.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.859+0000 7f418e59c640 1 -- 172.21.15.18:0/503654424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564978059d20 msgr2=0x564978058270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:57:56.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.859+0000 7f418e59c640 1 --2- 172.21.15.18:0/503654424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564978059d20 0x564978058270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.859+0000 7f418e59c640 1 -- 172.21.15.18:0/503654424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 msgr2=0x564978065940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:57:56.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.859+0000 7f418e59c640 1 --2- 172.21.15.18:0/503654424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978065940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.859+0000 7f418e59c640 1 -- 172.21.15.18:0/503654424 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564977f4a3a0 con 0x5649780587b0 2024-09-19T09:57:56.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.860+0000 7f418e59c640 1 --2- 172.21.15.18:0/503654424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x564978058bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f418002a990 tx=0x7f4180031ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d740b9be57c8ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:56.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.862+0000 7f417f7fe640 1 -- 172.21.15.18:0/5381297 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4184018020 con 0x7f4190110190 2024-09-19T09:57:56.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.862+0000 7f417cff9640 1 -- 172.21.15.18:0/503654424 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418003f070 con 0x5649780587b0 2024-09-19T09:57:56.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.865+0000 7f417cff9640 1 -- 172.21.15.18:0/503654424 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4180004040 con 0x5649780587b0 2024-09-19T09:57:56.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.867+0000 7f4196ca7740 1 -- 172.21.15.18:0/503654424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 msgr2=0x564978058bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:56.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.867+0000 7f4196ca7740 1 --2- 172.21.15.18:0/503654424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x564978058bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f418002a990 tx=0x7f4180031ad0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.868+0000 7f4196ca7740 1 -- 172.21.15.18:0/503654424 shutdown_connections 2024-09-19T09:57:56.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.868+0000 7f4196ca7740 1 --2- 172.21.15.18:0/503654424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978065940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.868+0000 7f4196ca7740 1 --2- 172.21.15.18:0/503654424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x564978058bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.868+0000 7f4196ca7740 1 --2- 172.21.15.18:0/503654424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564978059d20 0x564978058270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.868+0000 7f4196ca7740 1 -- 172.21.15.18:0/503654424 >> 172.21.15.18:0/503654424 conn(0x564978021310 msgr2=0x564978054e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:56.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.868+0000 7f4196ca7740 1 -- 172.21.15.18:0/503654424 shutdown_connections 2024-09-19T09:57:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.868+0000 7f4196ca7740 1 -- 172.21.15.18:0/503654424 wait complete. 2024-09-19T09:57:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.871+0000 7f4196ca7740 1 -- start start 2024-09-19T09:57:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.871+0000 7f4196ca7740 1 Processor -- start 2024-09-19T09:57:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.872+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649780587b0 0x564978062e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.872+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564978059d20 0x5649780600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.873+0000 7f418ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649780587b0 0x564978062e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.873+0000 7f418ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649780587b0 0x564978062e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37492/0 (socket says 172.21.15.18:37492) 2024-09-19T09:57:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.874+0000 7f418ed9d640 1 -- 172.21.15.18:0/1185690375 learned_addr learned my addr 172.21.15.18:0/1185690375 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.874+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978060620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.874+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564978066290 con 0x564978063550 2024-09-19T09:57:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.874+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564977f79060 con 0x5649780587b0 2024-09-19T09:57:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.874+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564978066410 con 0x564978059d20 2024-09-19T09:57:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.874+0000 7f4196ca7740 10 client.0 _ll_register_callbacks cb 0x564977ccc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.875+0000 7f418dd9b640 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978060620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.876+0000 7f418e59c640 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564978059d20 0x5649780600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.878+0000 7f418dd9b640 1 -- 172.21.15.18:0/1185690375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564978059d20 msgr2=0x5649780600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.878+0000 7f418dd9b640 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564978059d20 0x5649780600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.878+0000 7f418dd9b640 1 -- 172.21.15.18:0/1185690375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649780587b0 msgr2=0x564978062e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:56.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.878+0000 7f418dd9b640 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649780587b0 0x564978062e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.878+0000 7f418dd9b640 1 -- 172.21.15.18:0/1185690375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564977d2f3c0 con 0x564978063550 2024-09-19T09:57:56.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.881+0000 7f417f7fe640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41780a3310 0x7f41780a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.883+0000 7f417f7fe640 1 -- 172.21.15.18:0/5381297 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f41840cef80 con 0x7f4190110190 2024-09-19T09:57:56.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.884+0000 7f418dd9b640 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978060620 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f41840cca20 tx=0x7f41840d7860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f23383785f556f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:56.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.885+0000 7f418ed9d640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41780a3310 0x7f41780a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.885+0000 7f4175ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:57:56.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.886+0000 7f418ed9d640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41780a3310 0x7f41780a57d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4188009860 tx=0x7f4188009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:56.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.886+0000 7f4175ffb640 1 -- 172.21.15.18:0/1185690375 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184097810 con 0x564978063550 2024-09-19T09:57:56.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.886+0000 7f4175ffb640 1 -- 172.21.15.18:0/1185690375 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4184099870 con 0x564978063550 2024-09-19T09:57:56.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.888+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4180004040 con 0x564978063550 2024-09-19T09:57:56.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:56 smithi049 ceph-mon[34858]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 118 MiB/s wr, 706 op/s 2024-09-19T09:57:56.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.900+0000 7f4175ffb640 1 -- 172.21.15.18:0/1185690375 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f418409aed0 con 0x564978063550 2024-09-19T09:57:56.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.900+0000 7f4196ca7740 10 client.17001 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:56.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.900+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564978071d00 con 0x564978063550 2024-09-19T09:57:56.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.902+0000 7f4175ffb640 1 -- 172.21.15.18:0/1185690375 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4180004040 con 0x564978063550 2024-09-19T09:57:56.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.902+0000 7f4175ffb640 1 -- 172.21.15.18:0/1185690375 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4184097be0 con 0x564978063550 2024-09-19T09:57:56.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.905+0000 7f4196ca7740 10 client.17001 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:56.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.905+0000 7f4196ca7740 10 client.17001 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:57:56.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.905+0000 7f4196ca7740 20 client.17001 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:56.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.905+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5649780730f0 0x564978075510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.905+0000 7f4196ca7740 4 client.17001 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:56.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.905+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564977fcb860 con 0x5649780730f0 2024-09-19T09:57:56.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.905+0000 7f418e59c640 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5649780730f0 0x564978075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:56 smithi162 ceph-mon[35174]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 118 MiB/s wr, 706 op/s 2024-09-19T09:57:56.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.913+0000 7f418e59c640 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5649780730f0 0x564978075510 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3eaa4d94c2ee6fa6 server_cookie=14f24d528b9be87c in_seq=0 out_seq=0 2024-09-19T09:57:56.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.913+0000 7f4175ffb640 10 client.17001 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:57:56.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.918+0000 7f4175ffb640 1 -- 172.21.15.18:0/1185690375 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564977fcb860 con 0x5649780730f0 2024-09-19T09:57:56.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.918+0000 7f4175ffb640 10 client.17001 handle_command_reply: tid=0 2024-09-19T09:57:56.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.918+0000 7f4196ca7740 1 client.17001 shutdown 2024-09-19T09:57:56.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.919+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 msgr2=0x564978060620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:56.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.919+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978060620 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f41840cca20 tx=0x7f41840d7860 comp rx=0 tx=0).stop 2024-09-19T09:57:56.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.920+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 shutdown_connections 2024-09-19T09:57:56.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.920+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5649780730f0 0x564978075510 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.920+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978060620 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.920+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564978059d20 0x5649780600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.920+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1185690375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649780587b0 0x564978062e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.920+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 >> 172.21.15.18:0/1185690375 conn(0x564978021310 msgr2=0x56497805ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.920+0000 7f4175ffb640 0 client.17001 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:57:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.920+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 shutdown_connections 2024-09-19T09:57:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.920+0000 7f4196ca7740 1 -- 172.21.15.18:0/1185690375 wait complete. 2024-09-19T09:57:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.921+0000 7f4196ca7740 20 client.17001 trim_cache size 0 max 16384 2024-09-19T09:57:56.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.971+0000 7f4196ca7740 1 Processor -- start 2024-09-19T09:57:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.972+0000 7f4196ca7740 1 -- start start 2024-09-19T09:57:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.972+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649780587b0 0x56497806f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.973+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564978059d20 0x564978064940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.973+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978064e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.973+0000 7f4196ca7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f417000e4f0 con 0x564978063550 2024-09-19T09:57:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.973+0000 7f4196ca7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4170010030 con 0x5649780587b0 2024-09-19T09:57:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.973+0000 7f4196ca7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f417000ebc0 con 0x564978059d20 2024-09-19T09:57:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.974+0000 7f418ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978064e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.974+0000 7f418ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978064e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57796/0 (socket says 172.21.15.18:57796) 2024-09-19T09:57:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.974+0000 7f418ed9d640 1 -- 172.21.15.18:0/578471009 learned_addr learned my addr 172.21.15.18:0/578471009 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.974+0000 7f418dd9b640 1 --2- 172.21.15.18:0/578471009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564978059d20 0x564978064940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.975+0000 7f418ed9d640 1 -- 172.21.15.18:0/578471009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564978059d20 msgr2=0x564978064940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.975+0000 7f418ed9d640 1 --2- 172.21.15.18:0/578471009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564978059d20 0x564978064940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.975+0000 7f418ed9d640 1 -- 172.21.15.18:0/578471009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649780587b0 msgr2=0x56497806f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.975+0000 7f418ed9d640 1 --2- 172.21.15.18:0/578471009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649780587b0 0x56497806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.975+0000 7f418ed9d640 1 -- 172.21.15.18:0/578471009 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497805b300 con 0x564978063550 2024-09-19T09:57:56.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.976+0000 7f418ed9d640 1 --2- 172.21.15.18:0/578471009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978064e80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4188011740 tx=0x7f4188016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcdfcf611fdb157 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:56.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.979+0000 7f4177fff640 1 -- 172.21.15.18:0/578471009 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188028430 con 0x564978063550 2024-09-19T09:57:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.979+0000 7f4177fff640 1 -- 172.21.15.18:0/578471009 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f418801f8f0 con 0x564978063550 2024-09-19T09:57:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.979+0000 7f4177fff640 1 -- 172.21.15.18:0/578471009 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188027a40 con 0x564978063550 2024-09-19T09:57:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.980+0000 7f4196ca7740 1 -- 172.21.15.18:0/578471009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 msgr2=0x564978064e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.980+0000 7f4196ca7740 1 --2- 172.21.15.18:0/578471009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978064e80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4188011740 tx=0x7f4188016000 comp rx=0 tx=0).stop 2024-09-19T09:57:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.981+0000 7f4196ca7740 1 -- 172.21.15.18:0/578471009 shutdown_connections 2024-09-19T09:57:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.981+0000 7f4196ca7740 1 --2- 172.21.15.18:0/578471009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978063550 0x564978064e80 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.981+0000 7f4196ca7740 1 --2- 172.21.15.18:0/578471009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564978059d20 0x564978064940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.981+0000 7f4196ca7740 1 --2- 172.21.15.18:0/578471009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649780587b0 0x56497806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.981+0000 7f4196ca7740 1 -- 172.21.15.18:0/578471009 >> 172.21.15.18:0/578471009 conn(0x564978021310 msgr2=0x56497805e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.981+0000 7f4196ca7740 1 -- 172.21.15.18:0/578471009 shutdown_connections 2024-09-19T09:57:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.981+0000 7f4196ca7740 1 -- 172.21.15.18:0/578471009 wait complete. 2024-09-19T09:57:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.982+0000 7f4196ca7740 1 -- start start 2024-09-19T09:57:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.982+0000 7f4196ca7740 1 Processor -- start 2024-09-19T09:57:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.985+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x56497806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.985+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978059d20 0x56497807a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.985+0000 7f4196ca7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564978063550 0x56497807ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.985+0000 7f4196ca7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f417000f960 con 0x564978059d20 2024-09-19T09:57:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.985+0000 7f4196ca7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f417000f290 con 0x564978063550 2024-09-19T09:57:56.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.985+0000 7f4196ca7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f417000c4d0 con 0x5649780587b0 2024-09-19T09:57:56.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.985+0000 7f4196ca7740 10 client.0 _ll_register_callbacks cb 0x7f41840d2710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:56.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.987+0000 7f418ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564978063550 0x56497807ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.987+0000 7f418e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x56497806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.987+0000 7f418dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978059d20 0x56497807a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.987+0000 7f418dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978059d20 0x56497807a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57798/0 (socket says 172.21.15.18:57798) 2024-09-19T09:57:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.987+0000 7f418dd9b640 1 -- 172.21.15.18:0/1197128623 learned_addr learned my addr 172.21.15.18:0/1197128623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.988+0000 7f418e59c640 1 -- 172.21.15.18:0/1197128623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564978063550 msgr2=0x56497807ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.988+0000 7f418e59c640 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564978063550 0x56497807ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.988+0000 7f418e59c640 1 -- 172.21.15.18:0/1197128623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978059d20 msgr2=0x56497807a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.988+0000 7f418e59c640 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978059d20 0x56497807a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.988+0000 7f418e59c640 1 -- 172.21.15.18:0/1197128623 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497807b460 con 0x5649780587b0 2024-09-19T09:57:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.988+0000 7f418dd9b640 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978059d20 0x56497807a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:57:56.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.989+0000 7f418e59c640 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x56497806bf50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4180009850 tx=0x7f418002a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=825af53c39cae899 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:56.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.989+0000 7f4175ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:57:56.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.990+0000 7f4175ffb640 1 -- 172.21.15.18:0/1197128623 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180054030 con 0x5649780587b0 2024-09-19T09:57:56.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.990+0000 7f4175ffb640 1 -- 172.21.15.18:0/1197128623 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4180031400 con 0x5649780587b0 2024-09-19T09:57:56.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.990+0000 7f4196ca7740 1 -- 172.21.15.18:0/1197128623 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f418801f8f0 con 0x5649780587b0 2024-09-19T09:57:56.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.991+0000 7f4175ffb640 1 -- 172.21.15.18:0/1197128623 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f418003f040 con 0x5649780587b0 2024-09-19T09:57:56.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.991+0000 7f4196ca7740 10 client.26407 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:56.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.991+0000 7f4196ca7740 1 -- 172.21.15.18:0/1197128623 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5649780dddf0 con 0x5649780587b0 2024-09-19T09:57:56.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.992+0000 7f4175ffb640 1 -- 172.21.15.18:0/1197128623 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4180031600 con 0x5649780587b0 2024-09-19T09:57:56.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.992+0000 7f4175ffb640 1 -- 172.21.15.18:0/1197128623 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4180050450 con 0x5649780587b0 2024-09-19T09:57:56.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.992+0000 7f4196ca7740 10 client.26407 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:56.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.992+0000 7f4196ca7740 10 client.26407 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:57:56.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.992+0000 7f4196ca7740 20 client.26407 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:56.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.992+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5649780de0e0 0x5649780e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:56.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.992+0000 7f4196ca7740 4 client.26407 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:57:56.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.992+0000 7f4196ca7740 1 -- 172.21.15.18:0/1197128623 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f418801f8f0 con 0x5649780de0e0 2024-09-19T09:57:56.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.993+0000 7f418dd9b640 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5649780de0e0 0x5649780e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:56.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.996+0000 7f418dd9b640 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5649780de0e0 0x5649780e04d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87a3d36c0a8db7e5 server_cookie=7c5d74ffc5e499d0 in_seq=0 out_seq=0 2024-09-19T09:57:56.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.996+0000 7f4175ffb640 10 client.26407 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:57:57.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.997+0000 7f4175ffb640 1 -- 172.21.15.18:0/1197128623 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f418801f8f0 con 0x5649780de0e0 2024-09-19T09:57:57.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.997+0000 7f4175ffb640 10 client.26407 handle_command_reply: tid=0 2024-09-19T09:57:57.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.997+0000 7f4196ca7740 1 client.26407 shutdown 2024-09-19T09:57:57.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.998+0000 7f4196ca7740 1 -- 172.21.15.18:0/1197128623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 msgr2=0x56497806bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:57.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.998+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x56497806bf50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4180009850 tx=0x7f418002a420 comp rx=0 tx=0).stop 2024-09-19T09:57:57.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.998+0000 7f4196ca7740 1 -- 172.21.15.18:0/1197128623 shutdown_connections 2024-09-19T09:57:57.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.998+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x5649780de0e0 0x5649780e04d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:57.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.998+0000 7f4175ffb640 0 client.26407 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:57:57.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.998+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564978063550 0x56497807ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:57.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.998+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564978059d20 0x56497807a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:57.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.998+0000 7f4196ca7740 1 --2- 172.21.15.18:0/1197128623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5649780587b0 0x56497806bf50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:57.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.998+0000 7f4196ca7740 1 -- 172.21.15.18:0/1197128623 >> 172.21.15.18:0/1197128623 conn(0x564978021310 msgr2=0x56497805ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:57.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.999+0000 7f4196ca7740 1 -- 172.21.15.18:0/1197128623 shutdown_connections 2024-09-19T09:57:57.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.999+0000 7f4196ca7740 1 -- 172.21.15.18:0/1197128623 wait complete. 2024-09-19T09:57:57.002 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:57:57.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:56.999+0000 7f4196ca7740 20 client.26407 trim_cache size 0 max 16384 2024-09-19T09:57:57.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.004+0000 7f418f59e640 1 -- 172.21.15.18:0/5381297 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41780a3310 msgr2=0x7f41780a57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:57.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.004+0000 7f418f59e640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41780a3310 0x7f41780a57d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4188009860 tx=0x7f4188009590 comp rx=0 tx=0).stop 2024-09-19T09:57:57.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.004+0000 7f418f59e640 1 -- 172.21.15.18:0/5381297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4190110190 msgr2=0x7f41901a7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:57.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.004+0000 7f418f59e640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4190110190 0x7f41901a7640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4184009fd0 tx=0x7f418400b870 comp rx=0 tx=0).stop 2024-09-19T09:57:57.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.005+0000 7f418f59e640 1 -- 172.21.15.18:0/5381297 shutdown_connections 2024-09-19T09:57:57.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.005+0000 7f418f59e640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f41780a3310 0x7f41780a57d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:57.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.005+0000 7f418f59e640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f419011b140 0x7f41901ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:57.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.005+0000 7f418f59e640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4190110190 0x7f41901a7640 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4184009fd0 tx=0x7f418400b870 comp rx=0 tx=0).stop 2024-09-19T09:57:57.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.005+0000 7f418f59e640 1 --2- 172.21.15.18:0/5381297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f419006ea30 0x7f41901a7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:57.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.005+0000 7f418f59e640 1 -- 172.21.15.18:0/5381297 >> 172.21.15.18:0/5381297 conn(0x7f4190073180 msgr2=0x7f4190119340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:57.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.005+0000 7f418f59e640 1 -- 172.21.15.18:0/5381297 shutdown_connections 2024-09-19T09:57:57.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:57.005+0000 7f418f59e640 1 -- 172.21.15.18:0/5381297 wait complete. 2024-09-19T09:57:57.913 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:57:58.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:57 smithi018 ceph-mon[30956]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 270 MiB/s wr, 1.63k op/s 2024-09-19T09:57:58.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:57 smithi049 ceph-mon[34858]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 270 MiB/s wr, 1.63k op/s 2024-09-19T09:57:58.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:57 smithi162 ceph-mon[35174]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 270 MiB/s wr, 1.63k op/s 2024-09-19T09:57:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:57:59.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.613+0000 7f4372d85640 1 -- 172.21.15.18:0/1476026425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4364093c60 msgr2=0x7f43640940c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:59.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.613+0000 7f4372d85640 1 --2- 172.21.15.18:0/1476026425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4364093c60 0x7f43640940c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4368009890 tx=0x7f436802a390 comp rx=0 tx=0).stop 2024-09-19T09:57:59.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.614+0000 7f4372d85640 1 -- 172.21.15.18:0/1476026425 shutdown_connections 2024-09-19T09:57:59.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.614+0000 7f4372d85640 1 --2- 172.21.15.18:0/1476026425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4364094600 0x7f43640a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.614+0000 7f4372d85640 1 --2- 172.21.15.18:0/1476026425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4364093c60 0x7f43640940c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.614+0000 7f4372d85640 1 --2- 172.21.15.18:0/1476026425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43640997b0 0x7f4364099b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.614+0000 7f4372d85640 1 -- 172.21.15.18:0/1476026425 >> 172.21.15.18:0/1476026425 conn(0x7f4364009520 msgr2=0x7f4364009930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:59.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.615+0000 7f4372d85640 1 -- 172.21.15.18:0/1476026425 shutdown_connections 2024-09-19T09:57:59.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.619+0000 7f4372d85640 1 -- 172.21.15.18:0/1476026425 wait complete. 2024-09-19T09:57:59.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.620+0000 7f4372d85640 1 Processor -- start 2024-09-19T09:57:59.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.620+0000 7f4372d85640 1 -- start start 2024-09-19T09:57:59.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.621+0000 7f4372d85640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4364093c60 0x7f436412f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.622+0000 7f4372d85640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4364094600 0x7f436412fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.622+0000 7f4372d85640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43640997b0 0x7f4364129a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.622+0000 7f4372d85640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43640a3770 con 0x7f4364094600 2024-09-19T09:57:59.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.622+0000 7f4371d83640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4364093c60 0x7f436412f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.622+0000 7f4371d83640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4364093c60 0x7f436412f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54252/0 (socket says 172.21.15.18:54252) 2024-09-19T09:57:59.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.623+0000 7f4371d83640 1 -- 172.21.15.18:0/4073510451 learned_addr learned my addr 172.21.15.18:0/4073510451 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:59.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.623+0000 7f4372584640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43640997b0 0x7f4364129a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.623+0000 7f4372d85640 1 -- 172.21.15.18:0/4073510451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f43640a35f0 con 0x7f43640997b0 2024-09-19T09:57:59.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.623+0000 7f4372d85640 1 -- 172.21.15.18:0/4073510451 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43640a38f0 con 0x7f4364093c60 2024-09-19T09:57:59.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.624+0000 7f4371d83640 1 -- 172.21.15.18:0/4073510451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43640997b0 msgr2=0x7f4364129a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:59.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.624+0000 7f4371d83640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43640997b0 0x7f4364129a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.624+0000 7f4371d83640 1 -- 172.21.15.18:0/4073510451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4364094600 msgr2=0x7f436412fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:59.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.624+0000 7f4371d83640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4364094600 0x7f436412fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.624+0000 7f4371d83640 1 -- 172.21.15.18:0/4073510451 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436412a170 con 0x7f4364093c60 2024-09-19T09:57:59.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.625+0000 7f4371d83640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4364093c60 0x7f436412f880 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f436c051220 tx=0x7f436c07c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:59.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.632+0000 7f4362ffd640 1 -- 172.21.15.18:0/4073510451 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c074830 con 0x7f4364093c60 2024-09-19T09:57:59.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.632+0000 7f4362ffd640 1 -- 172.21.15.18:0/4073510451 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f436c06ba30 con 0x7f4364093c60 2024-09-19T09:57:59.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.632+0000 7f4362ffd640 1 -- 172.21.15.18:0/4073510451 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c085e10 con 0x7f4364093c60 2024-09-19T09:57:59.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.632+0000 7f4372d85640 1 -- 172.21.15.18:0/4073510451 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f436412a460 con 0x7f4364093c60 2024-09-19T09:57:59.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.632+0000 7f4372d85640 1 -- 172.21.15.18:0/4073510451 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4364136750 con 0x7f4364093c60 2024-09-19T09:57:59.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.639+0000 7f43763c0740 1 Processor -- start 2024-09-19T09:57:59.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.639+0000 7f43763c0740 1 -- start start 2024-09-19T09:57:59.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.640+0000 7f43763c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc647f0 0x555f3cc62d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.640+0000 7f43763c0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.640+0000 7f43763c0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc70410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.640+0000 7f43763c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555f3cbc02f0 con 0x555f3cc647f0 2024-09-19T09:57:59.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.640+0000 7f43763c0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555f3cb67cf0 con 0x555f3cc6e020 2024-09-19T09:57:59.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.640+0000 7f43763c0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555f3cbbc2b0 con 0x555f3cc63280 2024-09-19T09:57:59.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.642+0000 7f4372584640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc647f0 0x555f3cc62d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.642+0000 7f4372584640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc647f0 0x555f3cc62d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57838/0 (socket says 172.21.15.18:57838) 2024-09-19T09:57:59.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.643+0000 7f4372584640 1 -- 172.21.15.18:0/1278382983 learned_addr learned my addr 172.21.15.18:0/1278382983 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:59.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.646+0000 7f4371582640 1 --2- 172.21.15.18:0/1278382983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc70410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.646+0000 7f4362ffd640 1 -- 172.21.15.18:0/4073510451 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f436c0853e0 con 0x7f4364093c60 2024-09-19T09:57:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.648+0000 7f4362ffd640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43580a33e0 0x7f43580a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.649+0000 7f4372584640 1 -- 172.21.15.18:0/1278382983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 msgr2=0x555f3cc636c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:57:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.649+0000 7f4372584640 1 --2- 172.21.15.18:0/1278382983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc636c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.649+0000 7f4372584640 1 -- 172.21.15.18:0/1278382983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 msgr2=0x555f3cc70410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.649+0000 7f4372584640 1 --2- 172.21.15.18:0/1278382983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc70410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.649+0000 7f4372584640 1 -- 172.21.15.18:0/1278382983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3cb4c3a0 con 0x555f3cc647f0 2024-09-19T09:57:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.650+0000 7f4362ffd640 1 -- 172.21.15.18:0/4073510451 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f436c0fea00 con 0x7f4364093c60 2024-09-19T09:57:59.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.651+0000 7f4372584640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43580a33e0 0x7f43580a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.652+0000 7f4372584640 1 --2- 172.21.15.18:0/1278382983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc647f0 0x555f3cc62d40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f435c009ca0 tx=0x7f435c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6aca40fe5df0951 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:59.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.653+0000 7f4372584640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43580a33e0 0x7f43580a58a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f435c011d10 tx=0x7f435c01b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.654+0000 7f43577fe640 1 -- 172.21.15.18:0/1278382983 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c00e710 con 0x555f3cc647f0 2024-09-19T09:57:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.654+0000 7f43577fe640 1 -- 172.21.15.18:0/1278382983 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f435c00ed90 con 0x555f3cc647f0 2024-09-19T09:57:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.655+0000 7f43763c0740 1 -- 172.21.15.18:0/1278382983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc647f0 msgr2=0x555f3cc62d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.655+0000 7f43763c0740 1 --2- 172.21.15.18:0/1278382983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc647f0 0x555f3cc62d40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f435c009ca0 tx=0x7f435c011810 comp rx=0 tx=0).stop 2024-09-19T09:57:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.656+0000 7f43763c0740 1 -- 172.21.15.18:0/1278382983 shutdown_connections 2024-09-19T09:57:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.656+0000 7f43763c0740 1 --2- 172.21.15.18:0/1278382983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc70410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.656+0000 7f43763c0740 1 --2- 172.21.15.18:0/1278382983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.656+0000 7f43763c0740 1 --2- 172.21.15.18:0/1278382983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc647f0 0x555f3cc62d40 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.656+0000 7f43763c0740 1 -- 172.21.15.18:0/1278382983 >> 172.21.15.18:0/1278382983 conn(0x555f3cc23310 msgr2=0x555f3cc5f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.656+0000 7f43763c0740 1 -- 172.21.15.18:0/1278382983 shutdown_connections 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.656+0000 7f43763c0740 1 -- 172.21.15.18:0/1278382983 wait complete. 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.657+0000 7f43763c0740 1 -- start start 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.657+0000 7f43763c0740 1 Processor -- start 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.658+0000 7f43763c0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc63280 0x555f3cc6d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.658+0000 7f43763c0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc6e020 0x555f3cc6a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.658+0000 7f43763c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc6b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.658+0000 7f43763c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555f3cc81ca0 con 0x555f3cc6ae30 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.658+0000 7f43763c0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555f3cb7b060 con 0x555f3cc63280 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.658+0000 7f43763c0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555f3cc81e20 con 0x555f3cc6e020 2024-09-19T09:57:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.658+0000 7f43763c0740 10 client.0 _ll_register_callbacks cb 0x555f3c8ce8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:59.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.660+0000 7f4371582640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc6e020 0x555f3cc6a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.660+0000 7f4371582640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc6e020 0x555f3cc6a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54264/0 (socket says 172.21.15.18:54264) 2024-09-19T09:57:59.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.660+0000 7f4371582640 1 -- 172.21.15.18:0/3106773492 learned_addr learned my addr 172.21.15.18:0/3106773492 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:59.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.660+0000 7f4372584640 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc6b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.661+0000 7f4371d83640 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc63280 0x555f3cc6d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.662+0000 7f4371582640 1 -- 172.21.15.18:0/3106773492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc63280 msgr2=0x555f3cc6d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:59.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.662+0000 7f4371582640 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc63280 0x555f3cc6d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.663+0000 7f4371582640 1 -- 172.21.15.18:0/3106773492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 msgr2=0x555f3cc6b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:59.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.663+0000 7f4371582640 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc6b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.663+0000 7f4371582640 1 -- 172.21.15.18:0/3106773492 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3c9313c0 con 0x555f3cc6e020 2024-09-19T09:57:59.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.665+0000 7f4371582640 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc6e020 0x555f3cc6a8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4368035040 tx=0x7f43680305f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f8d346360a07147 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:59.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.667+0000 7f43557fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:57:59.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.667+0000 7f43557fa640 1 -- 172.21.15.18:0/3106773492 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368037040 con 0x555f3cc6e020 2024-09-19T09:57:59.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.668+0000 7f43763c0740 1 -- 172.21.15.18:0/3106773492 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555f3cbcd860 con 0x555f3cc6e020 2024-09-19T09:57:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.669+0000 7f43557fa640 1 -- 172.21.15.18:0/3106773492 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4368030960 con 0x555f3cc6e020 2024-09-19T09:57:59.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.673+0000 7f43557fa640 1 -- 172.21.15.18:0/3106773492 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4368004030 con 0x555f3cc6e020 2024-09-19T09:57:59.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.673+0000 7f43763c0740 10 client.26416 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:59.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.674+0000 7f43763c0740 1 -- 172.21.15.18:0/3106773492 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555f3cc8d870 con 0x555f3cc6e020 2024-09-19T09:57:59.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.676+0000 7f43557fa640 1 -- 172.21.15.18:0/3106773492 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555f3cbcd860 con 0x555f3cc6e020 2024-09-19T09:57:59.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.677+0000 7f43557fa640 1 -- 172.21.15.18:0/3106773492 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4368004930 con 0x555f3cc6e020 2024-09-19T09:57:59.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.677+0000 7f43763c0740 10 client.26416 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:59.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.677+0000 7f43763c0740 10 client.26416 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:57:59.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.677+0000 7f43763c0740 20 client.26416 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:59.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.677+0000 7f43763c0740 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x555f3cc8f0d0 0x555f3cc91550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.677+0000 7f43763c0740 4 client.26416 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:57:59.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.677+0000 7f43763c0740 1 -- 172.21.15.18:0/3106773492 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f3cbc7d70 con 0x555f3cc8f0d0 2024-09-19T09:57:59.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.681+0000 7f4371d83640 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x555f3cc8f0d0 0x555f3cc91550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.689+0000 7f4371d83640 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x555f3cc8f0d0 0x555f3cc91550 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6fc8ee7e22212554 server_cookie=3eba3de16f810b53 in_seq=0 out_seq=0 2024-09-19T09:57:59.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.689+0000 7f43557fa640 10 client.26416 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:57:59.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.693+0000 7f43557fa640 1 -- 172.21.15.18:0/3106773492 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f3cbc7d70 con 0x555f3cc8f0d0 2024-09-19T09:57:59.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.693+0000 7f43557fa640 10 client.26416 handle_command_reply: tid=0 2024-09-19T09:57:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.693+0000 7f43763c0740 1 client.26416 shutdown 2024-09-19T09:57:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.693+0000 7f43763c0740 1 -- 172.21.15.18:0/3106773492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc6e020 msgr2=0x555f3cc6a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.693+0000 7f43763c0740 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc6e020 0x555f3cc6a8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4368035040 tx=0x7f43680305f0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.693+0000 7f43763c0740 1 -- 172.21.15.18:0/3106773492 shutdown_connections 2024-09-19T09:57:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.693+0000 7f43763c0740 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x555f3cc8f0d0 0x555f3cc91550 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.693+0000 7f43763c0740 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc6b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.694+0000 7f43763c0740 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc6e020 0x555f3cc6a8f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.694+0000 7f43763c0740 1 --2- 172.21.15.18:0/3106773492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc63280 0x555f3cc6d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.694+0000 7f43763c0740 1 -- 172.21.15.18:0/3106773492 >> 172.21.15.18:0/3106773492 conn(0x555f3cc23310 msgr2=0x555f3cc56300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.694+0000 7f43557fa640 0 client.26416 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:57:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.694+0000 7f43763c0740 1 -- 172.21.15.18:0/3106773492 shutdown_connections 2024-09-19T09:57:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.694+0000 7f43763c0740 1 -- 172.21.15.18:0/3106773492 wait complete. 2024-09-19T09:57:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.694+0000 7f43763c0740 20 client.26416 trim_cache size 0 max 16384 2024-09-19T09:57:59.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.747+0000 7f43763c0740 1 Processor -- start 2024-09-19T09:57:59.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.748+0000 7f43763c0740 1 -- start start 2024-09-19T09:57:59.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.749+0000 7f43763c0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc65dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.749+0000 7f43763c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc96e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.750+0000 7f4371d83640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc65dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.750+0000 7f4371d83640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc65dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54280/0 (socket says 172.21.15.18:54280) 2024-09-19T09:57:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.750+0000 7f4371d83640 1 -- 172.21.15.18:0/2930898377 learned_addr learned my addr 172.21.15.18:0/2930898377 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.750+0000 7f43763c0740 1 --2- 172.21.15.18:0/2930898377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc973a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.750+0000 7f43763c0740 1 -- 172.21.15.18:0/2930898377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f436413edb0 con 0x555f3cc6ae30 2024-09-19T09:57:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.750+0000 7f43763c0740 1 -- 172.21.15.18:0/2930898377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f43641408f0 con 0x555f3cc6e020 2024-09-19T09:57:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.750+0000 7f43763c0740 1 -- 172.21.15.18:0/2930898377 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f436413f480 con 0x555f3cc63280 2024-09-19T09:57:59.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.751+0000 7f4371582640 1 --2- 172.21.15.18:0/2930898377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc96e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.752+0000 7f4371d83640 1 -- 172.21.15.18:0/2930898377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 msgr2=0x555f3cc973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:59.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.752+0000 7f4371d83640 1 --2- 172.21.15.18:0/2930898377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.752+0000 7f4371d83640 1 -- 172.21.15.18:0/2930898377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 msgr2=0x555f3cc96e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:59.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.752+0000 7f4371d83640 1 --2- 172.21.15.18:0/2930898377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc96e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.752+0000 7f4371d83640 1 -- 172.21.15.18:0/2930898377 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3cc30bf0 con 0x555f3cc63280 2024-09-19T09:57:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.753+0000 7f4371d83640 1 --2- 172.21.15.18:0/2930898377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc65dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f436c0fdbe0 tx=0x7f436c108020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3177c99498c7f877 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:59.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.754+0000 7f4356ffd640 1 -- 172.21.15.18:0/2930898377 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c0fd390 con 0x555f3cc63280 2024-09-19T09:57:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.754+0000 7f4356ffd640 1 -- 172.21.15.18:0/2930898377 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f436c100730 con 0x555f3cc63280 2024-09-19T09:57:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.754+0000 7f4356ffd640 1 -- 172.21.15.18:0/2930898377 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c0fd530 con 0x555f3cc63280 2024-09-19T09:57:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.756+0000 7f43763c0740 1 -- 172.21.15.18:0/2930898377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 msgr2=0x555f3cc65dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.756+0000 7f43763c0740 1 --2- 172.21.15.18:0/2930898377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc65dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f436c0fdbe0 tx=0x7f436c108020 comp rx=0 tx=0).stop 2024-09-19T09:57:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.756+0000 7f43763c0740 1 -- 172.21.15.18:0/2930898377 shutdown_connections 2024-09-19T09:57:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.756+0000 7f43763c0740 1 --2- 172.21.15.18:0/2930898377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.756+0000 7f43763c0740 1 --2- 172.21.15.18:0/2930898377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc96e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.756+0000 7f43763c0740 1 --2- 172.21.15.18:0/2930898377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc65dd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.756+0000 7f43763c0740 1 -- 172.21.15.18:0/2930898377 >> 172.21.15.18:0/2930898377 conn(0x555f3cc23310 msgr2=0x555f3cc56300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:59.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.757+0000 7f43763c0740 1 -- 172.21.15.18:0/2930898377 shutdown_connections 2024-09-19T09:57:59.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.757+0000 7f43763c0740 1 -- 172.21.15.18:0/2930898377 wait complete. 2024-09-19T09:57:59.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.758+0000 7f43763c0740 1 -- start start 2024-09-19T09:57:59.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.763+0000 7f43763c0740 1 Processor -- start 2024-09-19T09:57:59.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.765+0000 7f43763c0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc87650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.765+0000 7f43763c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc67430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.765+0000 7f43763c0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc67970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.766+0000 7f43763c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4364140220 con 0x555f3cc6ae30 2024-09-19T09:57:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.766+0000 7f43763c0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f436413fb50 con 0x555f3cc6e020 2024-09-19T09:57:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.766+0000 7f43763c0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f436413cd90 con 0x555f3cc63280 2024-09-19T09:57:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.766+0000 7f43763c0740 10 client.0 _ll_register_callbacks cb 0x7f4368035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:57:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.766+0000 7f4372584640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc67970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.766+0000 7f4372584640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc67970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37562/0 (socket says 172.21.15.18:37562) 2024-09-19T09:57:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.767+0000 7f4372584640 1 -- 172.21.15.18:0/2496076979 learned_addr learned my addr 172.21.15.18:0/2496076979 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:57:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.767+0000 7f4371d83640 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc87650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.773+0000 7f4371582640 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc67430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.775+0000 7f4371d83640 1 -- 172.21.15.18:0/2496076979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 msgr2=0x555f3cc67970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:59.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.775+0000 7f4371d83640 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc67970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.775+0000 7f4371d83640 1 -- 172.21.15.18:0/2496076979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 msgr2=0x555f3cc67430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:57:59.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.775+0000 7f4371d83640 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc67430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.775+0000 7f4371d83640 1 -- 172.21.15.18:0/2496076979 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3cc67f60 con 0x555f3cc63280 2024-09-19T09:57:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.778+0000 7f4371d83640 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc87650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f436c0fdbe0 tx=0x7f436c067fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8594a60b2df1f4be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:57:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.778+0000 7f43557fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:57:59.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.779+0000 7f43557fa640 1 -- 172.21.15.18:0/2496076979 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c0fd6d0 con 0x555f3cc63280 2024-09-19T09:57:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.779+0000 7f43557fa640 1 -- 172.21.15.18:0/2496076979 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f436c109300 con 0x555f3cc63280 2024-09-19T09:57:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.779+0000 7f43763c0740 1 -- 172.21.15.18:0/2496076979 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f436c100730 con 0x555f3cc63280 2024-09-19T09:57:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.781+0000 7f43557fa640 1 -- 172.21.15.18:0/2496076979 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f436c072070 con 0x555f3cc63280 2024-09-19T09:57:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.781+0000 7f43763c0740 10 client.26422 fetch_fsmap learned FSMap version 28 2024-09-19T09:57:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.781+0000 7f43763c0740 1 -- 172.21.15.18:0/2496076979 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555f3ccf9c30 con 0x555f3cc63280 2024-09-19T09:57:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.782+0000 7f43557fa640 1 -- 172.21.15.18:0/2496076979 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f436c11d040 con 0x555f3cc63280 2024-09-19T09:57:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.786+0000 7f43557fa640 1 -- 172.21.15.18:0/2496076979 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f436c07a040 con 0x555f3cc63280 2024-09-19T09:57:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.786+0000 7f43763c0740 10 client.26422 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:57:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.787+0000 7f43763c0740 10 client.26422 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:57:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.787+0000 7f43763c0740 20 client.26422 populate_metadata read hostname 'smithi018' 2024-09-19T09:57:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.787+0000 7f43763c0740 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x555f3ccfa2f0 0x555f3ccfc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:57:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.788+0000 7f43763c0740 4 client.26422 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:57:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.788+0000 7f43763c0740 1 -- 172.21.15.18:0/2496076979 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f436c100730 con 0x555f3ccfa2f0 2024-09-19T09:57:59.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.791+0000 7f4371582640 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x555f3ccfa2f0 0x555f3ccfc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:57:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.795+0000 7f4371582640 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x555f3ccfa2f0 0x555f3ccfc6e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=962eaa1d4a8caa9f server_cookie=e9c1d45ac1b57392 in_seq=0 out_seq=0 2024-09-19T09:57:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.795+0000 7f43557fa640 10 client.26422 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:57:59.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.796+0000 7f43557fa640 1 -- 172.21.15.18:0/2496076979 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f436c100730 con 0x555f3ccfa2f0 2024-09-19T09:57:59.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.796+0000 7f43557fa640 10 client.26422 handle_command_reply: tid=0 2024-09-19T09:57:59.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.796+0000 7f43763c0740 1 client.26422 shutdown 2024-09-19T09:57:59.801 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.797+0000 7f43763c0740 1 -- 172.21.15.18:0/2496076979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 msgr2=0x555f3cc87650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.797+0000 7f43763c0740 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc87650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f436c0fdbe0 tx=0x7f436c067fe0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.797+0000 7f43763c0740 1 -- 172.21.15.18:0/2496076979 shutdown_connections 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.797+0000 7f43763c0740 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x555f3ccfa2f0 0x555f3ccfc6e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.797+0000 7f43763c0740 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f3cc6e020 0x555f3cc67970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.797+0000 7f43763c0740 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f3cc6ae30 0x555f3cc67430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.797+0000 7f43763c0740 1 --2- 172.21.15.18:0/2496076979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3cc63280 0x555f3cc87650 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.797+0000 7f43763c0740 1 -- 172.21.15.18:0/2496076979 >> 172.21.15.18:0/2496076979 conn(0x555f3cc23310 msgr2=0x555f3cc6c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.798+0000 7f43557fa640 0 client.26422 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.798+0000 7f43763c0740 1 -- 172.21.15.18:0/2496076979 shutdown_connections 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.798+0000 7f43763c0740 1 -- 172.21.15.18:0/2496076979 wait complete. 2024-09-19T09:57:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.798+0000 7f43763c0740 20 client.26422 trim_cache size 0 max 16384 2024-09-19T09:57:59.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.801+0000 7f4360ff9640 1 -- 172.21.15.18:0/4073510451 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43580a33e0 msgr2=0x7f43580a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:59.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.801+0000 7f4360ff9640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43580a33e0 0x7f43580a58a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f435c011d10 tx=0x7f435c01b000 comp rx=0 tx=0).stop 2024-09-19T09:57:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.801+0000 7f4360ff9640 1 -- 172.21.15.18:0/4073510451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4364093c60 msgr2=0x7f436412f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:57:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.801+0000 7f4360ff9640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4364093c60 0x7f436412f880 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f436c051220 tx=0x7f436c07c940 comp rx=0 tx=0).stop 2024-09-19T09:57:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.801+0000 7f4360ff9640 1 -- 172.21.15.18:0/4073510451 shutdown_connections 2024-09-19T09:57:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.802+0000 7f4360ff9640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f43580a33e0 0x7f43580a58a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.802+0000 7f4360ff9640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43640997b0 0x7f4364129a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.802+0000 7f4360ff9640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4364094600 0x7f436412fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.802+0000 7f4360ff9640 1 --2- 172.21.15.18:0/4073510451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4364093c60 0x7f436412f880 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:57:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.802+0000 7f4360ff9640 1 -- 172.21.15.18:0/4073510451 >> 172.21.15.18:0/4073510451 conn(0x7f4364009520 msgr2=0x7f4364091840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:57:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.802+0000 7f4360ff9640 1 -- 172.21.15.18:0/4073510451 shutdown_connections 2024-09-19T09:57:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:57:59.802+0000 7f4360ff9640 1 -- 172.21.15.18:0/4073510451 wait complete. 2024-09-19T09:57:59.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:57:59 smithi018 ceph-mon[30956]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 346 MiB/s wr, 1.91k op/s 2024-09-19T09:58:00.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:57:59 smithi049 ceph-mon[34858]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 346 MiB/s wr, 1.91k op/s 2024-09-19T09:58:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:57:59 smithi162 ceph-mon[35174]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 346 MiB/s wr, 1.91k op/s 2024-09-19T09:58:00.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:58:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:58:02.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:01 smithi018 ceph-mon[30956]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 459 MiB/s wr, 2.15k op/s 2024-09-19T09:58:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:01 smithi049 ceph-mon[34858]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 459 MiB/s wr, 2.15k op/s 2024-09-19T09:58:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:01 smithi162 ceph-mon[35174]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 459 MiB/s wr, 2.15k op/s 2024-09-19T09:58:03.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.257+0000 7fbf67de4640 1 -- 172.21.15.18:0/2019683163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf6011b140 msgr2=0x7fbf6011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.258+0000 7fbf67de4640 1 --2- 172.21.15.18:0/2019683163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf6011b140 0x7fbf6011d530 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009ca0 tx=0x7fbf5802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.260+0000 7fbf67de4640 1 -- 172.21.15.18:0/2019683163 shutdown_connections 2024-09-19T09:58:03.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.260+0000 7fbf67de4640 1 --2- 172.21.15.18:0/2019683163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf6011b140 0x7fbf6011d530 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.260+0000 7fbf67de4640 1 --2- 172.21.15.18:0/2019683163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf60109830 0x7fbf60109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.260+0000 7fbf67de4640 1 --2- 172.21.15.18:0/2019683163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf60109450 0x7fbf60110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.260+0000 7fbf67de4640 1 -- 172.21.15.18:0/2019683163 >> 172.21.15.18:0/2019683163 conn(0x7fbf6006e140 msgr2=0x7fbf6006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:03.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.261+0000 7fbf67de4640 1 -- 172.21.15.18:0/2019683163 shutdown_connections 2024-09-19T09:58:03.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.261+0000 7fbf67de4640 1 -- 172.21.15.18:0/2019683163 wait complete. 2024-09-19T09:58:03.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.262+0000 7fbf67de4640 1 Processor -- start 2024-09-19T09:58:03.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.262+0000 7fbf67de4640 1 -- start start 2024-09-19T09:58:03.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.263+0000 7fbf67de4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf60109450 0x7fbf601186b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.263+0000 7fbf67de4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf60109830 0x7fbf60118bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.263+0000 7fbf67de4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf6011b140 0x7fbf60111920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.263+0000 7fbf67de4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60120d50 con 0x7fbf6011b140 2024-09-19T09:58:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.263+0000 7fbf67de4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60120bd0 con 0x7fbf60109830 2024-09-19T09:58:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.263+0000 7fbf67de4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60120ed0 con 0x7fbf60109450 2024-09-19T09:58:03.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.266+0000 7fbf65b80640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf60109450 0x7fbf601186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.266+0000 7fbf6537f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf60109830 0x7fbf60118bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.267+0000 7fbf66381640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf6011b140 0x7fbf60111920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.267+0000 7fbf66381640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf6011b140 0x7fbf60111920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57888/0 (socket says 172.21.15.18:57888) 2024-09-19T09:58:03.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.267+0000 7fbf66381640 1 -- 172.21.15.18:0/2138736376 learned_addr learned my addr 172.21.15.18:0/2138736376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:03.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.270+0000 7fbf66381640 1 -- 172.21.15.18:0/2138736376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf60109450 msgr2=0x7fbf601186b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.270+0000 7fbf66381640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf60109450 0x7fbf601186b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.270+0000 7fbf66381640 1 -- 172.21.15.18:0/2138736376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf60109830 msgr2=0x7fbf60118bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.270+0000 7fbf66381640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf60109830 0x7fbf60118bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.270+0000 7fbf66381640 1 -- 172.21.15.18:0/2138736376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf601121e0 con 0x7fbf6011b140 2024-09-19T09:58:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.271+0000 7fbf66381640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf6011b140 0x7fbf60111920 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fbf5802ae50 tx=0x7fbf58003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.271+0000 7fbf5effd640 1 -- 172.21.15.18:0/2138736376 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58031ba0 con 0x7fbf6011b140 2024-09-19T09:58:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.271+0000 7fbf5effd640 1 -- 172.21.15.18:0/2138736376 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf5803f070 con 0x7fbf6011b140 2024-09-19T09:58:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.271+0000 7fbf67de4640 1 -- 172.21.15.18:0/2138736376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf60112470 con 0x7fbf6011b140 2024-09-19T09:58:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.272+0000 7fbf5effd640 1 -- 172.21.15.18:0/2138736376 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58004600 con 0x7fbf6011b140 2024-09-19T09:58:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.272+0000 7fbf67de4640 1 -- 172.21.15.18:0/2138736376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf601164c0 con 0x7fbf6011b140 2024-09-19T09:58:03.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.276+0000 7fbf6a1bd740 1 Processor -- start 2024-09-19T09:58:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.279+0000 7fbf6a1bd740 1 -- start start 2024-09-19T09:58:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.281+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 0x5579c57cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.281+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 0x5579c57cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.281+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c57d8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.281+0000 7fbf6a1bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5579c57312f0 con 0x5579c57cb5d0 2024-09-19T09:58:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.281+0000 7fbf6a1bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5579c56d8cf0 con 0x5579c57ccb40 2024-09-19T09:58:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.281+0000 7fbf6a1bd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5579c572d2b0 con 0x5579c57d6370 2024-09-19T09:58:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.279+0000 7fbf5effd640 1 -- 172.21.15.18:0/2138736376 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbf58030880 con 0x7fbf6011b140 2024-09-19T09:58:03.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.283+0000 7fbf65b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 0x5579c57cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.283+0000 7fbf5effd640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf480a3380 0x7fbf480a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.283+0000 7fbf65b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 0x5579c57cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57900/0 (socket says 172.21.15.18:57900) 2024-09-19T09:58:03.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.283+0000 7fbf65b80640 1 -- 172.21.15.18:0/443807646 learned_addr learned my addr 172.21.15.18:0/443807646 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:03.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.284+0000 7fbf5effd640 1 -- 172.21.15.18:0/2138736376 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbf580f0d90 con 0x7fbf6011b140 2024-09-19T09:58:03.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.285+0000 7fbf66381640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf480a3380 0x7fbf480a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.285+0000 7fbf6537f640 1 --2- 172.21.15.18:0/443807646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 0x5579c57cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.285+0000 7fbf6537f640 1 --2- 172.21.15.18:0/443807646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c57d8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.286+0000 7fbf65b80640 1 -- 172.21.15.18:0/443807646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 msgr2=0x5579c57d8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.286+0000 7fbf65b80640 1 --2- 172.21.15.18:0/443807646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c57d8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.286+0000 7fbf65b80640 1 -- 172.21.15.18:0/443807646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 msgr2=0x5579c57cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.286+0000 7fbf65b80640 1 --2- 172.21.15.18:0/443807646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 0x5579c57cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.286+0000 7fbf65b80640 1 -- 172.21.15.18:0/443807646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c56bd3a0 con 0x5579c57cb5d0 2024-09-19T09:58:03.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.288+0000 7fbf65b80640 1 --2- 172.21.15.18:0/443807646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 0x5579c57cba10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000bce0 tx=0x7fbf5000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d0d5fd17dfaeb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.289+0000 7fbf66381640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf480a3380 0x7fbf480a5840 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbf58004080 tx=0x7fbf58041000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.289+0000 7fbf47fff640 1 -- 172.21.15.18:0/443807646 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50015070 con 0x5579c57cb5d0 2024-09-19T09:58:03.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.289+0000 7fbf47fff640 1 -- 172.21.15.18:0/443807646 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf5001a940 con 0x5579c57cb5d0 2024-09-19T09:58:03.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.290+0000 7fbf47fff640 1 -- 172.21.15.18:0/443807646 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50011ae0 con 0x5579c57cb5d0 2024-09-19T09:58:03.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.291+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/443807646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 msgr2=0x5579c57cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.291+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/443807646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 0x5579c57cba10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000bce0 tx=0x7fbf5000f730 comp rx=0 tx=0).stop 2024-09-19T09:58:03.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.291+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/443807646 shutdown_connections 2024-09-19T09:58:03.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.292+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/443807646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c57d8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.292+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/443807646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 0x5579c57cba10 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.292+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/443807646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 0x5579c57cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.292+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/443807646 >> 172.21.15.18:0/443807646 conn(0x5579c5794310 msgr2=0x5579c57c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:03.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.292+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/443807646 shutdown_connections 2024-09-19T09:58:03.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.292+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/443807646 wait complete. 2024-09-19T09:58:03.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.293+0000 7fbf6a1bd740 1 -- start start 2024-09-19T09:58:03.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.293+0000 7fbf6a1bd740 1 Processor -- start 2024-09-19T09:58:03.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.294+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57cb5d0 0x5579c57d5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.295+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57d3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.296+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57d6370 0x5579c57d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.296+0000 7fbf65b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.296+0000 7fbf65b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57d3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57904/0 (socket says 172.21.15.18:57904) 2024-09-19T09:58:03.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.296+0000 7fbf6537f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57cb5d0 0x5579c57d5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.296+0000 7fbf65b80640 1 -- 172.21.15.18:0/1749806872 learned_addr learned my addr 172.21.15.18:0/1749806872 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:03.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.296+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5579c57d9070 con 0x5579c57ccb40 2024-09-19T09:58:03.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.297+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5579c56ec060 con 0x5579c57d6370 2024-09-19T09:58:03.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.297+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5579c57d91f0 con 0x5579c57cb5d0 2024-09-19T09:58:03.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.297+0000 7fbf6a1bd740 10 client.0 _ll_register_callbacks cb 0x5579c543f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:03.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.299+0000 7fbf65b80640 1 -- 172.21.15.18:0/1749806872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57cb5d0 msgr2=0x5579c57d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.299+0000 7fbf65b80640 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57cb5d0 0x5579c57d5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.299+0000 7fbf65b80640 1 -- 172.21.15.18:0/1749806872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57d6370 msgr2=0x5579c57d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.299+0000 7fbf65b80640 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57d6370 0x5579c57d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.299+0000 7fbf65b80640 1 -- 172.21.15.18:0/1749806872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579c54a23c0 con 0x5579c57ccb40 2024-09-19T09:58:03.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.302+0000 7fbf65b80640 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57d3050 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbf5001ad20 tx=0x7fbf5001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dbe7088ccace24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.302+0000 7fbf457fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:58:03.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.303+0000 7fbf457fa640 1 -- 172.21.15.18:0/1749806872 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50015070 con 0x5579c57ccb40 2024-09-19T09:58:03.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.303+0000 7fbf457fa640 1 -- 172.21.15.18:0/1749806872 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbf5001a670 con 0x5579c57ccb40 2024-09-19T09:58:03.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.303+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf5001a940 con 0x5579c57ccb40 2024-09-19T09:58:03.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.304+0000 7fbf457fa640 1 -- 172.21.15.18:0/1749806872 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf50005040 con 0x5579c57ccb40 2024-09-19T09:58:03.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.304+0000 7fbf6a1bd740 10 client.17034 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:03.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.305+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5579c57e4b30 con 0x5579c57ccb40 2024-09-19T09:58:03.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.306+0000 7fbf457fa640 1 -- 172.21.15.18:0/1749806872 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf50011760 con 0x5579c57ccb40 2024-09-19T09:58:03.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.306+0000 7fbf457fa640 1 -- 172.21.15.18:0/1749806872 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbf500046c0 con 0x5579c57ccb40 2024-09-19T09:58:03.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.308+0000 7fbf6a1bd740 10 client.17034 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:03.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.308+0000 7fbf6a1bd740 10 client.17034 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:03.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.308+0000 7fbf6a1bd740 20 client.17034 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:03.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.308+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5579c57e5e80 0x5579c57e8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.308+0000 7fbf6a1bd740 4 client.17034 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:58:03.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.308+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbf5001a940 con 0x5579c57e5e80 2024-09-19T09:58:03.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.310+0000 7fbf6537f640 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5579c57e5e80 0x5579c57e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.329+0000 7fbf6537f640 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5579c57e5e80 0x5579c57e8270 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ec34fb6b640c5a4 server_cookie=51cf10e51b816bb5 in_seq=0 out_seq=0 2024-09-19T09:58:03.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.329+0000 7fbf457fa640 10 client.17034 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:03.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.335+0000 7fbf457fa640 1 -- 172.21.15.18:0/1749806872 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fbf5001a940 con 0x5579c57e5e80 2024-09-19T09:58:03.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.335+0000 7fbf457fa640 10 client.17034 handle_command_reply: tid=0 2024-09-19T09:58:03.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.335+0000 7fbf6a1bd740 1 client.17034 shutdown 2024-09-19T09:58:03.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.338+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 msgr2=0x5579c57d3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.338+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57d3050 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbf5001ad20 tx=0x7fbf5001ad50 comp rx=0 tx=0).stop 2024-09-19T09:58:03.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.338+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 shutdown_connections 2024-09-19T09:58:03.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.338+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5579c57e5e80 0x5579c57e8270 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.338+0000 7fbf457fa640 0 client.17034 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:03.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.338+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57d6370 0x5579c57d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.338+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57d3050 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.339+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/1749806872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57cb5d0 0x5579c57d5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.339+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 >> 172.21.15.18:0/1749806872 conn(0x5579c5794310 msgr2=0x5579c57cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:03.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.339+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 shutdown_connections 2024-09-19T09:58:03.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.339+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1749806872 wait complete. 2024-09-19T09:58:03.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.340+0000 7fbf6a1bd740 20 client.17034 trim_cache size 0 max 16384 2024-09-19T09:58:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.407+0000 7fbf6a1bd740 1 Processor -- start 2024-09-19T09:58:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.408+0000 7fbf6a1bd740 1 -- start start 2024-09-19T09:58:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.409+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57cb5d0 0x5579c57d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.409+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.409+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c57ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.409+0000 7fbf6a1bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf601b3b70 con 0x5579c57ccb40 2024-09-19T09:58:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.409+0000 7fbf6a1bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbf601b56b0 con 0x5579c57cb5d0 2024-09-19T09:58:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.409+0000 7fbf6a1bd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbf601b4240 con 0x5579c57d6370 2024-09-19T09:58:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.418+0000 7fbf65b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.418+0000 7fbf65b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57906/0 (socket says 172.21.15.18:57906) 2024-09-19T09:58:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.418+0000 7fbf65b80640 1 -- 172.21.15.18:0/1590405009 learned_addr learned my addr 172.21.15.18:0/1590405009 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.418+0000 7fbf6537f640 1 --2- 172.21.15.18:0/1590405009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c57ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.418+0000 7fbf6537f640 1 --2- 172.21.15.18:0/1590405009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57cb5d0 0x5579c57d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.423+0000 7fbf6537f640 1 -- 172.21.15.18:0/1590405009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57cb5d0 msgr2=0x5579c57d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.423+0000 7fbf6537f640 1 --2- 172.21.15.18:0/1590405009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57cb5d0 0x5579c57d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.423+0000 7fbf6537f640 1 -- 172.21.15.18:0/1590405009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 msgr2=0x5579c57ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.423+0000 7fbf6537f640 1 --2- 172.21.15.18:0/1590405009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.423+0000 7fbf6537f640 1 -- 172.21.15.18:0/1590405009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c57d3b50 con 0x5579c57d6370 2024-09-19T09:58:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.427+0000 7fbf6537f640 1 --2- 172.21.15.18:0/1590405009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c57ce660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5579c57d9220 tx=0x7fbf54009860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15631a3765105222 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.430+0000 7fbf477fe640 1 -- 172.21.15.18:0/1590405009 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54005030 con 0x5579c57d6370 2024-09-19T09:58:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.430+0000 7fbf477fe640 1 -- 172.21.15.18:0/1590405009 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf54004730 con 0x5579c57d6370 2024-09-19T09:58:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.431+0000 7fbf477fe640 1 -- 172.21.15.18:0/1590405009 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5401e690 con 0x5579c57d6370 2024-09-19T09:58:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.435+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1590405009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 msgr2=0x5579c57ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.435+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/1590405009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c57ce660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5579c57d9220 tx=0x7fbf54009860 comp rx=0 tx=0).stop 2024-09-19T09:58:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.436+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1590405009 shutdown_connections 2024-09-19T09:58:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.436+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/1590405009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c57ce660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.436+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/1590405009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57ccb40 0x5579c57ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.436+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/1590405009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57cb5d0 0x5579c57d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.436+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1590405009 >> 172.21.15.18:0/1590405009 conn(0x5579c5794310 msgr2=0x5579c57d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.440+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1590405009 shutdown_connections 2024-09-19T09:58:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.440+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/1590405009 wait complete. 2024-09-19T09:58:03.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.441+0000 7fbf6a1bd740 1 -- start start 2024-09-19T09:58:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.441+0000 7fbf6a1bd740 1 Processor -- start 2024-09-19T09:58:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.442+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 0x5579c57e89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.442+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 0x5579c57e8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.443+0000 7fbf6a1bd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c58487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.443+0000 7fbf6a1bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf601b4fe0 con 0x5579c57cb5d0 2024-09-19T09:58:03.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.443+0000 7fbf6a1bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbf601b4910 con 0x5579c57ccb40 2024-09-19T09:58:03.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.443+0000 7fbf6a1bd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbf601b1b50 con 0x5579c57d6370 2024-09-19T09:58:03.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.443+0000 7fbf6a1bd740 10 client.0 _ll_register_callbacks cb 0x7fbf5000bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:03.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.443+0000 7fbf6537f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c58487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.446+0000 7fbf6537f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c58487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54336/0 (socket says 172.21.15.18:54336) 2024-09-19T09:58:03.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.446+0000 7fbf6537f640 1 -- 172.21.15.18:0/3725517077 learned_addr learned my addr 172.21.15.18:0/3725517077 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:03.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.446+0000 7fbf6537f640 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 0x5579c57e89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.447+0000 7fbf65b80640 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 0x5579c57e8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.448+0000 7fbf6537f640 1 -- 172.21.15.18:0/3725517077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 msgr2=0x5579c57e8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.448+0000 7fbf6537f640 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 0x5579c57e8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.448+0000 7fbf6537f640 1 -- 172.21.15.18:0/3725517077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 msgr2=0x5579c57e89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.448+0000 7fbf6537f640 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 0x5579c57e89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.448+0000 7fbf6537f640 1 -- 172.21.15.18:0/3725517077 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579c5848e30 con 0x5579c57d6370 2024-09-19T09:58:03.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.449+0000 7fbf65b80640 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 0x5579c57e8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:58:03.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.451+0000 7fbf6537f640 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c58487f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005d80 tx=0x7fbf540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bbefeaac18989bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.452+0000 7fbf457fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:58:03.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.456+0000 7fbf457fa640 1 -- 172.21.15.18:0/3725517077 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54033040 con 0x5579c57d6370 2024-09-19T09:58:03.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.456+0000 7fbf457fa640 1 -- 172.21.15.18:0/3725517077 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbf54004ae0 con 0x5579c57d6370 2024-09-19T09:58:03.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.456+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/3725517077 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf54004730 con 0x5579c57d6370 2024-09-19T09:58:03.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.459+0000 7fbf457fa640 1 -- 172.21.15.18:0/3725517077 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf5403f050 con 0x5579c57d6370 2024-09-19T09:58:03.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.459+0000 7fbf6a1bd740 10 client.26437 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:03.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.459+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/3725517077 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5579c5850180 con 0x5579c57d6370 2024-09-19T09:58:03.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.461+0000 7fbf457fa640 1 -- 172.21.15.18:0/3725517077 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf54004d20 con 0x5579c57d6370 2024-09-19T09:58:03.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.461+0000 7fbf457fa640 1 -- 172.21.15.18:0/3725517077 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbf54029740 con 0x5579c57d6370 2024-09-19T09:58:03.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.463+0000 7fbf6a1bd740 10 client.26437 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:03.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.463+0000 7fbf6a1bd740 10 client.26437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:03.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.463+0000 7fbf6a1bd740 20 client.26437 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:03.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.463+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5579c57e5e80 0x5579c58526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.463+0000 7fbf6a1bd740 4 client.26437 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:58:03.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.463+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/3725517077 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbf54004730 con 0x5579c57e5e80 2024-09-19T09:58:03.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.463+0000 7fbf65b80640 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5579c57e5e80 0x5579c58526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.465+0000 7fbf65b80640 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5579c57e5e80 0x5579c58526f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=237dd364a58c3041 server_cookie=2ad238fe73ef644a in_seq=0 out_seq=0 2024-09-19T09:58:03.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.465+0000 7fbf457fa640 10 client.26437 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:03.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.467+0000 7fbf457fa640 1 -- 172.21.15.18:0/3725517077 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbf54004730 con 0x5579c57e5e80 2024-09-19T09:58:03.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.467+0000 7fbf457fa640 10 client.26437 handle_command_reply: tid=0 2024-09-19T09:58:03.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.470+0000 7fbf6a1bd740 1 client.26437 shutdown 2024-09-19T09:58:03.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.470+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/3725517077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 msgr2=0x5579c58487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.470+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c58487f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005d80 tx=0x7fbf540046c0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.472+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/3725517077 shutdown_connections 2024-09-19T09:58:03.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.472+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5579c57e5e80 0x5579c58526f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.472+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579c57d6370 0x5579c58487f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.472+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5579c57ccb40 0x5579c57e8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.472+0000 7fbf6a1bd740 1 --2- 172.21.15.18:0/3725517077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5579c57cb5d0 0x5579c57e89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.472+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/3725517077 >> 172.21.15.18:0/3725517077 conn(0x5579c5794310 msgr2=0x5579c57e1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:03.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.472+0000 7fbf457fa640 0 client.26437 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:03.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.472+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/3725517077 shutdown_connections 2024-09-19T09:58:03.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.472+0000 7fbf6a1bd740 1 -- 172.21.15.18:0/3725517077 wait complete. 2024-09-19T09:58:03.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.473+0000 7fbf6a1bd740 20 client.26437 trim_cache size 0 max 16384 2024-09-19T09:58:03.476 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:58:03.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.476+0000 7fbf67de4640 1 -- 172.21.15.18:0/2138736376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf480a3380 msgr2=0x7fbf480a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.476+0000 7fbf67de4640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf480a3380 0x7fbf480a5840 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbf58004080 tx=0x7fbf58041000 comp rx=0 tx=0).stop 2024-09-19T09:58:03.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.476+0000 7fbf67de4640 1 -- 172.21.15.18:0/2138736376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf6011b140 msgr2=0x7fbf60111920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.476+0000 7fbf67de4640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf6011b140 0x7fbf60111920 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fbf5802ae50 tx=0x7fbf58003f10 comp rx=0 tx=0).stop 2024-09-19T09:58:03.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.476+0000 7fbf67de4640 1 -- 172.21.15.18:0/2138736376 shutdown_connections 2024-09-19T09:58:03.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.476+0000 7fbf67de4640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbf480a3380 0x7fbf480a5840 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.477+0000 7fbf67de4640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf6011b140 0x7fbf60111920 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.477+0000 7fbf67de4640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf60109830 0x7fbf60118bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.477+0000 7fbf67de4640 1 --2- 172.21.15.18:0/2138736376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf60109450 0x7fbf601186b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.477+0000 7fbf67de4640 1 -- 172.21.15.18:0/2138736376 >> 172.21.15.18:0/2138736376 conn(0x7fbf6006e140 msgr2=0x7fbf6011c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:03.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.478+0000 7fbf67de4640 1 -- 172.21.15.18:0/2138736376 shutdown_connections 2024-09-19T09:58:03.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:03.478+0000 7fbf67de4640 1 -- 172.21.15.18:0/2138736376 wait complete. 2024-09-19T09:58:03.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.500+0000 7fb03d6af640 1 -- 172.21.15.18:0/3617439542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0380fffe0 msgr2=0x7fb0381003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.500+0000 7fb03d6af640 1 --2- 172.21.15.18:0/3617439542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0380fffe0 0x7fb0381003e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb030009ca0 tx=0x7fb03002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.505+0000 7fb03d6af640 1 -- 172.21.15.18:0/3617439542 shutdown_connections 2024-09-19T09:58:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.505+0000 7fb03d6af640 1 --2- 172.21.15.18:0/3617439542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb038101b90 0x7fb038108420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.505+0000 7fb03d6af640 1 --2- 172.21.15.18:0/3617439542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0381011d0 0x7fb038101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.505+0000 7fb03d6af640 1 --2- 172.21.15.18:0/3617439542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0380fffe0 0x7fb0381003e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.505+0000 7fb03d6af640 1 -- 172.21.15.18:0/3617439542 >> 172.21.15.18:0/3617439542 conn(0x7fb0380fb740 msgr2=0x7fb0380fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.506+0000 7fb03d6af640 1 -- 172.21.15.18:0/3617439542 shutdown_connections 2024-09-19T09:58:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.506+0000 7fb03d6af640 1 -- 172.21.15.18:0/3617439542 wait complete. 2024-09-19T09:58:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.508+0000 7fb03d6af640 1 Processor -- start 2024-09-19T09:58:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.509+0000 7fb03d6af640 1 -- start start 2024-09-19T09:58:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.509+0000 7fb03d6af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0381011d0 0x7fb038071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.509+0000 7fb03d6af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038101b90 0x7fb038072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.510+0000 7fb03d6af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0380732d0 0x7fb038073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.510+0000 7fb03d6af640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb03806c1e0 con 0x7fb0381011d0 2024-09-19T09:58:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.510+0000 7fb03d6af640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb03806c060 con 0x7fb038101b90 2024-09-19T09:58:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.510+0000 7fb03d6af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb03806c360 con 0x7fb0380732d0 2024-09-19T09:58:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.511+0000 7fb0377fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038101b90 0x7fb038072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.511+0000 7fb0377fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038101b90 0x7fb038072290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37650/0 (socket says 172.21.15.18:37650) 2024-09-19T09:58:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.511+0000 7fb0377fe640 1 -- 172.21.15.18:0/2978876512 learned_addr learned my addr 172.21.15.18:0/2978876512 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.512+0000 7fb03ceae640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0380732d0 0x7fb038073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.512+0000 7fb037fff640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0381011d0 0x7fb038071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.512+0000 7fb0377fe640 1 -- 172.21.15.18:0/2978876512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0380732d0 msgr2=0x7fb038073780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.512+0000 7fb0377fe640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0380732d0 0x7fb038073780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.512+0000 7fb0377fe640 1 -- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0381011d0 msgr2=0x7fb038071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.512+0000 7fb0377fe640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0381011d0 0x7fb038071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.512+0000 7fb0377fe640 1 -- 172.21.15.18:0/2978876512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb038073d40 con 0x7fb038101b90 2024-09-19T09:58:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.517+0000 7fb037fff640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0381011d0 0x7fb038071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:58:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.517+0000 7fb0377fe640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038101b90 0x7fb038072290 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00d950 tx=0x7fb02c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.517+0000 7fb0357fa640 1 -- 172.21.15.18:0/2978876512 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c017070 con 0x7fb038101b90 2024-09-19T09:58:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.517+0000 7fb03d6af640 1 -- 172.21.15.18:0/2978876512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb038074030 con 0x7fb038101b90 2024-09-19T09:58:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.518+0000 7fb03d6af640 1 -- 172.21.15.18:0/2978876512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0381a6dc0 con 0x7fb038101b90 2024-09-19T09:58:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.532+0000 7fb0416a8740 1 Processor -- start 2024-09-19T09:58:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.533+0000 7fb0416a8740 1 -- start start 2024-09-19T09:58:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.534+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 0x55c59c6d3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.534+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d44b0 0x55c59c6d8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.534+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 0x55c59c6dba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.534+0000 7fb0416a8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c59c6372f0 con 0x55c59c6d44b0 2024-09-19T09:58:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.535+0000 7fb0416a8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c59c5df270 con 0x55c59c6d9540 2024-09-19T09:58:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.535+0000 7fb0377fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 0x55c59c6dba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.538+0000 7fb0377fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 0x55c59c6dba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37660/0 (socket says 172.21.15.18:37660) 2024-09-19T09:58:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.538+0000 7fb0377fe640 1 -- 172.21.15.18:0/3861831187 learned_addr learned my addr 172.21.15.18:0/3861831187 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.538+0000 7fb0416a8740 1 -- 172.21.15.18:0/3861831187 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c59c6332b0 con 0x55c59c6d3b70 2024-09-19T09:58:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.538+0000 7fb0357fa640 1 -- 172.21.15.18:0/2978876512 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb02c009c30 con 0x7fb038101b90 2024-09-19T09:58:03.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.539+0000 7fb0357fa640 1 -- 172.21.15.18:0/2978876512 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00f690 con 0x7fb038101b90 2024-09-19T09:58:03.542 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.540+0000 7fb0357fa640 1 -- 172.21.15.18:0/2978876512 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb02c00f8b0 con 0x7fb038101b90 2024-09-19T09:58:03.543 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.541+0000 7fb03ceae640 1 --2- 172.21.15.18:0/3861831187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 0x55c59c6d3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.542+0000 7fb0357fa640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0200a32f0 0x7fb0200a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.542+0000 7fb0357fa640 1 -- 172.21.15.18:0/2978876512 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb02c0cfed0 con 0x7fb038101b90 2024-09-19T09:58:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.543+0000 7fb03ceae640 1 -- 172.21.15.18:0/3861831187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 msgr2=0x55c59c6dba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.543+0000 7fb03ceae640 1 --2- 172.21.15.18:0/3861831187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 0x55c59c6dba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.543+0000 7fb03ceae640 1 -- 172.21.15.18:0/3861831187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d44b0 msgr2=0x55c59c6d8f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:58:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.543+0000 7fb03ceae640 1 --2- 172.21.15.18:0/3861831187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d44b0 0x55c59c6d8f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.544+0000 7fb03ceae640 1 -- 172.21.15.18:0/3861831187 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59c5de340 con 0x55c59c6d3b70 2024-09-19T09:58:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.544+0000 7fb0377fe640 1 --2- 172.21.15.18:0/3861831187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 0x55c59c6dba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:58:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.550+0000 7fb03ceae640 1 --2- 172.21.15.18:0/3861831187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 0x55c59c6d3f70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb02800bd00 tx=0x7fb02800f830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7592ed532bec157c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.552+0000 7fb03ceae640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0200a32f0 0x7fb0200a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.563+0000 7fb01e7fc640 1 -- 172.21.15.18:0/3861831187 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028015030 con 0x55c59c6d3b70 2024-09-19T09:58:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.563+0000 7fb01e7fc640 1 -- 172.21.15.18:0/3861831187 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb02800db40 con 0x55c59c6d3b70 2024-09-19T09:58:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.564+0000 7fb0416a8740 1 -- 172.21.15.18:0/3861831187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 msgr2=0x55c59c6d3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.564+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3861831187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 0x55c59c6d3f70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb02800bd00 tx=0x7fb02800f830 comp rx=0 tx=0).stop 2024-09-19T09:58:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.567+0000 7fb0416a8740 1 -- 172.21.15.18:0/3861831187 shutdown_connections 2024-09-19T09:58:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.567+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3861831187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 0x55c59c6dba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.567+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3861831187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d44b0 0x55c59c6d8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.567+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3861831187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 0x55c59c6d3f70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.567+0000 7fb0416a8740 1 -- 172.21.15.18:0/3861831187 >> 172.21.15.18:0/3861831187 conn(0x55c59c6cf1e0 msgr2=0x55c59c6cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.568+0000 7fb0416a8740 1 -- 172.21.15.18:0/3861831187 shutdown_connections 2024-09-19T09:58:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.568+0000 7fb0416a8740 1 -- 172.21.15.18:0/3861831187 wait complete. 2024-09-19T09:58:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.571+0000 7fb0416a8740 1 -- start start 2024-09-19T09:58:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.571+0000 7fb0416a8740 1 Processor -- start 2024-09-19T09:58:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.572+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d3b70 0x55c59c6ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.572+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6de230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.572+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 0x55c59c6e5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.573+0000 7fb0416a8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c59c6dc560 con 0x55c59c6d3b70 2024-09-19T09:58:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.573+0000 7fb0416a8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c59c5c0290 con 0x55c59c6d9540 2024-09-19T09:58:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.573+0000 7fb0416a8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c59c6dc6e0 con 0x55c59c6d44b0 2024-09-19T09:58:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.573+0000 7fb0416a8740 10 client.0 _ll_register_callbacks cb 0x55c59c5f1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.573+0000 7fb0377fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6de230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.573+0000 7fb0377fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6de230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54370/0 (socket says 172.21.15.18:54370) 2024-09-19T09:58:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.573+0000 7fb0377fe640 1 -- 172.21.15.18:0/3550960525 learned_addr learned my addr 172.21.15.18:0/3550960525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.574+0000 7fb03ceae640 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 0x55c59c6e5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.574+0000 7fb0377fe640 1 -- 172.21.15.18:0/3550960525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 msgr2=0x55c59c6e5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.574+0000 7fb0377fe640 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 0x55c59c6e5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.574+0000 7fb0377fe640 1 -- 172.21.15.18:0/3550960525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d3b70 msgr2=0x55c59c6ddcf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:58:03.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.574+0000 7fb0377fe640 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d3b70 0x55c59c6ddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.574+0000 7fb0377fe640 1 -- 172.21.15.18:0/3550960525 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c59c34a210 con 0x55c59c6d44b0 2024-09-19T09:58:03.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.575+0000 7fb0377fe640 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6de230 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0058c0 tx=0x7fb02c09c170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc774ff3086943c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.577 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.575+0000 7fb03ceae640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0200a32f0 0x7fb0200a57b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb02801b040 tx=0x7fb02800c430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.579+0000 7fb0177fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:58:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.579+0000 7fb0177fe640 1 -- 172.21.15.18:0/3550960525 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c0cde60 con 0x55c59c6d44b0 2024-09-19T09:58:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.579+0000 7fb0177fe640 1 -- 172.21.15.18:0/3550960525 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb02c00fba0 con 0x55c59c6d44b0 2024-09-19T09:58:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.580+0000 7fb0416a8740 1 -- 172.21.15.18:0/3550960525 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb02800db40 con 0x55c59c6d44b0 2024-09-19T09:58:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.580+0000 7fb0177fe640 1 -- 172.21.15.18:0/3550960525 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb02c09c540 con 0x55c59c6d44b0 2024-09-19T09:58:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.580+0000 7fb0416a8740 10 client.26449 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.580+0000 7fb0416a8740 1 -- 172.21.15.18:0/3550960525 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c59c416620 con 0x55c59c6d44b0 2024-09-19T09:58:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.581+0000 7fb0177fe640 1 -- 172.21.15.18:0/3550960525 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb02800db40 con 0x55c59c6d44b0 2024-09-19T09:58:03.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.582+0000 7fb0177fe640 1 -- 172.21.15.18:0/3550960525 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb02c09b990 con 0x55c59c6d44b0 2024-09-19T09:58:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.582+0000 7fb0416a8740 10 client.26449 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.582+0000 7fb0416a8740 10 client.26449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.583+0000 7fb0416a8740 20 client.26449 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.583+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c59c6e9890 0x55c59c6ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.583+0000 7fb0416a8740 4 client.26449 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:58:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.583+0000 7fb0416a8740 1 -- 172.21.15.18:0/3550960525 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c59c644a20 con 0x55c59c6e9890 2024-09-19T09:58:03.587 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.585+0000 7fb037fff640 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c59c6e9890 0x55c59c6ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.587+0000 7fb037fff640 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c59c6e9890 0x55c59c6ebd10 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f88dbcea60ad8d6 server_cookie=797d97b062eeef62 in_seq=0 out_seq=0 2024-09-19T09:58:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.587+0000 7fb0177fe640 10 client.26449 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.590+0000 7fb0177fe640 1 -- 172.21.15.18:0/3550960525 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c59c644a20 con 0x55c59c6e9890 2024-09-19T09:58:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.590+0000 7fb0177fe640 10 client.26449 handle_command_reply: tid=0 2024-09-19T09:58:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.591+0000 7fb0416a8740 1 client.26449 shutdown 2024-09-19T09:58:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.591+0000 7fb0416a8740 1 -- 172.21.15.18:0/3550960525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 msgr2=0x55c59c6de230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.591+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6de230 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0058c0 tx=0x7fb02c09c170 comp rx=0 tx=0).stop 2024-09-19T09:58:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.592+0000 7fb0416a8740 1 -- 172.21.15.18:0/3550960525 shutdown_connections 2024-09-19T09:58:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.592+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c59c6e9890 0x55c59c6ebd10 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.592+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d9540 0x55c59c6e5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.592+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6de230 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.592+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3550960525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d3b70 0x55c59c6ddcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.592+0000 7fb0416a8740 1 -- 172.21.15.18:0/3550960525 >> 172.21.15.18:0/3550960525 conn(0x55c59c6cf1e0 msgr2=0x55c59c6d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.592+0000 7fb0177fe640 0 client.26449 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.592+0000 7fb0416a8740 1 -- 172.21.15.18:0/3550960525 shutdown_connections 2024-09-19T09:58:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.592+0000 7fb0416a8740 1 -- 172.21.15.18:0/3550960525 wait complete. 2024-09-19T09:58:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.592+0000 7fb0416a8740 20 client.26449 trim_cache size 0 max 16384 2024-09-19T09:58:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.651+0000 7fb0416a8740 1 Processor -- start 2024-09-19T09:58:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.651+0000 7fb0416a8740 1 -- start start 2024-09-19T09:58:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.651+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d3b70 0x55c59c6c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.651+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.651+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d9540 0x55c59c6cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.652+0000 7fb037fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d3b70 0x55c59c6c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.652+0000 7fb0416a8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb02400e330 con 0x55c59c6d9540 2024-09-19T09:58:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.652+0000 7fb037fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d3b70 0x55c59c6c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37670/0 (socket says 172.21.15.18:37670) 2024-09-19T09:58:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.652+0000 7fb037fff640 1 -- 172.21.15.18:0/607331574 learned_addr learned my addr 172.21.15.18:0/607331574 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.652+0000 7fb0377fe640 1 --2- 172.21.15.18:0/607331574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.652+0000 7fb0416a8740 1 -- 172.21.15.18:0/607331574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb02400fe70 con 0x55c59c6d3b70 2024-09-19T09:58:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.652+0000 7fb0416a8740 1 -- 172.21.15.18:0/607331574 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb02400ea00 con 0x55c59c6d44b0 2024-09-19T09:58:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.652+0000 7fb03ceae640 1 --2- 172.21.15.18:0/607331574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d9540 0x55c59c6cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.653+0000 7fb03ceae640 1 -- 172.21.15.18:0/607331574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 msgr2=0x55c59c6e51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.653+0000 7fb03ceae640 1 --2- 172.21.15.18:0/607331574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6e51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.653+0000 7fb03ceae640 1 -- 172.21.15.18:0/607331574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d3b70 msgr2=0x55c59c6c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.653+0000 7fb03ceae640 1 --2- 172.21.15.18:0/607331574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d3b70 0x55c59c6c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.653+0000 7fb03ceae640 1 -- 172.21.15.18:0/607331574 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59c6d4990 con 0x55c59c6d9540 2024-09-19T09:58:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.653+0000 7fb0377fe640 1 --2- 172.21.15.18:0/607331574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:58:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.654+0000 7fb03ceae640 1 --2- 172.21.15.18:0/607331574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d9540 0x55c59c6cda90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb028015000 tx=0x7fb028023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa716f3950b8977 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.654+0000 7fb01dffb640 1 -- 172.21.15.18:0/607331574 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028032070 con 0x55c59c6d9540 2024-09-19T09:58:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.654+0000 7fb01dffb640 1 -- 172.21.15.18:0/607331574 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb028029040 con 0x55c59c6d9540 2024-09-19T09:58:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.656+0000 7fb0416a8740 1 -- 172.21.15.18:0/607331574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d9540 msgr2=0x55c59c6cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.656+0000 7fb0416a8740 1 --2- 172.21.15.18:0/607331574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d9540 0x55c59c6cda90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb028015000 tx=0x7fb028023000 comp rx=0 tx=0).stop 2024-09-19T09:58:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.665+0000 7fb0416a8740 1 -- 172.21.15.18:0/607331574 shutdown_connections 2024-09-19T09:58:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.665+0000 7fb0416a8740 1 --2- 172.21.15.18:0/607331574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d9540 0x55c59c6cda90 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.665+0000 7fb0416a8740 1 --2- 172.21.15.18:0/607331574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d44b0 0x55c59c6e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.665+0000 7fb0416a8740 1 --2- 172.21.15.18:0/607331574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d3b70 0x55c59c6c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.665+0000 7fb0416a8740 1 -- 172.21.15.18:0/607331574 >> 172.21.15.18:0/607331574 conn(0x55c59c6cf1e0 msgr2=0x55c59c6ddcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.667+0000 7fb0416a8740 1 -- 172.21.15.18:0/607331574 shutdown_connections 2024-09-19T09:58:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.668+0000 7fb0416a8740 1 -- 172.21.15.18:0/607331574 wait complete. 2024-09-19T09:58:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.668+0000 7fb0416a8740 1 -- start start 2024-09-19T09:58:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.669+0000 7fb0416a8740 1 Processor -- start 2024-09-19T09:58:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.672+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 0x55c59c6e0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.672+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d44b0 0x55c59c6e0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.672+0000 7fb0416a8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d9540 0x55c59c6e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.672+0000 7fb0416a8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb02400f7a0 con 0x55c59c6d9540 2024-09-19T09:58:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.672+0000 7fb0416a8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb02400f0d0 con 0x55c59c6d44b0 2024-09-19T09:58:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.672+0000 7fb0416a8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb02400c3c0 con 0x55c59c6d3b70 2024-09-19T09:58:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.672+0000 7fb0416a8740 10 client.0 _ll_register_callbacks cb 0x7fb02c09c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.672+0000 7fb0377fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d44b0 0x55c59c6e0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.672+0000 7fb0377fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d44b0 0x55c59c6e0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:37672/0 (socket says 172.21.15.18:37672) 2024-09-19T09:58:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.672+0000 7fb0377fe640 1 -- 172.21.15.18:0/3926926130 learned_addr learned my addr 172.21.15.18:0/3926926130 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.673+0000 7fb037fff640 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 0x55c59c6e0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.673+0000 7fb0377fe640 1 -- 172.21.15.18:0/3926926130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 msgr2=0x55c59c6e0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.673+0000 7fb0377fe640 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 0x55c59c6e0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.673+0000 7fb0377fe640 1 -- 172.21.15.18:0/3926926130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d9540 msgr2=0x55c59c6e3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.673+0000 7fb0377fe640 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d9540 0x55c59c6e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.673+0000 7fb0377fe640 1 -- 172.21.15.18:0/3926926130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c59c6e45a0 con 0x55c59c6d44b0 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.673+0000 7fb0377fe640 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d44b0 0x55c59c6e0fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb02c09a7f0 tx=0x7fb02c0b5650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=645d002c99fa818e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.673+0000 7fb0177fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.673+0000 7fb0177fe640 1 -- 172.21.15.18:0/3926926130 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c0cde60 con 0x55c59c6d44b0 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.674+0000 7fb0416a8740 1 -- 172.21.15.18:0/3926926130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb028029040 con 0x55c59c6d44b0 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.674+0000 7fb0177fe640 1 -- 172.21.15.18:0/3926926130 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb02c09b990 con 0x55c59c6d44b0 2024-09-19T09:58:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.674+0000 7fb0177fe640 1 -- 172.21.15.18:0/3926926130 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb02c09bb90 con 0x55c59c6d44b0 2024-09-19T09:58:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.674+0000 7fb0416a8740 10 client.26465 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.674+0000 7fb0416a8740 1 -- 172.21.15.18:0/3926926130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c59c754750 con 0x55c59c6d44b0 2024-09-19T09:58:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.675+0000 7fb0177fe640 1 -- 172.21.15.18:0/3926926130 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb028029040 con 0x55c59c6d44b0 2024-09-19T09:58:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.675+0000 7fb0177fe640 1 -- 172.21.15.18:0/3926926130 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb02c09b620 con 0x55c59c6d44b0 2024-09-19T09:58:03.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.675+0000 7fb0416a8740 10 client.26465 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:03.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.675+0000 7fb0416a8740 10 client.26465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:03.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.676+0000 7fb0416a8740 20 client.26465 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:03.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.676+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c59c7551a0 0x55c59c7575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:03.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.676+0000 7fb0416a8740 4 client.26465 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:58:03.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.676+0000 7fb0416a8740 1 -- 172.21.15.18:0/3926926130 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c59c63ed70 con 0x55c59c7551a0 2024-09-19T09:58:03.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.676+0000 7fb037fff640 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c59c7551a0 0x55c59c7575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.677+0000 7fb0177fe640 10 client.26465 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:03.679+0000 7fb037fff640 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c59c7551a0 0x55c59c7575c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7da21f74473486a server_cookie=8a23621b0970860b in_seq=0 out_seq=0 2024-09-19T09:58:04.248 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:03 smithi018 ceph-mon[30956]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 668 MiB/s wr, 2.61k op/s 2024-09-19T09:58:04.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:03 smithi049 ceph-mon[34858]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 668 MiB/s wr, 2.61k op/s 2024-09-19T09:58:04.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:03 smithi162 ceph-mon[35174]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 668 MiB/s wr, 2.61k op/s 2024-09-19T09:58:05.759 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:58:05.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:58:06.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:06 smithi018 ceph-mon[30956]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 742 MiB/s wr, 2.73k op/s 2024-09-19T09:58:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:06 smithi049 ceph-mon[34858]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 742 MiB/s wr, 2.73k op/s 2024-09-19T09:58:06.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:06 smithi162 ceph-mon[35174]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 742 MiB/s wr, 2.73k op/s 2024-09-19T09:58:06.753 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:58:07.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.589+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/3532653154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6f8109b10 msgr2=0x7fb6f810e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:07.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.589+0000 7fb6fcb0b640 1 --2- 172.21.15.18:0/3532653154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6f8109b10 0x7fb6f810e2b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009900 tx=0x7fb6ec02a440 comp rx=0 tx=0).stop 2024-09-19T09:58:07.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.589+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/3532653154 shutdown_connections 2024-09-19T09:58:07.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.589+0000 7fb6fcb0b640 1 --2- 172.21.15.18:0/3532653154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6f810e7f0 0x7fb6f810eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.589+0000 7fb6fcb0b640 1 --2- 172.21.15.18:0/3532653154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6f8109b10 0x7fb6f810e2b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.589+0000 7fb6fcb0b640 1 --2- 172.21.15.18:0/3532653154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f81091f0 0x7fb6f81095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.589+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/3532653154 >> 172.21.15.18:0/3532653154 conn(0x7fb6f8073660 msgr2=0x7fb6f8073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.589+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/3532653154 shutdown_connections 2024-09-19T09:58:07.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.589+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/3532653154 wait complete. 2024-09-19T09:58:07.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.591+0000 7fb6fcb0b640 1 Processor -- start 2024-09-19T09:58:07.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.591+0000 7fb6fcb0b640 1 -- start start 2024-09-19T09:58:07.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.591+0000 7fb6fcb0b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6f81091f0 0x7fb6f81a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.591+0000 7fb6fcb0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f8109b10 0x7fb6f81a9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.591+0000 7fb6fcb0b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6f810e7f0 0x7fb6f8115680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.591+0000 7fb6fcb0b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f811ca90 con 0x7fb6f8109b10 2024-09-19T09:58:07.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.591+0000 7fb6fcb0b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8112430 con 0x7fb6f81091f0 2024-09-19T09:58:07.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.591+0000 7fb6fcb0b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f811cc10 con 0x7fb6f810e7f0 2024-09-19T09:58:07.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.592+0000 7fb6f5d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f8109b10 0x7fb6f81a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.592+0000 7fb6f5d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f8109b10 0x7fb6f81a9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40626/0 (socket says 172.21.15.18:40626) 2024-09-19T09:58:07.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.592+0000 7fb6f5d9b640 1 -- 172.21.15.18:0/2309440671 learned_addr learned my addr 172.21.15.18:0/2309440671 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:07.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.592+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6f810e7f0 0x7fb6f8115680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.592+0000 7fb6f5d9b640 1 -- 172.21.15.18:0/2309440671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6f810e7f0 msgr2=0x7fb6f8115680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:07.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.592+0000 7fb6f5d9b640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6f810e7f0 0x7fb6f8115680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.592+0000 7fb6f5d9b640 1 -- 172.21.15.18:0/2309440671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6f81091f0 msgr2=0x7fb6f81a8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:07.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.593+0000 7fb6f5d9b640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6f81091f0 0x7fb6f81a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.593+0000 7fb6f5d9b640 1 -- 172.21.15.18:0/2309440671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f8115d60 con 0x7fb6f8109b10 2024-09-19T09:58:07.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.593+0000 7fb6f5d9b640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f8109b10 0x7fb6f81a9230 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec005ab0 tx=0x7fb6ec005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:07.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.594+0000 7fb6e77fe640 1 -- 172.21.15.18:0/2309440671 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec040030 con 0x7fb6f8109b10 2024-09-19T09:58:07.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.594+0000 7fb6e77fe640 1 -- 172.21.15.18:0/2309440671 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6ec0041c0 con 0x7fb6f8109b10 2024-09-19T09:58:07.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.594+0000 7fb6e77fe640 1 -- 172.21.15.18:0/2309440671 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec031440 con 0x7fb6f8109b10 2024-09-19T09:58:07.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.595+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/2309440671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f8115ff0 con 0x7fb6f8109b10 2024-09-19T09:58:07.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.596+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/2309440671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f8116450 con 0x7fb6f8109b10 2024-09-19T09:58:07.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.601+0000 7fb6feee4740 1 Processor -- start 2024-09-19T09:58:07.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.601+0000 7fb6feee4740 1 -- start start 2024-09-19T09:58:07.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.603+0000 7fb6feee4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebed150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.605+0000 7fb6f6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.605+0000 7fb6f6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebed150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:52912/0 (socket says 172.21.15.18:52912) 2024-09-19T09:58:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.605+0000 7fb6e77fe640 1 -- 172.21.15.18:0/2309440671 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb6ec043030 con 0x7fb6f8109b10 2024-09-19T09:58:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.606+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/2678801579 learned_addr learned my addr 172.21.15.18:0/2678801579 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.606+0000 7fb6feee4740 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebed690 0x562d3ebf7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.607+0000 7fb6e77fe640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6e00a3300 0x7fb6e00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.608+0000 7fb6e77fe640 1 -- 172.21.15.18:0/2309440671 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb6ec0f05c0 con 0x7fb6f8109b10 2024-09-19T09:58:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.608+0000 7fb6feee4740 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebfa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.608+0000 7fb6feee4740 1 -- 172.21.15.18:0/2678801579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d3eb52280 con 0x562d3ebf7f50 2024-09-19T09:58:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.609+0000 7fb6f659c640 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebed690 0x562d3ebf7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.609+0000 7fb6f5d9b640 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebfa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.609+0000 7fb6feee4740 1 -- 172.21.15.18:0/2678801579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562d3eaf9b10 con 0x562d3ebecd70 2024-09-19T09:58:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.609+0000 7fb6feee4740 1 -- 172.21.15.18:0/2678801579 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562d3eb4e240 con 0x562d3ebed690 2024-09-19T09:58:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.610+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/2678801579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebed690 msgr2=0x562d3ebf7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.610+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebed690 0x562d3ebf7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.610+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/2678801579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 msgr2=0x562d3ebfa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.610+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebfa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.610+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/2678801579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3eb061f0 con 0x562d3ebecd70 2024-09-19T09:58:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.610+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6e00a3300 0x7fb6e00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.611+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebed150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000ae90 tx=0x7fb6f00117e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58e6e630da8afef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.612+0000 7fb6e4ff9640 1 -- 172.21.15.18:0/2678801579 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000d7c0 con 0x562d3ebecd70 2024-09-19T09:58:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.612+0000 7fb6e4ff9640 1 -- 172.21.15.18:0/2678801579 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6f000de40 con 0x562d3ebecd70 2024-09-19T09:58:07.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.613+0000 7fb6e4ff9640 1 -- 172.21.15.18:0/2678801579 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000c620 con 0x562d3ebecd70 2024-09-19T09:58:07.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.614+0000 7fb6feee4740 1 -- 172.21.15.18:0/2678801579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 msgr2=0x562d3ebed150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:07.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.614+0000 7fb6feee4740 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebed150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000ae90 tx=0x7fb6f00117e0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.615+0000 7fb6feee4740 1 -- 172.21.15.18:0/2678801579 shutdown_connections 2024-09-19T09:58:07.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.615+0000 7fb6feee4740 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebfa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.615+0000 7fb6feee4740 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebed690 0x562d3ebf7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.615+0000 7fb6feee4740 1 --2- 172.21.15.18:0/2678801579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebed150 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.615+0000 7fb6feee4740 1 -- 172.21.15.18:0/2678801579 >> 172.21.15.18:0/2678801579 conn(0x562d3ebe9300 msgr2=0x562d3ebe96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.615+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6e00a3300 0x7fb6e00a57c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb6f001e000 tx=0x7fb6f001aef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.615+0000 7fb6feee4740 1 -- 172.21.15.18:0/2678801579 shutdown_connections 2024-09-19T09:58:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.616+0000 7fb6feee4740 1 -- 172.21.15.18:0/2678801579 wait complete. 2024-09-19T09:58:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.616+0000 7fb6feee4740 1 -- start start 2024-09-19T09:58:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.617+0000 7fb6feee4740 1 Processor -- start 2024-09-19T09:58:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.617+0000 7fb6feee4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebf7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.617+0000 7fb6feee4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebed690 0x562d3ebf4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.618+0000 7fb6feee4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebf54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.619+0000 7fb6feee4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d3ebfab70 con 0x562d3ebf7f50 2024-09-19T09:58:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.619+0000 7fb6f6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebf54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.619+0000 7fb6f6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebf54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40650/0 (socket says 172.21.15.18:40650) 2024-09-19T09:58:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.619+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/4048436627 learned_addr learned my addr 172.21.15.18:0/4048436627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.619+0000 7fb6f659c640 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebf7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.619+0000 7fb6f5d9b640 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebed690 0x562d3ebf4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.619+0000 7fb6feee4740 1 -- 172.21.15.18:0/4048436627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562d3eb0cf10 con 0x562d3ebecd70 2024-09-19T09:58:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.619+0000 7fb6feee4740 1 -- 172.21.15.18:0/4048436627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562d3ebfacf0 con 0x562d3ebed690 2024-09-19T09:58:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.620+0000 7fb6feee4740 10 client.0 _ll_register_callbacks cb 0x562d3ead5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.620+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/4048436627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebed690 msgr2=0x562d3ebf4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.620+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebed690 0x562d3ebf4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.620+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/4048436627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 msgr2=0x562d3ebf7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.620+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebf7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.620+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/4048436627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d3e8c36a0 con 0x562d3ebf7f50 2024-09-19T09:58:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.621+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebf54e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0000b60 tx=0x7fb6f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d29684c1e57ab2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.621+0000 7fb6ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:58:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.621+0000 7fb6ddffb640 1 -- 172.21.15.18:0/4048436627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0033060 con 0x562d3ebf7f50 2024-09-19T09:58:07.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.622+0000 7fb6ddffb640 1 -- 172.21.15.18:0/4048436627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb6f002a070 con 0x562d3ebf7f50 2024-09-19T09:58:07.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.623+0000 7fb6feee4740 1 -- 172.21.15.18:0/4048436627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d3eb5f7f0 con 0x562d3ebf7f50 2024-09-19T09:58:07.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.623+0000 7fb6ddffb640 1 -- 172.21.15.18:0/4048436627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6f001ad50 con 0x562d3ebf7f50 2024-09-19T09:58:07.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.624+0000 7fb6feee4740 10 client.17055 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:07.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.624+0000 7fb6feee4740 1 -- 172.21.15.18:0/4048436627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562d3ec06570 con 0x562d3ebf7f50 2024-09-19T09:58:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.625+0000 7fb6ddffb640 1 -- 172.21.15.18:0/4048436627 <== mon.0 v2:172.21.15.18:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb6f00110f0 con 0x562d3ebf7f50 2024-09-19T09:58:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.625+0000 7fb6feee4740 10 client.17055 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.625+0000 7fb6feee4740 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.625+0000 7fb6feee4740 20 client.17055 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.625+0000 7fb6feee4740 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d3ec07920 0x562d3ec09d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.626+0000 7fb6feee4740 4 client.17055 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:58:07.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.626+0000 7fb6feee4740 1 -- 172.21.15.18:0/4048436627 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d3eb5f7f0 con 0x562d3ec07920 2024-09-19T09:58:07.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.627+0000 7fb6f659c640 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d3ec07920 0x562d3ec09d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.638+0000 7fb6f659c640 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d3ec07920 0x562d3ec09d10 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34e8f4f800b27142 server_cookie=a57856a969243ec5 in_seq=0 out_seq=0 2024-09-19T09:58:07.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.638+0000 7fb6ddffb640 10 client.17055 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:07.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.642+0000 7fb6ddffb640 1 -- 172.21.15.18:0/4048436627 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d3eb5f7f0 con 0x562d3ec07920 2024-09-19T09:58:07.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.642+0000 7fb6ddffb640 10 client.17055 handle_command_reply: tid=0 2024-09-19T09:58:07.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.642+0000 7fb6feee4740 1 client.17055 shutdown 2024-09-19T09:58:07.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.643+0000 7fb6feee4740 1 -- 172.21.15.18:0/4048436627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 msgr2=0x562d3ebf54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:07.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.643+0000 7fb6feee4740 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebf54e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0000b60 tx=0x7fb6f0015000 comp rx=0 tx=0).stop 2024-09-19T09:58:07.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.643+0000 7fb6feee4740 1 -- 172.21.15.18:0/4048436627 shutdown_connections 2024-09-19T09:58:07.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.643+0000 7fb6feee4740 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d3ec07920 0x562d3ec09d10 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.643+0000 7fb6feee4740 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebf54e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.643+0000 7fb6feee4740 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebed690 0x562d3ebf4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.643+0000 7fb6feee4740 1 --2- 172.21.15.18:0/4048436627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebf7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.643+0000 7fb6feee4740 1 -- 172.21.15.18:0/4048436627 >> 172.21.15.18:0/4048436627 conn(0x562d3ebe9300 msgr2=0x562d3ebeefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:07.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.644+0000 7fb6ddffb640 0 client.17055 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:07.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.644+0000 7fb6feee4740 1 -- 172.21.15.18:0/4048436627 shutdown_connections 2024-09-19T09:58:07.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.645+0000 7fb6feee4740 1 -- 172.21.15.18:0/4048436627 wait complete. 2024-09-19T09:58:07.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.645+0000 7fb6feee4740 20 client.17055 trim_cache size 0 max 16384 2024-09-19T09:58:07.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.690+0000 7fb6feee4740 1 Processor -- start 2024-09-19T09:58:07.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.698+0000 7fb6feee4740 1 -- start start 2024-09-19T09:58:07.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.698+0000 7fb6feee4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.699+0000 7fb6feee4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebed690 0x562d3ebf6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.699+0000 7fb6feee4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebf7f50 0x562d3ec0f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.699+0000 7fb6feee4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f81c4950 con 0x562d3ebed690 2024-09-19T09:58:07.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.699+0000 7fb6feee4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f81c6490 con 0x562d3ebecd70 2024-09-19T09:58:07.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.699+0000 7fb6feee4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f81c5020 con 0x562d3ebf7f50 2024-09-19T09:58:07.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.700+0000 7fb6f659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.700+0000 7fb6f6d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebf7f50 0x562d3ec0f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.700+0000 7fb6f659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebef7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:52924/0 (socket says 172.21.15.18:52924) 2024-09-19T09:58:07.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.700+0000 7fb6f659c640 1 -- 172.21.15.18:0/1425268990 learned_addr learned my addr 172.21.15.18:0/1425268990 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.709+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/1425268990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 msgr2=0x562d3ebef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.709+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/1425268990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.709+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/1425268990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebed690 msgr2=0x562d3ebf6bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:58:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.709+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/1425268990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebed690 0x562d3ebf6bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.709+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/1425268990 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3ebfaa00 con 0x562d3ebf7f50 2024-09-19T09:58:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.715+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/1425268990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebf7f50 0x562d3ec0f450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0011ce0 tx=0x7fb6f002a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af5bacbc99e7250d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:07.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.922+0000 7fb6dffff640 1 -- 172.21.15.18:0/1425268990 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0033050 con 0x562d3ebf7f50 2024-09-19T09:58:07.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.922+0000 7fb6dffff640 1 -- 172.21.15.18:0/1425268990 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6f000c610 con 0x562d3ebf7f50 2024-09-19T09:58:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.922+0000 7fb6dffff640 1 -- 172.21.15.18:0/1425268990 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f003d060 con 0x562d3ebf7f50 2024-09-19T09:58:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.923+0000 7fb6feee4740 1 -- 172.21.15.18:0/1425268990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebf7f50 msgr2=0x562d3ec0f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.924+0000 7fb6feee4740 1 --2- 172.21.15.18:0/1425268990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebf7f50 0x562d3ec0f450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0011ce0 tx=0x7fb6f002a000 comp rx=0 tx=0).stop 2024-09-19T09:58:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.924+0000 7fb6feee4740 1 -- 172.21.15.18:0/1425268990 shutdown_connections 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.924+0000 7fb6feee4740 1 --2- 172.21.15.18:0/1425268990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebf7f50 0x562d3ec0f450 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.924+0000 7fb6feee4740 1 --2- 172.21.15.18:0/1425268990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebed690 0x562d3ebf6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.924+0000 7fb6feee4740 1 --2- 172.21.15.18:0/1425268990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebecd70 0x562d3ebef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.924+0000 7fb6feee4740 1 -- 172.21.15.18:0/1425268990 >> 172.21.15.18:0/1425268990 conn(0x562d3ebe9300 msgr2=0x562d3ebf64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.924+0000 7fb6feee4740 1 -- 172.21.15.18:0/1425268990 shutdown_connections 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.924+0000 7fb6feee4740 1 -- 172.21.15.18:0/1425268990 wait complete. 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.925+0000 7fb6feee4740 1 -- start start 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.926+0000 7fb6feee4740 1 Processor -- start 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.926+0000 7fb6feee4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebecd70 0x562d3ec00410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.927+0000 7fb6feee4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebed690 0x562d3ebfb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.927+0000 7fb6feee4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebfbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.927+0000 7fb6feee4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f81c5dc0 con 0x562d3ebf7f50 2024-09-19T09:58:07.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.927+0000 7fb6feee4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f81c56f0 con 0x562d3ebed690 2024-09-19T09:58:07.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.927+0000 7fb6feee4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f81c2950 con 0x562d3ebecd70 2024-09-19T09:58:07.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.927+0000 7fb6feee4740 10 client.0 _ll_register_callbacks cb 0x7fb6f001d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:07.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.928+0000 7fb6f5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebed690 0x562d3ebfb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.928+0000 7fb6f659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebecd70 0x562d3ec00410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.928+0000 7fb6f659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebecd70 0x562d3ec00410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49406/0 (socket says 172.21.15.18:49406) 2024-09-19T09:58:07.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.928+0000 7fb6f659c640 1 -- 172.21.15.18:0/197313051 learned_addr learned my addr 172.21.15.18:0/197313051 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.930+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebfbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.930+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/197313051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebecd70 msgr2=0x562d3ec00410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.930+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebecd70 0x562d3ec00410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.930+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/197313051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebed690 msgr2=0x562d3ebfb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.930+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebed690 0x562d3ebfb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.930+0000 7fb6f6d9d640 1 -- 172.21.15.18:0/197313051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d3ebfc1c0 con 0x562d3ebf7f50 2024-09-19T09:58:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.931+0000 7fb6f6d9d640 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebfbc80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb6f001c040 tx=0x7fb6f000d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a355302dd090ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.931+0000 7fb6ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:58:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.931+0000 7fb6ddffb640 1 -- 172.21.15.18:0/197313051 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f003d070 con 0x562d3ebf7f50 2024-09-19T09:58:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.931+0000 7fb6feee4740 1 -- 172.21.15.18:0/197313051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6f000c610 con 0x562d3ebf7f50 2024-09-19T09:58:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.932+0000 7fb6ddffb640 1 -- 172.21.15.18:0/197313051 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb6f0019970 con 0x562d3ebf7f50 2024-09-19T09:58:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.932+0000 7fb6ddffb640 1 -- 172.21.15.18:0/197313051 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6f0033040 con 0x562d3ebf7f50 2024-09-19T09:58:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.932+0000 7fb6feee4740 10 client.17058 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.932+0000 7fb6feee4740 1 -- 172.21.15.18:0/197313051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d3ec72190 con 0x562d3ebf7f50 2024-09-19T09:58:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.933+0000 7fb6ddffb640 1 -- 172.21.15.18:0/197313051 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6f0046070 con 0x562d3ebf7f50 2024-09-19T09:58:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.933+0000 7fb6ddffb640 1 -- 172.21.15.18:0/197313051 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb6f0019c80 con 0x562d3ebf7f50 2024-09-19T09:58:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.934+0000 7fb6feee4740 10 client.17058 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.934+0000 7fb6feee4740 10 client.17058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.934+0000 7fb6feee4740 20 client.17058 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.934+0000 7fb6feee4740 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d3ec727a0 0x562d3ec74b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.934+0000 7fb6feee4740 4 client.17058 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:58:07.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.934+0000 7fb6feee4740 1 -- 172.21.15.18:0/197313051 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fb6f000c610 con 0x562d3ec727a0 2024-09-19T09:58:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.936+0000 7fb6f659c640 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d3ec727a0 0x562d3ec74b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:07.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.949+0000 7fb6f659c640 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d3ec727a0 0x562d3ec74b90 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=950bddf2a803a406 server_cookie=aff067206046328e in_seq=0 out_seq=0 2024-09-19T09:58:07.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:07.949+0000 7fb6ddffb640 10 client.17058 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:08.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:08 smithi018 ceph-mon[30956]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 877 MiB/s wr, 2.80k op/s 2024-09-19T09:58:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:08 smithi049 ceph-mon[34858]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 877 MiB/s wr, 2.80k op/s 2024-09-19T09:58:08.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:08 smithi162 ceph-mon[35174]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 877 MiB/s wr, 2.80k op/s 2024-09-19T09:58:09.185 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:58:09.185 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T09:58:09.185 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "73b5e001-0450-48bd-826a-22db2d09cf34", 2024-09-19T09:58:09.185 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T09:58:09.185 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.179+0000 7fb6ddffb640 1 -- 172.21.15.18:0/197313051 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fb6f000c610 con 0x562d3ec727a0 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.179+0000 7fb6ddffb640 10 client.17058 handle_command_reply: tid=0 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.180+0000 7fb6feee4740 1 client.17058 shutdown 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.180+0000 7fb6feee4740 1 -- 172.21.15.18:0/197313051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 msgr2=0x562d3ebfbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.180+0000 7fb6feee4740 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebfbc80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb6f001c040 tx=0x7fb6f000d9f0 comp rx=0 tx=0).stop 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.180+0000 7fb6feee4740 1 -- 172.21.15.18:0/197313051 shutdown_connections 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.180+0000 7fb6feee4740 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d3ec727a0 0x562d3ec74b90 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.180+0000 7fb6feee4740 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d3ebf7f50 0x562d3ebfbc80 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.180+0000 7fb6ddffb640 0 client.17058 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.181+0000 7fb6feee4740 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d3ebed690 0x562d3ebfb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.181+0000 7fb6feee4740 1 --2- 172.21.15.18:0/197313051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d3ebecd70 0x562d3ec00410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:09.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.181+0000 7fb6feee4740 1 -- 172.21.15.18:0/197313051 >> 172.21.15.18:0/197313051 conn(0x562d3ebe9300 msgr2=0x562d3ebe8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.181+0000 7fb6feee4740 1 -- 172.21.15.18:0/197313051 shutdown_connections 2024-09-19T09:58:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.181+0000 7fb6feee4740 1 -- 172.21.15.18:0/197313051 wait complete. 2024-09-19T09:58:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.181+0000 7fb6feee4740 20 client.17058 trim_cache size 0 max 16384 2024-09-19T09:58:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.183+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/2309440671 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6e00a3300 msgr2=0x7fb6e00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.183+0000 7fb6fcb0b640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6e00a3300 0x7fb6e00a57c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb6f001e000 tx=0x7fb6f001aef0 comp rx=0 tx=0).stop 2024-09-19T09:58:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.183+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/2309440671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f8109b10 msgr2=0x7fb6f81a9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.183+0000 7fb6fcb0b640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f8109b10 0x7fb6f81a9230 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec005ab0 tx=0x7fb6ec005690 comp rx=0 tx=0).stop 2024-09-19T09:58:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.185+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/2309440671 shutdown_connections 2024-09-19T09:58:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.185+0000 7fb6fcb0b640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb6e00a3300 0x7fb6e00a57c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.185+0000 7fb6fcb0b640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6f810e7f0 0x7fb6f8115680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.185+0000 7fb6fcb0b640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6f8109b10 0x7fb6f81a9230 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.185+0000 7fb6fcb0b640 1 --2- 172.21.15.18:0/2309440671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6f81091f0 0x7fb6f81a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.185+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/2309440671 >> 172.21.15.18:0/2309440671 conn(0x7fb6f8073660 msgr2=0x7fb6f810c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.185+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/2309440671 shutdown_connections 2024-09-19T09:58:09.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:09.185+0000 7fb6fcb0b640 1 -- 172.21.15.18:0/2309440671 wait complete. 2024-09-19T09:58:10.216 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:58:10.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:10 smithi018 ceph-mon[30956]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 804 MiB/s wr, 1.97k op/s 2024-09-19T09:58:10.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:10 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T09:58:10.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:10 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:58:10.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:10 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T09:58:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:10 smithi049 ceph-mon[34858]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 804 MiB/s wr, 1.97k op/s 2024-09-19T09:58:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:10 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T09:58:10.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:10 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:58:10.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:10 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T09:58:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:10 smithi162 ceph-mon[35174]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 804 MiB/s wr, 1.97k op/s 2024-09-19T09:58:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:10 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T09:58:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:10 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:58:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:10 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T09:58:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:58:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.493+0000 7fb0177fe640 1 -- 172.21.15.18:0/3926926130 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c59c63ed70 con 0x55c59c7551a0 2024-09-19T09:58:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.493+0000 7fb0177fe640 10 client.26465 handle_command_reply: tid=0 2024-09-19T09:58:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.493+0000 7fb0416a8740 1 client.26465 shutdown 2024-09-19T09:58:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.493+0000 7fb0416a8740 1 -- 172.21.15.18:0/3926926130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d44b0 msgr2=0x55c59c6e0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.493+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d44b0 0x55c59c6e0fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb02c09a7f0 tx=0x7fb02c0b5650 comp rx=0 tx=0).stop 2024-09-19T09:58:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.494+0000 7fb0416a8740 1 -- 172.21.15.18:0/3926926130 shutdown_connections 2024-09-19T09:58:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.494+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c59c7551a0 0x55c59c7575c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.494+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c59c6d9540 0x55c59c6e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.494+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c59c6d44b0 0x55c59c6e0fe0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.494+0000 7fb0416a8740 1 --2- 172.21.15.18:0/3926926130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c59c6d3b70 0x55c59c6e0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.494+0000 7fb0416a8740 1 -- 172.21.15.18:0/3926926130 >> 172.21.15.18:0/3926926130 conn(0x55c59c6cf1e0 msgr2=0x55c59c6d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.494+0000 7fb0177fe640 0 client.26465 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.494+0000 7fb0416a8740 1 -- 172.21.15.18:0/3926926130 shutdown_connections 2024-09-19T09:58:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.494+0000 7fb0416a8740 1 -- 172.21.15.18:0/3926926130 wait complete. 2024-09-19T09:58:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.494+0000 7fb0416a8740 20 client.26465 trim_cache size 0 max 16384 2024-09-19T09:58:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:58:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:58:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:58:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:58:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.498+0000 7fb03d6af640 1 -- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0200a32f0 msgr2=0x7fb0200a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.498+0000 7fb03d6af640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0200a32f0 0x7fb0200a57b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb02801b040 tx=0x7fb02800c430 comp rx=0 tx=0).stop 2024-09-19T09:58:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.498+0000 7fb03d6af640 1 -- 172.21.15.18:0/2978876512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038101b90 msgr2=0x7fb038072290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:11.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.498+0000 7fb03d6af640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038101b90 0x7fb038072290 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00d950 tx=0x7fb02c00de10 comp rx=0 tx=0).stop 2024-09-19T09:58:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.499+0000 7fb03d6af640 1 -- 172.21.15.18:0/2978876512 shutdown_connections 2024-09-19T09:58:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.499+0000 7fb03d6af640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb0200a32f0 0x7fb0200a57b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.499+0000 7fb03d6af640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0380732d0 0x7fb038073780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.499+0000 7fb03d6af640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb038101b90 0x7fb038072290 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.499+0000 7fb03d6af640 1 --2- 172.21.15.18:0/2978876512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0381011d0 0x7fb038071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.499+0000 7fb03d6af640 1 -- 172.21.15.18:0/2978876512 >> 172.21.15.18:0/2978876512 conn(0x7fb0380fb740 msgr2=0x7fb038104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.499+0000 7fb03d6af640 1 -- 172.21.15.18:0/2978876512 shutdown_connections 2024-09-19T09:58:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:11.499+0000 7fb03d6af640 1 -- 172.21.15.18:0/2978876512 wait complete. 2024-09-19T09:58:12.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:12 smithi018 ceph-mon[30956]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 846 MiB/s wr, 1.84k op/s 2024-09-19T09:58:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:12 smithi049 ceph-mon[34858]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 846 MiB/s wr, 1.84k op/s 2024-09-19T09:58:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:12 smithi162 ceph-mon[35174]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 846 MiB/s wr, 1.84k op/s 2024-09-19T09:58:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.704+0000 7f1d56619640 1 -- 172.21.15.18:0/4023730497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d501008c0 msgr2=0x7f1d50100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.704+0000 7f1d56619640 1 --2- 172.21.15.18:0/4023730497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d501008c0 0x7f1d50100ca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009890 tx=0x7f1d4002a3b0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.707+0000 7f1d56619640 1 -- 172.21.15.18:0/4023730497 shutdown_connections 2024-09-19T09:58:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.707+0000 7f1d56619640 1 --2- 172.21.15.18:0/4023730497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d50105ec0 0x7f1d50106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.707+0000 7f1d56619640 1 --2- 172.21.15.18:0/4023730497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d501011e0 0x7f1d50105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.707+0000 7f1d56619640 1 --2- 172.21.15.18:0/4023730497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d501008c0 0x7f1d50100ca0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.707+0000 7f1d56619640 1 -- 172.21.15.18:0/4023730497 >> 172.21.15.18:0/4023730497 conn(0x7f1d500fc7d0 msgr2=0x7f1d500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.708+0000 7f1d56619640 1 -- 172.21.15.18:0/4023730497 shutdown_connections 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.708+0000 7f1d56619640 1 -- 172.21.15.18:0/4023730497 wait complete. 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.709+0000 7f1d56619640 1 Processor -- start 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.709+0000 7f1d56619640 1 -- start start 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.710+0000 7f1d56619640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d501008c0 0x7f1d501070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.710+0000 7f1d56619640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d501011e0 0x7f1d501075f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.710+0000 7f1d56619640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d50105ec0 0x7f1d5010b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.710+0000 7f1d56619640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5006c660 con 0x7f1d50105ec0 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.710+0000 7f1d56619640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5006c4e0 con 0x7f1d501008c0 2024-09-19T09:58:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.710+0000 7f1d56619640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5006c7e0 con 0x7f1d501011e0 2024-09-19T09:58:12.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.713+0000 7f1d54bb6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d50105ec0 0x7f1d5010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.713+0000 7f1d54bb6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d50105ec0 0x7f1d5010b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40672/0 (socket says 172.21.15.18:40672) 2024-09-19T09:58:12.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.713+0000 7f1d54bb6640 1 -- 172.21.15.18:0/3402854931 learned_addr learned my addr 172.21.15.18:0/3402854931 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:12.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.713+0000 7f1d4f7fe640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d501011e0 0x7f1d501075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.716+0000 7f1d4ffff640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d501008c0 0x7f1d501070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.721+0000 7f1d54bb6640 1 -- 172.21.15.18:0/3402854931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d501011e0 msgr2=0x7f1d501075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.721+0000 7f1d54bb6640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d501011e0 0x7f1d501075f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.721+0000 7f1d54bb6640 1 -- 172.21.15.18:0/3402854931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d501008c0 msgr2=0x7f1d501070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.721+0000 7f1d54bb6640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d501008c0 0x7f1d501070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.721+0000 7f1d54bb6640 1 -- 172.21.15.18:0/3402854931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5010b840 con 0x7f1d50105ec0 2024-09-19T09:58:12.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.723+0000 7f1d54bb6640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d50105ec0 0x7f1d5010b110 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800eaa0 tx=0x7f1d4800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.723+0000 7f1d4d7fa640 1 -- 172.21.15.18:0/3402854931 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800cdb0 con 0x7f1d50105ec0 2024-09-19T09:58:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.724+0000 7f1d4d7fa640 1 -- 172.21.15.18:0/3402854931 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d48005020 con 0x7f1d50105ec0 2024-09-19T09:58:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.724+0000 7f1d56619640 1 -- 172.21.15.18:0/3402854931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5010bb30 con 0x7f1d50105ec0 2024-09-19T09:58:12.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.724+0000 7f1d56619640 1 -- 172.21.15.18:0/3402854931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d501133e0 con 0x7f1d50105ec0 2024-09-19T09:58:12.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.730+0000 7f1d589f2740 1 Processor -- start 2024-09-19T09:58:12.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.730+0000 7f1d589f2740 1 -- start start 2024-09-19T09:58:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.730+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f2e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.730+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ec430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.730+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ec970 0x55bb9f2eed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.730+0000 7f1d589f2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bb9f2472e0 con 0x55bb9f2e1790 2024-09-19T09:58:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.730+0000 7f1d589f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bb9f1eece0 con 0x55bb9f2e20b0 2024-09-19T09:58:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.730+0000 7f1d589f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bb9f2432a0 con 0x55bb9f2ec970 2024-09-19T09:58:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.731+0000 7f1d4d7fa640 1 -- 172.21.15.18:0/3402854931 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480116d0 con 0x7f1d50105ec0 2024-09-19T09:58:12.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.738+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.738+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ec430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:52966/0 (socket says 172.21.15.18:52966) 2024-09-19T09:58:12.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.738+0000 7f1d4ffff640 1 -- 172.21.15.18:0/3267010057 learned_addr learned my addr 172.21.15.18:0/3267010057 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:12.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.741+0000 7f1d4f7fe640 1 --2- 172.21.15.18:0/3267010057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ec970 0x55bb9f2eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.744+0000 7f1d4d7fa640 1 -- 172.21.15.18:0/3402854931 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1d48004a40 con 0x7f1d50105ec0 2024-09-19T09:58:12.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.746+0000 7f1d4ffff640 1 -- 172.21.15.18:0/3267010057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ec970 msgr2=0x55bb9f2eed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:12.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.746+0000 7f1d4ffff640 1 --2- 172.21.15.18:0/3267010057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ec970 0x55bb9f2eed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.746+0000 7f1d4ffff640 1 -- 172.21.15.18:0/3267010057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 msgr2=0x55bb9f2e1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:12.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.746+0000 7f1d4ffff640 1 --2- 172.21.15.18:0/3267010057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f2e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.746+0000 7f1d4ffff640 1 -- 172.21.15.18:0/3267010057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9f1d3440 con 0x55bb9f2e20b0 2024-09-19T09:58:12.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.747+0000 7f1d4d7fa640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d380a3390 0x7f1d380a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.748+0000 7f1d4ffff640 1 --2- 172.21.15.18:0/3267010057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ec430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d40034000 tx=0x7f1d40005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7bd4642f7ad6207 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:12.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.748+0000 7f1d4d7fa640 1 -- 172.21.15.18:0/3402854931 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1d48099f70 con 0x7f1d50105ec0 2024-09-19T09:58:12.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.757+0000 7f1d4f7fe640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d380a3390 0x7f1d380a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.761+0000 7f1d35ffb640 1 -- 172.21.15.18:0/3267010057 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40040020 con 0x55bb9f2e20b0 2024-09-19T09:58:12.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.761+0000 7f1d35ffb640 1 -- 172.21.15.18:0/3267010057 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d40030bf0 con 0x55bb9f2e20b0 2024-09-19T09:58:12.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.762+0000 7f1d589f2740 1 -- 172.21.15.18:0/3267010057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 msgr2=0x55bb9f2ec430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:12.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.762+0000 7f1d589f2740 1 --2- 172.21.15.18:0/3267010057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ec430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d40034000 tx=0x7f1d40005fd0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.763+0000 7f1d589f2740 1 -- 172.21.15.18:0/3267010057 shutdown_connections 2024-09-19T09:58:12.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.763+0000 7f1d589f2740 1 --2- 172.21.15.18:0/3267010057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ec970 0x55bb9f2eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.763+0000 7f1d589f2740 1 --2- 172.21.15.18:0/3267010057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ec430 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.763+0000 7f1d589f2740 1 --2- 172.21.15.18:0/3267010057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f2e1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.763+0000 7f1d589f2740 1 -- 172.21.15.18:0/3267010057 >> 172.21.15.18:0/3267010057 conn(0x55bb9f2ddd20 msgr2=0x55bb9f2de100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.767+0000 7f1d589f2740 1 -- 172.21.15.18:0/3267010057 shutdown_connections 2024-09-19T09:58:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.767+0000 7f1d589f2740 1 -- 172.21.15.18:0/3267010057 wait complete. 2024-09-19T09:58:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.768+0000 7f1d589f2740 1 -- start start 2024-09-19T09:58:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.768+0000 7f1d589f2740 1 Processor -- start 2024-09-19T09:58:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.769+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e1790 0x55bb9f2ebf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.769+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2e9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.769+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2ec970 0x55bb9f2e9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.769+0000 7f1d589f2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bb9f2ef4b0 con 0x55bb9f2ec970 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.769+0000 7f1d589f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bb9f202050 con 0x55bb9f2e1790 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.769+0000 7f1d589f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bb9f2ef630 con 0x55bb9f2e20b0 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.769+0000 7f1d589f2740 10 client.0 _ll_register_callbacks cb 0x55bb9f242160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.771+0000 7f1d4f7fe640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d380a3390 0x7f1d380a5850 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55bb9f2df0a0 tx=0x7f1d44012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.771+0000 7f1d54bb6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2ec970 0x55bb9f2e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.771+0000 7f1d54bb6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2ec970 0x55bb9f2e9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40690/0 (socket says 172.21.15.18:40690) 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.771+0000 7f1d54bb6640 1 -- 172.21.15.18:0/2732579853 learned_addr learned my addr 172.21.15.18:0/2732579853 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.772+0000 7f1d54bb6640 1 -- 172.21.15.18:0/2732579853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2e20b0 msgr2=0x55bb9f2e9230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.772+0000 7f1d54bb6640 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2e9230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.772+0000 7f1d54bb6640 1 -- 172.21.15.18:0/2732579853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e1790 msgr2=0x55bb9f2ebf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:12.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.772+0000 7f1d54bb6640 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e1790 0x55bb9f2ebf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.772+0000 7f1d54bb6640 1 -- 172.21.15.18:0/2732579853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9efb83c0 con 0x55bb9f2ec970 2024-09-19T09:58:12.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.773+0000 7f1d54bb6640 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2ec970 0x55bb9f2e9770 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1d480092f0 tx=0x7f1d480a03c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca28d923570abf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:12.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.773+0000 7f1d2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:58:12.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.774+0000 7f1d2f7fe640 1 -- 172.21.15.18:0/2732579853 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4801f040 con 0x55bb9f2ec970 2024-09-19T09:58:12.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.774+0000 7f1d2f7fe640 1 -- 172.21.15.18:0/2732579853 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1d480bab10 con 0x55bb9f2ec970 2024-09-19T09:58:12.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.774+0000 7f1d589f2740 1 -- 172.21.15.18:0/2732579853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d40030bf0 con 0x55bb9f2ec970 2024-09-19T09:58:12.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.775+0000 7f1d2f7fe640 1 -- 172.21.15.18:0/2732579853 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1d480bad10 con 0x55bb9f2ec970 2024-09-19T09:58:12.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.777+0000 7f1d589f2740 10 client.17064 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:12.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.777+0000 7f1d589f2740 1 -- 172.21.15.18:0/2732579853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb9f31cc20 con 0x55bb9f2ec970 2024-09-19T09:58:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.778+0000 7f1d2f7fe640 1 -- 172.21.15.18:0/2732579853 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d40030bf0 con 0x55bb9f2ec970 2024-09-19T09:58:12.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.778+0000 7f1d2f7fe640 1 -- 172.21.15.18:0/2732579853 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1d4800f040 con 0x55bb9f2ec970 2024-09-19T09:58:12.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.780+0000 7f1d589f2740 10 client.17064 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.780+0000 7f1d589f2740 10 client.17064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.780+0000 7f1d589f2740 20 client.17064 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.780+0000 7f1d589f2740 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bb9f31e5c0 0x55bb9f320a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.780+0000 7f1d589f2740 4 client.17064 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:58:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.780+0000 7f1d589f2740 1 -- 172.21.15.18:0/2732579853 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb9f254850 con 0x55bb9f31e5c0 2024-09-19T09:58:12.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.784+0000 7f1d4ffff640 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bb9f31e5c0 0x55bb9f320a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.793+0000 7f1d4ffff640 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bb9f31e5c0 0x55bb9f320a80 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=923ee398f4a776c8 server_cookie=5a18ec8f4c4332ff in_seq=0 out_seq=0 2024-09-19T09:58:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.793+0000 7f1d2f7fe640 10 client.17064 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.797+0000 7f1d2f7fe640 1 -- 172.21.15.18:0/2732579853 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb9f254850 con 0x55bb9f31e5c0 2024-09-19T09:58:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.798+0000 7f1d2f7fe640 10 client.17064 handle_command_reply: tid=0 2024-09-19T09:58:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.799+0000 7f1d589f2740 1 client.17064 shutdown 2024-09-19T09:58:12.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.800+0000 7f1d589f2740 1 -- 172.21.15.18:0/2732579853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2ec970 msgr2=0x55bb9f2e9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:12.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.800+0000 7f1d589f2740 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2ec970 0x55bb9f2e9770 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1d480092f0 tx=0x7f1d480a03c0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.801+0000 7f1d589f2740 1 -- 172.21.15.18:0/2732579853 shutdown_connections 2024-09-19T09:58:12.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.801+0000 7f1d589f2740 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bb9f31e5c0 0x55bb9f320a80 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.801+0000 7f1d589f2740 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2ec970 0x55bb9f2e9770 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.801+0000 7f1d589f2740 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2e9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.801+0000 7f1d589f2740 1 --2- 172.21.15.18:0/2732579853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e1790 0x55bb9f2ebf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.801+0000 7f1d589f2740 1 -- 172.21.15.18:0/2732579853 >> 172.21.15.18:0/2732579853 conn(0x55bb9f2ddd20 msgr2=0x55bb9f2dcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:12.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.801+0000 7f1d2f7fe640 0 client.17064 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:12.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.805+0000 7f1d589f2740 1 -- 172.21.15.18:0/2732579853 shutdown_connections 2024-09-19T09:58:12.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.805+0000 7f1d589f2740 1 -- 172.21.15.18:0/2732579853 wait complete. 2024-09-19T09:58:12.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.808+0000 7f1d589f2740 20 client.17064 trim_cache size 0 max 16384 2024-09-19T09:58:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.870+0000 7f1d589f2740 1 Processor -- start 2024-09-19T09:58:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.870+0000 7f1d589f2740 1 -- start start 2024-09-19T09:58:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.871+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ddd20 0x55bb9f326390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.871+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f3268d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.871+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2e6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.871+0000 7f1d589f2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c00e4f0 con 0x55bb9f2e1790 2024-09-19T09:58:12.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.871+0000 7f1d589f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c010030 con 0x55bb9f2e20b0 2024-09-19T09:58:12.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.871+0000 7f1d589f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c00ebc0 con 0x55bb9f2ddd20 2024-09-19T09:58:12.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.871+0000 7f1d4f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f3268d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.871+0000 7f1d4f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f3268d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40702/0 (socket says 172.21.15.18:40702) 2024-09-19T09:58:12.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.871+0000 7f1d4f7fe640 1 -- 172.21.15.18:0/439974213 learned_addr learned my addr 172.21.15.18:0/439974213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:12.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.873+0000 7f1d4f7fe640 1 -- 172.21.15.18:0/439974213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ddd20 msgr2=0x55bb9f326390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:58:12.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.873+0000 7f1d4f7fe640 1 --2- 172.21.15.18:0/439974213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ddd20 0x55bb9f326390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.873+0000 7f1d4f7fe640 1 -- 172.21.15.18:0/439974213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 msgr2=0x55bb9f2e6490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:58:12.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.873+0000 7f1d4f7fe640 1 --2- 172.21.15.18:0/439974213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2e6490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.873+0000 7f1d4f7fe640 1 -- 172.21.15.18:0/439974213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9f2afde0 con 0x55bb9f2e1790 2024-09-19T09:58:12.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.873+0000 7f1d4f7fe640 1 --2- 172.21.15.18:0/439974213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f3268d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1d44005ab0 tx=0x7f1d44014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b3f15f028ad242 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:12.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.874+0000 7f1d357fa640 1 -- 172.21.15.18:0/439974213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400f7b0 con 0x55bb9f2e1790 2024-09-19T09:58:12.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.874+0000 7f1d357fa640 1 -- 172.21.15.18:0/439974213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d4400fe30 con 0x55bb9f2e1790 2024-09-19T09:58:12.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.874+0000 7f1d357fa640 1 -- 172.21.15.18:0/439974213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d440263f0 con 0x55bb9f2e1790 2024-09-19T09:58:12.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.876+0000 7f1d589f2740 1 -- 172.21.15.18:0/439974213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 msgr2=0x55bb9f3268d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:12.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.876+0000 7f1d589f2740 1 --2- 172.21.15.18:0/439974213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f3268d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1d44005ab0 tx=0x7f1d44014000 comp rx=0 tx=0).stop 2024-09-19T09:58:12.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.882+0000 7f1d589f2740 1 -- 172.21.15.18:0/439974213 shutdown_connections 2024-09-19T09:58:12.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.882+0000 7f1d589f2740 1 --2- 172.21.15.18:0/439974213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2e6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.882+0000 7f1d589f2740 1 --2- 172.21.15.18:0/439974213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f3268d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.882+0000 7f1d589f2740 1 --2- 172.21.15.18:0/439974213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ddd20 0x55bb9f326390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.882+0000 7f1d589f2740 1 -- 172.21.15.18:0/439974213 >> 172.21.15.18:0/439974213 conn(0x55bb9f2e98d0 msgr2=0x55bb9f2e7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:12.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.886+0000 7f1d589f2740 1 -- 172.21.15.18:0/439974213 shutdown_connections 2024-09-19T09:58:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.887+0000 7f1d589f2740 1 -- 172.21.15.18:0/439974213 wait complete. 2024-09-19T09:58:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.888+0000 7f1d589f2740 1 -- start start 2024-09-19T09:58:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.888+0000 7f1d589f2740 1 Processor -- start 2024-09-19T09:58:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.889+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ddd20 0x55bb9f2edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.889+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f2ee210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.889+0000 7f1d589f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ee750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.889+0000 7f1d589f2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c00f960 con 0x55bb9f2e1790 2024-09-19T09:58:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.889+0000 7f1d589f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c00f290 con 0x55bb9f2e20b0 2024-09-19T09:58:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.889+0000 7f1d589f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c00c4d0 con 0x55bb9f2ddd20 2024-09-19T09:58:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.889+0000 7f1d589f2740 10 client.0 _ll_register_callbacks cb 0x7f1d4809bca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.891+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ddd20 0x55bb9f2edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.894+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ddd20 0x55bb9f2edcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49454/0 (socket says 172.21.15.18:49454) 2024-09-19T09:58:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.894+0000 7f1d4ffff640 1 -- 172.21.15.18:0/1709396742 learned_addr learned my addr 172.21.15.18:0/1709396742 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.894+0000 7f1d54bb6640 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.899+0000 7f1d54bb6640 1 -- 172.21.15.18:0/1709396742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ddd20 msgr2=0x55bb9f2edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:12.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.899+0000 7f1d54bb6640 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ddd20 0x55bb9f2edcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.899+0000 7f1d54bb6640 1 -- 172.21.15.18:0/1709396742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 msgr2=0x55bb9f2ee210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:12.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.899+0000 7f1d54bb6640 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f2ee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.899+0000 7f1d54bb6640 1 -- 172.21.15.18:0/1709396742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9f2f3320 con 0x55bb9f2e20b0 2024-09-19T09:58:12.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.903+0000 7f1d54bb6640 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ee750 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1d48098850 tx=0x7f1d48009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c457ba00a58d5f88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:12.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.903+0000 7f1d2effd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:58:12.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.904+0000 7f1d2effd640 1 -- 172.21.15.18:0/1709396742 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480a8070 con 0x55bb9f2e20b0 2024-09-19T09:58:12.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.904+0000 7f1d589f2740 1 -- 172.21.15.18:0/1709396742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d4400fe30 con 0x55bb9f2e20b0 2024-09-19T09:58:12.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.904+0000 7f1d2effd640 1 -- 172.21.15.18:0/1709396742 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1d4809ad90 con 0x55bb9f2e20b0 2024-09-19T09:58:12.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.906+0000 7f1d2effd640 1 -- 172.21.15.18:0/1709396742 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1d4801f040 con 0x55bb9f2e20b0 2024-09-19T09:58:12.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.908+0000 7f1d589f2740 10 client.26489 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:12.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.908+0000 7f1d589f2740 1 -- 172.21.15.18:0/1709396742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb9f389830 con 0x55bb9f2e20b0 2024-09-19T09:58:12.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.909+0000 7f1d2effd640 1 -- 172.21.15.18:0/1709396742 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d4400fe30 con 0x55bb9f2e20b0 2024-09-19T09:58:12.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.910+0000 7f1d2effd640 1 -- 172.21.15.18:0/1709396742 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1d4807ab80 con 0x55bb9f2e20b0 2024-09-19T09:58:12.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.911+0000 7f1d589f2740 10 client.26489 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:12.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.911+0000 7f1d589f2740 10 client.26489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:12.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.911+0000 7f1d589f2740 20 client.26489 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:12.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.911+0000 7f1d589f2740 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bb9f2ec970 0x55bb9f38bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:12.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.911+0000 7f1d589f2740 4 client.26489 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:58:12.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.911+0000 7f1d589f2740 1 -- 172.21.15.18:0/1709396742 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bb9f24ed60 con 0x55bb9f2ec970 2024-09-19T09:58:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.912+0000 7f1d4ffff640 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bb9f2ec970 0x55bb9f38bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:12.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.914+0000 7f1d4ffff640 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bb9f2ec970 0x55bb9f38bf70 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a5adf1cbea96ed server_cookie=8e28c40af41ca98b in_seq=0 out_seq=0 2024-09-19T09:58:12.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.915+0000 7f1d2effd640 10 client.26489 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.917+0000 7f1d2effd640 1 -- 172.21.15.18:0/1709396742 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55bb9f24ed60 con 0x55bb9f2ec970 2024-09-19T09:58:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.917+0000 7f1d2effd640 10 client.26489 handle_command_reply: tid=0 2024-09-19T09:58:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.919+0000 7f1d589f2740 1 client.26489 shutdown 2024-09-19T09:58:12.929 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:58:12.929 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "scrub active (9 inodes in the stack)", 2024-09-19T09:58:12.929 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T09:58:12.929 INFO:teuthology.orchestra.run.smithi018.stdout: "73b5e001-0450-48bd-826a-22db2d09cf34": { 2024-09-19T09:58:12.929 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T09:58:12.929 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "73b5e001-0450-48bd-826a-22db2d09cf34", 2024-09-19T09:58:12.929 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.919+0000 7f1d589f2740 1 -- 172.21.15.18:0/1709396742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 msgr2=0x55bb9f2ee750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.920+0000 7f1d589f2740 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ee750 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1d48098850 tx=0x7f1d48009250 comp rx=0 tx=0).stop 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.920+0000 7f1d589f2740 1 -- 172.21.15.18:0/1709396742 shutdown_connections 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.920+0000 7f1d589f2740 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55bb9f2ec970 0x55bb9f38bf70 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.920+0000 7f1d589f2740 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb9f2e20b0 0x55bb9f2ee750 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.920+0000 7f1d589f2740 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb9f2e1790 0x55bb9f2ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.920+0000 7f1d589f2740 1 --2- 172.21.15.18:0/1709396742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb9f2ddd20 0x55bb9f2edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.920+0000 7f1d589f2740 1 -- 172.21.15.18:0/1709396742 >> 172.21.15.18:0/1709396742 conn(0x55bb9f2e98d0 msgr2=0x55bb9f2eaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:12.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.920+0000 7f1d2effd640 0 client.26489 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:12.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.920+0000 7f1d589f2740 1 -- 172.21.15.18:0/1709396742 shutdown_connections 2024-09-19T09:58:12.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.924+0000 7f1d589f2740 1 -- 172.21.15.18:0/1709396742 wait complete. 2024-09-19T09:58:12.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.924+0000 7f1d589f2740 20 client.26489 trim_cache size 0 max 16384 2024-09-19T09:58:12.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.927+0000 7f1d36ffd640 1 -- 172.21.15.18:0/3402854931 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d380a3390 msgr2=0x7f1d380a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:12.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.927+0000 7f1d36ffd640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d380a3390 0x7f1d380a5850 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55bb9f2df0a0 tx=0x7f1d44012040 comp rx=0 tx=0).stop 2024-09-19T09:58:12.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.927+0000 7f1d36ffd640 1 -- 172.21.15.18:0/3402854931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d50105ec0 msgr2=0x7f1d5010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:12.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.927+0000 7f1d36ffd640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d50105ec0 0x7f1d5010b110 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800eaa0 tx=0x7f1d4800ef60 comp rx=0 tx=0).stop 2024-09-19T09:58:12.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.927+0000 7f1d36ffd640 1 -- 172.21.15.18:0/3402854931 shutdown_connections 2024-09-19T09:58:12.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.927+0000 7f1d36ffd640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d380a3390 0x7f1d380a5850 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.927+0000 7f1d36ffd640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d50105ec0 0x7f1d5010b110 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.927+0000 7f1d36ffd640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d501011e0 0x7f1d501075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.927+0000 7f1d36ffd640 1 --2- 172.21.15.18:0/3402854931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d501008c0 0x7f1d501070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:12.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.927+0000 7f1d36ffd640 1 -- 172.21.15.18:0/3402854931 >> 172.21.15.18:0/3402854931 conn(0x7f1d500fc7d0 msgr2=0x7f1d500fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:12.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.931+0000 7f1d36ffd640 1 -- 172.21.15.18:0/3402854931 shutdown_connections 2024-09-19T09:58:12.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:12.932+0000 7f1d36ffd640 1 -- 172.21.15.18:0/3402854931 wait complete. 2024-09-19T09:58:14.501 INFO:tasks.cephfs.filesystem:scrub status for tag:73b5e001-0450-48bd-826a-22db2d09cf34 - {'path': '/', 'tag': '73b5e001-0450-48bd-826a-22db2d09cf34', 'options': 'recursive,force'} 2024-09-19T09:58:14.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:14 smithi018 ceph-mon[30956]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 899 MiB/s wr, 1.91k op/s 2024-09-19T09:58:14.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:14 smithi049 ceph-mon[34858]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 899 MiB/s wr, 1.91k op/s 2024-09-19T09:58:14.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:14 smithi162 ceph-mon[35174]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 899 MiB/s wr, 1.91k op/s 2024-09-19T09:58:16.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:16 smithi018 ceph-mon[30956]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 814 MiB/s wr, 1.80k op/s 2024-09-19T09:58:16.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:16 smithi049 ceph-mon[34858]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 814 MiB/s wr, 1.80k op/s 2024-09-19T09:58:16.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:16 smithi162 ceph-mon[35174]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 814 MiB/s wr, 1.80k op/s 2024-09-19T09:58:17.888 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:17 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:58:17.888 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:17 smithi018 ceph-mon[30956]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 893 MiB/s wr, 1.98k op/s 2024-09-19T09:58:17.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:17 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:58:17.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:17 smithi049 ceph-mon[34858]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 893 MiB/s wr, 1.98k op/s 2024-09-19T09:58:17.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:17 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:58:17.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:17 smithi162 ceph-mon[35174]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 893 MiB/s wr, 1.98k op/s 2024-09-19T09:58:20.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:19 smithi018 ceph-mon[30956]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 785 MiB/s wr, 1.68k op/s 2024-09-19T09:58:20.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:19 smithi049 ceph-mon[34858]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 785 MiB/s wr, 1.68k op/s 2024-09-19T09:58:20.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:19 smithi162 ceph-mon[35174]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 785 MiB/s wr, 1.68k op/s 2024-09-19T09:58:21.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:20 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T09:58:21.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:20 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T09:58:21.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:20 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T09:58:22.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:21 smithi018 ceph-mon[30956]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 815 MiB/s wr, 1.85k op/s 2024-09-19T09:58:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:21 smithi049 ceph-mon[34858]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 815 MiB/s wr, 1.85k op/s 2024-09-19T09:58:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:22 smithi162 ceph-mon[35174]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 815 MiB/s wr, 1.85k op/s 2024-09-19T09:58:24.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:24 smithi018 ceph-mon[30956]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 867 MiB/s wr, 2.14k op/s 2024-09-19T09:58:24.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:24 smithi049 ceph-mon[34858]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 867 MiB/s wr, 2.14k op/s 2024-09-19T09:58:24.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:24 smithi162 ceph-mon[35174]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 867 MiB/s wr, 2.14k op/s 2024-09-19T09:58:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.820+0000 7fe43028d640 1 -- 172.21.15.18:0/575784095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe428073980 msgr2=0x7fe42807a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:24.824 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.820+0000 7fe43028d640 1 --2- 172.21.15.18:0/575784095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe428073980 0x7fe42807a450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe418009900 tx=0x7fe41802a420 comp rx=0 tx=0).stop 2024-09-19T09:58:24.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.822+0000 7fe43028d640 1 -- 172.21.15.18:0/575784095 shutdown_connections 2024-09-19T09:58:24.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.822+0000 7fe43028d640 1 --2- 172.21.15.18:0/575784095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe428073980 0x7fe42807a450 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.822+0000 7fe43028d640 1 --2- 172.21.15.18:0/575784095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe428072fc0 0x7fe428073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.822+0000 7fe43028d640 1 --2- 172.21.15.18:0/575784095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4281096e0 0x7fe428109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.822+0000 7fe43028d640 1 -- 172.21.15.18:0/575784095 >> 172.21.15.18:0/575784095 conn(0x7fe42806ece0 msgr2=0x7fe428071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:24.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.823+0000 7fe43028d640 1 -- 172.21.15.18:0/575784095 shutdown_connections 2024-09-19T09:58:24.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.823+0000 7fe43028d640 1 -- 172.21.15.18:0/575784095 wait complete. 2024-09-19T09:58:24.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.824+0000 7fe43028d640 1 Processor -- start 2024-09-19T09:58:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.825+0000 7fe43028d640 1 -- start start 2024-09-19T09:58:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.825+0000 7fe43028d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe428072fc0 0x7fe428084cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.825+0000 7fe43028d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe428073980 0x7fe428083310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.825+0000 7fe43028d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4281096e0 0x7fe428083850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.825+0000 7fe43028d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe42807ddc0 con 0x7fe4281096e0 2024-09-19T09:58:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.825+0000 7fe43028d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe42807dc40 con 0x7fe428072fc0 2024-09-19T09:58:24.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.825+0000 7fe43028d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe42807df40 con 0x7fe428073980 2024-09-19T09:58:24.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.827+0000 7fe42e82a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4281096e0 0x7fe428083850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.827+0000 7fe42e82a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4281096e0 0x7fe428083850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52608/0 (socket says 172.21.15.18:52608) 2024-09-19T09:58:24.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.827+0000 7fe42e82a640 1 -- 172.21.15.18:0/3853404785 learned_addr learned my addr 172.21.15.18:0/3853404785 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:24.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.828+0000 7fe42d828640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe428073980 0x7fe428083310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.828+0000 7fe42e029640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe428072fc0 0x7fe428084cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.835+0000 7fe42e82a640 1 -- 172.21.15.18:0/3853404785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe428073980 msgr2=0x7fe428083310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.835+0000 7fe42e82a640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe428073980 0x7fe428083310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.835+0000 7fe42e82a640 1 -- 172.21.15.18:0/3853404785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe428072fc0 msgr2=0x7fe428084cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.835+0000 7fe42e82a640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe428072fc0 0x7fe428084cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.835+0000 7fe42e82a640 1 -- 172.21.15.18:0/3853404785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe428084020 con 0x7fe4281096e0 2024-09-19T09:58:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.836+0000 7fe42e82a640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4281096e0 0x7fe428083850 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe41802aa10 tx=0x7fe418004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.838+0000 7fe41f7fe640 1 -- 172.21.15.18:0/3853404785 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418031600 con 0x7fe4281096e0 2024-09-19T09:58:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.838+0000 7fe41f7fe640 1 -- 172.21.15.18:0/3853404785 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4180035f0 con 0x7fe4281096e0 2024-09-19T09:58:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.838+0000 7fe41f7fe640 1 -- 172.21.15.18:0/3853404785 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418045670 con 0x7fe4281096e0 2024-09-19T09:58:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.840+0000 7fe43028d640 1 -- 172.21.15.18:0/3853404785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe428132550 con 0x7fe4281096e0 2024-09-19T09:58:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.840+0000 7fe43028d640 1 -- 172.21.15.18:0/3853404785 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4281329c0 con 0x7fe4281096e0 2024-09-19T09:58:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.846+0000 7fe43302d740 1 Processor -- start 2024-09-19T09:58:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.847+0000 7fe43302d740 1 -- start start 2024-09-19T09:58:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.847+0000 7fe43302d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 0x55eadf4cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.847+0000 7fe43302d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cd600 0x55eadf4d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.847+0000 7fe43302d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.847+0000 7fe43302d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55eadf4302f0 con 0x55eadf4d2690 2024-09-19T09:58:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.847+0000 7fe43302d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55eadf3d8270 con 0x55eadf4cd600 2024-09-19T09:58:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.847+0000 7fe43302d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55eadf42c2b0 con 0x55eadf4cccc0 2024-09-19T09:58:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.853+0000 7fe42e029640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cd600 0x55eadf4d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.853+0000 7fe42e029640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cd600 0x55eadf4d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34654/0 (socket says 172.21.15.18:34654) 2024-09-19T09:58:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.853+0000 7fe42e029640 1 -- 172.21.15.18:0/668208682 learned_addr learned my addr 172.21.15.18:0/668208682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.853+0000 7fe42d828640 1 --2- 172.21.15.18:0/668208682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 0x55eadf4cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.858+0000 7fe42e029640 1 -- 172.21.15.18:0/668208682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 msgr2=0x55eadf4cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.858+0000 7fe42e029640 1 --2- 172.21.15.18:0/668208682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 0x55eadf4cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.858+0000 7fe42e029640 1 -- 172.21.15.18:0/668208682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 msgr2=0x55eadf4d4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.858+0000 7fe42e029640 1 --2- 172.21.15.18:0/668208682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4d4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.858+0000 7fe42e029640 1 -- 172.21.15.18:0/668208682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eadf3d7340 con 0x55eadf4cd600 2024-09-19T09:58:24.868 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.864+0000 7fe42e029640 1 --2- 172.21.15.18:0/668208682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cd600 0x55eadf4d20c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe420009f40 tx=0x7fe420010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2569689b4100377a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:24.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.865+0000 7fe41f7fe640 1 -- 172.21.15.18:0/3853404785 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe418043020 con 0x7fe4281096e0 2024-09-19T09:58:24.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.866+0000 7fe41f7fe640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4140a34b0 0x7fe4140a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.867+0000 7fe413fff640 1 -- 172.21.15.18:0/668208682 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420016070 con 0x55eadf4cd600 2024-09-19T09:58:24.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.867+0000 7fe42d828640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4140a34b0 0x7fe4140a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.871 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.867+0000 7fe413fff640 1 -- 172.21.15.18:0/668208682 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe420004d20 con 0x55eadf4cd600 2024-09-19T09:58:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.868+0000 7fe43302d740 1 -- 172.21.15.18:0/668208682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cd600 msgr2=0x55eadf4d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.868+0000 7fe413fff640 1 -- 172.21.15.18:0/668208682 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420016070 con 0x55eadf4cd600 2024-09-19T09:58:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.868+0000 7fe43302d740 1 --2- 172.21.15.18:0/668208682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cd600 0x55eadf4d20c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe420009f40 tx=0x7fe420010800 comp rx=0 tx=0).stop 2024-09-19T09:58:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.869+0000 7fe41f7fe640 1 -- 172.21.15.18:0/3853404785 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe4180bb0e0 con 0x7fe4281096e0 2024-09-19T09:58:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.870+0000 7fe43302d740 1 -- 172.21.15.18:0/668208682 shutdown_connections 2024-09-19T09:58:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.870+0000 7fe43302d740 1 --2- 172.21.15.18:0/668208682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4d4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.870+0000 7fe43302d740 1 --2- 172.21.15.18:0/668208682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cd600 0x55eadf4d20c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.870+0000 7fe43302d740 1 --2- 172.21.15.18:0/668208682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 0x55eadf4cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.870+0000 7fe43302d740 1 -- 172.21.15.18:0/668208682 >> 172.21.15.18:0/668208682 conn(0x55eadf4c8330 msgr2=0x55eadf4c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.872+0000 7fe42d828640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4140a34b0 0x7fe4140a5970 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe428084a40 tx=0x7fe42400a6f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.878+0000 7fe43302d740 1 -- 172.21.15.18:0/668208682 shutdown_connections 2024-09-19T09:58:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.878+0000 7fe43302d740 1 -- 172.21.15.18:0/668208682 wait complete. 2024-09-19T09:58:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.879+0000 7fe43302d740 1 -- start start 2024-09-19T09:58:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.879+0000 7fe43302d740 1 Processor -- start 2024-09-19T09:58:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.880+0000 7fe43302d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 0x55eadf4d6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.880+0000 7fe43302d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 0x55eadf4d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.880+0000 7fe43302d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4de170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.880+0000 7fe43302d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55eadf4d55d0 con 0x55eadf4d2690 2024-09-19T09:58:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.880+0000 7fe43302d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55eadf3b9290 con 0x55eadf4cccc0 2024-09-19T09:58:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.880+0000 7fe43302d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55eadf4d5750 con 0x55eadf4cd600 2024-09-19T09:58:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.880+0000 7fe43302d740 10 client.0 _ll_register_callbacks cb 0x55eadf3ea140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.883+0000 7fe42e82a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4de170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.883+0000 7fe42e82a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4de170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52622/0 (socket says 172.21.15.18:52622) 2024-09-19T09:58:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.883+0000 7fe42e82a640 1 -- 172.21.15.18:0/1359914022 learned_addr learned my addr 172.21.15.18:0/1359914022 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.883+0000 7fe42d828640 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 0x55eadf4d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.884+0000 7fe42e029640 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 0x55eadf4d6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.884+0000 7fe42d828640 1 -- 172.21.15.18:0/1359914022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 msgr2=0x55eadf4d6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.884+0000 7fe42d828640 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 0x55eadf4d6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.884+0000 7fe42d828640 1 -- 172.21.15.18:0/1359914022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 msgr2=0x55eadf4de170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.884+0000 7fe42d828640 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4de170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.884+0000 7fe42d828640 1 -- 172.21.15.18:0/1359914022 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eadf143210 con 0x55eadf4cd600 2024-09-19T09:58:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.885+0000 7fe42d828640 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 0x55eadf4d71a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe42401fbf0 tx=0x7fe424004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d4123b36a375bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.885+0000 7fe411ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:58:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.886+0000 7fe411ffb640 1 -- 172.21.15.18:0/1359914022 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424004020 con 0x55eadf4cd600 2024-09-19T09:58:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.886+0000 7fe43302d740 1 -- 172.21.15.18:0/1359914022 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe420004d20 con 0x55eadf4cd600 2024-09-19T09:58:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.886+0000 7fe411ffb640 1 -- 172.21.15.18:0/1359914022 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe424017030 con 0x55eadf4cd600 2024-09-19T09:58:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.886+0000 7fe411ffb640 1 -- 172.21.15.18:0/1359914022 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe4240041c0 con 0x55eadf4cd600 2024-09-19T09:58:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.890+0000 7fe43302d740 10 client.26491 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.890+0000 7fe43302d740 1 -- 172.21.15.18:0/1359914022 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eadf20f620 con 0x55eadf4cd600 2024-09-19T09:58:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.891+0000 7fe411ffb640 1 -- 172.21.15.18:0/1359914022 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe420004d20 con 0x55eadf4cd600 2024-09-19T09:58:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.892+0000 7fe411ffb640 1 -- 172.21.15.18:0/1359914022 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe424033480 con 0x55eadf4cd600 2024-09-19T09:58:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.893+0000 7fe43302d740 10 client.26491 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.893+0000 7fe43302d740 10 client.26491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.893+0000 7fe43302d740 20 client.26491 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.893+0000 7fe43302d740 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eadf4e2c70 0x55eadf4e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.893+0000 7fe43302d740 4 client.26491 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:58:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.893+0000 7fe43302d740 1 -- 172.21.15.18:0/1359914022 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eadf43da20 con 0x55eadf4e2c70 2024-09-19T09:58:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.894+0000 7fe42e029640 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eadf4e2c70 0x55eadf4e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.897+0000 7fe42e029640 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eadf4e2c70 0x55eadf4e50d0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8947a1a0d66c3240 server_cookie=e60fff8f3069ca75 in_seq=0 out_seq=0 2024-09-19T09:58:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.897+0000 7fe411ffb640 10 client.26491 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.902+0000 7fe411ffb640 1 -- 172.21.15.18:0/1359914022 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eadf43da20 con 0x55eadf4e2c70 2024-09-19T09:58:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.902+0000 7fe411ffb640 10 client.26491 handle_command_reply: tid=0 2024-09-19T09:58:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.902+0000 7fe43302d740 1 client.26491 shutdown 2024-09-19T09:58:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.903+0000 7fe43302d740 1 -- 172.21.15.18:0/1359914022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 msgr2=0x55eadf4d71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.903+0000 7fe43302d740 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 0x55eadf4d71a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe42401fbf0 tx=0x7fe424004730 comp rx=0 tx=0).stop 2024-09-19T09:58:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.903+0000 7fe43302d740 1 -- 172.21.15.18:0/1359914022 shutdown_connections 2024-09-19T09:58:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.903+0000 7fe43302d740 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eadf4e2c70 0x55eadf4e50d0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.903+0000 7fe43302d740 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4de170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.903+0000 7fe43302d740 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 0x55eadf4d71a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.903+0000 7fe43302d740 1 --2- 172.21.15.18:0/1359914022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 0x55eadf4d6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.903+0000 7fe43302d740 1 -- 172.21.15.18:0/1359914022 >> 172.21.15.18:0/1359914022 conn(0x55eadf4c8330 msgr2=0x55eadf4c7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.903+0000 7fe411ffb640 0 client.26491 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.907+0000 7fe43302d740 1 -- 172.21.15.18:0/1359914022 shutdown_connections 2024-09-19T09:58:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.912+0000 7fe43302d740 1 -- 172.21.15.18:0/1359914022 wait complete. 2024-09-19T09:58:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.913+0000 7fe43302d740 20 client.26491 trim_cache size 0 max 16384 2024-09-19T09:58:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.968+0000 7fe43302d740 1 Processor -- start 2024-09-19T09:58:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.971+0000 7fe43302d740 1 -- start start 2024-09-19T09:58:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.973+0000 7fe43302d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 0x55eadf4d6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.973+0000 7fe43302d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 0x55eadf4de130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.973+0000 7fe43302d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.973+0000 7fe43302d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281d1560 con 0x55eadf4d2690 2024-09-19T09:58:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.973+0000 7fe43302d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281d30a0 con 0x55eadf4cccc0 2024-09-19T09:58:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.973+0000 7fe43302d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281d1c30 con 0x55eadf4cd600 2024-09-19T09:58:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.975+0000 7fe42d828640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 0x55eadf4de130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.975+0000 7fe42d828640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 0x55eadf4de130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:59582/0 (socket says 172.21.15.18:59582) 2024-09-19T09:58:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.975+0000 7fe42d828640 1 -- 172.21.15.18:0/991313348 learned_addr learned my addr 172.21.15.18:0/991313348 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.975+0000 7fe42e029640 1 --2- 172.21.15.18:0/991313348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 0x55eadf4d6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.976+0000 7fe42e82a640 1 --2- 172.21.15.18:0/991313348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.978+0000 7fe42e029640 1 -- 172.21.15.18:0/991313348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 msgr2=0x55eadf4de130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.978+0000 7fe42e029640 1 --2- 172.21.15.18:0/991313348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 0x55eadf4de130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.978+0000 7fe42e029640 1 -- 172.21.15.18:0/991313348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 msgr2=0x55eadf4d71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.978+0000 7fe42e029640 1 --2- 172.21.15.18:0/991313348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4d71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.978+0000 7fe42e029640 1 -- 172.21.15.18:0/991313348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eadf4ce290 con 0x55eadf4cccc0 2024-09-19T09:58:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.980+0000 7fe42e029640 1 --2- 172.21.15.18:0/991313348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 0x55eadf4d6c60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe420000f80 tx=0x7fe420005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a6ea2f56170da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.981+0000 7fe4137fe640 1 -- 172.21.15.18:0/991313348 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42002b020 con 0x55eadf4cccc0 2024-09-19T09:58:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.981+0000 7fe4137fe640 1 -- 172.21.15.18:0/991313348 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe420003b70 con 0x55eadf4cccc0 2024-09-19T09:58:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.981+0000 7fe4137fe640 1 -- 172.21.15.18:0/991313348 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420016070 con 0x55eadf4cccc0 2024-09-19T09:58:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.982+0000 7fe43302d740 1 -- 172.21.15.18:0/991313348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 msgr2=0x55eadf4d6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.982+0000 7fe43302d740 1 --2- 172.21.15.18:0/991313348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 0x55eadf4d6c60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe420000f80 tx=0x7fe420005fd0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.983+0000 7fe43302d740 1 -- 172.21.15.18:0/991313348 shutdown_connections 2024-09-19T09:58:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.983+0000 7fe43302d740 1 --2- 172.21.15.18:0/991313348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4d2690 0x55eadf4d71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.983+0000 7fe43302d740 1 --2- 172.21.15.18:0/991313348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cd600 0x55eadf4de130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.983+0000 7fe43302d740 1 --2- 172.21.15.18:0/991313348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4cccc0 0x55eadf4d6c60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.983+0000 7fe43302d740 1 -- 172.21.15.18:0/991313348 >> 172.21.15.18:0/991313348 conn(0x55eadf4c8330 msgr2=0x55eadf4ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.983+0000 7fe43302d740 1 -- 172.21.15.18:0/991313348 shutdown_connections 2024-09-19T09:58:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.983+0000 7fe43302d740 1 -- 172.21.15.18:0/991313348 wait complete. 2024-09-19T09:58:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.985+0000 7fe43302d740 1 -- start start 2024-09-19T09:58:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.985+0000 7fe43302d740 1 Processor -- start 2024-09-19T09:58:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.986+0000 7fe43302d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 0x55eadf4dafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.986+0000 7fe43302d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4cd600 0x55eadf4db510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.986+0000 7fe43302d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4d2690 0x55eadf54b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.986+0000 7fe43302d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281d29d0 con 0x55eadf4cd600 2024-09-19T09:58:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.986+0000 7fe43302d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281d2300 con 0x55eadf4d2690 2024-09-19T09:58:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.986+0000 7fe43302d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281cf540 con 0x55eadf4cccc0 2024-09-19T09:58:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.986+0000 7fe43302d740 10 client.0 _ll_register_callbacks cb 0x7fe424010ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.987+0000 7fe42e029640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 0x55eadf4dafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.988+0000 7fe42e029640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 0x55eadf4dafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:59598/0 (socket says 172.21.15.18:59598) 2024-09-19T09:58:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.988+0000 7fe42e029640 1 -- 172.21.15.18:0/3775778453 learned_addr learned my addr 172.21.15.18:0/3775778453 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.988+0000 7fe42d828640 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4cd600 0x55eadf4db510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.988+0000 7fe42e82a640 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4d2690 0x55eadf54b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.990+0000 7fe42e029640 1 -- 172.21.15.18:0/3775778453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4d2690 msgr2=0x55eadf54b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.990+0000 7fe42e029640 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4d2690 0x55eadf54b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.990+0000 7fe42e029640 1 -- 172.21.15.18:0/3775778453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4cd600 msgr2=0x55eadf4db510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.990+0000 7fe42e029640 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4cd600 0x55eadf4db510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.990+0000 7fe42e029640 1 -- 172.21.15.18:0/3775778453 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eadf4d23f0 con 0x55eadf4cccc0 2024-09-19T09:58:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.993+0000 7fe42e029640 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 0x55eadf4dafd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe42000a010 tx=0x7fe420009c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe72fc10e43d670d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.993+0000 7fe4117fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:58:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.994+0000 7fe4117fa640 1 -- 172.21.15.18:0/3775778453 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420016040 con 0x55eadf4cccc0 2024-09-19T09:58:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.995+0000 7fe4117fa640 1 -- 172.21.15.18:0/3775778453 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe420012970 con 0x55eadf4cccc0 2024-09-19T09:58:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.995+0000 7fe43302d740 1 -- 172.21.15.18:0/3775778453 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe420003b70 con 0x55eadf4cccc0 2024-09-19T09:58:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.997+0000 7fe4117fa640 1 -- 172.21.15.18:0/3775778453 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe42003f050 con 0x55eadf4cccc0 2024-09-19T09:58:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.997+0000 7fe43302d740 10 client.26497 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.997+0000 7fe43302d740 1 -- 172.21.15.18:0/3775778453 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eadf54cf60 con 0x55eadf4cccc0 2024-09-19T09:58:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.999+0000 7fe4117fa640 1 -- 172.21.15.18:0/3775778453 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe420003b70 con 0x55eadf4cccc0 2024-09-19T09:58:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.999+0000 7fe4117fa640 1 -- 172.21.15.18:0/3775778453 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe42000f040 con 0x55eadf4cccc0 2024-09-19T09:58:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.999+0000 7fe43302d740 10 client.26497 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.999+0000 7fe43302d740 10 client.26497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.999+0000 7fe43302d740 20 client.26497 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:24.999+0000 7fe43302d740 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eadf54d720 0x55eadf54fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:25.000+0000 7fe43302d740 4 client.26497 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:58:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:25.000+0000 7fe43302d740 1 -- 172.21.15.18:0/3775778453 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eadf437d70 con 0x55eadf54d720 2024-09-19T09:58:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:25.000+0000 7fe42d828640 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eadf54d720 0x55eadf54fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:25.005+0000 7fe42d828640 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eadf54d720 0x55eadf54fb40 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fb4cd794f6a4c73 server_cookie=14450c1b3127e8e5 in_seq=0 out_seq=0 2024-09-19T09:58:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:25.005+0000 7fe4117fa640 10 client.26497 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:26.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:26 smithi018 ceph-mon[30956]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 845 MiB/s wr, 2.31k op/s 2024-09-19T09:58:26.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:26 smithi049 ceph-mon[34858]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 845 MiB/s wr, 2.31k op/s 2024-09-19T09:58:26.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:26 smithi162 ceph-mon[35174]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1017 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 845 MiB/s wr, 2.31k op/s 2024-09-19T09:58:28.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:28 smithi018 ceph-mon[30956]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 893 MiB/s wr, 2.40k op/s 2024-09-19T09:58:28.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:28 smithi049 ceph-mon[34858]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 893 MiB/s wr, 2.40k op/s 2024-09-19T09:58:28.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:28 smithi162 ceph-mon[35174]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 893 MiB/s wr, 2.40k op/s 2024-09-19T09:58:30.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:30 smithi018 ceph-mon[30956]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 802 MiB/s wr, 2.02k op/s 2024-09-19T09:58:30.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:30 smithi049 ceph-mon[34858]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 802 MiB/s wr, 2.02k op/s 2024-09-19T09:58:30.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:30 smithi162 ceph-mon[35174]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 802 MiB/s wr, 2.02k op/s 2024-09-19T09:58:32.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:32 smithi018 ceph-mon[30956]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 837 MiB/s wr, 1.98k op/s 2024-09-19T09:58:32.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:32 smithi049 ceph-mon[34858]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 837 MiB/s wr, 1.98k op/s 2024-09-19T09:58:32.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:32 smithi162 ceph-mon[35174]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 837 MiB/s wr, 1.98k op/s 2024-09-19T09:58:34.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:34 smithi018 ceph-mon[30956]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 893 MiB/s wr, 2.00k op/s 2024-09-19T09:58:34.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:34 smithi049 ceph-mon[34858]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 893 MiB/s wr, 2.00k op/s 2024-09-19T09:58:34.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:34 smithi162 ceph-mon[35174]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 893 MiB/s wr, 2.00k op/s 2024-09-19T09:58:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.840+0000 7fe4117fa640 1 -- 172.21.15.18:0/3775778453 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eadf437d70 con 0x55eadf54d720 2024-09-19T09:58:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.840+0000 7fe4117fa640 10 client.26497 handle_command_reply: tid=0 2024-09-19T09:58:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.840+0000 7fe43302d740 1 client.26497 shutdown 2024-09-19T09:58:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:58:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:58:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:58:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:58:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.844+0000 7fe43302d740 1 -- 172.21.15.18:0/3775778453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 msgr2=0x55eadf4dafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.844+0000 7fe43302d740 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 0x55eadf4dafd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe42000a010 tx=0x7fe420009c90 comp rx=0 tx=0).stop 2024-09-19T09:58:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.845+0000 7fe43302d740 1 -- 172.21.15.18:0/3775778453 shutdown_connections 2024-09-19T09:58:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.845+0000 7fe43302d740 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55eadf54d720 0x55eadf54fb40 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.845+0000 7fe43302d740 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55eadf4d2690 0x55eadf54b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.845+0000 7fe43302d740 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eadf4cd600 0x55eadf4db510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.845+0000 7fe43302d740 1 --2- 172.21.15.18:0/3775778453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eadf4cccc0 0x55eadf4dafd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.845+0000 7fe43302d740 1 -- 172.21.15.18:0/3775778453 >> 172.21.15.18:0/3775778453 conn(0x55eadf4c8330 msgr2=0x55eadf4d1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.845+0000 7fe4117fa640 0 client.26497 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.845+0000 7fe43302d740 1 -- 172.21.15.18:0/3775778453 shutdown_connections 2024-09-19T09:58:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.845+0000 7fe43302d740 1 -- 172.21.15.18:0/3775778453 wait complete. 2024-09-19T09:58:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.846+0000 7fe43302d740 20 client.26497 trim_cache size 0 max 16384 2024-09-19T09:58:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.864+0000 7fe41d3ff640 1 -- 172.21.15.18:0/3853404785 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4140a34b0 msgr2=0x7fe4140a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.869+0000 7fe41d3ff640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4140a34b0 0x7fe4140a5970 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe428084a40 tx=0x7fe42400a6f0 comp rx=0 tx=0).stop 2024-09-19T09:58:34.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.869+0000 7fe41d3ff640 1 -- 172.21.15.18:0/3853404785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4281096e0 msgr2=0x7fe428083850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:34.876 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.869+0000 7fe41d3ff640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4281096e0 0x7fe428083850 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe41802aa10 tx=0x7fe418004270 comp rx=0 tx=0).stop 2024-09-19T09:58:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.877+0000 7fe41d3ff640 1 -- 172.21.15.18:0/3853404785 shutdown_connections 2024-09-19T09:58:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.877+0000 7fe41d3ff640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4140a34b0 0x7fe4140a5970 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.877+0000 7fe41d3ff640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4281096e0 0x7fe428083850 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.877+0000 7fe41d3ff640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe428073980 0x7fe428083310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.877+0000 7fe41d3ff640 1 --2- 172.21.15.18:0/3853404785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe428072fc0 0x7fe428084cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.877+0000 7fe41d3ff640 1 -- 172.21.15.18:0/3853404785 >> 172.21.15.18:0/3853404785 conn(0x7fe42806ece0 msgr2=0x7fe4280763f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.877+0000 7fe41d3ff640 1 -- 172.21.15.18:0/3853404785 shutdown_connections 2024-09-19T09:58:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:34.877+0000 7fe41d3ff640 1 -- 172.21.15.18:0/3853404785 wait complete. 2024-09-19T09:58:36.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:36 smithi018 ceph-mon[30956]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 870 MiB/s wr, 1.81k op/s 2024-09-19T09:58:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:36 smithi049 ceph-mon[34858]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 870 MiB/s wr, 1.81k op/s 2024-09-19T09:58:36.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:36 smithi162 ceph-mon[35174]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 870 MiB/s wr, 1.81k op/s 2024-09-19T09:58:38.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:38 smithi018 ceph-mon[30956]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 885 MiB/s wr, 1.60k op/s 2024-09-19T09:58:38.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:38 smithi049 ceph-mon[34858]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 885 MiB/s wr, 1.60k op/s 2024-09-19T09:58:38.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:38 smithi162 ceph-mon[35174]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 885 MiB/s wr, 1.60k op/s 2024-09-19T09:58:40.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:40 smithi018 ceph-mon[30956]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1004 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 834 MiB/s wr, 1.35k op/s 2024-09-19T09:58:40.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:40 smithi049 ceph-mon[34858]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1004 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 834 MiB/s wr, 1.35k op/s 2024-09-19T09:58:40.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:40 smithi162 ceph-mon[35174]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1004 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 834 MiB/s wr, 1.35k op/s 2024-09-19T09:58:41.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:41 smithi018 ceph-mon[30956]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1004 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 872 MiB/s wr, 1.45k op/s 2024-09-19T09:58:41.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:41 smithi049 ceph-mon[34858]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1004 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 872 MiB/s wr, 1.45k op/s 2024-09-19T09:58:41.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:41 smithi162 ceph-mon[35174]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1004 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 872 MiB/s wr, 1.45k op/s 2024-09-19T09:58:44.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:43 smithi018 ceph-mon[30956]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 921 MiB/s wr, 1.57k op/s 2024-09-19T09:58:44.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:43 smithi049 ceph-mon[34858]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 921 MiB/s wr, 1.57k op/s 2024-09-19T09:58:44.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:43 smithi162 ceph-mon[35174]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 921 MiB/s wr, 1.57k op/s 2024-09-19T09:58:44.502 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:58:45.326 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:58:46.084 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:45 smithi018 ceph-mon[30956]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 892 MiB/s wr, 1.51k op/s 2024-09-19T09:58:46.084 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:45 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:58:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.183+0000 7f8f9f732640 1 -- 172.21.15.18:0/3654377942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f9811b140 msgr2=0x7f8f9811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.183+0000 7f8f9f732640 1 --2- 172.21.15.18:0/3654377942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f9811b140 0x7f8f9811d530 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009900 tx=0x7f8f8802a400 comp rx=0 tx=0).stop 2024-09-19T09:58:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.189+0000 7f8f9f732640 1 -- 172.21.15.18:0/3654377942 shutdown_connections 2024-09-19T09:58:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.189+0000 7f8f9f732640 1 --2- 172.21.15.18:0/3654377942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f9811b140 0x7f8f9811d530 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.189+0000 7f8f9f732640 1 --2- 172.21.15.18:0/3654377942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f98109830 0x7f8f98109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.189+0000 7f8f9f732640 1 --2- 172.21.15.18:0/3654377942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f98109450 0x7f8f98110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.189+0000 7f8f9f732640 1 -- 172.21.15.18:0/3654377942 >> 172.21.15.18:0/3654377942 conn(0x7f8f9806e140 msgr2=0x7f8f9806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:46.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.191+0000 7f8f9f732640 1 -- 172.21.15.18:0/3654377942 shutdown_connections 2024-09-19T09:58:46.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.191+0000 7f8f9f732640 1 -- 172.21.15.18:0/3654377942 wait complete. 2024-09-19T09:58:46.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.193+0000 7f8f9f732640 1 Processor -- start 2024-09-19T09:58:46.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.193+0000 7f8f9f732640 1 -- start start 2024-09-19T09:58:46.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.194+0000 7f8f9f732640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f98109450 0x7f8f981a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.194+0000 7f8f9f732640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f98109830 0x7f8f981a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.194+0000 7f8f9f732640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f9811b140 0x7f8f981abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.194+0000 7f8f9f732640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f98120df0 con 0x7f8f98109830 2024-09-19T09:58:46.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.194+0000 7f8f9f732640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f98120c70 con 0x7f8f9811b140 2024-09-19T09:58:46.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.194+0000 7f8f9f732640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f98120f70 con 0x7f8f98109450 2024-09-19T09:58:46.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.195+0000 7f8f9cccd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f98109830 0x7f8f981a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.195+0000 7f8f9cccd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f98109830 0x7f8f981a77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32916/0 (socket says 172.21.15.18:32916) 2024-09-19T09:58:46.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.195+0000 7f8f9cccd640 1 -- 172.21.15.18:0/2095243759 learned_addr learned my addr 172.21.15.18:0/2095243759 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:46.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.195+0000 7f8f9cccd640 1 -- 172.21.15.18:0/2095243759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f98109450 msgr2=0x7f8f981a7270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:58:46.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.195+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f98109450 0x7f8f981a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.195+0000 7f8f9cccd640 1 -- 172.21.15.18:0/2095243759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f9811b140 msgr2=0x7f8f981abb40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:58:46.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.195+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f9811b140 0x7f8f981abb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.195+0000 7f8f9cccd640 1 -- 172.21.15.18:0/2095243759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f981ac240 con 0x7f8f98109830 2024-09-19T09:58:46.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.196+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f98109830 0x7f8f981a77b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000ebc0 tx=0x7f8f9000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:46.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.197+0000 7f8f8e7fc640 1 -- 172.21.15.18:0/2095243759 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90010630 con 0x7f8f98109830 2024-09-19T09:58:46.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.197+0000 7f8f9f732640 1 -- 172.21.15.18:0/2095243759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f981ac530 con 0x7f8f98109830 2024-09-19T09:58:46.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.197+0000 7f8f9f732640 1 -- 172.21.15.18:0/2095243759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f98110920 con 0x7f8f98109830 2024-09-19T09:58:46.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.199+0000 7f8f8e7fc640 1 -- 172.21.15.18:0/2095243759 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f90010cb0 con 0x7f8f98109830 2024-09-19T09:58:46.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.199+0000 7f8f8e7fc640 1 -- 172.21.15.18:0/2095243759 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90018bd0 con 0x7f8f98109830 2024-09-19T09:58:46.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.205+0000 7f8fa1b0b740 1 Processor -- start 2024-09-19T09:58:46.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.205+0000 7f8fa1b0b740 1 -- start start 2024-09-19T09:58:46.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.206+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2ef4a0 0x56402e2ef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.206+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2efdc0 0x56402e2fa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.206+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 0x56402e2fca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.207+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56402e2552e0 con 0x56402e2fa680 2024-09-19T09:58:46.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.207+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56402e1fcce0 con 0x56402e2efdc0 2024-09-19T09:58:46.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.207+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56402e2512a0 con 0x56402e2ef4a0 2024-09-19T09:58:46.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.207+0000 7f8f9cccd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 0x56402e2fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.207+0000 7f8f9cccd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 0x56402e2fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32922/0 (socket says 172.21.15.18:32922) 2024-09-19T09:58:46.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.207+0000 7f8f9cccd640 1 -- 172.21.15.18:0/3470484187 learned_addr learned my addr 172.21.15.18:0/3470484187 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:46.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.208+0000 7f8f9cccd640 1 -- 172.21.15.18:0/3470484187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2ef4a0 msgr2=0x56402e2ef880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:58:46.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.208+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/3470484187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2ef4a0 0x56402e2ef880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.208+0000 7f8f9cccd640 1 -- 172.21.15.18:0/3470484187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2efdc0 msgr2=0x56402e2fa140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:58:46.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.208+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/3470484187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2efdc0 0x56402e2fa140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.208+0000 7f8f9cccd640 1 -- 172.21.15.18:0/3470484187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56402e1e1440 con 0x56402e2fa680 2024-09-19T09:58:46.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.209+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/3470484187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 0x56402e2fca70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8f9001a040 tx=0x7f8f90018ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c59bcc67d95bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:46.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.209+0000 7f8f837fe640 1 -- 172.21.15.18:0/3470484187 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90030020 con 0x56402e2fa680 2024-09-19T09:58:46.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.209+0000 7f8f837fe640 1 -- 172.21.15.18:0/3470484187 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f900184e0 con 0x56402e2fa680 2024-09-19T09:58:46.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.209+0000 7f8f837fe640 1 -- 172.21.15.18:0/3470484187 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90005900 con 0x56402e2fa680 2024-09-19T09:58:46.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.211+0000 7f8f8e7fc640 1 -- 172.21.15.18:0/2095243759 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8f90033020 con 0x7f8f98109830 2024-09-19T09:58:46.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.213+0000 7f8f8e7fc640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f840a3410 0x7f8f840a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.213+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3470484187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 msgr2=0x56402e2fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:46.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.213+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/3470484187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 0x56402e2fca70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8f9001a040 tx=0x7f8f90018ea0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.213+0000 7f8f8e7fc640 1 -- 172.21.15.18:0/2095243759 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8f900d4420 con 0x7f8f98109830 2024-09-19T09:58:46.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.214+0000 7f8f9dccf640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f840a3410 0x7f8f840a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.214+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3470484187 shutdown_connections 2024-09-19T09:58:46.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.215+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/3470484187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 0x56402e2fca70 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.215+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/3470484187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2efdc0 0x56402e2fa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.215+0000 7f8f9dccf640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f840a3410 0x7f8f840a58d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009230 tx=0x7f8f88005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:46.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.215+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/3470484187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2ef4a0 0x56402e2ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.215+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3470484187 >> 172.21.15.18:0/3470484187 conn(0x56402e2eba30 msgr2=0x56402e2ebe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:46.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.215+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3470484187 shutdown_connections 2024-09-19T09:58:46.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.215+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3470484187 wait complete. 2024-09-19T09:58:46.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.217+0000 7f8fa1b0b740 1 -- start start 2024-09-19T09:58:46.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.217+0000 7f8fa1b0b740 1 Processor -- start 2024-09-19T09:58:46.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.219+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2ef4a0 0x56402e2f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.219+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2efdc0 0x56402e2f7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.220+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2fa680 0x56402e2f7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.221+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56402e2fd250 con 0x56402e2efdc0 2024-09-19T09:58:46.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.221+0000 7f8f9d4ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2ef4a0 0x56402e2f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.221+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56402e210050 con 0x56402e2fa680 2024-09-19T09:58:46.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.221+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56402e2fd3d0 con 0x56402e2ef4a0 2024-09-19T09:58:46.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.221+0000 7f8fa1b0b740 10 client.0 _ll_register_callbacks cb 0x56402e250160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:46.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.221+0000 7f8f9cccd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2efdc0 0x56402e2f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.221+0000 7f8f9cccd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2efdc0 0x56402e2f7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32924/0 (socket says 172.21.15.18:32924) 2024-09-19T09:58:46.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.221+0000 7f8f9cccd640 1 -- 172.21.15.18:0/3577046 learned_addr learned my addr 172.21.15.18:0/3577046 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:46.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.221+0000 7f8f9dccf640 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2fa680 0x56402e2f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.222+0000 7f8f9cccd640 1 -- 172.21.15.18:0/3577046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2ef4a0 msgr2=0x56402e2f9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:46.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.222+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2ef4a0 0x56402e2f9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.222+0000 7f8f9cccd640 1 -- 172.21.15.18:0/3577046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2fa680 msgr2=0x56402e2f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:46.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.222+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2fa680 0x56402e2f7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.222+0000 7f8f9cccd640 1 -- 172.21.15.18:0/3577046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56402dfc63c0 con 0x56402e2efdc0 2024-09-19T09:58:46.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.223+0000 7f8f80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:58:46.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.223+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2efdc0 0x56402e2f7120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8f900a9150 tx=0x7f8f900a0480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0c08c5cffa5534 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:46.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.224+0000 7f8f80ff9640 1 -- 172.21.15.18:0/3577046 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90030070 con 0x56402e2efdc0 2024-09-19T09:58:46.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.224+0000 7f8f80ff9640 1 -- 172.21.15.18:0/3577046 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8f9009eda0 con 0x56402e2efdc0 2024-09-19T09:58:46.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.224+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3577046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f900184e0 con 0x56402e2efdc0 2024-09-19T09:58:46.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.225+0000 7f8f80ff9640 1 -- 172.21.15.18:0/3577046 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f90030070 con 0x56402e2efdc0 2024-09-19T09:58:46.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.227+0000 7f8fa1b0b740 10 client.17094 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:46.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.227+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3577046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56402e2fd250 con 0x56402e2efdc0 2024-09-19T09:58:46.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.237+0000 7f8f80ff9640 1 -- 172.21.15.18:0/3577046 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f900a4e50 con 0x56402e2efdc0 2024-09-19T09:58:46.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.239+0000 7f8f80ff9640 1 -- 172.21.15.18:0/3577046 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f9008b0f0 con 0x56402e2efdc0 2024-09-19T09:58:46.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.239+0000 7f8fa1b0b740 10 client.17094 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:46.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.239+0000 7f8fa1b0b740 10 client.17094 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:46.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.239+0000 7f8fa1b0b740 20 client.17094 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:46.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.239+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56402e309cd0 0x56402e30c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.240+0000 7f8fa1b0b740 4 client.17094 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:58:46.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.240+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3577046 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8f900184e0 con 0x56402e309cd0 2024-09-19T09:58:46.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.242+0000 7f8f9d4ce640 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56402e309cd0 0x56402e30c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.250+0000 7f8f80ff9640 10 client.17094 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:46.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.250+0000 7f8f9d4ce640 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56402e309cd0 0x56402e30c0c0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ffe2ecb316cc054 server_cookie=89fef2e2d9feb7b6 in_seq=0 out_seq=0 2024-09-19T09:58:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.256+0000 7f8f80ff9640 1 -- 172.21.15.18:0/3577046 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8f900184e0 con 0x56402e309cd0 2024-09-19T09:58:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.256+0000 7f8f80ff9640 10 client.17094 handle_command_reply: tid=0 2024-09-19T09:58:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.256+0000 7f8fa1b0b740 1 client.17094 shutdown 2024-09-19T09:58:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.257+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3577046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2efdc0 msgr2=0x56402e2f7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.257+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2efdc0 0x56402e2f7120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8f900a9150 tx=0x7f8f900a0480 comp rx=0 tx=0).stop 2024-09-19T09:58:46.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.258+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3577046 shutdown_connections 2024-09-19T09:58:46.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.258+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56402e309cd0 0x56402e30c0c0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.258+0000 7f8f80ff9640 0 client.17094 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:46.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.258+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2fa680 0x56402e2f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.258+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2efdc0 0x56402e2f7120 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.259+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/3577046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2ef4a0 0x56402e2f9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.259+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3577046 >> 172.21.15.18:0/3577046 conn(0x56402e2eba30 msgr2=0x56402e2f1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:46.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.261+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3577046 shutdown_connections 2024-09-19T09:58:46.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.261+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/3577046 wait complete. 2024-09-19T09:58:46.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.261+0000 7f8fa1b0b740 20 client.17094 trim_cache size 0 max 16384 2024-09-19T09:58:46.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.337+0000 7f8fa1b0b740 1 Processor -- start 2024-09-19T09:58:46.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.337+0000 7f8fa1b0b740 1 -- start start 2024-09-19T09:58:46.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.338+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2ef4a0 0x56402e311750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.339+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2efdc0 0x56402e311c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.339+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2fa680 0x56402e2f4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.339+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c00e430 con 0x56402e2ef4a0 2024-09-19T09:58:46.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.339+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c00ff70 con 0x56402e2efdc0 2024-09-19T09:58:46.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.339+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c00eb00 con 0x56402e2fa680 2024-09-19T09:58:46.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.341+0000 7f8f9d4ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2ef4a0 0x56402e311750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.341+0000 7f8f9d4ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2ef4a0 0x56402e311750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32932/0 (socket says 172.21.15.18:32932) 2024-09-19T09:58:46.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.341+0000 7f8f9d4ce640 1 -- 172.21.15.18:0/1118900153 learned_addr learned my addr 172.21.15.18:0/1118900153 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:46.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.342+0000 7f8f9dccf640 1 --2- 172.21.15.18:0/1118900153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2fa680 0x56402e2f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.342+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/1118900153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2efdc0 0x56402e311c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.343+0000 7f8f9d4ce640 1 -- 172.21.15.18:0/1118900153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2fa680 msgr2=0x56402e2f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:46.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.343+0000 7f8f9d4ce640 1 --2- 172.21.15.18:0/1118900153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2fa680 0x56402e2f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.343+0000 7f8f9d4ce640 1 -- 172.21.15.18:0/1118900153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2efdc0 msgr2=0x56402e311c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:46.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.343+0000 7f8f9d4ce640 1 --2- 172.21.15.18:0/1118900153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2efdc0 0x56402e311c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.343+0000 7f8f9d4ce640 1 -- 172.21.15.18:0/1118900153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56402e2eb860 con 0x56402e2ef4a0 2024-09-19T09:58:46.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.345+0000 7f8f9d4ce640 1 --2- 172.21.15.18:0/1118900153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2ef4a0 0x56402e311750 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x56402e30c690 tx=0x7f8f94005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c10504cd5f189e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.346+0000 7f8f82ffd640 1 -- 172.21.15.18:0/1118900153 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94004050 con 0x56402e2ef4a0 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.346+0000 7f8f82ffd640 1 -- 172.21.15.18:0/1118900153 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f94005500 con 0x56402e2ef4a0 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.348+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1118900153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2ef4a0 msgr2=0x56402e311750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.348+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/1118900153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2ef4a0 0x56402e311750 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x56402e30c690 tx=0x7f8f94005f90 comp rx=0 tx=0).stop 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.349+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1118900153 shutdown_connections 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.349+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/1118900153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2fa680 0x56402e2f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.349+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/1118900153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2efdc0 0x56402e311c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.349+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/1118900153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2ef4a0 0x56402e311750 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.349+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1118900153 >> 172.21.15.18:0/1118900153 conn(0x56402e2eba30 msgr2=0x56402e2eab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.349+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1118900153 shutdown_connections 2024-09-19T09:58:46.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.349+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1118900153 wait complete. 2024-09-19T09:58:46.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.350+0000 7f8fa1b0b740 1 -- start start 2024-09-19T09:58:46.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.350+0000 7f8fa1b0b740 1 Processor -- start 2024-09-19T09:58:46.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.351+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2efdc0 0x56402e302e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.351+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 0x56402e2fe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.351+0000 7f8fa1b0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2fe5f0 0x56402e2fea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.352+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c00f8a0 con 0x56402e2fa680 2024-09-19T09:58:46.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.352+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c00f1d0 con 0x56402e2fe5f0 2024-09-19T09:58:46.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.352+0000 7f8fa1b0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c00c3b0 con 0x56402e2efdc0 2024-09-19T09:58:46.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.352+0000 7f8fa1b0b740 10 client.0 _ll_register_callbacks cb 0x7f8f90009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:46.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.355+0000 7f8f9d4ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2efdc0 0x56402e302e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.355+0000 7f8f9d4ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2efdc0 0x56402e302e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54024/0 (socket says 172.21.15.18:54024) 2024-09-19T09:58:46.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.355+0000 7f8f9d4ce640 1 -- 172.21.15.18:0/1742015273 learned_addr learned my addr 172.21.15.18:0/1742015273 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:46.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.356+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 0x56402e2fe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.357+0000 7f8f9d4ce640 1 -- 172.21.15.18:0/1742015273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2fe5f0 msgr2=0x56402e2fea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:46.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.357+0000 7f8f9d4ce640 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2fe5f0 0x56402e2fea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.357+0000 7f8f9d4ce640 1 -- 172.21.15.18:0/1742015273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 msgr2=0x56402e2fe0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:46.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.357+0000 7f8f9d4ce640 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 0x56402e2fe0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.357+0000 7f8f9d4ce640 1 -- 172.21.15.18:0/1742015273 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56402e3738d0 con 0x56402e2efdc0 2024-09-19T09:58:46.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.359+0000 7f8f9d4ce640 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2efdc0 0x56402e302e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009de0 tx=0x7f8f94009e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aea9518521ed8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:46.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.359+0000 7f8f80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:58:46.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.359+0000 7f8f80ff9640 1 -- 172.21.15.18:0/1742015273 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94004250 con 0x56402e2efdc0 2024-09-19T09:58:46.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.360+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1742015273 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56402e262850 con 0x56402e2efdc0 2024-09-19T09:58:46.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.360+0000 7f8f80ff9640 1 -- 172.21.15.18:0/1742015273 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8f940043f0 con 0x56402e2efdc0 2024-09-19T09:58:46.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.361+0000 7f8f80ff9640 1 -- 172.21.15.18:0/1742015273 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f94036050 con 0x56402e2efdc0 2024-09-19T09:58:46.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.361+0000 7f8fa1b0b740 10 client.26509 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:46.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.361+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1742015273 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56402e374bb0 con 0x56402e2efdc0 2024-09-19T09:58:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.363+0000 7f8f80ff9640 1 -- 172.21.15.18:0/1742015273 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56402e262850 con 0x56402e2efdc0 2024-09-19T09:58:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.363+0000 7f8f80ff9640 1 -- 172.21.15.18:0/1742015273 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f94003ae0 con 0x56402e2efdc0 2024-09-19T09:58:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.365+0000 7f8fa1b0b740 10 client.26509 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:46.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.365+0000 7f8fa1b0b740 10 client.26509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:46.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.365+0000 7f8fa1b0b740 20 client.26509 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:46.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.365+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56402e375170 0x56402e377580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:46.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.365+0000 7f8fa1b0b740 4 client.26509 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:58:46.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.365+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1742015273 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56402e25cd60 con 0x56402e375170 2024-09-19T09:58:46.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.383+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56402e375170 0x56402e377580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:46.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.393+0000 7f8f9cccd640 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56402e375170 0x56402e377580 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52a25e37f9273f8c server_cookie=ff597e601b8dc175 in_seq=0 out_seq=0 2024-09-19T09:58:46.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.393+0000 7f8f80ff9640 10 client.26509 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:45 smithi049 ceph-mon[34858]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 892 MiB/s wr, 1.51k op/s 2024-09-19T09:58:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:45 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:58:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.405+0000 7f8f80ff9640 1 -- 172.21.15.18:0/1742015273 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56402e25cd60 con 0x56402e375170 2024-09-19T09:58:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.405+0000 7f8f80ff9640 10 client.26509 handle_command_reply: tid=0 2024-09-19T09:58:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.405+0000 7f8fa1b0b740 1 client.26509 shutdown 2024-09-19T09:58:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.407+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1742015273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2efdc0 msgr2=0x56402e302e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.407+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2efdc0 0x56402e302e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009de0 tx=0x7f8f94009e10 comp rx=0 tx=0).stop 2024-09-19T09:58:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.407+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1742015273 shutdown_connections 2024-09-19T09:58:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.407+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56402e375170 0x56402e377580 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.407+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56402e2fe5f0 0x56402e2fea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.407+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56402e2fa680 0x56402e2fe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.407+0000 7f8fa1b0b740 1 --2- 172.21.15.18:0/1742015273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56402e2efdc0 0x56402e302e20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.407+0000 7f8f80ff9640 0 client.26509 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.407+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1742015273 >> 172.21.15.18:0/1742015273 conn(0x56402e2eba30 msgr2=0x56402e2f0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.408+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1742015273 shutdown_connections 2024-09-19T09:58:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.408+0000 7f8fa1b0b740 1 -- 172.21.15.18:0/1742015273 wait complete. 2024-09-19T09:58:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.408+0000 7f8fa1b0b740 20 client.26509 trim_cache size 0 max 16384 2024-09-19T09:58:46.414 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:58:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T09:58:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T09:58:46.414 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 -- 172.21.15.18:0/2095243759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f840a3410 msgr2=0x7f8f840a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f840a3410 0x7f8f840a58d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009230 tx=0x7f8f88005fd0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 -- 172.21.15.18:0/2095243759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f98109830 msgr2=0x7f8f981a77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f98109830 0x7f8f981a77b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000ebc0 tx=0x7f8f9000c6a0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 -- 172.21.15.18:0/2095243759 shutdown_connections 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f840a3410 0x7f8f840a58d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f9811b140 0x7f8f981abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f98109830 0x7f8f981a77b0 secure :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000ebc0 tx=0x7f8f9000c6a0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 --2- 172.21.15.18:0/2095243759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f98109450 0x7f8f981a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 -- 172.21.15.18:0/2095243759 >> 172.21.15.18:0/2095243759 conn(0x7f8f9806e140 msgr2=0x7f8f9811bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.411+0000 7f8f9f732640 1 -- 172.21.15.18:0/2095243759 shutdown_connections 2024-09-19T09:58:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:46.412+0000 7f8f9f732640 1 -- 172.21.15.18:0/2095243759 wait complete. 2024-09-19T09:58:46.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:45 smithi162 ceph-mon[35174]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 892 MiB/s wr, 1.51k op/s 2024-09-19T09:58:46.416 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:45 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:58:47.582 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:58:47.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:58:48.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:48 smithi018 ceph-mon[30956]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 884 MiB/s wr, 1.51k op/s 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.200+0000 7fcb5da03640 1 -- 172.21.15.18:0/3763572019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500a6030 msgr2=0x7fcb500aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.200+0000 7fcb5da03640 1 --2- 172.21.15.18:0/3763572019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500a6030 0x7fcb500aa8d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcb58067960 tx=0x7fcb5808e4d0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.201+0000 7fcb5da03640 1 -- 172.21.15.18:0/3763572019 shutdown_connections 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.201+0000 7fcb5da03640 1 --2- 172.21.15.18:0/3763572019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500a6030 0x7fcb500aa8d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.201+0000 7fcb5da03640 1 --2- 172.21.15.18:0/3763572019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb500a5670 0x7fcb500a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.201+0000 7fcb5da03640 1 --2- 172.21.15.18:0/3763572019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb500a4540 0x7fcb500a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.201+0000 7fcb5da03640 1 -- 172.21.15.18:0/3763572019 >> 172.21.15.18:0/3763572019 conn(0x7fcb5009fba0 msgr2=0x7fcb500a2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.201+0000 7fcb5da03640 1 -- 172.21.15.18:0/3763572019 shutdown_connections 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.201+0000 7fcb5da03640 1 -- 172.21.15.18:0/3763572019 wait complete. 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.202+0000 7fcb5da03640 1 Processor -- start 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.203+0000 7fcb5da03640 1 -- start start 2024-09-19T09:58:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.203+0000 7fcb5da03640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb500a4540 0x7fcb500b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.203+0000 7fcb5da03640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500a5670 0x7fcb500b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.203+0000 7fcb5da03640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb500a6030 0x7fcb50142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.203+0000 7fcb5da03640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb500b8990 con 0x7fcb500a6030 2024-09-19T09:58:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.203+0000 7fcb5da03640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcb500b8810 con 0x7fcb500a5670 2024-09-19T09:58:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.203+0000 7fcb5da03640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb500b8b10 con 0x7fcb500a4540 2024-09-19T09:58:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.203+0000 7fcb5d202640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb500a6030 0x7fcb50142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.204+0000 7fcb5d202640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb500a6030 0x7fcb50142090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53594/0 (socket says 172.21.15.18:53594) 2024-09-19T09:58:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.204+0000 7fcb5d202640 1 -- 172.21.15.18:0/2047502927 learned_addr learned my addr 172.21.15.18:0/2047502927 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.204+0000 7fcb5d202640 1 -- 172.21.15.18:0/2047502927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb500a4540 msgr2=0x7fcb500b1000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:58:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.204+0000 7fcb5d202640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb500a4540 0x7fcb500b1000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.204+0000 7fcb5d202640 1 -- 172.21.15.18:0/2047502927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500a5670 msgr2=0x7fcb500b1540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:58:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.204+0000 7fcb5d202640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500a5670 0x7fcb500b1540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.204+0000 7fcb5d202640 1 -- 172.21.15.18:0/2047502927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb500b1be0 con 0x7fcb500a6030 2024-09-19T09:58:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.205+0000 7fcb5d202640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb500a6030 0x7fcb50142090 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fcb58065a40 tx=0x7fcb58068f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:48.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.211+0000 7fcb55ffb640 1 -- 172.21.15.18:0/2047502927 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb580a7070 con 0x7fcb500a6030 2024-09-19T09:58:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.212+0000 7fcb55ffb640 1 -- 172.21.15.18:0/2047502927 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb5809c040 con 0x7fcb500a6030 2024-09-19T09:58:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.212+0000 7fcb55ffb640 1 -- 172.21.15.18:0/2047502927 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58096690 con 0x7fcb500a6030 2024-09-19T09:58:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.212+0000 7fcb5da03640 1 -- 172.21.15.18:0/2047502927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb50142630 con 0x7fcb500a6030 2024-09-19T09:58:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.212+0000 7fcb5da03640 1 -- 172.21.15.18:0/2047502927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb50142b20 con 0x7fcb500a6030 2024-09-19T09:58:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.219+0000 7fcb61a03740 1 Processor -- start 2024-09-19T09:58:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.224+0000 7fcb61a03740 1 -- start start 2024-09-19T09:58:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.225+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 0x558a39b17fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.225+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b18500 0x558a39b1cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.225+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b1d590 0x558a39b1fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.225+0000 7fcb61a03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558a39a7b2f0 con 0x558a39b17bc0 2024-09-19T09:58:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.225+0000 7fcb61a03740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558a39a23270 con 0x558a39b18500 2024-09-19T09:58:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.225+0000 7fcb61a03740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558a39a772b0 con 0x558a39b1d590 2024-09-19T09:58:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.226+0000 7fcb57fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 0x558a39b17fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.226+0000 7fcb57fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 0x558a39b17fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53602/0 (socket says 172.21.15.18:53602) 2024-09-19T09:58:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.226+0000 7fcb57fff640 1 -- 172.21.15.18:0/1033364831 learned_addr learned my addr 172.21.15.18:0/1033364831 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:48.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.227+0000 7fcb57fff640 1 --2- 172.21.15.18:0/1033364831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b1d590 0x558a39b1fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.227+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/1033364831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b18500 0x558a39b1cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.231+0000 7fcb5ca01640 1 -- 172.21.15.18:0/1033364831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b1d590 msgr2=0x558a39b1fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.231+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/1033364831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b1d590 0x558a39b1fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.231+0000 7fcb5ca01640 1 -- 172.21.15.18:0/1033364831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 msgr2=0x558a39b17fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.231+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/1033364831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 0x558a39b17fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.231+0000 7fcb5ca01640 1 -- 172.21.15.18:0/1033364831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a39a22340 con 0x558a39b18500 2024-09-19T09:58:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.233+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/1033364831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b18500 0x558a39b1cfc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb480096a0 tx=0x7fcb48009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6985624041d6dafb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.234+0000 7fcb55ffb640 1 -- 172.21.15.18:0/2047502927 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcb580958e0 con 0x7fcb500a6030 2024-09-19T09:58:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.235+0000 7fcb55ffb640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb400a33e0 0x7fcb400a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.240+0000 7fcb57fff640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb400a33e0 0x7fcb400a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.240+0000 7fcb55ffb640 1 -- 172.21.15.18:0/2047502927 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcb58153c80 con 0x7fcb500a6030 2024-09-19T09:58:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.241+0000 7fcb5da03640 1 -- 172.21.15.18:0/1033364831 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48015030 con 0x558a39b18500 2024-09-19T09:58:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.242+0000 7fcb5da03640 1 -- 172.21.15.18:0/1033364831 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb4800b6c0 con 0x558a39b18500 2024-09-19T09:58:48.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.244+0000 7fcb61a03740 1 -- 172.21.15.18:0/1033364831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b18500 msgr2=0x558a39b1cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:48.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.244+0000 7fcb61a03740 1 --2- 172.21.15.18:0/1033364831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b18500 0x558a39b1cfc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb480096a0 tx=0x7fcb48009b60 comp rx=0 tx=0).stop 2024-09-19T09:58:48.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.244+0000 7fcb57fff640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb400a33e0 0x7fcb400a58a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c006fd0 tx=0x7fcb4c009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:48.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.245+0000 7fcb61a03740 1 -- 172.21.15.18:0/1033364831 shutdown_connections 2024-09-19T09:58:48.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.245+0000 7fcb61a03740 1 --2- 172.21.15.18:0/1033364831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b1d590 0x558a39b1fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.245+0000 7fcb61a03740 1 --2- 172.21.15.18:0/1033364831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b18500 0x558a39b1cfc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.245+0000 7fcb61a03740 1 --2- 172.21.15.18:0/1033364831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 0x558a39b17fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.245+0000 7fcb61a03740 1 -- 172.21.15.18:0/1033364831 >> 172.21.15.18:0/1033364831 conn(0x558a39b13520 msgr2=0x558a39b13920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:48.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.245+0000 7fcb61a03740 1 -- 172.21.15.18:0/1033364831 shutdown_connections 2024-09-19T09:58:48.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.245+0000 7fcb61a03740 1 -- 172.21.15.18:0/1033364831 wait complete. 2024-09-19T09:58:48.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.246+0000 7fcb61a03740 1 -- start start 2024-09-19T09:58:48.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.246+0000 7fcb61a03740 1 Processor -- start 2024-09-19T09:58:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.247+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b21dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.247+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b1d590 0x558a39b22300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.247+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b27330 0x558a39b29720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.247+0000 7fcb61a03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558a39b205b0 con 0x558a39b1d590 2024-09-19T09:58:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.247+0000 7fcb61a03740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558a39a04290 con 0x558a39b27330 2024-09-19T09:58:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.247+0000 7fcb61a03740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558a39b20730 con 0x558a39b17bc0 2024-09-19T09:58:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.247+0000 7fcb61a03740 10 client.0 _ll_register_callbacks cb 0x558a39a35140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.252+0000 7fcb5ca01640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b21dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.252+0000 7fcb5ca01640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b21dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41906/0 (socket says 172.21.15.18:41906) 2024-09-19T09:58:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.252+0000 7fcb5ca01640 1 -- 172.21.15.18:0/632958894 learned_addr learned my addr 172.21.15.18:0/632958894 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:48.255 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.253+0000 7fcb57fff640 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b1d590 0x558a39b22300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.256 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.253+0000 7fcb5d202640 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b27330 0x558a39b29720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.255+0000 7fcb5ca01640 1 -- 172.21.15.18:0/632958894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b27330 msgr2=0x558a39b29720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:48.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.255+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b27330 0x558a39b29720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.255+0000 7fcb5ca01640 1 -- 172.21.15.18:0/632958894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b1d590 msgr2=0x558a39b22300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:48.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.255+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b1d590 0x558a39b22300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.258 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.255+0000 7fcb5ca01640 1 -- 172.21.15.18:0/632958894 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a3978e210 con 0x558a39b17bc0 2024-09-19T09:58:48.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.256+0000 7fcb37fff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:58:48.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.256+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b21dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009420 tx=0x7fcb48006de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b08b3909c6715d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:48.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.257+0000 7fcb37fff640 1 -- 172.21.15.18:0/632958894 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48005a10 con 0x558a39b17bc0 2024-09-19T09:58:48.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.257+0000 7fcb37fff640 1 -- 172.21.15.18:0/632958894 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcb48005bb0 con 0x558a39b17bc0 2024-09-19T09:58:48.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.257+0000 7fcb61a03740 1 -- 172.21.15.18:0/632958894 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a39a88a20 con 0x558a39b17bc0 2024-09-19T09:58:48.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.258+0000 7fcb37fff640 1 -- 172.21.15.18:0/632958894 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb48028050 con 0x558a39b17bc0 2024-09-19T09:58:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.258+0000 7fcb61a03740 10 client.26515 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.258+0000 7fcb61a03740 1 -- 172.21.15.18:0/632958894 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a3985a620 con 0x558a39b17bc0 2024-09-19T09:58:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.259+0000 7fcb37fff640 1 -- 172.21.15.18:0/632958894 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558a39a88a20 con 0x558a39b17bc0 2024-09-19T09:58:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.260+0000 7fcb37fff640 1 -- 172.21.15.18:0/632958894 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb4801a7a0 con 0x558a39b17bc0 2024-09-19T09:58:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.260+0000 7fcb61a03740 10 client.26515 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.260+0000 7fcb61a03740 10 client.26515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.260+0000 7fcb61a03740 20 client.26515 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.260+0000 7fcb61a03740 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558a39b2dcd0 0x558a39b30130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.260+0000 7fcb61a03740 4 client.26515 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:58:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.260+0000 7fcb61a03740 1 -- 172.21.15.18:0/632958894 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a39a82d70 con 0x558a39b2dcd0 2024-09-19T09:58:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.260+0000 7fcb57fff640 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558a39b2dcd0 0x558a39b30130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.268+0000 7fcb57fff640 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558a39b2dcd0 0x558a39b30130 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31b02300fed4578e server_cookie=6fa436044d1da590 in_seq=0 out_seq=0 2024-09-19T09:58:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.268+0000 7fcb37fff640 10 client.26515 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.270+0000 7fcb37fff640 1 -- 172.21.15.18:0/632958894 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a39a82d70 con 0x558a39b2dcd0 2024-09-19T09:58:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.270+0000 7fcb37fff640 10 client.26515 handle_command_reply: tid=0 2024-09-19T09:58:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.270+0000 7fcb61a03740 1 client.26515 shutdown 2024-09-19T09:58:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.271+0000 7fcb61a03740 1 -- 172.21.15.18:0/632958894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 msgr2=0x558a39b21dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.271+0000 7fcb61a03740 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b21dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009420 tx=0x7fcb48006de0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.271+0000 7fcb61a03740 1 -- 172.21.15.18:0/632958894 shutdown_connections 2024-09-19T09:58:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.271+0000 7fcb61a03740 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558a39b2dcd0 0x558a39b30130 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.271+0000 7fcb61a03740 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b27330 0x558a39b29720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.271+0000 7fcb61a03740 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b1d590 0x558a39b22300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.271+0000 7fcb61a03740 1 --2- 172.21.15.18:0/632958894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b21dc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.271+0000 7fcb61a03740 1 -- 172.21.15.18:0/632958894 >> 172.21.15.18:0/632958894 conn(0x558a39b13520 msgr2=0x558a39b14580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.271+0000 7fcb37fff640 0 client.26515 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.272+0000 7fcb61a03740 1 -- 172.21.15.18:0/632958894 shutdown_connections 2024-09-19T09:58:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.272+0000 7fcb61a03740 1 -- 172.21.15.18:0/632958894 wait complete. 2024-09-19T09:58:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.272+0000 7fcb61a03740 20 client.26515 trim_cache size 0 max 16384 2024-09-19T09:58:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.364+0000 7fcb61a03740 1 Processor -- start 2024-09-19T09:58:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.364+0000 7fcb61a03740 1 -- start start 2024-09-19T09:58:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.365+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 0x558a39b17fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.365+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b1d590 0x558a39b21b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.365+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b27330 0x558a39b220b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.365+0000 7fcb57fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b1d590 0x558a39b21b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.366+0000 7fcb57fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b1d590 0x558a39b21b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:47002/0 (socket says 172.21.15.18:47002) 2024-09-19T09:58:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.366+0000 7fcb57fff640 1 -- 172.21.15.18:0/51903998 learned_addr learned my addr 172.21.15.18:0/51903998 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.366+0000 7fcb61a03740 1 -- 172.21.15.18:0/51903998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5014b850 con 0x558a39b17bc0 2024-09-19T09:58:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.366+0000 7fcb61a03740 1 -- 172.21.15.18:0/51903998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5014d390 con 0x558a39b1d590 2024-09-19T09:58:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.366+0000 7fcb61a03740 1 -- 172.21.15.18:0/51903998 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5014bf20 con 0x558a39b27330 2024-09-19T09:58:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.367+0000 7fcb5d202640 1 --2- 172.21.15.18:0/51903998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b27330 0x558a39b220b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.367+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/51903998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 0x558a39b17fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.369+0000 7fcb5ca01640 1 -- 172.21.15.18:0/51903998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b27330 msgr2=0x558a39b220b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.369+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/51903998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b27330 0x558a39b220b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.369+0000 7fcb5ca01640 1 -- 172.21.15.18:0/51903998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b1d590 msgr2=0x558a39b21b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.369+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/51903998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b1d590 0x558a39b21b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.369+0000 7fcb5ca01640 1 -- 172.21.15.18:0/51903998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a39ae8700 con 0x558a39b17bc0 2024-09-19T09:58:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.370+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/51903998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 0x558a39b17fa0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcb48001eb0 tx=0x7fcb48004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05667acd00a9324 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:48.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.377+0000 7fcb3e7fc640 1 -- 172.21.15.18:0/51903998 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48015050 con 0x558a39b17bc0 2024-09-19T09:58:48.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.377+0000 7fcb3e7fc640 1 -- 172.21.15.18:0/51903998 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb4801a440 con 0x558a39b17bc0 2024-09-19T09:58:48.381 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.377+0000 7fcb3e7fc640 1 -- 172.21.15.18:0/51903998 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800bc50 con 0x558a39b17bc0 2024-09-19T09:58:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.380+0000 7fcb61a03740 1 -- 172.21.15.18:0/51903998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 msgr2=0x558a39b17fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:48.383 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.381+0000 7fcb61a03740 1 --2- 172.21.15.18:0/51903998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 0x558a39b17fa0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcb48001eb0 tx=0x7fcb48004640 comp rx=0 tx=0).stop 2024-09-19T09:58:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.381+0000 7fcb61a03740 1 -- 172.21.15.18:0/51903998 shutdown_connections 2024-09-19T09:58:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.381+0000 7fcb61a03740 1 --2- 172.21.15.18:0/51903998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b27330 0x558a39b220b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.381+0000 7fcb61a03740 1 --2- 172.21.15.18:0/51903998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b1d590 0x558a39b21b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.381+0000 7fcb61a03740 1 --2- 172.21.15.18:0/51903998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b17bc0 0x558a39b17fa0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.381+0000 7fcb61a03740 1 -- 172.21.15.18:0/51903998 >> 172.21.15.18:0/51903998 conn(0x558a39b13520 msgr2=0x558a39b13900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.382+0000 7fcb61a03740 1 -- 172.21.15.18:0/51903998 shutdown_connections 2024-09-19T09:58:48.384 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.382+0000 7fcb61a03740 1 -- 172.21.15.18:0/51903998 wait complete. 2024-09-19T09:58:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.382+0000 7fcb61a03740 1 -- start start 2024-09-19T09:58:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.383+0000 7fcb61a03740 1 Processor -- start 2024-09-19T09:58:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.384+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b3cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.384+0000 7fcb61a03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b1d590 0x558a39b3d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.384+0000 7fcb5ca01640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b3cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.384+0000 7fcb5ca01640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b3cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41926/0 (socket says 172.21.15.18:41926) 2024-09-19T09:58:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.384+0000 7fcb5ca01640 1 -- 172.21.15.18:0/2567233589 learned_addr learned my addr 172.21.15.18:0/2567233589 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.385+0000 7fcb61a03740 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b27330 0x558a39b96840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.385+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5014ccc0 con 0x558a39b1d590 2024-09-19T09:58:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.385+0000 7fcb5d202640 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b27330 0x558a39b96840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.386+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5014c5f0 con 0x558a39b27330 2024-09-19T09:58:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.386+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb50149830 con 0x558a39b17bc0 2024-09-19T09:58:48.389 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.387+0000 7fcb61a03740 10 client.0 _ll_register_callbacks cb 0x7fcb4c0095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.387+0000 7fcb5ca01640 1 -- 172.21.15.18:0/2567233589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b27330 msgr2=0x558a39b96840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.387+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b27330 0x558a39b96840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.387+0000 7fcb5ca01640 1 -- 172.21.15.18:0/2567233589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b1d590 msgr2=0x558a39b3d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.387+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b1d590 0x558a39b3d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.387+0000 7fcb5ca01640 1 -- 172.21.15.18:0/2567233589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a39b96d80 con 0x558a39b17bc0 2024-09-19T09:58:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:48 smithi049 ceph-mon[34858]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 884 MiB/s wr, 1.51k op/s 2024-09-19T09:58:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.398+0000 7fcb5ca01640 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b3cf50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcb4801ab50 tx=0x7fcb48009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a145d24f58e3eb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.407+0000 7fcb37fff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:58:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.408+0000 7fcb37fff640 1 -- 172.21.15.18:0/2567233589 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48031070 con 0x558a39b17bc0 2024-09-19T09:58:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.409+0000 7fcb37fff640 1 -- 172.21.15.18:0/2567233589 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcb48005c10 con 0x558a39b17bc0 2024-09-19T09:58:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.409+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb4801a440 con 0x558a39b17bc0 2024-09-19T09:58:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.410+0000 7fcb37fff640 1 -- 172.21.15.18:0/2567233589 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb4803f070 con 0x558a39b17bc0 2024-09-19T09:58:48.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:48 smithi162 ceph-mon[35174]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 884 MiB/s wr, 1.51k op/s 2024-09-19T09:58:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.430+0000 7fcb61a03740 10 client.26521 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.430+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a39b97ee0 con 0x558a39b17bc0 2024-09-19T09:58:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.431+0000 7fcb37fff640 1 -- 172.21.15.18:0/2567233589 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb48033070 con 0x558a39b17bc0 2024-09-19T09:58:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.433+0000 7fcb37fff640 1 -- 172.21.15.18:0/2567233589 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb48038a30 con 0x558a39b17bc0 2024-09-19T09:58:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.433+0000 7fcb61a03740 10 client.26521 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.433+0000 7fcb61a03740 10 client.26521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:58:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.433+0000 7fcb61a03740 20 client.26521 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.433+0000 7fcb61a03740 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558a39b98790 0x558a39b9abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.433+0000 7fcb61a03740 4 client.26521 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:58:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.433+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fcb4801a440 con 0x558a39b98790 2024-09-19T09:58:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.435+0000 7fcb57fff640 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558a39b98790 0x558a39b9abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.436+0000 7fcb57fff640 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558a39b98790 0x558a39b9abb0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c830e7c4e4e5193 server_cookie=c5e9036a721dd7c8 in_seq=0 out_seq=0 2024-09-19T09:58:48.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:48.436+0000 7fcb37fff640 10 client.26521 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:49.094 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:58:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:58:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:58:49.351 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:49 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:58:49.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:58:49.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:58:49.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:49 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:58:49.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:58:49.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:58:49.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:49 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:58:50.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.225+0000 7f03f88f1640 1 -- 172.21.15.18:0/3992259621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03f406e4f0 msgr2=0x7f03f406e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:50.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.225+0000 7f03f88f1640 1 --2- 172.21.15.18:0/3992259621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03f406e4f0 0x7f03f406e930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f03e4008570 tx=0x7f03e400ac00 comp rx=0 tx=0).stop 2024-09-19T09:58:50.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.225+0000 7f03f88f1640 1 -- 172.21.15.18:0/3992259621 shutdown_connections 2024-09-19T09:58:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.225+0000 7f03f88f1640 1 --2- 172.21.15.18:0/3992259621 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03f406ee70 0x7f03f407a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.225+0000 7f03f88f1640 1 --2- 172.21.15.18:0/3992259621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03f406e4f0 0x7f03f406e930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.225+0000 7f03f88f1640 1 --2- 172.21.15.18:0/3992259621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f410e090 0x7f03f410e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.225+0000 7f03f88f1640 1 -- 172.21.15.18:0/3992259621 >> 172.21.15.18:0/3992259621 conn(0x7f03f4073180 msgr2=0x7f03f4073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.226+0000 7f03f88f1640 1 -- 172.21.15.18:0/3992259621 shutdown_connections 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.226+0000 7f03f88f1640 1 -- 172.21.15.18:0/3992259621 wait complete. 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.227+0000 7f03f88f1640 1 Processor -- start 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.230+0000 7f03f88f1640 1 -- start start 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.234+0000 7f03f88f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03f406ee70 0x7f03f407a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.234+0000 7f03f88f1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03f410e090 0x7f03f40743e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.234+0000 7f03f88f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f4074920 0x7f03f4074da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.234+0000 7f03f88f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f03f407d180 con 0x7f03f406ee70 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.234+0000 7f03f88f1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f03f407d000 con 0x7f03f410e090 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.234+0000 7f03f88f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03f407d300 con 0x7f03f4074920 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.236+0000 7f03f359e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f4074920 0x7f03f4074da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.236+0000 7f03f359e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f4074920 0x7f03f4074da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41954/0 (socket says 172.21.15.18:41954) 2024-09-19T09:58:50.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.236+0000 7f03f359e640 1 -- 172.21.15.18:0/4128943155 learned_addr learned my addr 172.21.15.18:0/4128943155 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.238+0000 7f03f259c640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03f410e090 0x7f03f40743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.240+0000 7f03f359e640 1 -- 172.21.15.18:0/4128943155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03f410e090 msgr2=0x7f03f40743e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.240+0000 7f03f359e640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03f410e090 0x7f03f40743e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.240+0000 7f03f359e640 1 -- 172.21.15.18:0/4128943155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03f406ee70 msgr2=0x7f03f407a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.240+0000 7f03f359e640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03f406ee70 0x7f03f407a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.240+0000 7f03f359e640 1 -- 172.21.15.18:0/4128943155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f4136fa0 con 0x7f03f4074920 2024-09-19T09:58:50.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.243+0000 7f03f359e640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f4074920 0x7f03f4074da0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f03e800b3e0 tx=0x7f03e8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:50.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.243+0000 7f03dbfff640 1 -- 172.21.15.18:0/4128943155 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e8015020 con 0x7f03f4074920 2024-09-19T09:58:50.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.244+0000 7f03f88f1640 1 -- 172.21.15.18:0/4128943155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f4137290 con 0x7f03f4074920 2024-09-19T09:58:50.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.244+0000 7f03f88f1640 1 -- 172.21.15.18:0/4128943155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f41377a0 con 0x7f03f4074920 2024-09-19T09:58:50.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.244+0000 7f03dbfff640 1 -- 172.21.15.18:0/4128943155 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03e8011d10 con 0x7f03f4074920 2024-09-19T09:58:50.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.244+0000 7f03dbfff640 1 -- 172.21.15.18:0/4128943155 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e800f2e0 con 0x7f03f4074920 2024-09-19T09:58:50.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.249+0000 7f03f88f1640 1 -- 172.21.15.18:0/4128943155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e0005290 con 0x7f03f4074920 2024-09-19T09:58:50.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.254+0000 7f03dbfff640 1 -- 172.21.15.18:0/4128943155 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f03e8018020 con 0x7f03f4074920 2024-09-19T09:58:50.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.258+0000 7f03dbfff640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f03dc0a3380 0x7f03dc0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:50.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.259+0000 7f03dbfff640 1 -- 172.21.15.18:0/4128943155 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f03e80cf110 con 0x7f03f4074920 2024-09-19T09:58:50.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.263+0000 7f03f2d9d640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f03dc0a3380 0x7f03dc0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:50.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.264+0000 7f03dbfff640 1 -- 172.21.15.18:0/4128943155 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03e801f020 con 0x7f03f4074920 2024-09-19T09:58:50.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.266+0000 7f03f2d9d640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f03dc0a3380 0x7f03dc0a5840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03ec005fd0 tx=0x7f03ec00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:50.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:50 smithi018 ceph-mon[30956]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 856 MiB/s wr, 1.60k op/s 2024-09-19T09:58:50.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:50 smithi049 ceph-mon[34858]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 856 MiB/s wr, 1.60k op/s 2024-09-19T09:58:50.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:50 smithi162 ceph-mon[35174]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 856 MiB/s wr, 1.60k op/s 2024-09-19T09:58:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.886+0000 7f03f88f1640 1 -- 172.21.15.18:0/4128943155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03e0005580 con 0x7f03f4074920 2024-09-19T09:58:50.895 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:58:50.896 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:58:50.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.888+0000 7f03dbfff640 1 -- 172.21.15.18:0/4128943155 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f03e809be00 con 0x7f03f4074920 2024-09-19T09:58:50.896 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:58:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.895+0000 7f03d9ffb640 1 -- 172.21.15.18:0/4128943155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f03dc0a3380 msgr2=0x7f03dc0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.895+0000 7f03d9ffb640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f03dc0a3380 0x7f03dc0a5840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03ec005fd0 tx=0x7f03ec00d040 comp rx=0 tx=0).stop 2024-09-19T09:58:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.895+0000 7f03d9ffb640 1 -- 172.21.15.18:0/4128943155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f4074920 msgr2=0x7f03f4074da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.895+0000 7f03d9ffb640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f4074920 0x7f03f4074da0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f03e800b3e0 tx=0x7f03e8009f90 comp rx=0 tx=0).stop 2024-09-19T09:58:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.895+0000 7f03d9ffb640 1 -- 172.21.15.18:0/4128943155 shutdown_connections 2024-09-19T09:58:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.895+0000 7f03d9ffb640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f03dc0a3380 0x7f03dc0a5840 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:50.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.895+0000 7f03d9ffb640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f4074920 0x7f03f4074da0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:50.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.895+0000 7f03d9ffb640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03f410e090 0x7f03f40743e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:50.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.895+0000 7f03d9ffb640 1 --2- 172.21.15.18:0/4128943155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03f406ee70 0x7f03f407a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:50.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.895+0000 7f03d9ffb640 1 -- 172.21.15.18:0/4128943155 >> 172.21.15.18:0/4128943155 conn(0x7f03f4073180 msgr2=0x7f03f407f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:50.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.896+0000 7f03d9ffb640 1 -- 172.21.15.18:0/4128943155 shutdown_connections 2024-09-19T09:58:50.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:50.896+0000 7f03d9ffb640 1 -- 172.21.15.18:0/4128943155 wait complete. 2024-09-19T09:58:51.691 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:51 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4128943155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:58:51.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:58:51.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:51 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/4128943155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:58:51.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:51 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/4128943155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:58:52.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:52 smithi018 ceph-mon[30956]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 843 MiB/s wr, 1.77k op/s 2024-09-19T09:58:52.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:52 smithi049 ceph-mon[34858]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 843 MiB/s wr, 1.77k op/s 2024-09-19T09:58:52.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:52 smithi162 ceph-mon[35174]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 843 MiB/s wr, 1.77k op/s 2024-09-19T09:58:52.969 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:58:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.806+0000 7f18a4c0d640 1 -- 172.21.15.18:0/2542455798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18a0109450 msgr2=0x7f18a0109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.806+0000 7f18a4c0d640 1 --2- 172.21.15.18:0/2542455798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18a0109450 0x7f18a0109830 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f18980077b0 tx=0x7f189802b430 comp rx=0 tx=0).stop 2024-09-19T09:58:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.806+0000 7f18a4c0d640 1 -- 172.21.15.18:0/2542455798 shutdown_connections 2024-09-19T09:58:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.806+0000 7f18a4c0d640 1 --2- 172.21.15.18:0/2542455798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a010ea10 0x7f18a0115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.806+0000 7f18a4c0d640 1 --2- 172.21.15.18:0/2542455798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18a0109e00 0x7f18a010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.806+0000 7f18a4c0d640 1 --2- 172.21.15.18:0/2542455798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18a0109450 0x7f18a0109830 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.806+0000 7f18a4c0d640 1 -- 172.21.15.18:0/2542455798 >> 172.21.15.18:0/2542455798 conn(0x7f18a0073660 msgr2=0x7f18a0073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.806+0000 7f18a4c0d640 1 -- 172.21.15.18:0/2542455798 shutdown_connections 2024-09-19T09:58:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.807+0000 7f18a4c0d640 1 -- 172.21.15.18:0/2542455798 wait complete. 2024-09-19T09:58:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.808+0000 7f18a4c0d640 1 Processor -- start 2024-09-19T09:58:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.808+0000 7f18a4c0d640 1 -- start start 2024-09-19T09:58:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.809+0000 7f18a4c0d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18a0109450 0x7f18a0117530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.809+0000 7f18a4c0d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18a0109e00 0x7f18a0117a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.809+0000 7f18a4c0d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a010ea10 0x7f18a0117fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.809+0000 7f18a4c0d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f18a011a5d0 con 0x7f18a0109e00 2024-09-19T09:58:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.809+0000 7f18a4c0d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f18a011a450 con 0x7f18a0109450 2024-09-19T09:58:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.809+0000 7f18a4c0d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f18a011a750 con 0x7f18a010ea10 2024-09-19T09:58:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.810+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18a0109450 0x7f18a0117530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.810+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18a0109450 0x7f18a0117530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:47048/0 (socket says 172.21.15.18:47048) 2024-09-19T09:58:53.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.810+0000 7f189f7fe640 1 -- 172.21.15.18:0/1939628001 learned_addr learned my addr 172.21.15.18:0/1939628001 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:53.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.815+0000 7f189effd640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18a0109e00 0x7f18a0117a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.815+0000 7f189f7fe640 1 -- 172.21.15.18:0/1939628001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a010ea10 msgr2=0x7f18a0117fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:58:53.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.815+0000 7f189f7fe640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a010ea10 0x7f18a0117fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.815+0000 7f189f7fe640 1 -- 172.21.15.18:0/1939628001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18a0109e00 msgr2=0x7f18a0117a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:53.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.815+0000 7f189f7fe640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18a0109e00 0x7f18a0117a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.815+0000 7f189f7fe640 1 -- 172.21.15.18:0/1939628001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a01a4c60 con 0x7f18a0109450 2024-09-19T09:58:53.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.816+0000 7f189f7fe640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18a0109450 0x7f18a0117530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f189802ba20 tx=0x7f189800a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:53.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.819+0000 7f189cff9640 1 -- 172.21.15.18:0/1939628001 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898041020 con 0x7f18a0109450 2024-09-19T09:58:53.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.819+0000 7f18a4c0d640 1 -- 172.21.15.18:0/1939628001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a01a4ef0 con 0x7f18a0109450 2024-09-19T09:58:53.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.819+0000 7f18a4c0d640 1 -- 172.21.15.18:0/1939628001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a01a5430 con 0x7f18a0109450 2024-09-19T09:58:53.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.825+0000 7f18a8248740 1 Processor -- start 2024-09-19T09:58:53.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.828+0000 7f18a8248740 1 -- start start 2024-09-19T09:58:53.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.829+0000 7f189cff9640 1 -- 172.21.15.18:0/1939628001 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1898007c50 con 0x7f18a0109450 2024-09-19T09:58:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.846+0000 7f18a8248740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833cd9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.846+0000 7f18a8248740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833cd97b0 0x55d833cd9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.846+0000 7f18a8248740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833ce4550 0x55d833ce6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.847+0000 7f18a8248740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d833c3f2f0 con 0x55d833ce4550 2024-09-19T09:58:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.847+0000 7f189effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833ce4550 0x55d833ce6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.847+0000 7f189effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833ce4550 0x55d833ce6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53664/0 (socket says 172.21.15.18:53664) 2024-09-19T09:58:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.847+0000 7f189effd640 1 -- 172.21.15.18:0/1224790286 learned_addr learned my addr 172.21.15.18:0/1224790286 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:53.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.848+0000 7f189ffff640 1 --2- 172.21.15.18:0/1224790286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833cd9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.849+0000 7f18a8248740 1 -- 172.21.15.18:0/1224790286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d833be6cf0 con 0x55d833cdad20 2024-09-19T09:58:53.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.849+0000 7f18a8248740 1 -- 172.21.15.18:0/1224790286 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d833c3b2b0 con 0x55d833cd97b0 2024-09-19T09:58:53.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.849+0000 7f189cff9640 1 -- 172.21.15.18:0/1939628001 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898037040 con 0x7f18a0109450 2024-09-19T09:58:53.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.851+0000 7f189cff9640 1 -- 172.21.15.18:0/1939628001 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f18980040a0 con 0x7f18a0109450 2024-09-19T09:58:53.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.851+0000 7f189f7fe640 1 --2- 172.21.15.18:0/1224790286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833cd97b0 0x55d833cd9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.852+0000 7f189ffff640 1 -- 172.21.15.18:0/1224790286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833cd97b0 msgr2=0x55d833cd9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:53.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.852+0000 7f189ffff640 1 --2- 172.21.15.18:0/1224790286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833cd97b0 0x55d833cd9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.852+0000 7f189ffff640 1 -- 172.21.15.18:0/1224790286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833ce4550 msgr2=0x55d833ce6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.852+0000 7f189ffff640 1 --2- 172.21.15.18:0/1224790286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833ce4550 0x55d833ce6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.852+0000 7f189ffff640 1 -- 172.21.15.18:0/1224790286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d833bcb3a0 con 0x55d833cdad20 2024-09-19T09:58:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.855+0000 7f189cff9640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f188c0a3240 0x7f188c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.855+0000 7f189ffff640 1 --2- 172.21.15.18:0/1224790286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833cd9270 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f189000b8b0 tx=0x7f189000bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82fdf04acf5fe6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:53.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.856+0000 7f189f7fe640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f188c0a3240 0x7f188c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.857+0000 7f189f7fe640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f188c0a3240 0x7f188c0a5700 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1898035040 tx=0x7f1898088180 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:53.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.858+0000 7f189cff9640 1 -- 172.21.15.18:0/1939628001 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1898032880 con 0x7f18a0109450 2024-09-19T09:58:53.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.860+0000 7f1895ffb640 1 -- 172.21.15.18:0/1224790286 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890004230 con 0x55d833cdad20 2024-09-19T09:58:53.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.860+0000 7f1895ffb640 1 -- 172.21.15.18:0/1224790286 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f189000dda0 con 0x55d833cdad20 2024-09-19T09:58:53.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.861+0000 7f18a8248740 1 -- 172.21.15.18:0/1224790286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 msgr2=0x55d833cd9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:53.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.861+0000 7f18a8248740 1 --2- 172.21.15.18:0/1224790286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833cd9270 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f189000b8b0 tx=0x7f189000bd70 comp rx=0 tx=0).stop 2024-09-19T09:58:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.863+0000 7f18a8248740 1 -- 172.21.15.18:0/1224790286 shutdown_connections 2024-09-19T09:58:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.863+0000 7f18a8248740 1 --2- 172.21.15.18:0/1224790286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833ce4550 0x55d833ce6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.863+0000 7f18a8248740 1 --2- 172.21.15.18:0/1224790286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833cd97b0 0x55d833cd9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.863+0000 7f18a8248740 1 --2- 172.21.15.18:0/1224790286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833cd9270 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.863+0000 7f18a8248740 1 -- 172.21.15.18:0/1224790286 >> 172.21.15.18:0/1224790286 conn(0x55d833ca2310 msgr2=0x55d833cd5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.864+0000 7f18a8248740 1 -- 172.21.15.18:0/1224790286 shutdown_connections 2024-09-19T09:58:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.864+0000 7f18a8248740 1 -- 172.21.15.18:0/1224790286 wait complete. 2024-09-19T09:58:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.864+0000 7f18a8248740 1 -- start start 2024-09-19T09:58:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.865+0000 7f18a8248740 1 Processor -- start 2024-09-19T09:58:53.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.869+0000 7f18a8248740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833cd97b0 0x55d833ce3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.871+0000 7f18a8248740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cdad20 0x55d833ce10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.871+0000 7f18a8248740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833ce4550 0x55d833ce1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.871+0000 7f18a8248740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d833ce72a0 con 0x55d833cdad20 2024-09-19T09:58:53.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.871+0000 7f18a8248740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d833bfa060 con 0x55d833ce4550 2024-09-19T09:58:53.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.871+0000 7f18a8248740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d833ce7420 con 0x55d833cd97b0 2024-09-19T09:58:53.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.872+0000 7f18a8248740 10 client.0 _ll_register_callbacks cb 0x55d83394d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.873+0000 7f189ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833ce4550 0x55d833ce1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.873+0000 7f189ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833ce4550 0x55d833ce1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:47062/0 (socket says 172.21.15.18:47062) 2024-09-19T09:58:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.873+0000 7f189ffff640 1 -- 172.21.15.18:0/2353432457 learned_addr learned my addr 172.21.15.18:0/2353432457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.873+0000 7f189ffff640 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833cd97b0 0x55d833ce3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.875+0000 7f189ffff640 1 -- 172.21.15.18:0/2353432457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833cd97b0 msgr2=0x55d833ce3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.876+0000 7f189ffff640 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833cd97b0 0x55d833ce3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.876+0000 7f189ffff640 1 -- 172.21.15.18:0/2353432457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cdad20 msgr2=0x55d833ce10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.876+0000 7f189ffff640 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cdad20 0x55d833ce10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.876+0000 7f189ffff640 1 -- 172.21.15.18:0/2353432457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8339b03c0 con 0x55d833ce4550 2024-09-19T09:58:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.876+0000 7f189ffff640 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833ce4550 0x55d833ce1600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1890004fd0 tx=0x7f189000bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce99b24c5eae1406 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.877+0000 7f187effd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:58:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.878+0000 7f187effd640 1 -- 172.21.15.18:0/2353432457 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189000dad0 con 0x55d833ce4550 2024-09-19T09:58:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.878+0000 7f18a8248740 1 -- 172.21.15.18:0/2353432457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f189000dda0 con 0x55d833ce4550 2024-09-19T09:58:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.878+0000 7f187effd640 1 -- 172.21.15.18:0/2353432457 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1890010460 con 0x55d833ce4550 2024-09-19T09:58:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.879+0000 7f187effd640 1 -- 172.21.15.18:0/2353432457 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1890010660 con 0x55d833ce4550 2024-09-19T09:58:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.879+0000 7f18a8248740 10 client.26546 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.879+0000 7f18a8248740 1 -- 172.21.15.18:0/2353432457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d833cf2d70 con 0x55d833ce4550 2024-09-19T09:58:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.880+0000 7f187effd640 1 -- 172.21.15.18:0/2353432457 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1890010ce0 con 0x55d833ce4550 2024-09-19T09:58:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.881+0000 7f187effd640 1 -- 172.21.15.18:0/2353432457 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f189002c980 con 0x55d833ce4550 2024-09-19T09:58:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.881+0000 7f18a8248740 10 client.26546 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.881+0000 7f18a8248740 10 client.26546 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:58:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.881+0000 7f18a8248740 20 client.26546 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.881+0000 7f18a8248740 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55d833cf4650 0x55d833cf6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.881+0000 7f18a8248740 4 client.26546 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:58:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.882+0000 7f18a8248740 1 -- 172.21.15.18:0/2353432457 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f189000dda0 con 0x55d833cf4650 2024-09-19T09:58:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.889+0000 7f189effd640 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55d833cf4650 0x55d833cf6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.891+0000 7f189effd640 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55d833cf4650 0x55d833cf6a70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e7df6e8e5c2c5f06 server_cookie=13cb2b9bb00b8367 in_seq=0 out_seq=0 2024-09-19T09:58:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.891+0000 7f187effd640 10 client.26546 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:58:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.893+0000 7f187effd640 1 -- 172.21.15.18:0/2353432457 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f189000dda0 con 0x55d833cf4650 2024-09-19T09:58:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.893+0000 7f187effd640 10 client.26546 handle_command_reply: tid=0 2024-09-19T09:58:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.893+0000 7f18a8248740 1 client.26546 shutdown 2024-09-19T09:58:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.893+0000 7f18a8248740 1 -- 172.21.15.18:0/2353432457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833ce4550 msgr2=0x55d833ce1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.893+0000 7f18a8248740 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833ce4550 0x55d833ce1600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1890004fd0 tx=0x7f189000bd70 comp rx=0 tx=0).stop 2024-09-19T09:58:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.895+0000 7f18a8248740 1 -- 172.21.15.18:0/2353432457 shutdown_connections 2024-09-19T09:58:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.895+0000 7f18a8248740 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55d833cf4650 0x55d833cf6a70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.895+0000 7f18a8248740 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833ce4550 0x55d833ce1600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.895+0000 7f18a8248740 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cdad20 0x55d833ce10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.895+0000 7f18a8248740 1 --2- 172.21.15.18:0/2353432457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833cd97b0 0x55d833ce3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.895+0000 7f18a8248740 1 -- 172.21.15.18:0/2353432457 >> 172.21.15.18:0/2353432457 conn(0x55d833ca2310 msgr2=0x55d833cdbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.895+0000 7f187effd640 0 client.26546 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:58:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.895+0000 7f18a8248740 1 -- 172.21.15.18:0/2353432457 shutdown_connections 2024-09-19T09:58:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.896+0000 7f18a8248740 1 -- 172.21.15.18:0/2353432457 wait complete. 2024-09-19T09:58:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.897+0000 7f18a8248740 20 client.26546 trim_cache size 0 max 16384 2024-09-19T09:58:53.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.944+0000 7f18a8248740 1 Processor -- start 2024-09-19T09:58:53.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.948+0000 7f18a8248740 1 -- start start 2024-09-19T09:58:53.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.949+0000 7f18a8248740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 0x55d833cf0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.950+0000 7f18a8248740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833ce3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.950+0000 7f189ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 0x55d833cf0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.950+0000 7f189ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 0x55d833cf0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53674/0 (socket says 172.21.15.18:53674) 2024-09-19T09:58:53.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.951+0000 7f189ffff640 1 -- 172.21.15.18:0/2962841240 learned_addr learned my addr 172.21.15.18:0/2962841240 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:53.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.951+0000 7f18a8248740 1 --2- 172.21.15.18:0/2962841240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 0x55d833cdc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.951+0000 7f18a8248740 1 -- 172.21.15.18:0/2962841240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f188000e3d0 con 0x55d833cd97b0 2024-09-19T09:58:53.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.951+0000 7f18a8248740 1 -- 172.21.15.18:0/2962841240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f188000ff10 con 0x55d833cdad20 2024-09-19T09:58:53.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.952+0000 7f18a8248740 1 -- 172.21.15.18:0/2962841240 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f188000eaa0 con 0x55d833ce4550 2024-09-19T09:58:53.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.953+0000 7f189effd640 1 --2- 172.21.15.18:0/2962841240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833ce3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.954+0000 7f189ffff640 1 --2- 172.21.15.18:0/2962841240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 0x55d833cdc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.955+0000 7f189effd640 1 -- 172.21.15.18:0/2962841240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 msgr2=0x55d833cdc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:53.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.955+0000 7f189effd640 1 --2- 172.21.15.18:0/2962841240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 0x55d833cdc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.955+0000 7f189effd640 1 -- 172.21.15.18:0/2962841240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 msgr2=0x55d833cf0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:53.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.955+0000 7f189effd640 1 --2- 172.21.15.18:0/2962841240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 0x55d833cf0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.955+0000 7f189effd640 1 -- 172.21.15.18:0/2962841240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d833ce39c0 con 0x55d833cdad20 2024-09-19T09:58:53.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.961+0000 7f189effd640 1 --2- 172.21.15.18:0/2962841240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833ce3030 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55d833cf72f0 tx=0x7f188800b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16f249381d812b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:53.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.962+0000 7f18957fa640 1 -- 172.21.15.18:0/2962841240 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18880130d0 con 0x55d833cdad20 2024-09-19T09:58:53.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.962+0000 7f18957fa640 1 -- 172.21.15.18:0/2962841240 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1888013270 con 0x55d833cdad20 2024-09-19T09:58:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.962+0000 7f18957fa640 1 -- 172.21.15.18:0/2962841240 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888003d70 con 0x55d833cdad20 2024-09-19T09:58:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.963+0000 7f18a8248740 1 -- 172.21.15.18:0/2962841240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 msgr2=0x55d833ce3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.963+0000 7f18a8248740 1 --2- 172.21.15.18:0/2962841240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833ce3030 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55d833cf72f0 tx=0x7f188800b7f0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.964+0000 7f18a8248740 1 -- 172.21.15.18:0/2962841240 shutdown_connections 2024-09-19T09:58:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.964+0000 7f18a8248740 1 --2- 172.21.15.18:0/2962841240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 0x55d833cdc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.964+0000 7f18a8248740 1 --2- 172.21.15.18:0/2962841240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833ce3030 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.964+0000 7f18a8248740 1 --2- 172.21.15.18:0/2962841240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 0x55d833cf0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.964+0000 7f18a8248740 1 -- 172.21.15.18:0/2962841240 >> 172.21.15.18:0/2962841240 conn(0x55d833ca2310 msgr2=0x55d833ce2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:53.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.966+0000 7f18a8248740 1 -- 172.21.15.18:0/2962841240 shutdown_connections 2024-09-19T09:58:53.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.966+0000 7f18a8248740 1 -- 172.21.15.18:0/2962841240 wait complete. 2024-09-19T09:58:53.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.967+0000 7f18a8248740 1 -- start start 2024-09-19T09:58:53.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.967+0000 7f18a8248740 1 Processor -- start 2024-09-19T09:58:53.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.968+0000 7f18a8248740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 0x55d833ce7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.969+0000 7f18a8248740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833ce7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.969+0000 7f18a8248740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 0x55d833ce81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.969+0000 7f18a8248740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f188000f840 con 0x55d833cd97b0 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.969+0000 7f18a8248740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f188000f170 con 0x55d833cdad20 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.969+0000 7f18a8248740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f188000c3b0 con 0x55d833ce4550 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.970+0000 7f18a8248740 10 client.0 _ll_register_callbacks cb 0x7f188800b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.970+0000 7f189ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 0x55d833ce7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.970+0000 7f189ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 0x55d833ce7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53676/0 (socket says 172.21.15.18:53676) 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.970+0000 7f189ffff640 1 -- 172.21.15.18:0/3593269750 learned_addr learned my addr 172.21.15.18:0/3593269750 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.970+0000 7f189ffff640 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 0x55d833ce81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.970+0000 7f189effd640 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833ce7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.971+0000 7f189ffff640 1 -- 172.21.15.18:0/3593269750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 msgr2=0x55d833ce7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.971+0000 7f189ffff640 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833ce7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.971+0000 7f189ffff640 1 -- 172.21.15.18:0/3593269750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 msgr2=0x55d833ce7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.971+0000 7f189ffff640 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 0x55d833ce7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.971+0000 7f189ffff640 1 -- 172.21.15.18:0/3593269750 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d833d5d590 con 0x55d833ce4550 2024-09-19T09:58:53.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.971+0000 7f189ffff640 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 0x55d833ce81d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1890010630 tx=0x7f1890005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a14c043b06261cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:53.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.972+0000 7f187effd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:58:53.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.972+0000 7f187effd640 1 -- 172.21.15.18:0/3593269750 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189003c060 con 0x55d833ce4550 2024-09-19T09:58:53.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.972+0000 7f187effd640 1 -- 172.21.15.18:0/3593269750 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1890004040 con 0x55d833ce4550 2024-09-19T09:58:53.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.972+0000 7f18a8248740 1 -- 172.21.15.18:0/3593269750 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1888013270 con 0x55d833ce4550 2024-09-19T09:58:53.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.975+0000 7f187effd640 1 -- 172.21.15.18:0/3593269750 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1890004240 con 0x55d833ce4550 2024-09-19T09:58:53.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.975+0000 7f18a8248740 10 client.26539 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:53.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.975+0000 7f18a8248740 1 -- 172.21.15.18:0/3593269750 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d833d5e870 con 0x55d833ce4550 2024-09-19T09:58:53.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.977+0000 7f187effd640 1 -- 172.21.15.18:0/3593269750 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1888013270 con 0x55d833ce4550 2024-09-19T09:58:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.978+0000 7f187effd640 1 -- 172.21.15.18:0/3593269750 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f189002c5c0 con 0x55d833ce4550 2024-09-19T09:58:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.979+0000 7f18a8248740 10 client.26539 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.979+0000 7f18a8248740 10 client.26539 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:58:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.979+0000 7f18a8248740 20 client.26539 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.979+0000 7f18a8248740 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55d833d5ee80 0x55d833d612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.979+0000 7f18a8248740 4 client.26539 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:58:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.979+0000 7f18a8248740 1 -- 172.21.15.18:0/3593269750 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d833c4c860 con 0x55d833d5ee80 2024-09-19T09:58:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.980+0000 7f189effd640 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55d833d5ee80 0x55d833d612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.981+0000 7f189effd640 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55d833d5ee80 0x55d833d612a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c339f9269944115f server_cookie=83fd8f1fe78ad089 in_seq=0 out_seq=0 2024-09-19T09:58:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.981+0000 7f187effd640 10 client.26539 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:58:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.981+0000 7f187effd640 1 -- 172.21.15.18:0/3593269750 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f188800bc60 con 0x55d833d5ee80 2024-09-19T09:58:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.981+0000 7f187effd640 10 client.26539 handle_command_reply: tid=0 2024-09-19T09:58:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.981+0000 7f18a8248740 1 client.26539 shutdown 2024-09-19T09:58:53.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.983+0000 7f18a8248740 1 -- 172.21.15.18:0/3593269750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 msgr2=0x55d833ce81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:53.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.983+0000 7f18a8248740 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 0x55d833ce81d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1890010630 tx=0x7f1890005970 comp rx=0 tx=0).stop 2024-09-19T09:58:53.988 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:58:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.983+0000 7f18a8248740 1 -- 172.21.15.18:0/3593269750 shutdown_connections 2024-09-19T09:58:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.984+0000 7f18a8248740 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55d833d5ee80 0x55d833d612a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.984+0000 7f18a8248740 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d833ce4550 0x55d833ce81d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.984+0000 7f18a8248740 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d833cdad20 0x55d833ce7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.984+0000 7f18a8248740 1 --2- 172.21.15.18:0/3593269750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d833cd97b0 0x55d833ce7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.984+0000 7f18a8248740 1 -- 172.21.15.18:0/3593269750 >> 172.21.15.18:0/3593269750 conn(0x55d833ca2310 msgr2=0x55d833ce3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.984+0000 7f187effd640 0 client.26539 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:58:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.984+0000 7f18a8248740 1 -- 172.21.15.18:0/3593269750 shutdown_connections 2024-09-19T09:58:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.984+0000 7f18a8248740 1 -- 172.21.15.18:0/3593269750 wait complete. 2024-09-19T09:58:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.984+0000 7f18a8248740 20 client.26539 trim_cache size 0 max 16384 2024-09-19T09:58:53.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.988+0000 7f18a4c0d640 1 -- 172.21.15.18:0/1939628001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f188c0a3240 msgr2=0x7f188c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:53.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.988+0000 7f18a4c0d640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f188c0a3240 0x7f188c0a5700 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1898035040 tx=0x7f1898088180 comp rx=0 tx=0).stop 2024-09-19T09:58:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.988+0000 7f18a4c0d640 1 -- 172.21.15.18:0/1939628001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18a0109450 msgr2=0x7f18a0117530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.988+0000 7f18a4c0d640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18a0109450 0x7f18a0117530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f189802ba20 tx=0x7f189800a300 comp rx=0 tx=0).stop 2024-09-19T09:58:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.988+0000 7f18a4c0d640 1 -- 172.21.15.18:0/1939628001 shutdown_connections 2024-09-19T09:58:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.988+0000 7f18a4c0d640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f188c0a3240 0x7f188c0a5700 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.988+0000 7f18a4c0d640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18a010ea10 0x7f18a0117fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.988+0000 7f18a4c0d640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18a0109e00 0x7f18a0117a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.988+0000 7f18a4c0d640 1 --2- 172.21.15.18:0/1939628001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18a0109450 0x7f18a0117530 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.988+0000 7f18a4c0d640 1 -- 172.21.15.18:0/1939628001 >> 172.21.15.18:0/1939628001 conn(0x7f18a0073660 msgr2=0x7f18a010c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:53.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.991+0000 7f18a4c0d640 1 -- 172.21.15.18:0/1939628001 shutdown_connections 2024-09-19T09:58:53.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:53.991+0000 7f18a4c0d640 1 -- 172.21.15.18:0/1939628001 wait complete. 2024-09-19T09:58:54.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:54 smithi018 ceph-mon[30956]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 878 MiB/s wr, 2.06k op/s 2024-09-19T09:58:54.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:54 smithi049 ceph-mon[34858]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 878 MiB/s wr, 2.06k op/s 2024-09-19T09:58:54.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:54 smithi162 ceph-mon[35174]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 878 MiB/s wr, 2.06k op/s 2024-09-19T09:58:55.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:58:56.641 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:58:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.780+0000 7fcb37fff640 1 -- 172.21.15.18:0/2567233589 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fcb4801a440 con 0x558a39b98790 2024-09-19T09:58:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.780+0000 7fcb37fff640 10 client.26521 handle_command_reply: tid=0 2024-09-19T09:58:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.780+0000 7fcb61a03740 1 client.26521 shutdown 2024-09-19T09:58:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.780+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 msgr2=0x558a39b3cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.780+0000 7fcb61a03740 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b3cf50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcb4801ab50 tx=0x7fcb48009520 comp rx=0 tx=0).stop 2024-09-19T09:58:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.782+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 shutdown_connections 2024-09-19T09:58:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.782+0000 7fcb61a03740 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558a39b98790 0x558a39b9abb0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.782+0000 7fcb61a03740 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558a39b27330 0x558a39b96840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.782+0000 7fcb61a03740 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a39b1d590 0x558a39b3d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.782+0000 7fcb61a03740 1 --2- 172.21.15.18:0/2567233589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558a39b17bc0 0x558a39b3cf50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.782+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 >> 172.21.15.18:0/2567233589 conn(0x558a39b13520 msgr2=0x558a39b11eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.782+0000 7fcb37fff640 0 client.26521 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:58:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.782+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 shutdown_connections 2024-09-19T09:58:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.782+0000 7fcb61a03740 1 -- 172.21.15.18:0/2567233589 wait complete. 2024-09-19T09:58:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.782+0000 7fcb61a03740 20 client.26521 trim_cache size 0 max 16384 2024-09-19T09:58:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:58:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:58:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:58:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:58:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.787+0000 7fcb3f7fe640 1 -- 172.21.15.18:0/2047502927 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb400a33e0 msgr2=0x7fcb400a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.787+0000 7fcb3f7fe640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb400a33e0 0x7fcb400a58a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c006fd0 tx=0x7fcb4c009060 comp rx=0 tx=0).stop 2024-09-19T09:58:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.787+0000 7fcb3f7fe640 1 -- 172.21.15.18:0/2047502927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb500a6030 msgr2=0x7fcb50142090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.787+0000 7fcb3f7fe640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb500a6030 0x7fcb50142090 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fcb58065a40 tx=0x7fcb58068f30 comp rx=0 tx=0).stop 2024-09-19T09:58:56.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.806+0000 7fcb3f7fe640 1 -- 172.21.15.18:0/2047502927 shutdown_connections 2024-09-19T09:58:56.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.806+0000 7fcb3f7fe640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb400a33e0 0x7fcb400a58a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:56.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.806+0000 7fcb3f7fe640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb500a6030 0x7fcb50142090 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:56.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.806+0000 7fcb3f7fe640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500a5670 0x7fcb500b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:56.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.806+0000 7fcb3f7fe640 1 --2- 172.21.15.18:0/2047502927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb500a4540 0x7fcb500b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:56.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.806+0000 7fcb3f7fe640 1 -- 172.21.15.18:0/2047502927 >> 172.21.15.18:0/2047502927 conn(0x7fcb5009fba0 msgr2=0x7fcb500a07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:56.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.807+0000 7fcb3f7fe640 1 -- 172.21.15.18:0/2047502927 shutdown_connections 2024-09-19T09:58:56.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:58:56.807+0000 7fcb3f7fe640 1 -- 172.21.15.18:0/2047502927 wait complete. 2024-09-19T09:58:56.832 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:56 smithi018 ceph-mon[30956]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 853 MiB/s wr, 2.10k op/s 2024-09-19T09:58:56.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:56 smithi049 ceph-mon[34858]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 853 MiB/s wr, 2.10k op/s 2024-09-19T09:58:56.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:56 smithi162 ceph-mon[35174]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 853 MiB/s wr, 2.10k op/s 2024-09-19T09:58:57.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:57 smithi162 ceph-mon[35174]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 873 MiB/s wr, 2.07k op/s 2024-09-19T09:58:57.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:57 smithi018 ceph-mon[30956]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 873 MiB/s wr, 2.07k op/s 2024-09-19T09:58:57.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.958+0000 7fe8e5742640 1 -- 172.21.15.18:0/252472338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0109450 msgr2=0x7fe8e0109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:57.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.958+0000 7fe8e5742640 1 --2- 172.21.15.18:0/252472338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0109450 0x7fe8e0109830 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009900 tx=0x7fe8d002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.960+0000 7fe8e5742640 1 -- 172.21.15.18:0/252472338 shutdown_connections 2024-09-19T09:58:57.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.960+0000 7fe8e5742640 1 --2- 172.21.15.18:0/252472338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e0074990 0x7fe8e007b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.960+0000 7fe8e5742640 1 --2- 172.21.15.18:0/252472338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e0109e00 0x7fe8e00742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.960+0000 7fe8e5742640 1 --2- 172.21.15.18:0/252472338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0109450 0x7fe8e0109830 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.960+0000 7fe8e5742640 1 -- 172.21.15.18:0/252472338 >> 172.21.15.18:0/252472338 conn(0x7fe8e006e140 msgr2=0x7fe8e006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.960+0000 7fe8e5742640 1 -- 172.21.15.18:0/252472338 shutdown_connections 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.960+0000 7fe8e5742640 1 -- 172.21.15.18:0/252472338 wait complete. 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.961+0000 7fe8e5742640 1 Processor -- start 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.961+0000 7fe8e5742640 1 -- start start 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.962+0000 7fe8e5742640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0074990 0x7fe8e007b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.962+0000 7fe8e5742640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e0109450 0x7fe8e0076250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.962+0000 7fe8e5742640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e0109e00 0x7fe8e0076790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.962+0000 7fe8e5742640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e007e7b0 con 0x7fe8e0074990 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.962+0000 7fe8e5742640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e007e630 con 0x7fe8e0109450 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.962+0000 7fe8e5742640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e007e930 con 0x7fe8e0109e00 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.962+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0074990 0x7fe8e007b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.962+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0074990 0x7fe8e007b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51164/0 (socket says 172.21.15.18:51164) 2024-09-19T09:58:57.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.962+0000 7fe8deffd640 1 -- 172.21.15.18:0/1024251227 learned_addr learned my addr 172.21.15.18:0/1024251227 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:57.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.963+0000 7fe8d7fff640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e0109450 0x7fe8e0076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:57.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.965+0000 7fe8d7fff640 1 -- 172.21.15.18:0/1024251227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e0109e00 msgr2=0x7fe8e0076790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:58:57.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.965+0000 7fe8d7fff640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e0109e00 0x7fe8e0076790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.965+0000 7fe8d7fff640 1 -- 172.21.15.18:0/1024251227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0074990 msgr2=0x7fe8e007b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:57.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.965+0000 7fe8d7fff640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0074990 0x7fe8e007b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.965+0000 7fe8d7fff640 1 -- 172.21.15.18:0/1024251227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e0077020 con 0x7fe8e0109450 2024-09-19T09:58:57.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.966+0000 7fe8d7fff640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e0109450 0x7fe8e0076250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe8e006f670 tx=0x7fe8c800cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:57.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.968+0000 7fe8dcff9640 1 -- 172.21.15.18:0/1024251227 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8007bb0 con 0x7fe8e0109450 2024-09-19T09:58:57.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.968+0000 7fe8dcff9640 1 -- 172.21.15.18:0/1024251227 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8c8007d50 con 0x7fe8e0109450 2024-09-19T09:58:57.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.968+0000 7fe8dcff9640 1 -- 172.21.15.18:0/1024251227 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c800f450 con 0x7fe8e0109450 2024-09-19T09:58:57.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.968+0000 7fe8e5742640 1 -- 172.21.15.18:0/1024251227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e01c4810 con 0x7fe8e0109450 2024-09-19T09:58:57.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.968+0000 7fe8e5742640 1 -- 172.21.15.18:0/1024251227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e01c4d00 con 0x7fe8e0109450 2024-09-19T09:58:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.977+0000 7fe8e7b1b740 1 Processor -- start 2024-09-19T09:58:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.978+0000 7fe8dcff9640 1 -- 172.21.15.18:0/1024251227 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe8c800f5f0 con 0x7fe8e0109450 2024-09-19T09:58:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.979+0000 7fe8dcff9640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8cc0a3450 0x7fe8cc0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.980+0000 7fe8dcff9640 1 -- 172.21.15.18:0/1024251227 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe8c80cf580 con 0x7fe8e0109450 2024-09-19T09:58:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.981+0000 7fe8e7b1b740 1 -- start start 2024-09-19T09:58:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.982+0000 7fe8e7b1b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfeeb40 0x55e22bfed090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.982+0000 7fe8e7b1b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfed5d0 0x55e22bfeda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.982+0000 7fe8e7b1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 0x55e22c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.982+0000 7fe8e7b1b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e22bf532f0 con 0x55e22bfed5d0 2024-09-19T09:58:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.983+0000 7fe8e7b1b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e22befacf0 con 0x55e22bfeeb40 2024-09-19T09:58:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.983+0000 7fe8e7b1b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e22bf4f2b0 con 0x55e22c009380 2024-09-19T09:58:57.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.987+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfeeb40 0x55e22bfed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:57.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.987+0000 7fe8d7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfed5d0 0x55e22bfeda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:57.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.987+0000 7fe8d7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfed5d0 0x55e22bfeda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51170/0 (socket says 172.21.15.18:51170) 2024-09-19T09:58:57.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.987+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfeeb40 0x55e22bfed090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41710/0 (socket says 172.21.15.18:41710) 2024-09-19T09:58:57.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.987+0000 7fe8d7fff640 1 -- 172.21.15.18:0/3151317933 learned_addr learned my addr 172.21.15.18:0/3151317933 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:57.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.987+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/3151317933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 0x55e22c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.987+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8cc0a3450 0x7fe8cc0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.988+0000 7fe8df7fe640 1 -- 172.21.15.18:0/3151317933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfeeb40 msgr2=0x55e22bfed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.988+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/3151317933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfeeb40 0x55e22bfed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.988+0000 7fe8df7fe640 1 -- 172.21.15.18:0/3151317933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfed5d0 msgr2=0x55e22bfeda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.988+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/3151317933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfed5d0 0x55e22bfeda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.988+0000 7fe8df7fe640 1 -- 172.21.15.18:0/3151317933 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e22bedf3a0 con 0x55e22c009380 2024-09-19T09:58:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.988+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/3151317933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 0x55e22c00b770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8e007b8d0 tx=0x7fe8d8013c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6375135ba8c11936 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.990+0000 7fe8d57fa640 1 -- 172.21.15.18:0/3151317933 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8020070 con 0x55e22c009380 2024-09-19T09:58:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.990+0000 7fe8d57fa640 1 -- 172.21.15.18:0/3151317933 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d8011e40 con 0x55e22c009380 2024-09-19T09:58:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.990+0000 7fe8d57fa640 1 -- 172.21.15.18:0/3151317933 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800c350 con 0x55e22c009380 2024-09-19T09:58:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.991+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3151317933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 msgr2=0x55e22c00b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.991+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3151317933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 0x55e22c00b770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8e007b8d0 tx=0x7fe8d8013c30 comp rx=0 tx=0).stop 2024-09-19T09:58:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.991+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3151317933 shutdown_connections 2024-09-19T09:58:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.991+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3151317933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 0x55e22c00b770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.991+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3151317933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfed5d0 0x55e22bfeda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.991+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3151317933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfeeb40 0x55e22bfed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.991+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3151317933 >> 172.21.15.18:0/3151317933 conn(0x55e22bfb6310 msgr2=0x55e22bfe9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.992+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3151317933 shutdown_connections 2024-09-19T09:58:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.992+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3151317933 wait complete. 2024-09-19T09:58:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.992+0000 7fe8e7b1b740 1 -- start start 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.992+0000 7fe8e7b1b740 1 Processor -- start 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.993+0000 7fe8e7b1b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfed5d0 0x55e22c008dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.993+0000 7fe8e7b1b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 0x55e22c006070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.993+0000 7fe8e7b1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 0x55e22c006800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.993+0000 7fe8e7b1b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e22c00c080 con 0x55e22bfeeb40 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.993+0000 7fe8e7b1b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e22bf0e060 con 0x55e22bfed5d0 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.993+0000 7fe8e7b1b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e22c00c200 con 0x55e22c009380 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.993+0000 7fe8e7b1b740 10 client.0 _ll_register_callbacks cb 0x55e22bc618c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.994+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfed5d0 0x55e22c008dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.994+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfed5d0 0x55e22c008dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41714/0 (socket says 172.21.15.18:41714) 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.994+0000 7fe8deffd640 1 -- 172.21.15.18:0/3944143995 learned_addr learned my addr 172.21.15.18:0/3944143995 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.994+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 0x55e22c006800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.994+0000 7fe8deffd640 1 -- 172.21.15.18:0/3944143995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 msgr2=0x55e22c006800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.994+0000 7fe8deffd640 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 0x55e22c006800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.995+0000 7fe8deffd640 1 -- 172.21.15.18:0/3944143995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 msgr2=0x55e22c006070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.995+0000 7fe8deffd640 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 0x55e22c006070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.995+0000 7fe8deffd640 1 -- 172.21.15.18:0/3944143995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e22bcc43c0 con 0x55e22bfed5d0 2024-09-19T09:58:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.998+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8cc0a3450 0x7fe8cc0a5910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8005fd0 tx=0x7fe8d80096e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.998+0000 7fe8deffd640 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfed5d0 0x55e22c008dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0004580 tx=0x7fe8d00045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fed8e50ea805178 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.999+0000 7fe8c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:58:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.999+0000 7fe8c67fc640 1 -- 172.21.15.18:0/3944143995 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0035040 con 0x55e22bfed5d0 2024-09-19T09:58:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.999+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3944143995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e22bf60860 con 0x55e22bfed5d0 2024-09-19T09:58:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:57.999+0000 7fe8c67fc640 1 -- 172.21.15.18:0/3944143995 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe8d0005220 con 0x55e22bfed5d0 2024-09-19T09:58:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.001+0000 7fe8c67fc640 1 -- 172.21.15.18:0/3944143995 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe8d0005440 con 0x55e22bfed5d0 2024-09-19T09:58:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.001+0000 7fe8e7b1b740 10 client.26561 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.001+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3944143995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e22bff2950 con 0x55e22bfed5d0 2024-09-19T09:58:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.003+0000 7fe8c67fc640 1 -- 172.21.15.18:0/3944143995 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e22bf60860 con 0x55e22bfed5d0 2024-09-19T09:58:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.003+0000 7fe8c67fc640 1 -- 172.21.15.18:0/3944143995 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe8d0004c20 con 0x55e22bfed5d0 2024-09-19T09:58:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.003+0000 7fe8e7b1b740 10 client.26561 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.003+0000 7fe8e7b1b740 10 client.26561 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:58:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.003+0000 7fe8e7b1b740 20 client.26561 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.003+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55e22bff4140 0x55e22bff6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.003+0000 7fe8e7b1b740 4 client.26561 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:58:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.003+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3944143995 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e22bf5ad70 con 0x55e22bff4140 2024-09-19T09:58:58.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.006+0000 7fe8d7fff640 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55e22bff4140 0x55e22bff6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:58.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.009+0000 7fe8d7fff640 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55e22bff4140 0x55e22bff6600 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=568a30823ac62c97 server_cookie=2b739328b3b6f313 in_seq=0 out_seq=0 2024-09-19T09:58:58.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.009+0000 7fe8c67fc640 10 client.26561 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:58:58.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.010+0000 7fe8c67fc640 1 -- 172.21.15.18:0/3944143995 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e22bf5ad70 con 0x55e22bff4140 2024-09-19T09:58:58.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.010+0000 7fe8c67fc640 10 client.26561 handle_command_reply: tid=0 2024-09-19T09:58:58.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.010+0000 7fe8e7b1b740 1 client.26561 shutdown 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.011+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3944143995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfed5d0 msgr2=0x55e22c008dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.011+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfed5d0 0x55e22c008dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0004580 tx=0x7fe8d00045b0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.011+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3944143995 shutdown_connections 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.011+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55e22bff4140 0x55e22bff6600 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.011+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c009380 0x55e22c006800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.011+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 0x55e22c006070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.011+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3944143995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22bfed5d0 0x55e22c008dc0 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0004580 tx=0x7fe8d00045b0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.011+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3944143995 >> 172.21.15.18:0/3944143995 conn(0x55e22bfb6310 msgr2=0x55e22bfef930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.012+0000 7fe8c67fc640 0 client.26561 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.012+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3944143995 shutdown_connections 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.012+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3944143995 wait complete. 2024-09-19T09:58:58.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.012+0000 7fe8e7b1b740 20 client.26561 trim_cache size 0 max 16384 2024-09-19T09:58:58.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.041+0000 7fe8e7b1b740 1 Processor -- start 2024-09-19T09:58:58.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.042+0000 7fe8e7b1b740 1 -- start start 2024-09-19T09:58:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.042+0000 7fe8e7b1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22bfeeb40 0x55e22c005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.042+0000 7fe8e7b1b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c0114e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.042+0000 7fe8e7b1b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22c001710 0x55e22c011a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.042+0000 7fe8e7b1b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c000e490 con 0x55e22c001710 2024-09-19T09:58:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.042+0000 7fe8e7b1b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c000ffd0 con 0x55e22c009380 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.042+0000 7fe8e7b1b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c000eb60 con 0x55e22bfeeb40 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22bfeeb40 0x55e22c005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8d7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c0114e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8d7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c0114e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41722/0 (socket says 172.21.15.18:41722) 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22bfeeb40 0x55e22c005050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54690/0 (socket says 172.21.15.18:54690) 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8d7fff640 1 -- 172.21.15.18:0/3895367796 learned_addr learned my addr 172.21.15.18:0/3895367796 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8d7fff640 1 -- 172.21.15.18:0/3895367796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22bfeeb40 msgr2=0x55e22c005050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8d7fff640 1 --2- 172.21.15.18:0/3895367796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22bfeeb40 0x55e22c005050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8d7fff640 1 -- 172.21.15.18:0/3895367796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22c001710 msgr2=0x55e22c011a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8d7fff640 1 --2- 172.21.15.18:0/3895367796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22c001710 0x55e22c011a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8d7fff640 1 -- 172.21.15.18:0/3895367796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e22c00bae0 con 0x55e22c009380 2024-09-19T09:58:58.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.043+0000 7fe8d7fff640 1 --2- 172.21.15.18:0/3895367796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c0114e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80997d0 tx=0x7fe8c80ccf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd5499808503f00a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:58.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.044+0000 7fe8d4ff9640 1 -- 172.21.15.18:0/3895367796 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c80a9070 con 0x55e22c009380 2024-09-19T09:58:58.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.044+0000 7fe8d4ff9640 1 -- 172.21.15.18:0/3895367796 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8c80a5a70 con 0x55e22c009380 2024-09-19T09:58:58.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.044+0000 7fe8d4ff9640 1 -- 172.21.15.18:0/3895367796 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c801d040 con 0x55e22c009380 2024-09-19T09:58:58.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.045+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3895367796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 msgr2=0x55e22c0114e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:58.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.045+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3895367796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c0114e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80997d0 tx=0x7fe8c80ccf20 comp rx=0 tx=0).stop 2024-09-19T09:58:58.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.045+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3895367796 shutdown_connections 2024-09-19T09:58:58.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.045+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3895367796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22c001710 0x55e22c011a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.045+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3895367796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c0114e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.045+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/3895367796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22bfeeb40 0x55e22c005050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.045+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3895367796 >> 172.21.15.18:0/3895367796 conn(0x55e22bfb6310 msgr2=0x55e22c004940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.046+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3895367796 shutdown_connections 2024-09-19T09:58:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.046+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/3895367796 wait complete. 2024-09-19T09:58:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.046+0000 7fe8e7b1b740 1 -- start start 2024-09-19T09:58:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.046+0000 7fe8e7b1b740 1 Processor -- start 2024-09-19T09:58:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.047+0000 7fe8e7b1b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 0x55e22c011a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:58.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.047+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 0x55e22c011a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:58.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.047+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 0x55e22c011a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51194/0 (socket says 172.21.15.18:51194) 2024-09-19T09:58:58.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.047+0000 7fe8deffd640 1 -- 172.21.15.18:0/1068314271 learned_addr learned my addr 172.21.15.18:0/1068314271 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:58:58.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.047+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c001710 0x55e22c00ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:58.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.047+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c00f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:58.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.048+0000 7fe8d7fff640 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c001710 0x55e22c00ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:58.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.048+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c00f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:58.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.048+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c000f900 con 0x55e22bfeeb40 2024-09-19T09:58:58.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.048+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c000f230 con 0x55e22c009380 2024-09-19T09:58:58.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.048+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c000c470 con 0x55e22c001710 2024-09-19T09:58:58.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.048+0000 7fe8e7b1b740 10 client.0 _ll_register_callbacks cb 0x7fe8d0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:58:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8df7fe640 1 -- 172.21.15.18:0/1068314271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c001710 msgr2=0x55e22c00ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c001710 0x55e22c00ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8df7fe640 1 -- 172.21.15.18:0/1068314271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 msgr2=0x55e22c011a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:58:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 0x55e22c011a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8df7fe640 1 -- 172.21.15.18:0/1068314271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e22c00f960 con 0x55e22c009380 2024-09-19T09:58:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8deffd640 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 0x55e22c011a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8df7fe640 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c00f370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8011750 tx=0x7fe8d801ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=272e78ea9b4f9ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8c67fc640 1 -- 172.21.15.18:0/1068314271 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8020040 con 0x55e22c009380 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8c80a5a70 con 0x55e22c009380 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8c67fc640 1 -- 172.21.15.18:0/1068314271 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe8d801b6e0 con 0x55e22c009380 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8c67fc640 1 -- 172.21.15.18:0/1068314271 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe8d801b410 con 0x55e22c009380 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8e7b1b740 10 client.26567 fetch_fsmap learned FSMap version 28 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.049+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e22c0954d0 con 0x55e22c009380 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.050+0000 7fe8c67fc640 1 -- 172.21.15.18:0/1068314271 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8c80a5a70 con 0x55e22c009380 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.051+0000 7fe8c67fc640 1 -- 172.21.15.18:0/1068314271 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe8d800f040 con 0x55e22c009380 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.051+0000 7fe8e7b1b740 10 client.26567 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.051+0000 7fe8e7b1b740 10 client.26567 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T09:58:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.051+0000 7fe8e7b1b740 20 client.26567 populate_metadata read hostname 'smithi018' 2024-09-19T09:58:58.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.051+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55e22c095a10 0x55e22c097e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:58:58.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.051+0000 7fe8e7b1b740 4 client.26567 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:58:58.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.051+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e22bed7170 con 0x55e22c095a10 2024-09-19T09:58:58.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.051+0000 7fe8deffd640 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55e22c095a10 0x55e22c097e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:58:58.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8deffd640 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55e22c095a10 0x55e22c097e00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5a98564824316dfc server_cookie=76fb2c476c452575 in_seq=0 out_seq=0 2024-09-19T09:58:58.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8c67fc640 10 client.26567 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T09:58:58.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8c67fc640 1 -- 172.21.15.18:0/1068314271 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e22bed7170 con 0x55e22c095a10 2024-09-19T09:58:58.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8c67fc640 10 client.26567 handle_command_reply: tid=0 2024-09-19T09:58:58.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8e7b1b740 1 client.26567 shutdown 2024-09-19T09:58:58.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 msgr2=0x55e22c00f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:58.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c00f370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8011750 tx=0x7fe8d801ba00 comp rx=0 tx=0).stop 2024-09-19T09:58:58.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 shutdown_connections 2024-09-19T09:58:58.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55e22c095a10 0x55e22c097e00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e22c009380 0x55e22c00f370 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e22c001710 0x55e22c00ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8e7b1b740 1 --2- 172.21.15.18:0/1068314271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e22bfeeb40 0x55e22c011a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 >> 172.21.15.18:0/1068314271 conn(0x55e22bfb6310 msgr2=0x55e22c005160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:58.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.052+0000 7fe8c67fc640 0 client.26567 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T09:58:58.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.053+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 shutdown_connections 2024-09-19T09:58:58.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.053+0000 7fe8e7b1b740 1 -- 172.21.15.18:0/1068314271 wait complete. 2024-09-19T09:58:58.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.053+0000 7fe8e7b1b740 20 client.26567 trim_cache size 0 max 16384 2024-09-19T09:58:58.058 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 -- 172.21.15.18:0/1024251227 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8cc0a3450 msgr2=0x7fe8cc0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8cc0a3450 0x7fe8cc0a5910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8005fd0 tx=0x7fe8d80096e0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 -- 172.21.15.18:0/1024251227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e0109450 msgr2=0x7fe8e0076250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e0109450 0x7fe8e0076250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe8e006f670 tx=0x7fe8c800cdd0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 -- 172.21.15.18:0/1024251227 shutdown_connections 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe8cc0a3450 0x7fe8cc0a5910 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8e0109e00 0x7fe8e0076790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8e0109450 0x7fe8e0076250 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 --2- 172.21.15.18:0/1024251227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e0074990 0x7fe8e007b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 -- 172.21.15.18:0/1024251227 >> 172.21.15.18:0/1024251227 conn(0x7fe8e006e140 msgr2=0x7fe8e00724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 -- 172.21.15.18:0/1024251227 shutdown_connections 2024-09-19T09:58:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:58:58.054+0000 7fe8e5742640 1 -- 172.21.15.18:0/1024251227 wait complete. 2024-09-19T09:58:58.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:57 smithi049 ceph-mon[34858]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 873 MiB/s wr, 2.07k op/s 2024-09-19T09:58:59.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:59:00.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:58:59 smithi018 ceph-mon[30956]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 843 MiB/s wr, 2.00k op/s 2024-09-19T09:59:00.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:58:59 smithi049 ceph-mon[34858]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 843 MiB/s wr, 2.00k op/s 2024-09-19T09:59:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:58:59 smithi162 ceph-mon[35174]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 843 MiB/s wr, 2.00k op/s 2024-09-19T09:59:00.599 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:59:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.786+0000 7f1b17ae4640 1 -- 172.21.15.18:0/3957381988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b10103ff0 msgr2=0x7f1b101043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.786+0000 7f1b17ae4640 1 --2- 172.21.15.18:0/3957381988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b10103ff0 0x7f1b101043d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009900 tx=0x7f1b0c02a410 comp rx=0 tx=0).stop 2024-09-19T09:59:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.789+0000 7f1b17ae4640 1 -- 172.21.15.18:0/3957381988 shutdown_connections 2024-09-19T09:59:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.789+0000 7f1b17ae4640 1 --2- 172.21.15.18:0/3957381988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b10109120 0x7f1b10110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.789+0000 7f1b17ae4640 1 --2- 172.21.15.18:0/3957381988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b101049a0 0x7f1b101089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.789+0000 7f1b17ae4640 1 --2- 172.21.15.18:0/3957381988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b10103ff0 0x7f1b101043d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.789+0000 7f1b17ae4640 1 -- 172.21.15.18:0/3957381988 >> 172.21.15.18:0/3957381988 conn(0x7f1b100ffab0 msgr2=0x7f1b10101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.789+0000 7f1b17ae4640 1 -- 172.21.15.18:0/3957381988 shutdown_connections 2024-09-19T09:59:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.792+0000 7f1b17ae4640 1 -- 172.21.15.18:0/3957381988 wait complete. 2024-09-19T09:59:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.793+0000 7f1b17ae4640 1 Processor -- start 2024-09-19T09:59:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.793+0000 7f1b17ae4640 1 -- start start 2024-09-19T09:59:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.793+0000 7f1b17ae4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b10103ff0 0x7f1b10110b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.793+0000 7f1b17ae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b101049a0 0x7f1b1010dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.793+0000 7f1b17ae4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b10109120 0x7f1b1010e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.793+0000 7f1b17ae4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10114230 con 0x7f1b101049a0 2024-09-19T09:59:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.793+0000 7f1b17ae4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1b101140b0 con 0x7f1b10109120 2024-09-19T09:59:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.793+0000 7f1b17ae4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b101143b0 con 0x7f1b10103ff0 2024-09-19T09:59:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.794+0000 7f1b1507f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b101049a0 0x7f1b1010dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.795+0000 7f1b16081640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b10109120 0x7f1b1010e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.795+0000 7f1b16081640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b10109120 0x7f1b1010e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41752/0 (socket says 172.21.15.18:41752) 2024-09-19T09:59:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.795+0000 7f1b16081640 1 -- 172.21.15.18:0/1771126724 learned_addr learned my addr 172.21.15.18:0/1771126724 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:01.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.796+0000 7f1b16081640 1 -- 172.21.15.18:0/1771126724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b10103ff0 msgr2=0x7f1b10110b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:01.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.796+0000 7f1b16081640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b10103ff0 0x7f1b10110b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.796+0000 7f1b16081640 1 -- 172.21.15.18:0/1771126724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b101049a0 msgr2=0x7f1b1010dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:01.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.796+0000 7f1b16081640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b101049a0 0x7f1b1010dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.796+0000 7f1b16081640 1 -- 172.21.15.18:0/1771126724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1010e990 con 0x7f1b10109120 2024-09-19T09:59:01.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.798+0000 7f1b16081640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b10109120 0x7f1b1010e100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800eb10 tx=0x7f1b0800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:01.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.799+0000 7f1b06ffd640 1 -- 172.21.15.18:0/1771126724 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08004b20 con 0x7f1b10109120 2024-09-19T09:59:01.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.800+0000 7f1b06ffd640 1 -- 172.21.15.18:0/1771126724 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b08004cc0 con 0x7f1b10109120 2024-09-19T09:59:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.801+0000 7f1b06ffd640 1 -- 172.21.15.18:0/1771126724 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08010760 con 0x7f1b10109120 2024-09-19T09:59:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.801+0000 7f1b17ae4640 1 -- 172.21.15.18:0/1771126724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b101a0810 con 0x7f1b10109120 2024-09-19T09:59:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.802+0000 7f1b17ae4640 1 -- 172.21.15.18:0/1771126724 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b101a0cd0 con 0x7f1b10109120 2024-09-19T09:59:01.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.807+0000 7f1b19ebd740 1 Processor -- start 2024-09-19T09:59:01.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.808+0000 7f1b19ebd740 1 -- start start 2024-09-19T09:59:01.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.809+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a30b40 0x55adc1a2f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.809+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a2f5d0 0x55adc1a2fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.809+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a3a370 0x55adc1a3c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.809+0000 7f1b19ebd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55adc19952f0 con 0x55adc1a3a370 2024-09-19T09:59:01.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.809+0000 7f1b19ebd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55adc193ccf0 con 0x55adc1a2f5d0 2024-09-19T09:59:01.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.809+0000 7f1b19ebd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55adc19912b0 con 0x55adc1a30b40 2024-09-19T09:59:01.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.809+0000 7f1b1507f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a3a370 0x55adc1a3c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.810+0000 7f1b1507f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a3a370 0x55adc1a3c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51220/0 (socket says 172.21.15.18:51220) 2024-09-19T09:59:01.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.810+0000 7f1b1507f640 1 -- 172.21.15.18:0/479426541 learned_addr learned my addr 172.21.15.18:0/479426541 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:01.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.810+0000 7f1b1507f640 1 -- 172.21.15.18:0/479426541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a30b40 msgr2=0x55adc1a2f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:01.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.810+0000 7f1b1507f640 1 --2- 172.21.15.18:0/479426541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a30b40 0x55adc1a2f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.810+0000 7f1b1507f640 1 -- 172.21.15.18:0/479426541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a2f5d0 msgr2=0x55adc1a2fa10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:59:01.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.810+0000 7f1b1507f640 1 --2- 172.21.15.18:0/479426541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a2f5d0 0x55adc1a2fa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.810+0000 7f1b1507f640 1 -- 172.21.15.18:0/479426541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc19213a0 con 0x55adc1a3a370 2024-09-19T09:59:01.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.814+0000 7f1b06ffd640 1 -- 172.21.15.18:0/1771126724 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1b08005000 con 0x7f1b10109120 2024-09-19T09:59:01.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.815+0000 7f1b06ffd640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1afc0a32e0 0x7f1afc0a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.816+0000 7f1b06ffd640 1 -- 172.21.15.18:0/1771126724 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1b080cff20 con 0x7f1b10109120 2024-09-19T09:59:01.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.819+0000 7f1b1507f640 1 --2- 172.21.15.18:0/479426541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a3a370 0x55adc1a3c760 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009ae0 tx=0x7f1b0000e1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5e49917ce77ace server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:01.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.820+0000 7f1afbfff640 1 -- 172.21.15.18:0/479426541 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00017070 con 0x55adc1a3a370 2024-09-19T09:59:01.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.820+0000 7f1afbfff640 1 -- 172.21.15.18:0/479426541 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b0000eb50 con 0x55adc1a3a370 2024-09-19T09:59:01.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.821+0000 7f1afbfff640 1 -- 172.21.15.18:0/479426541 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00017070 con 0x55adc1a3a370 2024-09-19T09:59:01.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.821+0000 7f1b19ebd740 1 -- 172.21.15.18:0/479426541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a3a370 msgr2=0x55adc1a3c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:01.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.821+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/479426541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a3a370 0x55adc1a3c760 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009ae0 tx=0x7f1b0000e1d0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.821+0000 7f1b19ebd740 1 -- 172.21.15.18:0/479426541 shutdown_connections 2024-09-19T09:59:01.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.821+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/479426541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a3a370 0x55adc1a3c760 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.821+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/479426541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a2f5d0 0x55adc1a2fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.821+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/479426541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a30b40 0x55adc1a2f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.821+0000 7f1b19ebd740 1 -- 172.21.15.18:0/479426541 >> 172.21.15.18:0/479426541 conn(0x55adc19f8310 msgr2=0x55adc1a2bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:01.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.822+0000 7f1b15880640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1afc0a32e0 0x7f1afc0a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.822+0000 7f1b19ebd740 1 -- 172.21.15.18:0/479426541 shutdown_connections 2024-09-19T09:59:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.825+0000 7f1b19ebd740 1 -- 172.21.15.18:0/479426541 wait complete. 2024-09-19T09:59:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.825+0000 7f1b19ebd740 1 -- start start 2024-09-19T09:59:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.825+0000 7f1b19ebd740 1 Processor -- start 2024-09-19T09:59:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.826+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a2f5d0 0x55adc1a37130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.826+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a30b40 0x55adc1a37670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.826+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.827+0000 7f1b19ebd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55adc1a3d0c0 con 0x55adc1a37bb0 2024-09-19T09:59:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.827+0000 7f1b19ebd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55adc1950060 con 0x55adc1a2f5d0 2024-09-19T09:59:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.827+0000 7f1b19ebd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55adc1a3d240 con 0x55adc1a30b40 2024-09-19T09:59:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.827+0000 7f1b19ebd740 10 client.0 _ll_register_callbacks cb 0x55adc16a38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.828+0000 7f1b16081640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.828+0000 7f1b16081640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51236/0 (socket says 172.21.15.18:51236) 2024-09-19T09:59:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.828+0000 7f1b16081640 1 -- 172.21.15.18:0/484364920 learned_addr learned my addr 172.21.15.18:0/484364920 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.829+0000 7f1b16081640 1 -- 172.21.15.18:0/484364920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a30b40 msgr2=0x55adc1a37670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.829+0000 7f1b16081640 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a30b40 0x55adc1a37670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.829+0000 7f1b16081640 1 -- 172.21.15.18:0/484364920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a2f5d0 msgr2=0x55adc1a37130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:59:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.829+0000 7f1b16081640 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a2f5d0 0x55adc1a37130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.829+0000 7f1b16081640 1 -- 172.21.15.18:0/484364920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc17063c0 con 0x55adc1a37bb0 2024-09-19T09:59:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.829+0000 7f1b15880640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1afc0a32e0 0x7f1afc0a57a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c031550 tx=0x7f1b0c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.831+0000 7f1b16081640 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a465f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1b080a4c50 tx=0x7f1b0809c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a93a6387cc838d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.832+0000 7f1af97fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:59:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.832+0000 7f1af97fa640 1 -- 172.21.15.18:0/484364920 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080b4020 con 0x55adc1a37bb0 2024-09-19T09:59:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.832+0000 7f1af97fa640 1 -- 172.21.15.18:0/484364920 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1b080b5220 con 0x55adc1a37bb0 2024-09-19T09:59:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.833+0000 7f1b19ebd740 1 -- 172.21.15.18:0/484364920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b0000eb50 con 0x55adc1a37bb0 2024-09-19T09:59:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.835+0000 7f1af97fa640 1 -- 172.21.15.18:0/484364920 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b0809c510 con 0x55adc1a37bb0 2024-09-19T09:59:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.835+0000 7f1b19ebd740 10 client.17148 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.835+0000 7f1b19ebd740 1 -- 172.21.15.18:0/484364920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55adc1a490d0 con 0x55adc1a37bb0 2024-09-19T09:59:01.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.840+0000 7f1af97fa640 1 -- 172.21.15.18:0/484364920 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b0000eb50 con 0x55adc1a37bb0 2024-09-19T09:59:01.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.840+0000 7f1af97fa640 1 -- 172.21.15.18:0/484364920 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1b0809b960 con 0x55adc1a37bb0 2024-09-19T09:59:01.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.841+0000 7f1b19ebd740 10 client.17148 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:01.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.841+0000 7f1b19ebd740 10 client.17148 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:59:01.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.841+0000 7f1b19ebd740 20 client.17148 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:01.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.841+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55adc1a4a910 0x55adc1a4cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.841+0000 7f1b19ebd740 4 client.17148 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:01.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.841+0000 7f1b19ebd740 1 -- 172.21.15.18:0/484364920 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adc19a2860 con 0x55adc1a4a910 2024-09-19T09:59:01.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.843+0000 7f1b15880640 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55adc1a4a910 0x55adc1a4cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.846+0000 7f1b15880640 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55adc1a4a910 0x55adc1a4cdd0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd5d106adc5155f4 server_cookie=2897ea6d78e07917 in_seq=0 out_seq=0 2024-09-19T09:59:01.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.850+0000 7f1af97fa640 10 client.17148 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:59:01.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.850+0000 7f1af97fa640 1 -- 172.21.15.18:0/484364920 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55adc19a2860 con 0x55adc1a4a910 2024-09-19T09:59:01.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.850+0000 7f1af97fa640 10 client.17148 handle_command_reply: tid=0 2024-09-19T09:59:01.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.850+0000 7f1b19ebd740 1 client.17148 shutdown 2024-09-19T09:59:01.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.850+0000 7f1b19ebd740 1 -- 172.21.15.18:0/484364920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 msgr2=0x55adc1a465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:01.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.850+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a465f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1b080a4c50 tx=0x7f1b0809c360 comp rx=0 tx=0).stop 2024-09-19T09:59:01.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.851+0000 7f1b19ebd740 1 -- 172.21.15.18:0/484364920 shutdown_connections 2024-09-19T09:59:01.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.851+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55adc1a4a910 0x55adc1a4cdd0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.851+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a465f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.851+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a30b40 0x55adc1a37670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.851+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/484364920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a2f5d0 0x55adc1a37130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.851+0000 7f1b19ebd740 1 -- 172.21.15.18:0/484364920 >> 172.21.15.18:0/484364920 conn(0x55adc19f8310 msgr2=0x55adc1a31960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:01.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.851+0000 7f1af97fa640 0 client.17148 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:59:01.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.851+0000 7f1b19ebd740 1 -- 172.21.15.18:0/484364920 shutdown_connections 2024-09-19T09:59:01.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.851+0000 7f1b19ebd740 1 -- 172.21.15.18:0/484364920 wait complete. 2024-09-19T09:59:01.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.851+0000 7f1b19ebd740 20 client.17148 trim_cache size 0 max 16384 2024-09-19T09:59:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.899+0000 7f1b19ebd740 1 Processor -- start 2024-09-19T09:59:01.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.899+0000 7f1b19ebd740 1 -- start start 2024-09-19T09:59:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.900+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a2f5d0 0x55adc1a463e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.901+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a46920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.901+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a2b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.902+0000 7f1b1507f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a46920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.902+0000 7f1b16081640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a2b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.902+0000 7f1b16081640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a2b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51242/0 (socket says 172.21.15.18:51242) 2024-09-19T09:59:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.903+0000 7f1b1507f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a46920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41786/0 (socket says 172.21.15.18:41786) 2024-09-19T09:59:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.903+0000 7f1b16081640 1 -- 172.21.15.18:0/2367582819 learned_addr learned my addr 172.21.15.18:0/2367582819 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.904+0000 7f1b19ebd740 1 -- 172.21.15.18:0/2367582819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10072e30 con 0x55adc1a37bb0 2024-09-19T09:59:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.904+0000 7f1b19ebd740 1 -- 172.21.15.18:0/2367582819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1b101c6490 con 0x55adc1a30b40 2024-09-19T09:59:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.904+0000 7f1b19ebd740 1 -- 172.21.15.18:0/2367582819 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10073500 con 0x55adc1a2f5d0 2024-09-19T09:59:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.905+0000 7f1b16081640 1 -- 172.21.15.18:0/2367582819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a2f5d0 msgr2=0x55adc1a463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.905+0000 7f1b16081640 1 --2- 172.21.15.18:0/2367582819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a2f5d0 0x55adc1a463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.905+0000 7f1b16081640 1 -- 172.21.15.18:0/2367582819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 msgr2=0x55adc1a46920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.905+0000 7f1b16081640 1 --2- 172.21.15.18:0/2367582819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a46920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.905+0000 7f1b16081640 1 -- 172.21.15.18:0/2367582819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc1a32120 con 0x55adc1a37bb0 2024-09-19T09:59:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.907+0000 7f1b16081640 1 --2- 172.21.15.18:0/2367582819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a2b700 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1b0809c450 tx=0x7f1b0809cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df99fc7eeebb6f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:01.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.907+0000 7f1afb7fe640 1 -- 172.21.15.18:0/2367582819 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080b4070 con 0x55adc1a37bb0 2024-09-19T09:59:01.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.908+0000 7f1afb7fe640 1 -- 172.21.15.18:0/2367582819 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b080a08c0 con 0x55adc1a37bb0 2024-09-19T09:59:01.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.909+0000 7f1b19ebd740 1 -- 172.21.15.18:0/2367582819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 msgr2=0x55adc1a2b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:01.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.909+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/2367582819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a2b700 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1b0809c450 tx=0x7f1b0809cd50 comp rx=0 tx=0).stop 2024-09-19T09:59:01.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.909+0000 7f1b19ebd740 1 -- 172.21.15.18:0/2367582819 shutdown_connections 2024-09-19T09:59:01.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.909+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/2367582819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a37bb0 0x55adc1a2b700 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.909+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/2367582819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a46920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.909+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/2367582819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a2f5d0 0x55adc1a463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.909+0000 7f1b19ebd740 1 -- 172.21.15.18:0/2367582819 >> 172.21.15.18:0/2367582819 conn(0x55adc19f8310 msgr2=0x55adc1a32310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:01.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.909+0000 7f1b19ebd740 1 -- 172.21.15.18:0/2367582819 shutdown_connections 2024-09-19T09:59:01.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.909+0000 7f1b19ebd740 1 -- 172.21.15.18:0/2367582819 wait complete. 2024-09-19T09:59:01.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.910+0000 7f1b19ebd740 1 -- start start 2024-09-19T09:59:01.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.910+0000 7f1b19ebd740 1 Processor -- start 2024-09-19T09:59:01.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.911+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a2f5d0 0x55adc1a424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.911+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a42a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.911+0000 7f1b19ebd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a337d0 0x55adc1a33c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.911+0000 7f1b19ebd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1b100742a0 con 0x55adc1a337d0 2024-09-19T09:59:01.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.911+0000 7f1b19ebd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10073bd0 con 0x55adc1a30b40 2024-09-19T09:59:01.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.911+0000 7f1b19ebd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10070e10 con 0x55adc1a2f5d0 2024-09-19T09:59:01.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.911+0000 7f1b19ebd740 10 client.0 _ll_register_callbacks cb 0x7f1b08098040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:01.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.914+0000 7f1b1507f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a42a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.914+0000 7f1b1507f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a42a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41788/0 (socket says 172.21.15.18:41788) 2024-09-19T09:59:01.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.914+0000 7f1b1507f640 1 -- 172.21.15.18:0/1040848360 learned_addr learned my addr 172.21.15.18:0/1040848360 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:01.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.914+0000 7f1b16081640 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a337d0 0x55adc1a33c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.914+0000 7f1b15880640 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a2f5d0 0x55adc1a424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.916+0000 7f1b1507f640 1 -- 172.21.15.18:0/1040848360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a2f5d0 msgr2=0x55adc1a424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:01.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.916+0000 7f1b1507f640 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a2f5d0 0x55adc1a424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.916+0000 7f1b1507f640 1 -- 172.21.15.18:0/1040848360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a337d0 msgr2=0x55adc1a33c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:01.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.916+0000 7f1b1507f640 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a337d0 0x55adc1a33c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.916+0000 7f1b1507f640 1 -- 172.21.15.18:0/1040848360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc1a34190 con 0x55adc1a30b40 2024-09-19T09:59:01.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.919+0000 7f1b1507f640 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a42a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b00006ec0 tx=0x7f1b00004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95ee97e9eeb70cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:01.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.919+0000 7f1af97fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:01.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.922+0000 7f1af97fa640 1 -- 172.21.15.18:0/1040848360 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00017070 con 0x55adc1a30b40 2024-09-19T09:59:01.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.922+0000 7f1af97fa640 1 -- 172.21.15.18:0/1040848360 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1b0000e040 con 0x55adc1a30b40 2024-09-19T09:59:01.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.922+0000 7f1b19ebd740 1 -- 172.21.15.18:0/1040848360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55adc199cd70 con 0x55adc1a30b40 2024-09-19T09:59:01.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.923+0000 7f1af97fa640 1 -- 172.21.15.18:0/1040848360 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1b00004570 con 0x55adc1a30b40 2024-09-19T09:59:01.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.923+0000 7f1b19ebd740 10 client.26579 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:01.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.923+0000 7f1b19ebd740 1 -- 172.21.15.18:0/1040848360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55adc1ab5310 con 0x55adc1a30b40 2024-09-19T09:59:01.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.924+0000 7f1af97fa640 1 -- 172.21.15.18:0/1040848360 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55adc199cd70 con 0x55adc1a30b40 2024-09-19T09:59:01.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.924+0000 7f1af97fa640 1 -- 172.21.15.18:0/1040848360 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1b00024070 con 0x55adc1a30b40 2024-09-19T09:59:01.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.924+0000 7f1b19ebd740 10 client.26579 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:01.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.924+0000 7f1b19ebd740 10 client.26579 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:59:01.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.924+0000 7f1b19ebd740 20 client.26579 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:01.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.924+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55adc1ab57a0 0x55adc1ab7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:01.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.924+0000 7f1b19ebd740 4 client.26579 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:59:01.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.924+0000 7f1b19ebd740 1 -- 172.21.15.18:0/1040848360 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55adc1919170 con 0x55adc1ab57a0 2024-09-19T09:59:01.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.926+0000 7f1b15880640 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55adc1ab57a0 0x55adc1ab7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:01.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.930+0000 7f1b15880640 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55adc1ab57a0 0x55adc1ab7b90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3acb62e1126477a5 server_cookie=1df1a57ecf8a3414 in_seq=0 out_seq=0 2024-09-19T09:59:01.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.931+0000 7f1af97fa640 10 client.26579 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T09:59:01.939 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:59:01.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.934+0000 7f1af97fa640 1 -- 172.21.15.18:0/1040848360 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55adc1919170 con 0x55adc1ab57a0 2024-09-19T09:59:01.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.934+0000 7f1af97fa640 10 client.26579 handle_command_reply: tid=0 2024-09-19T09:59:01.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.934+0000 7f1b19ebd740 1 client.26579 shutdown 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.934+0000 7f1b19ebd740 1 -- 172.21.15.18:0/1040848360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 msgr2=0x55adc1a42a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.934+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a42a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b00006ec0 tx=0x7f1b00004270 comp rx=0 tx=0).stop 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.934+0000 7f1b19ebd740 1 -- 172.21.15.18:0/1040848360 shutdown_connections 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.935+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55adc1ab57a0 0x55adc1ab7b90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.935+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55adc1a337d0 0x55adc1a33c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.935+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55adc1a30b40 0x55adc1a42a00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.935+0000 7f1b19ebd740 1 --2- 172.21.15.18:0/1040848360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc1a2f5d0 0x55adc1a424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.935+0000 7f1b19ebd740 1 -- 172.21.15.18:0/1040848360 >> 172.21.15.18:0/1040848360 conn(0x55adc19f8310 msgr2=0x55adc1a370f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.935+0000 7f1af97fa640 0 client.26579 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.935+0000 7f1b19ebd740 1 -- 172.21.15.18:0/1040848360 shutdown_connections 2024-09-19T09:59:01.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.935+0000 7f1b19ebd740 1 -- 172.21.15.18:0/1040848360 wait complete. 2024-09-19T09:59:01.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.935+0000 7f1b19ebd740 20 client.26579 trim_cache size 0 max 16384 2024-09-19T09:59:01.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.937+0000 7f1b17ae4640 1 -- 172.21.15.18:0/1771126724 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1afc0a32e0 msgr2=0x7f1afc0a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:01.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.937+0000 7f1b17ae4640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1afc0a32e0 0x7f1afc0a57a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c031550 tx=0x7f1b0c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.937+0000 7f1b17ae4640 1 -- 172.21.15.18:0/1771126724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b10109120 msgr2=0x7f1b1010e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:01.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.937+0000 7f1b17ae4640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b10109120 0x7f1b1010e100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800eb10 tx=0x7f1b0800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.938+0000 7f1b17ae4640 1 -- 172.21.15.18:0/1771126724 shutdown_connections 2024-09-19T09:59:01.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.938+0000 7f1b17ae4640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1afc0a32e0 0x7f1afc0a57a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.938+0000 7f1b17ae4640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b10109120 0x7f1b1010e100 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.938+0000 7f1b17ae4640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b101049a0 0x7f1b1010dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.938+0000 7f1b17ae4640 1 --2- 172.21.15.18:0/1771126724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b10103ff0 0x7f1b10110b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:01.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.938+0000 7f1b17ae4640 1 -- 172.21.15.18:0/1771126724 >> 172.21.15.18:0/1771126724 conn(0x7f1b100ffab0 msgr2=0x7f1b10100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:01.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.939+0000 7f1b17ae4640 1 -- 172.21.15.18:0/1771126724 shutdown_connections 2024-09-19T09:59:01.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:01.939+0000 7f1b17ae4640 1 -- 172.21.15.18:0/1771126724 wait complete. 2024-09-19T09:59:02.142 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:01 smithi018 ceph-mon[30956]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 826 MiB/s wr, 1.86k op/s 2024-09-19T09:59:02.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:01 smithi049 ceph-mon[34858]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 826 MiB/s wr, 1.86k op/s 2024-09-19T09:59:02.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:01 smithi162 ceph-mon[35174]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 826 MiB/s wr, 1.86k op/s 2024-09-19T09:59:03.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:59:04.340 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:59:04.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:03 smithi018 ceph-mon[30956]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 836 MiB/s wr, 1.71k op/s 2024-09-19T09:59:04.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:03 smithi049 ceph-mon[34858]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 836 MiB/s wr, 1.71k op/s 2024-09-19T09:59:04.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:03 smithi162 ceph-mon[35174]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 836 MiB/s wr, 1.71k op/s 2024-09-19T09:59:05.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.185+0000 7f4a957fd640 1 -- 172.21.15.18:0/1609238625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9010d510 msgr2=0x7f4a9010d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.185+0000 7f4a957fd640 1 --2- 172.21.15.18:0/1609238625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9010d510 0x7f4a9010d9a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009cd0 tx=0x7f4a8802a930 comp rx=0 tx=0).stop 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.185+0000 7f4a957fd640 1 -- 172.21.15.18:0/1609238625 shutdown_connections 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.185+0000 7f4a957fd640 1 --2- 172.21.15.18:0/1609238625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a9010d510 0x7f4a9010d9a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.185+0000 7f4a957fd640 1 --2- 172.21.15.18:0/1609238625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9006ed80 0x7f4a90109990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.185+0000 7f4a957fd640 1 --2- 172.21.15.18:0/1609238625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a9006e910 0x7f4a90109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.185+0000 7f4a957fd640 1 -- 172.21.15.18:0/1609238625 >> 172.21.15.18:0/1609238625 conn(0x7f4a90073180 msgr2=0x7f4a90073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.186+0000 7f4a957fd640 1 -- 172.21.15.18:0/1609238625 shutdown_connections 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.186+0000 7f4a957fd640 1 -- 172.21.15.18:0/1609238625 wait complete. 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.188+0000 7f4a957fd640 1 Processor -- start 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.188+0000 7f4a957fd640 1 -- start start 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.188+0000 7f4a957fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9006e910 0x7f4a901a86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.188+0000 7f4a957fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a9006ed80 0x7f4a901a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.188+0000 7f4a957fd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a901a28b0 0x7f4a901a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.188+0000 7f4a957fd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a901164c0 con 0x7f4a901a28b0 2024-09-19T09:59:05.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.188+0000 7f4a957fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4a90116340 con 0x7f4a9006ed80 2024-09-19T09:59:05.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.188+0000 7f4a957fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a90116640 con 0x7f4a9006e910 2024-09-19T09:59:05.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.193+0000 7f4a94ffc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a901a28b0 0x7f4a901a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.193+0000 7f4a94ffc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a901a28b0 0x7f4a901a2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51264/0 (socket says 172.21.15.18:51264) 2024-09-19T09:59:05.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.193+0000 7f4a94ffc640 1 -- 172.21.15.18:0/4147584109 learned_addr learned my addr 172.21.15.18:0/4147584109 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:05.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.193+0000 7f4a8f7fe640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a9006ed80 0x7f4a901a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.193+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9006e910 0x7f4a901a86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.194+0000 7f4a8ffff640 1 -- 172.21.15.18:0/4147584109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a9006ed80 msgr2=0x7f4a901a8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:05.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.194+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a9006ed80 0x7f4a901a8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.194+0000 7f4a8ffff640 1 -- 172.21.15.18:0/4147584109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a901a28b0 msgr2=0x7f4a901a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:05.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.194+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a901a28b0 0x7f4a901a2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.195+0000 7f4a8ffff640 1 -- 172.21.15.18:0/4147584109 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a901a3490 con 0x7f4a9006e910 2024-09-19T09:59:05.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.196+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9006e910 0x7f4a901a86f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009fd0 tx=0x7f4a8000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:05.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.197+0000 7f4a8d7fa640 1 -- 172.21.15.18:0/4147584109 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80015020 con 0x7f4a9006e910 2024-09-19T09:59:05.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.197+0000 7f4a957fd640 1 -- 172.21.15.18:0/4147584109 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9007a450 con 0x7f4a9006e910 2024-09-19T09:59:05.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.197+0000 7f4a957fd640 1 -- 172.21.15.18:0/4147584109 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9007aa60 con 0x7f4a9006e910 2024-09-19T09:59:05.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.201+0000 7f4a8d7fa640 1 -- 172.21.15.18:0/4147584109 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a80011d10 con 0x7f4a9006e910 2024-09-19T09:59:05.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.201+0000 7f4a8d7fa640 1 -- 172.21.15.18:0/4147584109 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8000f2e0 con 0x7f4a9006e910 2024-09-19T09:59:05.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.203+0000 7f4a98e38740 1 Processor -- start 2024-09-19T09:59:05.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.203+0000 7f4a98e38740 1 -- start start 2024-09-19T09:59:05.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.203+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d2cf0 0x5600fe6d1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.204+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d1780 0x5600fe6d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.204+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 0x5600fe6de910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.204+0000 7f4a98e38740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5600fe6372f0 con 0x5600fe6d2cf0 2024-09-19T09:59:05.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.204+0000 7f4a98e38740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5600fe5decf0 con 0x5600fe6dc520 2024-09-19T09:59:05.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.204+0000 7f4a98e38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5600fe6332b0 con 0x5600fe6d1780 2024-09-19T09:59:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.206+0000 7f4a94ffc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d2cf0 0x5600fe6d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.206+0000 7f4a94ffc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d2cf0 0x5600fe6d1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51270/0 (socket says 172.21.15.18:51270) 2024-09-19T09:59:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.206+0000 7f4a94ffc640 1 -- 172.21.15.18:0/1356733901 learned_addr learned my addr 172.21.15.18:0/1356733901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.207+0000 7f4a8f7fe640 1 --2- 172.21.15.18:0/1356733901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 0x5600fe6de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.209+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/1356733901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d1780 0x5600fe6d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.209+0000 7f4a8d7fa640 1 -- 172.21.15.18:0/4147584109 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4a80018020 con 0x7f4a9006e910 2024-09-19T09:59:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.211+0000 7f4a8d7fa640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4a780a3380 0x7f4a780a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.212+0000 7f4a8d7fa640 1 -- 172.21.15.18:0/4147584109 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4a800cf0d0 con 0x7f4a9006e910 2024-09-19T09:59:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.215+0000 7f4a94ffc640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4a780a3380 0x7f4a780a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.216+0000 7f4a8ffff640 1 -- 172.21.15.18:0/1356733901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 msgr2=0x5600fe6de910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.216+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/1356733901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 0x5600fe6de910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.216+0000 7f4a8ffff640 1 -- 172.21.15.18:0/1356733901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d2cf0 msgr2=0x5600fe6d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.216+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/1356733901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d2cf0 0x5600fe6d1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.216+0000 7f4a8ffff640 1 -- 172.21.15.18:0/1356733901 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600fe5c33a0 con 0x5600fe6d1780 2024-09-19T09:59:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.218+0000 7f4a94ffc640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4a780a3380 0x7f4a780a5840 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009430 tx=0x7f4a8802a930 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.218+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/1356733901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d1780 0x5600fe6d1bc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4a800ccb40 tx=0x7f4a800092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d67dbc56d7bc62a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:05.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.220+0000 7f4a767fc640 1 -- 172.21.15.18:0/1356733901 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8009b200 con 0x5600fe6d1780 2024-09-19T09:59:05.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.220+0000 7f4a767fc640 1 -- 172.21.15.18:0/1356733901 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a8009bdc0 con 0x5600fe6d1780 2024-09-19T09:59:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.222+0000 7f4a98e38740 1 -- 172.21.15.18:0/1356733901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d1780 msgr2=0x5600fe6d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.222+0000 7f4a767fc640 1 -- 172.21.15.18:0/1356733901 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8009b200 con 0x5600fe6d1780 2024-09-19T09:59:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.222+0000 7f4a98e38740 1 --2- 172.21.15.18:0/1356733901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d1780 0x5600fe6d1bc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4a800ccb40 tx=0x7f4a800092d0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.222+0000 7f4a98e38740 1 -- 172.21.15.18:0/1356733901 shutdown_connections 2024-09-19T09:59:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.222+0000 7f4a98e38740 1 --2- 172.21.15.18:0/1356733901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 0x5600fe6de910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.222+0000 7f4a98e38740 1 --2- 172.21.15.18:0/1356733901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d1780 0x5600fe6d1bc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.222+0000 7f4a98e38740 1 --2- 172.21.15.18:0/1356733901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d2cf0 0x5600fe6d1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.222+0000 7f4a98e38740 1 -- 172.21.15.18:0/1356733901 >> 172.21.15.18:0/1356733901 conn(0x5600fe69a310 msgr2=0x5600fe6cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.223+0000 7f4a98e38740 1 -- 172.21.15.18:0/1356733901 shutdown_connections 2024-09-19T09:59:05.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.223+0000 7f4a98e38740 1 -- 172.21.15.18:0/1356733901 wait complete. 2024-09-19T09:59:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.224+0000 7f4a98e38740 1 -- start start 2024-09-19T09:59:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.224+0000 7f4a98e38740 1 Processor -- start 2024-09-19T09:59:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.225+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 0x5600fe6dbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.225+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d2cf0 0x5600fe6d90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.225+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 0x5600fe6d9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.225+0000 7f4a98e38740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5600fe6df270 con 0x5600fe6d1780 2024-09-19T09:59:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.225+0000 7f4a98e38740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5600fe5f2060 con 0x5600fe6dc520 2024-09-19T09:59:05.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.225+0000 7f4a98e38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5600fe6df3f0 con 0x5600fe6d2cf0 2024-09-19T09:59:05.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.225+0000 7f4a98e38740 10 client.0 _ll_register_callbacks cb 0x5600fe3458c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:05.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.225+0000 7f4a94ffc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 0x5600fe6d9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.226+0000 7f4a94ffc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 0x5600fe6d9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41834/0 (socket says 172.21.15.18:41834) 2024-09-19T09:59:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.226+0000 7f4a94ffc640 1 -- 172.21.15.18:0/3382630613 learned_addr learned my addr 172.21.15.18:0/3382630613 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.226+0000 7f4a8f7fe640 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d2cf0 0x5600fe6d90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.226+0000 7f4a94ffc640 1 -- 172.21.15.18:0/3382630613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d2cf0 msgr2=0x5600fe6d90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.226+0000 7f4a94ffc640 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d2cf0 0x5600fe6d90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.227+0000 7f4a94ffc640 1 -- 172.21.15.18:0/3382630613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 msgr2=0x5600fe6dbdd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:59:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.227+0000 7f4a94ffc640 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 0x5600fe6dbdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.227+0000 7f4a94ffc640 1 -- 172.21.15.18:0/3382630613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600fe3a83c0 con 0x5600fe6dc520 2024-09-19T09:59:05.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.227+0000 7f4a8f7fe640 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d2cf0 0x5600fe6d90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:59:05.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.231+0000 7f4a94ffc640 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 0x5600fe6d9610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4a88004750 tx=0x7f4a880095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=267350571f7268e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:05.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.232+0000 7f4a6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:05.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.232+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/3382630613 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88045070 con 0x5600fe6dc520 2024-09-19T09:59:05.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.232+0000 7f4a98e38740 1 -- 172.21.15.18:0/3382630613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a8009bdc0 con 0x5600fe6dc520 2024-09-19T09:59:05.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.232+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/3382630613 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4a88031480 con 0x5600fe6dc520 2024-09-19T09:59:05.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.234+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/3382630613 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4a8805b070 con 0x5600fe6dc520 2024-09-19T09:59:05.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.234+0000 7f4a98e38740 10 client.26588 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:05.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.235+0000 7f4a98e38740 1 -- 172.21.15.18:0/3382630613 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5600fe6e8cf0 con 0x5600fe6dc520 2024-09-19T09:59:05.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.236+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/3382630613 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a88036040 con 0x5600fe6dc520 2024-09-19T09:59:05.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.236+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/3382630613 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4a8802fa20 con 0x5600fe6dc520 2024-09-19T09:59:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.239+0000 7f4a98e38740 10 client.26588 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.239+0000 7f4a98e38740 10 client.26588 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:59:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.239+0000 7f4a98e38740 20 client.26588 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.241+0000 7f4a98e38740 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5600fe6ea680 0x5600fe6ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.241+0000 7f4a98e38740 4 client.26588 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.241+0000 7f4a98e38740 1 -- 172.21.15.18:0/3382630613 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4a8009bdc0 con 0x5600fe6ea680 2024-09-19T09:59:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.242+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5600fe6ea680 0x5600fe6ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.246+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5600fe6ea680 0x5600fe6ecac0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=58752ab886bc242a server_cookie=a13e536a80b64edf in_seq=0 out_seq=0 2024-09-19T09:59:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.246+0000 7f4a6f7fe640 10 client.26588 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:59:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.248+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/3382630613 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f4a8009bdc0 con 0x5600fe6ea680 2024-09-19T09:59:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.248+0000 7f4a6f7fe640 10 client.26588 handle_command_reply: tid=0 2024-09-19T09:59:05.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.248+0000 7f4a98e38740 1 client.26588 shutdown 2024-09-19T09:59:05.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.252+0000 7f4a98e38740 1 -- 172.21.15.18:0/3382630613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 msgr2=0x5600fe6d9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:05.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.252+0000 7f4a98e38740 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 0x5600fe6d9610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4a88004750 tx=0x7f4a880095c0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.254+0000 7f4a98e38740 1 -- 172.21.15.18:0/3382630613 shutdown_connections 2024-09-19T09:59:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.255+0000 7f4a98e38740 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5600fe6ea680 0x5600fe6ecac0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.255+0000 7f4a98e38740 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6dc520 0x5600fe6d9610 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.255+0000 7f4a98e38740 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6d2cf0 0x5600fe6d90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.255+0000 7f4a98e38740 1 --2- 172.21.15.18:0/3382630613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 0x5600fe6dbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.255+0000 7f4a98e38740 1 -- 172.21.15.18:0/3382630613 >> 172.21.15.18:0/3382630613 conn(0x5600fe69a310 msgr2=0x5600fe6d3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.255+0000 7f4a6f7fe640 0 client.26588 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:59:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.255+0000 7f4a98e38740 1 -- 172.21.15.18:0/3382630613 shutdown_connections 2024-09-19T09:59:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.255+0000 7f4a98e38740 1 -- 172.21.15.18:0/3382630613 wait complete. 2024-09-19T09:59:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.255+0000 7f4a98e38740 20 client.26588 trim_cache size 0 max 16384 2024-09-19T09:59:05.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.291+0000 7f4a98e38740 1 Processor -- start 2024-09-19T09:59:05.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.291+0000 7f4a98e38740 1 -- start start 2024-09-19T09:59:05.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.292+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 0x5600fe6db040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.292+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe6fa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.292+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6dc520 0x5600fe6fa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.292+0000 7f4a98e38740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c00e4f0 con 0x5600fe6d1780 2024-09-19T09:59:05.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.292+0000 7f4a98e38740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c010030 con 0x5600fe6d2cf0 2024-09-19T09:59:05.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.293+0000 7f4a98e38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c00ebc0 con 0x5600fe6dc520 2024-09-19T09:59:05.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.297+0000 7f4a8f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe6fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.297+0000 7f4a8f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe6fa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41846/0 (socket says 172.21.15.18:41846) 2024-09-19T09:59:05.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.297+0000 7f4a8f7fe640 1 -- 172.21.15.18:0/387033390 learned_addr learned my addr 172.21.15.18:0/387033390 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:05.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.297+0000 7f4a94ffc640 1 --2- 172.21.15.18:0/387033390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6dc520 0x5600fe6fa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.298+0000 7f4a8f7fe640 1 -- 172.21.15.18:0/387033390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6dc520 msgr2=0x5600fe6fa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:05.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.298+0000 7f4a8f7fe640 1 --2- 172.21.15.18:0/387033390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6dc520 0x5600fe6fa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.298+0000 7f4a8f7fe640 1 -- 172.21.15.18:0/387033390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 msgr2=0x5600fe6db040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:05.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.298+0000 7f4a8f7fe640 1 --2- 172.21.15.18:0/387033390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 0x5600fe6db040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.298+0000 7f4a8f7fe640 1 -- 172.21.15.18:0/387033390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600fe6ce8e0 con 0x5600fe6d2cf0 2024-09-19T09:59:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.299+0000 7f4a8f7fe640 1 --2- 172.21.15.18:0/387033390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe6fa410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a9006f4c0 tx=0x7f4a8400bc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3d157db5a7c21b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.299+0000 7f4a75ffb640 1 -- 172.21.15.18:0/387033390 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8401b070 con 0x5600fe6d2cf0 2024-09-19T09:59:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.299+0000 7f4a75ffb640 1 -- 172.21.15.18:0/387033390 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a84015450 con 0x5600fe6d2cf0 2024-09-19T09:59:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.300+0000 7f4a75ffb640 1 -- 172.21.15.18:0/387033390 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a840145f0 con 0x5600fe6d2cf0 2024-09-19T09:59:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.301+0000 7f4a98e38740 1 -- 172.21.15.18:0/387033390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 msgr2=0x5600fe6fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.301+0000 7f4a98e38740 1 --2- 172.21.15.18:0/387033390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe6fa410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a9006f4c0 tx=0x7f4a8400bc70 comp rx=0 tx=0).stop 2024-09-19T09:59:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.301+0000 7f4a98e38740 1 -- 172.21.15.18:0/387033390 shutdown_connections 2024-09-19T09:59:05.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.301+0000 7f4a98e38740 1 --2- 172.21.15.18:0/387033390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6dc520 0x5600fe6fa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.301+0000 7f4a98e38740 1 --2- 172.21.15.18:0/387033390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe6fa410 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.302+0000 7f4a98e38740 1 --2- 172.21.15.18:0/387033390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 0x5600fe6db040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.302+0000 7f4a98e38740 1 -- 172.21.15.18:0/387033390 >> 172.21.15.18:0/387033390 conn(0x5600fe69a310 msgr2=0x5600fe6da930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:05.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.302+0000 7f4a98e38740 1 -- 172.21.15.18:0/387033390 shutdown_connections 2024-09-19T09:59:05.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.302+0000 7f4a98e38740 1 -- 172.21.15.18:0/387033390 wait complete. 2024-09-19T09:59:05.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.303+0000 7f4a98e38740 1 -- start start 2024-09-19T09:59:05.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.304+0000 7f4a98e38740 1 Processor -- start 2024-09-19T09:59:05.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.306+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 0x5600fe7714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.307+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe7719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.307+0000 7f4a98e38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6dc520 0x5600fe6e1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.307+0000 7f4a98e38740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c00f960 con 0x5600fe6d1780 2024-09-19T09:59:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.307+0000 7f4a98e38740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c00f290 con 0x5600fe6d2cf0 2024-09-19T09:59:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.307+0000 7f4a98e38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c00c4d0 con 0x5600fe6dc520 2024-09-19T09:59:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.307+0000 7f4a8f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe7719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.307+0000 7f4a8f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe7719f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:41862/0 (socket says 172.21.15.18:41862) 2024-09-19T09:59:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.307+0000 7f4a8f7fe640 1 -- 172.21.15.18:0/1707534544 learned_addr learned my addr 172.21.15.18:0/1707534544 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.307+0000 7f4a94ffc640 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6dc520 0x5600fe6e1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.308+0000 7f4a98e38740 10 client.0 _ll_register_callbacks cb 0x7f4a88009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.310+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 0x5600fe7714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.317+0000 7f4a8f7fe640 1 -- 172.21.15.18:0/1707534544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6dc520 msgr2=0x5600fe6e1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:05.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.317+0000 7f4a8f7fe640 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6dc520 0x5600fe6e1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.317+0000 7f4a8f7fe640 1 -- 172.21.15.18:0/1707534544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 msgr2=0x5600fe7714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.317+0000 7f4a8f7fe640 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 0x5600fe7714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.317+0000 7f4a8f7fe640 1 -- 172.21.15.18:0/1707534544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600fe6e1f60 con 0x5600fe6d2cf0 2024-09-19T09:59:05.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.328+0000 7f4a8f7fe640 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe7719f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4a84012cd0 tx=0x7f4a84012d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c05f774875c8059 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:05.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.328+0000 7f4a6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:05.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.330+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/1707534544 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8401b040 con 0x5600fe6d2cf0 2024-09-19T09:59:05.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.330+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/1707534544 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4a84020860 con 0x5600fe6d2cf0 2024-09-19T09:59:05.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.330+0000 7f4a98e38740 1 -- 172.21.15.18:0/1707534544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a84015450 con 0x5600fe6d2cf0 2024-09-19T09:59:05.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.331+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/1707534544 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4a84020a60 con 0x5600fe6d2cf0 2024-09-19T09:59:05.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.336+0000 7f4a98e38740 10 client.26594 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:05.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.336+0000 7f4a98e38740 1 -- 172.21.15.18:0/1707534544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5600fe778c20 con 0x5600fe6d2cf0 2024-09-19T09:59:05.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.338+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/1707534544 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a84020c00 con 0x5600fe6d2cf0 2024-09-19T09:59:05.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.340+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/1707534544 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4a84029c10 con 0x5600fe6d2cf0 2024-09-19T09:59:05.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.340+0000 7f4a98e38740 10 client.26594 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:05.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.340+0000 7f4a98e38740 10 client.26594 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:59:05.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.340+0000 7f4a98e38740 20 client.26594 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:05.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.340+0000 7f4a98e38740 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5600fe7791f0 0x5600fe77b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:05.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.340+0000 7f4a98e38740 4 client.26594 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:59:05.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.341+0000 7f4a98e38740 1 -- 172.21.15.18:0/1707534544 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4a84015450 con 0x5600fe7791f0 2024-09-19T09:59:05.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.341+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5600fe7791f0 0x5600fe77b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:05.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.344+0000 7f4a8ffff640 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5600fe7791f0 0x5600fe77b610 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=93de1e8f67daa733 server_cookie=9bb69611f1950278 in_seq=0 out_seq=0 2024-09-19T09:59:05.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.345+0000 7f4a6f7fe640 10 client.26594 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T09:59:05.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.345+0000 7f4a6f7fe640 1 -- 172.21.15.18:0/1707534544 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4a84015450 con 0x5600fe7791f0 2024-09-19T09:59:05.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.345+0000 7f4a6f7fe640 10 client.26594 handle_command_reply: tid=0 2024-09-19T09:59:05.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.345+0000 7f4a98e38740 1 client.26594 shutdown 2024-09-19T09:59:05.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.346+0000 7f4a98e38740 1 -- 172.21.15.18:0/1707534544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 msgr2=0x5600fe7719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:05.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.346+0000 7f4a98e38740 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe7719f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4a84012cd0 tx=0x7f4a84012d00 comp rx=0 tx=0).stop 2024-09-19T09:59:05.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.346+0000 7f4a98e38740 1 -- 172.21.15.18:0/1707534544 shutdown_connections 2024-09-19T09:59:05.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.346+0000 7f4a98e38740 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5600fe7791f0 0x5600fe77b610 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.346+0000 7f4a98e38740 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600fe6dc520 0x5600fe6e1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.347+0000 7f4a98e38740 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5600fe6d2cf0 0x5600fe7719f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.347+0000 7f4a98e38740 1 --2- 172.21.15.18:0/1707534544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600fe6d1780 0x5600fe7714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.347+0000 7f4a98e38740 1 -- 172.21.15.18:0/1707534544 >> 172.21.15.18:0/1707534544 conn(0x5600fe69a310 msgr2=0x5600fe6db150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:05.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.347+0000 7f4a6f7fe640 0 client.26594 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T09:59:05.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.350+0000 7f4a98e38740 1 -- 172.21.15.18:0/1707534544 shutdown_connections 2024-09-19T09:59:05.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.350+0000 7f4a98e38740 1 -- 172.21.15.18:0/1707534544 wait complete. 2024-09-19T09:59:05.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.350+0000 7f4a98e38740 20 client.26594 trim_cache size 0 max 16384 2024-09-19T09:59:05.355 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:59:05.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.352+0000 7f4a957fd640 1 -- 172.21.15.18:0/4147584109 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4a780a3380 msgr2=0x7f4a780a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:05.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.352+0000 7f4a957fd640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4a780a3380 0x7f4a780a5840 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009430 tx=0x7f4a8802a930 comp rx=0 tx=0).stop 2024-09-19T09:59:05.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.353+0000 7f4a957fd640 1 -- 172.21.15.18:0/4147584109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9006e910 msgr2=0x7f4a901a86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:05.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.353+0000 7f4a957fd640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9006e910 0x7f4a901a86f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009fd0 tx=0x7f4a8000b870 comp rx=0 tx=0).stop 2024-09-19T09:59:05.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.353+0000 7f4a957fd640 1 -- 172.21.15.18:0/4147584109 shutdown_connections 2024-09-19T09:59:05.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.353+0000 7f4a957fd640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4a780a3380 0x7f4a780a5840 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.353+0000 7f4a957fd640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a901a28b0 0x7f4a901a2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.353+0000 7f4a957fd640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a9006ed80 0x7f4a901a8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.353+0000 7f4a957fd640 1 --2- 172.21.15.18:0/4147584109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9006e910 0x7f4a901a86f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:05.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.353+0000 7f4a957fd640 1 -- 172.21.15.18:0/4147584109 >> 172.21.15.18:0/4147584109 conn(0x7f4a90073180 msgr2=0x7f4a9006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:05.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.354+0000 7f4a957fd640 1 -- 172.21.15.18:0/4147584109 shutdown_connections 2024-09-19T09:59:05.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:05.354+0000 7f4a957fd640 1 -- 172.21.15.18:0/4147584109 wait complete. 2024-09-19T09:59:06.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:05 smithi018 ceph-mon[30956]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 862 MiB/s wr, 1.50k op/s 2024-09-19T09:59:06.292 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:59:06.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:05 smithi049 ceph-mon[34858]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 862 MiB/s wr, 1.50k op/s 2024-09-19T09:59:06.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:05 smithi162 ceph-mon[35174]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 862 MiB/s wr, 1.50k op/s 2024-09-19T09:59:07.413 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:59:08.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:07 smithi018 ceph-mon[30956]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 983 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 868 MiB/s wr, 1.42k op/s 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.265+0000 7f2b96cde640 1 -- 172.21.15.18:0/3544181697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b90106f10 msgr2=0x7f2b9010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.265+0000 7f2b96cde640 1 --2- 172.21.15.18:0/3544181697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b90106f10 0x7f2b9010ea90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009900 tx=0x7f2b7802a440 comp rx=0 tx=0).stop 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.265+0000 7f2b96cde640 1 -- 172.21.15.18:0/3544181697 shutdown_connections 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.265+0000 7f2b96cde640 1 --2- 172.21.15.18:0/3544181697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b90106f10 0x7f2b9010ea90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.266+0000 7f2b96cde640 1 --2- 172.21.15.18:0/3544181697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b90102790 0x7f2b901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.266+0000 7f2b96cde640 1 --2- 172.21.15.18:0/3544181697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b90101de0 0x7f2b901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.266+0000 7f2b96cde640 1 -- 172.21.15.18:0/3544181697 >> 172.21.15.18:0/3544181697 conn(0x7f2b900fd8e0 msgr2=0x7f2b900ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.266+0000 7f2b96cde640 1 -- 172.21.15.18:0/3544181697 shutdown_connections 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.266+0000 7f2b96cde640 1 -- 172.21.15.18:0/3544181697 wait complete. 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.268+0000 7f2b96cde640 1 Processor -- start 2024-09-19T09:59:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.268+0000 7f2b96cde640 1 -- start start 2024-09-19T09:59:08.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.269+0000 7f2b96cde640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b90101de0 0x7f2b901964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.269+0000 7f2b96cde640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b90102790 0x7f2b90196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.269+0000 7f2b96cde640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b90106f10 0x7f2b9019ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.270+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b90102790 0x7f2b90196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.270+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b90102790 0x7f2b90196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40186/0 (socket says 172.21.15.18:40186) 2024-09-19T09:59:08.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.270+0000 7f2b8ffff640 1 -- 172.21.15.18:0/2221748045 learned_addr learned my addr 172.21.15.18:0/2221748045 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:08.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.270+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9010fe40 con 0x7f2b90102790 2024-09-19T09:59:08.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.270+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9010fcc0 con 0x7f2b90101de0 2024-09-19T09:59:08.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.270+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9010ffc0 con 0x7f2b90106f10 2024-09-19T09:59:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.271+0000 7f2b9527b640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b90106f10 0x7f2b9019ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.271+0000 7f2b8ffff640 1 -- 172.21.15.18:0/2221748045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b90106f10 msgr2=0x7f2b9019ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.271+0000 7f2b8ffff640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b90106f10 0x7f2b9019ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.271+0000 7f2b8ffff640 1 -- 172.21.15.18:0/2221748045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b90101de0 msgr2=0x7f2b901964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.272+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b90101de0 0x7f2b901964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.272+0000 7f2b8ffff640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b90101de0 0x7f2b901964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.273+0000 7f2b8ffff640 1 -- 172.21.15.18:0/2221748045 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9019b470 con 0x7f2b90102790 2024-09-19T09:59:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.273+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b90101de0 0x7f2b901964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:59:08.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.273+0000 7f2b8ffff640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b90102790 0x7f2b90196a00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000b450 tx=0x7f2b8000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:08.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.281+0000 7f2b8dffb640 1 -- 172.21.15.18:0/2221748045 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80015020 con 0x7f2b90102790 2024-09-19T09:59:08.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.282+0000 7f2b8dffb640 1 -- 172.21.15.18:0/2221748045 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b80011d70 con 0x7f2b90102790 2024-09-19T09:59:08.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.282+0000 7f2b8dffb640 1 -- 172.21.15.18:0/2221748045 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80015020 con 0x7f2b90102790 2024-09-19T09:59:08.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.282+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9019b760 con 0x7f2b90102790 2024-09-19T09:59:08.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.283+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b901a3040 con 0x7f2b90102790 2024-09-19T09:59:08.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.292+0000 7f2b990b7740 1 Processor -- start 2024-09-19T09:59:08.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.295+0000 7f2b990b7740 1 -- start start 2024-09-19T09:59:08.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.298+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 0x564f6ea0e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.298+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0e5d0 0x564f6ea0ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.299+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea19370 0x564f6ea1b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.299+0000 7f2b990b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564f6e9742f0 con 0x564f6ea19370 2024-09-19T09:59:08.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.299+0000 7f2b990b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564f6e91bcf0 con 0x564f6ea0fb40 2024-09-19T09:59:08.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.299+0000 7f2b990b7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564f6e9702b0 con 0x564f6ea0e5d0 2024-09-19T09:59:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.301+0000 7f2b94a7a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0e5d0 0x564f6ea0ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.303+0000 7f2b94a7a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0e5d0 0x564f6ea0ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33372/0 (socket says 172.21.15.18:33372) 2024-09-19T09:59:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.303+0000 7f2b94a7a640 1 -- 172.21.15.18:0/2210169006 learned_addr learned my addr 172.21.15.18:0/2210169006 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.303+0000 7f2b8dffb640 1 -- 172.21.15.18:0/2221748045 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2b80018020 con 0x7f2b90102790 2024-09-19T09:59:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.305+0000 7f2b8dffb640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b7c0a7a90 0x7f2b7c0a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.310+0000 7f2b9527b640 1 --2- 172.21.15.18:0/2210169006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 0x564f6ea0e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.311+0000 7f2b94a7a640 1 -- 172.21.15.18:0/2210169006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 msgr2=0x564f6ea0e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.311+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/2210169006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 0x564f6ea0e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.311+0000 7f2b94a7a640 1 -- 172.21.15.18:0/2210169006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea19370 msgr2=0x564f6ea1b760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:59:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.311+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/2210169006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea19370 0x564f6ea1b760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.311+0000 7f2b94a7a640 1 -- 172.21.15.18:0/2210169006 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f6e9003a0 con 0x564f6ea0e5d0 2024-09-19T09:59:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.312+0000 7f2b8dffb640 1 -- 172.21.15.18:0/2221748045 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2b80011690 con 0x7f2b90102790 2024-09-19T09:59:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.312+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/2210169006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0e5d0 0x564f6ea0ea10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b88007f90 tx=0x7f2b8800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24443bf3e6679762 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.313+0000 7f2b86ffd640 1 -- 172.21.15.18:0/2210169006 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88014070 con 0x564f6ea0e5d0 2024-09-19T09:59:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.313+0000 7f2b86ffd640 1 -- 172.21.15.18:0/2210169006 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b8800fd10 con 0x564f6ea0e5d0 2024-09-19T09:59:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.314+0000 7f2b990b7740 1 -- 172.21.15.18:0/2210169006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0e5d0 msgr2=0x564f6ea0ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.315+0000 7f2b990b7740 1 --2- 172.21.15.18:0/2210169006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0e5d0 0x564f6ea0ea10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b88007f90 tx=0x7f2b8800c730 comp rx=0 tx=0).stop 2024-09-19T09:59:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.315+0000 7f2b990b7740 1 -- 172.21.15.18:0/2210169006 shutdown_connections 2024-09-19T09:59:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.315+0000 7f2b990b7740 1 --2- 172.21.15.18:0/2210169006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea19370 0x564f6ea1b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.315+0000 7f2b990b7740 1 --2- 172.21.15.18:0/2210169006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0e5d0 0x564f6ea0ea10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.315+0000 7f2b990b7740 1 --2- 172.21.15.18:0/2210169006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 0x564f6ea0e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.315+0000 7f2b990b7740 1 -- 172.21.15.18:0/2210169006 >> 172.21.15.18:0/2210169006 conn(0x564f6e9d7310 msgr2=0x564f6ea0ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.320+0000 7f2b990b7740 1 -- 172.21.15.18:0/2210169006 shutdown_connections 2024-09-19T09:59:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.321+0000 7f2b9527b640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b7c0a7a90 0x7f2b7c0a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.321+0000 7f2b990b7740 1 -- 172.21.15.18:0/2210169006 wait complete. 2024-09-19T09:59:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.322+0000 7f2b990b7740 1 -- start start 2024-09-19T09:59:08.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.323+0000 7f2b990b7740 1 Processor -- start 2024-09-19T09:59:08.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.324+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 0x564f6ea18ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.324+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea19370 0x564f6ea15d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.324+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea162a0 0x564f6ea16720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.324+0000 7f2b990b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564f6ea1c110 con 0x564f6ea162a0 2024-09-19T09:59:08.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.324+0000 7f2b990b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564f6e92f060 con 0x564f6ea0fb40 2024-09-19T09:59:08.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.324+0000 7f2b990b7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564f6ea1c290 con 0x564f6ea19370 2024-09-19T09:59:08.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.325+0000 7f2b990b7740 10 client.0 _ll_register_callbacks cb 0x564f6e6828c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:08.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.327+0000 7f2b94a7a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 0x564f6ea18ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.327+0000 7f2b94a7a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 0x564f6ea18ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59306/0 (socket says 172.21.15.18:59306) 2024-09-19T09:59:08.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.327+0000 7f2b94a7a640 1 -- 172.21.15.18:0/399380681 learned_addr learned my addr 172.21.15.18:0/399380681 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:08.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.327+0000 7f2b8ffff640 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea19370 0x564f6ea15d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.329+0000 7f2b94a7a640 1 -- 172.21.15.18:0/399380681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea19370 msgr2=0x564f6ea15d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.329+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea19370 0x564f6ea15d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.329+0000 7f2b94a7a640 1 -- 172.21.15.18:0/399380681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea162a0 msgr2=0x564f6ea16720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.329+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea162a0 0x564f6ea16720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.329+0000 7f2b94a7a640 1 -- 172.21.15.18:0/399380681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f6e6e53c0 con 0x564f6ea0fb40 2024-09-19T09:59:08.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.331+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 0x564f6ea18ab0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800cfb0 tx=0x7f2b88007260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de08ea4a3e7b4d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:08.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.331+0000 7f2b6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.332+0000 7f2b6ffff640 1 -- 172.21.15.18:0/399380681 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88014050 con 0x564f6ea0fb40 2024-09-19T09:59:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.332+0000 7f2b990b7740 1 -- 172.21.15.18:0/399380681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f6e981860 con 0x564f6ea0fb40 2024-09-19T09:59:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.332+0000 7f2b6ffff640 1 -- 172.21.15.18:0/399380681 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2b8800e790 con 0x564f6ea0fb40 2024-09-19T09:59:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.333+0000 7f2b9527b640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b7c0a7a90 0x7f2b7c0a9f50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2b78005c40 tx=0x7f2b78004320 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.338+0000 7f2b6ffff640 1 -- 172.21.15.18:0/399380681 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b8802a070 con 0x564f6ea0fb40 2024-09-19T09:59:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.338+0000 7f2b990b7740 10 client.26600 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.338+0000 7f2b990b7740 1 -- 172.21.15.18:0/399380681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f6ea27e20 con 0x564f6ea0fb40 2024-09-19T09:59:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.340+0000 7f2b6ffff640 1 -- 172.21.15.18:0/399380681 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564f6e981860 con 0x564f6ea0fb40 2024-09-19T09:59:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.341+0000 7f2b6ffff640 1 -- 172.21.15.18:0/399380681 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2b88021020 con 0x564f6ea0fb40 2024-09-19T09:59:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.342+0000 7f2b990b7740 10 client.26600 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.342+0000 7f2b990b7740 10 client.26600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.342+0000 7f2b990b7740 20 client.26600 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.342+0000 7f2b990b7740 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564f6ea29600 0x564f6ea2baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.342+0000 7f2b990b7740 4 client.26600 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.342+0000 7f2b990b7740 1 -- 172.21.15.18:0/399380681 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f6e97bd70 con 0x564f6ea29600 2024-09-19T09:59:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.343+0000 7f2b8ffff640 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564f6ea29600 0x564f6ea2baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.347+0000 7f2b8ffff640 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564f6ea29600 0x564f6ea2baa0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=823a666e874e7891 server_cookie=2b12147ab3b54a63 in_seq=0 out_seq=0 2024-09-19T09:59:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.347+0000 7f2b6ffff640 10 client.26600 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.351+0000 7f2b6ffff640 1 -- 172.21.15.18:0/399380681 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f6e97bd70 con 0x564f6ea29600 2024-09-19T09:59:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.352+0000 7f2b6ffff640 10 client.26600 handle_command_reply: tid=0 2024-09-19T09:59:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.352+0000 7f2b990b7740 1 client.26600 shutdown 2024-09-19T09:59:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.354+0000 7f2b990b7740 1 -- 172.21.15.18:0/399380681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 msgr2=0x564f6ea18ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.354+0000 7f2b990b7740 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 0x564f6ea18ab0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800cfb0 tx=0x7f2b88007260 comp rx=0 tx=0).stop 2024-09-19T09:59:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.354+0000 7f2b990b7740 1 -- 172.21.15.18:0/399380681 shutdown_connections 2024-09-19T09:59:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.354+0000 7f2b990b7740 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564f6ea29600 0x564f6ea2baa0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.354+0000 7f2b990b7740 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea162a0 0x564f6ea16720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.354+0000 7f2b990b7740 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea19370 0x564f6ea15d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.354+0000 7f2b990b7740 1 --2- 172.21.15.18:0/399380681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea0fb40 0x564f6ea18ab0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.354+0000 7f2b990b7740 1 -- 172.21.15.18:0/399380681 >> 172.21.15.18:0/399380681 conn(0x564f6e9d7310 msgr2=0x564f6ea10990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:08.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.355+0000 7f2b6ffff640 0 client.26600 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:08.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.356+0000 7f2b990b7740 1 -- 172.21.15.18:0/399380681 shutdown_connections 2024-09-19T09:59:08.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.357+0000 7f2b990b7740 1 -- 172.21.15.18:0/399380681 wait complete. 2024-09-19T09:59:08.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.357+0000 7f2b990b7740 20 client.26600 trim_cache size 0 max 16384 2024-09-19T09:59:08.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:07 smithi049 ceph-mon[34858]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 983 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 868 MiB/s wr, 1.42k op/s 2024-09-19T09:59:08.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.409+0000 7f2b990b7740 1 Processor -- start 2024-09-19T09:59:08.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.410+0000 7f2b990b7740 1 -- start start 2024-09-19T09:59:08.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:07 smithi162 ceph-mon[35174]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 983 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 868 MiB/s wr, 1.42k op/s 2024-09-19T09:59:08.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.411+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0fb40 0x564f6ea0e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.411+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea162a0 0x564f6ea24e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.411+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea19370 0x564f6ea313b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.411+0000 7f2b990b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7000e310 con 0x564f6ea19370 2024-09-19T09:59:08.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.411+0000 7f2b990b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7000fe50 con 0x564f6ea162a0 2024-09-19T09:59:08.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.412+0000 7f2b990b7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7000e9e0 con 0x564f6ea0fb40 2024-09-19T09:59:08.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.412+0000 7f2b94a7a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0fb40 0x564f6ea0e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.412+0000 7f2b9527b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea19370 0x564f6ea313b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.412+0000 7f2b9527b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea19370 0x564f6ea313b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40196/0 (socket says 172.21.15.18:40196) 2024-09-19T09:59:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.412+0000 7f2b9527b640 1 -- 172.21.15.18:0/837242598 learned_addr learned my addr 172.21.15.18:0/837242598 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.412+0000 7f2b8ffff640 1 --2- 172.21.15.18:0/837242598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea162a0 0x564f6ea24e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.416+0000 7f2b94a7a640 1 -- 172.21.15.18:0/837242598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea162a0 msgr2=0x564f6ea24e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.416+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/837242598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea162a0 0x564f6ea24e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.416+0000 7f2b94a7a640 1 -- 172.21.15.18:0/837242598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea19370 msgr2=0x564f6ea313b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.416+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/837242598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea19370 0x564f6ea313b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.416+0000 7f2b94a7a640 1 -- 172.21.15.18:0/837242598 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f6ea16a50 con 0x564f6ea0fb40 2024-09-19T09:59:08.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.418+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/837242598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0fb40 0x564f6ea0e730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800cf80 tx=0x7f2b8800cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ee1117e1903aec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:08.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.423+0000 7f2b867fc640 1 -- 172.21.15.18:0/837242598 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88014070 con 0x564f6ea0fb40 2024-09-19T09:59:08.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.423+0000 7f2b867fc640 1 -- 172.21.15.18:0/837242598 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b8800ea70 con 0x564f6ea0fb40 2024-09-19T09:59:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.424+0000 7f2b990b7740 1 -- 172.21.15.18:0/837242598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0fb40 msgr2=0x564f6ea0e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.424+0000 7f2b990b7740 1 --2- 172.21.15.18:0/837242598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0fb40 0x564f6ea0e730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800cf80 tx=0x7f2b8800cd60 comp rx=0 tx=0).stop 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.424+0000 7f2b990b7740 1 -- 172.21.15.18:0/837242598 shutdown_connections 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.424+0000 7f2b990b7740 1 --2- 172.21.15.18:0/837242598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea19370 0x564f6ea313b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.424+0000 7f2b990b7740 1 --2- 172.21.15.18:0/837242598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea162a0 0x564f6ea24e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.424+0000 7f2b990b7740 1 --2- 172.21.15.18:0/837242598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea0fb40 0x564f6ea0e730 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800cf80 tx=0x7f2b8800cd60 comp rx=0 tx=0).stop 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.424+0000 7f2b990b7740 1 -- 172.21.15.18:0/837242598 >> 172.21.15.18:0/837242598 conn(0x564f6e9d7310 msgr2=0x564f6ea0e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.425+0000 7f2b990b7740 1 -- 172.21.15.18:0/837242598 shutdown_connections 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.425+0000 7f2b990b7740 1 -- 172.21.15.18:0/837242598 wait complete. 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.426+0000 7f2b990b7740 1 -- start start 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.426+0000 7f2b990b7740 1 Processor -- start 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.427+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea162a0 0x564f6ea212f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.427+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea19370 0x564f6ea21830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.427+0000 7f2b990b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea1bff0 0x564f6ea1c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.428+0000 7f2b990b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7000f780 con 0x564f6ea1bff0 2024-09-19T09:59:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.428+0000 7f2b990b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7000f0b0 con 0x564f6ea19370 2024-09-19T09:59:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.428+0000 7f2b990b7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7000c3a0 con 0x564f6ea162a0 2024-09-19T09:59:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.428+0000 7f2b990b7740 10 client.0 _ll_register_callbacks cb 0x7f2b88007de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:08.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.431+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea19370 0x564f6ea21830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.431+0000 7f2b9527b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea1bff0 0x564f6ea1c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.431+0000 7f2b9527b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea1bff0 0x564f6ea1c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40200/0 (socket says 172.21.15.18:40200) 2024-09-19T09:59:08.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.431+0000 7f2b9527b640 1 -- 172.21.15.18:0/3710764627 learned_addr learned my addr 172.21.15.18:0/3710764627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:08.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.431+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea162a0 0x564f6ea212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.435+0000 7f2b9527b640 1 -- 172.21.15.18:0/3710764627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea162a0 msgr2=0x564f6ea212f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.435+0000 7f2b9527b640 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea162a0 0x564f6ea212f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.435+0000 7f2b9527b640 1 -- 172.21.15.18:0/3710764627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea19370 msgr2=0x564f6ea21830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.435+0000 7f2b9527b640 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea19370 0x564f6ea21830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.435+0000 7f2b9527b640 1 -- 172.21.15.18:0/3710764627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f6ea1cca0 con 0x564f6ea1bff0 2024-09-19T09:59:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.439+0000 7f2b9527b640 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea1bff0 0x564f6ea1c470 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009850 tx=0x7f2b7802a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cfa4c2db5673e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.439+0000 7f2b6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:59:08.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.444+0000 7f2b6ffff640 1 -- 172.21.15.18:0/3710764627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78035040 con 0x564f6ea1bff0 2024-09-19T09:59:08.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.444+0000 7f2b6ffff640 1 -- 172.21.15.18:0/3710764627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2b780317b0 con 0x564f6ea1bff0 2024-09-19T09:59:08.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.444+0000 7f2b990b7740 1 -- 172.21.15.18:0/3710764627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f6e8f8170 con 0x564f6ea1bff0 2024-09-19T09:59:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.453+0000 7f2b6ffff640 1 -- 172.21.15.18:0/3710764627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b780319b0 con 0x564f6ea1bff0 2024-09-19T09:59:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.454+0000 7f2b990b7740 10 client.17175 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.454+0000 7f2b990b7740 1 -- 172.21.15.18:0/3710764627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f6ea9bc80 con 0x564f6ea1bff0 2024-09-19T09:59:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.455+0000 7f2b6ffff640 1 -- 172.21.15.18:0/3710764627 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564f6e8f8170 con 0x564f6ea1bff0 2024-09-19T09:59:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.457+0000 7f2b6ffff640 1 -- 172.21.15.18:0/3710764627 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2b7804f020 con 0x564f6ea1bff0 2024-09-19T09:59:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.457+0000 7f2b990b7740 10 client.17175 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.457+0000 7f2b990b7740 10 client.17175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.457+0000 7f2b990b7740 20 client.17175 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.457+0000 7f2b990b7740 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564f6ea9c3d0 0x564f6ea9e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.457+0000 7f2b990b7740 4 client.17175 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:59:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.457+0000 7f2b990b7740 1 -- 172.21.15.18:0/3710764627 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f6e9459b0 con 0x564f6ea9c3d0 2024-09-19T09:59:08.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.460+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564f6ea9c3d0 0x564f6ea9e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:08.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.463+0000 7f2b94a7a640 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564f6ea9c3d0 0x564f6ea9e810 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4387f8f019b2113e server_cookie=3cea340d7456b62f in_seq=0 out_seq=0 2024-09-19T09:59:08.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.463+0000 7f2b6ffff640 10 client.17175 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:08.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.472+0000 7f2b6ffff640 1 -- 172.21.15.18:0/3710764627 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f6e9459b0 con 0x564f6ea9c3d0 2024-09-19T09:59:08.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.473+0000 7f2b6ffff640 10 client.17175 handle_command_reply: tid=0 2024-09-19T09:59:08.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.473+0000 7f2b990b7740 1 client.17175 shutdown 2024-09-19T09:59:08.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.473+0000 7f2b990b7740 1 -- 172.21.15.18:0/3710764627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea1bff0 msgr2=0x564f6ea1c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.473+0000 7f2b990b7740 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea1bff0 0x564f6ea1c470 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009850 tx=0x7f2b7802a440 comp rx=0 tx=0).stop 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.473+0000 7f2b990b7740 1 -- 172.21.15.18:0/3710764627 shutdown_connections 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.473+0000 7f2b990b7740 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564f6ea9c3d0 0x564f6ea9e810 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.473+0000 7f2b990b7740 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f6ea1bff0 0x564f6ea1c470 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.474+0000 7f2b6ffff640 0 client.17175 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.474+0000 7f2b990b7740 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f6ea19370 0x564f6ea21830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.474+0000 7f2b990b7740 1 --2- 172.21.15.18:0/3710764627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f6ea162a0 0x564f6ea212f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.474+0000 7f2b990b7740 1 -- 172.21.15.18:0/3710764627 >> 172.21.15.18:0/3710764627 conn(0x564f6e9d7310 msgr2=0x564f6ea14630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.474+0000 7f2b990b7740 1 -- 172.21.15.18:0/3710764627 shutdown_connections 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.474+0000 7f2b990b7740 1 -- 172.21.15.18:0/3710764627 wait complete. 2024-09-19T09:59:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.475+0000 7f2b990b7740 20 client.17175 trim_cache size 0 max 16384 2024-09-19T09:59:08.480 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:59:08.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.477+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b7c0a7a90 msgr2=0x7f2b7c0a9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:08.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.477+0000 7f2b96cde640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b7c0a7a90 0x7f2b7c0a9f50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2b78005c40 tx=0x7f2b78004320 comp rx=0 tx=0).stop 2024-09-19T09:59:08.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.477+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b90102790 msgr2=0x7f2b90196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:08.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.477+0000 7f2b96cde640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b90102790 0x7f2b90196a00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000b450 tx=0x7f2b8000b910 comp rx=0 tx=0).stop 2024-09-19T09:59:08.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.477+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 shutdown_connections 2024-09-19T09:59:08.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.477+0000 7f2b96cde640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2b7c0a7a90 0x7f2b7c0a9f50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.477+0000 7f2b96cde640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b90106f10 0x7f2b9019ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.477+0000 7f2b96cde640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b90102790 0x7f2b90196a00 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.477+0000 7f2b96cde640 1 --2- 172.21.15.18:0/2221748045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b90101de0 0x7f2b901964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:08.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.477+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 >> 172.21.15.18:0/2221748045 conn(0x7f2b900fd8e0 msgr2=0x7f2b900fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:08.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.478+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 shutdown_connections 2024-09-19T09:59:08.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:08.478+0000 7f2b96cde640 1 -- 172.21.15.18:0/2221748045 wait complete. 2024-09-19T09:59:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.270+0000 7fd52f6ba640 1 -- 172.21.15.18:0/2678123153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd528072d80 msgr2=0x7fd528073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.270+0000 7fd52f6ba640 1 --2- 172.21.15.18:0/2678123153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd528072d80 0x7fd528073180 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd520009ca0 tx=0x7fd52002a8f0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.272+0000 7fd52f6ba640 1 -- 172.21.15.18:0/2678123153 shutdown_connections 2024-09-19T09:59:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.272+0000 7fd52f6ba640 1 --2- 172.21.15.18:0/2678123153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd52810de90 0x7fd528110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.272+0000 7fd52f6ba640 1 --2- 172.21.15.18:0/2678123153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd52810b4e0 0x7fd52810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.272+0000 7fd52f6ba640 1 --2- 172.21.15.18:0/2678123153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd528072d80 0x7fd528073180 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.272+0000 7fd52f6ba640 1 -- 172.21.15.18:0/2678123153 >> 172.21.15.18:0/2678123153 conn(0x7fd52806eb50 msgr2=0x7fd528070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.285+0000 7fd52f6ba640 1 -- 172.21.15.18:0/2678123153 shutdown_connections 2024-09-19T09:59:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.289+0000 7fd52f6ba640 1 -- 172.21.15.18:0/2678123153 wait complete. 2024-09-19T09:59:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.290+0000 7fd52f6ba640 1 Processor -- start 2024-09-19T09:59:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.290+0000 7fd52f6ba640 1 -- start start 2024-09-19T09:59:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.290+0000 7fd52f6ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd528072d80 0x7fd5281157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.290+0000 7fd52f6ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd52810b4e0 0x7fd528115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.290+0000 7fd52f6ba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd52810de90 0x7fd5281a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.290+0000 7fd52f6ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd52811c570 con 0x7fd52810b4e0 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.290+0000 7fd52f6ba640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd52811c3f0 con 0x7fd52810de90 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.290+0000 7fd52f6ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd52811c6f0 con 0x7fd528072d80 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.291+0000 7fd52cc55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd52810b4e0 0x7fd528115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.291+0000 7fd52cc55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd52810b4e0 0x7fd528115d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40214/0 (socket says 172.21.15.18:40214) 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.291+0000 7fd52cc55640 1 -- 172.21.15.18:0/1305334448 learned_addr learned my addr 172.21.15.18:0/1305334448 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.291+0000 7fd52dc57640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd52810de90 0x7fd5281a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.291+0000 7fd52d456640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd528072d80 0x7fd5281157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.291+0000 7fd52cc55640 1 -- 172.21.15.18:0/1305334448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd528072d80 msgr2=0x7fd5281157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.291+0000 7fd52cc55640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd528072d80 0x7fd5281157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.291+0000 7fd52cc55640 1 -- 172.21.15.18:0/1305334448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd52810de90 msgr2=0x7fd5281a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.291+0000 7fd52cc55640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd52810de90 0x7fd5281a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.291+0000 7fd52cc55640 1 -- 172.21.15.18:0/1305334448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5281a61b0 con 0x7fd52810b4e0 2024-09-19T09:59:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.292+0000 7fd52cc55640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd52810b4e0 0x7fd528115d30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd51800b450 tx=0x7fd51800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.294+0000 7fd51e7fc640 1 -- 172.21.15.18:0/1305334448 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518015020 con 0x7fd52810b4e0 2024-09-19T09:59:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.294+0000 7fd51e7fc640 1 -- 172.21.15.18:0/1305334448 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd518011d70 con 0x7fd52810b4e0 2024-09-19T09:59:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.294+0000 7fd51e7fc640 1 -- 172.21.15.18:0/1305334448 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51800f340 con 0x7fd52810b4e0 2024-09-19T09:59:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.294+0000 7fd52f6ba640 1 -- 172.21.15.18:0/1305334448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5281a64a0 con 0x7fd52810b4e0 2024-09-19T09:59:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.294+0000 7fd52f6ba640 1 -- 172.21.15.18:0/1305334448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5281a6a20 con 0x7fd52810b4e0 2024-09-19T09:59:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.298+0000 7fd53245c740 1 Processor -- start 2024-09-19T09:59:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.299+0000 7fd53245c740 1 -- start start 2024-09-19T09:59:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.299+0000 7fd53245c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b2b70 0x5638ff1b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.299+0000 7fd53245c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1b34b0 0x5638ff1b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.299+0000 7fd53245c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 0x5638ff1baa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.299+0000 7fd53245c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5638ff1162f0 con 0x5638ff1b34b0 2024-09-19T09:59:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.299+0000 7fd53245c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5638ff0be270 con 0x5638ff1b8540 2024-09-19T09:59:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.299+0000 7fd53245c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5638ff1122b0 con 0x5638ff1b2b70 2024-09-19T09:59:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.300+0000 7fd52dc57640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b2b70 0x5638ff1b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.300+0000 7fd52dc57640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b2b70 0x5638ff1b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33440/0 (socket says 172.21.15.18:33440) 2024-09-19T09:59:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.300+0000 7fd52dc57640 1 -- 172.21.15.18:0/2832042321 learned_addr learned my addr 172.21.15.18:0/2832042321 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.301+0000 7fd52cc55640 1 --2- 172.21.15.18:0/2832042321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 0x5638ff1baa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.301+0000 7fd52dc57640 1 -- 172.21.15.18:0/2832042321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 msgr2=0x5638ff1baa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.301+0000 7fd52dc57640 1 --2- 172.21.15.18:0/2832042321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 0x5638ff1baa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.301+0000 7fd52dc57640 1 -- 172.21.15.18:0/2832042321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1b34b0 msgr2=0x5638ff1b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.301+0000 7fd52dc57640 1 --2- 172.21.15.18:0/2832042321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1b34b0 0x5638ff1b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.304+0000 7fd51e7fc640 1 -- 172.21.15.18:0/1305334448 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd518018020 con 0x7fd52810b4e0 2024-09-19T09:59:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.304+0000 7fd52dc57640 1 -- 172.21.15.18:0/2832042321 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638ff0bd340 con 0x5638ff1b2b70 2024-09-19T09:59:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.305+0000 7fd52dc57640 1 --2- 172.21.15.18:0/2832042321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b2b70 0x5638ff1b2f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd5240099e0 tx=0x7fd524009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3e4f5b189ec95b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.306+0000 7fd51e7fc640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd5140a33d0 0x7fd5140a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.306+0000 7fd5137fe640 1 -- 172.21.15.18:0/2832042321 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524017070 con 0x5638ff1b2b70 2024-09-19T09:59:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.306+0000 7fd5137fe640 1 -- 172.21.15.18:0/2832042321 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd524013470 con 0x5638ff1b2b70 2024-09-19T09:59:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.307+0000 7fd51e7fc640 1 -- 172.21.15.18:0/1305334448 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd5180d0760 con 0x7fd52810b4e0 2024-09-19T09:59:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.308+0000 7fd53245c740 1 -- 172.21.15.18:0/2832042321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b2b70 msgr2=0x5638ff1b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.308+0000 7fd53245c740 1 --2- 172.21.15.18:0/2832042321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b2b70 0x5638ff1b2f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd5240099e0 tx=0x7fd524009ea0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.308+0000 7fd53245c740 1 -- 172.21.15.18:0/2832042321 shutdown_connections 2024-09-19T09:59:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.308+0000 7fd53245c740 1 --2- 172.21.15.18:0/2832042321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 0x5638ff1baa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.308+0000 7fd53245c740 1 --2- 172.21.15.18:0/2832042321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1b34b0 0x5638ff1b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.308+0000 7fd53245c740 1 --2- 172.21.15.18:0/2832042321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b2b70 0x5638ff1b2f70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.308+0000 7fd53245c740 1 -- 172.21.15.18:0/2832042321 >> 172.21.15.18:0/2832042321 conn(0x5638ff1ae1e0 msgr2=0x5638ff1ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.308+0000 7fd52d456640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd5140a33d0 0x7fd5140a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.308+0000 7fd53245c740 1 -- 172.21.15.18:0/2832042321 shutdown_connections 2024-09-19T09:59:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.310+0000 7fd53245c740 1 -- 172.21.15.18:0/2832042321 wait complete. 2024-09-19T09:59:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.310+0000 7fd53245c740 1 -- start start 2024-09-19T09:59:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.310+0000 7fd53245c740 1 Processor -- start 2024-09-19T09:59:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.311+0000 7fd53245c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 0x5638ff1bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.311+0000 7fd53245c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 0x5638ff1bd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.311+0000 7fd53245c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 0x5638ff1c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.311+0000 7fd53245c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5638ff1bb560 con 0x5638ff1c22b0 2024-09-19T09:59:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.311+0000 7fd53245c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5638ff09f290 con 0x5638ff1b34b0 2024-09-19T09:59:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.311+0000 7fd53245c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5638ff1bb6e0 con 0x5638ff1b8540 2024-09-19T09:59:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.311+0000 7fd53245c740 10 client.0 _ll_register_callbacks cb 0x5638ff0d0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.312+0000 7fd52d456640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd5140a33d0 0x7fd5140a5890 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd520031c10 tx=0x7fd520005eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.312+0000 7fd52dc57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 0x5638ff1c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.312+0000 7fd52dc57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 0x5638ff1c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40230/0 (socket says 172.21.15.18:40230) 2024-09-19T09:59:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.312+0000 7fd52dc57640 1 -- 172.21.15.18:0/4118796490 learned_addr learned my addr 172.21.15.18:0/4118796490 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.312+0000 7fd52cc55640 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 0x5638ff1bd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.313+0000 7fd52d456640 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 0x5638ff1bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.313+0000 7fd52dc57640 1 -- 172.21.15.18:0/4118796490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 msgr2=0x5638ff1bd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.313+0000 7fd52dc57640 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 0x5638ff1bd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.313+0000 7fd52dc57640 1 -- 172.21.15.18:0/4118796490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 msgr2=0x5638ff1bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.313+0000 7fd52dc57640 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 0x5638ff1bcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.313+0000 7fd52dc57640 1 -- 172.21.15.18:0/4118796490 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638fee29210 con 0x5638ff1c22b0 2024-09-19T09:59:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.314+0000 7fd52dc57640 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 0x5638ff1c46a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd52400ef60 tx=0x7fd52400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4e16f864548e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.315+0000 7fd510ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:59:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.315+0000 7fd510ff9640 1 -- 172.21.15.18:0/4118796490 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524017050 con 0x5638ff1c22b0 2024-09-19T09:59:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.315+0000 7fd510ff9640 1 -- 172.21.15.18:0/4118796490 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd524012e60 con 0x5638ff1c22b0 2024-09-19T09:59:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.315+0000 7fd53245c740 1 -- 172.21.15.18:0/4118796490 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638ff123a20 con 0x5638ff1c22b0 2024-09-19T09:59:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.316+0000 7fd510ff9640 1 -- 172.21.15.18:0/4118796490 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd524013470 con 0x5638ff1c22b0 2024-09-19T09:59:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.316+0000 7fd53245c740 10 client.17184 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.316+0000 7fd53245c740 1 -- 172.21.15.18:0/4118796490 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5638feef5620 con 0x5638ff1c22b0 2024-09-19T09:59:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.318+0000 7fd510ff9640 1 -- 172.21.15.18:0/4118796490 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5638ff123a20 con 0x5638ff1c22b0 2024-09-19T09:59:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.318+0000 7fd510ff9640 1 -- 172.21.15.18:0/4118796490 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd52401c910 con 0x5638ff1c22b0 2024-09-19T09:59:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.319+0000 7fd53245c740 10 client.17184 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.319+0000 7fd53245c740 10 client.17184 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.319+0000 7fd53245c740 20 client.17184 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.319+0000 7fd53245c740 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5638ff1c91c0 0x5638ff1cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.319+0000 7fd53245c740 4 client.17184 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.319+0000 7fd53245c740 1 -- 172.21.15.18:0/4118796490 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638ff11dd70 con 0x5638ff1c91c0 2024-09-19T09:59:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.322+0000 7fd52d456640 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5638ff1c91c0 0x5638ff1cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.329+0000 7fd52d456640 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5638ff1c91c0 0x5638ff1cb600 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12bdadb6fab930c6 server_cookie=91e46e69908a4830 in_seq=0 out_seq=0 2024-09-19T09:59:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.330+0000 7fd510ff9640 10 client.17184 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.335+0000 7fd510ff9640 1 -- 172.21.15.18:0/4118796490 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638ff11dd70 con 0x5638ff1c91c0 2024-09-19T09:59:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.335+0000 7fd510ff9640 10 client.17184 handle_command_reply: tid=0 2024-09-19T09:59:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.335+0000 7fd53245c740 1 client.17184 shutdown 2024-09-19T09:59:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.336+0000 7fd53245c740 1 -- 172.21.15.18:0/4118796490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 msgr2=0x5638ff1c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.336+0000 7fd53245c740 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 0x5638ff1c46a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd52400ef60 tx=0x7fd52400ef90 comp rx=0 tx=0).stop 2024-09-19T09:59:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.337+0000 7fd53245c740 1 -- 172.21.15.18:0/4118796490 shutdown_connections 2024-09-19T09:59:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.337+0000 7fd53245c740 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5638ff1c91c0 0x5638ff1cb600 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.337+0000 7fd53245c740 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 0x5638ff1c46a0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.337+0000 7fd53245c740 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 0x5638ff1bd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.337+0000 7fd53245c740 1 --2- 172.21.15.18:0/4118796490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 0x5638ff1bcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.337+0000 7fd53245c740 1 -- 172.21.15.18:0/4118796490 >> 172.21.15.18:0/4118796490 conn(0x5638ff1ae1e0 msgr2=0x5638ff1af240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.337+0000 7fd510ff9640 0 client.17184 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.337+0000 7fd53245c740 1 -- 172.21.15.18:0/4118796490 shutdown_connections 2024-09-19T09:59:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.339+0000 7fd53245c740 1 -- 172.21.15.18:0/4118796490 wait complete. 2024-09-19T09:59:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.340+0000 7fd53245c740 20 client.17184 trim_cache size 0 max 16384 2024-09-19T09:59:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.384+0000 7fd53245c740 1 Processor -- start 2024-09-19T09:59:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.385+0000 7fd53245c740 1 -- start start 2024-09-19T09:59:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.385+0000 7fd53245c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 0x5638ff1a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:10 smithi018 ceph-mon[30956]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 800 MiB/s wr, 1.38k op/s 2024-09-19T09:59:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.385+0000 7fd53245c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 0x5638ff1adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.386+0000 7fd53245c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 0x5638ff1b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.389+0000 7fd52d456640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 0x5638ff1a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.389+0000 7fd52cc55640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 0x5638ff1adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.389+0000 7fd52cc55640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 0x5638ff1adaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33452/0 (socket says 172.21.15.18:33452) 2024-09-19T09:59:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.389+0000 7fd52dc57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 0x5638ff1b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.389+0000 7fd52cc55640 1 -- 172.21.15.18:0/3897592815 learned_addr learned my addr 172.21.15.18:0/3897592815 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.389+0000 7fd53245c740 1 -- 172.21.15.18:0/3897592815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c00e510 con 0x5638ff1c22b0 2024-09-19T09:59:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.390+0000 7fd53245c740 1 -- 172.21.15.18:0/3897592815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c010050 con 0x5638ff1b34b0 2024-09-19T09:59:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.390+0000 7fd53245c740 1 -- 172.21.15.18:0/3897592815 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c00ebe0 con 0x5638ff1b8540 2024-09-19T09:59:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.392+0000 7fd52d456640 1 -- 172.21.15.18:0/3897592815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 msgr2=0x5638ff1adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.392+0000 7fd52d456640 1 --2- 172.21.15.18:0/3897592815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 0x5638ff1adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.392+0000 7fd52d456640 1 -- 172.21.15.18:0/3897592815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 msgr2=0x5638ff1b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.392+0000 7fd52d456640 1 --2- 172.21.15.18:0/3897592815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 0x5638ff1b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.392+0000 7fd52d456640 1 -- 172.21.15.18:0/3897592815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638ff1c4a10 con 0x5638ff1b34b0 2024-09-19T09:59:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.394+0000 7fd52d456640 1 --2- 172.21.15.18:0/3897592815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 0x5638ff1a8ed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5638ff1af060 tx=0x7fd52003d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9285794427a53b7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.395+0000 7fd512ffd640 1 -- 172.21.15.18:0/3897592815 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520004510 con 0x5638ff1b34b0 2024-09-19T09:59:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.395+0000 7fd512ffd640 1 -- 172.21.15.18:0/3897592815 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd520036050 con 0x5638ff1b34b0 2024-09-19T09:59:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.395+0000 7fd512ffd640 1 -- 172.21.15.18:0/3897592815 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5200305f0 con 0x5638ff1b34b0 2024-09-19T09:59:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.397+0000 7fd53245c740 1 -- 172.21.15.18:0/3897592815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 msgr2=0x5638ff1a8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.397+0000 7fd53245c740 1 --2- 172.21.15.18:0/3897592815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 0x5638ff1a8ed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5638ff1af060 tx=0x7fd52003d000 comp rx=0 tx=0).stop 2024-09-19T09:59:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.397+0000 7fd53245c740 1 -- 172.21.15.18:0/3897592815 shutdown_connections 2024-09-19T09:59:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.397+0000 7fd53245c740 1 --2- 172.21.15.18:0/3897592815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1c22b0 0x5638ff1b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.398+0000 7fd53245c740 1 --2- 172.21.15.18:0/3897592815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1b8540 0x5638ff1adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.398+0000 7fd53245c740 1 --2- 172.21.15.18:0/3897592815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b34b0 0x5638ff1a8ed0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.398+0000 7fd53245c740 1 -- 172.21.15.18:0/3897592815 >> 172.21.15.18:0/3897592815 conn(0x5638ff1ae1e0 msgr2=0x5638ff1ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.398+0000 7fd53245c740 1 -- 172.21.15.18:0/3897592815 shutdown_connections 2024-09-19T09:59:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.398+0000 7fd53245c740 1 -- 172.21.15.18:0/3897592815 wait complete. 2024-09-19T09:59:10.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:10 smithi049 ceph-mon[34858]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 800 MiB/s wr, 1.38k op/s 2024-09-19T09:59:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.399+0000 7fd53245c740 1 -- start start 2024-09-19T09:59:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.399+0000 7fd53245c740 1 Processor -- start 2024-09-19T09:59:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.400+0000 7fd53245c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1b34b0 0x5638ff1d9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.401+0000 7fd53245c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 0x5638ff1dc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.401+0000 7fd53245c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1c22b0 0x5638ff1dc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.402+0000 7fd53245c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c00f980 con 0x5638ff1b34b0 2024-09-19T09:59:10.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.402+0000 7fd53245c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c00f2b0 con 0x5638ff1b8540 2024-09-19T09:59:10.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.402+0000 7fd53245c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c00c4f0 con 0x5638ff1c22b0 2024-09-19T09:59:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.402+0000 7fd52dc57640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1c22b0 0x5638ff1dc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.402+0000 7fd52dc57640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1c22b0 0x5638ff1dc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33454/0 (socket says 172.21.15.18:33454) 2024-09-19T09:59:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.402+0000 7fd52dc57640 1 -- 172.21.15.18:0/1880549899 learned_addr learned my addr 172.21.15.18:0/1880549899 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.403+0000 7fd52cc55640 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 0x5638ff1dc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.403+0000 7fd53245c740 10 client.0 _ll_register_callbacks cb 0x7fd524009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.404+0000 7fd52d456640 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1b34b0 0x5638ff1d9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.405+0000 7fd52cc55640 1 -- 172.21.15.18:0/1880549899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1c22b0 msgr2=0x5638ff1dc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.405+0000 7fd52cc55640 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1c22b0 0x5638ff1dc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.405+0000 7fd52cc55640 1 -- 172.21.15.18:0/1880549899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1b34b0 msgr2=0x5638ff1d9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.405+0000 7fd52cc55640 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1b34b0 0x5638ff1d9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.405+0000 7fd52cc55640 1 -- 172.21.15.18:0/1880549899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638ff1dd060 con 0x5638ff1b8540 2024-09-19T09:59:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.407+0000 7fd52cc55640 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 0x5638ff1dc160 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd518010aa0 tx=0x7fd51809d4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3190a405d7bf31e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.407+0000 7fd510ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.408+0000 7fd510ff9640 1 -- 172.21.15.18:0/1880549899 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5180a5a20 con 0x5638ff1b8540 2024-09-19T09:59:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.408+0000 7fd510ff9640 1 -- 172.21.15.18:0/1880549899 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd5180a5590 con 0x5638ff1b8540 2024-09-19T09:59:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.408+0000 7fd53245c740 1 -- 172.21.15.18:0/1880549899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd520036050 con 0x5638ff1b8540 2024-09-19T09:59:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.409+0000 7fd510ff9640 1 -- 172.21.15.18:0/1880549899 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd5180a5790 con 0x5638ff1b8540 2024-09-19T09:59:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:10 smithi162 ceph-mon[35174]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 800 MiB/s wr, 1.38k op/s 2024-09-19T09:59:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.411+0000 7fd53245c740 10 client.26618 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.411+0000 7fd53245c740 1 -- 172.21.15.18:0/1880549899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5638ff2326f0 con 0x5638ff1b8540 2024-09-19T09:59:10.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.412+0000 7fd510ff9640 1 -- 172.21.15.18:0/1880549899 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5180a0070 con 0x5638ff1b8540 2024-09-19T09:59:10.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.412+0000 7fd510ff9640 1 -- 172.21.15.18:0/1880549899 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd51809bc70 con 0x5638ff1b8540 2024-09-19T09:59:10.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.412+0000 7fd53245c740 10 client.26618 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:10.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.412+0000 7fd53245c740 10 client.26618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:10.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.412+0000 7fd53245c740 20 client.26618 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:10.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.412+0000 7fd53245c740 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5638ff233020 0x5638ff235440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:10.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.412+0000 7fd53245c740 4 client.26618 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:59:10.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.412+0000 7fd53245c740 1 -- 172.21.15.18:0/1880549899 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fd520036050 con 0x5638ff233020 2024-09-19T09:59:10.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.413+0000 7fd52d456640 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5638ff233020 0x5638ff235440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.415+0000 7fd52d456640 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5638ff233020 0x5638ff235440 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b4fae12cb1d7f2a server_cookie=22fa82cecd5a225e in_seq=0 out_seq=0 2024-09-19T09:59:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:10.415+0000 7fd510ff9640 10 client.26618 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:10.586 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:59:10.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:59:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:59:12.287 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:12 smithi018 ceph-mon[30956]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 805 MiB/s wr, 1.41k op/s 2024-09-19T09:59:12.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:12 smithi049 ceph-mon[34858]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 805 MiB/s wr, 1.41k op/s 2024-09-19T09:59:12.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:12 smithi162 ceph-mon[35174]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 805 MiB/s wr, 1.41k op/s 2024-09-19T09:59:12.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.840+0000 7fa96c679640 1 -- 172.21.15.18:0/667192463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa964101dd0 msgr2=0x7fa9641021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:12.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.840+0000 7fa96c679640 1 --2- 172.21.15.18:0/667192463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa964101dd0 0x7fa9641021b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa960009900 tx=0x7fa96002e850 comp rx=0 tx=0).stop 2024-09-19T09:59:12.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.841+0000 7fa96c679640 1 -- 172.21.15.18:0/667192463 shutdown_connections 2024-09-19T09:59:12.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.841+0000 7fa96c679640 1 --2- 172.21.15.18:0/667192463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964106f00 0x7fa96410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.841+0000 7fa96c679640 1 --2- 172.21.15.18:0/667192463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102780 0x7fa9641067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.841+0000 7fa96c679640 1 --2- 172.21.15.18:0/667192463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa964101dd0 0x7fa9641021b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.841+0000 7fa96c679640 1 -- 172.21.15.18:0/667192463 >> 172.21.15.18:0/667192463 conn(0x7fa9640fd8b0 msgr2=0x7fa9640ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:12.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.842+0000 7fa96c679640 1 -- 172.21.15.18:0/667192463 shutdown_connections 2024-09-19T09:59:12.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.842+0000 7fa96c679640 1 -- 172.21.15.18:0/667192463 wait complete. 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.843+0000 7fa96c679640 1 Processor -- start 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.843+0000 7fa96c679640 1 -- start start 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.843+0000 7fa96c679640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964101dd0 0x7fa9640738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.843+0000 7fa96c679640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102780 0x7fa964073e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.843+0000 7fa96c679640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa964106f00 0x7fa96406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.844+0000 7fa96c679640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa96406c3e0 con 0x7fa964102780 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.844+0000 7fa96c679640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa96406c260 con 0x7fa964106f00 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.844+0000 7fa96c679640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa96406c560 con 0x7fa964101dd0 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.844+0000 7fa96ac16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa964106f00 0x7fa96406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.844+0000 7fa96ac16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa964106f00 0x7fa96406da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59386/0 (socket says 172.21.15.18:59386) 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.844+0000 7fa96ac16640 1 -- 172.21.15.18:0/3563865610 learned_addr learned my addr 172.21.15.18:0/3563865610 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:12.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.844+0000 7fa96a415640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964101dd0 0x7fa9640738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:12.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.845+0000 7fa96ac16640 1 -- 172.21.15.18:0/3563865610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964101dd0 msgr2=0x7fa9640738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:12.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.845+0000 7fa96ac16640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964101dd0 0x7fa9640738e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.845+0000 7fa96ac16640 1 -- 172.21.15.18:0/3563865610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102780 msgr2=0x7fa964073e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:12.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.845+0000 7fa96ac16640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102780 0x7fa964073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.845+0000 7fa96ac16640 1 -- 172.21.15.18:0/3563865610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96406e320 con 0x7fa964106f00 2024-09-19T09:59:12.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.845+0000 7fa96ac16640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa964106f00 0x7fa96406da60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00eb10 tx=0x7fa95c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:12.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.853+0000 7fa95b7fe640 1 -- 172.21.15.18:0/3563865610 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c004b20 con 0x7fa964106f00 2024-09-19T09:59:12.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.853+0000 7fa95b7fe640 1 -- 172.21.15.18:0/3563865610 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95c004cc0 con 0x7fa964106f00 2024-09-19T09:59:12.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.853+0000 7fa95b7fe640 1 -- 172.21.15.18:0/3563865610 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c010760 con 0x7fa964106f00 2024-09-19T09:59:12.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.853+0000 7fa96c679640 1 -- 172.21.15.18:0/3563865610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96406e610 con 0x7fa964106f00 2024-09-19T09:59:12.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.853+0000 7fa96c679640 1 -- 172.21.15.18:0/3563865610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9641157d0 con 0x7fa964106f00 2024-09-19T09:59:12.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.858+0000 7fa95b7fe640 1 -- 172.21.15.18:0/3563865610 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa95c005020 con 0x7fa964106f00 2024-09-19T09:59:12.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.859+0000 7fa95b7fe640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa9500a3450 0x7fa9500a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.861+0000 7fa96a415640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa9500a3450 0x7fa9500a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:12.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.862+0000 7fa95b7fe640 1 -- 172.21.15.18:0/3563865610 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa95c0cfd30 con 0x7fa964106f00 2024-09-19T09:59:12.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.864+0000 7fa96a415640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa9500a3450 0x7fa9500a5910 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa960000c00 tx=0x7fa960005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:12.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.864+0000 7fa96ea52740 1 Processor -- start 2024-09-19T09:59:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.867+0000 7fa96ea52740 1 -- start start 2024-09-19T09:59:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.869+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 0x55577db63f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.869+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.869+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db6ed40 0x55577db71130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.869+0000 7fa96ea52740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55577dac9280 con 0x55577db63b60 2024-09-19T09:59:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.869+0000 7fa96ea52740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55577da70b10 con 0x55577db64480 2024-09-19T09:59:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.869+0000 7fa96ea52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55577dac5240 con 0x55577db6ed40 2024-09-19T09:59:12.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.872+0000 7fa96ac16640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db6ed40 0x55577db71130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:12.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.874+0000 7fa969c14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.875+0000 7fa969c14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59394/0 (socket says 172.21.15.18:59394) 2024-09-19T09:59:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.875+0000 7fa969c14640 1 -- 172.21.15.18:0/1252727357 learned_addr learned my addr 172.21.15.18:0/1252727357 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.875+0000 7fa96a415640 1 --2- 172.21.15.18:0/1252727357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 0x55577db63f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.876+0000 7fa96a415640 1 -- 172.21.15.18:0/1252727357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db6ed40 msgr2=0x55577db71130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.876+0000 7fa96a415640 1 --2- 172.21.15.18:0/1252727357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db6ed40 0x55577db71130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.876+0000 7fa96a415640 1 -- 172.21.15.18:0/1252727357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 msgr2=0x55577db6e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.876+0000 7fa96a415640 1 --2- 172.21.15.18:0/1252727357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.876+0000 7fa96a415640 1 -- 172.21.15.18:0/1252727357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577da7d1f0 con 0x55577db63b60 2024-09-19T09:59:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.878+0000 7fa96a415640 1 --2- 172.21.15.18:0/1252727357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 0x55577db63f40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa960009850 tx=0x7fa960042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1933b75ac18fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.881+0000 7fa958ff9640 1 -- 172.21.15.18:0/1252727357 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960053070 con 0x55577db63b60 2024-09-19T09:59:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.881+0000 7fa958ff9640 1 -- 172.21.15.18:0/1252727357 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa960049070 con 0x55577db63b60 2024-09-19T09:59:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.881+0000 7fa958ff9640 1 -- 172.21.15.18:0/1252727357 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9600426b0 con 0x55577db63b60 2024-09-19T09:59:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.882+0000 7fa96ea52740 1 -- 172.21.15.18:0/1252727357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 msgr2=0x55577db63f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.882+0000 7fa96ea52740 1 --2- 172.21.15.18:0/1252727357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 0x55577db63f40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa960009850 tx=0x7fa960042000 comp rx=0 tx=0).stop 2024-09-19T09:59:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.883+0000 7fa96ea52740 1 -- 172.21.15.18:0/1252727357 shutdown_connections 2024-09-19T09:59:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.883+0000 7fa96ea52740 1 --2- 172.21.15.18:0/1252727357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db6ed40 0x55577db71130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.883+0000 7fa96ea52740 1 --2- 172.21.15.18:0/1252727357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.883+0000 7fa96ea52740 1 --2- 172.21.15.18:0/1252727357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 0x55577db63f40 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.883+0000 7fa96ea52740 1 -- 172.21.15.18:0/1252727357 >> 172.21.15.18:0/1252727357 conn(0x55577db600f0 msgr2=0x55577db604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.883+0000 7fa96ea52740 1 -- 172.21.15.18:0/1252727357 shutdown_connections 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.883+0000 7fa96ea52740 1 -- 172.21.15.18:0/1252727357 wait complete. 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.884+0000 7fa96ea52740 1 -- start start 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.889+0000 7fa96ea52740 1 Processor -- start 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.890+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 0x55577db6bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.890+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.890+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db6ed40 0x55577db6c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.891+0000 7fa96ea52740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55577db71910 con 0x55577db6ed40 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.891+0000 7fa96ea52740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55577da83f10 con 0x55577db64480 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.891+0000 7fa96ea52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55577db71a90 con 0x55577db63b60 2024-09-19T09:59:12.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.891+0000 7fa96ea52740 10 client.0 _ll_register_callbacks cb 0x55577da4ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.892+0000 7fa969c14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.892+0000 7fa969c14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59396/0 (socket says 172.21.15.18:59396) 2024-09-19T09:59:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.892+0000 7fa969c14640 1 -- 172.21.15.18:0/3644938537 learned_addr learned my addr 172.21.15.18:0/3644938537 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:12.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.894+0000 7fa96ac16640 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db6ed40 0x55577db6c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:12.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.895+0000 7fa96a415640 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 0x55577db6bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.895+0000 7fa969c14640 1 -- 172.21.15.18:0/3644938537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 msgr2=0x55577db6bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:12.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.895+0000 7fa969c14640 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 0x55577db6bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.898+0000 7fa969c14640 1 -- 172.21.15.18:0/3644938537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db6ed40 msgr2=0x55577db6c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:12.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.898+0000 7fa969c14640 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db6ed40 0x55577db6c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.898+0000 7fa969c14640 1 -- 172.21.15.18:0/3644938537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577d83a6a0 con 0x55577db64480 2024-09-19T09:59:12.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.905+0000 7fa969c14640 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6c110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa95400be20 tx=0x7fa95400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e00c549892de3589 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:12.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.905+0000 7fa94dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:12.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.908+0000 7fa94dffb640 1 -- 172.21.15.18:0/3644938537 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa954015070 con 0x55577db64480 2024-09-19T09:59:12.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.908+0000 7fa94dffb640 1 -- 172.21.15.18:0/3644938537 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa954004230 con 0x55577db64480 2024-09-19T09:59:12.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.908+0000 7fa96ea52740 1 -- 172.21.15.18:0/3644938537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa960049070 con 0x55577db64480 2024-09-19T09:59:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.910+0000 7fa94dffb640 1 -- 172.21.15.18:0/3644938537 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa954020070 con 0x55577db64480 2024-09-19T09:59:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.911+0000 7fa96ea52740 10 client.26630 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.911+0000 7fa96ea52740 1 -- 172.21.15.18:0/3644938537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55577db7d5b0 con 0x55577db64480 2024-09-19T09:59:12.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.914+0000 7fa94dffb640 1 -- 172.21.15.18:0/3644938537 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa954004430 con 0x55577db64480 2024-09-19T09:59:12.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.915+0000 7fa94dffb640 1 -- 172.21.15.18:0/3644938537 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa9540039a0 con 0x55577db64480 2024-09-19T09:59:12.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.915+0000 7fa96ea52740 10 client.26630 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:12.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.915+0000 7fa96ea52740 10 client.26630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:12.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.915+0000 7fa96ea52740 20 client.26630 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:12.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.915+0000 7fa96ea52740 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55577db7eac0 0x55577db80ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:12.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.915+0000 7fa96ea52740 4 client.26630 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:12.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.916+0000 7fa96ea52740 1 -- 172.21.15.18:0/3644938537 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa960049070 con 0x55577db7eac0 2024-09-19T09:59:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.920+0000 7fa96a415640 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55577db7eac0 0x55577db80ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:12.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.943+0000 7fa94dffb640 10 client.26630 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:12.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.943+0000 7fa96a415640 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55577db7eac0 0x55577db80ee0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee6f3718555b3d4b server_cookie=d81c388ee91cf480 in_seq=0 out_seq=0 2024-09-19T09:59:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.948+0000 7fa94dffb640 1 -- 172.21.15.18:0/3644938537 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa960049070 con 0x55577db7eac0 2024-09-19T09:59:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.948+0000 7fa94dffb640 10 client.26630 handle_command_reply: tid=0 2024-09-19T09:59:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.948+0000 7fa96ea52740 1 client.26630 shutdown 2024-09-19T09:59:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.949+0000 7fa96ea52740 1 -- 172.21.15.18:0/3644938537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 msgr2=0x55577db6c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.949+0000 7fa96ea52740 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6c110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa95400be20 tx=0x7fa95400f730 comp rx=0 tx=0).stop 2024-09-19T09:59:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.949+0000 7fa96ea52740 1 -- 172.21.15.18:0/3644938537 shutdown_connections 2024-09-19T09:59:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.949+0000 7fa96ea52740 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55577db7eac0 0x55577db80ee0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.950+0000 7fa96ea52740 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db6ed40 0x55577db6c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.950+0000 7fa96ea52740 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db6c110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.950+0000 7fa96ea52740 1 --2- 172.21.15.18:0/3644938537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 0x55577db6bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.950+0000 7fa96ea52740 1 -- 172.21.15.18:0/3644938537 >> 172.21.15.18:0/3644938537 conn(0x55577db600f0 msgr2=0x55577db65e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.950+0000 7fa94dffb640 0 client.26630 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.950+0000 7fa96ea52740 1 -- 172.21.15.18:0/3644938537 shutdown_connections 2024-09-19T09:59:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.950+0000 7fa96ea52740 1 -- 172.21.15.18:0/3644938537 wait complete. 2024-09-19T09:59:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.950+0000 7fa96ea52740 20 client.26630 trim_cache size 0 max 16384 2024-09-19T09:59:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.996+0000 7fa96ea52740 1 Processor -- start 2024-09-19T09:59:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.997+0000 7fa96ea52740 1 -- start start 2024-09-19T09:59:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.997+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 0x55577db6ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.997+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db665c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.997+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db6ed40 0x55577db6c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.997+0000 7fa96ea52740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa94800e490 con 0x55577db6ed40 2024-09-19T09:59:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.997+0000 7fa96ea52740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa94800ffd0 con 0x55577db64480 2024-09-19T09:59:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.997+0000 7fa96ea52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa94800eb60 con 0x55577db63b60 2024-09-19T09:59:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.998+0000 7fa96a415640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 0x55577db6ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.998+0000 7fa96a415640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 0x55577db6ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33496/0 (socket says 172.21.15.18:33496) 2024-09-19T09:59:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.998+0000 7fa96a415640 1 -- 172.21.15.18:0/2502404893 learned_addr learned my addr 172.21.15.18:0/2502404893 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.998+0000 7fa969c14640 1 --2- 172.21.15.18:0/2502404893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:13.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.999+0000 7fa96a415640 1 -- 172.21.15.18:0/2502404893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 msgr2=0x55577db665c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:13.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.999+0000 7fa96a415640 1 --2- 172.21.15.18:0/2502404893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db665c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:13.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.999+0000 7fa96a415640 1 -- 172.21.15.18:0/2502404893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db6ed40 msgr2=0x55577db6c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:13.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.999+0000 7fa96a415640 1 --2- 172.21.15.18:0/2502404893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db6ed40 0x55577db6c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:13.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:12.999+0000 7fa96a415640 1 -- 172.21.15.18:0/2502404893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577db6e4a0 con 0x55577db63b60 2024-09-19T09:59:13.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.000+0000 7fa96a415640 1 --2- 172.21.15.18:0/2502404893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 0x55577db6ab30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa96002ee40 tx=0x7fa960005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fefc1c5b3766dca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.001+0000 7fa94ffff640 1 -- 172.21.15.18:0/2502404893 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960053040 con 0x55577db63b60 2024-09-19T09:59:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.001+0000 7fa94ffff640 1 -- 172.21.15.18:0/2502404893 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa960049070 con 0x55577db63b60 2024-09-19T09:59:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.001+0000 7fa94ffff640 1 -- 172.21.15.18:0/2502404893 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9600589b0 con 0x55577db63b60 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.002+0000 7fa96ea52740 1 -- 172.21.15.18:0/2502404893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 msgr2=0x55577db6ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.002+0000 7fa96ea52740 1 --2- 172.21.15.18:0/2502404893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 0x55577db6ab30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa96002ee40 tx=0x7fa960005850 comp rx=0 tx=0).stop 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.003+0000 7fa96ea52740 1 -- 172.21.15.18:0/2502404893 shutdown_connections 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.003+0000 7fa96ea52740 1 --2- 172.21.15.18:0/2502404893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db6ed40 0x55577db6c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.003+0000 7fa96ea52740 1 --2- 172.21.15.18:0/2502404893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db64480 0x55577db665c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.003+0000 7fa96ea52740 1 --2- 172.21.15.18:0/2502404893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db63b60 0x55577db6ab30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.003+0000 7fa96ea52740 1 -- 172.21.15.18:0/2502404893 >> 172.21.15.18:0/2502404893 conn(0x55577db600f0 msgr2=0x55577db6db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.003+0000 7fa96ea52740 1 -- 172.21.15.18:0/2502404893 shutdown_connections 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.003+0000 7fa96ea52740 1 -- 172.21.15.18:0/2502404893 wait complete. 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.004+0000 7fa96ea52740 1 -- start start 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.004+0000 7fa96ea52740 1 Processor -- start 2024-09-19T09:59:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.005+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 0x55577db76f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.006+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db64480 0x55577db77460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.006+0000 7fa96ea52740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db6ed40 0x55577db73d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.006+0000 7fa96ea52740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa94800f900 con 0x55577db63b60 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.006+0000 7fa96ea52740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa94800f230 con 0x55577db6ed40 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.006+0000 7fa96ea52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa94800c470 con 0x55577db64480 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.006+0000 7fa96ea52740 10 client.0 _ll_register_callbacks cb 0x7fa95400b3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.006+0000 7fa96ac16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db6ed40 0x55577db73d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.006+0000 7fa96ac16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db6ed40 0x55577db73d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59416/0 (socket says 172.21.15.18:59416) 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.006+0000 7fa96ac16640 1 -- 172.21.15.18:0/2514438528 learned_addr learned my addr 172.21.15.18:0/2514438528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.007+0000 7fa969c14640 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db64480 0x55577db77460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.007+0000 7fa96a415640 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 0x55577db76f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.008+0000 7fa96ac16640 1 -- 172.21.15.18:0/2514438528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db64480 msgr2=0x55577db77460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.008+0000 7fa96ac16640 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db64480 0x55577db77460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:13.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.008+0000 7fa96ac16640 1 -- 172.21.15.18:0/2514438528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 msgr2=0x55577db76f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:13.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.008+0000 7fa96ac16640 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 0x55577db76f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:13.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.008+0000 7fa96ac16640 1 -- 172.21.15.18:0/2514438528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577db74400 con 0x55577db6ed40 2024-09-19T09:59:13.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.015+0000 7fa96ac16640 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db6ed40 0x55577db73d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0049d0 tx=0x7fa95c09bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdca7b9899ca2729 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:13.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.015+0000 7fa94dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:13.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.016+0000 7fa94dffb640 1 -- 172.21.15.18:0/2514438528 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0ba060 con 0x55577db6ed40 2024-09-19T09:59:13.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.016+0000 7fa94dffb640 1 -- 172.21.15.18:0/2514438528 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa95c0a4b00 con 0x55577db6ed40 2024-09-19T09:59:13.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.016+0000 7fa96ea52740 1 -- 172.21.15.18:0/2514438528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa960049070 con 0x55577db6ed40 2024-09-19T09:59:13.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.018+0000 7fa94dffb640 1 -- 172.21.15.18:0/2514438528 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa95c0a06d0 con 0x55577db6ed40 2024-09-19T09:59:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.019+0000 7fa96ea52740 10 client.26636 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.019+0000 7fa96ea52740 1 -- 172.21.15.18:0/2514438528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55577dbea1f0 con 0x55577db6ed40 2024-09-19T09:59:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.022+0000 7fa94dffb640 1 -- 172.21.15.18:0/2514438528 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95c0a4f90 con 0x55577db6ed40 2024-09-19T09:59:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.022+0000 7fa94dffb640 1 -- 172.21.15.18:0/2514438528 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa95c098140 con 0x55577db6ed40 2024-09-19T09:59:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.022+0000 7fa96ea52740 10 client.26636 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.022+0000 7fa96ea52740 10 client.26636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.022+0000 7fa96ea52740 20 client.26636 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.022+0000 7fa96ea52740 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55577dbea940 0x55577dbecd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.023+0000 7fa96ea52740 4 client.26636 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:59:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.023+0000 7fa96ea52740 1 -- 172.21.15.18:0/2514438528 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fa960049070 con 0x55577dbea940 2024-09-19T09:59:13.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.026+0000 7fa96a415640 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55577dbea940 0x55577dbecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.027+0000 7fa96a415640 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55577dbea940 0x55577dbecd60 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70c73443895561f0 server_cookie=c23d75d299121e14 in_seq=0 out_seq=0 2024-09-19T09:59:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:13.028+0000 7fa94dffb640 10 client.26636 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:14.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.067+0000 7fa94dffb640 1 -- 172.21.15.18:0/2514438528 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fa960049070 con 0x55577dbea940 2024-09-19T09:59:14.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.067+0000 7fa94dffb640 10 client.26636 handle_command_reply: tid=0 2024-09-19T09:59:14.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.067+0000 7fa96ea52740 1 client.26636 shutdown 2024-09-19T09:59:14.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.068+0000 7fa96ea52740 1 -- 172.21.15.18:0/2514438528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db6ed40 msgr2=0x55577db73d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:14.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.068+0000 7fa96ea52740 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db6ed40 0x55577db73d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0049d0 tx=0x7fa95c09bd00 comp rx=0 tx=0).stop 2024-09-19T09:59:14.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.068+0000 7fa96ea52740 1 -- 172.21.15.18:0/2514438528 shutdown_connections 2024-09-19T09:59:14.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.068+0000 7fa96ea52740 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55577dbea940 0x55577dbecd60 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:14.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.068+0000 7fa96ea52740 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55577db6ed40 0x55577db73d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:14.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.068+0000 7fa96ea52740 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55577db64480 0x55577db77460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:14.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.068+0000 7fa96ea52740 1 --2- 172.21.15.18:0/2514438528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55577db63b60 0x55577db76f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:14.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.068+0000 7fa94dffb640 0 client.26636 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:14.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.068+0000 7fa96ea52740 1 -- 172.21.15.18:0/2514438528 >> 172.21.15.18:0/2514438528 conn(0x55577db600f0 msgr2=0x55577db6d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:14.072 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:59:14.073 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T09:59:14.073 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "4e498b39-a7da-480a-bf26-542991128973", 2024-09-19T09:59:14.073 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T09:59:14.073 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:59:14.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.069+0000 7fa96ea52740 1 -- 172.21.15.18:0/2514438528 shutdown_connections 2024-09-19T09:59:14.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.069+0000 7fa96ea52740 1 -- 172.21.15.18:0/2514438528 wait complete. 2024-09-19T09:59:14.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.069+0000 7fa96ea52740 20 client.26636 trim_cache size 0 max 16384 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.070+0000 7fa96c679640 1 -- 172.21.15.18:0/3563865610 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa9500a3450 msgr2=0x7fa9500a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.070+0000 7fa96c679640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa9500a3450 0x7fa9500a5910 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa960000c00 tx=0x7fa960005fd0 comp rx=0 tx=0).stop 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.070+0000 7fa96c679640 1 -- 172.21.15.18:0/3563865610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa964106f00 msgr2=0x7fa96406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.070+0000 7fa96c679640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa964106f00 0x7fa96406da60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00eb10 tx=0x7fa95c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.071+0000 7fa96c679640 1 -- 172.21.15.18:0/3563865610 shutdown_connections 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.071+0000 7fa96c679640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa9500a3450 0x7fa9500a5910 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.071+0000 7fa96c679640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa964106f00 0x7fa96406da60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.071+0000 7fa96c679640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa964102780 0x7fa964073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.071+0000 7fa96c679640 1 --2- 172.21.15.18:0/3563865610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa964101dd0 0x7fa9640738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.071+0000 7fa96c679640 1 -- 172.21.15.18:0/3563865610 >> 172.21.15.18:0/3563865610 conn(0x7fa9640fd8b0 msgr2=0x7fa9640fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.071+0000 7fa96c679640 1 -- 172.21.15.18:0/3563865610 shutdown_connections 2024-09-19T09:59:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:14.071+0000 7fa96c679640 1 -- 172.21.15.18:0/3563865610 wait complete. 2024-09-19T09:59:14.764 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:14 smithi018 ceph-mon[30956]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 850 MiB/s wr, 1.49k op/s 2024-09-19T09:59:14.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:14 smithi049 ceph-mon[34858]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 850 MiB/s wr, 1.49k op/s 2024-09-19T09:59:14.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:14 smithi162 ceph-mon[35174]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 850 MiB/s wr, 1.49k op/s 2024-09-19T09:59:15.434 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:59:15.605 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:15 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T09:59:15.605 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:15 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:59:15.605 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:15 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T09:59:15.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:15 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T09:59:15.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:15 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:59:15.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:15 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T09:59:15.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:15 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T09:59:15.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:15 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:59:15.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:15 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T09:59:16.509 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:59:16.740 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:16 smithi018 ceph-mon[30956]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 902 MiB/s wr, 1.59k op/s 2024-09-19T09:59:16.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:16 smithi049 ceph-mon[34858]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 902 MiB/s wr, 1.59k op/s 2024-09-19T09:59:16.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:16 smithi162 ceph-mon[35174]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 902 MiB/s wr, 1.59k op/s 2024-09-19T09:59:17.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.373+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/3630227594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd411b140 msgr2=0x7f0bd411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:17.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.374+0000 7f0bcbfff640 1 -- 172.21.15.18:0/3630227594 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0307f0 con 0x7f0bd411b140 2024-09-19T09:59:17.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.374+0000 7f0bdb3ce640 1 --2- 172.21.15.18:0/3630227594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd411b140 0x7f0bd411d530 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009ca0 tx=0x7f0bcc02a8f0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.375+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/3630227594 shutdown_connections 2024-09-19T09:59:17.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.375+0000 7f0bdb3ce640 1 --2- 172.21.15.18:0/3630227594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd411b140 0x7f0bd411d530 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.375+0000 7f0bdb3ce640 1 --2- 172.21.15.18:0/3630227594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4109830 0x7f0bd4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.375+0000 7f0bdb3ce640 1 --2- 172.21.15.18:0/3630227594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bd4109450 0x7f0bd4110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.375+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/3630227594 >> 172.21.15.18:0/3630227594 conn(0x7f0bd406e140 msgr2=0x7f0bd406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:17.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.376+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/3630227594 shutdown_connections 2024-09-19T09:59:17.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.376+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/3630227594 wait complete. 2024-09-19T09:59:17.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.377+0000 7f0bdb3ce640 1 Processor -- start 2024-09-19T09:59:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.377+0000 7f0bdb3ce640 1 -- start start 2024-09-19T09:59:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.378+0000 7f0bdb3ce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4109450 0x7f0bd4118640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.378+0000 7f0bdb3ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd4109830 0x7f0bd4118b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.378+0000 7f0bdb3ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bd411b140 0x7f0bd41118b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.378+0000 7f0bdb3ce640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd4120df0 con 0x7f0bd4109830 2024-09-19T09:59:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.378+0000 7f0bdb3ce640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd4120c70 con 0x7f0bd4109450 2024-09-19T09:59:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.378+0000 7f0bdb3ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd4120f70 con 0x7f0bd411b140 2024-09-19T09:59:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.379+0000 7f0bd916a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4109450 0x7f0bd4118640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.379+0000 7f0bd916a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4109450 0x7f0bd4118640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:38280/0 (socket says 172.21.15.18:38280) 2024-09-19T09:59:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.379+0000 7f0bd916a640 1 -- 172.21.15.18:0/1060882108 learned_addr learned my addr 172.21.15.18:0/1060882108 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:17.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.380+0000 7f0bd8969640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd4109830 0x7f0bd4118b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.380+0000 7f0bd8969640 1 -- 172.21.15.18:0/1060882108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bd411b140 msgr2=0x7f0bd41118b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:59:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.380+0000 7f0bd8969640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bd411b140 0x7f0bd41118b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.380+0000 7f0bd8969640 1 -- 172.21.15.18:0/1060882108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4109450 msgr2=0x7f0bd4118640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.380+0000 7f0bd8969640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4109450 0x7f0bd4118640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.380+0000 7f0bd8969640 1 -- 172.21.15.18:0/1060882108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd4112170 con 0x7f0bd4109830 2024-09-19T09:59:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.381+0000 7f0bd8969640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd4109830 0x7f0bd4118b80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400e9f0 tx=0x7f0bc400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:17.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.386+0000 7f0bca7fc640 1 -- 172.21.15.18:0/1060882108 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400ccc0 con 0x7f0bd4109830 2024-09-19T09:59:17.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.386+0000 7f0bca7fc640 1 -- 172.21.15.18:0/1060882108 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc4010910 con 0x7f0bd4109830 2024-09-19T09:59:17.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.386+0000 7f0bca7fc640 1 -- 172.21.15.18:0/1060882108 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4018980 con 0x7f0bd4109830 2024-09-19T09:59:17.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.386+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/1060882108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd4112460 con 0x7f0bd4109830 2024-09-19T09:59:17.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.386+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/1060882108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd41163a0 con 0x7f0bd4109830 2024-09-19T09:59:17.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.393+0000 7f0bdd7a7740 1 Processor -- start 2024-09-19T09:59:17.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.393+0000 7f0bdd7a7740 1 -- start start 2024-09-19T09:59:17.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.398+0000 7f0bca7fc640 1 -- 172.21.15.18:0/1060882108 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0bc4010ac0 con 0x7f0bd4109830 2024-09-19T09:59:17.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.398+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b331880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.398+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b331dc0 0x564d0b33c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.398+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b33ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.399+0000 7f0bca7fc640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0bc00a3300 0x7f0bc00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.400+0000 7f0bd996b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b331880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.400+0000 7f0bd996b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b331880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56016/0 (socket says 172.21.15.18:56016) 2024-09-19T09:59:17.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.400+0000 7f0bdd7a7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564d0b2972e0 con 0x564d0b3314a0 2024-09-19T09:59:17.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.400+0000 7f0bdd7a7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564d0b23ece0 con 0x564d0b331dc0 2024-09-19T09:59:17.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.400+0000 7f0bdd7a7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564d0b2932a0 con 0x564d0b33c680 2024-09-19T09:59:17.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.400+0000 7f0bd996b640 1 -- 172.21.15.18:0/2863196513 learned_addr learned my addr 172.21.15.18:0/2863196513 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:17.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.401+0000 7f0bd8969640 1 --2- 172.21.15.18:0/2863196513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b33ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.401+0000 7f0bd996b640 1 -- 172.21.15.18:0/2863196513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 msgr2=0x564d0b33ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:17.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.401+0000 7f0bd996b640 1 --2- 172.21.15.18:0/2863196513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b33ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.401+0000 7f0bd996b640 1 -- 172.21.15.18:0/2863196513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b331dc0 msgr2=0x564d0b33c140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:59:17.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.401+0000 7f0bd996b640 1 --2- 172.21.15.18:0/2863196513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b331dc0 0x564d0b33c140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.401+0000 7f0bd996b640 1 -- 172.21.15.18:0/2863196513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d0b223440 con 0x564d0b3314a0 2024-09-19T09:59:17.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.402+0000 7f0bd996b640 1 --2- 172.21.15.18:0/2863196513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b331880 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc031b50 tx=0x7f0bcc031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53643baee58529b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:17.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.402+0000 7f0bd996b640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0bc00a3300 0x7f0bc00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.403+0000 7f0bca7fc640 1 -- 172.21.15.18:0/1060882108 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0bc40cfc20 con 0x7f0bd4109830 2024-09-19T09:59:17.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.403+0000 7f0bbf7fe640 1 -- 172.21.15.18:0/2863196513 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc04c070 con 0x564d0b3314a0 2024-09-19T09:59:17.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.403+0000 7f0bbf7fe640 1 -- 172.21.15.18:0/2863196513 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bcc041070 con 0x564d0b3314a0 2024-09-19T09:59:17.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.403+0000 7f0bbf7fe640 1 -- 172.21.15.18:0/2863196513 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0046f0 con 0x564d0b3314a0 2024-09-19T09:59:17.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.405+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/2863196513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 msgr2=0x564d0b331880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:17.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.405+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/2863196513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b331880 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc031b50 tx=0x7f0bcc031b80 comp rx=0 tx=0).stop 2024-09-19T09:59:17.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.405+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/2863196513 shutdown_connections 2024-09-19T09:59:17.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.405+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/2863196513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b33ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.405+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/2863196513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b331dc0 0x564d0b33c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.405+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/2863196513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b331880 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.405+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/2863196513 >> 172.21.15.18:0/2863196513 conn(0x564d0b32da30 msgr2=0x564d0b32de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:17.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.406+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/2863196513 shutdown_connections 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.407+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/2863196513 wait complete. 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.408+0000 7f0bdd7a7740 1 -- start start 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.408+0000 7f0bdd7a7740 1 Processor -- start 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.409+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b33bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.410+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b331dc0 0x564d0b339240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.410+0000 7f0bd916a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b33bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.410+0000 7f0bd916a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b33bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56020/0 (socket says 172.21.15.18:56020) 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.410+0000 7f0bd916a640 1 -- 172.21.15.18:0/716468378 learned_addr learned my addr 172.21.15.18:0/716468378 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.410+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b339780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.410+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564d0b33f2a0 con 0x564d0b3314a0 2024-09-19T09:59:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.410+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564d0b252050 con 0x564d0b331dc0 2024-09-19T09:59:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.410+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564d0b33f420 con 0x564d0b33c680 2024-09-19T09:59:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.411+0000 7f0bd8969640 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b331dc0 0x564d0b339240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.411+0000 7f0bd996b640 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b339780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.411+0000 7f0bdd7a7740 10 client.0 _ll_register_callbacks cb 0x564d0b292160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.412+0000 7f0bd8969640 1 -- 172.21.15.18:0/716468378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 msgr2=0x564d0b339780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.412+0000 7f0bd8969640 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b339780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.412+0000 7f0bd8969640 1 -- 172.21.15.18:0/716468378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 msgr2=0x564d0b33bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.412+0000 7f0bd8969640 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b33bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.412+0000 7f0bd8969640 1 -- 172.21.15.18:0/716468378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d0b0083c0 con 0x564d0b331dc0 2024-09-19T09:59:17.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.414+0000 7f0bd8969640 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b331dc0 0x564d0b339240 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40cd7a0 tx=0x7f0bc40980c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b47832662c8b89ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.414+0000 7f0bbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.414+0000 7f0bd916a640 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b33bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:59:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.414+0000 7f0bbcff9640 1 -- 172.21.15.18:0/716468378 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40bc2c0 con 0x564d0b331dc0 2024-09-19T09:59:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.415+0000 7f0bbcff9640 1 -- 172.21.15.18:0/716468378 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0bc40a0130 con 0x564d0b331dc0 2024-09-19T09:59:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.415+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bcc041070 con 0x564d0b331dc0 2024-09-19T09:59:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.415+0000 7f0bd996b640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0bc00a3300 0x7f0bc00a57c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc031b50 tx=0x7f0bcc031b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.417+0000 7f0bbcff9640 1 -- 172.21.15.18:0/716468378 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0bc409c970 con 0x564d0b331dc0 2024-09-19T09:59:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.417+0000 7f0bdd7a7740 10 client.26645 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.417+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564d0b34aca0 con 0x564d0b331dc0 2024-09-19T09:59:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.418+0000 7f0bbcff9640 1 -- 172.21.15.18:0/716468378 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc409c270 con 0x564d0b331dc0 2024-09-19T09:59:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.419+0000 7f0bbcff9640 1 -- 172.21.15.18:0/716468378 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0bc409b730 con 0x564d0b331dc0 2024-09-19T09:59:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.419+0000 7f0bdd7a7740 10 client.26645 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.419+0000 7f0bdd7a7740 10 client.26645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.420+0000 7f0bdd7a7740 20 client.26645 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.420+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564d0b34c100 0x564d0b34e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.420+0000 7f0bdd7a7740 4 client.26645 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.421+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0bcc041070 con 0x564d0b34c100 2024-09-19T09:59:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.422+0000 7f0bd916a640 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564d0b34c100 0x564d0b34e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.423+0000 7f0bd916a640 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564d0b34c100 0x564d0b34e530 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e997c0912d6b9ea8 server_cookie=9117003435c30b66 in_seq=0 out_seq=0 2024-09-19T09:59:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.423+0000 7f0bbcff9640 10 client.26645 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.428+0000 7f0bbcff9640 1 -- 172.21.15.18:0/716468378 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0bcc041070 con 0x564d0b34c100 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.428+0000 7f0bbcff9640 10 client.26645 handle_command_reply: tid=0 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.429+0000 7f0bdd7a7740 1 client.26645 shutdown 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.429+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b331dc0 msgr2=0x564d0b339240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.429+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b331dc0 0x564d0b339240 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40cd7a0 tx=0x7f0bc40980c0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.429+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 shutdown_connections 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.430+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564d0b34c100 0x564d0b34e530 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.430+0000 7f0bbcff9640 0 client.26645 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.430+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b339780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.430+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b331dc0 0x564d0b339240 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.430+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/716468378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b3314a0 0x564d0b33bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.430+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 >> 172.21.15.18:0/716468378 conn(0x564d0b32da30 msgr2=0x564d0b333760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.430+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 shutdown_connections 2024-09-19T09:59:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.430+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/716468378 wait complete. 2024-09-19T09:59:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.431+0000 7f0bdd7a7740 20 client.26645 trim_cache size 0 max 16384 2024-09-19T09:59:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.487+0000 7f0bdd7a7740 1 Processor -- start 2024-09-19T09:59:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.488+0000 7f0bdd7a7740 1 -- start start 2024-09-19T09:59:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.488+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b3314a0 0x564d0b348580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.488+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b331dc0 0x564d0b33b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.488+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b353e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.488+0000 7f0bdd7a7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41c4b30 con 0x564d0b331dc0 2024-09-19T09:59:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.488+0000 7f0bdd7a7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41c6670 con 0x564d0b3314a0 2024-09-19T09:59:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.488+0000 7f0bdd7a7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41c5200 con 0x564d0b33c680 2024-09-19T09:59:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.488+0000 7f0bd996b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b353e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.489+0000 7f0bd996b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b353e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:59608/0 (socket says 172.21.15.18:59608) 2024-09-19T09:59:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.489+0000 7f0bd996b640 1 -- 172.21.15.18:0/3819028376 learned_addr learned my addr 172.21.15.18:0/3819028376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.489+0000 7f0bd916a640 1 --2- 172.21.15.18:0/3819028376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b3314a0 0x564d0b348580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.489+0000 7f0bd996b640 1 -- 172.21.15.18:0/3819028376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b3314a0 msgr2=0x564d0b348580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:17.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.489+0000 7f0bd996b640 1 --2- 172.21.15.18:0/3819028376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b3314a0 0x564d0b348580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.489+0000 7f0bd996b640 1 -- 172.21.15.18:0/3819028376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b331dc0 msgr2=0x564d0b33b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:17.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.489+0000 7f0bd996b640 1 --2- 172.21.15.18:0/3819028376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b331dc0 0x564d0b33b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.489+0000 7f0bd996b640 1 -- 172.21.15.18:0/3819028376 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d0b331bf0 con 0x564d0b33c680 2024-09-19T09:59:17.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.490+0000 7f0bd996b640 1 --2- 172.21.15.18:0/3819028376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b353e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc04a040 tx=0x7f0bcc041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=177e028dc5bbc0cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.493+0000 7f0bbeffd640 1 -- 172.21.15.18:0/3819028376 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc04c070 con 0x564d0b33c680 2024-09-19T09:59:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.494+0000 7f0bbeffd640 1 -- 172.21.15.18:0/3819028376 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bcc036030 con 0x564d0b33c680 2024-09-19T09:59:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.494+0000 7f0bbeffd640 1 -- 172.21.15.18:0/3819028376 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc005090 con 0x564d0b33c680 2024-09-19T09:59:17.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.495+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/3819028376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 msgr2=0x564d0b353e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:17.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.495+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/3819028376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b353e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc04a040 tx=0x7f0bcc041000 comp rx=0 tx=0).stop 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.498+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/3819028376 shutdown_connections 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.498+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/3819028376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b33c680 0x564d0b353e00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.498+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/3819028376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b331dc0 0x564d0b33b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.498+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/3819028376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b3314a0 0x564d0b348580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.498+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/3819028376 >> 172.21.15.18:0/3819028376 conn(0x564d0b32da30 msgr2=0x564d0b333760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.498+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/3819028376 shutdown_connections 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.498+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/3819028376 wait complete. 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.499+0000 7f0bdd7a7740 1 -- start start 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.499+0000 7f0bdd7a7740 1 Processor -- start 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.500+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b3314a0 0x564d0b345010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.500+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b331dc0 0x564d0b340340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.501+0000 7f0bdd7a7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b33c680 0x564d0b340ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.501+0000 7f0bdd7a7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41c5fa0 con 0x564d0b331dc0 2024-09-19T09:59:17.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.501+0000 7f0bdd7a7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41c58d0 con 0x564d0b33c680 2024-09-19T09:59:17.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.501+0000 7f0bd916a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b3314a0 0x564d0b345010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.501+0000 7f0bd916a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b3314a0 0x564d0b345010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:59616/0 (socket says 172.21.15.18:59616) 2024-09-19T09:59:17.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.501+0000 7f0bd916a640 1 -- 172.21.15.18:0/494387780 learned_addr learned my addr 172.21.15.18:0/494387780 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:17.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.501+0000 7f0bdd7a7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41c2b10 con 0x564d0b3314a0 2024-09-19T09:59:17.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.501+0000 7f0bdd7a7740 10 client.0 _ll_register_callbacks cb 0x7f0bc400cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:17.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.501+0000 7f0bd996b640 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b33c680 0x564d0b340ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.502+0000 7f0bd916a640 1 -- 172.21.15.18:0/494387780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b33c680 msgr2=0x564d0b340ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:17.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.502+0000 7f0bd916a640 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b33c680 0x564d0b340ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.502+0000 7f0bd916a640 1 -- 172.21.15.18:0/494387780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b331dc0 msgr2=0x564d0b340340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:17.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.502+0000 7f0bd916a640 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b331dc0 0x564d0b340340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.502+0000 7f0bd916a640 1 -- 172.21.15.18:0/494387780 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d0b3b5dd0 con 0x564d0b3314a0 2024-09-19T09:59:17.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.503+0000 7f0bd916a640 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b3314a0 0x564d0b345010 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009620 tx=0x7f0bd0012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e53b530e9eaa2af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:17.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.503+0000 7f0bbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:59:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.513+0000 7f0bbcff9640 1 -- 172.21.15.18:0/494387780 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd001b6a0 con 0x564d0b3314a0 2024-09-19T09:59:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.513+0000 7f0bbcff9640 1 -- 172.21.15.18:0/494387780 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0bd001b840 con 0x564d0b3314a0 2024-09-19T09:59:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.513+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/494387780 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bcc036030 con 0x564d0b3314a0 2024-09-19T09:59:17.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.516+0000 7f0bbcff9640 1 -- 172.21.15.18:0/494387780 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0bd002b070 con 0x564d0b3314a0 2024-09-19T09:59:17.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.516+0000 7f0bdd7a7740 10 client.26626 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:17.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.516+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/494387780 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564d0b3b7000 con 0x564d0b3314a0 2024-09-19T09:59:17.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.520+0000 7f0bbcff9640 1 -- 172.21.15.18:0/494387780 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bd001f070 con 0x564d0b3314a0 2024-09-19T09:59:17.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.520+0000 7f0bbcff9640 1 -- 172.21.15.18:0/494387780 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0bd0011440 con 0x564d0b3314a0 2024-09-19T09:59:17.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.520+0000 7f0bdd7a7740 10 client.26626 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:17.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.520+0000 7f0bdd7a7740 10 client.26626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:17.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.520+0000 7f0bdd7a7740 20 client.26626 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:17.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.520+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564d0b34c100 0x564d0b3b9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:17.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.520+0000 7f0bdd7a7740 4 client.26626 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:59:17.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.520+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/494387780 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f0bcc036030 con 0x564d0b34c100 2024-09-19T09:59:17.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.521+0000 7f0bd8969640 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564d0b34c100 0x564d0b3b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:17.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.529+0000 7f0bd8969640 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564d0b34c100 0x564d0b3b9770 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31f0cde3a8f7a4c9 server_cookie=15f26c046559def7 in_seq=0 out_seq=0 2024-09-19T09:59:17.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.529+0000 7f0bbcff9640 10 client.26626 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:17.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.535+0000 7f0bbcff9640 1 -- 172.21.15.18:0/494387780 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x7f0bcc036030 con 0x564d0b34c100 2024-09-19T09:59:17.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.535+0000 7f0bbcff9640 10 client.26626 handle_command_reply: tid=0 2024-09-19T09:59:17.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.535+0000 7f0bdd7a7740 1 client.26626 shutdown 2024-09-19T09:59:17.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.536+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/494387780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b3314a0 msgr2=0x564d0b345010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:17.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.536+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b3314a0 0x564d0b345010 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009620 tx=0x7f0bd0012820 comp rx=0 tx=0).stop 2024-09-19T09:59:17.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.536+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/494387780 shutdown_connections 2024-09-19T09:59:17.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.536+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564d0b34c100 0x564d0b3b9770 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.536+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d0b33c680 0x564d0b340ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.536+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d0b331dc0 0x564d0b340340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.537+0000 7f0bdd7a7740 1 --2- 172.21.15.18:0/494387780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d0b3314a0 0x564d0b345010 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.537+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/494387780 >> 172.21.15.18:0/494387780 conn(0x564d0b32da30 msgr2=0x564d0b332f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:17.543 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:59:17.544 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "scrub active (0 inodes in the stack)", 2024-09-19T09:59:17.544 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T09:59:17.544 INFO:teuthology.orchestra.run.smithi018.stdout: "4e498b39-a7da-480a-bf26-542991128973": { 2024-09-19T09:59:17.544 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T09:59:17.544 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "4e498b39-a7da-480a-bf26-542991128973", 2024-09-19T09:59:17.544 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T09:59:17.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:59:17.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:59:17.544 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:59:17.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.537+0000 7f0bbcff9640 0 client.26626 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:17.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.537+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/494387780 shutdown_connections 2024-09-19T09:59:17.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.537+0000 7f0bdd7a7740 1 -- 172.21.15.18:0/494387780 wait complete. 2024-09-19T09:59:17.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.538+0000 7f0bdd7a7740 20 client.26626 trim_cache size 0 max 16384 2024-09-19T09:59:17.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.539+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0bc00a3300 msgr2=0x7f0bc00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:17.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.539+0000 7f0bdb3ce640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0bc00a3300 0x7f0bc00a57c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc031b50 tx=0x7f0bcc031b80 comp rx=0 tx=0).stop 2024-09-19T09:59:17.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.539+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd4109830 msgr2=0x7f0bd4118b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:17.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.539+0000 7f0bdb3ce640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd4109830 0x7f0bd4118b80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400e9f0 tx=0x7f0bc400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.539+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/1060882108 shutdown_connections 2024-09-19T09:59:17.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.540+0000 7f0bdb3ce640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0bc00a3300 0x7f0bc00a57c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.540+0000 7f0bdb3ce640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bd411b140 0x7f0bd41118b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.540+0000 7f0bdb3ce640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd4109830 0x7f0bd4118b80 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.540+0000 7f0bdb3ce640 1 --2- 172.21.15.18:0/1060882108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0bd4109450 0x7f0bd4118640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:17.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.540+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/1060882108 >> 172.21.15.18:0/1060882108 conn(0x7f0bd406e140 msgr2=0x7f0bd411bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.540+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/1060882108 shutdown_connections 2024-09-19T09:59:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:17.540+0000 7f0bdb3ce640 1 -- 172.21.15.18:0/1060882108 wait complete. 2024-09-19T09:59:18.663 INFO:tasks.cephfs.filesystem:scrub status for tag:4e498b39-a7da-480a-bf26-542991128973 - {'path': '/', 'tag': '4e498b39-a7da-480a-bf26-542991128973', 'options': 'recursive,force'} 2024-09-19T09:59:18.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:18 smithi018 ceph-mon[30956]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 857 MiB/s wr, 1.52k op/s 2024-09-19T09:59:18.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:18 smithi049 ceph-mon[34858]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 857 MiB/s wr, 1.52k op/s 2024-09-19T09:59:18.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:18 smithi162 ceph-mon[35174]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 857 MiB/s wr, 1.52k op/s 2024-09-19T09:59:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.586+0000 7fd510ff9640 1 -- 172.21.15.18:0/1880549899 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fd520036050 con 0x5638ff233020 2024-09-19T09:59:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.586+0000 7fd510ff9640 10 client.26618 handle_command_reply: tid=0 2024-09-19T09:59:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.586+0000 7fd53245c740 1 client.26618 shutdown 2024-09-19T09:59:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.589+0000 7fd53245c740 1 -- 172.21.15.18:0/1880549899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 msgr2=0x5638ff1dc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.589+0000 7fd53245c740 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 0x5638ff1dc160 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd518010aa0 tx=0x7fd51809d4b0 comp rx=0 tx=0).stop 2024-09-19T09:59:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.589+0000 7fd53245c740 1 -- 172.21.15.18:0/1880549899 shutdown_connections 2024-09-19T09:59:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.589+0000 7fd53245c740 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5638ff233020 0x5638ff235440 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.589+0000 7fd53245c740 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638ff1c22b0 0x5638ff1dc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.589+0000 7fd53245c740 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5638ff1b8540 0x5638ff1dc160 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.589+0000 7fd53245c740 1 --2- 172.21.15.18:0/1880549899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5638ff1b34b0 0x5638ff1d9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.589+0000 7fd53245c740 1 -- 172.21.15.18:0/1880549899 >> 172.21.15.18:0/1880549899 conn(0x5638ff1ae1e0 msgr2=0x5638ff1b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.589+0000 7fd510ff9640 0 client.26618 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:59:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:59:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:59:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:59:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.591+0000 7fd53245c740 1 -- 172.21.15.18:0/1880549899 shutdown_connections 2024-09-19T09:59:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.591+0000 7fd53245c740 1 -- 172.21.15.18:0/1880549899 wait complete. 2024-09-19T09:59:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.591+0000 7fd53245c740 20 client.26618 trim_cache size 0 max 16384 2024-09-19T09:59:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.593+0000 7fd52f6ba640 1 -- 172.21.15.18:0/1305334448 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd5140a33d0 msgr2=0x7fd5140a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.594+0000 7fd52f6ba640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd5140a33d0 0x7fd5140a5890 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd520031c10 tx=0x7fd520005eb0 comp rx=0 tx=0).stop 2024-09-19T09:59:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.594+0000 7fd52f6ba640 1 -- 172.21.15.18:0/1305334448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd52810b4e0 msgr2=0x7fd528115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.594+0000 7fd52f6ba640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd52810b4e0 0x7fd528115d30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd51800b450 tx=0x7fd51800b910 comp rx=0 tx=0).stop 2024-09-19T09:59:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.597+0000 7fd52f6ba640 1 -- 172.21.15.18:0/1305334448 shutdown_connections 2024-09-19T09:59:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.597+0000 7fd52f6ba640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd5140a33d0 0x7fd5140a5890 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.597+0000 7fd52f6ba640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd52810de90 0x7fd5281a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.597+0000 7fd52f6ba640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd52810b4e0 0x7fd528115d30 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.597+0000 7fd52f6ba640 1 --2- 172.21.15.18:0/1305334448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd528072d80 0x7fd5281157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.597+0000 7fd52f6ba640 1 -- 172.21.15.18:0/1305334448 >> 172.21.15.18:0/1305334448 conn(0x7fd52806eb50 msgr2=0x7fd52810ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.597+0000 7fd52f6ba640 1 -- 172.21.15.18:0/1305334448 shutdown_connections 2024-09-19T09:59:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:19.597+0000 7fd52f6ba640 1 -- 172.21.15.18:0/1305334448 wait complete. 2024-09-19T09:59:20.888 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:20 smithi018 ceph-mon[30956]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 812 MiB/s wr, 1.44k op/s 2024-09-19T09:59:20.888 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:20 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T09:59:20.888 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:20 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T09:59:20.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:20 smithi049 ceph-mon[34858]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 812 MiB/s wr, 1.44k op/s 2024-09-19T09:59:20.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:20 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T09:59:20.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:20 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T09:59:20.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:20 smithi162 ceph-mon[35174]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 812 MiB/s wr, 1.44k op/s 2024-09-19T09:59:20.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:20 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T09:59:20.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:20 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T09:59:21.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:21 smithi049 ceph-mon[34858]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 838 MiB/s wr, 1.60k op/s 2024-09-19T09:59:21.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:21 smithi162 ceph-mon[35174]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 838 MiB/s wr, 1.60k op/s 2024-09-19T09:59:22.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:21 smithi018 ceph-mon[30956]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 838 MiB/s wr, 1.60k op/s 2024-09-19T09:59:24.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:23 smithi018 ceph-mon[30956]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 892 MiB/s wr, 1.99k op/s 2024-09-19T09:59:24.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:23 smithi049 ceph-mon[34858]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 892 MiB/s wr, 1.99k op/s 2024-09-19T09:59:24.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:23 smithi162 ceph-mon[35174]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 892 MiB/s wr, 1.99k op/s 2024-09-19T09:59:26.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:25 smithi018 ceph-mon[30956]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 908 MiB/s wr, 2.24k op/s 2024-09-19T09:59:26.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:25 smithi049 ceph-mon[34858]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 908 MiB/s wr, 2.24k op/s 2024-09-19T09:59:26.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:25 smithi162 ceph-mon[35174]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 908 MiB/s wr, 2.24k op/s 2024-09-19T09:59:28.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:27 smithi018 ceph-mon[30956]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 872 MiB/s wr, 2.19k op/s 2024-09-19T09:59:28.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:27 smithi049 ceph-mon[34858]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 872 MiB/s wr, 2.19k op/s 2024-09-19T09:59:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:27 smithi162 ceph-mon[35174]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 872 MiB/s wr, 2.19k op/s 2024-09-19T09:59:30.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:30 smithi018 ceph-mon[30956]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 827 MiB/s wr, 2.09k op/s 2024-09-19T09:59:30.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:30 smithi049 ceph-mon[34858]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 827 MiB/s wr, 2.09k op/s 2024-09-19T09:59:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:30 smithi162 ceph-mon[35174]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 827 MiB/s wr, 2.09k op/s 2024-09-19T09:59:32.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:32 smithi018 ceph-mon[30956]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 840 MiB/s wr, 2.19k op/s 2024-09-19T09:59:32.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:32 smithi049 ceph-mon[34858]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 840 MiB/s wr, 2.19k op/s 2024-09-19T09:59:32.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:32 smithi162 ceph-mon[35174]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 840 MiB/s wr, 2.19k op/s 2024-09-19T09:59:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.105+0000 7f5ed53fd640 1 -- 172.21.15.18:0/3909133713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed01003b0 msgr2=0x7f5ed01027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.105+0000 7f5ed53fd640 1 --2- 172.21.15.18:0/3909133713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed01003b0 0x7f5ed01027c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009860 tx=0x7f5ec002a380 comp rx=0 tx=0).stop 2024-09-19T09:59:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.105+0000 7f5ed53fd640 1 -- 172.21.15.18:0/3909133713 shutdown_connections 2024-09-19T09:59:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.105+0000 7f5ed53fd640 1 --2- 172.21.15.18:0/3909133713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ed01056b0 0x7f5ed0105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.105+0000 7f5ed53fd640 1 --2- 172.21.15.18:0/3909133713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed0102d00 0x7f5ed0105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.105+0000 7f5ed53fd640 1 --2- 172.21.15.18:0/3909133713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed01003b0 0x7f5ed01027c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.105+0000 7f5ed53fd640 1 -- 172.21.15.18:0/3909133713 >> 172.21.15.18:0/3909133713 conn(0x7f5ed00fc1e0 msgr2=0x7f5ed00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.107+0000 7f5ed53fd640 1 -- 172.21.15.18:0/3909133713 shutdown_connections 2024-09-19T09:59:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.107+0000 7f5ed53fd640 1 -- 172.21.15.18:0/3909133713 wait complete. 2024-09-19T09:59:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.108+0000 7f5ed53fd640 1 Processor -- start 2024-09-19T09:59:33.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.109+0000 7f5ed53fd640 1 -- start start 2024-09-19T09:59:33.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.109+0000 7f5ed53fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed01003b0 0x7f5ed0070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.109+0000 7f5ed53fd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ed0102d00 0x7f5ed0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.109+0000 7f5ed53fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed01056b0 0x7f5ed01ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.109+0000 7f5ed53fd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed0113e40 con 0x7f5ed0102d00 2024-09-19T09:59:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.109+0000 7f5ed53fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed0113cc0 con 0x7f5ed01003b0 2024-09-19T09:59:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.109+0000 7f5ed53fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed0113fc0 con 0x7f5ed01056b0 2024-09-19T09:59:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.110+0000 7f5eceffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed01003b0 0x7f5ed0070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.110+0000 7f5eceffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed01003b0 0x7f5ed0070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59938/0 (socket says 172.21.15.18:59938) 2024-09-19T09:59:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.111+0000 7f5eceffd640 1 -- 172.21.15.18:0/1390641013 learned_addr learned my addr 172.21.15.18:0/1390641013 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.111+0000 7f5ecf7fe640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed01056b0 0x7f5ed01ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.112+0000 7f5ece7fc640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ed0102d00 0x7f5ed0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.112+0000 7f5ecf7fe640 1 -- 172.21.15.18:0/1390641013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed01003b0 msgr2=0x7f5ed0070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.112+0000 7f5ecf7fe640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed01003b0 0x7f5ed0070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.113+0000 7f5ecf7fe640 1 -- 172.21.15.18:0/1390641013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ed0102d00 msgr2=0x7f5ed0071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.113+0000 7f5ecf7fe640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ed0102d00 0x7f5ed0071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.113+0000 7f5ecf7fe640 1 -- 172.21.15.18:0/1390641013 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed01069d0 con 0x7f5ed01056b0 2024-09-19T09:59:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.113+0000 7f5ecf7fe640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed01056b0 0x7f5ed01ae4f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800ef00 tx=0x7f5ec800c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.126+0000 7f5eb7fff640 1 -- 172.21.15.18:0/1390641013 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8004b20 con 0x7f5ed01056b0 2024-09-19T09:59:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.126+0000 7f5eb7fff640 1 -- 172.21.15.18:0/1390641013 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ec8003e50 con 0x7f5ed01056b0 2024-09-19T09:59:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.126+0000 7f5eb7fff640 1 -- 172.21.15.18:0/1390641013 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800b570 con 0x7f5ed01056b0 2024-09-19T09:59:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.126+0000 7f5ed53fd640 1 -- 172.21.15.18:0/1390641013 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed0106cc0 con 0x7f5ed01056b0 2024-09-19T09:59:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.126+0000 7f5ed53fd640 1 -- 172.21.15.18:0/1390641013 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed01071c0 con 0x7f5ed01056b0 2024-09-19T09:59:33.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.134+0000 7f5ed827f740 1 Processor -- start 2024-09-19T09:59:33.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.134+0000 7f5ed827f740 1 -- start start 2024-09-19T09:59:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.135+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x55882205ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.135+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882205fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.135+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558822060370 0x558822062830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.135+0000 7f5ece7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x55882205ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.136+0000 7f5eceffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882205fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.136+0000 7f5ece7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x55882205ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59944/0 (socket says 172.21.15.18:59944) 2024-09-19T09:59:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.136+0000 7f5ece7fc640 1 -- 172.21.15.18:0/4233477325 learned_addr learned my addr 172.21.15.18:0/4233477325 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.136+0000 7f5ed827f740 1 -- 172.21.15.18:0/4233477325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558821fbe2f0 con 0x558822060370 2024-09-19T09:59:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.136+0000 7f5ed827f740 1 -- 172.21.15.18:0/4233477325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558821f66270 con 0x55882205a9a0 2024-09-19T09:59:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.136+0000 7f5ed827f740 1 -- 172.21.15.18:0/4233477325 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558821fba2b0 con 0x55882205b2e0 2024-09-19T09:59:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.138+0000 7f5eceffd640 1 -- 172.21.15.18:0/4233477325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 msgr2=0x55882205ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.138+0000 7f5eceffd640 1 --2- 172.21.15.18:0/4233477325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x55882205ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.138+0000 7f5eceffd640 1 -- 172.21.15.18:0/4233477325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558822060370 msgr2=0x558822062830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:59:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.138+0000 7f5eceffd640 1 --2- 172.21.15.18:0/4233477325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558822060370 0x558822062830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.138+0000 7f5eceffd640 1 -- 172.21.15.18:0/4233477325 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558821f65340 con 0x55882205b2e0 2024-09-19T09:59:33.142 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.139+0000 7f5eceffd640 1 --2- 172.21.15.18:0/4233477325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882205fda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0000c00 tx=0x7f5ec0005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7bede84290d9e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.142+0000 7f5eb57fa640 1 -- 172.21.15.18:0/4233477325 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0041020 con 0x55882205b2e0 2024-09-19T09:59:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.142+0000 7f5eb57fa640 1 -- 172.21.15.18:0/4233477325 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ec0004040 con 0x55882205b2e0 2024-09-19T09:59:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.142+0000 7f5eb57fa640 1 -- 172.21.15.18:0/4233477325 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0037040 con 0x55882205b2e0 2024-09-19T09:59:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.143+0000 7f5eb7fff640 1 -- 172.21.15.18:0/1390641013 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5ec801d020 con 0x7f5ed01056b0 2024-09-19T09:59:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.145+0000 7f5eb7fff640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5eb80a3520 0x7f5eb80a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.145+0000 7f5eb7fff640 1 -- 172.21.15.18:0/1390641013 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5ec80cf6b0 con 0x7f5ed01056b0 2024-09-19T09:59:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.152+0000 7f5ed827f740 1 -- 172.21.15.18:0/4233477325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 msgr2=0x55882205fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.152+0000 7f5ed827f740 1 --2- 172.21.15.18:0/4233477325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882205fda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0000c00 tx=0x7f5ec0005a90 comp rx=0 tx=0).stop 2024-09-19T09:59:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.152+0000 7f5ed827f740 1 -- 172.21.15.18:0/4233477325 shutdown_connections 2024-09-19T09:59:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.152+0000 7f5ed827f740 1 --2- 172.21.15.18:0/4233477325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558822060370 0x558822062830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.153+0000 7f5ed827f740 1 --2- 172.21.15.18:0/4233477325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882205fda0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.153+0000 7f5ed827f740 1 --2- 172.21.15.18:0/4233477325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x55882205ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.153+0000 7f5ed827f740 1 -- 172.21.15.18:0/4233477325 >> 172.21.15.18:0/4233477325 conn(0x558822056010 msgr2=0x558822056410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.153+0000 7f5ed827f740 1 -- 172.21.15.18:0/4233477325 shutdown_connections 2024-09-19T09:59:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.153+0000 7f5ed827f740 1 -- 172.21.15.18:0/4233477325 wait complete. 2024-09-19T09:59:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.155+0000 7f5ed827f740 1 -- start start 2024-09-19T09:59:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.155+0000 7f5ed827f740 1 Processor -- start 2024-09-19T09:59:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.156+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205a9a0 0x558822064bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.156+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x558822065130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.156+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 0x55882206c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.156+0000 7f5ed827f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5588220632e0 con 0x55882205a9a0 2024-09-19T09:59:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.156+0000 7f5ed827f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558821f47290 con 0x558822060370 2024-09-19T09:59:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.156+0000 7f5ed827f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558822063460 con 0x55882205b2e0 2024-09-19T09:59:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.156+0000 7f5ed827f740 10 client.0 _ll_register_callbacks cb 0x558821f78140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.157+0000 7f5ecf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 0x55882206c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.157+0000 7f5ecf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 0x55882206c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59946/0 (socket says 172.21.15.18:59946) 2024-09-19T09:59:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.157+0000 7f5ecf7fe640 1 -- 172.21.15.18:0/2399060967 learned_addr learned my addr 172.21.15.18:0/2399060967 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.157+0000 7f5ece7fc640 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x558822065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.158+0000 7f5ecf7fe640 1 -- 172.21.15.18:0/2399060967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 msgr2=0x558822065130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.158+0000 7f5ecf7fe640 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x558822065130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.158+0000 7f5ecf7fe640 1 -- 172.21.15.18:0/2399060967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205a9a0 msgr2=0x558822064bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.158+0000 7f5ecf7fe640 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205a9a0 0x558822064bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.158+0000 7f5ecf7fe640 1 -- 172.21.15.18:0/2399060967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558821cd1210 con 0x558822060370 2024-09-19T09:59:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.159+0000 7f5ecf7fe640 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 0x55882206c170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80a43e0 tx=0x7f5ec809b6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a12cdd648c451f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.160+0000 7f5eb2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.160+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/2399060967 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80a4910 con 0x558822060370 2024-09-19T09:59:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.160+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/2399060967 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5ec80cd290 con 0x558822060370 2024-09-19T09:59:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.161+0000 7f5ed827f740 1 -- 172.21.15.18:0/2399060967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ec0004040 con 0x558822060370 2024-09-19T09:59:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.161+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/2399060967 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5ec80a4480 con 0x558822060370 2024-09-19T09:59:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.161+0000 7f5ed827f740 10 client.26663 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.162+0000 7f5ed827f740 1 -- 172.21.15.18:0/2399060967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558821d9d620 con 0x558822060370 2024-09-19T09:59:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.162+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/2399060967 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ec80a4620 con 0x558822060370 2024-09-19T09:59:33.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.163+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/2399060967 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5ec800b040 con 0x558822060370 2024-09-19T09:59:33.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.163+0000 7f5ed827f740 10 client.26663 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:33.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.163+0000 7f5ed827f740 10 client.26663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:33.168 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.163+0000 7f5ed827f740 20 client.26663 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:33.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.163+0000 7f5ed827f740 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558822070d70 0x558822073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.163+0000 7f5ed827f740 4 client.26663 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:33.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.163+0000 7f5ed827f740 1 -- 172.21.15.18:0/2399060967 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5ec0004040 con 0x558822070d70 2024-09-19T09:59:33.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.165+0000 7f5eceffd640 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558822070d70 0x558822073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.170 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.168+0000 7f5eceffd640 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558822070d70 0x558822073210 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1b5374339ac998d server_cookie=22fedf6109fbdc3c in_seq=0 out_seq=0 2024-09-19T09:59:33.170 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.168+0000 7f5eb2ff5640 10 client.26663 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:33.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.171+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/2399060967 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5ec0004040 con 0x558822070d70 2024-09-19T09:59:33.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.172+0000 7f5eb2ff5640 10 client.26663 handle_command_reply: tid=0 2024-09-19T09:59:33.174 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.172+0000 7f5ed827f740 1 client.26663 shutdown 2024-09-19T09:59:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.176+0000 7f5ece7fc640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5eb80a3520 0x7f5eb80a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.177+0000 7f5ece7fc640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5eb80a3520 0x7f5eb80a59e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x5588220660d0 tx=0x7f5ec4012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.181+0000 7f5ed827f740 1 -- 172.21.15.18:0/2399060967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 msgr2=0x55882206c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.181+0000 7f5ed827f740 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 0x55882206c170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80a43e0 tx=0x7f5ec809b6c0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.181+0000 7f5ed827f740 1 -- 172.21.15.18:0/2399060967 shutdown_connections 2024-09-19T09:59:33.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.181+0000 7f5ed827f740 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558822070d70 0x558822073210 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.181+0000 7f5ed827f740 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 0x55882206c170 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.182+0000 7f5ed827f740 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x558822065130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.182+0000 7f5ed827f740 1 --2- 172.21.15.18:0/2399060967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205a9a0 0x558822064bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.182+0000 7f5ed827f740 1 -- 172.21.15.18:0/2399060967 >> 172.21.15.18:0/2399060967 conn(0x558822056010 msgr2=0x558822057820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.182+0000 7f5eb2ff5640 0 client.26663 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.186+0000 7f5ed827f740 1 -- 172.21.15.18:0/2399060967 shutdown_connections 2024-09-19T09:59:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.187+0000 7f5ed827f740 1 -- 172.21.15.18:0/2399060967 wait complete. 2024-09-19T09:59:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.187+0000 7f5ed827f740 20 client.26663 trim_cache size 0 max 16384 2024-09-19T09:59:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.278+0000 7f5ed827f740 1 Processor -- start 2024-09-19T09:59:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.278+0000 7f5ed827f740 1 -- start start 2024-09-19T09:59:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.279+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205a9a0 0x5588220550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.279+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882206c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.280+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 0x558822077b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.280+0000 7f5ed827f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01c0720 con 0x55882205a9a0 2024-09-19T09:59:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.280+0000 7f5ed827f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01c2260 con 0x558822060370 2024-09-19T09:59:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.280+0000 7f5ece7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882206c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.280+0000 7f5ece7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882206c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51760/0 (socket says 172.21.15.18:51760) 2024-09-19T09:59:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.280+0000 7f5ece7fc640 1 -- 172.21.15.18:0/3583606918 learned_addr learned my addr 172.21.15.18:0/3583606918 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.280+0000 7f5ecf7fe640 1 --2- 172.21.15.18:0/3583606918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 0x558822077b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.280+0000 7f5ed827f740 1 -- 172.21.15.18:0/3583606918 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01c0df0 con 0x55882205b2e0 2024-09-19T09:59:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.281+0000 7f5eceffd640 1 --2- 172.21.15.18:0/3583606918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205a9a0 0x5588220550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.281+0000 7f5eceffd640 1 -- 172.21.15.18:0/3583606918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 msgr2=0x55882206c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.282+0000 7f5eceffd640 1 --2- 172.21.15.18:0/3583606918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882206c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.282+0000 7f5eceffd640 1 -- 172.21.15.18:0/3583606918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 msgr2=0x558822077b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.282+0000 7f5eceffd640 1 --2- 172.21.15.18:0/3583606918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 0x558822077b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.282+0000 7f5eceffd640 1 -- 172.21.15.18:0/3583606918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558821e2d8a0 con 0x55882205a9a0 2024-09-19T09:59:33.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.282+0000 7f5ece7fc640 1 --2- 172.21.15.18:0/3583606918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882206c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:59:33.285 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.282+0000 7f5eceffd640 1 --2- 172.21.15.18:0/3583606918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205a9a0 0x5588220550b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x558822064120 tx=0x7f5ec0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a6bfe7ea67ed72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.300+0000 7f5eb4ff9640 1 -- 172.21.15.18:0/3583606918 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0041070 con 0x55882205a9a0 2024-09-19T09:59:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.300+0000 7f5eb4ff9640 1 -- 172.21.15.18:0/3583606918 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ec0004030 con 0x55882205a9a0 2024-09-19T09:59:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.300+0000 7f5eb4ff9640 1 -- 172.21.15.18:0/3583606918 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0037040 con 0x55882205a9a0 2024-09-19T09:59:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.305+0000 7f5ed827f740 1 -- 172.21.15.18:0/3583606918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205a9a0 msgr2=0x5588220550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.305+0000 7f5ed827f740 1 --2- 172.21.15.18:0/3583606918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205a9a0 0x5588220550b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x558822064120 tx=0x7f5ec0005850 comp rx=0 tx=0).stop 2024-09-19T09:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.307+0000 7f5ed827f740 1 -- 172.21.15.18:0/3583606918 shutdown_connections 2024-09-19T09:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.307+0000 7f5ed827f740 1 --2- 172.21.15.18:0/3583606918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558822060370 0x558822077b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.307+0000 7f5ed827f740 1 --2- 172.21.15.18:0/3583606918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55882205b2e0 0x55882206c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.307+0000 7f5ed827f740 1 --2- 172.21.15.18:0/3583606918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205a9a0 0x5588220550b0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.308+0000 7f5ed827f740 1 -- 172.21.15.18:0/3583606918 >> 172.21.15.18:0/3583606918 conn(0x558822056010 msgr2=0x5588220549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:33.313 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.311+0000 7f5ed827f740 1 -- 172.21.15.18:0/3583606918 shutdown_connections 2024-09-19T09:59:33.313 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.311+0000 7f5ed827f740 1 -- 172.21.15.18:0/3583606918 wait complete. 2024-09-19T09:59:33.314 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.312+0000 7f5ed827f740 1 -- start start 2024-09-19T09:59:33.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.312+0000 7f5ed827f740 1 Processor -- start 2024-09-19T09:59:33.315 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.313+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x558822069940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.313+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205b2e0 0x558822069e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.314+0000 7f5ed827f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558822060370 0x55882206ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.314+0000 7f5ed827f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01c1b90 con 0x55882205b2e0 2024-09-19T09:59:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.314+0000 7f5eceffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x558822069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.314+0000 7f5eceffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x558822069940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59966/0 (socket says 172.21.15.18:59966) 2024-09-19T09:59:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.314+0000 7f5eceffd640 1 -- 172.21.15.18:0/1350604131 learned_addr learned my addr 172.21.15.18:0/1350604131 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.314+0000 7f5ed827f740 1 -- 172.21.15.18:0/1350604131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01c14c0 con 0x55882205a9a0 2024-09-19T09:59:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.314+0000 7f5ed827f740 1 -- 172.21.15.18:0/1350604131 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed010dea0 con 0x558822060370 2024-09-19T09:59:33.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.315+0000 7f5ecf7fe640 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558822060370 0x55882206ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.318 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.315+0000 7f5ed827f740 10 client.0 _ll_register_callbacks cb 0x7f5ec8004f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:33.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.318+0000 7f5ece7fc640 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205b2e0 0x558822069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.317+0000 7f5eceffd640 1 -- 172.21.15.18:0/1350604131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558822060370 msgr2=0x55882206ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.318+0000 7f5eceffd640 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558822060370 0x55882206ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.318+0000 7f5eceffd640 1 -- 172.21.15.18:0/1350604131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205b2e0 msgr2=0x558822069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.318+0000 7f5eceffd640 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205b2e0 0x558822069e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.318+0000 7f5eceffd640 1 -- 172.21.15.18:0/1350604131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55882206b450 con 0x55882205a9a0 2024-09-19T09:59:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.318+0000 7f5ecf7fe640 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558822060370 0x55882206ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:59:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.318+0000 7f5ece7fc640 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205b2e0 0x558822069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:59:33.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.319+0000 7f5eceffd640 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x558822069940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0035040 tx=0x7f5ec00038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c157ccecd14198ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.320+0000 7f5eb2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.320+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/1350604131 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0037070 con 0x55882205a9a0 2024-09-19T09:59:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.321+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/1350604131 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5ec0030340 con 0x55882205a9a0 2024-09-19T09:59:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.321+0000 7f5ed827f740 1 -- 172.21.15.18:0/1350604131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ec0004030 con 0x55882205a9a0 2024-09-19T09:59:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.321+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/1350604131 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5ec0041040 con 0x55882205a9a0 2024-09-19T09:59:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.322+0000 7f5ed827f740 10 client.26669 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.322+0000 7f5ed827f740 1 -- 172.21.15.18:0/1350604131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5588220dbb50 con 0x55882205a9a0 2024-09-19T09:59:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.323+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/1350604131 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ec0003e70 con 0x55882205a9a0 2024-09-19T09:59:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.325+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/1350604131 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5ec004e6d0 con 0x55882205a9a0 2024-09-19T09:59:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.325+0000 7f5ed827f740 10 client.26669 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.325+0000 7f5ed827f740 10 client.26669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.325+0000 7f5ed827f740 20 client.26669 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.325+0000 7f5ed827f740 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5588220dc040 0x5588220de460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.325+0000 7f5ed827f740 4 client.26669 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:59:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.326+0000 7f5ed827f740 1 -- 172.21.15.18:0/1350604131 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f5ec0004030 con 0x5588220dc040 2024-09-19T09:59:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.327+0000 7f5ece7fc640 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5588220dc040 0x5588220de460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.337+0000 7f5ece7fc640 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5588220dc040 0x5588220de460 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1b5f7e35c768a46 server_cookie=71a0913d82be3113 in_seq=0 out_seq=0 2024-09-19T09:59:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:33.337+0000 7f5eb2ff5640 10 client.26669 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:34.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:34 smithi049 ceph-mon[34858]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 880 MiB/s wr, 2.38k op/s 2024-09-19T09:59:34.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:34 smithi018 ceph-mon[30956]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 880 MiB/s wr, 2.38k op/s 2024-09-19T09:59:34.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:34 smithi162 ceph-mon[35174]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 880 MiB/s wr, 2.38k op/s 2024-09-19T09:59:36.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:36 smithi018 ceph-mon[30956]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 882 MiB/s wr, 2.32k op/s 2024-09-19T09:59:36.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:36 smithi049 ceph-mon[34858]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 882 MiB/s wr, 2.32k op/s 2024-09-19T09:59:36.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:36 smithi162 ceph-mon[35174]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 882 MiB/s wr, 2.32k op/s 2024-09-19T09:59:38.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:38 smithi018 ceph-mon[30956]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 843 MiB/s wr, 2.10k op/s 2024-09-19T09:59:38.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:38 smithi049 ceph-mon[34858]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 843 MiB/s wr, 2.10k op/s 2024-09-19T09:59:38.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:38 smithi162 ceph-mon[35174]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 843 MiB/s wr, 2.10k op/s 2024-09-19T09:59:40.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:40 smithi018 ceph-mon[30956]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 106 GiB used, 966 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 795 MiB/s wr, 1.95k op/s 2024-09-19T09:59:40.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:40 smithi049 ceph-mon[34858]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 106 GiB used, 966 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 795 MiB/s wr, 1.95k op/s 2024-09-19T09:59:40.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:40 smithi162 ceph-mon[35174]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 106 GiB used, 966 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 795 MiB/s wr, 1.95k op/s 2024-09-19T09:59:42.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:42 smithi018 ceph-mon[30956]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 107 GiB used, 966 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 833 MiB/s wr, 2.06k op/s 2024-09-19T09:59:42.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:42 smithi049 ceph-mon[34858]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 107 GiB used, 966 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 833 MiB/s wr, 2.06k op/s 2024-09-19T09:59:42.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:42 smithi162 ceph-mon[35174]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 107 GiB used, 966 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 833 MiB/s wr, 2.06k op/s 2024-09-19T09:59:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.453+0000 7f5eb2ff5640 1 -- 172.21.15.18:0/1350604131 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f5ec0004030 con 0x5588220dc040 2024-09-19T09:59:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.453+0000 7f5eb2ff5640 10 client.26669 handle_command_reply: tid=0 2024-09-19T09:59:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.453+0000 7f5ed827f740 1 client.26669 shutdown 2024-09-19T09:59:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.454+0000 7f5ed827f740 1 -- 172.21.15.18:0/1350604131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 msgr2=0x558822069940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.454+0000 7f5ed827f740 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x558822069940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0035040 tx=0x7f5ec00038a0 comp rx=0 tx=0).stop 2024-09-19T09:59:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.454+0000 7f5ed827f740 1 -- 172.21.15.18:0/1350604131 shutdown_connections 2024-09-19T09:59:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.454+0000 7f5ed827f740 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5588220dc040 0x5588220de460 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.454+0000 7f5ed827f740 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558822060370 0x55882206ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.454+0000 7f5ed827f740 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55882205b2e0 0x558822069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.454+0000 7f5ed827f740 1 --2- 172.21.15.18:0/1350604131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55882205a9a0 0x558822069940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.454+0000 7f5ed827f740 1 -- 172.21.15.18:0/1350604131 >> 172.21.15.18:0/1350604131 conn(0x558822056010 msgr2=0x5588220551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.455+0000 7f5eb2ff5640 0 client.26669 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.455+0000 7f5ed827f740 1 -- 172.21.15.18:0/1350604131 shutdown_connections 2024-09-19T09:59:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.455+0000 7f5ed827f740 1 -- 172.21.15.18:0/1350604131 wait complete. 2024-09-19T09:59:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.455+0000 7f5ed827f740 20 client.26669 trim_cache size 0 max 16384 2024-09-19T09:59:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T09:59:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T09:59:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T09:59:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T09:59:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.468+0000 7f5ed53fd640 1 -- 172.21.15.18:0/1390641013 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5eb80a3520 msgr2=0x7f5eb80a59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.468+0000 7f5ed53fd640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5eb80a3520 0x7f5eb80a59e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x5588220660d0 tx=0x7f5ec4012040 comp rx=0 tx=0).stop 2024-09-19T09:59:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.469+0000 7f5ed53fd640 1 -- 172.21.15.18:0/1390641013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed01056b0 msgr2=0x7f5ed01ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.469+0000 7f5ed53fd640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed01056b0 0x7f5ed01ae4f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800ef00 tx=0x7f5ec800c740 comp rx=0 tx=0).stop 2024-09-19T09:59:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.471+0000 7f5ed53fd640 1 -- 172.21.15.18:0/1390641013 shutdown_connections 2024-09-19T09:59:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.471+0000 7f5ed53fd640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5eb80a3520 0x7f5eb80a59e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.471+0000 7f5ed53fd640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed01056b0 0x7f5ed01ae4f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.471+0000 7f5ed53fd640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ed0102d00 0x7f5ed0071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.471+0000 7f5ed53fd640 1 --2- 172.21.15.18:0/1390641013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ed01003b0 0x7f5ed0070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.471+0000 7f5ed53fd640 1 -- 172.21.15.18:0/1390641013 >> 172.21.15.18:0/1390641013 conn(0x7f5ed00fc1e0 msgr2=0x7f5ed0103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.472+0000 7f5ed53fd640 1 -- 172.21.15.18:0/1390641013 shutdown_connections 2024-09-19T09:59:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:43.472+0000 7f5ed53fd640 1 -- 172.21.15.18:0/1390641013 wait complete. 2024-09-19T09:59:44.572 INFO:tasks.quiescer.fs.[cephfs]:Total duration (51.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:59:44.572 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T09:59:44.572 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:59:44.889 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:44 smithi018 ceph-mon[30956]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 899 MiB/s wr, 2.29k op/s 2024-09-19T09:59:44.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:44 smithi049 ceph-mon[34858]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 899 MiB/s wr, 2.29k op/s 2024-09-19T09:59:44.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:44 smithi162 ceph-mon[35174]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 899 MiB/s wr, 2.29k op/s 2024-09-19T09:59:45.596 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:59:46.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.399+0000 7f7e41a72640 1 -- 172.21.15.18:0/1730618791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e3c109450 msgr2=0x7f7e3c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:46.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.399+0000 7f7e41a72640 1 --2- 172.21.15.18:0/1730618791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e3c109450 0x7f7e3c110250 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009ca0 tx=0x7f7e3402a8f0 comp rx=0 tx=0).stop 2024-09-19T09:59:46.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.402+0000 7f7e41a72640 1 -- 172.21.15.18:0/1730618791 shutdown_connections 2024-09-19T09:59:46.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.402+0000 7f7e41a72640 1 --2- 172.21.15.18:0/1730618791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e3c11b140 0x7f7e3c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:46.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.402+0000 7f7e41a72640 1 --2- 172.21.15.18:0/1730618791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e3c109830 0x7f7e3c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:46.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.402+0000 7f7e41a72640 1 --2- 172.21.15.18:0/1730618791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e3c109450 0x7f7e3c110250 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:46.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.402+0000 7f7e41a72640 1 -- 172.21.15.18:0/1730618791 >> 172.21.15.18:0/1730618791 conn(0x7f7e3c06e140 msgr2=0x7f7e3c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:46.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.402+0000 7f7e41a72640 1 -- 172.21.15.18:0/1730618791 shutdown_connections 2024-09-19T09:59:46.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.402+0000 7f7e41a72640 1 -- 172.21.15.18:0/1730618791 wait complete. 2024-09-19T09:59:46.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.403+0000 7f7e41a72640 1 Processor -- start 2024-09-19T09:59:46.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.404+0000 7f7e41a72640 1 -- start start 2024-09-19T09:59:46.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.404+0000 7f7e41a72640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e3c109450 0x7f7e3c1a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:46.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.404+0000 7f7e41a72640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e3c109830 0x7f7e3c1a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:46.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.404+0000 7f7e41a72640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e3c11b140 0x7f7e3c1abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:46.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.404+0000 7f7e3affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e3c109830 0x7f7e3c1a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:46.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.404+0000 7f7e3affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e3c109830 0x7f7e3c1a7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51938/0 (socket says 172.21.15.18:51938) 2024-09-19T09:59:46.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.404+0000 7f7e3affd640 1 -- 172.21.15.18:0/4087773572 learned_addr learned my addr 172.21.15.18:0/4087773572 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:46.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.404+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c120eb0 con 0x7f7e3c109830 2024-09-19T09:59:46.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.404+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c120d30 con 0x7f7e3c11b140 2024-09-19T09:59:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.404+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c121030 con 0x7f7e3c109450 2024-09-19T09:59:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.405+0000 7f7e3b7fe640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e3c109450 0x7f7e3c1a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.405+0000 7f7e3affd640 1 -- 172.21.15.18:0/4087773572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e3c109450 msgr2=0x7f7e3c1a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.405+0000 7f7e3affd640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e3c109450 0x7f7e3c1a71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.405+0000 7f7e3affd640 1 -- 172.21.15.18:0/4087773572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e3c11b140 msgr2=0x7f7e3c1abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.405+0000 7f7e3affd640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e3c11b140 0x7f7e3c1abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.405+0000 7f7e3affd640 1 -- 172.21.15.18:0/4087773572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c1ac180 con 0x7f7e3c109830 2024-09-19T09:59:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.405+0000 7f7e3affd640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e3c109830 0x7f7e3c1a7710 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000b450 tx=0x7f7e3000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.406+0000 7f7e38ff9640 1 -- 172.21.15.18:0/4087773572 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30015020 con 0x7f7e3c109830 2024-09-19T09:59:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.406+0000 7f7e38ff9640 1 -- 172.21.15.18:0/4087773572 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e30011d70 con 0x7f7e3c109830 2024-09-19T09:59:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.406+0000 7f7e38ff9640 1 -- 172.21.15.18:0/4087773572 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000f340 con 0x7f7e3c109830 2024-09-19T09:59:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.407+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3c1ac470 con 0x7f7e3c109830 2024-09-19T09:59:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.407+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e3c1b3d50 con 0x7f7e3c109830 2024-09-19T09:59:46.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.409+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3c06f6c0 con 0x7f7e3c109830 2024-09-19T09:59:46.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.413+0000 7f7e38ff9640 1 -- 172.21.15.18:0/4087773572 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7e30018020 con 0x7f7e3c109830 2024-09-19T09:59:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.415+0000 7f7e38ff9640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e240a3280 0x7f7e240a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:46.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.416+0000 7f7e3b7fe640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e240a3280 0x7f7e240a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:46.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.416+0000 7f7e38ff9640 1 -- 172.21.15.18:0/4087773572 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7e3009a030 con 0x7f7e3c109830 2024-09-19T09:59:46.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.417+0000 7f7e3b7fe640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e240a3280 0x7f7e240a5740 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7e3402f570 tx=0x7f7e34000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:46.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.426+0000 7f7e38ff9640 1 -- 172.21.15.18:0/4087773572 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7e3001f020 con 0x7f7e3c109830 2024-09-19T09:59:46.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:46 smithi162 ceph-mon[35174]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 111 GiB used, 962 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 909 MiB/s wr, 2.17k op/s 2024-09-19T09:59:46.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:46 smithi018 ceph-mon[30956]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 111 GiB used, 962 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 909 MiB/s wr, 2.17k op/s 2024-09-19T09:59:46.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.961+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e3c1a8530 con 0x7f7e3c109830 2024-09-19T09:59:46.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.967+0000 7f7e38ff9640 1 -- 172.21.15.18:0/4087773572 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f7e3c1a8530 con 0x7f7e3c109830 2024-09-19T09:59:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:59:46.982 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:59:46.982 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.978+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e240a3280 msgr2=0x7f7e240a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.978+0000 7f7e41a72640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e240a3280 0x7f7e240a5740 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7e3402f570 tx=0x7f7e34000f40 comp rx=0 tx=0).stop 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.978+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e3c109830 msgr2=0x7f7e3c1a7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.978+0000 7f7e41a72640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e3c109830 0x7f7e3c1a7710 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000b450 tx=0x7f7e3000b910 comp rx=0 tx=0).stop 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.978+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 shutdown_connections 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.978+0000 7f7e41a72640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e240a3280 0x7f7e240a5740 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.978+0000 7f7e41a72640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e3c11b140 0x7f7e3c1abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.978+0000 7f7e41a72640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e3c109830 0x7f7e3c1a7710 secure :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000b450 tx=0x7f7e3000b910 comp rx=0 tx=0).stop 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.978+0000 7f7e41a72640 1 --2- 172.21.15.18:0/4087773572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e3c109450 0x7f7e3c1a71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.978+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 >> 172.21.15.18:0/4087773572 conn(0x7f7e3c06e140 msgr2=0x7f7e3c11bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.979+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 shutdown_connections 2024-09-19T09:59:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:46.979+0000 7f7e41a72640 1 -- 172.21.15.18:0/4087773572 wait complete. 2024-09-19T09:59:47.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:46 smithi049 ceph-mon[34858]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 111 GiB used, 962 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 909 MiB/s wr, 2.17k op/s 2024-09-19T09:59:48.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:47 smithi018 ceph-mon[30956]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 113 GiB used, 960 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 875 MiB/s wr, 1.83k op/s 2024-09-19T09:59:48.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:47 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4087773572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:59:48.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:47 smithi049 ceph-mon[34858]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 113 GiB used, 960 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 875 MiB/s wr, 1.83k op/s 2024-09-19T09:59:48.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:47 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/4087773572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:59:48.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:47 smithi162 ceph-mon[35174]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 113 GiB used, 960 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 875 MiB/s wr, 1.83k op/s 2024-09-19T09:59:48.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:47 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/4087773572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:59:48.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:59:48.733 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T09:59:48.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T09:59:49.707 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:59:50.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:50 smithi018 ceph-mon[30956]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 795 MiB/s wr, 1.60k op/s 2024-09-19T09:59:50.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:59:50.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:50 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:50 smithi049 ceph-mon[34858]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 795 MiB/s wr, 1.60k op/s 2024-09-19T09:59:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:59:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:50 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:50 smithi162 ceph-mon[35174]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 795 MiB/s wr, 1.60k op/s 2024-09-19T09:59:50.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:59:50.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:50 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:50.647 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:59:51.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:51 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T09:59:51.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:51 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi049 to 176.0M 2024-09-19T09:59:51.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:51 smithi018 ceph-mon[30956]: Unable to set osd_memory_target on smithi162 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-19T09:59:51.285 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:51 smithi018 ceph-mon[30956]: Unable to set osd_memory_target on smithi049 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-09-19T09:59:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.341+0000 7f8f1f880640 1 -- 172.21.15.18:0/2883647217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f18108da0 msgr2=0x7f8f1810cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.342+0000 7f8f1f880640 1 --2- 172.21.15.18:0/2883647217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f18108da0 0x7f8f1810cdf0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009900 tx=0x7f8f0802a410 comp rx=0 tx=0).stop 2024-09-19T09:59:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.342+0000 7f8f1f880640 1 -- 172.21.15.18:0/2883647217 shutdown_connections 2024-09-19T09:59:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.342+0000 7f8f1f880640 1 --2- 172.21.15.18:0/2883647217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1810d520 0x7f8f181150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.342+0000 7f8f1f880640 1 --2- 172.21.15.18:0/2883647217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f18108da0 0x7f8f1810cdf0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.342+0000 7f8f1f880640 1 --2- 172.21.15.18:0/2883647217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f181083f0 0x7f8f181087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.342+0000 7f8f1f880640 1 -- 172.21.15.18:0/2883647217 >> 172.21.15.18:0/2883647217 conn(0x7f8f18077af0 msgr2=0x7f8f18079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.342+0000 7f8f1f880640 1 -- 172.21.15.18:0/2883647217 shutdown_connections 2024-09-19T09:59:51.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.342+0000 7f8f1f880640 1 -- 172.21.15.18:0/2883647217 wait complete. 2024-09-19T09:59:51.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.344+0000 7f8f1f880640 1 Processor -- start 2024-09-19T09:59:51.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.347+0000 7f8f1f880640 1 -- start start 2024-09-19T09:59:51.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.347+0000 7f8f1f880640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f181083f0 0x7f8f181a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.352+0000 7f8f1d61c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f181083f0 0x7f8f181a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.352+0000 7f8f1d61c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f181083f0 0x7f8f181a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:54040/0 (socket says 172.21.15.18:54040) 2024-09-19T09:59:51.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.352+0000 7f8f1d61c640 1 -- 172.21.15.18:0/2499705473 learned_addr learned my addr 172.21.15.18:0/2499705473 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:51.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.352+0000 7f8f1f880640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f18108da0 0x7f8f181a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.352+0000 7f8f1f880640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f1810d520 0x7f8f1819e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.352+0000 7f8f1f880640 1 -- 172.21.15.18:0/2499705473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f18118570 con 0x7f8f1810d520 2024-09-19T09:59:51.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.352+0000 7f8f1f880640 1 -- 172.21.15.18:0/2499705473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f181183f0 con 0x7f8f181083f0 2024-09-19T09:59:51.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.352+0000 7f8f1f880640 1 -- 172.21.15.18:0/2499705473 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f181186f0 con 0x7f8f18108da0 2024-09-19T09:59:51.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.354+0000 7f8f1d61c640 1 -- 172.21.15.18:0/2499705473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f18108da0 msgr2=0x7f8f181a4be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:59:51.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.354+0000 7f8f1d61c640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f18108da0 0x7f8f181a4be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.354+0000 7f8f1d61c640 1 -- 172.21.15.18:0/2499705473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f1810d520 msgr2=0x7f8f1819e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:51.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.354+0000 7f8f1d61c640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f1810d520 0x7f8f1819e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.354+0000 7f8f1d61c640 1 -- 172.21.15.18:0/2499705473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1819efc0 con 0x7f8f181083f0 2024-09-19T09:59:51.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.356+0000 7f8f1d61c640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f181083f0 0x7f8f181a46a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400d950 tx=0x7f8f1400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:51.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.356+0000 7f8f0e7fc640 1 -- 172.21.15.18:0/2499705473 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14017030 con 0x7f8f181083f0 2024-09-19T09:59:51.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.356+0000 7f8f0e7fc640 1 -- 172.21.15.18:0/2499705473 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f14004020 con 0x7f8f181083f0 2024-09-19T09:59:51.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.356+0000 7f8f1f880640 1 -- 172.21.15.18:0/2499705473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1819f2b0 con 0x7f8f181083f0 2024-09-19T09:59:51.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.356+0000 7f8f1f880640 1 -- 172.21.15.18:0/2499705473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f181ab500 con 0x7f8f181083f0 2024-09-19T09:59:51.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.361+0000 7f8f21c59740 1 Processor -- start 2024-09-19T09:59:51.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.361+0000 7f8f21c59740 1 -- start start 2024-09-19T09:59:51.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.361+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb1790 0x558c9eeb1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.361+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb20b0 0x558c9eebc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.361+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebc970 0x558c9eebed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.361+0000 7f8f21c59740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558c9ee172e0 con 0x558c9eeb20b0 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.361+0000 7f8f21c59740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558c9edbece0 con 0x558c9eebc970 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.361+0000 7f8f21c59740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558c9ee132a0 con 0x558c9eeb1790 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.362+0000 7f8f1de1d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb1790 0x558c9eeb1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.362+0000 7f8f1de1d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb1790 0x558c9eeb1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33928/0 (socket says 172.21.15.18:33928) 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.362+0000 7f8f1de1d640 1 -- 172.21.15.18:0/420623588 learned_addr learned my addr 172.21.15.18:0/420623588 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.362+0000 7f8f1ce1b640 1 --2- 172.21.15.18:0/420623588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebc970 0x558c9eebed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.364+0000 7f8f1de1d640 1 -- 172.21.15.18:0/420623588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebc970 msgr2=0x558c9eebed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.364+0000 7f8f1de1d640 1 --2- 172.21.15.18:0/420623588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebc970 0x558c9eebed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.364+0000 7f8f1de1d640 1 -- 172.21.15.18:0/420623588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb20b0 msgr2=0x558c9eebc430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.364+0000 7f8f1de1d640 1 --2- 172.21.15.18:0/420623588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb20b0 0x558c9eebc430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.364+0000 7f8f1de1d640 1 -- 172.21.15.18:0/420623588 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c9eda3440 con 0x558c9eeb1790 2024-09-19T09:59:51.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.368+0000 7f8f1de1d640 1 --2- 172.21.15.18:0/420623588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb1790 0x558c9eeb1b70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009e50 tx=0x7f8f1000d6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28e12740882c0760 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:51.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.368+0000 7f8f02ffd640 1 -- 172.21.15.18:0/420623588 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10003b70 con 0x558c9eeb1790 2024-09-19T09:59:51.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.369+0000 7f8f02ffd640 1 -- 172.21.15.18:0/420623588 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f1000de20 con 0x558c9eeb1790 2024-09-19T09:59:51.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.369+0000 7f8f02ffd640 1 -- 172.21.15.18:0/420623588 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10021810 con 0x558c9eeb1790 2024-09-19T09:59:51.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.373+0000 7f8f21c59740 1 -- 172.21.15.18:0/420623588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb1790 msgr2=0x558c9eeb1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:51.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.373+0000 7f8f21c59740 1 --2- 172.21.15.18:0/420623588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb1790 0x558c9eeb1b70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009e50 tx=0x7f8f1000d6b0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.374+0000 7f8f0e7fc640 1 -- 172.21.15.18:0/2499705473 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14003d40 con 0x7f8f181083f0 2024-09-19T09:59:51.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.374+0000 7f8f0e7fc640 1 -- 172.21.15.18:0/2499705473 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8f1401a070 con 0x7f8f181083f0 2024-09-19T09:59:51.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.375+0000 7f8f0e7fc640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f040a3340 0x7f8f040a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.376+0000 7f8f0e7fc640 1 -- 172.21.15.18:0/2499705473 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8f140d0550 con 0x7f8f181083f0 2024-09-19T09:59:51.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.376+0000 7f8f21c59740 1 -- 172.21.15.18:0/420623588 shutdown_connections 2024-09-19T09:59:51.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.376+0000 7f8f21c59740 1 --2- 172.21.15.18:0/420623588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebc970 0x558c9eebed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.376+0000 7f8f21c59740 1 --2- 172.21.15.18:0/420623588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb20b0 0x558c9eebc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.376+0000 7f8f21c59740 1 --2- 172.21.15.18:0/420623588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb1790 0x558c9eeb1b70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.376+0000 7f8f21c59740 1 -- 172.21.15.18:0/420623588 >> 172.21.15.18:0/420623588 conn(0x558c9eeadd20 msgr2=0x558c9eeae100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:51.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.377+0000 7f8f21c59740 1 -- 172.21.15.18:0/420623588 shutdown_connections 2024-09-19T09:59:51.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.377+0000 7f8f21c59740 1 -- 172.21.15.18:0/420623588 wait complete. 2024-09-19T09:59:51.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.377+0000 7f8f21c59740 1 -- start start 2024-09-19T09:59:51.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.378+0000 7f8f21c59740 1 Processor -- start 2024-09-19T09:59:51.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.379+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eeb1790 0x558c9eebc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.379+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb20b0 0x558c9eeb9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.379+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eebc970 0x558c9eeb98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.379+0000 7f8f1de1d640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f040a3340 0x7f8f040a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.379+0000 7f8f1d61c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eeb1790 0x558c9eebc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.379+0000 7f8f1d61c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eeb1790 0x558c9eebc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:54062/0 (socket says 172.21.15.18:54062) 2024-09-19T09:59:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.380+0000 7f8f1d61c640 1 -- 172.21.15.18:0/429365697 learned_addr learned my addr 172.21.15.18:0/429365697 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.380+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558c9eebf450 con 0x558c9eebc970 2024-09-19T09:59:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.380+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558c9edd2050 con 0x558c9eeb1790 2024-09-19T09:59:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.380+0000 7f8f1de1d640 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eebc970 0x558c9eeb98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.380+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558c9eebf5d0 con 0x558c9eeb20b0 2024-09-19T09:59:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.381+0000 7f8f1ce1b640 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb20b0 0x558c9eeb9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.381+0000 7f8f21c59740 10 client.0 _ll_register_callbacks cb 0x558c9ee12160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.382+0000 7f8f1ce1b640 1 -- 172.21.15.18:0/429365697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eeb1790 msgr2=0x558c9eebc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.382+0000 7f8f1de1d640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f040a3340 0x7f8f040a5800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009c10 tx=0x7f8f10004900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.382+0000 7f8f1ce1b640 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eeb1790 0x558c9eebc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.382+0000 7f8f1ce1b640 1 -- 172.21.15.18:0/429365697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eebc970 msgr2=0x558c9eeb98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:51.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.382+0000 7f8f1ce1b640 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eebc970 0x558c9eeb98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.382+0000 7f8f1ce1b640 1 -- 172.21.15.18:0/429365697 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c9eb883c0 con 0x558c9eeb20b0 2024-09-19T09:59:51.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.382+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f1000de20 con 0x558c9eeb20b0 2024-09-19T09:59:51.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.386+0000 7f8f1ce1b640 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb20b0 0x558c9eeb9390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8f1810eef0 tx=0x7f8f08004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f977d0326c2fd820 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:51.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.386+0000 7f8f00ff9640 10 client.26656 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:59:51.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.386+0000 7f8f00ff9640 1 -- 172.21.15.18:0/429365697 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08040030 con 0x558c9eeb20b0 2024-09-19T09:59:51.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.386+0000 7f8f00ff9640 1 -- 172.21.15.18:0/429365697 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8f080035f0 con 0x558c9eeb20b0 2024-09-19T09:59:51.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.387+0000 7f8f00ff9640 1 -- 172.21.15.18:0/429365697 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f08035040 con 0x558c9eeb20b0 2024-09-19T09:59:51.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.387+0000 7f8f21c59740 10 client.26656 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:51.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.387+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=28}) -- 0x558c9eecab90 con 0x558c9eeb20b0 2024-09-19T09:59:51.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.389+0000 7f8f00ff9640 1 -- 172.21.15.18:0/429365697 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f0803a040 con 0x558c9eeb20b0 2024-09-19T09:59:51.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.389+0000 7f8f21c59740 10 client.26656 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:51.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.389+0000 7f8f21c59740 10 client.26656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:51.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.389+0000 7f8f21c59740 20 client.26656 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:51.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.389+0000 7f8f21c59740 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c9eecc000 0x558c9eece440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.389+0000 7f8f21c59740 4 client.26656 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:51.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.389+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c9ee24850 con 0x558c9eecc000 2024-09-19T09:59:51.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.390+0000 7f8f1d61c640 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c9eecc000 0x558c9eece440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.390+0000 7f8f1d61c640 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c9eecc000 0x558c9eece440 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b4577c34e5fc1c4 server_cookie=5d4d992dadd2379a in_seq=0 out_seq=0 2024-09-19T09:59:51.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.390+0000 7f8f00ff9640 10 client.26656 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:51.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.392+0000 7f8f00ff9640 1 -- 172.21.15.18:0/429365697 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c9ee24850 con 0x558c9eecc000 2024-09-19T09:59:51.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.392+0000 7f8f00ff9640 10 client.26656 handle_command_reply: tid=0 2024-09-19T09:59:51.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.392+0000 7f8f21c59740 1 client.26656 shutdown 2024-09-19T09:59:51.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.395+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb20b0 msgr2=0x558c9eeb9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:51.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.395+0000 7f8f21c59740 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb20b0 0x558c9eeb9390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8f1810eef0 tx=0x7f8f08004270 comp rx=0 tx=0).stop 2024-09-19T09:59:51.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.395+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 shutdown_connections 2024-09-19T09:59:51.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.395+0000 7f8f21c59740 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c9eecc000 0x558c9eece440 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.395+0000 7f8f21c59740 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eebc970 0x558c9eeb98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.395+0000 7f8f21c59740 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eeb20b0 0x558c9eeb9390 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8f1810eef0 tx=0x7f8f08004270 comp rx=0 tx=0).stop 2024-09-19T09:59:51.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.395+0000 7f8f21c59740 1 --2- 172.21.15.18:0/429365697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eeb1790 0x558c9eebc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.395+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 >> 172.21.15.18:0/429365697 conn(0x558c9eeadd20 msgr2=0x558c9eeacee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:51.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.395+0000 7f8f00ff9640 0 client.26656 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:51.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:51 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T09:59:51.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:51 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi049 to 176.0M 2024-09-19T09:59:51.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:51 smithi049 ceph-mon[34858]: Unable to set osd_memory_target on smithi162 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-19T09:59:51.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:51 smithi049 ceph-mon[34858]: Unable to set osd_memory_target on smithi049 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-09-19T09:59:51.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.401+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 shutdown_connections 2024-09-19T09:59:51.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.401+0000 7f8f21c59740 1 -- 172.21.15.18:0/429365697 wait complete. 2024-09-19T09:59:51.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.401+0000 7f8f21c59740 20 client.26656 trim_cache size 0 max 16384 2024-09-19T09:59:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:51 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T09:59:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:51 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi049 to 176.0M 2024-09-19T09:59:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:51 smithi162 ceph-mon[35174]: Unable to set osd_memory_target on smithi162 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-19T09:59:51.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:51 smithi162 ceph-mon[35174]: Unable to set osd_memory_target on smithi049 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-09-19T09:59:51.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.467+0000 7f8f21c59740 1 Processor -- start 2024-09-19T09:59:51.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.470+0000 7f8f21c59740 1 -- start start 2024-09-19T09:59:51.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.470+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 0x558c9eeb7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.470+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 0x558c9eed3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.470+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebbb20 0x558c9eed4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.470+0000 7f8f21c59740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00e370 con 0x558c9eeb1790 2024-09-19T09:59:51.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.470+0000 7f8f21c59740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00feb0 con 0x558c9eebbb20 2024-09-19T09:59:51.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.470+0000 7f8f21c59740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00ea40 con 0x558c9eebc970 2024-09-19T09:59:51.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.472+0000 7f8f1ce1b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 0x558c9eed3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.473+0000 7f8f1de1d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebbb20 0x558c9eed4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.473+0000 7f8f1de1d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebbb20 0x558c9eed4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:54068/0 (socket says 172.21.15.18:54068) 2024-09-19T09:59:51.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.473+0000 7f8f1de1d640 1 -- 172.21.15.18:0/569355458 learned_addr learned my addr 172.21.15.18:0/569355458 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:51.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.474+0000 7f8f1d61c640 1 --2- 172.21.15.18:0/569355458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 0x558c9eeb7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.476+0000 7f8f1ce1b640 1 -- 172.21.15.18:0/569355458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebbb20 msgr2=0x558c9eed4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:51.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.476+0000 7f8f1ce1b640 1 --2- 172.21.15.18:0/569355458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebbb20 0x558c9eed4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.476+0000 7f8f1ce1b640 1 -- 172.21.15.18:0/569355458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 msgr2=0x558c9eeb7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:51.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.476+0000 7f8f1ce1b640 1 --2- 172.21.15.18:0/569355458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 0x558c9eeb7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.476+0000 7f8f1ce1b640 1 -- 172.21.15.18:0/569355458 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c9eebc450 con 0x558c9eebc970 2024-09-19T09:59:51.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.479+0000 7f8f1ce1b640 1 --2- 172.21.15.18:0/569355458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 0x558c9eed3d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x558c9eeba480 tx=0x7f8f08037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64d9ed4d2b6eaef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.479+0000 7f8f027fc640 1 -- 172.21.15.18:0/569355458 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08040070 con 0x558c9eebc970 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.479+0000 7f8f027fc640 1 -- 172.21.15.18:0/569355458 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f08054070 con 0x558c9eebc970 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.479+0000 7f8f027fc640 1 -- 172.21.15.18:0/569355458 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0803c970 con 0x558c9eebc970 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.480+0000 7f8f21c59740 1 -- 172.21.15.18:0/569355458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 msgr2=0x558c9eed3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.480+0000 7f8f21c59740 1 --2- 172.21.15.18:0/569355458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 0x558c9eed3d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x558c9eeba480 tx=0x7f8f08037000 comp rx=0 tx=0).stop 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.481+0000 7f8f21c59740 1 -- 172.21.15.18:0/569355458 shutdown_connections 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.481+0000 7f8f21c59740 1 --2- 172.21.15.18:0/569355458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebbb20 0x558c9eed4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.481+0000 7f8f21c59740 1 --2- 172.21.15.18:0/569355458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 0x558c9eed3d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.481+0000 7f8f21c59740 1 --2- 172.21.15.18:0/569355458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 0x558c9eeb7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.481+0000 7f8f21c59740 1 -- 172.21.15.18:0/569355458 >> 172.21.15.18:0/569355458 conn(0x558c9eeadd20 msgr2=0x558c9eebb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.481+0000 7f8f21c59740 1 -- 172.21.15.18:0/569355458 shutdown_connections 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.481+0000 7f8f21c59740 1 -- 172.21.15.18:0/569355458 wait complete. 2024-09-19T09:59:51.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.481+0000 7f8f21c59740 1 -- start start 2024-09-19T09:59:51.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.482+0000 7f8f21c59740 1 Processor -- start 2024-09-19T09:59:51.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.482+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 0x558c9eec2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.482+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebbb20 0x558c9eec33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.482+0000 7f8f21c59740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 0x558c9ef2fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.482+0000 7f8f21c59740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00f7e0 con 0x558c9eeb1790 2024-09-19T09:59:51.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.482+0000 7f8f21c59740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00f110 con 0x558c9eebbb20 2024-09-19T09:59:51.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.482+0000 7f8f21c59740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc00c350 con 0x558c9eebc970 2024-09-19T09:59:51.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.482+0000 7f8f21c59740 10 client.0 _ll_register_callbacks cb 0x7f8f08009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:51.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.483+0000 7f8f1d61c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 0x558c9eec2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.483+0000 7f8f1d61c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 0x558c9eec2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44962/0 (socket says 172.21.15.18:44962) 2024-09-19T09:59:51.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.483+0000 7f8f1d61c640 1 -- 172.21.15.18:0/3141170551 learned_addr learned my addr 172.21.15.18:0/3141170551 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:51.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.483+0000 7f8f1de1d640 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 0x558c9ef2fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.486+0000 7f8f1d61c640 1 -- 172.21.15.18:0/3141170551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 msgr2=0x558c9ef2fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:51.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.486+0000 7f8f1d61c640 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 0x558c9ef2fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.486+0000 7f8f1d61c640 1 -- 172.21.15.18:0/3141170551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebbb20 msgr2=0x558c9eec33c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:59:51.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.486+0000 7f8f1d61c640 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebbb20 0x558c9eec33c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.486+0000 7f8f1d61c640 1 -- 172.21.15.18:0/3141170551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c9ee7fde0 con 0x558c9eeb1790 2024-09-19T09:59:51.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.486+0000 7f8f1d61c640 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 0x558c9eec2e80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8f140a5300 tx=0x7f8f140ce010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eeab984acc92139 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:51.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.487+0000 7f8ef7fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:59:51.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.487+0000 7f8ef7fff640 1 -- 172.21.15.18:0/3141170551 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140ce1b0 con 0x558c9eeb1790 2024-09-19T09:59:51.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.487+0000 7f8f21c59740 1 -- 172.21.15.18:0/3141170551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f08054070 con 0x558c9eeb1790 2024-09-19T09:59:51.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.487+0000 7f8ef7fff640 1 -- 172.21.15.18:0/3141170551 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8f14099230 con 0x558c9eeb1790 2024-09-19T09:59:51.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.490+0000 7f8ef7fff640 1 -- 172.21.15.18:0/3141170551 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f140aa050 con 0x558c9eeb1790 2024-09-19T09:59:51.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.490+0000 7f8f21c59740 10 client.17235 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:51.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.490+0000 7f8f21c59740 1 -- 172.21.15.18:0/3141170551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c9ef37570 con 0x558c9eeb1790 2024-09-19T09:59:51.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.491+0000 7f8ef7fff640 1 -- 172.21.15.18:0/3141170551 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f08054070 con 0x558c9eeb1790 2024-09-19T09:59:51.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.493+0000 7f8ef7fff640 1 -- 172.21.15.18:0/3141170551 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f140ad020 con 0x558c9eeb1790 2024-09-19T09:59:51.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.493+0000 7f8f21c59740 10 client.17235 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:51.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.493+0000 7f8f21c59740 10 client.17235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:51.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.493+0000 7f8f21c59740 20 client.17235 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:51.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.493+0000 7f8f21c59740 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c9ef37d40 0x558c9ef3a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:51.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.493+0000 7f8f21c59740 4 client.17235 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:59:51.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.493+0000 7f8f21c59740 1 -- 172.21.15.18:0/3141170551 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c9ee1ed60 con 0x558c9ef37d40 2024-09-19T09:59:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.512+0000 7f8f1ce1b640 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c9ef37d40 0x558c9ef3a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:51.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.525+0000 7f8ef7fff640 10 client.17235 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:51.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.525+0000 7f8f1ce1b640 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c9ef37d40 0x558c9ef3a180 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=494e55b9c68405e9 server_cookie=1832f83913c49b7 in_seq=0 out_seq=0 2024-09-19T09:59:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8ef7fff640 1 -- 172.21.15.18:0/3141170551 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558c9ee1ed60 con 0x558c9ef37d40 2024-09-19T09:59:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8ef7fff640 10 client.17235 handle_command_reply: tid=0 2024-09-19T09:59:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8f21c59740 1 client.17235 shutdown 2024-09-19T09:59:51.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8f21c59740 1 -- 172.21.15.18:0/3141170551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 msgr2=0x558c9eec2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:51.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8f21c59740 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 0x558c9eec2e80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8f140a5300 tx=0x7f8f140ce010 comp rx=0 tx=0).stop 2024-09-19T09:59:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8f21c59740 1 -- 172.21.15.18:0/3141170551 shutdown_connections 2024-09-19T09:59:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8f21c59740 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c9ef37d40 0x558c9ef3a180 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8f21c59740 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c9eebc970 0x558c9ef2fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8f21c59740 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c9eebbb20 0x558c9eec33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8f21c59740 1 --2- 172.21.15.18:0/3141170551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c9eeb1790 0x558c9eec2e80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8f21c59740 1 -- 172.21.15.18:0/3141170551 >> 172.21.15.18:0/3141170551 conn(0x558c9eeadd20 msgr2=0x558c9eeac6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.530+0000 7f8ef7fff640 0 client.17235 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.532+0000 7f8f21c59740 1 -- 172.21.15.18:0/3141170551 shutdown_connections 2024-09-19T09:59:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.532+0000 7f8f21c59740 1 -- 172.21.15.18:0/3141170551 wait complete. 2024-09-19T09:59:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.532+0000 7f8f21c59740 20 client.17235 trim_cache size 0 max 16384 2024-09-19T09:59:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.534+0000 7f8f03fff640 1 -- 172.21.15.18:0/2499705473 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f040a3340 msgr2=0x7f8f040a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.534+0000 7f8f03fff640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f040a3340 0x7f8f040a5800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009c10 tx=0x7f8f10004900 comp rx=0 tx=0).stop 2024-09-19T09:59:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.534+0000 7f8f03fff640 1 -- 172.21.15.18:0/2499705473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f181083f0 msgr2=0x7f8f181a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:51.538 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:59:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T09:59:51.539 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T09:59:51.539 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:59:51.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.534+0000 7f8f03fff640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f181083f0 0x7f8f181a46a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400d950 tx=0x7f8f1400de10 comp rx=0 tx=0).stop 2024-09-19T09:59:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.535+0000 7f8f03fff640 1 -- 172.21.15.18:0/2499705473 shutdown_connections 2024-09-19T09:59:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.535+0000 7f8f03fff640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8f040a3340 0x7f8f040a5800 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.535+0000 7f8f03fff640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f1810d520 0x7f8f1819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.535+0000 7f8f03fff640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f18108da0 0x7f8f181a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.535+0000 7f8f03fff640 1 --2- 172.21.15.18:0/2499705473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f181083f0 0x7f8f181a46a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.535+0000 7f8f03fff640 1 -- 172.21.15.18:0/2499705473 >> 172.21.15.18:0/2499705473 conn(0x7f8f18077af0 msgr2=0x7f8f18078e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.538+0000 7f8f03fff640 1 -- 172.21.15.18:0/2499705473 shutdown_connections 2024-09-19T09:59:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:51.538+0000 7f8f03fff640 1 -- 172.21.15.18:0/2499705473 wait complete. 2024-09-19T09:59:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:52 smithi018 ceph-mon[30956]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 860 MiB/s wr, 1.76k op/s 2024-09-19T09:59:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:52 smithi018 ceph-mon[30956]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T09:59:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:52 smithi018 ceph-mon[30956]: Unable to set osd_memory_target on smithi018 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T09:59:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:59:52.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:59:52.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:52 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:59:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:52 smithi049 ceph-mon[34858]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 860 MiB/s wr, 1.76k op/s 2024-09-19T09:59:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:52 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:52 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:52 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:52 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:52 smithi049 ceph-mon[34858]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T09:59:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:52 smithi049 ceph-mon[34858]: Unable to set osd_memory_target on smithi018 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T09:59:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:52 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:59:52.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:52 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:59:52.402 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:52 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:59:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:52 smithi162 ceph-mon[35174]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 860 MiB/s wr, 1.76k op/s 2024-09-19T09:59:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:52 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:52 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:52 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:52 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:59:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:52 smithi162 ceph-mon[35174]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T09:59:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:52 smithi162 ceph-mon[35174]: Unable to set osd_memory_target on smithi018 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T09:59:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:52 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:59:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:52 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:59:52.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:52 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T09:59:53.134 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:59:53.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:59:53.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.513+0000 7efe0224c640 1 -- 172.21.15.18:0/2537115161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc10d9b0 msgr2=0x7efdfc115510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:53.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.514+0000 7efe0224c640 1 --2- 172.21.15.18:0/2537115161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc10d9b0 0x7efdfc115510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009860 tx=0x7efdf402a380 comp rx=0 tx=0).stop 2024-09-19T09:59:53.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.514+0000 7efe0224c640 1 -- 172.21.15.18:0/2537115161 shutdown_connections 2024-09-19T09:59:53.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.514+0000 7efe0224c640 1 --2- 172.21.15.18:0/2537115161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc10d9b0 0x7efdfc115510 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.514+0000 7efe0224c640 1 --2- 172.21.15.18:0/2537115161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdfc10ef30 0x7efdfc10d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.514+0000 7efe0224c640 1 --2- 172.21.15.18:0/2537115161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc10e580 0x7efdfc10e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.514+0000 7efe0224c640 1 -- 172.21.15.18:0/2537115161 >> 172.21.15.18:0/2537115161 conn(0x7efdfc06e140 msgr2=0x7efdfc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:53.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.520+0000 7efdfaffd640 1 --2- 172.21.15.18:0/2537115161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdfc10ef30 0x7efdfc10d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:59:53.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.522+0000 7efe0224c640 1 -- 172.21.15.18:0/2537115161 shutdown_connections 2024-09-19T09:59:53.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.522+0000 7efe0224c640 1 -- 172.21.15.18:0/2537115161 wait complete. 2024-09-19T09:59:53.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.524+0000 7efe0224c640 1 Processor -- start 2024-09-19T09:59:53.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.524+0000 7efe0224c640 1 -- start start 2024-09-19T09:59:53.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.525+0000 7efe0224c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc10d9b0 0x7efdfc1a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.526+0000 7efe0224c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdfc10e580 0x7efdfc1a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.526+0000 7efe0224c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc19e920 0x7efdfc19edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.526+0000 7efe0224c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1185d0 con 0x7efdfc10e580 2024-09-19T09:59:53.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.526+0000 7efdfb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc10d9b0 0x7efdfc1a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.526+0000 7efdfb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc10d9b0 0x7efdfc1a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:54106/0 (socket says 172.21.15.18:54106) 2024-09-19T09:59:53.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.526+0000 7efdfb7fe640 1 -- 172.21.15.18:0/2875971890 learned_addr learned my addr 172.21.15.18:0/2875971890 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:53.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.526+0000 7efe0224c640 1 -- 172.21.15.18:0/2875971890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc118450 con 0x7efdfc10d9b0 2024-09-19T09:59:53.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.527+0000 7efe0224c640 1 -- 172.21.15.18:0/2875971890 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc118750 con 0x7efdfc19e920 2024-09-19T09:59:53.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.527+0000 7efdfbfff640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc19e920 0x7efdfc19edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.528+0000 7efdfb7fe640 1 -- 172.21.15.18:0/2875971890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc19e920 msgr2=0x7efdfc19edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:53.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.528+0000 7efdfb7fe640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc19e920 0x7efdfc19edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.528+0000 7efdfb7fe640 1 -- 172.21.15.18:0/2875971890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdfc10e580 msgr2=0x7efdfc1a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:53.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.528+0000 7efdfb7fe640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdfc10e580 0x7efdfc1a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.528+0000 7efdfb7fe640 1 -- 172.21.15.18:0/2875971890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc19f440 con 0x7efdfc10d9b0 2024-09-19T09:59:53.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.528+0000 7efdfb7fe640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc10d9b0 0x7efdfc1a4760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efdec00cce0 tx=0x7efdec00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:53.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.530+0000 7efdf8ff9640 1 -- 172.21.15.18:0/2875971890 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec00f650 con 0x7efdfc10d9b0 2024-09-19T09:59:53.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.530+0000 7efe0224c640 1 -- 172.21.15.18:0/2875971890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc19f730 con 0x7efdfc10d9b0 2024-09-19T09:59:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.530+0000 7efe0224c640 1 -- 172.21.15.18:0/2875971890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc1ab9c0 con 0x7efdfc10d9b0 2024-09-19T09:59:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.530+0000 7efdf8ff9640 1 -- 172.21.15.18:0/2875971890 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdec00fcd0 con 0x7efdfc10d9b0 2024-09-19T09:59:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.530+0000 7efdf8ff9640 1 -- 172.21.15.18:0/2875971890 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec018cd0 con 0x7efdfc10d9b0 2024-09-19T09:59:53.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.536+0000 7efe04625740 1 Processor -- start 2024-09-19T09:59:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.538+0000 7efe04625740 1 -- start start 2024-09-19T09:59:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.539+0000 7efe04625740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 0x55cb63102c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.539+0000 7efe04625740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb6310d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.539+0000 7efe04625740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb6310da30 0x55cb6310fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.540+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 0x55cb63102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.540+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 0x55cb63102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:54112/0 (socket says 172.21.15.18:54112) 2024-09-19T09:59:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.540+0000 7efdfbfff640 1 -- 172.21.15.18:0/1430195288 learned_addr learned my addr 172.21.15.18:0/1430195288 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.540+0000 7efe04625740 1 -- 172.21.15.18:0/1430195288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cb63067160 con 0x55cb6310da30 2024-09-19T09:59:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.540+0000 7efe04625740 1 -- 172.21.15.18:0/1430195288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cb6300e720 con 0x55cb63102850 2024-09-19T09:59:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.540+0000 7efdfb7fe640 1 --2- 172.21.15.18:0/1430195288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb6310d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.540+0000 7efe04625740 1 -- 172.21.15.18:0/1430195288 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cb63063120 con 0x55cb63103170 2024-09-19T09:59:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.541+0000 7efdf8ff9640 1 -- 172.21.15.18:0/2875971890 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efdec00f7f0 con 0x7efdfc10d9b0 2024-09-19T09:59:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.541+0000 7efdfbfff640 1 -- 172.21.15.18:0/1430195288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 msgr2=0x55cb6310d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.541+0000 7efdfbfff640 1 --2- 172.21.15.18:0/1430195288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb6310d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.541+0000 7efdfbfff640 1 -- 172.21.15.18:0/1430195288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb6310da30 msgr2=0x55cb6310fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.541+0000 7efdfbfff640 1 --2- 172.21.15.18:0/1430195288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb6310da30 0x55cb6310fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.541+0000 7efdfbfff640 1 -- 172.21.15.18:0/1430195288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb62dd8ba0 con 0x55cb63102850 2024-09-19T09:59:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.541+0000 7efdfbfff640 1 --2- 172.21.15.18:0/1430195288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 0x55cb63102c30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efdf402a970 tx=0x7efdf4009490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81ed78a39362da94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.543+0000 7efdf8ff9640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efde40a33c0 0x7efde40a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.544+0000 7efdfb7fe640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efde40a33c0 0x7efde40a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.545+0000 7efde1ffb640 1 -- 172.21.15.18:0/1430195288 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4041020 con 0x55cb63102850 2024-09-19T09:59:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.545+0000 7efde1ffb640 1 -- 172.21.15.18:0/1430195288 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdf4004040 con 0x55cb63102850 2024-09-19T09:59:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.545+0000 7efde1ffb640 1 -- 172.21.15.18:0/1430195288 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4037040 con 0x55cb63102850 2024-09-19T09:59:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.545+0000 7efdf8ff9640 1 -- 172.21.15.18:0/2875971890 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efdec0cfc80 con 0x7efdfc10d9b0 2024-09-19T09:59:53.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.546+0000 7efdfb7fe640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efde40a33c0 0x7efde40a5880 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efdec09c200 tx=0x7efdec000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:53.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.546+0000 7efe04625740 1 -- 172.21.15.18:0/1430195288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 msgr2=0x55cb63102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:53.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.546+0000 7efe04625740 1 --2- 172.21.15.18:0/1430195288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 0x55cb63102c30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efdf402a970 tx=0x7efdf4009490 comp rx=0 tx=0).stop 2024-09-19T09:59:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.547+0000 7efe04625740 1 -- 172.21.15.18:0/1430195288 shutdown_connections 2024-09-19T09:59:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.547+0000 7efe04625740 1 --2- 172.21.15.18:0/1430195288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb6310da30 0x55cb6310fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.547+0000 7efe04625740 1 --2- 172.21.15.18:0/1430195288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb6310d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.547+0000 7efe04625740 1 --2- 172.21.15.18:0/1430195288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 0x55cb63102c30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.547+0000 7efe04625740 1 -- 172.21.15.18:0/1430195288 >> 172.21.15.18:0/1430195288 conn(0x55cb630fede0 msgr2=0x55cb630ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.547+0000 7efe04625740 1 -- 172.21.15.18:0/1430195288 shutdown_connections 2024-09-19T09:59:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.547+0000 7efe04625740 1 -- 172.21.15.18:0/1430195288 wait complete. 2024-09-19T09:59:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.548+0000 7efe04625740 1 -- start start 2024-09-19T09:59:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.549+0000 7efe04625740 1 Processor -- start 2024-09-19T09:59:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.550+0000 7efe04625740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 0x55cb6310a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.550+0000 7efe04625740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb6310ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.551+0000 7efe04625740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb6310da30 0x55cb6310b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.551+0000 7efe04625740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cb63110600 con 0x55cb6310da30 2024-09-19T09:59:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.551+0000 7efe04625740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cb62fef900 con 0x55cb63102850 2024-09-19T09:59:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.551+0000 7efe04625740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cb63110780 con 0x55cb63103170 2024-09-19T09:59:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.551+0000 7efe04625740 10 client.0 _ll_register_callbacks cb 0x55cb62fed780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.552+0000 7efdfaffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb6310ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.552+0000 7efdfaffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb6310ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:34006/0 (socket says 172.21.15.18:34006) 2024-09-19T09:59:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.552+0000 7efdfaffd640 1 -- 172.21.15.18:0/218659116 learned_addr learned my addr 172.21.15.18:0/218659116 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.553+0000 7efdfbfff640 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 0x55cb6310a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.554+0000 7efdfaffd640 1 -- 172.21.15.18:0/218659116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 msgr2=0x55cb6310a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.554+0000 7efdfaffd640 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 0x55cb6310a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.554+0000 7efdfaffd640 1 -- 172.21.15.18:0/218659116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb6310da30 msgr2=0x55cb6310b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.554+0000 7efdfaffd640 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb6310da30 0x55cb6310b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.554+0000 7efdfaffd640 1 -- 172.21.15.18:0/218659116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb6302fc50 con 0x55cb63103170 2024-09-19T09:59:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.555+0000 7efdfaffd640 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb6310ae80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdfc073830 tx=0x7efdf000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7fdbb0c86124108 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:53.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.555+0000 7efddaffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:59:53.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.556+0000 7efddaffd640 1 -- 172.21.15.18:0/218659116 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf0005220 con 0x55cb63103170 2024-09-19T09:59:53.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.556+0000 7efddaffd640 1 -- 172.21.15.18:0/218659116 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efdf00053c0 con 0x55cb63103170 2024-09-19T09:59:53.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.556+0000 7efe04625740 1 -- 172.21.15.18:0/218659116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdf4004040 con 0x55cb63103170 2024-09-19T09:59:53.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.556+0000 7efddaffd640 1 -- 172.21.15.18:0/218659116 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efdf0005600 con 0x55cb63103170 2024-09-19T09:59:53.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.556+0000 7efe04625740 10 client.26674 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:53.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.557+0000 7efe04625740 1 -- 172.21.15.18:0/218659116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb6311c3c0 con 0x55cb63103170 2024-09-19T09:59:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.558+0000 7efddaffd640 1 -- 172.21.15.18:0/218659116 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdf0004c80 con 0x55cb63103170 2024-09-19T09:59:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.558+0000 7efddaffd640 1 -- 172.21.15.18:0/218659116 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efdf0018400 con 0x55cb63103170 2024-09-19T09:59:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.559+0000 7efe04625740 10 client.26674 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.559+0000 7efe04625740 10 client.26674 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:59:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.559+0000 7efe04625740 20 client.26674 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.560+0000 7efe04625740 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb6311d820 0x55cb6311fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.560+0000 7efe04625740 4 client.26674 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.560+0000 7efe04625740 1 -- 172.21.15.18:0/218659116 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efdf4004040 con 0x55cb6311d820 2024-09-19T09:59:53.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.565+0000 7efdfbfff640 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb6311d820 0x55cb6311fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.586+0000 7efddaffd640 10 client.26674 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:53.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.586+0000 7efdfbfff640 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb6311d820 0x55cb6311fc40 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=750645118929abd7 server_cookie=a4a0861abb090937 in_seq=0 out_seq=0 2024-09-19T09:59:53.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.588+0000 7efddaffd640 1 -- 172.21.15.18:0/218659116 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7efdf4004040 con 0x55cb6311d820 2024-09-19T09:59:53.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.589+0000 7efddaffd640 10 client.26674 handle_command_reply: tid=0 2024-09-19T09:59:53.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.589+0000 7efe04625740 1 client.26674 shutdown 2024-09-19T09:59:53.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.589+0000 7efe04625740 1 -- 172.21.15.18:0/218659116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 msgr2=0x55cb6310ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:53.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.589+0000 7efe04625740 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb6310ae80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdfc073830 tx=0x7efdf000c6a0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.591+0000 7efe04625740 1 -- 172.21.15.18:0/218659116 shutdown_connections 2024-09-19T09:59:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.591+0000 7efe04625740 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb6311d820 0x55cb6311fc40 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.591+0000 7efe04625740 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb6310da30 0x55cb6310b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.591+0000 7efe04625740 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb6310ae80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.591+0000 7efe04625740 1 --2- 172.21.15.18:0/218659116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb63102850 0x55cb6310a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.591+0000 7efe04625740 1 -- 172.21.15.18:0/218659116 >> 172.21.15.18:0/218659116 conn(0x55cb630fede0 msgr2=0x55cb63104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.591+0000 7efddaffd640 0 client.26674 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.591+0000 7efe04625740 1 -- 172.21.15.18:0/218659116 shutdown_connections 2024-09-19T09:59:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.591+0000 7efe04625740 1 -- 172.21.15.18:0/218659116 wait complete. 2024-09-19T09:59:53.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.595+0000 7efe04625740 20 client.26674 trim_cache size 0 max 16384 2024-09-19T09:59:53.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.641+0000 7efe04625740 1 Processor -- start 2024-09-19T09:59:53.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.642+0000 7efe04625740 1 -- start start 2024-09-19T09:59:53.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.642+0000 7efe04625740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb63102850 0x55cb6310b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.642+0000 7efe04625740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb630fddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.643+0000 7efe04625740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb630fe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.643+0000 7efe04625740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efde800e440 con 0x55cb63102850 2024-09-19T09:59:53.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.643+0000 7efe04625740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efde800ff80 con 0x55cb6310da30 2024-09-19T09:59:53.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.643+0000 7efe04625740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efde800eb10 con 0x55cb63103170 2024-09-19T09:59:53.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.644+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb630fe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.644+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb630fe2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:54134/0 (socket says 172.21.15.18:54134) 2024-09-19T09:59:53.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.644+0000 7efdfbfff640 1 -- 172.21.15.18:0/2186212528 learned_addr learned my addr 172.21.15.18:0/2186212528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:53.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.644+0000 7efdfaffd640 1 --2- 172.21.15.18:0/2186212528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb630fddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.644+0000 7efdfbfff640 1 -- 172.21.15.18:0/2186212528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 msgr2=0x55cb630fddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:53.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.644+0000 7efdfbfff640 1 --2- 172.21.15.18:0/2186212528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb630fddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.644+0000 7efdfbfff640 1 -- 172.21.15.18:0/2186212528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb63102850 msgr2=0x55cb6310b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:53.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.644+0000 7efdfbfff640 1 --2- 172.21.15.18:0/2186212528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb63102850 0x55cb6310b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.644+0000 7efdfbfff640 1 -- 172.21.15.18:0/2186212528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb63102680 con 0x55cb6310da30 2024-09-19T09:59:53.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.645+0000 7efdfbfff640 1 --2- 172.21.15.18:0/2186212528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb630fe2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000c00 tx=0x7efdf4003730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebd0a305edbef5c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.645+0000 7efde17fa640 1 -- 172.21.15.18:0/2186212528 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4037030 con 0x55cb6310da30 2024-09-19T09:59:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.645+0000 7efde17fa640 1 -- 172.21.15.18:0/2186212528 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdf4004270 con 0x55cb6310da30 2024-09-19T09:59:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.645+0000 7efde17fa640 1 -- 172.21.15.18:0/2186212528 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4041040 con 0x55cb6310da30 2024-09-19T09:59:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.646+0000 7efe04625740 1 -- 172.21.15.18:0/2186212528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 msgr2=0x55cb630fe2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.647+0000 7efe04625740 1 --2- 172.21.15.18:0/2186212528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb630fe2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000c00 tx=0x7efdf4003730 comp rx=0 tx=0).stop 2024-09-19T09:59:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.647+0000 7efe04625740 1 -- 172.21.15.18:0/2186212528 shutdown_connections 2024-09-19T09:59:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.647+0000 7efe04625740 1 --2- 172.21.15.18:0/2186212528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb630fe2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.647+0000 7efe04625740 1 --2- 172.21.15.18:0/2186212528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb630fddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.647+0000 7efe04625740 1 --2- 172.21.15.18:0/2186212528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb63102850 0x55cb6310b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.647+0000 7efe04625740 1 -- 172.21.15.18:0/2186212528 >> 172.21.15.18:0/2186212528 conn(0x55cb630fede0 msgr2=0x55cb630fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.647+0000 7efe04625740 1 -- 172.21.15.18:0/2186212528 shutdown_connections 2024-09-19T09:59:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.648+0000 7efe04625740 1 -- 172.21.15.18:0/2186212528 wait complete. 2024-09-19T09:59:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.648+0000 7efe04625740 1 -- start start 2024-09-19T09:59:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.649+0000 7efe04625740 1 Processor -- start 2024-09-19T09:59:53.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.650+0000 7efe04625740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb63102850 0x55cb63111b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.651+0000 7efe04625740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb63112080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.651+0000 7efe04625740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb6318fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.651+0000 7efe04625740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efde800f8b0 con 0x55cb63102850 2024-09-19T09:59:53.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.651+0000 7efe04625740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efde800f1e0 con 0x55cb6310da30 2024-09-19T09:59:53.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.651+0000 7efe04625740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efde800c420 con 0x55cb63103170 2024-09-19T09:59:53.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.652+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb6318fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.652+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb6318fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:54148/0 (socket says 172.21.15.18:54148) 2024-09-19T09:59:53.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.652+0000 7efdfbfff640 1 -- 172.21.15.18:0/2207148463 learned_addr learned my addr 172.21.15.18:0/2207148463 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:53.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.653+0000 7efe04625740 10 client.0 _ll_register_callbacks cb 0x7efdf0005df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:53.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.653+0000 7efdfbfff640 1 -- 172.21.15.18:0/2207148463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 msgr2=0x55cb63112080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:53.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.653+0000 7efdfaffd640 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb63112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.653+0000 7efdfbfff640 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb63112080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.653+0000 7efdfbfff640 1 -- 172.21.15.18:0/2207148463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb63102850 msgr2=0x55cb63111b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:53.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.653+0000 7efdfbfff640 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb63102850 0x55cb63111b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:53.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.653+0000 7efdfbfff640 1 -- 172.21.15.18:0/2207148463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb630fa3f0 con 0x55cb6310da30 2024-09-19T09:59:53.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.656+0000 7efdfbfff640 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb6318fcb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efdf4031000 tx=0x7efdf4009740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adbe70792c9d2d62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:53.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.656+0000 7efddaffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:53.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.657+0000 7efddaffd640 1 -- 172.21.15.18:0/2207148463 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4055060 con 0x55cb6310da30 2024-09-19T09:59:53.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.658+0000 7efddaffd640 1 -- 172.21.15.18:0/2207148463 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efdf4005440 con 0x55cb6310da30 2024-09-19T09:59:53.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.658+0000 7efe04625740 1 -- 172.21.15.18:0/2207148463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdf4004270 con 0x55cb6310da30 2024-09-19T09:59:53.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.658+0000 7efddaffd640 1 -- 172.21.15.18:0/2207148463 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efdf4037070 con 0x55cb6310da30 2024-09-19T09:59:53.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.658+0000 7efe04625740 10 client.26702 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:53.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.658+0000 7efe04625740 1 -- 172.21.15.18:0/2207148463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb631910f0 con 0x55cb6310da30 2024-09-19T09:59:53.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.661+0000 7efddaffd640 1 -- 172.21.15.18:0/2207148463 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdf4005640 con 0x55cb6310da30 2024-09-19T09:59:53.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.661+0000 7efddaffd640 1 -- 172.21.15.18:0/2207148463 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efdf40037a0 con 0x55cb6310da30 2024-09-19T09:59:53.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.663+0000 7efe04625740 10 client.26702 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:53.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.663+0000 7efe04625740 10 client.26702 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T09:59:53.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.663+0000 7efe04625740 20 client.26702 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:53.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.663+0000 7efe04625740 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb631912c0 0x55cb631936b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:53.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.663+0000 7efe04625740 4 client.26702 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T09:59:53.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.663+0000 7efe04625740 1 -- 172.21.15.18:0/2207148463 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x7efdf4004270 con 0x55cb631912c0 2024-09-19T09:59:53.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.665+0000 7efdfaffd640 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb631912c0 0x55cb631936b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:53.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.667+0000 7efdfaffd640 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb631912c0 0x55cb631936b0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e39478794294798d server_cookie=76efa1b28104d757 in_seq=0 out_seq=0 2024-09-19T09:59:53.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:53.667+0000 7efddaffd640 10 client.26702 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:54.247 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:59:54.478 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:54 smithi018 ceph-mon[30956]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 891 MiB/s wr, 1.84k op/s 2024-09-19T09:59:54.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:54 smithi049 ceph-mon[34858]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 891 MiB/s wr, 1.84k op/s 2024-09-19T09:59:54.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:54 smithi162 ceph-mon[35174]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 891 MiB/s wr, 1.84k op/s 2024-09-19T09:59:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.377+0000 7fd1375ed640 1 -- 172.21.15.18:0/1033192728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd13006ee90 msgr2=0x7fd13007a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.377+0000 7fd1375ed640 1 --2- 172.21.15.18:0/1033192728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd13006ee90 0x7fd13007a450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd120007380 tx=0x7fd12002b080 comp rx=0 tx=0).stop 2024-09-19T09:59:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.377+0000 7fd1375ed640 1 -- 172.21.15.18:0/1033192728 shutdown_connections 2024-09-19T09:59:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.377+0000 7fd1375ed640 1 --2- 172.21.15.18:0/1033192728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd13006ee90 0x7fd13007a450 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.377+0000 7fd1375ed640 1 --2- 172.21.15.18:0/1033192728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd13006e4f0 0x7fd13006e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.377+0000 7fd1375ed640 1 --2- 172.21.15.18:0/1033192728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13010e150 0x7fd13010e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:55.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.377+0000 7fd1375ed640 1 -- 172.21.15.18:0/1033192728 >> 172.21.15.18:0/1033192728 conn(0x7fd130073210 msgr2=0x7fd130073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:55.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.378+0000 7fd1375ed640 1 -- 172.21.15.18:0/1033192728 shutdown_connections 2024-09-19T09:59:55.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.378+0000 7fd1375ed640 1 -- 172.21.15.18:0/1033192728 wait complete. 2024-09-19T09:59:55.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.380+0000 7fd1375ed640 1 Processor -- start 2024-09-19T09:59:55.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.380+0000 7fd1375ed640 1 -- start start 2024-09-19T09:59:55.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.380+0000 7fd1375ed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13006e4f0 0x7fd130084ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:55.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.386+0000 7fd1375ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd13010e150 0x7fd13007eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:55.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.386+0000 7fd1375ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd13007f090 0x7fd13007f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:55.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.386+0000 7fd1375ed640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd13007d820 con 0x7fd13010e150 2024-09-19T09:59:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.386+0000 7fd1375ed640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd13007d6a0 con 0x7fd13007f090 2024-09-19T09:59:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.386+0000 7fd1375ed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd13007d9a0 con 0x7fd13006e4f0 2024-09-19T09:59:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.387+0000 7fd135389640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13006e4f0 0x7fd130084ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.387+0000 7fd135389640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13006e4f0 0x7fd130084ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:34030/0 (socket says 172.21.15.18:34030) 2024-09-19T09:59:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.387+0000 7fd135389640 1 -- 172.21.15.18:0/3380036423 learned_addr learned my addr 172.21.15.18:0/3380036423 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:55.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.392+0000 7fd135b8a640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd13007f090 0x7fd13007f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:55.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.397+0000 7fd135389640 1 -- 172.21.15.18:0/3380036423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd13007f090 msgr2=0x7fd13007f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:55.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.397+0000 7fd135389640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd13007f090 0x7fd13007f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:55.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.397+0000 7fd135389640 1 -- 172.21.15.18:0/3380036423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd13010e150 msgr2=0x7fd13007eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:55.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.397+0000 7fd135389640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd13010e150 0x7fd13007eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:55.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.397+0000 7fd135389640 1 -- 172.21.15.18:0/3380036423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd130136ed0 con 0x7fd13006e4f0 2024-09-19T09:59:55.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.407+0000 7fd135389640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13006e4f0 0x7fd130084ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00c8c0 tx=0x7fd12c00cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:55.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.425+0000 7fd1267fc640 1 -- 172.21.15.18:0/3380036423 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c004220 con 0x7fd13006e4f0 2024-09-19T09:59:55.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.425+0000 7fd1375ed640 1 -- 172.21.15.18:0/3380036423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1301371c0 con 0x7fd13006e4f0 2024-09-19T09:59:55.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.425+0000 7fd1375ed640 1 -- 172.21.15.18:0/3380036423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd130137700 con 0x7fd13006e4f0 2024-09-19T09:59:55.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.431+0000 7fd1267fc640 1 -- 172.21.15.18:0/3380036423 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd12c0043c0 con 0x7fd13006e4f0 2024-09-19T09:59:55.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.431+0000 7fd1267fc640 1 -- 172.21.15.18:0/3380036423 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c004a00 con 0x7fd13006e4f0 2024-09-19T09:59:55.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.443+0000 7fd1375ed640 1 -- 172.21.15.18:0/3380036423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd114005290 con 0x7fd13006e4f0 2024-09-19T09:59:55.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.455+0000 7fd1267fc640 1 -- 172.21.15.18:0/3380036423 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd12c0079b0 con 0x7fd13006e4f0 2024-09-19T09:59:55.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.457+0000 7fd1267fc640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd11c0a33d0 0x7fd11c0a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:55.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.458+0000 7fd134b88640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd11c0a33d0 0x7fd11c0a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:55.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.458+0000 7fd1267fc640 1 -- 172.21.15.18:0/3380036423 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd12c09a360 con 0x7fd13006e4f0 2024-09-19T09:59:55.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.459+0000 7fd1267fc640 1 -- 172.21.15.18:0/3380036423 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd12c01d020 con 0x7fd13006e4f0 2024-09-19T09:59:55.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:55.460+0000 7fd134b88640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd11c0a33d0 0x7fd11c0a5890 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd128005e30 tx=0x7fd128005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:56.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.160+0000 7fd1375ed640 1 -- 172.21.15.18:0/3380036423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd114005580 con 0x7fd13006e4f0 2024-09-19T09:59:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.167+0000 7fd1267fc640 1 -- 172.21.15.18:0/3380036423 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fd12c01d020 con 0x7fd13006e4f0 2024-09-19T09:59:56.175 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:59:56.175 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T09:59:56.175 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:59:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 -- 172.21.15.18:0/3380036423 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd11c0a33d0 msgr2=0x7fd11c0a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd11c0a33d0 0x7fd11c0a5890 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd128005e30 tx=0x7fd128005d80 comp rx=0 tx=0).stop 2024-09-19T09:59:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 -- 172.21.15.18:0/3380036423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13006e4f0 msgr2=0x7fd130084ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13006e4f0 0x7fd130084ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00c8c0 tx=0x7fd12c00cd80 comp rx=0 tx=0).stop 2024-09-19T09:59:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 -- 172.21.15.18:0/3380036423 shutdown_connections 2024-09-19T09:59:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd11c0a33d0 0x7fd11c0a5890 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd13007f090 0x7fd13007f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd13010e150 0x7fd13007eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 --2- 172.21.15.18:0/3380036423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13006e4f0 0x7fd130084ad0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 -- 172.21.15.18:0/3380036423 >> 172.21.15.18:0/3380036423 conn(0x7fd130073210 msgr2=0x7fd1300743f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 -- 172.21.15.18:0/3380036423 shutdown_connections 2024-09-19T09:59:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:56.182+0000 7fd1375ed640 1 -- 172.21.15.18:0/3380036423 wait complete. 2024-09-19T09:59:56.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:56 smithi018 ceph-mon[30956]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 863 MiB/s wr, 1.79k op/s 2024-09-19T09:59:56.601 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:56 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3380036423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:59:56.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:56 smithi049 ceph-mon[34858]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 863 MiB/s wr, 1.79k op/s 2024-09-19T09:59:56.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:56 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3380036423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:59:56.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:56 smithi162 ceph-mon[35174]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 863 MiB/s wr, 1.79k op/s 2024-09-19T09:59:56.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:56 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3380036423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:59:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.919+0000 7ff3d63f6640 1 -- 172.21.15.18:0/197788996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d0077df0 msgr2=0x7ff3d0078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.919+0000 7ff3d63f6640 1 --2- 172.21.15.18:0/197788996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d0077df0 0x7ff3d0078250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff3c001a910 tx=0x7ff3c003b450 comp rx=0 tx=0).stop 2024-09-19T09:59:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.919+0000 7ff3d63f6640 1 -- 172.21.15.18:0/197788996 shutdown_connections 2024-09-19T09:59:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.920+0000 7ff3d63f6640 1 --2- 172.21.15.18:0/197788996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d0078790 0x7ff3d0079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.920+0000 7ff3d63f6640 1 --2- 172.21.15.18:0/197788996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d0077df0 0x7ff3d0078250 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.920+0000 7ff3d63f6640 1 --2- 172.21.15.18:0/197788996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3d0076bb0 0x7ff3d0076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.920+0000 7ff3d63f6640 1 -- 172.21.15.18:0/197788996 >> 172.21.15.18:0/197788996 conn(0x7ff3d00ff4e0 msgr2=0x7ff3d0101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.920+0000 7ff3d63f6640 1 -- 172.21.15.18:0/197788996 shutdown_connections 2024-09-19T09:59:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.920+0000 7ff3d63f6640 1 -- 172.21.15.18:0/197788996 wait complete. 2024-09-19T09:59:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.923+0000 7ff3d63f6640 1 Processor -- start 2024-09-19T09:59:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.930+0000 7ff3d63f6640 1 -- start start 2024-09-19T09:59:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.930+0000 7ff3d63f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3d0076bb0 0x7ff3d0108710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.931+0000 7ff3d63f6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d0077df0 0x7ff3d0108c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.931+0000 7ff3d63f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d0078790 0x7ff3d010fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.931+0000 7ff3d63f6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d0105640 con 0x7ff3d0078790 2024-09-19T09:59:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.931+0000 7ff3d63f6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d01054c0 con 0x7ff3d0076bb0 2024-09-19T09:59:56.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.931+0000 7ff3d63f6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d01057c0 con 0x7ff3d0077df0 2024-09-19T09:59:56.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.932+0000 7ff3d4993640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d0078790 0x7ff3d010fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:56.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.932+0000 7ff3d4993640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d0078790 0x7ff3d010fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55692/0 (socket says 172.21.15.18:55692) 2024-09-19T09:59:56.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.932+0000 7ff3d4993640 1 -- 172.21.15.18:0/1107200061 learned_addr learned my addr 172.21.15.18:0/1107200061 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:56.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.932+0000 7ff3cffff640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3d0076bb0 0x7ff3d0108710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.933+0000 7ff3d4993640 1 -- 172.21.15.18:0/1107200061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d0077df0 msgr2=0x7ff3d0108c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:59:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.933+0000 7ff3d4993640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d0077df0 0x7ff3d0108c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.933+0000 7ff3d4993640 1 -- 172.21.15.18:0/1107200061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3d0076bb0 msgr2=0x7ff3d0108710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.933+0000 7ff3d4993640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3d0076bb0 0x7ff3d0108710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.933+0000 7ff3d4993640 1 -- 172.21.15.18:0/1107200061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d0110330 con 0x7ff3d0078790 2024-09-19T09:59:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.934+0000 7ff3d4993640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d0078790 0x7ff3d010fcc0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400d750 tx=0x7ff3c400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.934+0000 7ff3cd7fa640 1 -- 172.21.15.18:0/1107200061 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4017070 con 0x7ff3d0078790 2024-09-19T09:59:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.934+0000 7ff3cd7fa640 1 -- 172.21.15.18:0/1107200061 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c4005500 con 0x7ff3d0078790 2024-09-19T09:59:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.934+0000 7ff3cd7fa640 1 -- 172.21.15.18:0/1107200061 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4004d90 con 0x7ff3d0078790 2024-09-19T09:59:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.935+0000 7ff3d63f6640 1 -- 172.21.15.18:0/1107200061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d0110620 con 0x7ff3d0078790 2024-09-19T09:59:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.935+0000 7ff3d63f6640 1 -- 172.21.15.18:0/1107200061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d0110b20 con 0x7ff3d0078790 2024-09-19T09:59:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.940+0000 7ff3d926b740 1 Processor -- start 2024-09-19T09:59:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.941+0000 7ff3d926b740 1 -- start start 2024-09-19T09:59:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.941+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef44279a0 0x558ef4427da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.941+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef44282e0 0x558ef442cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.941+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef442d370 0x558ef442f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.941+0000 7ff3d926b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558ef438b2f0 con 0x558ef44282e0 2024-09-19T09:59:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.941+0000 7ff3d926b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558ef4333270 con 0x558ef442d370 2024-09-19T09:59:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.941+0000 7ff3d926b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558ef43872b0 con 0x558ef44279a0 2024-09-19T09:59:56.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.949+0000 7ff3cd7fa640 1 -- 172.21.15.18:0/1107200061 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff3c4009bd0 con 0x7ff3d0078790 2024-09-19T09:59:56.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.951+0000 7ff3cd7fa640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff3b80a34b0 0x7ff3b80a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.953+0000 7ff3d4993640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff3b80a34b0 0x7ff3b80a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.956+0000 7ff3cd7fa640 1 -- 172.21.15.18:0/1107200061 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff3c40046c0 con 0x7ff3d0078790 2024-09-19T09:59:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.957+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef44282e0 0x558ef442cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:56.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.957+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef44282e0 0x558ef442cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55696/0 (socket says 172.21.15.18:55696) 2024-09-19T09:59:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.957+0000 7ff3cffff640 1 -- 172.21.15.18:0/2145108442 learned_addr learned my addr 172.21.15.18:0/2145108442 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.957+0000 7ff3cffff640 1 -- 172.21.15.18:0/2145108442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef44279a0 msgr2=0x558ef4427da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:59:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.957+0000 7ff3cffff640 1 --2- 172.21.15.18:0/2145108442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef44279a0 0x558ef4427da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.957+0000 7ff3cffff640 1 -- 172.21.15.18:0/2145108442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef442d370 msgr2=0x558ef442f830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:59:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.957+0000 7ff3cffff640 1 --2- 172.21.15.18:0/2145108442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef442d370 0x558ef442f830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.957+0000 7ff3cffff640 1 -- 172.21.15.18:0/2145108442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef4332340 con 0x558ef44282e0 2024-09-19T09:59:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.957+0000 7ff3cffff640 1 --2- 172.21.15.18:0/2145108442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef44282e0 0x558ef442cda0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80114f0 tx=0x7ff3c80119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52806b1e8ff0ed8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.960+0000 7ff3d4993640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff3b80a34b0 0x7ff3b80a5970 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff3c409b470 tx=0x7ff3c40057a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.960+0000 7ff3b67fc640 1 -- 172.21.15.18:0/2145108442 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c801e070 con 0x558ef44282e0 2024-09-19T09:59:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.960+0000 7ff3b67fc640 1 -- 172.21.15.18:0/2145108442 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c800fb00 con 0x558ef44282e0 2024-09-19T09:59:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.961+0000 7ff3d926b740 1 -- 172.21.15.18:0/2145108442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef44282e0 msgr2=0x558ef442cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.961+0000 7ff3d926b740 1 --2- 172.21.15.18:0/2145108442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef44282e0 0x558ef442cda0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80114f0 tx=0x7ff3c80119b0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.963+0000 7ff3d926b740 1 -- 172.21.15.18:0/2145108442 shutdown_connections 2024-09-19T09:59:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.963+0000 7ff3d926b740 1 --2- 172.21.15.18:0/2145108442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef442d370 0x558ef442f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.963+0000 7ff3d926b740 1 --2- 172.21.15.18:0/2145108442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef44282e0 0x558ef442cda0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.963+0000 7ff3d926b740 1 --2- 172.21.15.18:0/2145108442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef44279a0 0x558ef4427da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.963+0000 7ff3d926b740 1 -- 172.21.15.18:0/2145108442 >> 172.21.15.18:0/2145108442 conn(0x558ef4423010 msgr2=0x558ef4423410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.967+0000 7ff3d926b740 1 -- 172.21.15.18:0/2145108442 shutdown_connections 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.967+0000 7ff3d926b740 1 -- 172.21.15.18:0/2145108442 wait complete. 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.968+0000 7ff3d926b740 1 -- start start 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.968+0000 7ff3d926b740 1 Processor -- start 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.969+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 0x558ef4431bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.969+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef442d370 0x558ef4432110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.969+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef4437140 0x558ef4439530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.969+0000 7ff3d926b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558ef4430390 con 0x558ef4437140 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.969+0000 7ff3d926b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558ef4314290 con 0x558ef44279a0 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.969+0000 7ff3d926b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558ef4430510 con 0x558ef442d370 2024-09-19T09:59:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.969+0000 7ff3d926b740 10 client.0 _ll_register_callbacks cb 0x558ef4345140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.973+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef442d370 0x558ef4432110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.973+0000 7ff3cf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 0x558ef4431bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.973+0000 7ff3cf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 0x558ef4431bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34212/0 (socket says 172.21.15.18:34212) 2024-09-19T09:59:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.973+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/853107229 learned_addr learned my addr 172.21.15.18:0/853107229 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.976+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/853107229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef442d370 msgr2=0x558ef4432110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.976+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef442d370 0x558ef4432110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.976+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/853107229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef4437140 msgr2=0x558ef4439530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.976+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef4437140 0x558ef4439530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.976+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/853107229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef409e210 con 0x558ef44279a0 2024-09-19T09:59:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.978+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 0x558ef4431bd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0005b50 tx=0x7ff3c0005b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbb1842a17f5868 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.978+0000 7ff3af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T09:59:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.978+0000 7ff3af7fe640 1 -- 172.21.15.18:0/853107229 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0052020 con 0x558ef44279a0 2024-09-19T09:59:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.979+0000 7ff3d926b740 1 -- 172.21.15.18:0/853107229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558ef4398a20 con 0x558ef44279a0 2024-09-19T09:59:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.979+0000 7ff3af7fe640 1 -- 172.21.15.18:0/853107229 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff3c00046c0 con 0x558ef44279a0 2024-09-19T09:59:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.990+0000 7ff3af7fe640 1 -- 172.21.15.18:0/853107229 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff3c0040d00 con 0x558ef44279a0 2024-09-19T09:59:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.998+0000 7ff3d926b740 10 client.26717 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:56.998+0000 7ff3d926b740 1 -- 172.21.15.18:0/853107229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558ef416a620 con 0x558ef44279a0 2024-09-19T09:59:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.001+0000 7ff3af7fe640 1 -- 172.21.15.18:0/853107229 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558ef4398a20 con 0x558ef44279a0 2024-09-19T09:59:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.001+0000 7ff3af7fe640 1 -- 172.21.15.18:0/853107229 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff3c0042440 con 0x558ef44279a0 2024-09-19T09:59:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.001+0000 7ff3d926b740 10 client.26717 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.001+0000 7ff3d926b740 10 client.26717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.001+0000 7ff3d926b740 20 client.26717 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.001+0000 7ff3d926b740 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ef443e0a0 0x558ef4440540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.001+0000 7ff3d926b740 4 client.26717 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.001+0000 7ff3d926b740 1 -- 172.21.15.18:0/853107229 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ef4392d70 con 0x558ef443e0a0 2024-09-19T09:59:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.006+0000 7ff3cffff640 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ef443e0a0 0x558ef4440540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.020+0000 7ff3cffff640 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ef443e0a0 0x558ef4440540 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b966d7e13835970d server_cookie=3cf8bd2f68b6c012 in_seq=0 out_seq=0 2024-09-19T09:59:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.020+0000 7ff3af7fe640 10 client.26717 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.026+0000 7ff3af7fe640 1 -- 172.21.15.18:0/853107229 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ef4392d70 con 0x558ef443e0a0 2024-09-19T09:59:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.026+0000 7ff3af7fe640 10 client.26717 handle_command_reply: tid=0 2024-09-19T09:59:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.026+0000 7ff3d926b740 1 client.26717 shutdown 2024-09-19T09:59:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.032+0000 7ff3d926b740 1 -- 172.21.15.18:0/853107229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 msgr2=0x558ef4431bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.032+0000 7ff3d926b740 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 0x558ef4431bd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0005b50 tx=0x7ff3c0005b80 comp rx=0 tx=0).stop 2024-09-19T09:59:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.032+0000 7ff3d926b740 1 -- 172.21.15.18:0/853107229 shutdown_connections 2024-09-19T09:59:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.032+0000 7ff3d926b740 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ef443e0a0 0x558ef4440540 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.032+0000 7ff3d926b740 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef4437140 0x558ef4439530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.032+0000 7ff3d926b740 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef442d370 0x558ef4432110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.032+0000 7ff3d926b740 1 --2- 172.21.15.18:0/853107229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 0x558ef4431bd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.032+0000 7ff3d926b740 1 -- 172.21.15.18:0/853107229 >> 172.21.15.18:0/853107229 conn(0x558ef4423010 msgr2=0x558ef4424070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.032+0000 7ff3af7fe640 0 client.26717 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.033+0000 7ff3d926b740 1 -- 172.21.15.18:0/853107229 shutdown_connections 2024-09-19T09:59:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.033+0000 7ff3d926b740 1 -- 172.21.15.18:0/853107229 wait complete. 2024-09-19T09:59:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.033+0000 7ff3d926b740 20 client.26717 trim_cache size 0 max 16384 2024-09-19T09:59:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.091+0000 7ff3d926b740 1 Processor -- start 2024-09-19T09:59:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.092+0000 7ff3d926b740 1 -- start start 2024-09-19T09:59:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.092+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef44279a0 0x558ef4432090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.092+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef442d370 0x558ef4423ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.092+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef4437140 0x558ef4424400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.093+0000 7ff3cf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef44279a0 0x558ef4432090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.093+0000 7ff3cf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef44279a0 0x558ef4432090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:34206/0 (socket says 172.21.15.18:34206) 2024-09-19T09:59:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.093+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/2269852608 learned_addr learned my addr 172.21.15.18:0/2269852608 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.093+0000 7ff3d926b740 1 -- 172.21.15.18:0/2269852608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc00e510 con 0x558ef4437140 2024-09-19T09:59:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.093+0000 7ff3d926b740 1 -- 172.21.15.18:0/2269852608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc010050 con 0x558ef442d370 2024-09-19T09:59:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.093+0000 7ff3d926b740 1 -- 172.21.15.18:0/2269852608 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc00ebe0 con 0x558ef44279a0 2024-09-19T09:59:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.094+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/2269852608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef4437140 0x558ef4424400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.094+0000 7ff3cffff640 1 --2- 172.21.15.18:0/2269852608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef442d370 0x558ef4423ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.095+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/2269852608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef44279a0 msgr2=0x558ef4432090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.095+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/2269852608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef44279a0 0x558ef4432090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.095+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/2269852608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef442d370 msgr2=0x558ef4423ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.095+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/2269852608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef442d370 0x558ef4423ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.095+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/2269852608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef4431710 con 0x558ef4437140 2024-09-19T09:59:57.100 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.096+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/2269852608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef4437140 0x558ef4424400 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff3c001a910 tx=0x7ff3c0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabfe12e2bb5b649 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.101+0000 7ff3b5ffb640 1 -- 172.21.15.18:0/2269852608 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0052070 con 0x558ef4437140 2024-09-19T09:59:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.101+0000 7ff3b5ffb640 1 -- 172.21.15.18:0/2269852608 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c0004780 con 0x558ef4437140 2024-09-19T09:59:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.101+0000 7ff3b5ffb640 1 -- 172.21.15.18:0/2269852608 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0042ca0 con 0x558ef4437140 2024-09-19T09:59:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.104+0000 7ff3d926b740 1 -- 172.21.15.18:0/2269852608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef4437140 msgr2=0x558ef4424400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.104+0000 7ff3d926b740 1 --2- 172.21.15.18:0/2269852608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef4437140 0x558ef4424400 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff3c001a910 tx=0x7ff3c0005fd0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.119+0000 7ff3d926b740 1 -- 172.21.15.18:0/2269852608 shutdown_connections 2024-09-19T09:59:57.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.119+0000 7ff3d926b740 1 --2- 172.21.15.18:0/2269852608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef4437140 0x558ef4424400 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.119+0000 7ff3d926b740 1 --2- 172.21.15.18:0/2269852608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef442d370 0x558ef4423ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.119+0000 7ff3d926b740 1 --2- 172.21.15.18:0/2269852608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef44279a0 0x558ef4432090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.119+0000 7ff3d926b740 1 -- 172.21.15.18:0/2269852608 >> 172.21.15.18:0/2269852608 conn(0x558ef4423010 msgr2=0x558ef4431980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.124+0000 7ff3d926b740 1 -- 172.21.15.18:0/2269852608 shutdown_connections 2024-09-19T09:59:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.125+0000 7ff3d926b740 1 -- 172.21.15.18:0/2269852608 wait complete. 2024-09-19T09:59:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.125+0000 7ff3d926b740 1 -- start start 2024-09-19T09:59:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.126+0000 7ff3d926b740 1 Processor -- start 2024-09-19T09:59:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.127+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 0x558ef444d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.127+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef442d370 0x558ef444dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.127+0000 7ff3d926b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef4437140 0x558ef4450c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.127+0000 7ff3d926b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc00f980 con 0x558ef442d370 2024-09-19T09:59:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.127+0000 7ff3d926b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc00f2b0 con 0x558ef44279a0 2024-09-19T09:59:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.127+0000 7ff3d926b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc00c4f0 con 0x558ef4437140 2024-09-19T09:59:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.127+0000 7ff3d926b740 10 client.0 _ll_register_callbacks cb 0x7ff3c80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.128+0000 7ff3cf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef4437140 0x558ef4450c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.128+0000 7ff3cf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef4437140 0x558ef4450c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:34214/0 (socket says 172.21.15.18:34214) 2024-09-19T09:59:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.128+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/1389471815 learned_addr learned my addr 172.21.15.18:0/1389471815 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.128+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 0x558ef444d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.129+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/1389471815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 msgr2=0x558ef444d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.129+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 0x558ef444d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.129+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/1389471815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef442d370 msgr2=0x558ef444dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.129+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef442d370 0x558ef444dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.129+0000 7ff3cf7fe640 1 -- 172.21.15.18:0/1389471815 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef44512a0 con 0x558ef4437140 2024-09-19T09:59:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.129+0000 7ff3cf7fe640 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef4437140 0x558ef4450c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x558ef444cd20 tx=0x7ff3c0068040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8141ccc308cf497f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.135+0000 7ff3af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:59:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.135+0000 7ff3af7fe640 1 -- 172.21.15.18:0/1389471815 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0052070 con 0x558ef4437140 2024-09-19T09:59:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.136+0000 7ff3d926b740 1 -- 172.21.15.18:0/1389471815 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c0004780 con 0x558ef4437140 2024-09-19T09:59:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.136+0000 7ff3af7fe640 1 -- 172.21.15.18:0/1389471815 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff3c0066680 con 0x558ef4437140 2024-09-19T09:59:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.136+0000 7ff3af7fe640 1 -- 172.21.15.18:0/1389471815 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff3c0066e50 con 0x558ef4437140 2024-09-19T09:59:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.136+0000 7ff3d926b740 10 client.26689 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.136+0000 7ff3d926b740 1 -- 172.21.15.18:0/1389471815 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558ef44525b0 con 0x558ef4437140 2024-09-19T09:59:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.139+0000 7ff3af7fe640 1 -- 172.21.15.18:0/1389471815 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c0004780 con 0x558ef4437140 2024-09-19T09:59:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.139+0000 7ff3af7fe640 1 -- 172.21.15.18:0/1389471815 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff3c0063040 con 0x558ef4437140 2024-09-19T09:59:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.139+0000 7ff3d926b740 10 client.26689 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.139+0000 7ff3d926b740 10 client.26689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:59:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.139+0000 7ff3d926b740 20 client.26689 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.139+0000 7ff3d926b740 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ef44a9080 0x558ef44ab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.139+0000 7ff3d926b740 4 client.26689 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:59:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.139+0000 7ff3d926b740 1 -- 172.21.15.18:0/1389471815 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ef430f900 con 0x558ef44a9080 2024-09-19T09:59:57.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.141+0000 7ff3cffff640 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ef44a9080 0x558ef44ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.150+0000 7ff3cffff640 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ef44a9080 0x558ef44ab470 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e2b8739bec98e6e server_cookie=3e521143828f4b3c in_seq=0 out_seq=0 2024-09-19T09:59:57.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:59:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T09:59:57.162+0000 7ff3af7fe640 10 client.26689 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T09:59:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:59:58.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 09:59:58 smithi018 ceph-mon[30956]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 804 MiB/s wr, 1.68k op/s 2024-09-19T09:59:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 09:59:58 smithi049 ceph-mon[34858]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 804 MiB/s wr, 1.68k op/s 2024-09-19T09:59:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 09:59:58 smithi162 ceph-mon[35174]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 804 MiB/s wr, 1.68k op/s 2024-09-19T09:59:59.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.713+0000 7fcc2aed3640 1 -- 172.21.15.18:0/2883441118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc24109e00 msgr2=0x7fcc2410e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.713+0000 7fcc2aed3640 1 --2- 172.21.15.18:0/2883441118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc24109e00 0x7fcc2410e240 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc140074e0 tx=0x7fcc1402b080 comp rx=0 tx=0).stop 2024-09-19T09:59:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.716+0000 7fcc2aed3640 1 -- 172.21.15.18:0/2883441118 shutdown_connections 2024-09-19T09:59:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.716+0000 7fcc2aed3640 1 --2- 172.21.15.18:0/2883441118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2410e970 0x7fcc24115310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.716+0000 7fcc2aed3640 1 --2- 172.21.15.18:0/2883441118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc24109e00 0x7fcc2410e240 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.716+0000 7fcc2aed3640 1 --2- 172.21.15.18:0/2883441118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc24109450 0x7fcc24109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.716+0000 7fcc2aed3640 1 -- 172.21.15.18:0/2883441118 >> 172.21.15.18:0/2883441118 conn(0x7fcc24073180 msgr2=0x7fcc24073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.717+0000 7fcc2aed3640 1 -- 172.21.15.18:0/2883441118 shutdown_connections 2024-09-19T09:59:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.717+0000 7fcc2aed3640 1 -- 172.21.15.18:0/2883441118 wait complete. 2024-09-19T09:59:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.720+0000 7fcc2aed3640 1 Processor -- start 2024-09-19T09:59:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.720+0000 7fcc2aed3640 1 -- start start 2024-09-19T09:59:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.723+0000 7fcc2aed3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc24109450 0x7fcc241a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.723+0000 7fcc2aed3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc24109e00 0x7fcc241a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.723+0000 7fcc2aed3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2410e970 0x7fcc2419e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.724+0000 7fcc2aed3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc241183c0 con 0x7fcc24109e00 2024-09-19T09:59:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.724+0000 7fcc2aed3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcc24118240 con 0x7fcc2410e970 2024-09-19T09:59:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.724+0000 7fcc2aed3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc24118540 con 0x7fcc24109450 2024-09-19T09:59:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.731+0000 7fcc29ed1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc24109450 0x7fcc241a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.731+0000 7fcc29ed1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc24109450 0x7fcc241a4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:34224/0 (socket says 172.21.15.18:34224) 2024-09-19T09:59:59.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.731+0000 7fcc29ed1640 1 -- 172.21.15.18:0/3570657557 learned_addr learned my addr 172.21.15.18:0/3570657557 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:59.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.731+0000 7fcc2a6d2640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2410e970 0x7fcc2419e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.739+0000 7fcc29ed1640 1 -- 172.21.15.18:0/3570657557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2410e970 msgr2=0x7fcc2419e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:59.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.739+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2410e970 0x7fcc2419e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.739+0000 7fcc29ed1640 1 -- 172.21.15.18:0/3570657557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc24109e00 msgr2=0x7fcc241a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:59.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.739+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc24109e00 0x7fcc241a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.739+0000 7fcc29ed1640 1 -- 172.21.15.18:0/3570657557 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2419efa0 con 0x7fcc24109450 2024-09-19T09:59:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.747+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc24109450 0x7fcc241a4660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000b4a0 tx=0x7fcc2000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.753+0000 7fcc1affd640 1 -- 172.21.15.18:0/3570657557 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20014070 con 0x7fcc24109450 2024-09-19T09:59:59.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.753+0000 7fcc1affd640 1 -- 172.21.15.18:0/3570657557 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc20010af0 con 0x7fcc24109450 2024-09-19T09:59:59.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.753+0000 7fcc2aed3640 1 -- 172.21.15.18:0/3570657557 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2419f290 con 0x7fcc24109450 2024-09-19T09:59:59.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.753+0000 7fcc2aed3640 1 -- 172.21.15.18:0/3570657557 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc241ab410 con 0x7fcc24109450 2024-09-19T09:59:59.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.754+0000 7fcc1affd640 1 -- 172.21.15.18:0/3570657557 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20017d10 con 0x7fcc24109450 2024-09-19T09:59:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.758+0000 7fcc2e50e740 1 Processor -- start 2024-09-19T09:59:59.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.759+0000 7fcc2e50e740 1 -- start start 2024-09-19T09:59:59.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.761+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a6198d20 0x5575a6197270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.761+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a61977b0 0x5575a6197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.761+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61a2550 0x5575a61a4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.762+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575a60fd2f0 con 0x5575a61a2550 2024-09-19T09:59:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.762+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5575a60a4cf0 con 0x5575a61977b0 2024-09-19T09:59:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.762+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5575a60f92b0 con 0x5575a6198d20 2024-09-19T09:59:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.763+0000 7fcc2a6d2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a6198d20 0x5575a6197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.763+0000 7fcc2a6d2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a6198d20 0x5575a6197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:34230/0 (socket says 172.21.15.18:34230) 2024-09-19T09:59:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.763+0000 7fcc2a6d2640 1 -- 172.21.15.18:0/4197022037 learned_addr learned my addr 172.21.15.18:0/4197022037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.764+0000 7fcc296d0640 1 --2- 172.21.15.18:0/4197022037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61a2550 0x5575a61a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.764+0000 7fcc1affd640 1 -- 172.21.15.18:0/3570657557 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcc20017070 con 0x7fcc24109450 2024-09-19T09:59:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.764+0000 7fcc296d0640 1 -- 172.21.15.18:0/4197022037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a6198d20 msgr2=0x5575a6197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.764+0000 7fcc296d0640 1 --2- 172.21.15.18:0/4197022037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a6198d20 0x5575a6197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.764+0000 7fcc296d0640 1 -- 172.21.15.18:0/4197022037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a61977b0 msgr2=0x5575a6197bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:59.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.764+0000 7fcc296d0640 1 --2- 172.21.15.18:0/4197022037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a61977b0 0x5575a6197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.765+0000 7fcc296d0640 1 -- 172.21.15.18:0/4197022037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575a60893a0 con 0x5575a61a2550 2024-09-19T09:59:59.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.770+0000 7fcc1affd640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc100a3410 0x7fcc100a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.770+0000 7fcc296d0640 1 --2- 172.21.15.18:0/4197022037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61a2550 0x5575a61a4940 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fcc1402b5a0 tx=0x7fcc14008af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffa204d7cd6ca6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:59.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.772+0000 7fcc0ffff640 1 -- 172.21.15.18:0/4197022037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1402b9c0 con 0x5575a61a2550 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.772+0000 7fcc0ffff640 1 -- 172.21.15.18:0/4197022037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc1402bb60 con 0x5575a61a2550 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.772+0000 7fcc0ffff640 1 -- 172.21.15.18:0/4197022037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc14003cd0 con 0x5575a61a2550 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.773+0000 7fcc1affd640 1 -- 172.21.15.18:0/3570657557 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcc200cec10 con 0x7fcc24109450 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.775+0000 7fcc2e50e740 1 -- 172.21.15.18:0/4197022037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61a2550 msgr2=0x5575a61a4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.775+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/4197022037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61a2550 0x5575a61a4940 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fcc1402b5a0 tx=0x7fcc14008af0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.775+0000 7fcc2e50e740 1 -- 172.21.15.18:0/4197022037 shutdown_connections 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.775+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/4197022037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61a2550 0x5575a61a4940 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.775+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/4197022037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a61977b0 0x5575a6197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.775+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/4197022037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a6198d20 0x5575a6197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.775+0000 7fcc2e50e740 1 -- 172.21.15.18:0/4197022037 >> 172.21.15.18:0/4197022037 conn(0x5575a6160310 msgr2=0x5575a6193e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.776+0000 7fcc2e50e740 1 -- 172.21.15.18:0/4197022037 shutdown_connections 2024-09-19T09:59:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.776+0000 7fcc2e50e740 1 -- 172.21.15.18:0/4197022037 wait complete. 2024-09-19T09:59:59.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.777+0000 7fcc2e50e740 1 -- start start 2024-09-19T09:59:59.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.778+0000 7fcc2e50e740 1 Processor -- start 2024-09-19T09:59:59.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.779+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61977b0 0x5575a619f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.779+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 0x5575a619f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.779+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61a2550 0x5575a619fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.779+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575a61a51f0 con 0x5575a61a2550 2024-09-19T09:59:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.779+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5575a60b8060 con 0x5575a6198d20 2024-09-19T09:59:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.780+0000 7fcc296d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 0x5575a619f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.780+0000 7fcc296d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 0x5575a619f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34270/0 (socket says 172.21.15.18:34270) 2024-09-19T09:59:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.780+0000 7fcc296d0640 1 -- 172.21.15.18:0/1083659720 learned_addr learned my addr 172.21.15.18:0/1083659720 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.780+0000 7fcc2e50e740 1 -- 172.21.15.18:0/1083659720 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5575a61a5370 con 0x5575a61977b0 2024-09-19T09:59:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.780+0000 7fcc2e50e740 10 client.0 _ll_register_callbacks cb 0x5575a5e0b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.780+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61977b0 0x5575a619f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.782+0000 7fcc29ed1640 1 -- 172.21.15.18:0/1083659720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 msgr2=0x5575a619f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.782+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 0x5575a619f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.782+0000 7fcc29ed1640 1 -- 172.21.15.18:0/1083659720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61a2550 msgr2=0x5575a619fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.782+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61a2550 0x5575a619fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.782+0000 7fcc29ed1640 1 -- 172.21.15.18:0/1083659720 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575a5e6e3c0 con 0x5575a61977b0 2024-09-19T09:59:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.783+0000 7fcc296d0640 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 0x5575a619f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:59:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.783+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61977b0 0x5575a619f340 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5575a6194ca0 tx=0x7fcc2009ab60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd0f3ff9f42941fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.783+0000 7fcc0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T09:59:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.784+0000 7fcc2a6d2640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc100a3410 0x7fcc100a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.784+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/1083659720 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2001e050 con 0x5575a61977b0 2024-09-19T09:59:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.784+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/1083659720 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcc200b4160 con 0x5575a61977b0 2024-09-19T09:59:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.785+0000 7fcc2e50e740 1 -- 172.21.15.18:0/1083659720 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc1402bb60 con 0x5575a61977b0 2024-09-19T09:59:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.785+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/1083659720 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcc2009f5b0 con 0x5575a61977b0 2024-09-19T09:59:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.786+0000 7fcc2e50e740 10 client.26701 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.786+0000 7fcc2e50e740 1 -- 172.21.15.18:0/1083659720 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5575a61b0e20 con 0x5575a61977b0 2024-09-19T09:59:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.786+0000 7fcc2a6d2640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc100a3410 0x7fcc100a58d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c005f40 tx=0x7fcc1c009d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.787+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/1083659720 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc1402bb60 con 0x5575a61977b0 2024-09-19T09:59:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.787+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/1083659720 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcc200bb0e0 con 0x5575a61977b0 2024-09-19T09:59:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.787+0000 7fcc2e50e740 10 client.26701 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.787+0000 7fcc2e50e740 10 client.26701 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:59:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.787+0000 7fcc2e50e740 20 client.26701 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.787+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5575a61b2230 0x5575a61b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.788+0000 7fcc2e50e740 4 client.26701 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:59:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.788+0000 7fcc2e50e740 1 -- 172.21.15.18:0/1083659720 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575a610a860 con 0x5575a61b2230 2024-09-19T09:59:59.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.788+0000 7fcc296d0640 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5575a61b2230 0x5575a61b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.790+0000 7fcc296d0640 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5575a61b2230 0x5575a61b4620 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fd9c2efd3b35240e server_cookie=93da6ac081c5c059 in_seq=0 out_seq=0 2024-09-19T09:59:59.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.790+0000 7fcc0d7fa640 10 client.26701 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:59:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.792+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/1083659720 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575a610a860 con 0x5575a61b2230 2024-09-19T09:59:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.792+0000 7fcc0d7fa640 10 client.26701 handle_command_reply: tid=0 2024-09-19T09:59:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.792+0000 7fcc2e50e740 1 client.26701 shutdown 2024-09-19T09:59:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.793+0000 7fcc2e50e740 1 -- 172.21.15.18:0/1083659720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61977b0 msgr2=0x5575a619f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.793+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61977b0 0x5575a619f340 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5575a6194ca0 tx=0x7fcc2009ab60 comp rx=0 tx=0).stop 2024-09-19T09:59:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.793+0000 7fcc2e50e740 1 -- 172.21.15.18:0/1083659720 shutdown_connections 2024-09-19T09:59:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.793+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5575a61b2230 0x5575a61b4620 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.793+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61a2550 0x5575a619fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.793+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 0x5575a619f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.793+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/1083659720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61977b0 0x5575a619f340 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.793+0000 7fcc2e50e740 1 -- 172.21.15.18:0/1083659720 >> 172.21.15.18:0/1083659720 conn(0x5575a6160310 msgr2=0x5575a6199b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.793+0000 7fcc0d7fa640 0 client.26701 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:59:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.794+0000 7fcc2e50e740 1 -- 172.21.15.18:0/1083659720 shutdown_connections 2024-09-19T09:59:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.794+0000 7fcc2e50e740 1 -- 172.21.15.18:0/1083659720 wait complete. 2024-09-19T09:59:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.794+0000 7fcc2e50e740 20 client.26701 trim_cache size 0 max 16384 2024-09-19T09:59:59.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.836+0000 7fcc2e50e740 1 Processor -- start 2024-09-19T09:59:59.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.837+0000 7fcc2e50e740 1 -- start start 2024-09-19T09:59:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.837+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61977b0 0x5575a6193790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.837+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 0x5575a6193cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.837+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61a2550 0x5575a61b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.838+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc241b3a10 con 0x5575a61977b0 2024-09-19T09:59:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.838+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcc241b5550 con 0x5575a6198d20 2024-09-19T09:59:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.838+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc241b40e0 con 0x5575a61a2550 2024-09-19T09:59:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.840+0000 7fcc29ed1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61977b0 0x5575a6193790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.840+0000 7fcc29ed1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61977b0 0x5575a6193790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55758/0 (socket says 172.21.15.18:55758) 2024-09-19T09:59:59.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.840+0000 7fcc29ed1640 1 -- 172.21.15.18:0/2892118362 learned_addr learned my addr 172.21.15.18:0/2892118362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:59.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.843+0000 7fcc296d0640 1 --2- 172.21.15.18:0/2892118362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 0x5575a6193cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.844+0000 7fcc2a6d2640 1 --2- 172.21.15.18:0/2892118362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61a2550 0x5575a61b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.844+0000 7fcc29ed1640 1 -- 172.21.15.18:0/2892118362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61a2550 msgr2=0x5575a61b9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:59.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.844+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/2892118362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61a2550 0x5575a61b9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.844+0000 7fcc29ed1640 1 -- 172.21.15.18:0/2892118362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 msgr2=0x5575a6193cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:59:59.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.844+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/2892118362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 0x5575a6193cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.844+0000 7fcc29ed1640 1 -- 172.21.15.18:0/2892118362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575a6198960 con 0x5575a61977b0 2024-09-19T09:59:59.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.844+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/2892118362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61977b0 0x5575a6193790 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fcc200a3940 tx=0x7fcc2009ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cf75d99f4801bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:59.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.847+0000 7fcc0f7fe640 1 -- 172.21.15.18:0/2892118362 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2001e070 con 0x5575a61977b0 2024-09-19T09:59:59.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.847+0000 7fcc0f7fe640 1 -- 172.21.15.18:0/2892118362 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc200a3e70 con 0x5575a61977b0 2024-09-19T09:59:59.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.847+0000 7fcc0f7fe640 1 -- 172.21.15.18:0/2892118362 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2009a650 con 0x5575a61977b0 2024-09-19T09:59:59.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.848+0000 7fcc2e50e740 1 -- 172.21.15.18:0/2892118362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61977b0 msgr2=0x5575a6193790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:59.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.848+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/2892118362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61977b0 0x5575a6193790 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fcc200a3940 tx=0x7fcc2009ac90 comp rx=0 tx=0).stop 2024-09-19T09:59:59.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.850+0000 7fcc2e50e740 1 -- 172.21.15.18:0/2892118362 shutdown_connections 2024-09-19T09:59:59.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.850+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/2892118362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61a2550 0x5575a61b9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.850+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/2892118362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a6198d20 0x5575a6193cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.850+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/2892118362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a61977b0 0x5575a6193790 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.850+0000 7fcc2e50e740 1 -- 172.21.15.18:0/2892118362 >> 172.21.15.18:0/2892118362 conn(0x5575a6160310 msgr2=0x5575a619e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:59.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.853+0000 7fcc2e50e740 1 -- 172.21.15.18:0/2892118362 shutdown_connections 2024-09-19T09:59:59.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.855+0000 7fcc2e50e740 1 -- 172.21.15.18:0/2892118362 wait complete. 2024-09-19T09:59:59.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.856+0000 7fcc2e50e740 1 -- start start 2024-09-19T09:59:59.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.856+0000 7fcc2e50e740 1 Processor -- start 2024-09-19T09:59:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.857+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61977b0 0x5575a61a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.858+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a6198d20 0x5575a61a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.858+0000 7fcc2e50e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a61a2550 0x5575a61a9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.858+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc241b4e80 con 0x5575a6198d20 2024-09-19T09:59:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.858+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcc241b47b0 con 0x5575a61a2550 2024-09-19T09:59:59.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.858+0000 7fcc2e50e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc241b19f0 con 0x5575a61977b0 2024-09-19T09:59:59.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.859+0000 7fcc2e50e740 10 client.0 _ll_register_callbacks cb 0x7fcc20017eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:59:59.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.859+0000 7fcc296d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a6198d20 0x5575a61a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.859+0000 7fcc296d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a6198d20 0x5575a61a2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55774/0 (socket says 172.21.15.18:55774) 2024-09-19T09:59:59.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.859+0000 7fcc296d0640 1 -- 172.21.15.18:0/502449114 learned_addr learned my addr 172.21.15.18:0/502449114 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:59:59.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.860+0000 7fcc296d0640 1 -- 172.21.15.18:0/502449114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61977b0 msgr2=0x5575a61a2a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:59:59.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.860+0000 7fcc296d0640 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61977b0 0x5575a61a2a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.861+0000 7fcc296d0640 1 -- 172.21.15.18:0/502449114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a61a2550 msgr2=0x5575a61a9600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:59:59.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.861+0000 7fcc296d0640 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a61a2550 0x5575a61a9600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.861+0000 7fcc296d0640 1 -- 172.21.15.18:0/502449114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575a61a3870 con 0x5575a6198d20 2024-09-19T09:59:59.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.862+0000 7fcc296d0640 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a6198d20 0x5575a61a2fd0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fcc140037e0 tx=0x7fcc14000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7076d2f153602 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:59:59.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.863+0000 7fcc0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:59:59.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.863+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/502449114 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400a2d0 con 0x5575a6198d20 2024-09-19T09:59:59.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.863+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/502449114 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcc1400a470 con 0x5575a6198d20 2024-09-19T09:59:59.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.863+0000 7fcc2e50e740 1 -- 172.21.15.18:0/502449114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc200a3e70 con 0x5575a6198d20 2024-09-19T09:59:59.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.865+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/502449114 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcc1400a670 con 0x5575a6198d20 2024-09-19T09:59:59.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.865+0000 7fcc2e50e740 10 client.17259 fetch_fsmap learned FSMap version 28 2024-09-19T09:59:59.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.865+0000 7fcc2e50e740 1 -- 172.21.15.18:0/502449114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5575a61aaae0 con 0x5575a6198d20 2024-09-19T09:59:59.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.867+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/502449114 <== mon.0 v2:172.21.15.18:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcc14042030 con 0x5575a6198d20 2024-09-19T09:59:59.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.867+0000 7fcc2e50e740 10 client.17259 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:59:59.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.868+0000 7fcc2e50e740 10 client.17259 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T09:59:59.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.868+0000 7fcc2e50e740 20 client.17259 populate_metadata read hostname 'smithi018' 2024-09-19T09:59:59.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.868+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5575a61aacb0 0x5575a6227690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:59:59.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.868+0000 7fcc2e50e740 4 client.17259 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:59:59.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.868+0000 7fcc2e50e740 1 -- 172.21.15.18:0/502449114 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5575a6104d70 con 0x5575a61aacb0 2024-09-19T09:59:59.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.875+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5575a61aacb0 0x5575a6227690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:59:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.878+0000 7fcc0d7fa640 10 client.17259 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T09:59:59.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.878+0000 7fcc29ed1640 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5575a61aacb0 0x5575a6227690 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=882b2fbe75ec9fc9 server_cookie=15b42a23f7a4f252 in_seq=0 out_seq=0 2024-09-19T09:59:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.879+0000 7fcc0d7fa640 1 -- 172.21.15.18:0/502449114 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5575a6104d70 con 0x5575a61aacb0 2024-09-19T09:59:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.879+0000 7fcc0d7fa640 10 client.17259 handle_command_reply: tid=0 2024-09-19T09:59:59.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.879+0000 7fcc2e50e740 1 client.17259 shutdown 2024-09-19T09:59:59.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.880+0000 7fcc2e50e740 1 -- 172.21.15.18:0/502449114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a6198d20 msgr2=0x5575a61a2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:59.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.880+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a6198d20 0x5575a61a2fd0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fcc140037e0 tx=0x7fcc14000bc0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.880+0000 7fcc2e50e740 1 -- 172.21.15.18:0/502449114 shutdown_connections 2024-09-19T09:59:59.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.880+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5575a61aacb0 0x5575a6227690 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.880+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575a61a2550 0x5575a61a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.880+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575a6198d20 0x5575a61a2fd0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.880+0000 7fcc2e50e740 1 --2- 172.21.15.18:0/502449114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575a61977b0 0x5575a61a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.880+0000 7fcc2e50e740 1 -- 172.21.15.18:0/502449114 >> 172.21.15.18:0/502449114 conn(0x5575a6160310 msgr2=0x5575a61ad480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:59.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.881+0000 7fcc0d7fa640 0 client.17259 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T09:59:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.884+0000 7fcc2e50e740 1 -- 172.21.15.18:0/502449114 shutdown_connections 2024-09-19T09:59:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.884+0000 7fcc2e50e740 1 -- 172.21.15.18:0/502449114 wait complete. 2024-09-19T09:59:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.884+0000 7fcc2e50e740 20 client.17259 trim_cache size 0 max 16384 2024-09-19T09:59:59.890 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T09:59:59.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.886+0000 7fcc2aed3640 1 -- 172.21.15.18:0/3570657557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc100a3410 msgr2=0x7fcc100a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:59.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.886+0000 7fcc2aed3640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc100a3410 0x7fcc100a58d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c005f40 tx=0x7fcc1c009d10 comp rx=0 tx=0).stop 2024-09-19T09:59:59.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.886+0000 7fcc2aed3640 1 -- 172.21.15.18:0/3570657557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc24109450 msgr2=0x7fcc241a4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:59:59.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.886+0000 7fcc2aed3640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc24109450 0x7fcc241a4660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000b4a0 tx=0x7fcc2000b960 comp rx=0 tx=0).stop 2024-09-19T09:59:59.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.886+0000 7fcc2aed3640 1 -- 172.21.15.18:0/3570657557 shutdown_connections 2024-09-19T09:59:59.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.886+0000 7fcc2aed3640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcc100a3410 0x7fcc100a58d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.886+0000 7fcc2aed3640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2410e970 0x7fcc2419e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.886+0000 7fcc2aed3640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc24109e00 0x7fcc241a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.886+0000 7fcc2aed3640 1 --2- 172.21.15.18:0/3570657557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc24109450 0x7fcc241a4660 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:59:59.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.886+0000 7fcc2aed3640 1 -- 172.21.15.18:0/3570657557 >> 172.21.15.18:0/3570657557 conn(0x7fcc24073180 msgr2=0x7fcc2410c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:59:59.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.887+0000 7fcc2aed3640 1 -- 172.21.15.18:0/3570657557 shutdown_connections 2024-09-19T09:59:59.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:59:59.887+0000 7fcc2aed3640 1 -- 172.21.15.18:0/3570657557 wait complete. 2024-09-19T10:00:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:00 smithi018 ceph-mon[30956]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 122 GiB used, 950 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 713 MiB/s wr, 1.54k op/s 2024-09-19T10:00:00.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:00 smithi018 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T10:00:00.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:00 smithi049 ceph-mon[34858]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 122 GiB used, 950 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 713 MiB/s wr, 1.54k op/s 2024-09-19T10:00:00.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:00 smithi049 ceph-mon[34858]: overall HEALTH_OK 2024-09-19T10:00:00.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:00 smithi162 ceph-mon[35174]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 122 GiB used, 950 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 713 MiB/s wr, 1.54k op/s 2024-09-19T10:00:00.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:00 smithi162 ceph-mon[35174]: overall HEALTH_OK 2024-09-19T10:00:00.738 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T10:00:01.003 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:01.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.749+0000 7f7f679ae640 1 -- 172.21.15.18:0/4012475204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f60074eb0 msgr2=0x7f7f60112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.749+0000 7f7f679ae640 1 --2- 172.21.15.18:0/4012475204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f60074eb0 0x7f7f60112640 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009900 tx=0x7f7f5002a480 comp rx=0 tx=0).stop 2024-09-19T10:00:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.749+0000 7f7f679ae640 1 -- 172.21.15.18:0/4012475204 shutdown_connections 2024-09-19T10:00:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.749+0000 7f7f679ae640 1 --2- 172.21.15.18:0/4012475204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f60112b80 0x7f7f60114f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.749+0000 7f7f679ae640 1 --2- 172.21.15.18:0/4012475204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f60074eb0 0x7f7f60112640 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.749+0000 7f7f679ae640 1 --2- 172.21.15.18:0/4012475204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f60074590 0x7f7f60074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.749+0000 7f7f679ae640 1 -- 172.21.15.18:0/4012475204 >> 172.21.15.18:0/4012475204 conn(0x7f7f600fd890 msgr2=0x7f7f600ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.749+0000 7f7f679ae640 1 -- 172.21.15.18:0/4012475204 shutdown_connections 2024-09-19T10:00:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.749+0000 7f7f679ae640 1 -- 172.21.15.18:0/4012475204 wait complete. 2024-09-19T10:00:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f679ae640 1 Processor -- start 2024-09-19T10:00:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f679ae640 1 -- start start 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f679ae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f60074590 0x7f7f601a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f679ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f60074eb0 0x7f7f601a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f679ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f60112b80 0x7f7f6019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f679ae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7f601185a0 con 0x7f7f60074eb0 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f679ae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7f60118420 con 0x7f7f60112b80 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f679ae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f60118720 con 0x7f7f60074590 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f64f49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f60074eb0 0x7f7f601a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f64f49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f60074eb0 0x7f7f601a4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55800/0 (socket says 172.21.15.18:55800) 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f64f49640 1 -- 172.21.15.18:0/2161105430 learned_addr learned my addr 172.21.15.18:0/2161105430 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f65f4b640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f60112b80 0x7f7f6019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f6574a640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f60074590 0x7f7f601a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f64f49640 1 -- 172.21.15.18:0/2161105430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f60074590 msgr2=0x7f7f601a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f64f49640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f60074590 0x7f7f601a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f64f49640 1 -- 172.21.15.18:0/2161105430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f60112b80 msgr2=0x7f7f6019e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f64f49640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f60112b80 0x7f7f6019e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.750+0000 7f7f64f49640 1 -- 172.21.15.18:0/2161105430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6019f040 con 0x7f7f60074eb0 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.751+0000 7f7f64f49640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f60074eb0 0x7f7f601a4c90 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7f50004770 tx=0x7f7f50003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.751+0000 7f7f567fc640 1 -- 172.21.15.18:0/2161105430 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5003f070 con 0x7f7f60074eb0 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.751+0000 7f7f567fc640 1 -- 172.21.15.18:0/2161105430 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f50031ca0 con 0x7f7f60074eb0 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.751+0000 7f7f679ae640 1 -- 172.21.15.18:0/2161105430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6019f2d0 con 0x7f7f60074eb0 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.751+0000 7f7f567fc640 1 -- 172.21.15.18:0/2161105430 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50035030 con 0x7f7f60074eb0 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.751+0000 7f7f679ae640 1 -- 172.21.15.18:0/2161105430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f601ab620 con 0x7f7f60074eb0 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.753+0000 7f7f567fc640 1 -- 172.21.15.18:0/2161105430 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7f50042070 con 0x7f7f60074eb0 2024-09-19T10:00:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.754+0000 7f7f567fc640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f4c0a3240 0x7f7f4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.754+0000 7f7f69d87740 1 Processor -- start 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.754+0000 7f7f6574a640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f4c0a3240 0x7f7f4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.754+0000 7f7f567fc640 1 -- 172.21.15.18:0/2161105430 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7f500effb0 con 0x7f7f60074eb0 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.754+0000 7f7f69d87740 1 -- start start 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3937090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b3937a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3944760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f69d87740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601b389d2f0 con 0x5601b3938b40 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f69d87740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5601b3844cf0 con 0x5601b3942370 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f69d87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5601b38992b0 con 0x5601b39375d0 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f6574a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3937090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f6574a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3937090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55810/0 (socket says 172.21.15.18:55810) 2024-09-19T10:00:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f64f49640 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b3937a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f6574a640 1 -- 172.21.15.18:0/2054280400 learned_addr learned my addr 172.21.15.18:0/2054280400 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f65f4b640 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3944760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f6574a640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f4c0a3240 0x7f7f4c0a5700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7f6019fa50 tx=0x7f7f5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f64f49640 1 -- 172.21.15.18:0/2054280400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 msgr2=0x5601b3944760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f64f49640 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3944760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f64f49640 1 -- 172.21.15.18:0/2054280400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 msgr2=0x5601b3937090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f64f49640 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3937090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f64f49640 1 -- 172.21.15.18:0/2054280400 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601b38293a0 con 0x5601b39375d0 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f6574a640 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3937090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f65f4b640 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3944760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.755+0000 7f7f64f49640 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b3937a10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f50000c00 tx=0x7f7f5003b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fe72f4ba60802c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f4b7fe640 1 -- 172.21.15.18:0/2054280400 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50049070 con 0x5601b39375d0 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f4b7fe640 1 -- 172.21.15.18:0/2054280400 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f500bc660 con 0x5601b39375d0 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f4b7fe640 1 -- 172.21.15.18:0/2054280400 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f500b8cd0 con 0x5601b39375d0 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f69d87740 1 -- 172.21.15.18:0/2054280400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 msgr2=0x5601b3937a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f69d87740 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b3937a10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f50000c00 tx=0x7f7f5003b460 comp rx=0 tx=0).stop 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f69d87740 1 -- 172.21.15.18:0/2054280400 shutdown_connections 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f69d87740 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3944760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f69d87740 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b3937a10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f69d87740 1 --2- 172.21.15.18:0/2054280400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3937090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f69d87740 1 -- 172.21.15.18:0/2054280400 >> 172.21.15.18:0/2054280400 conn(0x5601b3900310 msgr2=0x5601b3933c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f69d87740 1 -- 172.21.15.18:0/2054280400 shutdown_connections 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.756+0000 7f7f69d87740 1 -- 172.21.15.18:0/2054280400 wait complete. 2024-09-19T10:00:01.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f69d87740 1 -- start start 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f69d87740 1 Processor -- start 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 0x5601b3941d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b393f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 0x5601b393f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f69d87740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601b3944e30 con 0x5601b3938b40 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f69d87740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5601b3858060 con 0x5601b39375d0 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f69d87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5601b3944fb0 con 0x5601b3942370 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f69d87740 10 client.0 _ll_register_callbacks cb 0x5601b35ab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f64f49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b393f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f65f4b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 0x5601b393f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f64f49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b393f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55812/0 (socket says 172.21.15.18:55812) 2024-09-19T10:00:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f64f49640 1 -- 172.21.15.18:0/2120231666 learned_addr learned my addr 172.21.15.18:0/2120231666 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.757+0000 7f7f6574a640 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 0x5601b3941d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f64f49640 1 -- 172.21.15.18:0/2120231666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 msgr2=0x5601b393f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f64f49640 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 0x5601b393f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f64f49640 1 -- 172.21.15.18:0/2120231666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 msgr2=0x5601b3941d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f64f49640 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 0x5601b3941d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f64f49640 1 -- 172.21.15.18:0/2120231666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601b360e3c0 con 0x5601b3938b40 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f65f4b640 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 0x5601b393f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f6574a640 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 0x5601b3941d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f64f49640 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b393f030 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7f500bf040 tx=0x7f7f500ba700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2c3bd105669539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f48ff9640 1 -- 172.21.15.18:0/2120231666 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50049070 con 0x5601b3938b40 2024-09-19T10:00:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f48ff9640 1 -- 172.21.15.18:0/2120231666 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7f500ba960 con 0x5601b3938b40 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f69d87740 1 -- 172.21.15.18:0/2120231666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f500bc660 con 0x5601b3938b40 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f48ff9640 1 -- 172.21.15.18:0/2120231666 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7f500c52d0 con 0x5601b3938b40 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f69d87740 10 client.17271 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f69d87740 1 -- 172.21.15.18:0/2120231666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5601b3944e30 con 0x5601b3938b40 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.758+0000 7f7f48ff9640 1 -- 172.21.15.18:0/2120231666 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f500bc660 con 0x5601b3938b40 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.759+0000 7f7f48ff9640 1 -- 172.21.15.18:0/2120231666 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7f500c4e40 con 0x5601b3938b40 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.759+0000 7f7f69d87740 10 client.17271 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.759+0000 7f7f69d87740 10 client.17271 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.759+0000 7f7f69d87740 20 client.17271 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.759+0000 7f7f69d87740 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5601b3951a80 0x5601b3953e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.759+0000 7f7f69d87740 4 client.17271 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.759+0000 7f7f69d87740 1 -- 172.21.15.18:0/2120231666 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601b38aa860 con 0x5601b3951a80 2024-09-19T10:00:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.759+0000 7f7f6574a640 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5601b3951a80 0x5601b3953e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.759+0000 7f7f48ff9640 10 client.17271 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.759+0000 7f7f6574a640 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5601b3951a80 0x5601b3953e70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=77a876024b172735 server_cookie=9f775fb1ae7c2e92 in_seq=0 out_seq=0 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f48ff9640 1 -- 172.21.15.18:0/2120231666 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601b38aa860 con 0x5601b3951a80 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f48ff9640 10 client.17271 handle_command_reply: tid=0 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f69d87740 1 client.17271 shutdown 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f69d87740 1 -- 172.21.15.18:0/2120231666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 msgr2=0x5601b393f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f69d87740 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b393f030 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7f500bf040 tx=0x7f7f500ba700 comp rx=0 tx=0).stop 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f69d87740 1 -- 172.21.15.18:0/2120231666 shutdown_connections 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f69d87740 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5601b3951a80 0x5601b3953e70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f69d87740 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 0x5601b393f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f69d87740 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b393f030 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f69d87740 1 --2- 172.21.15.18:0/2120231666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 0x5601b3941d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f69d87740 1 -- 172.21.15.18:0/2120231666 >> 172.21.15.18:0/2120231666 conn(0x5601b3900310 msgr2=0x5601b3939960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.760+0000 7f7f48ff9640 0 client.17271 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:00:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.761+0000 7f7f69d87740 1 -- 172.21.15.18:0/2120231666 shutdown_connections 2024-09-19T10:00:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.761+0000 7f7f69d87740 1 -- 172.21.15.18:0/2120231666 wait complete. 2024-09-19T10:00:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.761+0000 7f7f69d87740 20 client.17271 trim_cache size 0 max 16384 2024-09-19T10:00:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.779+0000 7f7f69d87740 1 Processor -- start 2024-09-19T10:00:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.779+0000 7f7f69d87740 1 -- start start 2024-09-19T10:00:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.779+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 0x5601b393f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.779+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b394e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.779+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 0x5601b3959740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.779+0000 7f7f69d87740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7f601b3bb0 con 0x5601b3938b40 2024-09-19T10:00:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.779+0000 7f7f69d87740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7f601b56f0 con 0x5601b39375d0 2024-09-19T10:00:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.779+0000 7f7f69d87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f601b4280 con 0x5601b3942370 2024-09-19T10:00:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.779+0000 7f7f64f49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b394e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f6574a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 0x5601b393f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f64f49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b394e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55818/0 (socket says 172.21.15.18:55818) 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f64f49640 1 -- 172.21.15.18:0/3350050562 learned_addr learned my addr 172.21.15.18:0/3350050562 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f65f4b640 1 --2- 172.21.15.18:0/3350050562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 0x5601b3959740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f64f49640 1 -- 172.21.15.18:0/3350050562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 msgr2=0x5601b3959740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f64f49640 1 --2- 172.21.15.18:0/3350050562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 0x5601b3959740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f64f49640 1 -- 172.21.15.18:0/3350050562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 msgr2=0x5601b393f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f64f49640 1 --2- 172.21.15.18:0/3350050562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 0x5601b393f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f64f49640 1 -- 172.21.15.18:0/3350050562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601b3933ed0 con 0x5601b3938b40 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f64f49640 1 --2- 172.21.15.18:0/3350050562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b394e000 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7f500bc360 tx=0x7f7f5003b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f108f80bc389a0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f4affd640 1 -- 172.21.15.18:0/3350050562 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50049070 con 0x5601b3938b40 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f4affd640 1 -- 172.21.15.18:0/3350050562 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f500ba770 con 0x5601b3938b40 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.780+0000 7f7f4affd640 1 -- 172.21.15.18:0/3350050562 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f500c4e40 con 0x5601b3938b40 2024-09-19T10:00:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.781+0000 7f7f69d87740 1 -- 172.21.15.18:0/3350050562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 msgr2=0x5601b394e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.781+0000 7f7f69d87740 1 --2- 172.21.15.18:0/3350050562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b394e000 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7f500bc360 tx=0x7f7f5003b460 comp rx=0 tx=0).stop 2024-09-19T10:00:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.781+0000 7f7f69d87740 1 -- 172.21.15.18:0/3350050562 shutdown_connections 2024-09-19T10:00:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.781+0000 7f7f69d87740 1 --2- 172.21.15.18:0/3350050562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b3942370 0x5601b3959740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.781+0000 7f7f69d87740 1 --2- 172.21.15.18:0/3350050562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b394e000 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.781+0000 7f7f69d87740 1 --2- 172.21.15.18:0/3350050562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b39375d0 0x5601b393f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.781+0000 7f7f69d87740 1 -- 172.21.15.18:0/3350050562 >> 172.21.15.18:0/3350050562 conn(0x5601b3900310 msgr2=0x5601b393e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.781+0000 7f7f69d87740 1 -- 172.21.15.18:0/3350050562 shutdown_connections 2024-09-19T10:00:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.781+0000 7f7f69d87740 1 -- 172.21.15.18:0/3350050562 wait complete. 2024-09-19T10:00:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.781+0000 7f7f69d87740 1 -- start start 2024-09-19T10:00:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f69d87740 1 Processor -- start 2024-09-19T10:00:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b39450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3945600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f69d87740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3945b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f69d87740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7f601b5020 con 0x5601b3938b40 2024-09-19T10:00:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f69d87740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7f601b4950 con 0x5601b3942370 2024-09-19T10:00:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f69d87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f601b1b90 con 0x5601b39375d0 2024-09-19T10:00:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f69d87740 10 client.0 _ll_register_callbacks cb 0x7f7f5c0099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f6574a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b39450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f65f4b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3945b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f6574a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b39450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:34324/0 (socket says 172.21.15.18:34324) 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f64f49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3945600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f65f4b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3945b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:34368/0 (socket says 172.21.15.18:34368) 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.782+0000 7f7f6574a640 1 -- 172.21.15.18:0/3963582712 learned_addr learned my addr 172.21.15.18:0/3963582712 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f6574a640 1 -- 172.21.15.18:0/3963582712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 msgr2=0x5601b3945b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f6574a640 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3945b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f6574a640 1 -- 172.21.15.18:0/3963582712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 msgr2=0x5601b3945600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f6574a640 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3945600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f6574a640 1 -- 172.21.15.18:0/3963582712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601b39ba7b0 con 0x5601b39375d0 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f65f4b640 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3945b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f64f49640 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3945600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f6574a640 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b39450c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c011da0 tx=0x7f7f5c014070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddac682e4d295cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f48ff9640 1 -- 172.21.15.18:0/3963582712 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c020cc0 con 0x5601b39375d0 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f48ff9640 1 -- 172.21.15.18:0/3963582712 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7f5c02b420 con 0x5601b39375d0 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f69d87740 1 -- 172.21.15.18:0/3963582712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f500ba770 con 0x5601b39375d0 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f48ff9640 1 -- 172.21.15.18:0/3963582712 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c03a070 con 0x5601b39375d0 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f69d87740 10 client.26719 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f69d87740 1 -- 172.21.15.18:0/3963582712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5601b39bbad0 con 0x5601b39375d0 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.783+0000 7f7f48ff9640 1 -- 172.21.15.18:0/3963582712 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f500ba770 con 0x5601b39375d0 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f48ff9640 1 -- 172.21.15.18:0/3963582712 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7f5c032030 con 0x5601b39375d0 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f69d87740 10 client.26719 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f69d87740 10 client.26719 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:00:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f69d87740 20 client.26719 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f69d87740 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5601b39bc200 0x5601b39be620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f69d87740 4 client.26719 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f69d87740 1 -- 172.21.15.18:0/3963582712 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601b38a4d70 con 0x5601b39bc200 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f64f49640 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5601b39bc200 0x5601b39be620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f64f49640 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5601b39bc200 0x5601b39be620 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e1709350c5f08026 server_cookie=93baee9f5c26fbaf in_seq=0 out_seq=0 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f48ff9640 10 client.26719 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f48ff9640 1 -- 172.21.15.18:0/3963582712 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601b38a4d70 con 0x5601b39bc200 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f48ff9640 10 client.26719 handle_command_reply: tid=0 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.784+0000 7f7f69d87740 1 client.26719 shutdown 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 1 -- 172.21.15.18:0/3963582712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 msgr2=0x5601b39450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b39450c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c011da0 tx=0x7f7f5c014070 comp rx=0 tx=0).stop 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 1 -- 172.21.15.18:0/3963582712 shutdown_connections 2024-09-19T10:00:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x5601b39bc200 0x5601b39be620 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5601b3942370 0x5601b3945b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601b3938b40 0x5601b3945600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f48ff9640 0 client.26719 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:00:01.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 1 --2- 172.21.15.18:0/3963582712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601b39375d0 0x5601b39450c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 1 -- 172.21.15.18:0/3963582712 >> 172.21.15.18:0/3963582712 conn(0x5601b3900310 msgr2=0x5601b3940890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:01.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 1 -- 172.21.15.18:0/3963582712 shutdown_connections 2024-09-19T10:00:01.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 1 -- 172.21.15.18:0/3963582712 wait complete. 2024-09-19T10:00:01.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f69d87740 20 client.26719 trim_cache size 0 max 16384 2024-09-19T10:00:01.793 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:00:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f679ae640 1 -- 172.21.15.18:0/2161105430 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f4c0a3240 msgr2=0x7f7f4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f679ae640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f4c0a3240 0x7f7f4c0a5700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7f6019fa50 tx=0x7f7f5c005f90 comp rx=0 tx=0).stop 2024-09-19T10:00:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f679ae640 1 -- 172.21.15.18:0/2161105430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f60074eb0 msgr2=0x7f7f601a4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f679ae640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f60074eb0 0x7f7f601a4c90 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7f50004770 tx=0x7f7f50003c10 comp rx=0 tx=0).stop 2024-09-19T10:00:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f679ae640 1 -- 172.21.15.18:0/2161105430 shutdown_connections 2024-09-19T10:00:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f679ae640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7f4c0a3240 0x7f7f4c0a5700 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f679ae640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f60112b80 0x7f7f6019e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f679ae640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f60074eb0 0x7f7f601a4c90 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.785+0000 7f7f679ae640 1 --2- 172.21.15.18:0/2161105430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f60074590 0x7f7f601a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.786+0000 7f7f679ae640 1 -- 172.21.15.18:0/2161105430 >> 172.21.15.18:0/2161105430 conn(0x7f7f600fd890 msgr2=0x7f7f600ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.786+0000 7f7f679ae640 1 -- 172.21.15.18:0/2161105430 shutdown_connections 2024-09-19T10:00:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:01.786+0000 7f7f679ae640 1 -- 172.21.15.18:0/2161105430 wait complete. 2024-09-19T10:00:02.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T10:00:02.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:02 smithi018 ceph-mon[30956]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 122 GiB used, 950 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 812 MiB/s wr, 1.60k op/s 2024-09-19T10:00:02.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:02 smithi162 ceph-mon[35174]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 122 GiB used, 950 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 812 MiB/s wr, 1.60k op/s 2024-09-19T10:00:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:02.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:02 smithi049 ceph-mon[34858]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 122 GiB used, 950 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 812 MiB/s wr, 1.60k op/s 2024-09-19T10:00:03.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.256+0000 7f625ce7a640 1 -- 172.21.15.18:0/644089750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6258106a80 msgr2=0x7f6258106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:03.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.256+0000 7f625ce7a640 1 --2- 172.21.15.18:0/644089750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6258106a80 0x7f6258106e60 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6248009cd0 tx=0x7f624802a8e0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.256+0000 7f625ce7a640 1 -- 172.21.15.18:0/644089750 shutdown_connections 2024-09-19T10:00:03.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.257+0000 7f625ce7a640 1 --2- 172.21.15.18:0/644089750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6258101420 0x7f625810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.257+0000 7f625ce7a640 1 --2- 172.21.15.18:0/644089750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6258100a80 0x7f6258100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.257+0000 7f625ce7a640 1 --2- 172.21.15.18:0/644089750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6258106a80 0x7f6258106e60 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.257+0000 7f625ce7a640 1 -- 172.21.15.18:0/644089750 >> 172.21.15.18:0/644089750 conn(0x7f62580fc7a0 msgr2=0x7f62580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:03.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.257+0000 7f625ce7a640 1 -- 172.21.15.18:0/644089750 shutdown_connections 2024-09-19T10:00:03.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.257+0000 7f625ce7a640 1 -- 172.21.15.18:0/644089750 wait complete. 2024-09-19T10:00:03.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.257+0000 7f625ce7a640 1 Processor -- start 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.257+0000 7f625ce7a640 1 -- start start 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f625ce7a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6258100a80 0x7f6258199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f625ce7a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6258101420 0x7f6258199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f625ce7a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6258106a80 0x7f62581a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f625ce7a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6258110ed0 con 0x7f6258101420 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f625ce7a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6258110d50 con 0x7f6258106a80 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f625ce7a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6258111050 con 0x7f6258100a80 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f6255d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6258101420 0x7f6258199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f6255d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6258101420 0x7f6258199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55854/0 (socket says 172.21.15.18:55854) 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f6255d9b640 1 -- 172.21.15.18:0/677881309 learned_addr learned my addr 172.21.15.18:0/677881309 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f6256d9d640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6258106a80 0x7f62581a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f625659c640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6258100a80 0x7f6258199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f6255d9b640 1 -- 172.21.15.18:0/677881309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6258100a80 msgr2=0x7f6258199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f6255d9b640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6258100a80 0x7f6258199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f6255d9b640 1 -- 172.21.15.18:0/677881309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6258106a80 msgr2=0x7f62581a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f6255d9b640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6258106a80 0x7f62581a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f6255d9b640 1 -- 172.21.15.18:0/677881309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62581a4900 con 0x7f6258101420 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.258+0000 7f6256d9d640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6258106a80 0x7f62581a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.259+0000 7f6255d9b640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6258101420 0x7f6258199880 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f624000d950 tx=0x7f624000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.259+0000 7f624f7fe640 1 -- 172.21.15.18:0/677881309 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240017070 con 0x7f6258101420 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.259+0000 7f624f7fe640 1 -- 172.21.15.18:0/677881309 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6240009c30 con 0x7f6258101420 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.259+0000 7f625ce7a640 1 -- 172.21.15.18:0/677881309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62581a4ad0 con 0x7f6258101420 2024-09-19T10:00:03.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.259+0000 7f624f7fe640 1 -- 172.21.15.18:0/677881309 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624000f6b0 con 0x7f6258101420 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.259+0000 7f625ce7a640 1 -- 172.21.15.18:0/677881309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62581a5010 con 0x7f6258101420 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.261+0000 7f624f7fe640 1 -- 172.21.15.18:0/677881309 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f62400109d0 con 0x7f6258101420 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f625f253740 1 Processor -- start 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f625f253740 1 -- start start 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f625f253740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f625f253740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eaca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f625f253740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f625f253740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559682e122f0 con 0x559682eadb40 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f625f253740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559682db9cf0 con 0x559682eb7370 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f625f253740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559682e0e2b0 con 0x559682eac5d0 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f6256d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f6256d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55856/0 (socket says 172.21.15.18:55856) 2024-09-19T10:00:03.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f625659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eaca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f6256d9d640 1 -- 172.21.15.18:0/3731955765 learned_addr learned my addr 172.21.15.18:0/3731955765 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f624f7fe640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f62440a3240 0x7f62440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.262+0000 7f6255d9b640 1 --2- 172.21.15.18:0/3731955765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f6256d9d640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f62440a3240 0x7f62440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f625659c640 1 -- 172.21.15.18:0/3731955765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 msgr2=0x559682eb9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f625659c640 1 --2- 172.21.15.18:0/3731955765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f625659c640 1 -- 172.21.15.18:0/3731955765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 msgr2=0x559682eac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f625659c640 1 --2- 172.21.15.18:0/3731955765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f625659c640 1 -- 172.21.15.18:0/3731955765 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559682d9e3a0 con 0x559682eac5d0 2024-09-19T10:00:03.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f6256d9d640 1 --2- 172.21.15.18:0/3731955765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:03.427 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:00:03.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f624f7fe640 1 -- 172.21.15.18:0/677881309 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f62400cf480 con 0x7f6258101420 2024-09-19T10:00:03.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f625659c640 1 --2- 172.21.15.18:0/3731955765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eaca10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6248000f80 tx=0x7f6248009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d31c3d9879b2409e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:03.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f6256d9d640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f62440a3240 0x7f62440a5700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6250009fd0 tx=0x7f6250004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:03.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f624cff9640 1 -- 172.21.15.18:0/3731955765 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6248049070 con 0x559682eac5d0 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f624cff9640 1 -- 172.21.15.18:0/3731955765 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6248036040 con 0x559682eac5d0 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.263+0000 7f624cff9640 1 -- 172.21.15.18:0/3731955765 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62480042a0 con 0x559682eac5d0 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.264+0000 7f625f253740 1 -- 172.21.15.18:0/3731955765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 msgr2=0x559682eaca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.264+0000 7f625f253740 1 --2- 172.21.15.18:0/3731955765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eaca10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6248000f80 tx=0x7f6248009a20 comp rx=0 tx=0).stop 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.264+0000 7f625f253740 1 -- 172.21.15.18:0/3731955765 shutdown_connections 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.264+0000 7f625f253740 1 --2- 172.21.15.18:0/3731955765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.264+0000 7f625f253740 1 --2- 172.21.15.18:0/3731955765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eaca10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.264+0000 7f625f253740 1 --2- 172.21.15.18:0/3731955765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.264+0000 7f625f253740 1 -- 172.21.15.18:0/3731955765 >> 172.21.15.18:0/3731955765 conn(0x559682e75310 msgr2=0x559682ea8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.264+0000 7f625f253740 1 -- 172.21.15.18:0/3731955765 shutdown_connections 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.264+0000 7f625f253740 1 -- 172.21.15.18:0/3731955765 wait complete. 2024-09-19T10:00:03.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625f253740 1 -- start start 2024-09-19T10:00:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625f253740 1 Processor -- start 2024-09-19T10:00:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625f253740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625f253740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625f253740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625f253740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559682eba010 con 0x559682eadb40 2024-09-19T10:00:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625f253740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559682dcd060 con 0x559682eb7370 2024-09-19T10:00:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625f253740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559682eba190 con 0x559682eac5d0 2024-09-19T10:00:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625f253740 10 client.0 _ll_register_callbacks cb 0x559682b208c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f6255d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f6255d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55870/0 (socket says 172.21.15.18:55870) 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f6255d9b640 1 -- 172.21.15.18:0/4168694092 learned_addr learned my addr 172.21.15.18:0/4168694092 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f6256d9d640 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f6255d9b640 1 -- 172.21.15.18:0/4168694092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 msgr2=0x559682eb6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f6255d9b640 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f6255d9b640 1 -- 172.21.15.18:0/4168694092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 msgr2=0x559682eb45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f6255d9b640 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f6255d9b640 1 -- 172.21.15.18:0/4168694092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559682b833c0 con 0x559682eadb40 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.265+0000 7f625659c640 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f6255d9b640 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb3ff0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f624009bb10 tx=0x7f6240000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c4bf2136ae73c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f623dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f623dffb640 1 -- 172.21.15.18:0/4168694092 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240020040 con 0x559682eadb40 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f623dffb640 1 -- 172.21.15.18:0/4168694092 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6240098290 con 0x559682eadb40 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f625f253740 1 -- 172.21.15.18:0/4168694092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6248036040 con 0x559682eadb40 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f623dffb640 1 -- 172.21.15.18:0/4168694092 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f624009bb80 con 0x559682eadb40 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f625f253740 10 client.17289 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f625f253740 1 -- 172.21.15.18:0/4168694092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559682ec5b30 con 0x559682eadb40 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f623dffb640 1 -- 172.21.15.18:0/4168694092 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6248036040 con 0x559682eadb40 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f623dffb640 1 -- 172.21.15.18:0/4168694092 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f62400860e0 con 0x559682eadb40 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f625f253740 10 client.17289 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f625f253740 10 client.17289 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f625f253740 20 client.17289 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f625f253740 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559682ec6f40 0x559682ec9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f625f253740 4 client.17289 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.266+0000 7f625f253740 1 -- 172.21.15.18:0/4168694092 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559682e1f860 con 0x559682ec6f40 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.267+0000 7f625659c640 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559682ec6f40 0x559682ec9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.267+0000 7f623dffb640 10 client.17289 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.267+0000 7f625659c640 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559682ec6f40 0x559682ec9370 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a52dc2eb29fb4f8d server_cookie=31cba71c1b625878 in_seq=0 out_seq=0 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f623dffb640 1 -- 172.21.15.18:0/4168694092 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559682e1f860 con 0x559682ec6f40 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f623dffb640 10 client.17289 handle_command_reply: tid=0 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 client.17289 shutdown 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 -- 172.21.15.18:0/4168694092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 msgr2=0x559682eb3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb3ff0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f624009bb10 tx=0x7f6240000bc0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 -- 172.21.15.18:0/4168694092 shutdown_connections 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559682ec6f40 0x559682ec9370 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb3ff0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f623dffb640 0 client.17289 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 --2- 172.21.15.18:0/4168694092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 -- 172.21.15.18:0/4168694092 >> 172.21.15.18:0/4168694092 conn(0x559682e75310 msgr2=0x559682eae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 -- 172.21.15.18:0/4168694092 shutdown_connections 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 1 -- 172.21.15.18:0/4168694092 wait complete. 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.268+0000 7f625f253740 20 client.17289 trim_cache size 0 max 16384 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f625f253740 1 Processor -- start 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f625f253740 1 -- start start 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f625f253740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f625f253740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eadb40 0x559682eaf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f625f253740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eb7370 0x559682eaf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f625f253740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62581ad450 con 0x559682eb7370 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f625f253740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f62581aef90 con 0x559682eadb40 2024-09-19T10:00:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f625f253740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62581adb20 con 0x559682eac5d0 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f6256d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eb7370 0x559682eaf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f6256d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eb7370 0x559682eaf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55876/0 (socket says 172.21.15.18:55876) 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f6256d9d640 1 -- 172.21.15.18:0/395376778 learned_addr learned my addr 172.21.15.18:0/395376778 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f6255d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eadb40 0x559682eaf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.282+0000 7f625659c640 1 --2- 172.21.15.18:0/395376778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.283+0000 7f6256d9d640 1 -- 172.21.15.18:0/395376778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 msgr2=0x559682eb5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.283+0000 7f6256d9d640 1 --2- 172.21.15.18:0/395376778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.283+0000 7f6256d9d640 1 -- 172.21.15.18:0/395376778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eadb40 msgr2=0x559682eaf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.283+0000 7f6256d9d640 1 --2- 172.21.15.18:0/395376778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eadb40 0x559682eaf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.283+0000 7f6256d9d640 1 -- 172.21.15.18:0/395376778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559682ea9dd0 con 0x559682eb7370 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.283+0000 7f6256d9d640 1 --2- 172.21.15.18:0/395376778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eb7370 0x559682eaf660 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6250013270 tx=0x7f6250009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7e82b52377ca98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.283+0000 7f623ffff640 1 -- 172.21.15.18:0/395376778 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500037f0 con 0x559682eb7370 2024-09-19T10:00:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.283+0000 7f623ffff640 1 -- 172.21.15.18:0/395376778 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62500132a0 con 0x559682eb7370 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.283+0000 7f623ffff640 1 -- 172.21.15.18:0/395376778 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250022d70 con 0x559682eb7370 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 -- 172.21.15.18:0/395376778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eb7370 msgr2=0x559682eaf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 --2- 172.21.15.18:0/395376778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eb7370 0x559682eaf660 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6250013270 tx=0x7f6250009c00 comp rx=0 tx=0).stop 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 -- 172.21.15.18:0/395376778 shutdown_connections 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 --2- 172.21.15.18:0/395376778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eb7370 0x559682eaf660 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 --2- 172.21.15.18:0/395376778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eadb40 0x559682eaf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 --2- 172.21.15.18:0/395376778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 -- 172.21.15.18:0/395376778 >> 172.21.15.18:0/395376778 conn(0x559682e75310 msgr2=0x559682eb5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 -- 172.21.15.18:0/395376778 shutdown_connections 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 -- 172.21.15.18:0/395376778 wait complete. 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 -- start start 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.284+0000 7f625f253740 1 Processor -- start 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f625f253740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f625f253740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f625f253740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f625f253740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62581ae8c0 con 0x559682eadb40 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f625f253740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f62581ae1f0 con 0x559682eb7370 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f625f253740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62581ab450 con 0x559682eac5d0 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f625f253740 10 client.0 _ll_register_callbacks cb 0x7f624000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6255d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f625659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6255d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55890/0 (socket says 172.21.15.18:55890) 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6255d9b640 1 -- 172.21.15.18:0/323517584 learned_addr learned my addr 172.21.15.18:0/323517584 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6256d9d640 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6255d9b640 1 -- 172.21.15.18:0/323517584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 msgr2=0x559682eb11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6255d9b640 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6255d9b640 1 -- 172.21.15.18:0/323517584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 msgr2=0x559682eb1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6255d9b640 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6255d9b640 1 -- 172.21.15.18:0/323517584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559682f39620 con 0x559682eadb40 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6256d9d640 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f6255d9b640 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb1710 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f6240097fe0 tx=0x7f624009afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ce3f5b240d3ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f623dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f623dffb640 1 -- 172.21.15.18:0/323517584 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240064020 con 0x559682eadb40 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f623dffb640 1 -- 172.21.15.18:0/323517584 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f62400978d0 con 0x559682eadb40 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.285+0000 7f625f253740 1 -- 172.21.15.18:0/323517584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62500132a0 con 0x559682eadb40 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f623dffb640 1 -- 172.21.15.18:0/323517584 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6240020070 con 0x559682eadb40 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f625f253740 10 client.17295 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f625f253740 1 -- 172.21.15.18:0/323517584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559682f3a8c0 con 0x559682eadb40 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f623dffb640 1 -- 172.21.15.18:0/323517584 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62500132a0 con 0x559682eadb40 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f623dffb640 1 -- 172.21.15.18:0/323517584 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f624009b130 con 0x559682eadb40 2024-09-19T10:00:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f625f253740 10 client.17295 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f625f253740 10 client.17295 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f625f253740 20 client.17295 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f625f253740 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559682f3af20 0x559682f3d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f625f253740 4 client.17295 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f625f253740 1 -- 172.21.15.18:0/323517584 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559682e19d70 con 0x559682f3af20 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.286+0000 7f625659c640 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559682f3af20 0x559682f3d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625659c640 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559682f3af20 0x559682f3d340 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d92f1fd864ee6d59 server_cookie=4543554f7a1fa520 in_seq=0 out_seq=0 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f623dffb640 10 client.17295 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f623dffb640 1 -- 172.21.15.18:0/323517584 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559682e19d70 con 0x559682f3af20 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f623dffb640 10 client.17295 handle_command_reply: tid=0 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 client.17295 shutdown 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 -- 172.21.15.18:0/323517584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 msgr2=0x559682eb1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:03.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb1710 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f6240097fe0 tx=0x7f624009afd0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 -- 172.21.15.18:0/323517584 shutdown_connections 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x559682f3af20 0x559682f3d340 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559682eb7370 0x559682eb1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559682eadb40 0x559682eb1710 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 --2- 172.21.15.18:0/323517584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559682eac5d0 0x559682eb11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 -- 172.21.15.18:0/323517584 >> 172.21.15.18:0/323517584 conn(0x559682e75310 msgr2=0x559682eb6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f623dffb640 0 client.17295 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 -- 172.21.15.18:0/323517584 shutdown_connections 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 1 -- 172.21.15.18:0/323517584 wait complete. 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625f253740 20 client.17295 trim_cache size 0 max 16384 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.287+0000 7f625ce7a640 1 -- 172.21.15.18:0/677881309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f62440a3240 msgr2=0x7f62440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f62440a3240 0x7f62440a5700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6250009fd0 tx=0x7f6250004730 comp rx=0 tx=0).stop 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 -- 172.21.15.18:0/677881309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6258101420 msgr2=0x7f6258199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6258101420 0x7f6258199880 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f624000d950 tx=0x7f624000de10 comp rx=0 tx=0).stop 2024-09-19T10:00:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 -- 172.21.15.18:0/677881309 shutdown_connections 2024-09-19T10:00:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f62440a3240 0x7f62440a5700 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6258106a80 0x7f62581a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6258101420 0x7f6258199880 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 --2- 172.21.15.18:0/677881309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6258100a80 0x7f6258199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 -- 172.21.15.18:0/677881309 >> 172.21.15.18:0/677881309 conn(0x7f62580fc7a0 msgr2=0x7f62580fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 -- 172.21.15.18:0/677881309 shutdown_connections 2024-09-19T10:00:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:03.288+0000 7f625ce7a640 1 -- 172.21.15.18:0/677881309 wait complete. 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efddaffd640 1 -- 172.21.15.18:0/2207148463 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7efdf4004270 con 0x55cb631912c0 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efddaffd640 10 client.26702 handle_command_reply: tid=0 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 client.26702 shutdown 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 -- 172.21.15.18:0/2207148463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 msgr2=0x55cb6318fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb6318fcb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efdf4031000 tx=0x7efdf4009740 comp rx=0 tx=0).stop 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 -- 172.21.15.18:0/2207148463 shutdown_connections 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cb631912c0 0x55cb631936b0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb6310da30 0x55cb6318fcb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cb63103170 0x55cb63112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 --2- 172.21.15.18:0/2207148463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cb63102850 0x55cb63111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 -- 172.21.15.18:0/2207148463 >> 172.21.15.18:0/2207148463 conn(0x55cb630fede0 msgr2=0x55cb630fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:04.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efddaffd640 0 client.26702 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:04.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 -- 172.21.15.18:0/2207148463 shutdown_connections 2024-09-19T10:00:04.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.118+0000 7efe04625740 1 -- 172.21.15.18:0/2207148463 wait complete. 2024-09-19T10:00:04.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3af7fe640 1 -- 172.21.15.18:0/1389471815 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ef430f900 con 0x558ef44a9080 2024-09-19T10:00:04.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3af7fe640 10 client.26689 handle_command_reply: tid=0 2024-09-19T10:00:04.122 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 client.26689 shutdown 2024-09-19T10:00:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.119+0000 7efe04625740 20 client.26702 trim_cache size 0 max 16384 2024-09-19T10:00:04.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 -- 172.21.15.18:0/1389471815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef4437140 msgr2=0x558ef4450c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:04.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef4437140 0x558ef4450c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x558ef444cd20 tx=0x7ff3c0068040 comp rx=0 tx=0).stop 2024-09-19T10:00:04.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 -- 172.21.15.18:0/1389471815 shutdown_connections 2024-09-19T10:00:04.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ef44a9080 0x558ef44ab470 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ef4437140 0x558ef4450c90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ef442d370 0x558ef444dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3af7fe640 0 client.26689 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:04.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 --2- 172.21.15.18:0/1389471815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ef44279a0 0x558ef444d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.124 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 -- 172.21.15.18:0/1389471815 >> 172.21.15.18:0/1389471815 conn(0x558ef4423010 msgr2=0x558ef4423ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:04.124 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:00:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T10:00:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T10:00:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 26, 2024-09-19T10:00:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "2809e3bc": { 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 26, 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 145.8, 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:00:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T10:00:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:00:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:04.126 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:00:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 -- 172.21.15.18:0/1389471815 shutdown_connections 2024-09-19T10:00:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 1 -- 172.21.15.18:0/1389471815 wait complete. 2024-09-19T10:00:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.119+0000 7ff3d926b740 20 client.26689 trim_cache size 0 max 16384 2024-09-19T10:00:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:00:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:00:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:00:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:00:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 -- 172.21.15.18:0/2875971890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efde40a33c0 msgr2=0x7efde40a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efde40a33c0 0x7efde40a5880 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efdec09c200 tx=0x7efdec000f40 comp rx=0 tx=0).stop 2024-09-19T10:00:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 -- 172.21.15.18:0/2875971890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc10d9b0 msgr2=0x7efdfc1a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc10d9b0 0x7efdfc1a4760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efdec00cce0 tx=0x7efdec00a620 comp rx=0 tx=0).stop 2024-09-19T10:00:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 -- 172.21.15.18:0/2875971890 shutdown_connections 2024-09-19T10:00:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efde40a33c0 0x7efde40a5880 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc19e920 0x7efdfc19edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdfc10e580 0x7efdfc1a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 --2- 172.21.15.18:0/2875971890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdfc10d9b0 0x7efdfc1a4760 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 -- 172.21.15.18:0/2875971890 >> 172.21.15.18:0/2875971890 conn(0x7efdfc06e140 msgr2=0x7efdfc072530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:04.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 -- 172.21.15.18:0/2875971890 shutdown_connections 2024-09-19T10:00:04.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:04.120+0000 7efe0224c640 1 -- 172.21.15.18:0/2875971890 wait complete. 2024-09-19T10:00:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 -- 172.21.15.18:0/1107200061 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff3b80a34b0 msgr2=0x7ff3b80a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff3b80a34b0 0x7ff3b80a5970 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff3c409b470 tx=0x7ff3c40057a0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 -- 172.21.15.18:0/1107200061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d0078790 msgr2=0x7ff3d010fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d0078790 0x7ff3d010fcc0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400d750 tx=0x7ff3c400dc10 comp rx=0 tx=0).stop 2024-09-19T10:00:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 -- 172.21.15.18:0/1107200061 shutdown_connections 2024-09-19T10:00:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff3b80a34b0 0x7ff3b80a5970 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d0078790 0x7ff3d010fcc0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d0077df0 0x7ff3d0108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 --2- 172.21.15.18:0/1107200061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3d0076bb0 0x7ff3d0108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 -- 172.21.15.18:0/1107200061 >> 172.21.15.18:0/1107200061 conn(0x7ff3d00ff4e0 msgr2=0x7ff3d0100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 -- 172.21.15.18:0/1107200061 shutdown_connections 2024-09-19T10:00:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:04.121+0000 7ff3d63f6640 1 -- 172.21.15.18:0/1107200061 wait complete. 2024-09-19T10:00:04.172 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T10:00:04.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:04 smithi162 ceph-mon[35174]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 125 GiB used, 948 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 804 MiB/s wr, 1.53k op/s 2024-09-19T10:00:04.794 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:04 smithi018 ceph-mon[30956]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 125 GiB used, 948 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 804 MiB/s wr, 1.53k op/s 2024-09-19T10:00:04.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:04 smithi049 ceph-mon[34858]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 125 GiB used, 948 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 804 MiB/s wr, 1.53k op/s 2024-09-19T10:00:04.961 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2809e3bc', quiesce took 20.4 seconds. Will release after: 5.350000000000001 2024-09-19T10:00:04.990 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:05.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.466+0000 7f051a834640 1 -- 172.21.15.18:0/1007076538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514101420 msgr2=0x7f051410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:05.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.466+0000 7f051a834640 1 --2- 172.21.15.18:0/1007076538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514101420 0x7f051410d950 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f050c009cd0 tx=0x7f050c02a8e0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.466+0000 7f051a834640 1 -- 172.21.15.18:0/1007076538 shutdown_connections 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.466+0000 7f051a834640 1 --2- 172.21.15.18:0/1007076538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514101420 0x7f051410d950 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.466+0000 7f051a834640 1 --2- 172.21.15.18:0/1007076538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514100a80 0x7f0514100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.466+0000 7f051a834640 1 --2- 172.21.15.18:0/1007076538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514106a80 0x7f0514106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.467+0000 7f051a834640 1 -- 172.21.15.18:0/1007076538 >> 172.21.15.18:0/1007076538 conn(0x7f05140fc7a0 msgr2=0x7f05140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.467+0000 7f051a834640 1 -- 172.21.15.18:0/1007076538 shutdown_connections 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.467+0000 7f051a834640 1 -- 172.21.15.18:0/1007076538 wait complete. 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.467+0000 7f051a834640 1 Processor -- start 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.467+0000 7f051a834640 1 -- start start 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f051a834640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514100a80 0x7f0514199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f051a834640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514101420 0x7f05141997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f051a834640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514106a80 0x7f05141a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f051a834640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0514110e80 con 0x7f0514100a80 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f051a834640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0514110d00 con 0x7f0514106a80 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f051a834640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0514111000 con 0x7f0514101420 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514100a80 0x7f0514199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514100a80 0x7f0514199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55902/0 (socket says 172.21.15.18:55902) 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f0513fff640 1 -- 172.21.15.18:0/3133904460 learned_addr learned my addr 172.21.15.18:0/3133904460 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f05137fe640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514101420 0x7f05141997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f0518dd1640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514106a80 0x7f05141a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f0513fff640 1 -- 172.21.15.18:0/3133904460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514101420 msgr2=0x7f05141997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f0513fff640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514101420 0x7f05141997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f0513fff640 1 -- 172.21.15.18:0/3133904460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514106a80 msgr2=0x7f05141a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f0513fff640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514106a80 0x7f05141a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f0513fff640 1 -- 172.21.15.18:0/3133904460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05141a4850 con 0x7f0514100a80 2024-09-19T10:00:05.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f05137fe640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514101420 0x7f05141997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.468+0000 7f0513fff640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514100a80 0x7f0514199290 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f050400e9f0 tx=0x7f050400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.469+0000 7f05117fa640 1 -- 172.21.15.18:0/3133904460 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050400cd80 con 0x7f0514100a80 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.469+0000 7f05117fa640 1 -- 172.21.15.18:0/3133904460 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0504005500 con 0x7f0514100a80 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.469+0000 7f051a834640 1 -- 172.21.15.18:0/3133904460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05141a4a20 con 0x7f0514100a80 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.469+0000 7f05117fa640 1 -- 172.21.15.18:0/3133904460 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504010690 con 0x7f0514100a80 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.469+0000 7f051a834640 1 -- 172.21.15.18:0/3133904460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05141a4ee0 con 0x7f0514100a80 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.471+0000 7f05117fa640 1 -- 172.21.15.18:0/3133904460 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f05040046c0 con 0x7f0514100a80 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.471+0000 7f051cc0d740 1 Processor -- start 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f051cc0d740 1 -- start start 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c37796090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377965d0 0x560c37796a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377a1370 0x560c377a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f051cc0d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560c376fc2f0 con 0x560c377a1370 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f051cc0d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560c376a3cf0 con 0x560c37797b40 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f051cc0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560c376f82b0 con 0x560c377965d0 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f05137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377a1370 0x560c377a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f05137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377a1370 0x560c377a3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55916/0 (socket says 172.21.15.18:55916) 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f05137fe640 1 -- 172.21.15.18:0/2104602050 learned_addr learned my addr 172.21.15.18:0/2104602050 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f05117fa640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3240 0x7f04fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f0513fff640 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377965d0 0x560c37796a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f0518dd1640 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c37796090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f0518dd1640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3240 0x7f04fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f05137fe640 1 -- 172.21.15.18:0/2104602050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377965d0 msgr2=0x560c37796a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:05.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f05137fe640 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377965d0 0x560c37796a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f05137fe640 1 -- 172.21.15.18:0/2104602050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 msgr2=0x560c37796090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f05137fe640 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c37796090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f05137fe640 1 -- 172.21.15.18:0/2104602050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c376883a0 con 0x560c377a1370 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f0513fff640 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377965d0 0x560c37796a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f0518dd1640 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c37796090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.472+0000 7f05117fa640 1 -- 172.21.15.18:0/3133904460 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f05040cfc80 con 0x7f0514100a80 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.473+0000 7f05137fe640 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377a1370 0x560c377a3760 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0508010480 tx=0x7f0508010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebaa17cfa95dd459 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.473+0000 7f0518dd1640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3240 0x7f04fc0a5700 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f050c004ab0 tx=0x7f050c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.473+0000 7f04fa7fc640 1 -- 172.21.15.18:0/2104602050 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508011760 con 0x560c377a1370 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.473+0000 7f04fa7fc640 1 -- 172.21.15.18:0/2104602050 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0508011de0 con 0x560c377a1370 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.473+0000 7f04fa7fc640 1 -- 172.21.15.18:0/2104602050 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050801a380 con 0x560c377a1370 2024-09-19T10:00:05.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.473+0000 7f051cc0d740 1 -- 172.21.15.18:0/2104602050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377a1370 msgr2=0x560c377a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:05.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.473+0000 7f051cc0d740 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377a1370 0x560c377a3760 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0508010480 tx=0x7f0508010940 comp rx=0 tx=0).stop 2024-09-19T10:00:05.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 -- 172.21.15.18:0/2104602050 shutdown_connections 2024-09-19T10:00:05.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377a1370 0x560c377a3760 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377965d0 0x560c37796a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 --2- 172.21.15.18:0/2104602050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c37796090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 -- 172.21.15.18:0/2104602050 >> 172.21.15.18:0/2104602050 conn(0x560c3775f310 msgr2=0x560c37792c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:05.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 -- 172.21.15.18:0/2104602050 shutdown_connections 2024-09-19T10:00:05.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 -- 172.21.15.18:0/2104602050 wait complete. 2024-09-19T10:00:05.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 -- start start 2024-09-19T10:00:05.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 Processor -- start 2024-09-19T10:00:05.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c3779dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 0x560c3779e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560c377a4070 con 0x560c377965d0 2024-09-19T10:00:05.707 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:00:05.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560c376b7060 con 0x560c37797b40 2024-09-19T10:00:05.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560c377a41f0 con 0x560c377a1370 2024-09-19T10:00:05.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.474+0000 7f051cc0d740 10 client.0 _ll_register_callbacks cb 0x560c3740a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:05.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55926/0 (socket says 172.21.15.18:55926) 2024-09-19T10:00:05.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f0518dd1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 0x560c3779e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f0513fff640 1 -- 172.21.15.18:0/1178851483 learned_addr learned my addr 172.21.15.18:0/1178851483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f05137fe640 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c3779dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f0513fff640 1 -- 172.21.15.18:0/1178851483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 msgr2=0x560c3779e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f0513fff640 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 0x560c3779e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f0513fff640 1 -- 172.21.15.18:0/1178851483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 msgr2=0x560c3779dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f0513fff640 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c3779dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f0513fff640 1 -- 172.21.15.18:0/1178851483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c3746d3c0 con 0x560c377965d0 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f0513fff640 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a0cf0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f050400c6a0 tx=0x7f050409bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c42bcee321fafa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f04f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f04f37fe640 1 -- 172.21.15.18:0/1178851483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05040a4cb0 con 0x560c377965d0 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f04f37fe640 1 -- 172.21.15.18:0/1178851483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f05040bc0c0 con 0x560c377965d0 2024-09-19T10:00:05.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f051cc0d740 1 -- 172.21.15.18:0/1178851483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0508011de0 con 0x560c377965d0 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f04f37fe640 1 -- 172.21.15.18:0/1178851483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f050409c2d0 con 0x560c377965d0 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f051cc0d740 10 client.17307 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.475+0000 7f051cc0d740 1 -- 172.21.15.18:0/1178851483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560c377afb00 con 0x560c377965d0 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f04f37fe640 1 -- 172.21.15.18:0/1178851483 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0508011de0 con 0x560c377965d0 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f04f37fe640 1 -- 172.21.15.18:0/1178851483 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f050409b720 con 0x560c377965d0 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f051cc0d740 10 client.17307 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f051cc0d740 10 client.17307 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f051cc0d740 20 client.17307 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f051cc0d740 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560c377b0f10 0x560c377b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f051cc0d740 4 client.17307 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f051cc0d740 1 -- 172.21.15.18:0/1178851483 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c37709860 con 0x560c377b0f10 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f05137fe640 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560c377b0f10 0x560c377b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f04f37fe640 10 client.17307 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.476+0000 7f05137fe640 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560c377b0f10 0x560c377b3340 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e4bc42c6749a9da4 server_cookie=79a28c16d6ae08a9 in_seq=0 out_seq=0 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f04f37fe640 1 -- 172.21.15.18:0/1178851483 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c37709860 con 0x560c377b0f10 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f04f37fe640 10 client.17307 handle_command_reply: tid=0 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f051cc0d740 1 client.17307 shutdown 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f051cc0d740 1 -- 172.21.15.18:0/1178851483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 msgr2=0x560c377a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f051cc0d740 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a0cf0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f050400c6a0 tx=0x7f050409bed0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f051cc0d740 1 -- 172.21.15.18:0/1178851483 shutdown_connections 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f051cc0d740 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560c377b0f10 0x560c377b3340 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f04f37fe640 0 client.17307 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f051cc0d740 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 0x560c3779e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f051cc0d740 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c3779dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f051cc0d740 1 --2- 172.21.15.18:0/1178851483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a0cf0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.477+0000 7f051cc0d740 1 -- 172.21.15.18:0/1178851483 >> 172.21.15.18:0/1178851483 conn(0x560c3775f310 msgr2=0x560c37798960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.478+0000 7f051cc0d740 1 -- 172.21.15.18:0/1178851483 shutdown_connections 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.478+0000 7f051cc0d740 1 -- 172.21.15.18:0/1178851483 wait complete. 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.478+0000 7f051cc0d740 20 client.17307 trim_cache size 0 max 16384 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.490+0000 7f051cc0d740 1 Processor -- start 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.490+0000 7f051cc0d740 1 -- start start 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377ad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c377b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 0x560c377b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f051cc0d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05141ad4a0 con 0x560c377965d0 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f051cc0d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05141aefe0 con 0x560c37797b40 2024-09-19T10:00:05.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f051cc0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05141adb70 con 0x560c377a1370 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377ad310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55940/0 (socket says 172.21.15.18:55940) 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0513fff640 1 -- 172.21.15.18:0/2359388325 learned_addr learned my addr 172.21.15.18:0/2359388325 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0518dd1640 1 --2- 172.21.15.18:0/2359388325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 0x560c377b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0513fff640 1 -- 172.21.15.18:0/2359388325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 msgr2=0x560c377b90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0513fff640 1 --2- 172.21.15.18:0/2359388325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 0x560c377b90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0513fff640 1 -- 172.21.15.18:0/2359388325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 msgr2=0x560c377b8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0513fff640 1 --2- 172.21.15.18:0/2359388325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c377b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0513fff640 1 -- 172.21.15.18:0/2359388325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c37799120 con 0x560c377965d0 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0518dd1640 1 --2- 172.21.15.18:0/2359388325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 0x560c377b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f0513fff640 1 --2- 172.21.15.18:0/2359388325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377ad310 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f050409a580 tx=0x7f050409a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4155e7d7d8a4eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f04f9ffb640 1 -- 172.21.15.18:0/2359388325 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05040b5120 con 0x560c377965d0 2024-09-19T10:00:05.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f04f9ffb640 1 -- 172.21.15.18:0/2359388325 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05040a0680 con 0x560c377965d0 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.491+0000 7f04f9ffb640 1 -- 172.21.15.18:0/2359388325 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05040a4ab0 con 0x560c377965d0 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.492+0000 7f051cc0d740 1 -- 172.21.15.18:0/2359388325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 msgr2=0x560c377ad310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.492+0000 7f051cc0d740 1 --2- 172.21.15.18:0/2359388325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377ad310 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f050409a580 tx=0x7f050409a7e0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.492+0000 7f051cc0d740 1 -- 172.21.15.18:0/2359388325 shutdown_connections 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.492+0000 7f051cc0d740 1 --2- 172.21.15.18:0/2359388325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c377a1370 0x560c377b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.492+0000 7f051cc0d740 1 --2- 172.21.15.18:0/2359388325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c37797b40 0x560c377b8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.492+0000 7f051cc0d740 1 --2- 172.21.15.18:0/2359388325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377ad310 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.492+0000 7f051cc0d740 1 -- 172.21.15.18:0/2359388325 >> 172.21.15.18:0/2359388325 conn(0x560c3775f310 msgr2=0x560c3779c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.492+0000 7f051cc0d740 1 -- 172.21.15.18:0/2359388325 shutdown_connections 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.492+0000 7f051cc0d740 1 -- 172.21.15.18:0/2359388325 wait complete. 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.492+0000 7f051cc0d740 1 -- start start 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f051cc0d740 1 Processor -- start 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c37797b40 0x560c377a5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f051cc0d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c377a1370 0x560c377a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f051cc0d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05141ae910 con 0x560c377965d0 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f051cc0d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05141ae240 con 0x560c377a1370 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f051cc0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05141ab480 con 0x560c37797b40 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f051cc0d740 10 client.0 _ll_register_callbacks cb 0x7f0504096cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f0513fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55956/0 (socket says 172.21.15.18:55956) 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f0513fff640 1 -- 172.21.15.18:0/441495826 learned_addr learned my addr 172.21.15.18:0/441495826 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f0518dd1640 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c377a1370 0x560c377a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f05137fe640 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c37797b40 0x560c377a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f0513fff640 1 -- 172.21.15.18:0/441495826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c37797b40 msgr2=0x560c377a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f0513fff640 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c37797b40 0x560c377a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f0513fff640 1 -- 172.21.15.18:0/441495826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c377a1370 msgr2=0x560c377a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:05.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f0513fff640 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c377a1370 0x560c377a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.493+0000 7f0513fff640 1 -- 172.21.15.18:0/441495826 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c3781ef50 con 0x560c377965d0 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f0513fff640 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a5110 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f05040cd800 tx=0x7f0504004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba36da3be5a126a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f04f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f04f37fe640 1 -- 172.21.15.18:0/441495826 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05040b5120 con 0x560c377965d0 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f04f37fe640 1 -- 172.21.15.18:0/441495826 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f05040a0120 con 0x560c377965d0 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f051cc0d740 1 -- 172.21.15.18:0/441495826 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05040a0680 con 0x560c377965d0 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f04f37fe640 1 -- 172.21.15.18:0/441495826 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05040a4f40 con 0x560c377965d0 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f051cc0d740 10 client.17313 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f051cc0d740 1 -- 172.21.15.18:0/441495826 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560c37820170 con 0x560c377965d0 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f04f37fe640 1 -- 172.21.15.18:0/441495826 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05040a0680 con 0x560c377965d0 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f04f37fe640 1 -- 172.21.15.18:0/441495826 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f05040a1810 con 0x560c377965d0 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f051cc0d740 10 client.17313 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:05.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f051cc0d740 10 client.17313 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f051cc0d740 20 client.17313 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f051cc0d740 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560c377b0f10 0x560c37822650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f051cc0d740 4 client.17313 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.494+0000 7f051cc0d740 1 -- 172.21.15.18:0/441495826 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c37703d70 con 0x560c377b0f10 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f05137fe640 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560c377b0f10 0x560c37822650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f05137fe640 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560c377b0f10 0x560c37822650 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d6d355bf3dfb34b4 server_cookie=a30cd75133e764da in_seq=0 out_seq=0 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f04f37fe640 10 client.17313 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f04f37fe640 1 -- 172.21.15.18:0/441495826 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c37703d70 con 0x560c377b0f10 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f04f37fe640 10 client.17313 handle_command_reply: tid=0 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f051cc0d740 1 client.17313 shutdown 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f051cc0d740 1 -- 172.21.15.18:0/441495826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 msgr2=0x560c377a5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f051cc0d740 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a5110 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f05040cd800 tx=0x7f0504004a40 comp rx=0 tx=0).stop 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f051cc0d740 1 -- 172.21.15.18:0/441495826 shutdown_connections 2024-09-19T10:00:05.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f051cc0d740 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x560c377b0f10 0x560c37822650 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f051cc0d740 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c377a1370 0x560c377a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f051cc0d740 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c37797b40 0x560c377a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f051cc0d740 1 --2- 172.21.15.18:0/441495826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c377965d0 0x560c377a5110 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f04f37fe640 0 client.17313 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.495+0000 7f051cc0d740 1 -- 172.21.15.18:0/441495826 >> 172.21.15.18:0/441495826 conn(0x560c3775f310 msgr2=0x560c37798110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051cc0d740 1 -- 172.21.15.18:0/441495826 shutdown_connections 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051cc0d740 1 -- 172.21.15.18:0/441495826 wait complete. 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051cc0d740 20 client.17313 trim_cache size 0 max 16384 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 -- 172.21.15.18:0/3133904460 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3240 msgr2=0x7f04fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3240 0x7f04fc0a5700 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f050c004ab0 tx=0x7f050c004a40 comp rx=0 tx=0).stop 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 -- 172.21.15.18:0/3133904460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514100a80 msgr2=0x7f0514199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514100a80 0x7f0514199290 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f050400e9f0 tx=0x7f050400edf0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 -- 172.21.15.18:0/3133904460 shutdown_connections 2024-09-19T10:00:05.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f04fc0a3240 0x7f04fc0a5700 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0514106a80 0x7f05141a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0514101420 0x7f05141997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 --2- 172.21.15.18:0/3133904460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0514100a80 0x7f0514199290 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:05.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 -- 172.21.15.18:0/3133904460 >> 172.21.15.18:0/3133904460 conn(0x7f05140fc7a0 msgr2=0x7f05140fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:05.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 -- 172.21.15.18:0/3133904460 shutdown_connections 2024-09-19T10:00:05.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:05.496+0000 7f051a834640 1 -- 172.21.15.18:0/3133904460 wait complete. 2024-09-19T10:00:06.466 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:06 smithi018 ceph-mon[30956]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 126 GiB used, 947 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 686 MiB/s wr, 1.32k op/s 2024-09-19T10:00:06.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T10:00:06.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:06 smithi049 ceph-mon[34858]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 126 GiB used, 947 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 686 MiB/s wr, 1.32k op/s 2024-09-19T10:00:06.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:06 smithi162 ceph-mon[35174]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 126 GiB used, 947 GiB / 1.0 TiB avail; 3.0 MiB/s rd, 686 MiB/s wr, 1.32k op/s 2024-09-19T10:00:06.957 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:07.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.601+0000 7f2135e3e640 1 -- 172.21.15.18:0/3072256286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2130103760 msgr2=0x7f2130107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:07.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.601+0000 7f2135e3e640 1 --2- 172.21.15.18:0/3072256286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2130103760 0x7f2130107ba0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2124009930 tx=0x7f212402a420 comp rx=0 tx=0).stop 2024-09-19T10:00:07.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.601+0000 7f2135e3e640 1 -- 172.21.15.18:0/3072256286 shutdown_connections 2024-09-19T10:00:07.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.601+0000 7f2135e3e640 1 --2- 172.21.15.18:0/3072256286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21301082e0 0x7f213010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.601+0000 7f2135e3e640 1 --2- 172.21.15.18:0/3072256286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2130103760 0x7f2130107ba0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.601+0000 7f2135e3e640 1 --2- 172.21.15.18:0/3072256286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2130102db0 0x7f2130103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.601+0000 7f2135e3e640 1 -- 172.21.15.18:0/3072256286 >> 172.21.15.18:0/3072256286 conn(0x7f21300fc7d0 msgr2=0x7f21300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.601+0000 7f2135e3e640 1 -- 172.21.15.18:0/3072256286 shutdown_connections 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.602+0000 7f2135e3e640 1 -- 172.21.15.18:0/3072256286 wait complete. 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.602+0000 7f2135e3e640 1 Processor -- start 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.602+0000 7f2135e3e640 1 -- start start 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.602+0000 7f2135e3e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130102db0 0x7f21301a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.602+0000 7f2135e3e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2130103760 0x7f21301a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.602+0000 7f2135e3e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21301082e0 0x7f213019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.602+0000 7f2135e3e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2130112070 con 0x7f21301082e0 2024-09-19T10:00:07.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.602+0000 7f2135e3e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2130111ef0 con 0x7f2130102db0 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.602+0000 7f2135e3e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21301121f0 con 0x7f2130103760 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21301082e0 0x7f213019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2130103760 0x7f21301a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21301082e0 0x7f213019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37990/0 (socket says 172.21.15.18:37990) 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212ffff640 1 -- 172.21.15.18:0/3300870500 learned_addr learned my addr 172.21.15.18:0/3300870500 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212f7fe640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130102db0 0x7f21301a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212ffff640 1 -- 172.21.15.18:0/3300870500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2130103760 msgr2=0x7f21301a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212ffff640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2130103760 0x7f21301a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212ffff640 1 -- 172.21.15.18:0/3300870500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130102db0 msgr2=0x7f21301a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212ffff640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130102db0 0x7f21301a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212ffff640 1 -- 172.21.15.18:0/3300870500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213019ad10 con 0x7f21301082e0 2024-09-19T10:00:07.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212f7fe640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130102db0 0x7f21301a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212ffff640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21301082e0 0x7f213019a5e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f212800d750 tx=0x7f212800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212cff9640 1 -- 172.21.15.18:0/3300870500 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128017070 con 0x7f21301082e0 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f2135e3e640 1 -- 172.21.15.18:0/3300870500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213019b000 con 0x7f21301082e0 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212cff9640 1 -- 172.21.15.18:0/3300870500 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2128005500 con 0x7f21301082e0 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f212cff9640 1 -- 172.21.15.18:0/3300870500 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128004d90 con 0x7f21301082e0 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.603+0000 7f2135e3e640 1 -- 172.21.15.18:0/3300870500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21301a72f0 con 0x7f21301082e0 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f212cff9640 1 -- 172.21.15.18:0/3300870500 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2128004f30 con 0x7f21301082e0 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f2138217740 1 Processor -- start 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f2138217740 1 -- start start 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f2138217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be8b40 0x55cc09be7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f2138217740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be75d0 0x55cc09be7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f2138217740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 0x55cc09bf4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f2138217740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cc09b4d2f0 con 0x55cc09bf2370 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f2138217740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cc09af4cf0 con 0x55cc09be75d0 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f2138217740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cc09b492b0 con 0x55cc09be8b40 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f212cff9640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21180a3240 0x7f21180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f212effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be8b40 0x55cc09be7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f212effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be8b40 0x55cc09be7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:56654/0 (socket says 172.21.15.18:56654) 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f212effd640 1 -- 172.21.15.18:0/6357085 learned_addr learned my addr 172.21.15.18:0/6357085 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.606+0000 7f212f7fe640 1 --2- 172.21.15.18:0/6357085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be75d0 0x55cc09be7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212effd640 1 --2- 172.21.15.18:0/6357085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 0x55cc09bf4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212cff9640 1 -- 172.21.15.18:0/3300870500 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f21280cf250 con 0x7f21301082e0 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212ffff640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21180a3240 0x7f21180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212f7fe640 1 -- 172.21.15.18:0/6357085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be8b40 msgr2=0x55cc09be7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212f7fe640 1 --2- 172.21.15.18:0/6357085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be8b40 0x55cc09be7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212f7fe640 1 -- 172.21.15.18:0/6357085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 msgr2=0x55cc09bf4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212f7fe640 1 --2- 172.21.15.18:0/6357085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 0x55cc09bf4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212f7fe640 1 -- 172.21.15.18:0/6357085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc09ad93a0 con 0x55cc09be75d0 2024-09-19T10:00:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212effd640 1 --2- 172.21.15.18:0/6357085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be8b40 0x55cc09be7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212ffff640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21180a3240 0x7f21180a5700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f21280ccd80 tx=0x7f2128086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.607+0000 7f212f7fe640 1 --2- 172.21.15.18:0/6357085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be75d0 0x55cc09be7a10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2120009f40 tx=0x7f212000f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a32350ddba996d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.608+0000 7f2115ffb640 1 -- 172.21.15.18:0/6357085 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120003b70 con 0x55cc09be75d0 2024-09-19T10:00:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.608+0000 7f2115ffb640 1 -- 172.21.15.18:0/6357085 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2120003d10 con 0x55cc09be75d0 2024-09-19T10:00:07.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.608+0000 7f2115ffb640 1 -- 172.21.15.18:0/6357085 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21200119a0 con 0x55cc09be75d0 2024-09-19T10:00:07.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 -- 172.21.15.18:0/6357085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be75d0 msgr2=0x55cc09be7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:07.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 --2- 172.21.15.18:0/6357085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be75d0 0x55cc09be7a10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2120009f40 tx=0x7f212000f7f0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 -- 172.21.15.18:0/6357085 shutdown_connections 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 --2- 172.21.15.18:0/6357085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 0x55cc09bf4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 --2- 172.21.15.18:0/6357085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be75d0 0x55cc09be7a10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 --2- 172.21.15.18:0/6357085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be8b40 0x55cc09be7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 -- 172.21.15.18:0/6357085 >> 172.21.15.18:0/6357085 conn(0x55cc09bb0310 msgr2=0x55cc09be3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 -- 172.21.15.18:0/6357085 shutdown_connections 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 -- 172.21.15.18:0/6357085 wait complete. 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 -- start start 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.609+0000 7f2138217740 1 Processor -- start 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f2138217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bf1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f2138217740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09beefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f2138217740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09bf2370 0x55cc09bef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f2138217740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cc09bf5070 con 0x55cc09be8b40 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f2138217740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cc09b08060 con 0x55cc09bf2370 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f2138217740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cc09bf51f0 con 0x55cc09be75d0 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f2138217740 10 client.0 _ll_register_callbacks cb 0x55cc0985b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09beefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bf1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bf1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:56666/0 (socket says 172.21.15.18:56666) 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212effd640 1 -- 172.21.15.18:0/2320736412 learned_addr learned my addr 172.21.15.18:0/2320736412 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09beefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38012/0 (socket says 172.21.15.18:38012) 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212effd640 1 -- 172.21.15.18:0/2320736412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09bf2370 msgr2=0x55cc09bef5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212effd640 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09bf2370 0x55cc09bef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212effd640 1 -- 172.21.15.18:0/2320736412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 msgr2=0x55cc09beefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212effd640 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09beefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212effd640 1 -- 172.21.15.18:0/2320736412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc098be3c0 con 0x55cc09be75d0 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f212effd640 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bf1d30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2124009230 tx=0x7f2124004510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c732e2309e779056 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.610+0000 7f210effd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f210effd640 1 -- 172.21.15.18:0/2320736412 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2124035040 con 0x55cc09be75d0 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f210effd640 1 -- 172.21.15.18:0/2320736412 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2124031b80 con 0x55cc09be75d0 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f2138217740 1 -- 172.21.15.18:0/2320736412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2120003d10 con 0x55cc09be75d0 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f210effd640 1 -- 172.21.15.18:0/2320736412 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2124031d80 con 0x55cc09be75d0 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f2138217740 10 client.26767 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f2138217740 1 -- 172.21.15.18:0/2320736412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cc09c00ad0 con 0x55cc09be75d0 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f210effd640 1 -- 172.21.15.18:0/2320736412 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2120003d10 con 0x55cc09be75d0 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f210effd640 1 -- 172.21.15.18:0/2320736412 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f212403d690 con 0x55cc09be75d0 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f2138217740 10 client.26767 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f2138217740 10 client.26767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f2138217740 20 client.26767 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f2138217740 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cc09c01ee0 0x55cc09c042d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f2138217740 4 client.26767 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.611+0000 7f2138217740 1 -- 172.21.15.18:0/2320736412 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc09b5a860 con 0x55cc09c01ee0 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.612+0000 7f212f7fe640 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cc09c01ee0 0x55cc09c042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.612+0000 7f212f7fe640 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cc09c01ee0 0x55cc09c042d0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7978ad58dd986b92 server_cookie=640712e708b95a9f in_seq=0 out_seq=0 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.612+0000 7f210effd640 10 client.26767 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f210effd640 1 -- 172.21.15.18:0/2320736412 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc09b5a860 con 0x55cc09c01ee0 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f210effd640 10 client.26767 handle_command_reply: tid=0 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 client.26767 shutdown 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 -- 172.21.15.18:0/2320736412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 msgr2=0x55cc09bf1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bf1d30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2124009230 tx=0x7f2124004510 comp rx=0 tx=0).stop 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 -- 172.21.15.18:0/2320736412 shutdown_connections 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cc09c01ee0 0x55cc09c042d0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09bf2370 0x55cc09bef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09beefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f210effd640 0 client.26767 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 --2- 172.21.15.18:0/2320736412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bf1d30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 -- 172.21.15.18:0/2320736412 >> 172.21.15.18:0/2320736412 conn(0x55cc09bb0310 msgr2=0x55cc09be9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 -- 172.21.15.18:0/2320736412 shutdown_connections 2024-09-19T10:00:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 1 -- 172.21.15.18:0/2320736412 wait complete. 2024-09-19T10:00:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.613+0000 7f2138217740 20 client.26767 trim_cache size 0 max 16384 2024-09-19T10:00:07.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.626+0000 7f2138217740 1 Processor -- start 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.626+0000 7f2138217740 1 -- start start 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f2138217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09be2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f2138217740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09bea120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f2138217740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09bf2370 0x55cc09bea660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f2138217740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21301af6e0 con 0x55cc09be8b40 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f2138217740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f21301b1220 con 0x55cc09bf2370 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f2138217740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21301afdb0 con 0x55cc09be75d0 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09bea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09be2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09be2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:56672/0 (socket says 172.21.15.18:56672) 2024-09-19T10:00:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212effd640 1 -- 172.21.15.18:0/544814678 learned_addr learned my addr 172.21.15.18:0/544814678 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09bea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38018/0 (socket says 172.21.15.18:38018) 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212effd640 1 -- 172.21.15.18:0/544814678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09bf2370 msgr2=0x55cc09bea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212effd640 1 --2- 172.21.15.18:0/544814678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09bf2370 0x55cc09bea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212effd640 1 -- 172.21.15.18:0/544814678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 msgr2=0x55cc09bea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212effd640 1 --2- 172.21.15.18:0/544814678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09bea120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212effd640 1 -- 172.21.15.18:0/544814678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc09be3ed0 con 0x55cc09be75d0 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212f7fe640 1 --2- 172.21.15.18:0/544814678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09bea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f212effd640 1 --2- 172.21.15.18:0/544814678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09be2bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f212402a940 tx=0x7f2124005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=886732743ca88ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f21157fa640 1 -- 172.21.15.18:0/544814678 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2124035040 con 0x55cc09be75d0 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f21157fa640 1 -- 172.21.15.18:0/544814678 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f212405a070 con 0x55cc09be75d0 2024-09-19T10:00:07.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.627+0000 7f21157fa640 1 -- 172.21.15.18:0/544814678 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2124003c30 con 0x55cc09be75d0 2024-09-19T10:00:07.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.628+0000 7f2138217740 1 -- 172.21.15.18:0/544814678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 msgr2=0x55cc09be2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:07.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.628+0000 7f2138217740 1 --2- 172.21.15.18:0/544814678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09be2bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f212402a940 tx=0x7f2124005a20 comp rx=0 tx=0).stop 2024-09-19T10:00:07.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.628+0000 7f2138217740 1 -- 172.21.15.18:0/544814678 shutdown_connections 2024-09-19T10:00:07.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.628+0000 7f2138217740 1 --2- 172.21.15.18:0/544814678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09bf2370 0x55cc09bea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.628+0000 7f2138217740 1 --2- 172.21.15.18:0/544814678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09be8b40 0x55cc09bea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.628+0000 7f2138217740 1 --2- 172.21.15.18:0/544814678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09be2bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.628+0000 7f2138217740 1 -- 172.21.15.18:0/544814678 >> 172.21.15.18:0/544814678 conn(0x55cc09bb0310 msgr2=0x55cc09be24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:07.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.628+0000 7f2138217740 1 -- 172.21.15.18:0/544814678 shutdown_connections 2024-09-19T10:00:07.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.628+0000 7f2138217740 1 -- 172.21.15.18:0/544814678 wait complete. 2024-09-19T10:00:07.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.628+0000 7f2138217740 1 -- start start 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f2138217740 1 Processor -- start 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f2138217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bfa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f2138217740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be8b40 0x55cc09bfa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f2138217740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 0x55cc09bf5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f2138217740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21301b0b50 con 0x55cc09bf2370 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f2138217740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f21301b0480 con 0x55cc09be8b40 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f2138217740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21301ad6e0 con 0x55cc09be75d0 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f2138217740 10 client.0 _ll_register_callbacks cb 0x7f21240043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f212effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bfa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f212effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bfa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:56678/0 (socket says 172.21.15.18:56678) 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f212effd640 1 -- 172.21.15.18:0/1087325489 learned_addr learned my addr 172.21.15.18:0/1087325489 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f212effd640 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 0x55cc09bf5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.629+0000 7f212f7fe640 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be8b40 0x55cc09bfa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f212effd640 1 -- 172.21.15.18:0/1087325489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 msgr2=0x55cc09bfa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f212effd640 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bfa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f212effd640 1 -- 172.21.15.18:0/1087325489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be8b40 msgr2=0x55cc09bfa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f212effd640 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be8b40 0x55cc09bfa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f212effd640 1 -- 172.21.15.18:0/1087325489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc09bf5980 con 0x55cc09bf2370 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f212f7fe640 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be8b40 0x55cc09bfa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f212effd640 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 0x55cc09bf5440 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f212403dc00 tx=0x7f2124000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5dcccbb2eafc50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f210effd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f210effd640 1 -- 172.21.15.18:0/1087325489 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212403d450 con 0x55cc09bf2370 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f2138217740 1 -- 172.21.15.18:0/1087325489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f212405a070 con 0x55cc09bf2370 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f210effd640 1 -- 172.21.15.18:0/1087325489 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f212403d5f0 con 0x55cc09bf2370 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f210effd640 1 -- 172.21.15.18:0/1087325489 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f212403d7f0 con 0x55cc09bf2370 2024-09-19T10:00:07.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f2138217740 10 client.17331 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f2138217740 1 -- 172.21.15.18:0/1087325489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cc09c6d180 con 0x55cc09bf2370 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.630+0000 7f210effd640 1 -- 172.21.15.18:0/1087325489 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f212405a070 con 0x55cc09bf2370 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.631+0000 7f210effd640 1 -- 172.21.15.18:0/1087325489 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21240559d0 con 0x55cc09bf2370 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.631+0000 7f2138217740 10 client.17331 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.631+0000 7f2138217740 10 client.17331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.631+0000 7f2138217740 20 client.17331 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.631+0000 7f2138217740 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cc09c6d8a0 0x55cc09c6fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.631+0000 7f2138217740 4 client.17331 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.631+0000 7f2138217740 1 -- 172.21.15.18:0/1087325489 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cc09b54d70 con 0x55cc09c6d8a0 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.631+0000 7f212f7fe640 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cc09c6d8a0 0x55cc09c6fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.631+0000 7f212f7fe640 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cc09c6d8a0 0x55cc09c6fcc0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fc787db2a34b554 server_cookie=f418a13529a084d6 in_seq=0 out_seq=0 2024-09-19T10:00:07.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.631+0000 7f210effd640 10 client.17331 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f210effd640 1 -- 172.21.15.18:0/1087325489 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cc09b54d70 con 0x55cc09c6d8a0 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f210effd640 10 client.17331 handle_command_reply: tid=0 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 client.17331 shutdown 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 -- 172.21.15.18:0/1087325489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 msgr2=0x55cc09bf5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 0x55cc09bf5440 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f212403dc00 tx=0x7f2124000bc0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 -- 172.21.15.18:0/1087325489 shutdown_connections 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cc09c6d8a0 0x55cc09c6fcc0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc09bf2370 0x55cc09bf5440 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc09be8b40 0x55cc09bfa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 --2- 172.21.15.18:0/1087325489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc09be75d0 0x55cc09bfa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 -- 172.21.15.18:0/1087325489 >> 172.21.15.18:0/1087325489 conn(0x55cc09bb0310 msgr2=0x55cc09be2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f210effd640 0 client.17331 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:07.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 -- 172.21.15.18:0/1087325489 shutdown_connections 2024-09-19T10:00:07.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 1 -- 172.21.15.18:0/1087325489 wait complete. 2024-09-19T10:00:07.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2138217740 20 client.17331 trim_cache size 0 max 16384 2024-09-19T10:00:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:00:07.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2135e3e640 1 -- 172.21.15.18:0/3300870500 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21180a3240 msgr2=0x7f21180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:07.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2135e3e640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21180a3240 0x7f21180a5700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f21280ccd80 tx=0x7f2128086040 comp rx=0 tx=0).stop 2024-09-19T10:00:07.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2135e3e640 1 -- 172.21.15.18:0/3300870500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21301082e0 msgr2=0x7f213019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:07.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.632+0000 7f2135e3e640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21301082e0 0x7f213019a5e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f212800d750 tx=0x7f212800dc10 comp rx=0 tx=0).stop 2024-09-19T10:00:07.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.633+0000 7f2135e3e640 1 -- 172.21.15.18:0/3300870500 shutdown_connections 2024-09-19T10:00:07.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.633+0000 7f2135e3e640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21180a3240 0x7f21180a5700 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.633+0000 7f2135e3e640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21301082e0 0x7f213019a5e0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.633+0000 7f2135e3e640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2130103760 0x7f21301a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.633+0000 7f2135e3e640 1 --2- 172.21.15.18:0/3300870500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2130102db0 0x7f21301a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:07.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.633+0000 7f2135e3e640 1 -- 172.21.15.18:0/3300870500 >> 172.21.15.18:0/3300870500 conn(0x7f21300fc7d0 msgr2=0x7f2130100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:07.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.633+0000 7f2135e3e640 1 -- 172.21.15.18:0/3300870500 shutdown_connections 2024-09-19T10:00:07.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:07.633+0000 7f2135e3e640 1 -- 172.21.15.18:0/3300870500 wait complete. 2024-09-19T10:00:08.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:08 smithi018 ceph-mon[30956]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 116 GiB used, 956 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 537 MiB/s wr, 895 op/s 2024-09-19T10:00:08.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:08 smithi049 ceph-mon[34858]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 116 GiB used, 956 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 537 MiB/s wr, 895 op/s 2024-09-19T10:00:08.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:08 smithi162 ceph-mon[35174]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 116 GiB used, 956 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 537 MiB/s wr, 895 op/s 2024-09-19T10:00:09.328 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T10:00:09.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T10:00:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:10.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.246+0000 7f39c744f640 1 -- 172.21.15.18:0/2988517917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c0102d30 msgr2=0x7f39c0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:10.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.246+0000 7f39c744f640 1 --2- 172.21.15.18:0/2988517917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c0102d30 0x7f39c0103110 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009930 tx=0x7f39bc02a420 comp rx=0 tx=0).stop 2024-09-19T10:00:10.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.246+0000 7f39c744f640 1 -- 172.21.15.18:0/2988517917 shutdown_connections 2024-09-19T10:00:10.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.246+0000 7f39c744f640 1 --2- 172.21.15.18:0/2988517917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c01082a0 0x7f39c010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.246+0000 7f39c744f640 1 --2- 172.21.15.18:0/2988517917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c01036e0 0x7f39c0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.246+0000 7f39c744f640 1 --2- 172.21.15.18:0/2988517917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c0102d30 0x7f39c0103110 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.246+0000 7f39c744f640 1 -- 172.21.15.18:0/2988517917 >> 172.21.15.18:0/2988517917 conn(0x7f39c00fc7d0 msgr2=0x7f39c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.246+0000 7f39c744f640 1 -- 172.21.15.18:0/2988517917 shutdown_connections 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.246+0000 7f39c744f640 1 -- 172.21.15.18:0/2988517917 wait complete. 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c744f640 1 Processor -- start 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c744f640 1 -- start start 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c744f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c0102d30 0x7f39c01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c744f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c01036e0 0x7f39c0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c744f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c01082a0 0x7f39c019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c744f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39c01120a0 con 0x7f39c0102d30 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c744f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0111f20 con 0x7f39c01082a0 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c744f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0112220 con 0x7f39c01036e0 2024-09-19T10:00:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c51eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c0102d30 0x7f39c01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c51eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c0102d30 0x7f39c01985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38044/0 (socket says 172.21.15.18:38044) 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c51eb640 1 -- 172.21.15.18:0/1000279600 learned_addr learned my addr 172.21.15.18:0/1000279600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c49ea640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c01036e0 0x7f39c0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c59ec640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c01082a0 0x7f39c019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c51eb640 1 -- 172.21.15.18:0/1000279600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c01036e0 msgr2=0x7f39c0198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c51eb640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c01036e0 0x7f39c0198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c51eb640 1 -- 172.21.15.18:0/1000279600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c01082a0 msgr2=0x7f39c019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c51eb640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c01082a0 0x7f39c019ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.247+0000 7f39c51eb640 1 -- 172.21.15.18:0/1000279600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c019d570 con 0x7f39c0102d30 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.248+0000 7f39c51eb640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c0102d30 0x7f39c01985c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009230 tx=0x7f39bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.248+0000 7f39b67fc640 1 -- 172.21.15.18:0/1000279600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc03f030 con 0x7f39c0102d30 2024-09-19T10:00:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.248+0000 7f39c744f640 1 -- 172.21.15.18:0/1000279600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c019d800 con 0x7f39c0102d30 2024-09-19T10:00:10.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.248+0000 7f39b67fc640 1 -- 172.21.15.18:0/1000279600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39bc003ad0 con 0x7f39c0102d30 2024-09-19T10:00:10.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.248+0000 7f39b67fc640 1 -- 172.21.15.18:0/1000279600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc035070 con 0x7f39c0102d30 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.248+0000 7f39c744f640 1 -- 172.21.15.18:0/1000279600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c01a5140 con 0x7f39c0102d30 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c9828740 1 Processor -- start 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39b67fc640 1 -- 172.21.15.18:0/1000279600 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f39bc042030 con 0x7f39c0102d30 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c9828740 1 -- start start 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c9828740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf59b60 0x55d5ccf59f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c9828740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 0x55d5ccf64800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c9828740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 0x55d5ccf67130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c9828740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d5ccebf280 con 0x55d5ccf5a480 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c9828740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d5cce66b10 con 0x55d5ccf59b60 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c9828740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d5ccebb240 con 0x55d5ccf64d40 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c51eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 0x55d5ccf64800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c49ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 0x55d5ccf67130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c49ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 0x55d5ccf67130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:56710/0 (socket says 172.21.15.18:56710) 2024-09-19T10:00:10.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.251+0000 7f39c49ea640 1 -- 172.21.15.18:0/1160965351 learned_addr learned my addr 172.21.15.18:0/1160965351 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:10.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39c49ea640 1 -- 172.21.15.18:0/1160965351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf59b60 msgr2=0x55d5ccf59f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:10.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39c49ea640 1 --2- 172.21.15.18:0/1160965351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf59b60 0x55d5ccf59f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39c49ea640 1 -- 172.21.15.18:0/1160965351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 msgr2=0x55d5ccf64800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:10.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39c49ea640 1 --2- 172.21.15.18:0/1160965351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 0x55d5ccf64800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39c49ea640 1 -- 172.21.15.18:0/1160965351 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5cce731f0 con 0x55d5ccf64d40 2024-09-19T10:00:10.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39b67fc640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f39ac0a3240 0x7f39ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39c59ec640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f39ac0a3240 0x7f39ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39b67fc640 1 -- 172.21.15.18:0/1000279600 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f39bc0efa70 con 0x7f39c0102d30 2024-09-19T10:00:10.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39c49ea640 1 --2- 172.21.15.18:0/1160965351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 0x55d5ccf67130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f39b000bc30 tx=0x7f39b00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6083f37b6bbdfdcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39ab7fe640 1 -- 172.21.15.18:0/1160965351 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b001c480 con 0x55d5ccf64d40 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39ab7fe640 1 -- 172.21.15.18:0/1160965351 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39b001cb00 con 0x55d5ccf64d40 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.252+0000 7f39ab7fe640 1 -- 172.21.15.18:0/1160965351 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0011b50 con 0x55d5ccf64d40 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.253+0000 7f39c9828740 1 -- 172.21.15.18:0/1160965351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 msgr2=0x55d5ccf67130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.253+0000 7f39c59ec640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f39ac0a3240 0x7f39ac0a5700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f39b80092f0 tx=0x7f39b8009240 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.253+0000 7f39c9828740 1 --2- 172.21.15.18:0/1160965351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 0x55d5ccf67130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f39b000bc30 tx=0x7f39b00107a0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.253+0000 7f39c9828740 1 -- 172.21.15.18:0/1160965351 shutdown_connections 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.253+0000 7f39c9828740 1 --2- 172.21.15.18:0/1160965351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 0x55d5ccf67130 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.253+0000 7f39c9828740 1 --2- 172.21.15.18:0/1160965351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 0x55d5ccf64800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.253+0000 7f39c9828740 1 --2- 172.21.15.18:0/1160965351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf59b60 0x55d5ccf59f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.253+0000 7f39c9828740 1 -- 172.21.15.18:0/1160965351 >> 172.21.15.18:0/1160965351 conn(0x55d5ccf560f0 msgr2=0x55d5ccf564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.253+0000 7f39c9828740 1 -- 172.21.15.18:0/1160965351 shutdown_connections 2024-09-19T10:00:10.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.253+0000 7f39c9828740 1 -- 172.21.15.18:0/1160965351 wait complete. 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c9828740 1 -- start start 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c9828740 1 Processor -- start 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c9828740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf61c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c9828740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf5a480 0x55d5ccf62150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c9828740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf64d40 0x55d5ccf62690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c9828740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d5ccf67910 con 0x55d5ccf59b60 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c9828740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d5cce79f10 con 0x55d5ccf64d40 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c9828740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d5ccf67a90 con 0x55d5ccf5a480 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c51eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf61c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c9828740 10 client.0 _ll_register_callbacks cb 0x55d5cce42a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c49ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf5a480 0x55d5ccf62150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c51eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf61c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38064/0 (socket says 172.21.15.18:38064) 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c49ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf5a480 0x55d5ccf62150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:56720/0 (socket says 172.21.15.18:56720) 2024-09-19T10:00:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.254+0000 7f39c51eb640 1 -- 172.21.15.18:0/3887777751 learned_addr learned my addr 172.21.15.18:0/3887777751 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39c59ec640 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf64d40 0x55d5ccf62690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39c49ea640 1 -- 172.21.15.18:0/3887777751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf64d40 msgr2=0x55d5ccf62690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39c49ea640 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf64d40 0x55d5ccf62690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39c49ea640 1 -- 172.21.15.18:0/3887777751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 msgr2=0x55d5ccf61c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39c49ea640 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf61c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39c49ea640 1 -- 172.21.15.18:0/3887777751 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5ccc306a0 con 0x55d5ccf5a480 2024-09-19T10:00:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39c49ea640 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf5a480 0x55d5ccf62150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f39b0000c00 tx=0x7f39b000b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6043db350ccb274f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39a8ff9640 1 -- 172.21.15.18:0/3887777751 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b002b060 con 0x55d5ccf5a480 2024-09-19T10:00:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39a8ff9640 1 -- 172.21.15.18:0/3887777751 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f39b001c480 con 0x55d5ccf5a480 2024-09-19T10:00:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.255+0000 7f39c9828740 1 -- 172.21.15.18:0/3887777751 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39b001cb00 con 0x55d5ccf5a480 2024-09-19T10:00:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39a8ff9640 1 -- 172.21.15.18:0/3887777751 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f39b001c680 con 0x55d5ccf5a480 2024-09-19T10:00:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39c9828740 10 client.26785 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39c9828740 1 -- 172.21.15.18:0/3887777751 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d5ccf73510 con 0x55d5ccf5a480 2024-09-19T10:00:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39a8ff9640 1 -- 172.21.15.18:0/3887777751 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39b001cb00 con 0x55d5ccf5a480 2024-09-19T10:00:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39a8ff9640 1 -- 172.21.15.18:0/3887777751 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f39b00051d0 con 0x55d5ccf5a480 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39c9828740 10 client.26785 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39c9828740 10 client.26785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39c9828740 20 client.26785 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39c9828740 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d5ccf749d0 0x55d5ccf76dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39c9828740 4 client.26785 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39c9828740 1 -- 172.21.15.18:0/3887777751 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5ccecc7f0 con 0x55d5ccf749d0 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.256+0000 7f39c51eb640 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d5ccf749d0 0x55d5ccf76dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.257+0000 7f39c51eb640 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d5ccf749d0 0x55d5ccf76dc0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cfb1b9e9fba2168 server_cookie=de7636524bfb6007 in_seq=0 out_seq=0 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.257+0000 7f39a8ff9640 10 client.26785 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39a8ff9640 1 -- 172.21.15.18:0/3887777751 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d5ccecc7f0 con 0x55d5ccf749d0 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39a8ff9640 10 client.26785 handle_command_reply: tid=0 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 client.26785 shutdown 2024-09-19T10:00:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 -- 172.21.15.18:0/3887777751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf5a480 msgr2=0x55d5ccf62150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf5a480 0x55d5ccf62150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f39b0000c00 tx=0x7f39b000b8f0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 -- 172.21.15.18:0/3887777751 shutdown_connections 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d5ccf749d0 0x55d5ccf76dc0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf64d40 0x55d5ccf62690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf5a480 0x55d5ccf62150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 --2- 172.21.15.18:0/3887777751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf61c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 -- 172.21.15.18:0/3887777751 >> 172.21.15.18:0/3887777751 conn(0x55d5ccf560f0 msgr2=0x55d5ccf5be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39a8ff9640 0 client.26785 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 -- 172.21.15.18:0/3887777751 shutdown_connections 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 1 -- 172.21.15.18:0/3887777751 wait complete. 2024-09-19T10:00:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.258+0000 7f39c9828740 20 client.26785 trim_cache size 0 max 16384 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c9828740 1 Processor -- start 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c9828740 1 -- start start 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c9828740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf59b60 0x55d5ccf5bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c9828740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 0x55d5ccf79a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c9828740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf64d40 0x55d5ccf79f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c9828740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39c01ab330 con 0x55d5ccf5a480 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c9828740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39c01ace70 con 0x55d5ccf64d40 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c9828740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39c01aba00 con 0x55d5ccf59b60 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c49ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 0x55d5ccf79a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c49ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 0x55d5ccf79a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38066/0 (socket says 172.21.15.18:38066) 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c49ea640 1 -- 172.21.15.18:0/2313594760 learned_addr learned my addr 172.21.15.18:0/2313594760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c51eb640 1 --2- 172.21.15.18:0/2313594760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf59b60 0x55d5ccf5bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c49ea640 1 -- 172.21.15.18:0/2313594760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf59b60 msgr2=0x55d5ccf5bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c49ea640 1 --2- 172.21.15.18:0/2313594760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf59b60 0x55d5ccf5bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c49ea640 1 -- 172.21.15.18:0/2313594760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf64d40 msgr2=0x55d5ccf79f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c49ea640 1 --2- 172.21.15.18:0/2313594760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf64d40 0x55d5ccf79f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c49ea640 1 -- 172.21.15.18:0/2313594760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5ccf51830 con 0x55d5ccf5a480 2024-09-19T10:00:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.276+0000 7f39c51eb640 1 --2- 172.21.15.18:0/2313594760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf59b60 0x55d5ccf5bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.277+0000 7f39c49ea640 1 --2- 172.21.15.18:0/2313594760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 0x55d5ccf79a00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f39b0005570 tx=0x7f39b000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81186084ca7203d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:10.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.277+0000 7f39aaffd640 1 -- 172.21.15.18:0/2313594760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0036030 con 0x55d5ccf5a480 2024-09-19T10:00:10.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.277+0000 7f39aaffd640 1 -- 172.21.15.18:0/2313594760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39b001c480 con 0x55d5ccf5a480 2024-09-19T10:00:10.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.277+0000 7f39aaffd640 1 -- 172.21.15.18:0/2313594760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b001c8b0 con 0x55d5ccf5a480 2024-09-19T10:00:10.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.277+0000 7f39c9828740 1 -- 172.21.15.18:0/2313594760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 msgr2=0x55d5ccf79a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.277+0000 7f39c9828740 1 --2- 172.21.15.18:0/2313594760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 0x55d5ccf79a00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f39b0005570 tx=0x7f39b000b390 comp rx=0 tx=0).stop 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 -- 172.21.15.18:0/2313594760 shutdown_connections 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 --2- 172.21.15.18:0/2313594760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf64d40 0x55d5ccf79f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 --2- 172.21.15.18:0/2313594760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf5a480 0x55d5ccf79a00 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 --2- 172.21.15.18:0/2313594760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf59b60 0x55d5ccf5bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 -- 172.21.15.18:0/2313594760 >> 172.21.15.18:0/2313594760 conn(0x55d5ccf560f0 msgr2=0x55d5ccf5b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 -- 172.21.15.18:0/2313594760 shutdown_connections 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 -- 172.21.15.18:0/2313594760 wait complete. 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 -- start start 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 Processor -- start 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf77af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf5a480 0x55d5ccf78030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.278+0000 7f39c9828740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 0x55d5ccfde310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c9828740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39c01ac7a0 con 0x55d5ccf59b60 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c9828740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39c01ac0d0 con 0x55d5ccf5a480 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c9828740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39c01a9330 con 0x55d5ccf64d40 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c9828740 10 client.0 _ll_register_callbacks cb 0x7f39bc0fa6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c51eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf77af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c51eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf77af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38074/0 (socket says 172.21.15.18:38074) 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c51eb640 1 -- 172.21.15.18:0/1030934027 learned_addr learned my addr 172.21.15.18:0/1030934027 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c49ea640 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf5a480 0x55d5ccf78030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c59ec640 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 0x55d5ccfde310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c51eb640 1 -- 172.21.15.18:0/1030934027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 msgr2=0x55d5ccfde310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c51eb640 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 0x55d5ccfde310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c51eb640 1 -- 172.21.15.18:0/1030934027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf5a480 msgr2=0x55d5ccf78030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c51eb640 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf5a480 0x55d5ccf78030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c51eb640 1 -- 172.21.15.18:0/1030934027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5ccf788f0 con 0x55d5ccf59b60 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c49ea640 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf5a480 0x55d5ccf78030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39c51eb640 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf77af0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0ed5f0 tx=0x7f39bc0dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4dbbc9499083d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.279+0000 7f39a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39a8ff9640 1 -- 172.21.15.18:0/1030934027 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc049040 con 0x55d5ccf59b60 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39a8ff9640 1 -- 172.21.15.18:0/1030934027 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f39bc0ba3c0 con 0x55d5ccf59b60 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39c9828740 1 -- 172.21.15.18:0/1030934027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39b001c480 con 0x55d5ccf59b60 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39a8ff9640 1 -- 172.21.15.18:0/1030934027 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f39bc0bc0c0 con 0x55d5ccf59b60 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39c9828740 10 client.17349 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39c9828740 1 -- 172.21.15.18:0/1030934027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d5ccfdf9f0 con 0x55d5ccf59b60 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39a8ff9640 1 -- 172.21.15.18:0/1030934027 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39b001c480 con 0x55d5ccf59b60 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39a8ff9640 1 -- 172.21.15.18:0/1030934027 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f39bc04c060 con 0x55d5ccf59b60 2024-09-19T10:00:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39c9828740 10 client.17349 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39c9828740 10 client.17349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39c9828740 20 client.17349 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39c9828740 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d5ccfe00c0 0x55d5ccfe24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39c9828740 4 client.17349 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T10:00:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.280+0000 7f39c9828740 1 -- 172.21.15.18:0/1030934027 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d5ccec6d00 con 0x55d5ccfe00c0 2024-09-19T10:00:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.281+0000 7f39c49ea640 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d5ccfe00c0 0x55d5ccfe24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.281+0000 7f39a8ff9640 10 client.17349 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.281+0000 7f39c49ea640 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d5ccfe00c0 0x55d5ccfe24b0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dcb378ffa2e1605 server_cookie=d424d9f7ae341223 in_seq=0 out_seq=0 2024-09-19T10:00:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.282+0000 7f39a8ff9640 1 -- 172.21.15.18:0/1030934027 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d5ccec6d00 con 0x55d5ccfe00c0 2024-09-19T10:00:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.282+0000 7f39a8ff9640 10 client.17349 handle_command_reply: tid=0 2024-09-19T10:00:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.282+0000 7f39c9828740 1 client.17349 shutdown 2024-09-19T10:00:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.282+0000 7f39c9828740 1 -- 172.21.15.18:0/1030934027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 msgr2=0x55d5ccf77af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.282+0000 7f39c9828740 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf77af0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0ed5f0 tx=0x7f39bc0dc040 comp rx=0 tx=0).stop 2024-09-19T10:00:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.283+0000 7f39c9828740 1 -- 172.21.15.18:0/1030934027 shutdown_connections 2024-09-19T10:00:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.283+0000 7f39c9828740 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d5ccfe00c0 0x55d5ccfe24b0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.283+0000 7f39c9828740 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5ccf64d40 0x55d5ccfde310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.283+0000 7f39c9828740 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d5ccf5a480 0x55d5ccf78030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.283+0000 7f39c9828740 1 --2- 172.21.15.18:0/1030934027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d5ccf59b60 0x55d5ccf77af0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.283+0000 7f39c9828740 1 -- 172.21.15.18:0/1030934027 >> 172.21.15.18:0/1030934027 conn(0x55d5ccf560f0 msgr2=0x55d5ccf55270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.283+0000 7f39a8ff9640 0 client.17349 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.283+0000 7f39c9828740 1 -- 172.21.15.18:0/1030934027 shutdown_connections 2024-09-19T10:00:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.283+0000 7f39c9828740 1 -- 172.21.15.18:0/1030934027 wait complete. 2024-09-19T10:00:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.283+0000 7f39c9828740 20 client.17349 trim_cache size 0 max 16384 2024-09-19T10:00:10.289 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:00:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T10:00:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "9083f287-6792-400a-b23d-a414702d8629", 2024-09-19T10:00:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T10:00:10.290 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:00:10.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 -- 172.21.15.18:0/1000279600 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f39ac0a3240 msgr2=0x7f39ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f39ac0a3240 0x7f39ac0a5700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f39b80092f0 tx=0x7f39b8009240 comp rx=0 tx=0).stop 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 -- 172.21.15.18:0/1000279600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c0102d30 msgr2=0x7f39c01985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c0102d30 0x7f39c01985c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009230 tx=0x7f39bc004270 comp rx=0 tx=0).stop 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 -- 172.21.15.18:0/1000279600 shutdown_connections 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f39ac0a3240 0x7f39ac0a5700 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39c01082a0 0x7f39c019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c01036e0 0x7f39c0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 --2- 172.21.15.18:0/1000279600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c0102d30 0x7f39c01985c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 -- 172.21.15.18:0/1000279600 >> 172.21.15.18:0/1000279600 conn(0x7f39c00fc7d0 msgr2=0x7f39c0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 -- 172.21.15.18:0/1000279600 shutdown_connections 2024-09-19T10:00:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:10.284+0000 7f39c744f640 1 -- 172.21.15.18:0/1000279600 wait complete. 2024-09-19T10:00:10.312 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:00:10.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:10 smithi018 ceph-mon[30956]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 425 MiB/s wr, 613 op/s 2024-09-19T10:00:10.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:10 smithi049 ceph-mon[34858]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 425 MiB/s wr, 613 op/s 2024-09-19T10:00:10.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:10 smithi162 ceph-mon[35174]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 2.9 MiB/s rd, 425 MiB/s wr, 613 op/s 2024-09-19T10:00:10.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T10:00:11.019 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:11.546 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:11 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T10:00:11.546 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:11 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T10:00:11.546 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:11 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T10:00:11.546 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:11 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T10:00:11.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.541+0000 7f5a54477640 1 -- 172.21.15.18:0/574229716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a4c100a80 msgr2=0x7f5a4c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:11.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.541+0000 7f5a54477640 1 --2- 172.21.15.18:0/574229716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a4c100a80 0x7f5a4c100ee0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009930 tx=0x7f5a3c02a420 comp rx=0 tx=0).stop 2024-09-19T10:00:11.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.541+0000 7f5a54477640 1 -- 172.21.15.18:0/574229716 shutdown_connections 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.541+0000 7f5a54477640 1 --2- 172.21.15.18:0/574229716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a4c101420 0x7f5a4c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.541+0000 7f5a54477640 1 --2- 172.21.15.18:0/574229716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a4c100a80 0x7f5a4c100ee0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.541+0000 7f5a54477640 1 --2- 172.21.15.18:0/574229716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a4c106a80 0x7f5a4c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.541+0000 7f5a54477640 1 -- 172.21.15.18:0/574229716 >> 172.21.15.18:0/574229716 conn(0x7f5a4c0fc7a0 msgr2=0x7f5a4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.542+0000 7f5a54477640 1 -- 172.21.15.18:0/574229716 shutdown_connections 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.542+0000 7f5a54477640 1 -- 172.21.15.18:0/574229716 wait complete. 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.543+0000 7f5a54477640 1 Processor -- start 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.544+0000 7f5a54477640 1 -- start start 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.544+0000 7f5a54477640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a4c101420 0x7f5a4c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.545+0000 7f5a54477640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a4c106a80 0x7f5a4c198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.545+0000 7f5a54477640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a4c19cf40 0x7f5a4c19d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:11.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.545+0000 7f5a51a12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a4c106a80 0x7f5a4c198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.545+0000 7f5a54477640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c110e90 con 0x7f5a4c106a80 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.545+0000 7f5a51a12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a4c106a80 0x7f5a4c198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38098/0 (socket says 172.21.15.18:38098) 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.545+0000 7f5a51a12640 1 -- 172.21.15.18:0/130850008 learned_addr learned my addr 172.21.15.18:0/130850008 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.545+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c110d10 con 0x7f5a4c19cf40 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.545+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c111010 con 0x7f5a4c101420 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.546+0000 7f5a51a12640 1 -- 172.21.15.18:0/130850008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a4c101420 msgr2=0x7f5a4c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.546+0000 7f5a51a12640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a4c101420 0x7f5a4c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.546+0000 7f5a51a12640 1 -- 172.21.15.18:0/130850008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a4c19cf40 msgr2=0x7f5a4c19d3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.546+0000 7f5a51a12640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a4c19cf40 0x7f5a4c19d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.546+0000 7f5a51a12640 1 -- 172.21.15.18:0/130850008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c19da00 con 0x7f5a4c106a80 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.546+0000 7f5a51a12640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a4c106a80 0x7f5a4c198bb0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009900 tx=0x7f5a3c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.547+0000 7f5a437fe640 1 -- 172.21.15.18:0/130850008 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c03f020 con 0x7f5a4c106a80 2024-09-19T10:00:11.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.547+0000 7f5a437fe640 1 -- 172.21.15.18:0/130850008 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a3c031ca0 con 0x7f5a4c106a80 2024-09-19T10:00:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.547+0000 7f5a437fe640 1 -- 172.21.15.18:0/130850008 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c035070 con 0x7f5a4c106a80 2024-09-19T10:00:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.547+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c19dc90 con 0x7f5a4c106a80 2024-09-19T10:00:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.547+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c1a53c0 con 0x7f5a4c106a80 2024-09-19T10:00:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.556+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4c100ee0 con 0x7f5a4c106a80 2024-09-19T10:00:11.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.573+0000 7f5a437fe640 1 -- 172.21.15.18:0/130850008 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5a3c042020 con 0x7f5a4c106a80 2024-09-19T10:00:11.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.575+0000 7f5a437fe640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a380a3410 0x7f5a380a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:11.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.575+0000 7f5a437fe640 1 -- 172.21.15.18:0/130850008 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5a3c0f0030 con 0x7f5a4c106a80 2024-09-19T10:00:11.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.576+0000 7f5a52213640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a380a3410 0x7f5a380a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:11.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.577+0000 7f5a52213640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a380a3410 0x7f5a380a58d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009ad0 tx=0x7f5a48009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:11.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:11.585+0000 7f5a437fe640 1 -- 172.21.15.18:0/130850008 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a3c049020 con 0x7f5a4c106a80 2024-09-19T10:00:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:11.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:11 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T10:00:11.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:11 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T10:00:11.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:11 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T10:00:11.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:11 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T10:00:11.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:11 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T10:00:11.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:11 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T10:00:11.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:11 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T10:00:11.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:11 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T10:00:12.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.012+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a4c102780 con 0x7f5a4c106a80 2024-09-19T10:00:12.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.013+0000 7f5a437fe640 1 -- 172.21.15.18:0/130850008 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f5a3c0bcd20 con 0x7f5a4c106a80 2024-09-19T10:00:12.016 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:00:12.016 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:00:12.016 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:00:12.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.015+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a380a3410 msgr2=0x7f5a380a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:12.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.015+0000 7f5a54477640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a380a3410 0x7f5a380a58d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009ad0 tx=0x7f5a48009590 comp rx=0 tx=0).stop 2024-09-19T10:00:12.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.015+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a4c106a80 msgr2=0x7f5a4c198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:12.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.015+0000 7f5a54477640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a4c106a80 0x7f5a4c198bb0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009900 tx=0x7f5a3c003c10 comp rx=0 tx=0).stop 2024-09-19T10:00:12.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.015+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 shutdown_connections 2024-09-19T10:00:12.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.015+0000 7f5a54477640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f5a380a3410 0x7f5a380a58d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:12.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.015+0000 7f5a54477640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a4c19cf40 0x7f5a4c19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:12.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.015+0000 7f5a54477640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a4c106a80 0x7f5a4c198bb0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:12.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.015+0000 7f5a54477640 1 --2- 172.21.15.18:0/130850008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a4c101420 0x7f5a4c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:12.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.015+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 >> 172.21.15.18:0/130850008 conn(0x7f5a4c0fc7a0 msgr2=0x7f5a4c104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:12.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.016+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 shutdown_connections 2024-09-19T10:00:12.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:12.016+0000 7f5a54477640 1 -- 172.21.15.18:0/130850008 wait complete. 2024-09-19T10:00:12.761 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:12 smithi018 ceph-mon[30956]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 383 MiB/s wr, 566 op/s 2024-09-19T10:00:12.761 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:12 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/130850008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:12.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:12 smithi049 ceph-mon[34858]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 383 MiB/s wr, 566 op/s 2024-09-19T10:00:12.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:12 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/130850008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:12.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:12 smithi162 ceph-mon[35174]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 383 MiB/s wr, 566 op/s 2024-09-19T10:00:12.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:12 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/130850008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:12.926 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --set-id 2809e3bc --release --await' 2024-09-19T10:00:12.926 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --set-id 2809e3bc --release --await 2024-09-19T10:00:13.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.119+0000 7f191291e640 1 -- 172.21.15.18:0/3027510633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190c101360 msgr2=0x7f190c10df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:13.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.119+0000 7f191291e640 1 --2- 172.21.15.18:0/3027510633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190c101360 0x7f190c10df90 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009900 tx=0x7f18f402a410 comp rx=0 tx=0).stop 2024-09-19T10:00:13.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.120+0000 7f191291e640 1 -- 172.21.15.18:0/3027510633 shutdown_connections 2024-09-19T10:00:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.120+0000 7f191291e640 1 --2- 172.21.15.18:0/3027510633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190c10e4d0 0x7f190c1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.120+0000 7f191291e640 1 --2- 172.21.15.18:0/3027510633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190c101360 0x7f190c10df90 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.120+0000 7f191291e640 1 --2- 172.21.15.18:0/3027510633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f190c1009b0 0x7f190c100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.120+0000 7f191291e640 1 -- 172.21.15.18:0/3027510633 >> 172.21.15.18:0/3027510633 conn(0x7f190c0fc7d0 msgr2=0x7f190c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.120+0000 7f191291e640 1 -- 172.21.15.18:0/3027510633 shutdown_connections 2024-09-19T10:00:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.120+0000 7f191291e640 1 -- 172.21.15.18:0/3027510633 wait complete. 2024-09-19T10:00:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.120+0000 7f191291e640 1 Processor -- start 2024-09-19T10:00:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.120+0000 7f191291e640 1 -- start start 2024-09-19T10:00:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f191291e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190c1009b0 0x7f190c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f191291e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f190c101360 0x7f190c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f191291e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190c10e4d0 0x7f190c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f191291e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f190c114200 con 0x7f190c10e4d0 2024-09-19T10:00:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f191291e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f190c114080 con 0x7f190c101360 2024-09-19T10:00:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f191291e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f190c114380 con 0x7f190c1009b0 2024-09-19T10:00:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1910ebb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190c10e4d0 0x7f190c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1910ebb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190c10e4d0 0x7f190c19ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38130/0 (socket says 172.21.15.18:38130) 2024-09-19T10:00:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1910ebb640 1 -- 172.21.15.18:0/2736823410 learned_addr learned my addr 172.21.15.18:0/2736823410 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f190bfff640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190c1009b0 0x7f190c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1903fff640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f190c101360 0x7f190c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1910ebb640 1 -- 172.21.15.18:0/2736823410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190c1009b0 msgr2=0x7f190c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1910ebb640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190c1009b0 0x7f190c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1910ebb640 1 -- 172.21.15.18:0/2736823410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f190c101360 msgr2=0x7f190c19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1910ebb640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f190c101360 0x7f190c19abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1910ebb640 1 -- 172.21.15.18:0/2736823410 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c19f630 con 0x7f190c10e4d0 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f190bfff640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190c1009b0 0x7f190c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1903fff640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f190c101360 0x7f190c19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.121+0000 7f1910ebb640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190c10e4d0 0x7f190c19ef50 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f190400eaa0 tx=0x7f190400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.122+0000 7f1909ffb640 1 -- 172.21.15.18:0/2736823410 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190400cdb0 con 0x7f190c10e4d0 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.122+0000 7f1909ffb640 1 -- 172.21.15.18:0/2736823410 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1904005020 con 0x7f190c10e4d0 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.122+0000 7f191291e640 1 -- 172.21.15.18:0/2736823410 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190c19f920 con 0x7f190c10e4d0 2024-09-19T10:00:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.122+0000 7f1909ffb640 1 -- 172.21.15.18:0/2736823410 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040116b0 con 0x7f190c10e4d0 2024-09-19T10:00:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.122+0000 7f191291e640 1 -- 172.21.15.18:0/2736823410 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190c1a7200 con 0x7f190c10e4d0 2024-09-19T10:00:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.124+0000 7f1914cf7740 1 Processor -- start 2024-09-19T10:00:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.125+0000 7f1909ffb640 1 -- 172.21.15.18:0/2736823410 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1904005560 con 0x7f190c10e4d0 2024-09-19T10:00:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.125+0000 7f1914cf7740 1 -- start start 2024-09-19T10:00:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.125+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c6f5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.125+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c700140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.125+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c700680 0x55de2c702a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.125+0000 7f1914cf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de2c65b2e0 con 0x55de2c6f5dc0 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.125+0000 7f1914cf7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55de2c602ce0 con 0x55de2c700680 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.125+0000 7f1914cf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55de2c6572a0 con 0x55de2c6f54a0 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f1903fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c6f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f190bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c700140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f1903fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c6f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:56774/0 (socket says 172.21.15.18:56774) 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f1903fff640 1 -- 172.21.15.18:0/2295328731 learned_addr learned my addr 172.21.15.18:0/2295328731 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f1903fff640 1 --2- 172.21.15.18:0/2295328731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c700680 0x55de2c702a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f190bfff640 1 -- 172.21.15.18:0/2295328731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 msgr2=0x55de2c6f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:13.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f190bfff640 1 --2- 172.21.15.18:0/2295328731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c6f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f190bfff640 1 -- 172.21.15.18:0/2295328731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c700680 msgr2=0x55de2c702a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f190bfff640 1 --2- 172.21.15.18:0/2295328731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c700680 0x55de2c702a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f190bfff640 1 -- 172.21.15.18:0/2295328731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de2c5e7440 con 0x55de2c6f5dc0 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f1909ffb640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f18f80a3240 0x7f18f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f190bfff640 1 --2- 172.21.15.18:0/2295328731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c700140 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f18fc008b80 tx=0x7f18fc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e48adf7520e67f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f1903fff640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f18f80a3240 0x7f18f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.126+0000 7f1909ffb640 1 -- 172.21.15.18:0/2736823410 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f19040cfb80 con 0x7f190c10e4d0 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f19027fc640 1 -- 172.21.15.18:0/2295328731 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc014070 con 0x55de2c6f5dc0 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f19027fc640 1 -- 172.21.15.18:0/2295328731 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc0047a0 con 0x55de2c6f5dc0 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f19027fc640 1 -- 172.21.15.18:0/2295328731 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0107f0 con 0x55de2c6f5dc0 2024-09-19T10:00:13.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f1903fff640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f18f80a3240 0x7f18f80a5700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f18f4005ec0 tx=0x7f18f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f1914cf7740 1 -- 172.21.15.18:0/2295328731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 msgr2=0x55de2c700140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f1914cf7740 1 --2- 172.21.15.18:0/2295328731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c700140 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f18fc008b80 tx=0x7f18fc00e720 comp rx=0 tx=0).stop 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f1914cf7740 1 -- 172.21.15.18:0/2295328731 shutdown_connections 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f1914cf7740 1 --2- 172.21.15.18:0/2295328731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c700680 0x55de2c702a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f1914cf7740 1 --2- 172.21.15.18:0/2295328731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c700140 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f1914cf7740 1 --2- 172.21.15.18:0/2295328731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c6f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f1914cf7740 1 -- 172.21.15.18:0/2295328731 >> 172.21.15.18:0/2295328731 conn(0x55de2c6f1a30 msgr2=0x55de2c6f1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f1914cf7740 1 -- 172.21.15.18:0/2295328731 shutdown_connections 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.127+0000 7f1914cf7740 1 -- 172.21.15.18:0/2295328731 wait complete. 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1914cf7740 1 -- start start 2024-09-19T10:00:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1914cf7740 1 Processor -- start 2024-09-19T10:00:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c6f54a0 0x55de2c6fff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c6fd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c700680 0x55de2c6fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1914cf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55de2c703250 con 0x55de2c6f5dc0 2024-09-19T10:00:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1914cf7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55de2c616050 con 0x55de2c6f54a0 2024-09-19T10:00:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1914cf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55de2c7033d0 con 0x55de2c700680 2024-09-19T10:00:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1914cf7740 10 client.0 _ll_register_callbacks cb 0x55de2c656160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1903fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c6fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1903fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c6fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38138/0 (socket says 172.21.15.18:38138) 2024-09-19T10:00:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1903fff640 1 -- 172.21.15.18:0/137344012 learned_addr learned my addr 172.21.15.18:0/137344012 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f1910ebb640 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c700680 0x55de2c6fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.128+0000 7f190bfff640 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c6f54a0 0x55de2c6fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f1903fff640 1 -- 172.21.15.18:0/137344012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c700680 msgr2=0x55de2c6fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f1903fff640 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c700680 0x55de2c6fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f1903fff640 1 -- 172.21.15.18:0/137344012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c6f54a0 msgr2=0x55de2c6fff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f1903fff640 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c6f54a0 0x55de2c6fff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f1903fff640 1 -- 172.21.15.18:0/137344012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de2c3cc3c0 con 0x55de2c6f5dc0 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f1903fff640 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c6fd220 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009230 tx=0x7f18f40056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef40a64b3deccba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f18eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f18eb7fe640 1 -- 172.21.15.18:0/137344012 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f404e030 con 0x55de2c6f5dc0 2024-09-19T10:00:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f18eb7fe640 1 -- 172.21.15.18:0/137344012 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f18f4003800 con 0x55de2c6f5dc0 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f1914cf7740 1 -- 172.21.15.18:0/137344012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18fc0047a0 con 0x55de2c6f5dc0 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f18eb7fe640 1 -- 172.21.15.18:0/137344012 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18f4035040 con 0x55de2c6f5dc0 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f1914cf7740 10 client.17367 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.129+0000 7f1914cf7740 1 -- 172.21.15.18:0/137344012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55de2c70ebc0 con 0x55de2c6f5dc0 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.130+0000 7f18eb7fe640 1 -- 172.21.15.18:0/137344012 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc0047a0 con 0x55de2c6f5dc0 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.130+0000 7f18eb7fe640 1 -- 172.21.15.18:0/137344012 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f18f403a040 con 0x55de2c6f5dc0 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.130+0000 7f1914cf7740 10 client.17367 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.130+0000 7f1914cf7740 10 client.17367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.130+0000 7f1914cf7740 20 client.17367 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.130+0000 7f1914cf7740 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55de2c70ffd0 0x55de2c712450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.130+0000 7f1914cf7740 4 client.17367 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.130+0000 7f1914cf7740 1 -- 172.21.15.18:0/137344012 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de2c668850 con 0x55de2c70ffd0 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.130+0000 7f190bfff640 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55de2c70ffd0 0x55de2c712450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.131+0000 7f190bfff640 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55de2c70ffd0 0x55de2c712450 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=520460e072d83d1f server_cookie=f97dfba89635ca42 in_seq=0 out_seq=0 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.131+0000 7f18eb7fe640 10 client.17367 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.131+0000 7f18eb7fe640 1 -- 172.21.15.18:0/137344012 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de2c668850 con 0x55de2c70ffd0 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.131+0000 7f18eb7fe640 10 client.17367 handle_command_reply: tid=0 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.131+0000 7f1914cf7740 1 client.17367 shutdown 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 1 -- 172.21.15.18:0/137344012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 msgr2=0x55de2c6fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c6fd220 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009230 tx=0x7f18f40056d0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 1 -- 172.21.15.18:0/137344012 shutdown_connections 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55de2c70ffd0 0x55de2c712450 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c700680 0x55de2c6fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c6fd220 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 1 --2- 172.21.15.18:0/137344012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c6f54a0 0x55de2c6fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f18eb7fe640 0 client.17367 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 1 -- 172.21.15.18:0/137344012 >> 172.21.15.18:0/137344012 conn(0x55de2c6f1a30 msgr2=0x55de2c6f7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 1 -- 172.21.15.18:0/137344012 shutdown_connections 2024-09-19T10:00:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 1 -- 172.21.15.18:0/137344012 wait complete. 2024-09-19T10:00:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.132+0000 7f1914cf7740 20 client.17367 trim_cache size 0 max 16384 2024-09-19T10:00:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.149+0000 7f1914cf7740 1 Processor -- start 2024-09-19T10:00:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.149+0000 7f1914cf7740 1 -- start start 2024-09-19T10:00:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c717d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c718260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c700680 0x55de2c6fa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1914cf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f190c1af620 con 0x55de2c6f5dc0 2024-09-19T10:00:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1914cf7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f190c1b1160 con 0x55de2c700680 2024-09-19T10:00:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1914cf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f190c1afcf0 con 0x55de2c6f54a0 2024-09-19T10:00:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1903fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c718260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1903fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c718260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38142/0 (socket says 172.21.15.18:38142) 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1903fff640 1 -- 172.21.15.18:0/1370890456 learned_addr learned my addr 172.21.15.18:0/1370890456 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f190bfff640 1 --2- 172.21.15.18:0/1370890456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c717d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1910ebb640 1 --2- 172.21.15.18:0/1370890456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c700680 0x55de2c6fa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f190bfff640 1 -- 172.21.15.18:0/1370890456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c700680 msgr2=0x55de2c6fa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f190bfff640 1 --2- 172.21.15.18:0/1370890456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c700680 0x55de2c6fa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f190bfff640 1 -- 172.21.15.18:0/1370890456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 msgr2=0x55de2c718260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f190bfff640 1 --2- 172.21.15.18:0/1370890456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c718260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f190bfff640 1 -- 172.21.15.18:0/1370890456 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de2c7002e0 con 0x55de2c6f54a0 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f1903fff640 1 --2- 172.21.15.18:0/1370890456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c718260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.150+0000 7f190bfff640 1 --2- 172.21.15.18:0/1370890456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c717d20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f18fc000c00 tx=0x7f18fc0084c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb30eb8284ab9e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:13.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.151+0000 7f1901ffb640 1 -- 172.21.15.18:0/1370890456 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc014040 con 0x55de2c6f54a0 2024-09-19T10:00:13.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.151+0000 7f1901ffb640 1 -- 172.21.15.18:0/1370890456 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc008310 con 0x55de2c6f54a0 2024-09-19T10:00:13.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.151+0000 7f1901ffb640 1 -- 172.21.15.18:0/1370890456 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc024970 con 0x55de2c6f54a0 2024-09-19T10:00:13.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.151+0000 7f1914cf7740 1 -- 172.21.15.18:0/1370890456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 msgr2=0x55de2c717d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:13.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.151+0000 7f1914cf7740 1 --2- 172.21.15.18:0/1370890456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c717d20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f18fc000c00 tx=0x7f18fc0084c0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.151+0000 7f1914cf7740 1 -- 172.21.15.18:0/1370890456 shutdown_connections 2024-09-19T10:00:13.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.151+0000 7f1914cf7740 1 --2- 172.21.15.18:0/1370890456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c700680 0x55de2c6fa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.151+0000 7f1914cf7740 1 --2- 172.21.15.18:0/1370890456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c6f5dc0 0x55de2c718260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.151+0000 7f1914cf7740 1 --2- 172.21.15.18:0/1370890456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c717d20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.151+0000 7f1914cf7740 1 -- 172.21.15.18:0/1370890456 >> 172.21.15.18:0/1370890456 conn(0x55de2c6f1a30 msgr2=0x55de2c6f0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.152+0000 7f1914cf7740 1 -- 172.21.15.18:0/1370890456 shutdown_connections 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.152+0000 7f1914cf7740 1 -- 172.21.15.18:0/1370890456 wait complete. 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.152+0000 7f1914cf7740 1 -- start start 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.152+0000 7f1914cf7740 1 Processor -- start 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.152+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c7067e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.152+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c6f5dc0 0x55de2c706d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.152+0000 7f1914cf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c700680 0x55de2c779d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f1914cf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f190c1b0a90 con 0x55de2c700680 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f1914cf7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f190c1b03c0 con 0x55de2c6f5dc0 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f1914cf7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f190c1ad600 con 0x55de2c6f54a0 2024-09-19T10:00:13.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f1914cf7740 10 client.0 _ll_register_callbacks cb 0x7f18f4032e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:13.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f190bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c7067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f1910ebb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c700680 0x55de2c779d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f190bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c7067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:56804/0 (socket says 172.21.15.18:56804) 2024-09-19T10:00:13.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f190bfff640 1 -- 172.21.15.18:0/309071870 learned_addr learned my addr 172.21.15.18:0/309071870 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:13.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f1903fff640 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c6f5dc0 0x55de2c706d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f190bfff640 1 -- 172.21.15.18:0/309071870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c6f5dc0 msgr2=0x55de2c706d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:13.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f190bfff640 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c6f5dc0 0x55de2c706d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f190bfff640 1 -- 172.21.15.18:0/309071870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c700680 msgr2=0x55de2c779d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:13.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f190bfff640 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c700680 0x55de2c779d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f190bfff640 1 -- 172.21.15.18:0/309071870 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de2c77a240 con 0x55de2c6f54a0 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f190bfff640 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c7067e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00ec20 tx=0x7f18fc0046f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f791e0c5364e01d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f18eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.153+0000 7f18eb7fe640 1 -- 172.21.15.18:0/309071870 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc014070 con 0x55de2c6f54a0 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f18eb7fe640 1 -- 172.21.15.18:0/309071870 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f18fc011a90 con 0x55de2c6f54a0 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f1914cf7740 1 -- 172.21.15.18:0/309071870 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18fc008310 con 0x55de2c6f54a0 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f18eb7fe640 1 -- 172.21.15.18:0/309071870 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18fc03e050 con 0x55de2c6f54a0 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f1914cf7740 10 client.26812 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f1914cf7740 1 -- 172.21.15.18:0/309071870 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55de2c77b3f0 con 0x55de2c6f54a0 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f18eb7fe640 1 -- 172.21.15.18:0/309071870 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc008310 con 0x55de2c6f54a0 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f18eb7fe640 1 -- 172.21.15.18:0/309071870 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f18fc018410 con 0x55de2c6f54a0 2024-09-19T10:00:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f1914cf7740 10 client.26812 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f1914cf7740 10 client.26812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f1914cf7740 20 client.26812 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f1914cf7740 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55de2c77b810 0x55de2c77dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f1914cf7740 4 client.26812 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f1914cf7740 1 -- 172.21.15.18:0/309071870 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55de2c662d60 con 0x55de2c77b810 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.154+0000 7f1903fff640 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55de2c77b810 0x55de2c77dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f18eb7fe640 10 client.26812 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f1903fff640 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55de2c77b810 0x55de2c77dc00 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca93bdeba8e7c8db server_cookie=46c9be45b2afdfcc in_seq=0 out_seq=0 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f18eb7fe640 1 -- 172.21.15.18:0/309071870 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55de2c662d60 con 0x55de2c77b810 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f18eb7fe640 10 client.26812 handle_command_reply: tid=0 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f1914cf7740 1 client.26812 shutdown 2024-09-19T10:00:13.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f1914cf7740 1 -- 172.21.15.18:0/309071870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 msgr2=0x55de2c7067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f1914cf7740 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c7067e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00ec20 tx=0x7f18fc0046f0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f1914cf7740 1 -- 172.21.15.18:0/309071870 shutdown_connections 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f1914cf7740 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55de2c77b810 0x55de2c77dc00 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f1914cf7740 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55de2c700680 0x55de2c779d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f18eb7fe640 0 client.26812 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f1914cf7740 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55de2c6f5dc0 0x55de2c706d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.155+0000 7f1914cf7740 1 --2- 172.21.15.18:0/309071870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de2c6f54a0 0x55de2c7067e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.156+0000 7f1914cf7740 1 -- 172.21.15.18:0/309071870 >> 172.21.15.18:0/309071870 conn(0x55de2c6f1a30 msgr2=0x55de2c6f0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.156+0000 7f1914cf7740 1 -- 172.21.15.18:0/309071870 shutdown_connections 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.156+0000 7f1914cf7740 1 -- 172.21.15.18:0/309071870 wait complete. 2024-09-19T10:00:13.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.156+0000 7f1914cf7740 20 client.26812 trim_cache size 0 max 16384 2024-09-19T10:00:13.169 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:00:13.169 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T10:00:13.169 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T10:00:13.169 INFO:teuthology.orchestra.run.smithi018.stdout: "9083f287-6792-400a-b23d-a414702d8629": { 2024-09-19T10:00:13.169 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T10:00:13.169 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "9083f287-6792-400a-b23d-a414702d8629", 2024-09-19T10:00:13.169 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T10:00:13.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:13.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:13.170 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:00:13.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.156+0000 7f191291e640 1 -- 172.21.15.18:0/2736823410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f18f80a3240 msgr2=0x7f18f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:13.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.156+0000 7f191291e640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f18f80a3240 0x7f18f80a5700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f18f4005ec0 tx=0x7f18f4009260 comp rx=0 tx=0).stop 2024-09-19T10:00:13.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.156+0000 7f191291e640 1 -- 172.21.15.18:0/2736823410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190c10e4d0 msgr2=0x7f190c19ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:13.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.156+0000 7f191291e640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190c10e4d0 0x7f190c19ef50 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f190400eaa0 tx=0x7f190400ef60 comp rx=0 tx=0).stop 2024-09-19T10:00:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.157+0000 7f191291e640 1 -- 172.21.15.18:0/2736823410 shutdown_connections 2024-09-19T10:00:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.157+0000 7f191291e640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f18f80a3240 0x7f18f80a5700 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.157+0000 7f191291e640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190c10e4d0 0x7f190c19ef50 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.157+0000 7f191291e640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f190c101360 0x7f190c19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.157+0000 7f191291e640 1 --2- 172.21.15.18:0/2736823410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190c1009b0 0x7f190c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.157+0000 7f191291e640 1 -- 172.21.15.18:0/2736823410 >> 172.21.15.18:0/2736823410 conn(0x7f190c0fc7d0 msgr2=0x7f190c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.157+0000 7f191291e640 1 -- 172.21.15.18:0/2736823410 shutdown_connections 2024-09-19T10:00:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:13.157+0000 7f191291e640 1 -- 172.21.15.18:0/2736823410 wait complete. 2024-09-19T10:00:13.833 INFO:tasks.cephfs.filesystem:scrub status for tag:9083f287-6792-400a-b23d-a414702d8629 - {'path': '/', 'tag': '9083f287-6792-400a-b23d-a414702d8629', 'options': 'recursive,force'} 2024-09-19T10:00:13.837 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.288+0000 7fa871066640 1 -- 172.21.15.18:0/152453726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86c103780 msgr2=0x7fa86c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.288+0000 7fa871066640 1 --2- 172.21.15.18:0/152453726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86c103780 0x7fa86c107bc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa854009930 tx=0x7fa85402a420 comp rx=0 tx=0).stop 2024-09-19T10:00:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.288+0000 7fa871066640 1 -- 172.21.15.18:0/152453726 shutdown_connections 2024-09-19T10:00:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.288+0000 7fa871066640 1 --2- 172.21.15.18:0/152453726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa86c108300 0x7fa86c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.288+0000 7fa871066640 1 --2- 172.21.15.18:0/152453726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86c103780 0x7fa86c107bc0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.288+0000 7fa871066640 1 --2- 172.21.15.18:0/152453726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86c102dd0 0x7fa86c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.288+0000 7fa871066640 1 -- 172.21.15.18:0/152453726 >> 172.21.15.18:0/152453726 conn(0x7fa86c0fc7d0 msgr2=0x7fa86c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.288+0000 7fa871066640 1 -- 172.21.15.18:0/152453726 shutdown_connections 2024-09-19T10:00:14.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.288+0000 7fa871066640 1 -- 172.21.15.18:0/152453726 wait complete. 2024-09-19T10:00:14.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa871066640 1 Processor -- start 2024-09-19T10:00:14.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa871066640 1 -- start start 2024-09-19T10:00:14.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa871066640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa86c102dd0 0x7fa86c100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa871066640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86c103780 0x7fa86c100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa871066640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86c108300 0x7fa86c1014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa871066640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c1120f0 con 0x7fa86c108300 2024-09-19T10:00:14.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa871066640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c111f70 con 0x7fa86c102dd0 2024-09-19T10:00:14.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa871066640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c112270 con 0x7fa86c103780 2024-09-19T10:00:14.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa86b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86c108300 0x7fa86c1014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa86b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86c108300 0x7fa86c1014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38158/0 (socket says 172.21.15.18:38158) 2024-09-19T10:00:14.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa86b59e640 1 -- 172.21.15.18:0/4291655860 learned_addr learned my addr 172.21.15.18:0/4291655860 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:14.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa86c102dd0 0x7fa86c100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.289+0000 7fa863fff640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86c103780 0x7fa86c100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa86b59e640 1 -- 172.21.15.18:0/4291655860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86c103780 msgr2=0x7fa86c100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa86b59e640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86c103780 0x7fa86c100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa86b59e640 1 -- 172.21.15.18:0/4291655860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa86c102dd0 msgr2=0x7fa86c100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa86b59e640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa86c102dd0 0x7fa86c100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa86b59e640 1 -- 172.21.15.18:0/4291655860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86c1a6b50 con 0x7fa86c108300 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa86b59e640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86c108300 0x7fa86c1014b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa86400b970 tx=0x7fa86400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa868d99640 1 -- 172.21.15.18:0/4291655860 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864019070 con 0x7fa86c108300 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa868d99640 1 -- 172.21.15.18:0/4291655860 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa86400cb40 con 0x7fa86c108300 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa871066640 1 -- 172.21.15.18:0/4291655860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86c1a6e40 con 0x7fa86c108300 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa868d99640 1 -- 172.21.15.18:0/4291655860 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864007650 con 0x7fa86c108300 2024-09-19T10:00:14.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.290+0000 7fa871066640 1 -- 172.21.15.18:0/4291655860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa86c1a7300 con 0x7fa86c108300 2024-09-19T10:00:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa87343f740 1 Processor -- start 2024-09-19T10:00:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa868d99640 1 -- 172.21.15.18:0/4291655860 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa86401c070 con 0x7fa86c108300 2024-09-19T10:00:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa87343f740 1 -- start start 2024-09-19T10:00:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa87343f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7060 0x5589785c7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa87343f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7980 0x5589785d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa87343f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785d2240 0x5589785d4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa87343f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55897852c620 con 0x5589785d2240 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa87343f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5589784d3e50 con 0x5589785c7060 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa87343f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5589785285e0 con 0x5589785c7980 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa863fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785d2240 0x5589785d4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.293+0000 7fa86ad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7980 0x5589785d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa86ad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7980 0x5589785d1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:56836/0 (socket says 172.21.15.18:56836) 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa863fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785d2240 0x5589785d4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38160/0 (socket says 172.21.15.18:38160) 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa86ad9d640 1 -- 172.21.15.18:0/105866584 learned_addr learned my addr 172.21.15.18:0/105866584 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa863fff640 1 --2- 172.21.15.18:0/105866584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7060 0x5589785c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa86ad9d640 1 -- 172.21.15.18:0/105866584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7060 msgr2=0x5589785c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/105866584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7060 0x5589785c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa86ad9d640 1 -- 172.21.15.18:0/105866584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785d2240 msgr2=0x5589785d4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/105866584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785d2240 0x5589785d4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa86ad9d640 1 -- 172.21.15.18:0/105866584 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589784c4d40 con 0x5589785c7980 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa868d99640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa8580a32c0 0x7fa8580a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa863fff640 1 --2- 172.21.15.18:0/105866584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7060 0x5589785c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/105866584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7980 0x5589785d1d00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009d20 tx=0x7fa85c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c912359c70b5f37a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa868d99640 1 -- 172.21.15.18:0/4291655860 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa8640cee60 con 0x7fa86c108300 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa863fff640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa8580a32c0 0x7fa8580a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa8617fa640 1 -- 172.21.15.18:0/105866584 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c01e070 con 0x5589785c7980 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa8617fa640 1 -- 172.21.15.18:0/105866584 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa85c019b10 con 0x5589785c7980 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.294+0000 7fa8617fa640 1 -- 172.21.15.18:0/105866584 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c00ebf0 con 0x5589785c7980 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.295+0000 7fa87343f740 1 -- 172.21.15.18:0/105866584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7980 msgr2=0x5589785d1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.295+0000 7fa87343f740 1 --2- 172.21.15.18:0/105866584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7980 0x5589785d1d00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009d20 tx=0x7fa85c011810 comp rx=0 tx=0).stop 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.295+0000 7fa863fff640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa8580a32c0 0x7fa8580a5780 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa854005940 tx=0x7fa854005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.295+0000 7fa87343f740 1 -- 172.21.15.18:0/105866584 shutdown_connections 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.295+0000 7fa87343f740 1 --2- 172.21.15.18:0/105866584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785d2240 0x5589785d4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.295+0000 7fa87343f740 1 --2- 172.21.15.18:0/105866584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7980 0x5589785d1d00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.295+0000 7fa87343f740 1 --2- 172.21.15.18:0/105866584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7060 0x5589785c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.295+0000 7fa87343f740 1 -- 172.21.15.18:0/105866584 >> 172.21.15.18:0/105866584 conn(0x5589785c35f0 msgr2=0x5589785c39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.295+0000 7fa87343f740 1 -- 172.21.15.18:0/105866584 shutdown_connections 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.295+0000 7fa87343f740 1 -- 172.21.15.18:0/105866584 wait complete. 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa87343f740 1 -- start start 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa87343f740 1 Processor -- start 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa87343f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7060 0x5589785cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa87343f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7980 0x5589785cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa87343f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785d2240 0x5589785cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa87343f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589785d4e10 con 0x5589785c7060 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa87343f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5589784b4f10 con 0x5589785c7980 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa87343f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5589785d4f90 con 0x5589785d2240 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa87343f740 10 client.0 _ll_register_callbacks cb 0x5589784d8db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa86ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7060 0x5589785cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa86ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7060 0x5589785cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38172/0 (socket says 172.21.15.18:38172) 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa86ad9d640 1 -- 172.21.15.18:0/1673696397 learned_addr learned my addr 172.21.15.18:0/1673696397 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa86b59e640 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785d2240 0x5589785cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa863fff640 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7980 0x5589785cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa86ad9d640 1 -- 172.21.15.18:0/1673696397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785d2240 msgr2=0x5589785cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785d2240 0x5589785cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa86ad9d640 1 -- 172.21.15.18:0/1673696397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7980 msgr2=0x5589785cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7980 0x5589785cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa86ad9d640 1 -- 172.21.15.18:0/1673696397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55897823b580 con 0x5589785c7060 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.296+0000 7fa863fff640 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7980 0x5589785cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.297+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7060 0x5589785cf0b0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa85c019660 tx=0x7fa85c019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6eb6a07b7513513 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.297+0000 7fa8527fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.297+0000 7fa8527fc640 1 -- 172.21.15.18:0/1673696397 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c01e070 con 0x5589785c7060 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.297+0000 7fa8527fc640 1 -- 172.21.15.18:0/1673696397 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa85c00eaf0 con 0x5589785c7060 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.297+0000 7fa87343f740 1 -- 172.21.15.18:0/1673696397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa85c019b10 con 0x5589785c7060 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.297+0000 7fa8527fc640 1 -- 172.21.15.18:0/1673696397 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa85c0098f0 con 0x5589785c7060 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.297+0000 7fa87343f740 10 client.17385 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.297+0000 7fa87343f740 1 -- 172.21.15.18:0/1673696397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558978305960 con 0x5589785c7060 2024-09-19T10:00:14.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.297+0000 7fa8527fc640 1 -- 172.21.15.18:0/1673696397 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa85c019b10 con 0x5589785c7060 2024-09-19T10:00:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.298+0000 7fa8527fc640 1 -- 172.21.15.18:0/1673696397 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa85c0047e0 con 0x5589785c7060 2024-09-19T10:00:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.298+0000 7fa87343f740 10 client.17385 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.298+0000 7fa87343f740 10 client.17385 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:00:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.298+0000 7fa87343f740 20 client.17385 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.298+0000 7fa87343f740 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5589785e1bc0 0x5589785e3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.298+0000 7fa87343f740 4 client.17385 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.298+0000 7fa87343f740 1 -- 172.21.15.18:0/1673696397 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558978539b90 con 0x5589785e1bc0 2024-09-19T10:00:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.298+0000 7fa863fff640 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5589785e1bc0 0x5589785e3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.298+0000 7fa863fff640 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5589785e1bc0 0x5589785e3fb0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67ff50853603085d server_cookie=d773b74ffe445a9d in_seq=0 out_seq=0 2024-09-19T10:00:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.298+0000 7fa8527fc640 10 client.17385 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa8527fc640 1 -- 172.21.15.18:0/1673696397 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558978539b90 con 0x5589785e1bc0 2024-09-19T10:00:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa8527fc640 10 client.17385 handle_command_reply: tid=0 2024-09-19T10:00:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa87343f740 1 client.17385 shutdown 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa87343f740 1 -- 172.21.15.18:0/1673696397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7060 msgr2=0x5589785cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa87343f740 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7060 0x5589785cf0b0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa85c019660 tx=0x7fa85c019690 comp rx=0 tx=0).stop 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa87343f740 1 -- 172.21.15.18:0/1673696397 shutdown_connections 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa87343f740 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5589785e1bc0 0x5589785e3fb0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa87343f740 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785d2240 0x5589785cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa87343f740 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785c7980 0x5589785cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa87343f740 1 --2- 172.21.15.18:0/1673696397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7060 0x5589785cf0b0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa87343f740 1 -- 172.21.15.18:0/1673696397 >> 172.21.15.18:0/1673696397 conn(0x5589785c35f0 msgr2=0x5589785c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.299+0000 7fa8527fc640 0 client.17385 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.300+0000 7fa87343f740 1 -- 172.21.15.18:0/1673696397 shutdown_connections 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.300+0000 7fa87343f740 1 -- 172.21.15.18:0/1673696397 wait complete. 2024-09-19T10:00:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.300+0000 7fa87343f740 20 client.17385 trim_cache size 0 max 16384 2024-09-19T10:00:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.316+0000 7fa87343f740 1 Processor -- start 2024-09-19T10:00:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.316+0000 7fa87343f740 1 -- start start 2024-09-19T10:00:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa87343f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 0x5589785ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa87343f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785e9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa87343f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 0x5589785e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa87343f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c1af710 con 0x5589785c7980 2024-09-19T10:00:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa87343f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c1b1250 con 0x5589785d2240 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa87343f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c1afde0 con 0x5589785c7060 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa863fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785e9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa863fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785e9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38180/0 (socket says 172.21.15.18:38180) 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa863fff640 1 -- 172.21.15.18:0/1671213258 learned_addr learned my addr 172.21.15.18:0/1671213258 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 0x5589785ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa86b59e640 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 0x5589785e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa863fff640 1 -- 172.21.15.18:0/1671213258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 msgr2=0x5589785ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa863fff640 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 0x5589785ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa863fff640 1 -- 172.21.15.18:0/1671213258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 msgr2=0x5589785e9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa863fff640 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 0x5589785e9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa863fff640 1 -- 172.21.15.18:0/1671213258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589785c6de0 con 0x5589785c7980 2024-09-19T10:00:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 0x5589785ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa86b59e640 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 0x5589785e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.317+0000 7fa863fff640 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785e9790 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fa854009900 tx=0x7fa854040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fcb82b6d4f4d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.318+0000 7fa860ff9640 1 -- 172.21.15.18:0/1671213258 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85405b070 con 0x5589785c7980 2024-09-19T10:00:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.318+0000 7fa860ff9640 1 -- 172.21.15.18:0/1671213258 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa854003d90 con 0x5589785c7980 2024-09-19T10:00:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.318+0000 7fa860ff9640 1 -- 172.21.15.18:0/1671213258 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854035040 con 0x5589785c7980 2024-09-19T10:00:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.318+0000 7fa87343f740 1 -- 172.21.15.18:0/1671213258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 msgr2=0x5589785e9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.318+0000 7fa87343f740 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785e9790 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fa854009900 tx=0x7fa854040040 comp rx=0 tx=0).stop 2024-09-19T10:00:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.318+0000 7fa87343f740 1 -- 172.21.15.18:0/1671213258 shutdown_connections 2024-09-19T10:00:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.318+0000 7fa87343f740 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 0x5589785e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785e9790 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 --2- 172.21.15.18:0/1671213258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 0x5589785ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 -- 172.21.15.18:0/1671213258 >> 172.21.15.18:0/1671213258 conn(0x5589785c35f0 msgr2=0x5589785d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 -- 172.21.15.18:0/1671213258 shutdown_connections 2024-09-19T10:00:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 -- 172.21.15.18:0/1671213258 wait complete. 2024-09-19T10:00:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 -- start start 2024-09-19T10:00:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 Processor -- start 2024-09-19T10:00:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 0x5589785d62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785d67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 0x55897864b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c1b0b80 con 0x5589785c7980 2024-09-19T10:00:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c1b04b0 con 0x5589785d2240 2024-09-19T10:00:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c1ad710 con 0x5589785c7060 2024-09-19T10:00:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.319+0000 7fa87343f740 10 client.0 _ll_register_callbacks cb 0x7fa85c009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa863fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785d67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa863fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785d67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38194/0 (socket says 172.21.15.18:38194) 2024-09-19T10:00:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa863fff640 1 -- 172.21.15.18:0/2004936614 learned_addr learned my addr 172.21.15.18:0/2004936614 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 0x5589785d62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa86b59e640 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 0x55897864b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa863fff640 1 -- 172.21.15.18:0/2004936614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 msgr2=0x5589785d62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa863fff640 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 0x5589785d62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa863fff640 1 -- 172.21.15.18:0/2004936614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 msgr2=0x55897864b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa863fff640 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 0x55897864b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa863fff640 1 -- 172.21.15.18:0/2004936614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589785d7070 con 0x5589785c7980 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa86b59e640 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 0x55897864b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa863fff640 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785d67e0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fa85402a940 tx=0x7fa8540036b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c195b3fd1063d531 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa8527fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa8527fc640 1 -- 172.21.15.18:0/2004936614 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854035050 con 0x5589785c7980 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa8527fc640 1 -- 172.21.15.18:0/2004936614 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa854003b60 con 0x5589785c7980 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.320+0000 7fa87343f740 1 -- 172.21.15.18:0/2004936614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa854003d90 con 0x5589785c7980 2024-09-19T10:00:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa8527fc640 1 -- 172.21.15.18:0/2004936614 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa85405b040 con 0x5589785c7980 2024-09-19T10:00:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa87343f740 10 client.17391 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa87343f740 1 -- 172.21.15.18:0/2004936614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55897864cde0 con 0x5589785c7980 2024-09-19T10:00:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa8527fc640 1 -- 172.21.15.18:0/2004936614 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa854003d90 con 0x5589785c7980 2024-09-19T10:00:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa8527fc640 1 -- 172.21.15.18:0/2004936614 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa85403d780 con 0x5589785c7980 2024-09-19T10:00:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa87343f740 10 client.17391 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa87343f740 10 client.17391 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:00:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa87343f740 20 client.17391 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa87343f740 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55897864d590 0x55897864f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa87343f740 4 client.17391 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2809e3bc", "release": true, "await": true}] 2024-09-19T10:00:14.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.321+0000 7fa87343f740 1 -- 172.21.15.18:0/2004936614 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2809e3bc", "release": true, "await": true}) -- 0x5589785340a0 con 0x55897864d590 2024-09-19T10:00:14.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.322+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55897864d590 0x55897864f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:14.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.322+0000 7fa86ad9d640 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55897864d590 0x55897864f9b0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee7f85c8325712e server_cookie=3edf04bccbe4d96c in_seq=0 out_seq=0 2024-09-19T10:00:14.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.322+0000 7fa8527fc640 10 client.17391 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:14.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.326+0000 7fa8527fc640 1 -- 172.21.15.18:0/2004936614 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5589785340a0 con 0x55897864d590 2024-09-19T10:00:14.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.327+0000 7fa8527fc640 10 client.17391 handle_command_reply: tid=0 2024-09-19T10:00:14.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.327+0000 7fa87343f740 1 client.17391 shutdown 2024-09-19T10:00:14.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.327+0000 7fa87343f740 1 -- 172.21.15.18:0/2004936614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 msgr2=0x5589785d67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:14.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.327+0000 7fa87343f740 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785d67e0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fa85402a940 tx=0x7fa8540036b0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.327+0000 7fa87343f740 1 -- 172.21.15.18:0/2004936614 shutdown_connections 2024-09-19T10:00:14.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.327+0000 7fa87343f740 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55897864d590 0x55897864f9b0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.327+0000 7fa8527fc640 0 client.17391 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:14.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.327+0000 7fa87343f740 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5589785d2240 0x55897864b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.328+0000 7fa87343f740 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589785c7980 0x5589785d67e0 secure :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fa85402a940 tx=0x7fa8540036b0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.328+0000 7fa87343f740 1 --2- 172.21.15.18:0/2004936614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5589785c7060 0x5589785d62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.328+0000 7fa87343f740 1 -- 172.21.15.18:0/2004936614 >> 172.21.15.18:0/2004936614 conn(0x5589785c35f0 msgr2=0x5589785c8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:14.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.347+0000 7fa87343f740 1 -- 172.21.15.18:0/2004936614 shutdown_connections 2024-09-19T10:00:14.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.347+0000 7fa87343f740 1 -- 172.21.15.18:0/2004936614 wait complete. 2024-09-19T10:00:14.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.347+0000 7fa87343f740 20 client.17391 trim_cache size 0 max 16384 2024-09-19T10:00:14.356 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:00:14.356 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T10:00:14.356 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T10:00:14.357 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 28, 2024-09-19T10:00:14.357 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T10:00:14.357 INFO:teuthology.orchestra.run.smithi018.stdout: "2809e3bc": { 2024-09-19T10:00:14.357 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 28, 2024-09-19T10:00:14.357 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T10:00:14.357 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:00:14.357 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T10:00:14.357 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:00:14.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:00:14.357 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T10:00:14.358 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 145.8, 2024-09-19T10:00:14.358 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T10:00:14.358 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T10:00:14.358 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T10:00:14.358 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:00:14.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T10:00:14.358 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:00:14.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:14.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:14.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:14.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:14.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:14.359 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:00:14.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.373+0000 7fa871066640 1 -- 172.21.15.18:0/4291655860 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa8580a32c0 msgr2=0x7fa8580a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.373+0000 7fa871066640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa8580a32c0 0x7fa8580a5780 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa854005940 tx=0x7fa854005780 comp rx=0 tx=0).stop 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.374+0000 7fa871066640 1 -- 172.21.15.18:0/4291655860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86c108300 msgr2=0x7fa86c1014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.374+0000 7fa871066640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86c108300 0x7fa86c1014b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa86400b970 tx=0x7fa86400be30 comp rx=0 tx=0).stop 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.374+0000 7fa871066640 1 -- 172.21.15.18:0/4291655860 shutdown_connections 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.374+0000 7fa871066640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa8580a32c0 0x7fa8580a5780 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.374+0000 7fa871066640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86c108300 0x7fa86c1014b0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.374+0000 7fa871066640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86c103780 0x7fa86c100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.374+0000 7fa871066640 1 --2- 172.21.15.18:0/4291655860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa86c102dd0 0x7fa86c100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.374+0000 7fa871066640 1 -- 172.21.15.18:0/4291655860 >> 172.21.15.18:0/4291655860 conn(0x7fa86c0fc7d0 msgr2=0x7fa86c105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.374+0000 7fa871066640 1 -- 172.21.15.18:0/4291655860 shutdown_connections 2024-09-19T10:00:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:14.376+0000 7fa871066640 1 -- 172.21.15.18:0/4291655860 wait complete. 2024-09-19T10:00:14.641 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:14 smithi018 ceph-mon[30956]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 244 MiB/s wr, 470 op/s 2024-09-19T10:00:14.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:14 smithi049 ceph-mon[34858]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 244 MiB/s wr, 470 op/s 2024-09-19T10:00:15.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:14 smithi162 ceph-mon[35174]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 244 MiB/s wr, 470 op/s 2024-09-19T10:00:15.672 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2809e3bc', total seconds elapsed: 31.1 2024-09-19T10:00:15.672 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T10:00:15.672 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:00:15.837 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:15 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T10:00:16.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:15 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T10:00:16.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:15 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T10:00:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:17.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:16 smithi018 ceph-mon[30956]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 944 KiB/s rd, 105 MiB/s wr, 305 op/s 2024-09-19T10:00:17.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:16 smithi049 ceph-mon[34858]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 944 KiB/s rd, 105 MiB/s wr, 305 op/s 2024-09-19T10:00:17.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:16 smithi162 ceph-mon[35174]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 944 KiB/s rd, 105 MiB/s wr, 305 op/s 2024-09-19T10:00:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.441+0000 7f14ae8ae640 1 -- 172.21.15.18:0/4019900002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14a810de90 msgr2=0x7f14a8110350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.441+0000 7f14ae8ae640 1 --2- 172.21.15.18:0/4019900002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14a810de90 0x7f14a8110350 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1498009900 tx=0x7f149802a410 comp rx=0 tx=0).stop 2024-09-19T10:00:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.442+0000 7f14ae8ae640 1 -- 172.21.15.18:0/4019900002 shutdown_connections 2024-09-19T10:00:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.442+0000 7f14ae8ae640 1 --2- 172.21.15.18:0/4019900002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14a810de90 0x7f14a8110350 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.442+0000 7f14ae8ae640 1 --2- 172.21.15.18:0/4019900002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a810b4e0 0x7f14a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.442+0000 7f14ae8ae640 1 --2- 172.21.15.18:0/4019900002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14a8072d80 0x7f14a8073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.442+0000 7f14ae8ae640 1 -- 172.21.15.18:0/4019900002 >> 172.21.15.18:0/4019900002 conn(0x7f14a806eb50 msgr2=0x7f14a8070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.443+0000 7f14ae8ae640 1 -- 172.21.15.18:0/4019900002 shutdown_connections 2024-09-19T10:00:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.443+0000 7f14ae8ae640 1 -- 172.21.15.18:0/4019900002 wait complete. 2024-09-19T10:00:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.445+0000 7f14ae8ae640 1 Processor -- start 2024-09-19T10:00:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.445+0000 7f14ae8ae640 1 -- start start 2024-09-19T10:00:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.446+0000 7f14ae8ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14a8072d80 0x7f14a81a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.446+0000 7f14ae8ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a810b4e0 0x7f14a81a7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.446+0000 7f14ae8ae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14a810de90 0x7f14a81ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.446+0000 7f14ae8ae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f14a811c480 con 0x7f14a8072d80 2024-09-19T10:00:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.446+0000 7f14ae8ae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f14a811c300 con 0x7f14a810b4e0 2024-09-19T10:00:17.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.446+0000 7f14ae8ae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14a811c600 con 0x7f14a810de90 2024-09-19T10:00:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.448+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a810b4e0 0x7f14a81a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.448+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a810b4e0 0x7f14a81a7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43426/0 (socket says 172.21.15.18:43426) 2024-09-19T10:00:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.448+0000 7f14a77fe640 1 -- 172.21.15.18:0/1866044926 learned_addr learned my addr 172.21.15.18:0/1866044926 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:17.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.448+0000 7f14ace4b640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14a810de90 0x7f14a81ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.449+0000 7f14ace4b640 1 -- 172.21.15.18:0/1866044926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a810b4e0 msgr2=0x7f14a81a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.450+0000 7f14ace4b640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a810b4e0 0x7f14a81a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.450+0000 7f14ace4b640 1 -- 172.21.15.18:0/1866044926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14a8072d80 msgr2=0x7f14a81a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.450+0000 7f14ace4b640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14a8072d80 0x7f14a81a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.450+0000 7f14ace4b640 1 -- 172.21.15.18:0/1866044926 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a81ae6f0 con 0x7f14a810de90 2024-09-19T10:00:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.451+0000 7f14ace4b640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14a810de90 0x7f14a81ae080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1498009850 tx=0x7f1498032d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.451+0000 7f14a57fa640 1 -- 172.21.15.18:0/1866044926 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149803f030 con 0x7f14a810de90 2024-09-19T10:00:17.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.452+0000 7f14ae8ae640 1 -- 172.21.15.18:0/1866044926 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a81ae980 con 0x7f14a810de90 2024-09-19T10:00:17.459 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.452+0000 7f14ae8ae640 1 -- 172.21.15.18:0/1866044926 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a81aef10 con 0x7f14a810de90 2024-09-19T10:00:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.465+0000 7f14b1649740 1 Processor -- start 2024-09-19T10:00:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.465+0000 7f14b1649740 1 -- start start 2024-09-19T10:00:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.466+0000 7f14a57fa640 1 -- 172.21.15.18:0/1866044926 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1498003ce0 con 0x7f14a810de90 2024-09-19T10:00:17.472 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.466+0000 7f14a57fa640 1 -- 172.21.15.18:0/1866044926 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498035070 con 0x7f14a810de90 2024-09-19T10:00:17.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.475+0000 7f14a57fa640 1 -- 172.21.15.18:0/1866044926 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1498042030 con 0x7f14a810de90 2024-09-19T10:00:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.484+0000 7f14b1649740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d83797f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.484+0000 7f14b1649740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837984b0 0x563d8379cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.484+0000 7f14b1649740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d8379d540 0x563d8379fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.484+0000 7f14b1649740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563d836fb2f0 con 0x563d8379d540 2024-09-19T10:00:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.484+0000 7f14b1649740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563d836a3270 con 0x563d837984b0 2024-09-19T10:00:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.484+0000 7f14b1649740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563d836f72b0 con 0x563d83797b70 2024-09-19T10:00:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.484+0000 7f14a57fa640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f14900a3380 0x7f14900a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.485+0000 7f14a57fa640 1 -- 172.21.15.18:0/1866044926 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f14980f03c0 con 0x7f14a810de90 2024-09-19T10:00:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.485+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837984b0 0x563d8379cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.485+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837984b0 0x563d8379cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43432/0 (socket says 172.21.15.18:43432) 2024-09-19T10:00:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.485+0000 7f14a7fff640 1 -- 172.21.15.18:0/2080769269 learned_addr learned my addr 172.21.15.18:0/2080769269 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.486+0000 7f14ace4b640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f14900a3380 0x7f14900a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.486+0000 7f14a77fe640 1 --2- 172.21.15.18:0/2080769269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d83797f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.486+0000 7f14a77fe640 1 --2- 172.21.15.18:0/2080769269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d8379d540 0x563d8379fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.487+0000 7f14a7fff640 1 -- 172.21.15.18:0/2080769269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 msgr2=0x563d83797f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.487+0000 7f14a7fff640 1 --2- 172.21.15.18:0/2080769269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d83797f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.487+0000 7f14a7fff640 1 -- 172.21.15.18:0/2080769269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d8379d540 msgr2=0x563d8379fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.487+0000 7f14a7fff640 1 --2- 172.21.15.18:0/2080769269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d8379d540 0x563d8379fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.487+0000 7f14a7fff640 1 -- 172.21.15.18:0/2080769269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d836a2340 con 0x563d837984b0 2024-09-19T10:00:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.491+0000 7f14a7fff640 1 --2- 172.21.15.18:0/2080769269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837984b0 0x563d8379cf70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f149c00bb10 tx=0x7f149c00d2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec43c59bf9b9b794 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:17.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.492+0000 7f148e7fc640 1 -- 172.21.15.18:0/2080769269 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c016070 con 0x563d837984b0 2024-09-19T10:00:17.494 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.492+0000 7f148e7fc640 1 -- 172.21.15.18:0/2080769269 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f149c005500 con 0x563d837984b0 2024-09-19T10:00:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.493+0000 7f14b1649740 1 -- 172.21.15.18:0/2080769269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837984b0 msgr2=0x563d8379cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.493+0000 7f14b1649740 1 --2- 172.21.15.18:0/2080769269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837984b0 0x563d8379cf70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f149c00bb10 tx=0x7f149c00d2e0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.494+0000 7f14ace4b640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f14900a3380 0x7f14900a5840 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f14980bc6b0 tx=0x7f149802a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.494+0000 7f14b1649740 1 -- 172.21.15.18:0/2080769269 shutdown_connections 2024-09-19T10:00:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.494+0000 7f14b1649740 1 --2- 172.21.15.18:0/2080769269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d8379d540 0x563d8379fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.494+0000 7f14b1649740 1 --2- 172.21.15.18:0/2080769269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837984b0 0x563d8379cf70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.494+0000 7f14b1649740 1 --2- 172.21.15.18:0/2080769269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d83797f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.494+0000 7f14b1649740 1 -- 172.21.15.18:0/2080769269 >> 172.21.15.18:0/2080769269 conn(0x563d837931e0 msgr2=0x563d837935e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.497+0000 7f14b1649740 1 -- 172.21.15.18:0/2080769269 shutdown_connections 2024-09-19T10:00:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.498+0000 7f14b1649740 1 -- 172.21.15.18:0/2080769269 wait complete. 2024-09-19T10:00:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.499+0000 7f14b1649740 1 -- start start 2024-09-19T10:00:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.500+0000 7f14b1649740 1 Processor -- start 2024-09-19T10:00:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.501+0000 7f14b1649740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d83797b70 0x563d837a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.501+0000 7f14b1649740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 0x563d837a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.501+0000 7f14b1649740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d837a7310 0x563d837a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.501+0000 7f14b1649740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563d837a0560 con 0x563d83797b70 2024-09-19T10:00:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.501+0000 7f14b1649740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563d83684290 con 0x563d8379d540 2024-09-19T10:00:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.501+0000 7f14b1649740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563d837a06e0 con 0x563d837a7310 2024-09-19T10:00:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.501+0000 7f14b1649740 10 client.0 _ll_register_callbacks cb 0x563d836b5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.503+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 0x563d837a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.503+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 0x563d837a22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43438/0 (socket says 172.21.15.18:43438) 2024-09-19T10:00:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.503+0000 7f14a7fff640 1 -- 172.21.15.18:0/2969189989 learned_addr learned my addr 172.21.15.18:0/2969189989 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.504+0000 7f14a7fff640 1 -- 172.21.15.18:0/2969189989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d837a7310 msgr2=0x563d837a9700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:00:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.504+0000 7f14a7fff640 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d837a7310 0x563d837a9700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.504+0000 7f14a7fff640 1 -- 172.21.15.18:0/2969189989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d83797b70 msgr2=0x563d837a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.504+0000 7f14a7fff640 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d83797b70 0x563d837a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.504+0000 7f14a7fff640 1 -- 172.21.15.18:0/2969189989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d8340e210 con 0x563d8379d540 2024-09-19T10:00:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.506+0000 7f14a7fff640 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 0x563d837a22e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f149c00bfd0 tx=0x7f149c00dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ac26765171cec12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.506+0000 7f14877fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:00:17.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.507+0000 7f14877fe640 1 -- 172.21.15.18:0/2969189989 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c016050 con 0x563d8379d540 2024-09-19T10:00:17.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.507+0000 7f14b1649740 1 -- 172.21.15.18:0/2969189989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563d83708a20 con 0x563d8379d540 2024-09-19T10:00:17.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.508+0000 7f14877fe640 1 -- 172.21.15.18:0/2969189989 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f149c004440 con 0x563d8379d540 2024-09-19T10:00:17.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.509+0000 7f14877fe640 1 -- 172.21.15.18:0/2969189989 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f149c02a070 con 0x563d8379d540 2024-09-19T10:00:17.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.509+0000 7f14b1649740 10 client.26837 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:17.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.509+0000 7f14b1649740 1 -- 172.21.15.18:0/2969189989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563d834da620 con 0x563d8379d540 2024-09-19T10:00:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.510+0000 7f14877fe640 1 -- 172.21.15.18:0/2969189989 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563d83708a20 con 0x563d8379d540 2024-09-19T10:00:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.512+0000 7f14877fe640 1 -- 172.21.15.18:0/2969189989 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f149c010680 con 0x563d8379d540 2024-09-19T10:00:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.513+0000 7f14b1649740 10 client.26837 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.513+0000 7f14b1649740 10 client.26837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.513+0000 7f14b1649740 20 client.26837 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.513+0000 7f14b1649740 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563d837ae280 0x563d837b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.513+0000 7f14b1649740 4 client.26837 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.513+0000 7f14b1649740 1 -- 172.21.15.18:0/2969189989 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d83702d70 con 0x563d837ae280 2024-09-19T10:00:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.521+0000 7f14a77fe640 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563d837ae280 0x563d837b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.523+0000 7f14a77fe640 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563d837ae280 0x563d837b06e0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=495a5d08f1bbd171 server_cookie=758e285839beb3e9 in_seq=0 out_seq=0 2024-09-19T10:00:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.523+0000 7f14877fe640 10 client.26837 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.529+0000 7f14877fe640 1 -- 172.21.15.18:0/2969189989 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d83702d70 con 0x563d837ae280 2024-09-19T10:00:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.529+0000 7f14877fe640 10 client.26837 handle_command_reply: tid=0 2024-09-19T10:00:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.529+0000 7f14b1649740 1 client.26837 shutdown 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.532+0000 7f14b1649740 1 -- 172.21.15.18:0/2969189989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 msgr2=0x563d837a22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.533+0000 7f14b1649740 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 0x563d837a22e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f149c00bfd0 tx=0x7f149c00dd10 comp rx=0 tx=0).stop 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.533+0000 7f14b1649740 1 -- 172.21.15.18:0/2969189989 shutdown_connections 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.533+0000 7f14b1649740 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563d837ae280 0x563d837b06e0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.533+0000 7f14b1649740 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d837a7310 0x563d837a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.533+0000 7f14b1649740 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 0x563d837a22e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.533+0000 7f14b1649740 1 --2- 172.21.15.18:0/2969189989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d83797b70 0x563d837a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.533+0000 7f14b1649740 1 -- 172.21.15.18:0/2969189989 >> 172.21.15.18:0/2969189989 conn(0x563d837931e0 msgr2=0x563d83794240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.533+0000 7f14877fe640 0 client.26837 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.534+0000 7f14b1649740 1 -- 172.21.15.18:0/2969189989 shutdown_connections 2024-09-19T10:00:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.535+0000 7f14b1649740 1 -- 172.21.15.18:0/2969189989 wait complete. 2024-09-19T10:00:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.535+0000 7f14b1649740 20 client.26837 trim_cache size 0 max 16384 2024-09-19T10:00:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.585+0000 7f14b1649740 1 Processor -- start 2024-09-19T10:00:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.585+0000 7f14b1649740 1 -- start start 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.586+0000 7f14b1649740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d837994f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.586+0000 7f14b1649740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 0x563d83799a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.586+0000 7f14b1649740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d837a7310 0x563d83794100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.586+0000 7f14b1649740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f149400e380 con 0x563d837a7310 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.586+0000 7f14b1649740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f149400fec0 con 0x563d8379d540 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.586+0000 7f14b1649740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f149400ea50 con 0x563d83797b70 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.586+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d837a7310 0x563d83794100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.586+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d837a7310 0x563d83794100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39316/0 (socket says 172.21.15.18:39316) 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.586+0000 7f14a77fe640 1 -- 172.21.15.18:0/1638487570 learned_addr learned my addr 172.21.15.18:0/1638487570 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.587+0000 7f14a77fe640 1 --2- 172.21.15.18:0/1638487570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d837994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.587+0000 7f14a77fe640 1 -- 172.21.15.18:0/1638487570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 msgr2=0x563d837994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.587+0000 7f14a77fe640 1 --2- 172.21.15.18:0/1638487570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d837994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.587+0000 7f14a77fe640 1 -- 172.21.15.18:0/1638487570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 msgr2=0x563d83799a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.587+0000 7f14a77fe640 1 --2- 172.21.15.18:0/1638487570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 0x563d83799a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.587+0000 7f14a77fe640 1 -- 172.21.15.18:0/1638487570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d837b0d60 con 0x563d837a7310 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.588+0000 7f14a77fe640 1 --2- 172.21.15.18:0/1638487570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d837a7310 0x563d83794100 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f14a00070b0 tx=0x7f14a0004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9390abcdafbe34cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.588+0000 7f148dffb640 1 -- 172.21.15.18:0/1638487570 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a00199c0 con 0x563d837a7310 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.588+0000 7f148dffb640 1 -- 172.21.15.18:0/1638487570 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14a001b450 con 0x563d837a7310 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.588+0000 7f148dffb640 1 -- 172.21.15.18:0/1638487570 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a0017640 con 0x563d837a7310 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.589+0000 7f14b1649740 1 -- 172.21.15.18:0/1638487570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d837a7310 msgr2=0x563d83794100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.590+0000 7f14b1649740 1 --2- 172.21.15.18:0/1638487570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d837a7310 0x563d83794100 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f14a00070b0 tx=0x7f14a0004b50 comp rx=0 tx=0).stop 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.590+0000 7f14b1649740 1 -- 172.21.15.18:0/1638487570 shutdown_connections 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.590+0000 7f14b1649740 1 --2- 172.21.15.18:0/1638487570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d837a7310 0x563d83794100 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.596 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.590+0000 7f14b1649740 1 --2- 172.21.15.18:0/1638487570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d8379d540 0x563d83799a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.590+0000 7f14b1649740 1 --2- 172.21.15.18:0/1638487570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d837994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.590+0000 7f14b1649740 1 -- 172.21.15.18:0/1638487570 >> 172.21.15.18:0/1638487570 conn(0x563d837931e0 msgr2=0x563d837935c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.606+0000 7f14b1649740 1 -- 172.21.15.18:0/1638487570 shutdown_connections 2024-09-19T10:00:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.608+0000 7f14b1649740 1 -- 172.21.15.18:0/1638487570 wait complete. 2024-09-19T10:00:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.612+0000 7f14b1649740 1 -- start start 2024-09-19T10:00:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.612+0000 7f14b1649740 1 Processor -- start 2024-09-19T10:00:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.614+0000 7f14b1649740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d837bcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.615+0000 7f14b1649740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d8379d540 0x563d837bd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.615+0000 7f14b1649740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837a7310 0x563d837c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.615+0000 7f14b1649740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f149400f7f0 con 0x563d8379d540 2024-09-19T10:00:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.615+0000 7f14b1649740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f149400f120 con 0x563d837a7310 2024-09-19T10:00:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.615+0000 7f14b1649740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f149400c410 con 0x563d83797b70 2024-09-19T10:00:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.615+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d837bcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.615+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d837bcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50998/0 (socket says 172.21.15.18:50998) 2024-09-19T10:00:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.615+0000 7f14a77fe640 1 -- 172.21.15.18:0/3717716000 learned_addr learned my addr 172.21.15.18:0/3717716000 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.615+0000 7f14b1649740 10 client.0 _ll_register_callbacks cb 0x7f14a00098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.617+0000 7f14a77fe640 1 -- 172.21.15.18:0/3717716000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837a7310 msgr2=0x563d837c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.617+0000 7f14a77fe640 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837a7310 0x563d837c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.617+0000 7f14a77fe640 1 -- 172.21.15.18:0/3717716000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d8379d540 msgr2=0x563d837bd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.617+0000 7f14a77fe640 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d8379d540 0x563d837bd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.617+0000 7f14a77fe640 1 -- 172.21.15.18:0/3717716000 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d837c28c0 con 0x563d83797b70 2024-09-19T10:00:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.617+0000 7f14a77fe640 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d837bcf30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f14a0006d80 tx=0x7f14a0019c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb71227113581f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.621+0000 7f14877fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.621+0000 7f14877fe640 1 -- 172.21.15.18:0/3717716000 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a001b600 con 0x563d83797b70 2024-09-19T10:00:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.622+0000 7f14877fe640 1 -- 172.21.15.18:0/3717716000 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f14a001b7a0 con 0x563d83797b70 2024-09-19T10:00:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.623+0000 7f14b1649740 1 -- 172.21.15.18:0/3717716000 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14a001b450 con 0x563d83797b70 2024-09-19T10:00:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.624+0000 7f14877fe640 1 -- 172.21.15.18:0/3717716000 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f14a001b9a0 con 0x563d83797b70 2024-09-19T10:00:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.625+0000 7f14b1649740 10 client.26845 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.625+0000 7f14b1649740 1 -- 172.21.15.18:0/3717716000 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563d83817e80 con 0x563d83797b70 2024-09-19T10:00:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.626+0000 7f14877fe640 1 -- 172.21.15.18:0/3717716000 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14a001bb40 con 0x563d83797b70 2024-09-19T10:00:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.626+0000 7f14877fe640 1 -- 172.21.15.18:0/3717716000 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f14a0057030 con 0x563d83797b70 2024-09-19T10:00:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.626+0000 7f14b1649740 10 client.26845 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.626+0000 7f14b1649740 10 client.26845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.627+0000 7f14b1649740 20 client.26845 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.627+0000 7f14b1649740 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563d838187c0 0x563d8381abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.627+0000 7f14b1649740 4 client.26845 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:00:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.627+0000 7f14b1649740 1 -- 172.21.15.18:0/3717716000 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f14a001b450 con 0x563d838187c0 2024-09-19T10:00:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.627+0000 7f14a7fff640 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563d838187c0 0x563d8381abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.629+0000 7f14a7fff640 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563d838187c0 0x563d8381abe0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c591e2d54341ebb7 server_cookie=ba7da75e34fa894d in_seq=0 out_seq=0 2024-09-19T10:00:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:17.629+0000 7f14877fe640 10 client.26845 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:17.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:17.993+0000 7fed3a34b640 1 -- 172.21.15.18:0/1269880337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed34109120 msgr2=0x7fed34110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:17.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:17.993+0000 7fed3a34b640 1 --2- 172.21.15.18:0/1269880337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed34109120 0x7fed34110ca0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fed24009900 tx=0x7fed2402a420 comp rx=0 tx=0).stop 2024-09-19T10:00:17.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:17.994+0000 7fed3a34b640 1 -- 172.21.15.18:0/1269880337 shutdown_connections 2024-09-19T10:00:17.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:17.994+0000 7fed3a34b640 1 --2- 172.21.15.18:0/1269880337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed34109120 0x7fed34110ca0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:17.994+0000 7fed3a34b640 1 --2- 172.21.15.18:0/1269880337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed341049a0 0x7fed341089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:17.994+0000 7fed3a34b640 1 --2- 172.21.15.18:0/1269880337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed34103ff0 0x7fed341043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:17.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:17.994+0000 7fed3a34b640 1 -- 172.21.15.18:0/1269880337 >> 172.21.15.18:0/1269880337 conn(0x7fed340ffa90 msgr2=0x7fed34101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:17.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:17.995+0000 7fed3a34b640 1 -- 172.21.15.18:0/1269880337 shutdown_connections 2024-09-19T10:00:18.004 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:17 smithi018 ceph-mon[30956]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 997 GiB / 1.0 TiB avail; 212 KiB/s rd, 118 MiB/s wr, 390 op/s 2024-09-19T10:00:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:17.998+0000 7fed3a34b640 1 -- 172.21.15.18:0/1269880337 wait complete. 2024-09-19T10:00:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:17.999+0000 7fed3a34b640 1 Processor -- start 2024-09-19T10:00:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.000+0000 7fed3a34b640 1 -- start start 2024-09-19T10:00:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.001+0000 7fed3a34b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed34103ff0 0x7fed34110b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.001+0000 7fed3a34b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed341049a0 0x7fed3410dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.002+0000 7fed3a34b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed34109120 0x7fed3410e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.002+0000 7fed3a34b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fed34114130 con 0x7fed34109120 2024-09-19T10:00:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.002+0000 7fed3a34b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fed34113fb0 con 0x7fed34103ff0 2024-09-19T10:00:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.002+0000 7fed33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed34103ff0 0x7fed34110b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.002+0000 7fed3a34b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed341142b0 con 0x7fed341049a0 2024-09-19T10:00:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.002+0000 7fed33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed34103ff0 0x7fed34110b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43478/0 (socket says 172.21.15.18:43478) 2024-09-19T10:00:18.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.002+0000 7fed33fff640 1 -- 172.21.15.18:0/1357143435 learned_addr learned my addr 172.21.15.18:0/1357143435 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:18.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.004+0000 7fed388e8640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed34109120 0x7fed3410e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:18.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.004+0000 7fed337fe640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed341049a0 0x7fed3410dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:18.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.016+0000 7fed33fff640 1 -- 172.21.15.18:0/1357143435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed341049a0 msgr2=0x7fed3410dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:18.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.016+0000 7fed33fff640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed341049a0 0x7fed3410dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:18.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.016+0000 7fed33fff640 1 -- 172.21.15.18:0/1357143435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed34109120 msgr2=0x7fed3410e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:18.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.016+0000 7fed33fff640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed34109120 0x7fed3410e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:18.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.016+0000 7fed33fff640 1 -- 172.21.15.18:0/1357143435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3410e990 con 0x7fed34103ff0 2024-09-19T10:00:18.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.019+0000 7fed33fff640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed34103ff0 0x7fed34110b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00cce0 tx=0x7fed2c00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:18.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.023+0000 7fed317fa640 1 -- 172.21.15.18:0/1357143435 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c004b20 con 0x7fed34103ff0 2024-09-19T10:00:18.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.023+0000 7fed3a34b640 1 -- 172.21.15.18:0/1357143435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed341a0710 con 0x7fed34103ff0 2024-09-19T10:00:18.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.024+0000 7fed3a34b640 1 -- 172.21.15.18:0/1357143435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed341a0c50 con 0x7fed34103ff0 2024-09-19T10:00:18.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.025+0000 7fed317fa640 1 -- 172.21.15.18:0/1357143435 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed2c004cc0 con 0x7fed34103ff0 2024-09-19T10:00:18.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.025+0000 7fed317fa640 1 -- 172.21.15.18:0/1357143435 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c00f7d0 con 0x7fed34103ff0 2024-09-19T10:00:18.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.027+0000 7fed3a34b640 1 -- 172.21.15.18:0/1357143435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed20005290 con 0x7fed34103ff0 2024-09-19T10:00:18.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.039+0000 7fed317fa640 1 -- 172.21.15.18:0/1357143435 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fed2c00fa30 con 0x7fed34103ff0 2024-09-19T10:00:18.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.040+0000 7fed317fa640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fed1c0a3450 0x7fed1c0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:18.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.041+0000 7fed337fe640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fed1c0a3450 0x7fed1c0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.061+0000 7fed337fe640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fed1c0a3450 0x7fed1c0a5910 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fed28005d90 tx=0x7fed28005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.061+0000 7fed317fa640 1 -- 172.21.15.18:0/1357143435 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fed2c0cfa10 con 0x7fed34103ff0 2024-09-19T10:00:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.061+0000 7fed317fa640 1 -- 172.21.15.18:0/1357143435 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed2c014030 con 0x7fed34103ff0 2024-09-19T10:00:18.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:17 smithi049 ceph-mon[34858]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 997 GiB / 1.0 TiB avail; 212 KiB/s rd, 118 MiB/s wr, 390 op/s 2024-09-19T10:00:18.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:17 smithi162 ceph-mon[35174]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 997 GiB / 1.0 TiB avail; 212 KiB/s rd, 118 MiB/s wr, 390 op/s 2024-09-19T10:00:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.648+0000 7fed3a34b640 1 -- 172.21.15.18:0/1357143435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed20005580 con 0x7fed34103ff0 2024-09-19T10:00:18.655 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:00:18.655 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:00:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.652+0000 7fed317fa640 1 -- 172.21.15.18:0/1357143435 <== mon.2 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fed2c09c800 con 0x7fed34103ff0 2024-09-19T10:00:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:00:18.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.657+0000 7fed3a34b640 1 -- 172.21.15.18:0/1357143435 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fed1c0a3450 msgr2=0x7fed1c0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:18.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.657+0000 7fed3a34b640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fed1c0a3450 0x7fed1c0a5910 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fed28005d90 tx=0x7fed28005d20 comp rx=0 tx=0).stop 2024-09-19T10:00:18.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.657+0000 7fed3a34b640 1 -- 172.21.15.18:0/1357143435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed34103ff0 msgr2=0x7fed34110b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:18.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.657+0000 7fed3a34b640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed34103ff0 0x7fed34110b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00cce0 tx=0x7fed2c00a620 comp rx=0 tx=0).stop 2024-09-19T10:00:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.660+0000 7fed3a34b640 1 -- 172.21.15.18:0/1357143435 shutdown_connections 2024-09-19T10:00:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.660+0000 7fed3a34b640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fed1c0a3450 0x7fed1c0a5910 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.660+0000 7fed3a34b640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed34109120 0x7fed3410e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.660+0000 7fed3a34b640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed341049a0 0x7fed3410dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.660+0000 7fed3a34b640 1 --2- 172.21.15.18:0/1357143435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed34103ff0 0x7fed34110b10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.660+0000 7fed3a34b640 1 -- 172.21.15.18:0/1357143435 >> 172.21.15.18:0/1357143435 conn(0x7fed340ffa90 msgr2=0x7fed34100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:18.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.660+0000 7fed3a34b640 1 -- 172.21.15.18:0/1357143435 shutdown_connections 2024-09-19T10:00:18.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:18.661+0000 7fed3a34b640 1 -- 172.21.15.18:0/1357143435 wait complete. 2024-09-19T10:00:19.138 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:18 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1357143435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:19.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:18 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1357143435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:19.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:18 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1357143435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:20.035 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T10:00:20.036 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T10:00:20.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:19 smithi049 ceph-mon[34858]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 301 KiB/s rd, 169 MiB/s wr, 562 op/s 2024-09-19T10:00:20.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:19 smithi018 ceph-mon[30956]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 301 KiB/s rd, 169 MiB/s wr, 562 op/s 2024-09-19T10:00:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:19 smithi162 ceph-mon[35174]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 301 KiB/s rd, 169 MiB/s wr, 562 op/s 2024-09-19T10:00:21.294 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:22.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:21 smithi018 ceph-mon[30956]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 780 KiB/s rd, 275 MiB/s wr, 894 op/s 2024-09-19T10:00:22.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.350+0000 7f7e7896d640 1 -- 172.21.15.18:0/4171878043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e74110190 msgr2=0x7f7e7406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:22.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.350+0000 7f7e727fc640 1 -- 172.21.15.18:0/4171878043 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64035020 con 0x7f7e74110190 2024-09-19T10:00:22.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.350+0000 7f7e7896d640 1 --2- 172.21.15.18:0/4171878043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e74110190 0x7f7e7406e4f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009900 tx=0x7f7e6402a440 comp rx=0 tx=0).stop 2024-09-19T10:00:22.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.351+0000 7f7e7896d640 1 -- 172.21.15.18:0/4171878043 shutdown_connections 2024-09-19T10:00:22.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.351+0000 7f7e7896d640 1 --2- 172.21.15.18:0/4171878043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7411b140 0x7f7e7411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.351+0000 7f7e7896d640 1 --2- 172.21.15.18:0/4171878043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e7406ea30 0x7f7e7406ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.351+0000 7f7e7896d640 1 --2- 172.21.15.18:0/4171878043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e74110190 0x7f7e7406e4f0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.351+0000 7f7e7896d640 1 -- 172.21.15.18:0/4171878043 >> 172.21.15.18:0/4171878043 conn(0x7f7e74073180 msgr2=0x7f7e74073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:22.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.356+0000 7f7e7896d640 1 -- 172.21.15.18:0/4171878043 shutdown_connections 2024-09-19T10:00:22.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.356+0000 7f7e7896d640 1 -- 172.21.15.18:0/4171878043 wait complete. 2024-09-19T10:00:22.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.357+0000 7f7e7896d640 1 Processor -- start 2024-09-19T10:00:22.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.358+0000 7f7e7896d640 1 -- start start 2024-09-19T10:00:22.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.358+0000 7f7e7896d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7406ea30 0x7f7e74118730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.358+0000 7f7e7896d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e74110190 0x7f7e74111830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.359+0000 7f7e7896d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e7411b140 0x7f7e74111d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.359+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7406ea30 0x7f7e74118730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.359+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e7411b140 0x7f7e74111d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.359+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e7411b140 0x7f7e74111d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51036/0 (socket says 172.21.15.18:51036) 2024-09-19T10:00:22.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.359+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7406ea30 0x7f7e74118730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43490/0 (socket says 172.21.15.18:43490) 2024-09-19T10:00:22.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.359+0000 7f7e73fff640 1 -- 172.21.15.18:0/1085166119 learned_addr learned my addr 172.21.15.18:0/1085166119 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:22.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.359+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74120ce0 con 0x7f7e74110190 2024-09-19T10:00:22.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.359+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74120b60 con 0x7f7e7406ea30 2024-09-19T10:00:22.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.359+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74120e60 con 0x7f7e7411b140 2024-09-19T10:00:22.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.360+0000 7f7e73fff640 1 -- 172.21.15.18:0/1085166119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7406ea30 msgr2=0x7f7e74118730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:22.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.360+0000 7f7e73fff640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7406ea30 0x7f7e74118730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.360+0000 7f7e73fff640 1 -- 172.21.15.18:0/1085166119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e74110190 msgr2=0x7f7e74111830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.360+0000 7f7e73fff640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e74110190 0x7f7e74111830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.360+0000 7f7e73fff640 1 -- 172.21.15.18:0/1085166119 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e741123e0 con 0x7f7e7411b140 2024-09-19T10:00:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.361+0000 7f7e73fff640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e7411b140 0x7f7e74111d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00b9e0 tx=0x7f7e6c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.361+0000 7f7e70ff9640 1 -- 172.21.15.18:0/1085166119 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c019070 con 0x7f7e7411b140 2024-09-19T10:00:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.361+0000 7f7e70ff9640 1 -- 172.21.15.18:0/1085166119 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e6c014440 con 0x7f7e7411b140 2024-09-19T10:00:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.361+0000 7f7e70ff9640 1 -- 172.21.15.18:0/1085166119 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0125a0 con 0x7f7e7411b140 2024-09-19T10:00:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.367+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e741162d0 con 0x7f7e7411b140 2024-09-19T10:00:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.367+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e74116730 con 0x7f7e7411b140 2024-09-19T10:00:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:21 smithi049 ceph-mon[34858]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 780 KiB/s rd, 275 MiB/s wr, 894 op/s 2024-09-19T10:00:22.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.398+0000 7f7e70ff9640 1 -- 172.21.15.18:0/1085166119 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7e6c0145f0 con 0x7f7e7411b140 2024-09-19T10:00:22.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.399+0000 7f7e70ff9640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e5c0a3380 0x7f7e5c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.400+0000 7f7e70ff9640 1 -- 172.21.15.18:0/1085166119 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7e6c0cedf0 con 0x7f7e7411b140 2024-09-19T10:00:22.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.404+0000 7f7e7bfa8740 1 Processor -- start 2024-09-19T10:00:22.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.404+0000 7f7e7bfa8740 1 -- start start 2024-09-19T10:00:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.405+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c8849e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.405+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c88546c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.405+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 0x55d3c8856ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.405+0000 7f7e7bfa8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d3c87ae160 con 0x55d3c8854c00 2024-09-19T10:00:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.405+0000 7f7e7bfa8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d3c8755720 con 0x55d3c8849a20 2024-09-19T10:00:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.405+0000 7f7e7bfa8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d3c87aa120 con 0x55d3c884a340 2024-09-19T10:00:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.406+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c88546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.406+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c88546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51052/0 (socket says 172.21.15.18:51052) 2024-09-19T10:00:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.406+0000 7f7e72ffd640 1 -- 172.21.15.18:0/1556484059 learned_addr learned my addr 172.21.15.18:0/1556484059 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:22.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.407+0000 7f7e72ffd640 1 -- 172.21.15.18:0/1556484059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 msgr2=0x55d3c8849e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T10:00:22.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.407+0000 7f7e72ffd640 1 --2- 172.21.15.18:0/1556484059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c8849e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.407+0000 7f7e72ffd640 1 -- 172.21.15.18:0/1556484059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 msgr2=0x55d3c8856ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:22.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.407+0000 7f7e72ffd640 1 --2- 172.21.15.18:0/1556484059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 0x55d3c8856ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.407+0000 7f7e72ffd640 1 -- 172.21.15.18:0/1556484059 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c851fba0 con 0x55d3c884a340 2024-09-19T10:00:22.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.408+0000 7f7e72ffd640 1 --2- 172.21.15.18:0/1556484059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c88546c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7e680097b0 tx=0x7f7e68009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=334c9d6688b1ab0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:21 smithi162 ceph-mon[35174]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 780 KiB/s rd, 275 MiB/s wr, 894 op/s 2024-09-19T10:00:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.408+0000 7f7e59ffb640 1 -- 172.21.15.18:0/1556484059 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68015020 con 0x55d3c884a340 2024-09-19T10:00:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.408+0000 7f7e59ffb640 1 -- 172.21.15.18:0/1556484059 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e68011420 con 0x55d3c884a340 2024-09-19T10:00:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.408+0000 7f7e59ffb640 1 -- 172.21.15.18:0/1556484059 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e680105e0 con 0x55d3c884a340 2024-09-19T10:00:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.410+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/1556484059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 msgr2=0x55d3c88546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.410+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/1556484059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c88546c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7e680097b0 tx=0x7f7e68009c70 comp rx=0 tx=0).stop 2024-09-19T10:00:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.412+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/1556484059 shutdown_connections 2024-09-19T10:00:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.412+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/1556484059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 0x55d3c8856ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.412+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/1556484059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c88546c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.412+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/1556484059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c8849e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.412+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/1556484059 >> 172.21.15.18:0/1556484059 conn(0x55d3c8845fb0 msgr2=0x55d3c8846390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:22.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.413+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/1556484059 shutdown_connections 2024-09-19T10:00:22.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.414+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/1556484059 wait complete. 2024-09-19T10:00:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.414+0000 7f7e7bfa8740 1 -- start start 2024-09-19T10:00:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.415+0000 7f7e7bfa8740 1 Processor -- start 2024-09-19T10:00:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.415+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c8851c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.415+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c884a340 0x55d3c8852150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.415+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8854c00 0x55d3c8852690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.415+0000 7f7e7bfa8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d3c88797e0 con 0x55d3c884a340 2024-09-19T10:00:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.415+0000 7f7e7bfa8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d3c8736900 con 0x55d3c8849a20 2024-09-19T10:00:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.415+0000 7f7e7bfa8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d3c8879960 con 0x55d3c8854c00 2024-09-19T10:00:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.416+0000 7f7e7bfa8740 10 client.0 _ll_register_callbacks cb 0x55d3c8734780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:22.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.417+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8854c00 0x55d3c8852690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.417+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c8851c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.417+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8854c00 0x55d3c8852690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51062/0 (socket says 172.21.15.18:51062) 2024-09-19T10:00:22.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.417+0000 7f7e73fff640 1 -- 172.21.15.18:0/3998265439 learned_addr learned my addr 172.21.15.18:0/3998265439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:22.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.420+0000 7f7e73fff640 1 -- 172.21.15.18:0/3998265439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 msgr2=0x55d3c8851c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:22.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.420+0000 7f7e73fff640 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c8851c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.420+0000 7f7e73fff640 1 -- 172.21.15.18:0/3998265439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c884a340 msgr2=0x55d3c8852150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:22.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.420+0000 7f7e73fff640 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c884a340 0x55d3c8852150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.420+0000 7f7e73fff640 1 -- 172.21.15.18:0/3998265439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c8776c50 con 0x55d3c8854c00 2024-09-19T10:00:22.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.421+0000 7f7e73fff640 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8854c00 0x55d3c8852690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00b9b0 tx=0x7f7e6c09bba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13985cbd217fdb62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:22.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.421+0000 7f7e52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:22.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.421+0000 7f7e52ffd640 1 -- 172.21.15.18:0/3998265439 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0a4050 con 0x55d3c8854c00 2024-09-19T10:00:22.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.421+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/3998265439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e68011420 con 0x55d3c8854c00 2024-09-19T10:00:22.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.421+0000 7f7e52ffd640 1 -- 172.21.15.18:0/3998265439 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7e6c097a50 con 0x55d3c8854c00 2024-09-19T10:00:22.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.422+0000 7f7e52ffd640 1 -- 172.21.15.18:0/3998265439 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e6c0b4160 con 0x55d3c8854c00 2024-09-19T10:00:22.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.422+0000 7f7e7bfa8740 10 client.26857 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:22.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.422+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/3998265439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3c88a7610 con 0x55d3c8854c00 2024-09-19T10:00:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.422+0000 7f7e52ffd640 1 -- 172.21.15.18:0/3998265439 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e68011420 con 0x55d3c8854c00 2024-09-19T10:00:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.424+0000 7f7e52ffd640 1 -- 172.21.15.18:0/3998265439 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7e6c09a830 con 0x55d3c8854c00 2024-09-19T10:00:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.424+0000 7f7e7bfa8740 10 client.26857 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.424+0000 7f7e7bfa8740 10 client.26857 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:00:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.424+0000 7f7e7bfa8740 20 client.26857 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.424+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d3c88a8e90 0x55d3c88ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.424+0000 7f7e7bfa8740 4 client.26857 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:22.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.424+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/3998265439 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3c87bb890 con 0x55d3c88a8e90 2024-09-19T10:00:22.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.425+0000 7f7e737fe640 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d3c88a8e90 0x55d3c88ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.432+0000 7f7e737fe640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e5c0a3380 0x7f7e5c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.433+0000 7f7e737fe640 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d3c88a8e90 0x55d3c88ab2d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c33d11012f5dc60b server_cookie=2e39237f99af3411 in_seq=0 out_seq=0 2024-09-19T10:00:22.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.433+0000 7f7e52ffd640 10 client.26857 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:22.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.436+0000 7f7e52ffd640 1 -- 172.21.15.18:0/3998265439 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3c87bb890 con 0x55d3c88a8e90 2024-09-19T10:00:22.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.436+0000 7f7e52ffd640 10 client.26857 handle_command_reply: tid=0 2024-09-19T10:00:22.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.436+0000 7f7e7bfa8740 1 client.26857 shutdown 2024-09-19T10:00:22.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.438+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/3998265439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8854c00 msgr2=0x55d3c8852690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:22.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.438+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8854c00 0x55d3c8852690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00b9b0 tx=0x7f7e6c09bba0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.438+0000 7f7e737fe640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e5c0a3380 0x7f7e5c0a5840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x55d3c88abb80 tx=0x7f7e64005890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.438+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/3998265439 shutdown_connections 2024-09-19T10:00:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.438+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d3c88a8e90 0x55d3c88ab2d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.438+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8854c00 0x55d3c8852690 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.438+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c884a340 0x55d3c8852150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.438+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/3998265439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c8851c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.438+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/3998265439 >> 172.21.15.18:0/3998265439 conn(0x55d3c8845fb0 msgr2=0x55d3c884bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.439+0000 7f7e52ffd640 0 client.26857 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.440+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/3998265439 shutdown_connections 2024-09-19T10:00:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.440+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/3998265439 wait complete. 2024-09-19T10:00:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.440+0000 7f7e7bfa8740 20 client.26857 trim_cache size 0 max 16384 2024-09-19T10:00:22.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.486+0000 7f7e7bfa8740 1 Processor -- start 2024-09-19T10:00:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.486+0000 7f7e7bfa8740 1 -- start start 2024-09-19T10:00:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.488+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c88524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.488+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c8844f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.488+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 0x55d3c88b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.489+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c88524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.489+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c8844f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.489+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c8844f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51072/0 (socket says 172.21.15.18:51072) 2024-09-19T10:00:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.489+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c88524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43508/0 (socket says 172.21.15.18:43508) 2024-09-19T10:00:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.489+0000 7f7e72ffd640 1 -- 172.21.15.18:0/2650939039 learned_addr learned my addr 172.21.15.18:0/2650939039 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.489+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2650939039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7407bc30 con 0x55d3c8854c00 2024-09-19T10:00:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.489+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2650939039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7407d770 con 0x55d3c8849a20 2024-09-19T10:00:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.489+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2650939039 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7407c300 con 0x55d3c884a340 2024-09-19T10:00:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.490+0000 7f7e72ffd640 1 -- 172.21.15.18:0/2650939039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 msgr2=0x55d3c88524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.490+0000 7f7e72ffd640 1 --2- 172.21.15.18:0/2650939039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c88524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.490+0000 7f7e72ffd640 1 -- 172.21.15.18:0/2650939039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 msgr2=0x55d3c88b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.490+0000 7f7e72ffd640 1 --2- 172.21.15.18:0/2650939039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 0x55d3c88b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.491+0000 7f7e72ffd640 1 -- 172.21.15.18:0/2650939039 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c8857360 con 0x55d3c884a340 2024-09-19T10:00:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.492+0000 7f7e72ffd640 1 --2- 172.21.15.18:0/2650939039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c8844f60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e680097b0 tx=0x7f7e68009350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf59504ea3ef164 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:22.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.492+0000 7f7e597fa640 1 -- 172.21.15.18:0/2650939039 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6801e070 con 0x55d3c884a340 2024-09-19T10:00:22.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.492+0000 7f7e597fa640 1 -- 172.21.15.18:0/2650939039 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e680093c0 con 0x55d3c884a340 2024-09-19T10:00:22.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.493+0000 7f7e597fa640 1 -- 172.21.15.18:0/2650939039 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68015070 con 0x55d3c884a340 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.494+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2650939039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 msgr2=0x55d3c8844f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.494+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2650939039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c8844f60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e680097b0 tx=0x7f7e68009350 comp rx=0 tx=0).stop 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.494+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2650939039 shutdown_connections 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.494+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2650939039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 0x55d3c88b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.494+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2650939039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c884a340 0x55d3c8844f60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.494+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2650939039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c8849a20 0x55d3c88524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.494+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2650939039 >> 172.21.15.18:0/2650939039 conn(0x55d3c8845fb0 msgr2=0x55d3c8844850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.495+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2650939039 shutdown_connections 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.495+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2650939039 wait complete. 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.495+0000 7f7e7bfa8740 1 -- start start 2024-09-19T10:00:22.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.496+0000 7f7e7bfa8740 1 Processor -- start 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.497+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8849a20 0x55d3c887a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.497+0000 7f7e7bfa8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 0x55d3c887ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.497+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8849a20 0x55d3c887a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.497+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8849a20 0x55d3c887a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51074/0 (socket says 172.21.15.18:51074) 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.497+0000 7f7e737fe640 1 -- 172.21.15.18:0/2944904920 learned_addr learned my addr 172.21.15.18:0/2944904920 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.497+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c887b3a0 0x55d3c8912bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.497+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7407d0a0 con 0x55d3c8854c00 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.498+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7407c9d0 con 0x55d3c887b3a0 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.498+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74079cc0 con 0x55d3c8849a20 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.498+0000 7f7e73fff640 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c887b3a0 0x55d3c8912bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.498+0000 7f7e737fe640 1 -- 172.21.15.18:0/2944904920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c887b3a0 msgr2=0x55d3c8912bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.498+0000 7f7e737fe640 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c887b3a0 0x55d3c8912bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.498+0000 7f7e737fe640 1 -- 172.21.15.18:0/2944904920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 msgr2=0x55d3c887ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.498+0000 7f7e737fe640 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 0x55d3c887ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.498+0000 7f7e737fe640 1 -- 172.21.15.18:0/2944904920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c89130f0 con 0x55d3c8849a20 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.499+0000 7f7e737fe640 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8849a20 0x55d3c887a920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7e64004650 tx=0x7f7e64009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=806d8403aa3842ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.499+0000 7f7e7bfa8740 10 client.0 _ll_register_callbacks cb 0x7f7e6c095f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.499+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e680093c0 con 0x55d3c8849a20 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.499+0000 7f7e52ffd640 10 client.26863 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.499+0000 7f7e52ffd640 1 -- 172.21.15.18:0/2944904920 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6405b060 con 0x55d3c8849a20 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.499+0000 7f7e52ffd640 1 -- 172.21.15.18:0/2944904920 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7e64004d20 con 0x55d3c8849a20 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.500+0000 7f7e52ffd640 1 -- 172.21.15.18:0/2944904920 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e64035040 con 0x55d3c8849a20 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.500+0000 7f7e7bfa8740 10 client.26863 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.500+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d3c89141b0 con 0x55d3c8849a20 2024-09-19T10:00:22.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.500+0000 7f7e52ffd640 1 -- 172.21.15.18:0/2944904920 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7e640036f0 con 0x55d3c8849a20 2024-09-19T10:00:22.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.500+0000 7f7e7bfa8740 10 client.26863 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:22.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.500+0000 7f7e7bfa8740 10 client.26863 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:00:22.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.500+0000 7f7e7bfa8740 20 client.26863 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:22.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.500+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d3c89148c0 0x55d3c8916d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:22.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.501+0000 7f7e7bfa8740 4 client.26863 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T10:00:22.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.501+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x7f7e680093c0 con 0x55d3c89148c0 2024-09-19T10:00:22.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.501+0000 7f7e72ffd640 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d3c89148c0 0x55d3c8916d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:22.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.505+0000 7f7e72ffd640 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d3c89148c0 0x55d3c8916d80 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d044c07962671bb server_cookie=c6121ca285e6ca22 in_seq=0 out_seq=0 2024-09-19T10:00:22.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:22.505+0000 7f7e52ffd640 10 client.26863 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:23.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.393+0000 7f7e52ffd640 1 -- 172.21.15.18:0/2944904920 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f7e680093c0 con 0x55d3c89148c0 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.393+0000 7f7e52ffd640 10 client.26863 handle_command_reply: tid=0 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.393+0000 7f7e7bfa8740 1 client.26863 shutdown 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8849a20 msgr2=0x55d3c887a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8849a20 0x55d3c887a920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7e64004650 tx=0x7f7e64009260 comp rx=0 tx=0).stop 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 shutdown_connections 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d3c89148c0 0x55d3c8916d80 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3c887b3a0 0x55d3c8912bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3c8854c00 0x55d3c887ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e52ffd640 0 client.26863 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 1 --2- 172.21.15.18:0/2944904920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3c8849a20 0x55d3c887a920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 >> 172.21.15.18:0/2944904920 conn(0x55d3c8845fb0 msgr2=0x55d3c8845070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14877fe640 1 -- 172.21.15.18:0/3717716000 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f14a001b450 con 0x563d838187c0 2024-09-19T10:00:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14877fe640 10 client.26845 handle_command_reply: tid=0 2024-09-19T10:00:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14b1649740 1 client.26845 shutdown 2024-09-19T10:00:23.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 shutdown_connections 2024-09-19T10:00:23.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 1 -- 172.21.15.18:0/2944904920 wait complete. 2024-09-19T10:00:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14b1649740 1 -- 172.21.15.18:0/3717716000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 msgr2=0x563d837bcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14b1649740 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d837bcf30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f14a0006d80 tx=0x7f14a0019c60 comp rx=0 tx=0).stop 2024-09-19T10:00:23.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f7e7bfa8740 20 client.26863 trim_cache size 0 max 16384 2024-09-19T10:00:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14b1649740 1 -- 172.21.15.18:0/3717716000 shutdown_connections 2024-09-19T10:00:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14b1649740 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563d838187c0 0x563d8381abe0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14b1649740 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d837a7310 0x563d837c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14b1649740 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563d8379d540 0x563d837bd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14877fe640 0 client.26845 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14b1649740 1 --2- 172.21.15.18:0/3717716000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d83797b70 0x563d837bcf30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.394+0000 7f14b1649740 1 -- 172.21.15.18:0/3717716000 >> 172.21.15.18:0/3717716000 conn(0x563d837931e0 msgr2=0x563d837a1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f14b1649740 1 -- 172.21.15.18:0/3717716000 shutdown_connections 2024-09-19T10:00:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f14b1649740 1 -- 172.21.15.18:0/3717716000 wait complete. 2024-09-19T10:00:23.400 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 30, 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "b3681015": { 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 30, 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T10:00:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 145.8, 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:23.402 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:00:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f14b1649740 20 client.26845 trim_cache size 0 max 16384 2024-09-19T10:00:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:00:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:00:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:00:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:00:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e5c0a3380 msgr2=0x7f7e5c0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e5c0a3380 0x7f7e5c0a5840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x55d3c88abb80 tx=0x7f7e64005890 comp rx=0 tx=0).stop 2024-09-19T10:00:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e7411b140 msgr2=0x7f7e74111d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e7411b140 0x7f7e74111d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00b9e0 tx=0x7f7e6c00bea0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 shutdown_connections 2024-09-19T10:00:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7e5c0a3380 0x7f7e5c0a5840 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e7411b140 0x7f7e74111d70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e74110190 0x7f7e74111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 --2- 172.21.15.18:0/1085166119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e7406ea30 0x7f7e74118730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 >> 172.21.15.18:0/1085166119 conn(0x7f7e74073180 msgr2=0x7f7e7410e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f14ae8ae640 1 -- 172.21.15.18:0/1866044926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f14900a3380 msgr2=0x7f14900a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f14ae8ae640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f14900a3380 0x7f14900a5840 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f14980bc6b0 tx=0x7f149802a410 comp rx=0 tx=0).stop 2024-09-19T10:00:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f14ae8ae640 1 -- 172.21.15.18:0/1866044926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14a810de90 msgr2=0x7f14a81ae080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f14ae8ae640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14a810de90 0x7f14a81ae080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1498009850 tx=0x7f1498032d30 comp rx=0 tx=0).stop 2024-09-19T10:00:23.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 shutdown_connections 2024-09-19T10:00:23.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:23.395+0000 7f7e7896d640 1 -- 172.21.15.18:0/1085166119 wait complete. 2024-09-19T10:00:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.396+0000 7f14ae8ae640 1 -- 172.21.15.18:0/1866044926 shutdown_connections 2024-09-19T10:00:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.396+0000 7f14ae8ae640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f14900a3380 0x7f14900a5840 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.396+0000 7f14ae8ae640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14a810de90 0x7f14a81ae080 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.396+0000 7f14ae8ae640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a810b4e0 0x7f14a81a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.396+0000 7f14ae8ae640 1 --2- 172.21.15.18:0/1866044926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14a8072d80 0x7f14a81a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.396+0000 7f14ae8ae640 1 -- 172.21.15.18:0/1866044926 >> 172.21.15.18:0/1866044926 conn(0x7f14a806eb50 msgr2=0x7f14a810c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.396+0000 7f14ae8ae640 1 -- 172.21.15.18:0/1866044926 shutdown_connections 2024-09-19T10:00:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:23.396+0000 7f14ae8ae640 1 -- 172.21.15.18:0/1866044926 wait complete. 2024-09-19T10:00:24.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:23 smithi018 ceph-mon[30956]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 779 KiB/s rd, 483 MiB/s wr, 1.41k op/s 2024-09-19T10:00:24.053 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b3681015', quiesce took 8.4 seconds. Will release after: 17.35 2024-09-19T10:00:24.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:23 smithi049 ceph-mon[34858]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 779 KiB/s rd, 483 MiB/s wr, 1.41k op/s 2024-09-19T10:00:24.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:23 smithi162 ceph-mon[35174]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 779 KiB/s rd, 483 MiB/s wr, 1.41k op/s 2024-09-19T10:00:26.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:25 smithi018 ceph-mon[30956]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 559 MiB/s wr, 1.54k op/s 2024-09-19T10:00:26.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:25 smithi049 ceph-mon[34858]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 559 MiB/s wr, 1.54k op/s 2024-09-19T10:00:26.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:25 smithi162 ceph-mon[35174]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 559 MiB/s wr, 1.54k op/s 2024-09-19T10:00:28.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:27 smithi018 ceph-mon[30956]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 594 MiB/s wr, 1.59k op/s 2024-09-19T10:00:28.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:27 smithi049 ceph-mon[34858]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 594 MiB/s wr, 1.59k op/s 2024-09-19T10:00:28.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:27 smithi162 ceph-mon[35174]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 594 MiB/s wr, 1.59k op/s 2024-09-19T10:00:30.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:29 smithi018 ceph-mon[30956]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 543 MiB/s wr, 1.41k op/s 2024-09-19T10:00:30.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:29 smithi049 ceph-mon[34858]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 543 MiB/s wr, 1.41k op/s 2024-09-19T10:00:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:29 smithi162 ceph-mon[35174]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 543 MiB/s wr, 1.41k op/s 2024-09-19T10:00:32.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:31 smithi018 ceph-mon[30956]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 494 MiB/s wr, 1.24k op/s 2024-09-19T10:00:32.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:31 smithi049 ceph-mon[34858]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 494 MiB/s wr, 1.24k op/s 2024-09-19T10:00:32.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:31 smithi162 ceph-mon[35174]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 494 MiB/s wr, 1.24k op/s 2024-09-19T10:00:34.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:33 smithi018 ceph-mon[30956]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 876 KiB/s rd, 401 MiB/s wr, 928 op/s 2024-09-19T10:00:34.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:33 smithi049 ceph-mon[34858]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 876 KiB/s rd, 401 MiB/s wr, 928 op/s 2024-09-19T10:00:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:33 smithi162 ceph-mon[35174]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 876 KiB/s rd, 401 MiB/s wr, 928 op/s 2024-09-19T10:00:36.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:35 smithi018 ceph-mon[30956]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 202 MiB/s wr, 424 op/s 2024-09-19T10:00:36.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:35 smithi049 ceph-mon[34858]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 202 MiB/s wr, 424 op/s 2024-09-19T10:00:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:35 smithi162 ceph-mon[35174]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 202 MiB/s wr, 424 op/s 2024-09-19T10:00:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.498+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/2119397364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f08103710 msgr2=0x7f8f08109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.498+0000 7f8f0cdc4640 1 --2- 172.21.15.18:0/2119397364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f08103710 0x7f8f08109fa0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009ca0 tx=0x7f8f0002a8c0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.499+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/2119397364 shutdown_connections 2024-09-19T10:00:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.499+0000 7f8f0cdc4640 1 --2- 172.21.15.18:0/2119397364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f08103710 0x7f8f08109fa0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.499+0000 7f8f0cdc4640 1 --2- 172.21.15.18:0/2119397364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f08102d50 0x7f8f081031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.499+0000 7f8f0cdc4640 1 --2- 172.21.15.18:0/2119397364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f08101b60 0x7f8f08101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.499+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/2119397364 >> 172.21.15.18:0/2119397364 conn(0x7f8f080fd2e0 msgr2=0x7f8f080ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.499+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/2119397364 shutdown_connections 2024-09-19T10:00:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.499+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/2119397364 wait complete. 2024-09-19T10:00:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.499+0000 7f8f0cdc4640 1 Processor -- start 2024-09-19T10:00:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.499+0000 7f8f0cdc4640 1 -- start start 2024-09-19T10:00:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f0cdc4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f08101b60 0x7f8f08075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f0cdc4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f08102d50 0x7f8f080745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f0cdc4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f08103710 0x7f8f08074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f0cdc4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0810d7c0 con 0x7f8f08102d50 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f0cdc4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0810d640 con 0x7f8f08101b60 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f0cdc4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0810d940 con 0x7f8f08103710 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f05d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f08102d50 0x7f8f080745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f05d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f08102d50 0x7f8f080745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49814/0 (socket says 172.21.15.18:49814) 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f05d9b640 1 -- 172.21.15.18:0/1611566827 learned_addr learned my addr 172.21.15.18:0/1611566827 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f0659c640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f08101b60 0x7f8f08075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f06d9d640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f08103710 0x7f8f08074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f05d9b640 1 -- 172.21.15.18:0/1611566827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f08103710 msgr2=0x7f8f08074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f08103710 0x7f8f08074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f05d9b640 1 -- 172.21.15.18:0/1611566827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f08101b60 msgr2=0x7f8f08075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f08101b60 0x7f8f08075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f05d9b640 1 -- 172.21.15.18:0/1611566827 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f080753b0 con 0x7f8f08102d50 2024-09-19T10:00:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f06d9d640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f08103710 0x7f8f08074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.500+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f08102d50 0x7f8f080745e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00d950 tx=0x7f8efc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.501+0000 7f8ef77fe640 1 -- 172.21.15.18:0/1611566827 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc017070 con 0x7f8f08102d50 2024-09-19T10:00:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.501+0000 7f8ef77fe640 1 -- 172.21.15.18:0/1611566827 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8efc009c30 con 0x7f8f08102d50 2024-09-19T10:00:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.501+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/1611566827 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f081a1e50 con 0x7f8f08102d50 2024-09-19T10:00:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.501+0000 7f8ef77fe640 1 -- 172.21.15.18:0/1611566827 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00f6b0 con 0x7f8f08102d50 2024-09-19T10:00:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.501+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/1611566827 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f081a22c0 con 0x7f8f08102d50 2024-09-19T10:00:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.503+0000 7f8ef77fe640 1 -- 172.21.15.18:0/1611566827 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8efc0109d0 con 0x7f8f08102d50 2024-09-19T10:00:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.503+0000 7f8f0fc38740 1 Processor -- start 2024-09-19T10:00:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f0fc38740 1 -- start start 2024-09-19T10:00:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf2054da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 0x561bf2059da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf205a370 0x561bf205c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561bf1fb82f0 con 0x561bf205a370 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561bf1f60270 con 0x561bf20552e0 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561bf1fb42b0 con 0x561bf20549a0 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f05d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf205a370 0x561bf205c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f05d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf205a370 0x561bf205c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49820/0 (socket says 172.21.15.18:49820) 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f05d9b640 1 -- 172.21.15.18:0/2979996968 learned_addr learned my addr 172.21.15.18:0/2979996968 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f0659c640 1 --2- 172.21.15.18:0/2979996968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 0x561bf2059da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f06d9d640 1 --2- 172.21.15.18:0/2979996968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf2054da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f05d9b640 1 -- 172.21.15.18:0/2979996968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 msgr2=0x561bf2054da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/2979996968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf2054da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f05d9b640 1 -- 172.21.15.18:0/2979996968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 msgr2=0x561bf2059da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/2979996968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 0x561bf2059da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8ef77fe640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef00a3370 0x7f8ef00a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f05d9b640 1 -- 172.21.15.18:0/2979996968 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf1f5f340 con 0x561bf205a370 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.504+0000 7f8f0659c640 1 --2- 172.21.15.18:0/2979996968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 0x561bf2059da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.505+0000 7f8f06d9d640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef00a3370 0x7f8ef00a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.505+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/2979996968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf205a370 0x561bf205c830 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0d7560 tx=0x7f8efc097cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f808b1822568305 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.505+0000 7f8ef77fe640 1 -- 172.21.15.18:0/1611566827 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8efc0cf460 con 0x7f8f08102d50 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.505+0000 7f8ef4ff9640 1 -- 172.21.15.18:0/2979996968 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc020020 con 0x561bf205a370 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.505+0000 7f8ef4ff9640 1 -- 172.21.15.18:0/2979996968 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8efc0a46c0 con 0x561bf205a370 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.505+0000 7f8ef4ff9640 1 -- 172.21.15.18:0/2979996968 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0a4230 con 0x561bf205a370 2024-09-19T10:00:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2979996968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf205a370 msgr2=0x561bf205c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f06d9d640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef00a3370 0x7f8ef00a5830 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8f00006010 tx=0x7f8f00031bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2979996968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf205a370 0x561bf205c830 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0d7560 tx=0x7f8efc097cf0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2979996968 shutdown_connections 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2979996968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf205a370 0x561bf205c830 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2979996968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 0x561bf2059da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2979996968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf2054da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2979996968 >> 172.21.15.18:0/2979996968 conn(0x561bf2050010 msgr2=0x561bf2050410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2979996968 shutdown_connections 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2979996968 wait complete. 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 -- start start 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.506+0000 7f8f0fc38740 1 Processor -- start 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf205ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf205f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf205a370 0x561bf2066150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561bf205d340 con 0x561bf20552e0 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561bf1f41290 con 0x561bf205a370 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561bf205d4c0 con 0x561bf20549a0 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f0fc38740 10 client.0 _ll_register_callbacks cb 0x561bf1f72140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f05d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf205f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f05d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf205f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49832/0 (socket says 172.21.15.18:49832) 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f05d9b640 1 -- 172.21.15.18:0/1266604972 learned_addr learned my addr 172.21.15.18:0/1266604972 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f0659c640 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf205ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f06d9d640 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf205a370 0x561bf2066150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f05d9b640 1 -- 172.21.15.18:0/1266604972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 msgr2=0x561bf205ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf205ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f05d9b640 1 -- 172.21.15.18:0/1266604972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf205a370 msgr2=0x561bf2066150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf205a370 0x561bf2066150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f05d9b640 1 -- 172.21.15.18:0/1266604972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf1ccb210 con 0x561bf20552e0 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf205f110 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8efc010fd0 tx=0x7f8efc010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed60e7e334aff63e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8eedffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8eedffb640 1 -- 172.21.15.18:0/1266604972 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc020020 con 0x561bf20552e0 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8eedffb640 1 -- 172.21.15.18:0/1266604972 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8efc0d7150 con 0x561bf20552e0 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.507+0000 7f8f0fc38740 1 -- 172.21.15.18:0/1266604972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561bf1fc5a20 con 0x561bf20552e0 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8eedffb640 1 -- 172.21.15.18:0/1266604972 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8efc09b820 con 0x561bf20552e0 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8f0fc38740 10 client.17421 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8f0fc38740 1 -- 172.21.15.18:0/1266604972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561bf1d97620 con 0x561bf20552e0 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8eedffb640 1 -- 172.21.15.18:0/1266604972 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561bf1fc5a20 con 0x561bf20552e0 2024-09-19T10:00:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8eedffb640 1 -- 172.21.15.18:0/1266604972 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8efc0cf0e0 con 0x561bf20552e0 2024-09-19T10:00:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8f0fc38740 10 client.17421 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8f0fc38740 10 client.17421 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8f0fc38740 20 client.17421 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x561bf206a450 0x561bf206c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8f0fc38740 4 client.17421 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8f0fc38740 1 -- 172.21.15.18:0/1266604972 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bf1fbfd70 con 0x561bf206a450 2024-09-19T10:00:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.508+0000 7f8f0659c640 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x561bf206a450 0x561bf206c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.509+0000 7f8eedffb640 10 client.17421 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:36.517 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.509+0000 7f8f0659c640 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x561bf206a450 0x561bf206c840 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b2c390e7bfb4737 server_cookie=69905af7e248e837 in_seq=0 out_seq=0 2024-09-19T10:00:36.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.509+0000 7f8eedffb640 1 -- 172.21.15.18:0/1266604972 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561bf1fbfd70 con 0x561bf206a450 2024-09-19T10:00:36.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.509+0000 7f8eedffb640 10 client.17421 handle_command_reply: tid=0 2024-09-19T10:00:36.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 client.17421 shutdown 2024-09-19T10:00:36.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 -- 172.21.15.18:0/1266604972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 msgr2=0x561bf205f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:36.518 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf205f110 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8efc010fd0 tx=0x7f8efc010d70 comp rx=0 tx=0).stop 2024-09-19T10:00:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 -- 172.21.15.18:0/1266604972 shutdown_connections 2024-09-19T10:00:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x561bf206a450 0x561bf206c840 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf205a370 0x561bf2066150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf205f110 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8eedffb640 0 client.17421 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/1266604972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf205ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 -- 172.21.15.18:0/1266604972 >> 172.21.15.18:0/1266604972 conn(0x561bf2050010 msgr2=0x561bf2051820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 -- 172.21.15.18:0/1266604972 shutdown_connections 2024-09-19T10:00:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 1 -- 172.21.15.18:0/1266604972 wait complete. 2024-09-19T10:00:36.519 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.510+0000 7f8f0fc38740 20 client.17421 trim_cache size 0 max 16384 2024-09-19T10:00:36.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0fc38740 1 Processor -- start 2024-09-19T10:00:36.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0fc38740 1 -- start start 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20549a0 0x561bf205dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 0x561bf2066110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf205a370 0x561bf2050ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f081ab080 con 0x561bf20549a0 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f081acbc0 con 0x561bf20552e0 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f081ab750 con 0x561bf205a370 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20549a0 0x561bf205dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20549a0 0x561bf205dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49842/0 (socket says 172.21.15.18:49842) 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0659c640 1 -- 172.21.15.18:0/2493490004 learned_addr learned my addr 172.21.15.18:0/2493490004 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/2493490004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 0x561bf2066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f06d9d640 1 --2- 172.21.15.18:0/2493490004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf205a370 0x561bf2050ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0659c640 1 -- 172.21.15.18:0/2493490004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf205a370 msgr2=0x561bf2050ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0659c640 1 --2- 172.21.15.18:0/2493490004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf205a370 0x561bf2050ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0659c640 1 -- 172.21.15.18:0/2493490004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 msgr2=0x561bf2066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0659c640 1 --2- 172.21.15.18:0/2493490004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 0x561bf2066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f0659c640 1 -- 172.21.15.18:0/2493490004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf204fe30 con 0x561bf20549a0 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.525+0000 7f8f06d9d640 1 --2- 172.21.15.18:0/2493490004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf205a370 0x561bf2050ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8f0659c640 1 --2- 172.21.15.18:0/2493490004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20549a0 0x561bf205dfa0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x561bf2050e90 tx=0x7f8ef800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabf796dd68026ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8eeffff640 1 -- 172.21.15.18:0/2493490004 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8003d60 con 0x561bf20549a0 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8eeffff640 1 -- 172.21.15.18:0/2493490004 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ef8011920 con 0x561bf20549a0 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8eeffff640 1 -- 172.21.15.18:0/2493490004 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef801d920 con 0x561bf20549a0 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2493490004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20549a0 msgr2=0x561bf205dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2493490004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20549a0 0x561bf205dfa0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x561bf2050e90 tx=0x7f8ef800b390 comp rx=0 tx=0).stop 2024-09-19T10:00:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2493490004 shutdown_connections 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2493490004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf205a370 0x561bf2050ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2493490004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf20552e0 0x561bf2066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2493490004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20549a0 0x561bf205dfa0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2493490004 >> 172.21.15.18:0/2493490004 conn(0x561bf2050010 msgr2=0x561bf205d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2493490004 shutdown_connections 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.526+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2493490004 wait complete. 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f0fc38740 1 -- start start 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f0fc38740 1 Processor -- start 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf2063380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf20638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f0fc38740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf205a370 0x561bf20648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f081ac4f0 con 0x561bf20552e0 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f081abe20 con 0x561bf205a370 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f0fc38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f081a9060 con 0x561bf20549a0 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f0fc38740 10 client.0 _ll_register_callbacks cb 0x7f8ef800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f05d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf20638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f05d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf20638c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49856/0 (socket says 172.21.15.18:49856) 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f05d9b640 1 -- 172.21.15.18:0/2805604650 learned_addr learned my addr 172.21.15.18:0/2805604650 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f06d9d640 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf205a370 0x561bf20648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f0659c640 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf2063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f05d9b640 1 -- 172.21.15.18:0/2805604650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 msgr2=0x561bf2063380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.527+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf2063380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f05d9b640 1 -- 172.21.15.18:0/2805604650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf205a370 msgr2=0x561bf20648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf205a370 0x561bf20648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f05d9b640 1 -- 172.21.15.18:0/2805604650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf2064ee0 con 0x561bf20552e0 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f05d9b640 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf20638c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f8efc09b9e0 tx=0x7f8efc00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bfbe71fde4bd42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8eedffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8eedffb640 1 -- 172.21.15.18:0/2805604650 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc020040 con 0x561bf20552e0 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8eedffb640 1 -- 172.21.15.18:0/2805604650 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8efc0d2c70 con 0x561bf20552e0 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2805604650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ef8011920 con 0x561bf20552e0 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8eedffb640 1 -- 172.21.15.18:0/2805604650 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8efc09c150 con 0x561bf20552e0 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f0fc38740 10 client.17427 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2805604650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561bf2066160 con 0x561bf20552e0 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8eedffb640 1 -- 172.21.15.18:0/2805604650 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ef8011920 con 0x561bf20552e0 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8eedffb640 1 -- 172.21.15.18:0/2805604650 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8efc0cf0c0 con 0x561bf20552e0 2024-09-19T10:00:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f0fc38740 10 client.17427 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f0fc38740 10 client.17427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f0fc38740 20 client.17427 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x561bf20d5270 0x561bf20d7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f0fc38740 4 client.17427 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:00:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.528+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2805604650 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561bf1f3c900 con 0x561bf20d5270 2024-09-19T10:00:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.529+0000 7f8f0659c640 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x561bf20d5270 0x561bf20d7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.529+0000 7f8eedffb640 10 client.17427 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.529+0000 7f8f0659c640 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x561bf20d5270 0x561bf20d7660 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5edc290c14d38b8 server_cookie=4152ab7fafa91af5 in_seq=0 out_seq=0 2024-09-19T10:00:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.541+0000 7f8eedffb640 1 -- 172.21.15.18:0/2805604650 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561bf1f3c900 con 0x561bf20d5270 2024-09-19T10:00:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.541+0000 7f8eedffb640 10 client.17427 handle_command_reply: tid=0 2024-09-19T10:00:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.541+0000 7f8f0fc38740 1 client.17427 shutdown 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.541+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2805604650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 msgr2=0x561bf20638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.541+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf20638c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f8efc09b9e0 tx=0x7f8efc00bf60 comp rx=0 tx=0).stop 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.542+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2805604650 shutdown_connections 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.542+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x561bf20d5270 0x561bf20d7660 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.542+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561bf205a370 0x561bf20648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.542+0000 7f8eedffb640 0 client.17427 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.542+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561bf20552e0 0x561bf20638c0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.542+0000 7f8f0fc38740 1 --2- 172.21.15.18:0/2805604650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561bf20549a0 0x561bf2063380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.542+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2805604650 >> 172.21.15.18:0/2805604650 conn(0x561bf2050010 msgr2=0x561bf204f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.542+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2805604650 shutdown_connections 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.542+0000 7f8f0fc38740 1 -- 172.21.15.18:0/2805604650 wait complete. 2024-09-19T10:00:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.542+0000 7f8f0fc38740 20 client.17427 trim_cache size 0 max 16384 2024-09-19T10:00:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:00:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:00:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:00:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/1611566827 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef00a3370 msgr2=0x7f8ef00a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef00a3370 0x7f8ef00a5830 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8f00006010 tx=0x7f8f00031bd0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/1611566827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f08102d50 msgr2=0x7f8f080745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f08102d50 0x7f8f080745e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00d950 tx=0x7f8efc00de10 comp rx=0 tx=0).stop 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/1611566827 shutdown_connections 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8ef00a3370 0x7f8ef00a5830 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f08103710 0x7f8f08074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f08102d50 0x7f8f080745e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 --2- 172.21.15.18:0/1611566827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f08101b60 0x7f8f08075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/1611566827 >> 172.21.15.18:0/1611566827 conn(0x7f8f080fd2e0 msgr2=0x7f8f08106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/1611566827 shutdown_connections 2024-09-19T10:00:36.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:36.543+0000 7f8f0cdc4640 1 -- 172.21.15.18:0/1611566827 wait complete. 2024-09-19T10:00:38.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:37 smithi018 ceph-mon[30956]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 114 MiB/s wr, 241 op/s 2024-09-19T10:00:38.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:37 smithi049 ceph-mon[34858]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 114 MiB/s wr, 241 op/s 2024-09-19T10:00:38.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:37 smithi162 ceph-mon[35174]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 114 MiB/s wr, 241 op/s 2024-09-19T10:00:40.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:39 smithi018 ceph-mon[30956]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 75 MiB/s wr, 162 op/s 2024-09-19T10:00:40.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:39 smithi049 ceph-mon[34858]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 75 MiB/s wr, 162 op/s 2024-09-19T10:00:40.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:39 smithi162 ceph-mon[35174]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 75 MiB/s wr, 162 op/s 2024-09-19T10:00:41.404 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:00:41.677 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:42.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:41 smithi018 ceph-mon[30956]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 75 MiB/s wr, 165 op/s 2024-09-19T10:00:42.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.170+0000 7f6990ce5640 1 -- 172.21.15.18:0/648143202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698c101420 msgr2=0x7f698c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:42.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.170+0000 7f6990ce5640 1 --2- 172.21.15.18:0/648143202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698c101420 0x7f698c10d950 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f6984009cd0 tx=0x7f698402a8e0 comp rx=0 tx=0).stop 2024-09-19T10:00:42.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.170+0000 7f6990ce5640 1 -- 172.21.15.18:0/648143202 shutdown_connections 2024-09-19T10:00:42.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.170+0000 7f6990ce5640 1 --2- 172.21.15.18:0/648143202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698c101420 0x7f698c10d950 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:42.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.170+0000 7f6990ce5640 1 --2- 172.21.15.18:0/648143202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f698c100a80 0x7f698c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:42.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.170+0000 7f6990ce5640 1 --2- 172.21.15.18:0/648143202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f698c106a80 0x7f698c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:42.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.170+0000 7f6990ce5640 1 -- 172.21.15.18:0/648143202 >> 172.21.15.18:0/648143202 conn(0x7f698c0fc7a0 msgr2=0x7f698c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:42.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.170+0000 7f6990ce5640 1 -- 172.21.15.18:0/648143202 shutdown_connections 2024-09-19T10:00:42.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.170+0000 7f6990ce5640 1 -- 172.21.15.18:0/648143202 wait complete. 2024-09-19T10:00:42.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.170+0000 7f6990ce5640 1 Processor -- start 2024-09-19T10:00:42.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6990ce5640 1 -- start start 2024-09-19T10:00:42.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6990ce5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f698c100a80 0x7f698c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:42.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6990ce5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698c101420 0x7f698c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:42.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6990ce5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f698c106a80 0x7f698c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:42.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6990ce5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f698c110e80 con 0x7f698c101420 2024-09-19T10:00:42.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6990ce5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f698c110d00 con 0x7f698c106a80 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6990ce5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f698c111000 con 0x7f698c100a80 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6989d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698c101420 0x7f698c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6989d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698c101420 0x7f698c19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49886/0 (socket says 172.21.15.18:49886) 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6989d9b640 1 -- 172.21.15.18:0/3000584403 learned_addr learned my addr 172.21.15.18:0/3000584403 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f698a59c640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f698c100a80 0x7f698c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f698ad9d640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f698c106a80 0x7f698c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6989d9b640 1 -- 172.21.15.18:0/3000584403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f698c100a80 msgr2=0x7f698c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6989d9b640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f698c100a80 0x7f698c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6989d9b640 1 -- 172.21.15.18:0/3000584403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f698c106a80 msgr2=0x7f698c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6989d9b640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f698c106a80 0x7f698c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:42.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6989d9b640 1 -- 172.21.15.18:0/3000584403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c19f5b0 con 0x7f698c101420 2024-09-19T10:00:42.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f698ad9d640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f698c106a80 0x7f698c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:00:42.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.171+0000 7f6989d9b640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698c101420 0x7f698c19ab40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f698000d950 tx=0x7f698000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:42.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.172+0000 7f697b7fe640 1 -- 172.21.15.18:0/3000584403 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980017030 con 0x7f698c101420 2024-09-19T10:00:42.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.172+0000 7f6990ce5640 1 -- 172.21.15.18:0/3000584403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c19f8a0 con 0x7f698c101420 2024-09-19T10:00:42.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.172+0000 7f697b7fe640 1 -- 172.21.15.18:0/3000584403 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6980004020 con 0x7f698c101420 2024-09-19T10:00:42.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.172+0000 7f697b7fe640 1 -- 172.21.15.18:0/3000584403 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69800047a0 con 0x7f698c101420 2024-09-19T10:00:42.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.172+0000 7f6990ce5640 1 -- 172.21.15.18:0/3000584403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c1a7180 con 0x7f698c101420 2024-09-19T10:00:42.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.173+0000 7f6990ce5640 1 -- 172.21.15.18:0/3000584403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f698c100ee0 con 0x7f698c101420 2024-09-19T10:00:42.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.174+0000 7f697b7fe640 1 -- 172.21.15.18:0/3000584403 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f69800041d0 con 0x7f698c101420 2024-09-19T10:00:42.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.174+0000 7f697b7fe640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f69740a3240 0x7f69740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:42.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.175+0000 7f698a59c640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f69740a3240 0x7f69740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:42.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.175+0000 7f697b7fe640 1 -- 172.21.15.18:0/3000584403 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f69800cf380 con 0x7f698c101420 2024-09-19T10:00:42.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.175+0000 7f698a59c640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f69740a3240 0x7f69740a5700 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f697c005fd0 tx=0x7f697c00b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:42.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.179+0000 7f697b7fe640 1 -- 172.21.15.18:0/3000584403 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f698009c0d0 con 0x7f698c101420 2024-09-19T10:00:42.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.392+0000 7f6990ce5640 1 -- 172.21.15.18:0/3000584403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f698c1a73e0 con 0x7f698c101420 2024-09-19T10:00:42.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.393+0000 7f697b7fe640 1 -- 172.21.15.18:0/3000584403 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f698009b9d0 con 0x7f698c101420 2024-09-19T10:00:42.396 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:00:42.396 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:00:42.396 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:00:42.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 -- 172.21.15.18:0/3000584403 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f69740a3240 msgr2=0x7f69740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:42.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f69740a3240 0x7f69740a5700 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f697c005fd0 tx=0x7f697c00b510 comp rx=0 tx=0).stop 2024-09-19T10:00:42.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 -- 172.21.15.18:0/3000584403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698c101420 msgr2=0x7f698c19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:42.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698c101420 0x7f698c19ab40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f698000d950 tx=0x7f698000de10 comp rx=0 tx=0).stop 2024-09-19T10:00:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 -- 172.21.15.18:0/3000584403 shutdown_connections 2024-09-19T10:00:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f69740a3240 0x7f69740a5700 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f698c106a80 0x7f698c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698c101420 0x7f698c19ab40 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 --2- 172.21.15.18:0/3000584403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f698c100a80 0x7f698c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 -- 172.21.15.18:0/3000584403 >> 172.21.15.18:0/3000584403 conn(0x7f698c0fc7a0 msgr2=0x7f698c06a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 -- 172.21.15.18:0/3000584403 shutdown_connections 2024-09-19T10:00:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:42.395+0000 7f6990ce5640 1 -- 172.21.15.18:0/3000584403 wait complete. 2024-09-19T10:00:42.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:41 smithi049 ceph-mon[34858]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 75 MiB/s wr, 165 op/s 2024-09-19T10:00:42.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:41 smithi162 ceph-mon[35174]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 75 MiB/s wr, 165 op/s 2024-09-19T10:00:43.118 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:42 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3000584403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:43.148 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --set-id b3681015 --release --await' 2024-09-19T10:00:43.148 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --set-id b3681015 --release --await 2024-09-19T10:00:43.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:42 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3000584403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:43.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:42 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3000584403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:43.835 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T10:00:44.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:43 smithi018 ceph-mon[30956]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 MiB/s wr, 186 op/s 2024-09-19T10:00:44.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.188+0000 7fd7aa22a640 1 -- 172.21.15.18:0/2254726268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a41082a0 msgr2=0x7fd7a410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:44.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.188+0000 7fd7aa22a640 1 --2- 172.21.15.18:0/2254726268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a41082a0 0x7fd7a410ec40 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009cd0 tx=0x7fd79c02a8e0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.188+0000 7fd7aa22a640 1 -- 172.21.15.18:0/2254726268 shutdown_connections 2024-09-19T10:00:44.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.188+0000 7fd7aa22a640 1 --2- 172.21.15.18:0/2254726268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a41082a0 0x7fd7a410ec40 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.188+0000 7fd7aa22a640 1 --2- 172.21.15.18:0/2254726268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7a41036e0 0x7fd7a4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.188+0000 7fd7aa22a640 1 --2- 172.21.15.18:0/2254726268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a4102d30 0x7fd7a4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.188+0000 7fd7aa22a640 1 -- 172.21.15.18:0/2254726268 >> 172.21.15.18:0/2254726268 conn(0x7fd7a40fc7d0 msgr2=0x7fd7a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:44.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.188+0000 7fd7aa22a640 1 -- 172.21.15.18:0/2254726268 shutdown_connections 2024-09-19T10:00:44.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.189+0000 7fd7aa22a640 1 -- 172.21.15.18:0/2254726268 wait complete. 2024-09-19T10:00:44.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7aa22a640 1 Processor -- start 2024-09-19T10:00:44.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7aa22a640 1 -- start start 2024-09-19T10:00:44.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7aa22a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a4102d30 0x7fd7a4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7aa22a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a41036e0 0x7fd7a4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7aa22a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7a41082a0 0x7fd7a4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7aa22a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a41120a0 con 0x7fd7a4102d30 2024-09-19T10:00:44.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7aa22a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4111f20 con 0x7fd7a41082a0 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7aa22a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4112220 con 0x7fd7a41036e0 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a4102d30 0x7fd7a4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a4102d30 0x7fd7a4100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49894/0 (socket says 172.21.15.18:49894) 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7a37fe640 1 -- 172.21.15.18:0/3565065315 learned_addr learned my addr 172.21.15.18:0/3565065315 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a41036e0 0x7fd7a4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.190+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7a41082a0 0x7fd7a4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7a37fe640 1 -- 172.21.15.18:0/3565065315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a41036e0 msgr2=0x7fd7a4100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a41036e0 0x7fd7a4100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7a37fe640 1 -- 172.21.15.18:0/3565065315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7a41082a0 msgr2=0x7fd7a4101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7a41082a0 0x7fd7a4101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7a37fe640 1 -- 172.21.15.18:0/3565065315 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a41a69e0 con 0x7fd7a4102d30 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7a41082a0 0x7fd7a4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:44.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a4102d30 0x7fd7a4100990 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd79400e9f0 tx=0x7fd79400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:44.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7a0ff9640 1 -- 172.21.15.18:0/3565065315 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79400cd80 con 0x7fd7a4102d30 2024-09-19T10:00:44.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7a0ff9640 1 -- 172.21.15.18:0/3565065315 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd794010910 con 0x7fd7a4102d30 2024-09-19T10:00:44.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7aa22a640 1 -- 172.21.15.18:0/3565065315 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a41a6cd0 con 0x7fd7a4102d30 2024-09-19T10:00:44.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7a0ff9640 1 -- 172.21.15.18:0/3565065315 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794018990 con 0x7fd7a4102d30 2024-09-19T10:00:44.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.191+0000 7fd7aa22a640 1 -- 172.21.15.18:0/3565065315 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a41a71c0 con 0x7fd7a4102d30 2024-09-19T10:00:44.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7a0ff9640 1 -- 172.21.15.18:0/3565065315 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd794018b30 con 0x7fd7a4102d30 2024-09-19T10:00:44.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7ac603740 1 Processor -- start 2024-09-19T10:00:44.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7ac603740 1 -- start start 2024-09-19T10:00:44.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0d8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8980 0x558ded0e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7ac603740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558ded03d620 con 0x558ded0d8060 2024-09-19T10:00:44.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7ac603740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558decfe4e50 con 0x558ded0d8980 2024-09-19T10:00:44.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7ac603740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558ded0395e0 con 0x558ded0e3240 2024-09-19T10:00:44.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0d8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.194+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0d8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49906/0 (socket says 172.21.15.18:49906) 2024-09-19T10:00:44.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.195+0000 7fd7a3fff640 1 -- 172.21.15.18:0/648493523 learned_addr learned my addr 172.21.15.18:0/648493523 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:44.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.195+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.195+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8980 0x558ded0e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.195+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/648493523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8980 msgr2=0x558ded0e2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:44.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.195+0000 7fd7a0ff9640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd78c0a3240 0x7fd78c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.195+0000 7fd7a0ff9640 1 -- 172.21.15.18:0/3565065315 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd7940cfc80 con 0x7fd7a4102d30 2024-09-19T10:00:44.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.195+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8980 0x558ded0e2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.195+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/648493523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 msgr2=0x558ded0d8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.195+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0d8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.195+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/648493523 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558decfd5d40 con 0x558ded0e3240 2024-09-19T10:00:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.196+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0d8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.196+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8980 0x558ded0e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:00:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.196+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd78c0a3240 0x7fd78c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.196+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e5630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd7a406a370 tx=0x7fd798011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe77ca925b4d5d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.196+0000 7fd789ffb640 1 -- 172.21.15.18:0/648493523 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798004050 con 0x558ded0e3240 2024-09-19T10:00:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.196+0000 7fd789ffb640 1 -- 172.21.15.18:0/648493523 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd798005500 con 0x558ded0e3240 2024-09-19T10:00:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.196+0000 7fd789ffb640 1 -- 172.21.15.18:0/648493523 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798004d50 con 0x558ded0e3240 2024-09-19T10:00:44.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7ac603740 1 -- 172.21.15.18:0/648493523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 msgr2=0x558ded0e5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:44.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd78c0a3240 0x7fd78c0a5700 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009cd0 tx=0x7fd79c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:44.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7ac603740 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e5630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd7a406a370 tx=0x7fd798011810 comp rx=0 tx=0).stop 2024-09-19T10:00:44.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7ac603740 1 -- 172.21.15.18:0/648493523 shutdown_connections 2024-09-19T10:00:44.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7ac603740 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e5630 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7ac603740 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8980 0x558ded0e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7ac603740 1 --2- 172.21.15.18:0/648493523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0d8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7ac603740 1 -- 172.21.15.18:0/648493523 >> 172.21.15.18:0/648493523 conn(0x558ded0d45f0 msgr2=0x558ded0d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7ac603740 1 -- 172.21.15.18:0/648493523 shutdown_connections 2024-09-19T10:00:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7ac603740 1 -- 172.21.15.18:0/648493523 wait complete. 2024-09-19T10:00:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.197+0000 7fd7ac603740 1 -- start start 2024-09-19T10:00:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7ac603740 1 Processor -- start 2024-09-19T10:00:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8060 0x558ded0e0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8980 0x558ded0e0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7ac603740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558ded0e5e10 con 0x558ded0d8980 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7ac603740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558decfc5f10 con 0x558ded0d8060 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7ac603740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558ded0e5f90 con 0x558ded0e3240 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7ac603740 10 client.0 _ll_register_callbacks cb 0x558decfe9db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7a2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8980 0x558ded0e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7a2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8980 0x558ded0e0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49912/0 (socket says 172.21.15.18:49912) 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/2359160985 learned_addr learned my addr 172.21.15.18:0/2359160985 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8060 0x558ded0e0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.198+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/2359160985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 msgr2=0x558ded0e0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/2359160985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8060 msgr2=0x558ded0e0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8060 0x558ded0e0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/2359160985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558decd4c580 con 0x558ded0d8980 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8060 0x558ded0e0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8980 0x558ded0e0660 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd798004480 tx=0x7fd7980096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27638b9fd339a64e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd782ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd782ffd640 1 -- 172.21.15.18:0/2359160985 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798028070 con 0x558ded0d8980 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd7ac603740 1 -- 172.21.15.18:0/2359160985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd798005500 con 0x558ded0d8980 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd782ffd640 1 -- 172.21.15.18:0/2359160985 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd798004cf0 con 0x558ded0d8980 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd782ffd640 1 -- 172.21.15.18:0/2359160985 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd798034050 con 0x558ded0d8980 2024-09-19T10:00:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd7ac603740 10 client.17445 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.199+0000 7fd7ac603740 1 -- 172.21.15.18:0/2359160985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558dece16960 con 0x558ded0d8980 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.200+0000 7fd782ffd640 1 -- 172.21.15.18:0/2359160985 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd798005500 con 0x558ded0d8980 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.200+0000 7fd782ffd640 1 -- 172.21.15.18:0/2359160985 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd798003c40 con 0x558ded0d8980 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.200+0000 7fd7ac603740 10 client.17445 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.200+0000 7fd7ac603740 10 client.17445 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.200+0000 7fd7ac603740 20 client.17445 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.200+0000 7fd7ac603740 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ded0f2ca0 0x558ded0f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.200+0000 7fd7ac603740 4 client.17445 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.200+0000 7fd7ac603740 1 -- 172.21.15.18:0/2359160985 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ded04ab90 con 0x558ded0f2ca0 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.200+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ded0f2ca0 0x558ded0f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.201+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ded0f2ca0 0x558ded0f5090 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b22137ae80bb36 server_cookie=612b74a95343dfc4 in_seq=0 out_seq=0 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.201+0000 7fd782ffd640 10 client.17445 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.201+0000 7fd782ffd640 1 -- 172.21.15.18:0/2359160985 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ded04ab90 con 0x558ded0f2ca0 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.201+0000 7fd782ffd640 10 client.17445 handle_command_reply: tid=0 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.201+0000 7fd7ac603740 1 client.17445 shutdown 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.201+0000 7fd7ac603740 1 -- 172.21.15.18:0/2359160985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8980 msgr2=0x558ded0e0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.201+0000 7fd7ac603740 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8980 0x558ded0e0660 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd798004480 tx=0x7fd7980096c0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.202+0000 7fd7ac603740 1 -- 172.21.15.18:0/2359160985 shutdown_connections 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.202+0000 7fd7ac603740 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ded0f2ca0 0x558ded0f5090 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.202+0000 7fd7ac603740 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.202+0000 7fd7ac603740 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8980 0x558ded0e0660 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.202+0000 7fd7ac603740 1 --2- 172.21.15.18:0/2359160985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0d8060 0x558ded0e0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.202+0000 7fd782ffd640 0 client.17445 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.202+0000 7fd7ac603740 1 -- 172.21.15.18:0/2359160985 >> 172.21.15.18:0/2359160985 conn(0x558ded0d45f0 msgr2=0x558ded0da320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.202+0000 7fd7ac603740 1 -- 172.21.15.18:0/2359160985 shutdown_connections 2024-09-19T10:00:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.202+0000 7fd7ac603740 1 -- 172.21.15.18:0/2359160985 wait complete. 2024-09-19T10:00:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.202+0000 7fd7ac603740 20 client.17445 trim_cache size 0 max 16384 2024-09-19T10:00:44.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7ac603740 1 Processor -- start 2024-09-19T10:00:44.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7ac603740 1 -- start start 2024-09-19T10:00:44.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0db420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0d8980 0x558ded0d3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0e3240 0x558ded0fa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7ac603740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a41af6f0 con 0x558ded0d8060 2024-09-19T10:00:44.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7ac603740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a41b1230 con 0x558ded0e3240 2024-09-19T10:00:44.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7ac603740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a41afdc0 con 0x558ded0d8980 2024-09-19T10:00:44.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7a2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0d8980 0x558ded0d3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7a2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0d8980 0x558ded0d3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:49816/0 (socket says 172.21.15.18:49816) 2024-09-19T10:00:44.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/1293649395 learned_addr learned my addr 172.21.15.18:0/1293649395 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:44.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/1293649395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0e3240 0x558ded0fa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/1293649395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0e3240 msgr2=0x558ded0fa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/1293649395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0e3240 0x558ded0fa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/1293649395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 msgr2=0x558ded0db420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/1293649395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0db420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.220+0000 7fd7a2ffd640 1 -- 172.21.15.18:0/1293649395 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ded0e2060 con 0x558ded0d8980 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.221+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/1293649395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0d8980 0x558ded0d3640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd798023490 tx=0x7fd798011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70ea4e7c8a0d9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.221+0000 7fd7897fa640 1 -- 172.21.15.18:0/1293649395 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798028070 con 0x558ded0d8980 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.221+0000 7fd7897fa640 1 -- 172.21.15.18:0/1293649395 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd798005500 con 0x558ded0d8980 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.221+0000 7fd7897fa640 1 -- 172.21.15.18:0/1293649395 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79801d040 con 0x558ded0d8980 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 -- 172.21.15.18:0/1293649395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0d8980 msgr2=0x558ded0d3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 --2- 172.21.15.18:0/1293649395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0d8980 0x558ded0d3640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd798023490 tx=0x7fd798011810 comp rx=0 tx=0).stop 2024-09-19T10:00:44.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 -- 172.21.15.18:0/1293649395 shutdown_connections 2024-09-19T10:00:44.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 --2- 172.21.15.18:0/1293649395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded0e3240 0x558ded0fa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 --2- 172.21.15.18:0/1293649395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0d8980 0x558ded0d3640 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd798023490 tx=0x7fd798011810 comp rx=0 tx=0).stop 2024-09-19T10:00:44.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 --2- 172.21.15.18:0/1293649395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0db420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 -- 172.21.15.18:0/1293649395 >> 172.21.15.18:0/1293649395 conn(0x558ded0d45f0 msgr2=0x558ded0d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:44.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 -- 172.21.15.18:0/1293649395 shutdown_connections 2024-09-19T10:00:44.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 -- 172.21.15.18:0/1293649395 wait complete. 2024-09-19T10:00:44.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 -- start start 2024-09-19T10:00:44.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.222+0000 7fd7ac603740 1 Processor -- start 2024-09-19T10:00:44.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0e7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7ac603740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded15a790 0x558ded15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7ac603740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a41b0b60 con 0x558ded0d8060 2024-09-19T10:00:44.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0e7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49930/0 (socket says 172.21.15.18:49930) 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7a37fe640 1 -- 172.21.15.18:0/3494272773 learned_addr learned my addr 172.21.15.18:0/3494272773 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded15a790 0x558ded15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7ac603740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a41b0490 con 0x558ded15a790 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7ac603740 1 -- 172.21.15.18:0/3494272773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a41ad6d0 con 0x558ded0e3240 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7a2ffd640 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7ac603740 10 client.0 _ll_register_callbacks cb 0x7fd798005d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7a3fff640 1 -- 172.21.15.18:0/3494272773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 msgr2=0x558ded0e7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.223+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd7a3fff640 1 -- 172.21.15.18:0/3494272773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 msgr2=0x558ded0e7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0e7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd7a3fff640 1 -- 172.21.15.18:0/3494272773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ded15d140 con 0x558ded15a790 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd7a3fff640 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded15a790 0x558ded15cb80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd79c005e30 tx=0x7fd79c02a8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ccfb72d3eff0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd782ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd782ffd640 1 -- 172.21.15.18:0/3494272773 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c058060 con 0x558ded15a790 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd782ffd640 1 -- 172.21.15.18:0/3494272773 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd79c0309b0 con 0x558ded15a790 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd7ac603740 1 -- 172.21.15.18:0/3494272773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd798005500 con 0x558ded15a790 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd782ffd640 1 -- 172.21.15.18:0/3494272773 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd79c030bb0 con 0x558ded15a790 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd7ac603740 10 client.26888 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd7ac603740 1 -- 172.21.15.18:0/3494272773 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558ded15e440 con 0x558ded15a790 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.224+0000 7fd782ffd640 1 -- 172.21.15.18:0/3494272773 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd79c036040 con 0x558ded15a790 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.225+0000 7fd782ffd640 1 -- 172.21.15.18:0/3494272773 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd79c030070 con 0x558ded15a790 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.225+0000 7fd7ac603740 10 client.26888 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.225+0000 7fd7ac603740 10 client.26888 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:00:44.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.225+0000 7fd7ac603740 20 client.26888 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:44.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.225+0000 7fd7ac603740 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ded15eb60 0x558ded160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:44.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.225+0000 7fd7ac603740 4 client.26888 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b3681015", "release": true, "await": true}] 2024-09-19T10:00:44.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.225+0000 7fd7ac603740 1 -- 172.21.15.18:0/3494272773 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b3681015", "release": true, "await": true}) -- 0x7fd798005500 con 0x558ded15eb60 2024-09-19T10:00:44.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.225+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ded15eb60 0x558ded160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:44.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.225+0000 7fd7a37fe640 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ded15eb60 0x558ded160f50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5149d126455e829c server_cookie=903da6343de10687 in_seq=0 out_seq=0 2024-09-19T10:00:44.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.225+0000 7fd782ffd640 10 client.26888 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd782ffd640 1 -- 172.21.15.18:0/3494272773 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fd798005500 con 0x558ded15eb60 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd782ffd640 10 client.26888 handle_command_reply: tid=0 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd7ac603740 1 client.26888 shutdown 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd7ac603740 1 -- 172.21.15.18:0/3494272773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded15a790 msgr2=0x558ded15cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd7ac603740 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded15a790 0x558ded15cb80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd79c005e30 tx=0x7fd79c02a8e0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd7ac603740 1 -- 172.21.15.18:0/3494272773 shutdown_connections 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd7ac603740 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558ded15eb60 0x558ded160f50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd782ffd640 0 client.26888 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd7ac603740 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ded15a790 0x558ded15cb80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd7ac603740 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ded0e3240 0x558ded0e7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd7ac603740 1 --2- 172.21.15.18:0/3494272773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ded0d8060 0x558ded0e7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.229+0000 7fd7ac603740 1 -- 172.21.15.18:0/3494272773 >> 172.21.15.18:0/3494272773 conn(0x558ded0d45f0 msgr2=0x558ded0d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:44.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.230+0000 7fd7ac603740 1 -- 172.21.15.18:0/3494272773 shutdown_connections 2024-09-19T10:00:44.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.230+0000 7fd7ac603740 1 -- 172.21.15.18:0/3494272773 wait complete. 2024-09-19T10:00:44.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.230+0000 7fd7ac603740 20 client.26888 trim_cache size 0 max 16384 2024-09-19T10:00:44.236 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:00:44.236 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T10:00:44.236 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T10:00:44.236 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 32, 2024-09-19T10:00:44.236 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T10:00:44.236 INFO:teuthology.orchestra.run.smithi018.stdout: "b3681015": { 2024-09-19T10:00:44.236 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 32, 2024-09-19T10:00:44.236 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T10:00:44.236 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 145.8, 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T10:00:44.237 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:00:44.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:44.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:44.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:44.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:44.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:00:44.238 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:00:44.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.234+0000 7fd7aa22a640 1 -- 172.21.15.18:0/3565065315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd78c0a3240 msgr2=0x7fd78c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.234+0000 7fd7aa22a640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd78c0a3240 0x7fd78c0a5700 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009cd0 tx=0x7fd79c0095c0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.234+0000 7fd7aa22a640 1 -- 172.21.15.18:0/3565065315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a4102d30 msgr2=0x7fd7a4100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.234+0000 7fd7aa22a640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a4102d30 0x7fd7a4100990 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd79400e9f0 tx=0x7fd79400eeb0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.234+0000 7fd7aa22a640 1 -- 172.21.15.18:0/3565065315 shutdown_connections 2024-09-19T10:00:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.234+0000 7fd7aa22a640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd78c0a3240 0x7fd78c0a5700 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.234+0000 7fd7aa22a640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7a41082a0 0x7fd7a4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.234+0000 7fd7aa22a640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a41036e0 0x7fd7a4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.234+0000 7fd7aa22a640 1 --2- 172.21.15.18:0/3565065315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7a4102d30 0x7fd7a4100990 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:44.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.234+0000 7fd7aa22a640 1 -- 172.21.15.18:0/3565065315 >> 172.21.15.18:0/3565065315 conn(0x7fd7a40fc7d0 msgr2=0x7fd7a4105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.244+0000 7fd7aa22a640 1 -- 172.21.15.18:0/3565065315 shutdown_connections 2024-09-19T10:00:44.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:44.244+0000 7fd7aa22a640 1 -- 172.21.15.18:0/3565065315 wait complete. 2024-09-19T10:00:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:44.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:43 smithi049 ceph-mon[34858]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 MiB/s wr, 186 op/s 2024-09-19T10:00:44.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:43 smithi162 ceph-mon[35174]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 MiB/s wr, 186 op/s 2024-09-19T10:00:46.087 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b3681015', total seconds elapsed: 30.4 2024-09-19T10:00:46.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:46 smithi018 ceph-mon[30956]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 80 MiB/s wr, 176 op/s 2024-09-19T10:00:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:46 smithi049 ceph-mon[34858]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 80 MiB/s wr, 176 op/s 2024-09-19T10:00:46.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:46 smithi162 ceph-mon[35174]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 80 MiB/s wr, 176 op/s 2024-09-19T10:00:47.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.030+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2444608832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc99c110190 msgr2=0x7fc99c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:47.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.030+0000 7fc9a2ddf640 1 --2- 172.21.15.18:0/2444608832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc99c110190 0x7fc99c06e4f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc998009900 tx=0x7fc99802a440 comp rx=0 tx=0).stop 2024-09-19T10:00:47.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.032+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2444608832 shutdown_connections 2024-09-19T10:00:47.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.032+0000 7fc9a2ddf640 1 --2- 172.21.15.18:0/2444608832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc99c11b140 0x7fc99c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.032+0000 7fc9a2ddf640 1 --2- 172.21.15.18:0/2444608832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c06ea30 0x7fc99c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.032+0000 7fc9a2ddf640 1 --2- 172.21.15.18:0/2444608832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc99c110190 0x7fc99c06e4f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.032+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2444608832 >> 172.21.15.18:0/2444608832 conn(0x7fc99c073180 msgr2=0x7fc99c073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:47.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.033+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2444608832 shutdown_connections 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.034+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2444608832 wait complete. 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.036+0000 7fc9a2ddf640 1 Processor -- start 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.036+0000 7fc9a2ddf640 1 -- start start 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.036+0000 7fc9a2ddf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c06ea30 0x7fc99c1a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.037+0000 7fc9a2ddf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc99c110190 0x7fc99c1a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.037+0000 7fc9a2ddf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc99c11b140 0x7fc99c1aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.037+0000 7fc9a2ddf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c120c40 con 0x7fc99c11b140 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.037+0000 7fc9a2ddf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c120ac0 con 0x7fc99c06ea30 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.037+0000 7fc9a2ddf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c120dc0 con 0x7fc99c110190 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.040+0000 7fc9a15dc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc99c110190 0x7fc99c1a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.040+0000 7fc9a15dc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc99c110190 0x7fc99c1a76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50808/0 (socket says 172.21.15.18:50808) 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.040+0000 7fc9a15dc640 1 -- 172.21.15.18:0/2264518722 learned_addr learned my addr 172.21.15.18:0/2264518722 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:47.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.040+0000 7fc9a1ddd640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c06ea30 0x7fc99c1a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.044+0000 7fc9a25de640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc99c11b140 0x7fc99c1aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.044+0000 7fc9a15dc640 1 -- 172.21.15.18:0/2264518722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c06ea30 msgr2=0x7fc99c1a7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:47.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.044+0000 7fc9a15dc640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c06ea30 0x7fc99c1a7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.044+0000 7fc9a15dc640 1 -- 172.21.15.18:0/2264518722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc99c11b140 msgr2=0x7fc99c1aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:47.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.044+0000 7fc9a15dc640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc99c11b140 0x7fc99c1aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.044+0000 7fc9a15dc640 1 -- 172.21.15.18:0/2264518722 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c1ac130 con 0x7fc99c110190 2024-09-19T10:00:47.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.049+0000 7fc9a15dc640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc99c110190 0x7fc99c1a76c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00d950 tx=0x7fc98c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.058+0000 7fc992ffd640 1 -- 172.21.15.18:0/2264518722 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c017070 con 0x7fc99c110190 2024-09-19T10:00:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.059+0000 7fc992ffd640 1 -- 172.21.15.18:0/2264518722 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc98c009c30 con 0x7fc99c110190 2024-09-19T10:00:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.060+0000 7fc992ffd640 1 -- 172.21.15.18:0/2264518722 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c00f6b0 con 0x7fc99c110190 2024-09-19T10:00:47.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.060+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2264518722 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99c1ac420 con 0x7fc99c110190 2024-09-19T10:00:47.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.061+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2264518722 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99c1b3d00 con 0x7fc99c110190 2024-09-19T10:00:47.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.069+0000 7fc9a641a740 1 Processor -- start 2024-09-19T10:00:47.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.069+0000 7fc9a641a740 1 -- start start 2024-09-19T10:00:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.069+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8436670 0x5610b8436a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.069+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b8441310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.069+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8441850 0x5610b8443c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.069+0000 7fc9a641a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5610b839c2e0 con 0x5610b8441850 2024-09-19T10:00:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.069+0000 7fc9a641a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5610b8343ce0 con 0x5610b8436f90 2024-09-19T10:00:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.069+0000 7fc9a641a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5610b83982a0 con 0x5610b8436670 2024-09-19T10:00:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.070+0000 7fc9a1ddd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b8441310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.070+0000 7fc9a1ddd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b8441310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:45258/0 (socket says 172.21.15.18:45258) 2024-09-19T10:00:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.070+0000 7fc9a1ddd640 1 -- 172.21.15.18:0/1673234821 learned_addr learned my addr 172.21.15.18:0/1673234821 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.071+0000 7fc9a25de640 1 --2- 172.21.15.18:0/1673234821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8436670 0x5610b8436a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.072+0000 7fc9a25de640 1 -- 172.21.15.18:0/1673234821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 msgr2=0x5610b8441310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.072+0000 7fc9a25de640 1 --2- 172.21.15.18:0/1673234821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b8441310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.072+0000 7fc9a25de640 1 -- 172.21.15.18:0/1673234821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8441850 msgr2=0x5610b8443c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.072+0000 7fc9a25de640 1 --2- 172.21.15.18:0/1673234821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8441850 0x5610b8443c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.072+0000 7fc9a25de640 1 -- 172.21.15.18:0/1673234821 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610b8328440 con 0x5610b8436670 2024-09-19T10:00:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.074+0000 7fc9a25de640 1 --2- 172.21.15.18:0/1673234821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8436670 0x5610b8436a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc994009e20 tx=0x7fc99400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=394440ae7ad4fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.082+0000 7fc987fff640 1 -- 172.21.15.18:0/1673234821 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99401a070 con 0x5610b8436670 2024-09-19T10:00:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.082+0000 7fc987fff640 1 -- 172.21.15.18:0/1673234821 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9940158f0 con 0x5610b8436670 2024-09-19T10:00:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.084+0000 7fc9a641a740 1 -- 172.21.15.18:0/1673234821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8436670 msgr2=0x5610b8436a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.084+0000 7fc9a641a740 1 --2- 172.21.15.18:0/1673234821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8436670 0x5610b8436a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc994009e20 tx=0x7fc99400c7f0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.084+0000 7fc9a641a740 1 -- 172.21.15.18:0/1673234821 shutdown_connections 2024-09-19T10:00:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.084+0000 7fc9a641a740 1 --2- 172.21.15.18:0/1673234821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8441850 0x5610b8443c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.084+0000 7fc9a641a740 1 --2- 172.21.15.18:0/1673234821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b8441310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.084+0000 7fc9a641a740 1 --2- 172.21.15.18:0/1673234821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8436670 0x5610b8436a50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.084+0000 7fc9a641a740 1 -- 172.21.15.18:0/1673234821 >> 172.21.15.18:0/1673234821 conn(0x5610b8432c00 msgr2=0x5610b8432fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.088+0000 7fc9a641a740 1 -- 172.21.15.18:0/1673234821 shutdown_connections 2024-09-19T10:00:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.091+0000 7fc9a641a740 1 -- 172.21.15.18:0/1673234821 wait complete. 2024-09-19T10:00:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.092+0000 7fc9a641a740 1 -- start start 2024-09-19T10:00:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.092+0000 7fc9a641a740 1 Processor -- start 2024-09-19T10:00:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.093+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8436f90 0x5610b8440fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.093+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8441850 0x5610b843e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.093+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b843e790 0x5610b843ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.093+0000 7fc9a641a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5610b84444c0 con 0x5610b8436f90 2024-09-19T10:00:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.093+0000 7fc9a641a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5610b8357050 con 0x5610b843e790 2024-09-19T10:00:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.093+0000 7fc9a641a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5610b8444640 con 0x5610b8441850 2024-09-19T10:00:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.093+0000 7fc9a25de640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8436f90 0x5610b8440fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.093+0000 7fc9a25de640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8436f90 0x5610b8440fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37278/0 (socket says 172.21.15.18:37278) 2024-09-19T10:00:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.093+0000 7fc9a25de640 1 -- 172.21.15.18:0/1493733623 learned_addr learned my addr 172.21.15.18:0/1493733623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.093+0000 7fc9a641a740 10 client.0 _ll_register_callbacks cb 0x5610b8397160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.094+0000 7fc992ffd640 1 -- 172.21.15.18:0/2264518722 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc98c00f850 con 0x7fc99c110190 2024-09-19T10:00:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.096+0000 7fc9a25de640 1 -- 172.21.15.18:0/1493733623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8441850 msgr2=0x5610b843e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.096+0000 7fc9a25de640 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8441850 0x5610b843e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.096+0000 7fc9a25de640 1 -- 172.21.15.18:0/1493733623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b843e790 msgr2=0x5610b843ec10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:00:47.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.096+0000 7fc9a25de640 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b843e790 0x5610b843ec10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.096+0000 7fc9a25de640 1 -- 172.21.15.18:0/1493733623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610b810d3c0 con 0x5610b8436f90 2024-09-19T10:00:47.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.097+0000 7fc992ffd640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9880a3200 0x7fc9880a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.097+0000 7fc992ffd640 1 -- 172.21.15.18:0/2264518722 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc98c0cf170 con 0x7fc99c110190 2024-09-19T10:00:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.099+0000 7fc9a25de640 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8436f90 0x5610b8440fa0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc99400a010 tx=0x7fc99400af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad1268ac72ea257 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.099+0000 7fc9a1ddd640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9880a3200 0x7fc9880a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.099+0000 7fc9857fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.102+0000 7fc9857fa640 1 -- 172.21.15.18:0/1493733623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99401a040 con 0x5610b8436f90 2024-09-19T10:00:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.103+0000 7fc9a641a740 1 -- 172.21.15.18:0/1493733623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5610b83a9850 con 0x5610b8436f90 2024-09-19T10:00:47.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.104+0000 7fc9857fa640 1 -- 172.21.15.18:0/1493733623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc994009980 con 0x5610b8436f90 2024-09-19T10:00:47.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.105+0000 7fc9857fa640 1 -- 172.21.15.18:0/1493733623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc99402c460 con 0x5610b8436f90 2024-09-19T10:00:47.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.105+0000 7fc9a1ddd640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9880a3200 0x7fc9880a56c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x5610b843f890 tx=0x7fc998005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:47.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.106+0000 7fc9a641a740 10 client.17457 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:47.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.106+0000 7fc9a641a740 1 -- 172.21.15.18:0/1493733623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5610b8461170 con 0x5610b8436f90 2024-09-19T10:00:47.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.108+0000 7fc9857fa640 1 -- 172.21.15.18:0/1493733623 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5610b83a9850 con 0x5610b8436f90 2024-09-19T10:00:47.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.110+0000 7fc9857fa640 1 -- 172.21.15.18:0/1493733623 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc994020690 con 0x5610b8436f90 2024-09-19T10:00:47.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.110+0000 7fc9a641a740 10 client.17457 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:47.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.110+0000 7fc9a641a740 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:47.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.110+0000 7fc9a641a740 20 client.17457 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:47.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.110+0000 7fc9a641a740 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5610b84629c0 0x5610b8464e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.110+0000 7fc9a641a740 4 client.17457 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:47.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.110+0000 7fc9a641a740 1 -- 172.21.15.18:0/1493733623 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610b83a3d60 con 0x5610b84629c0 2024-09-19T10:00:47.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.114+0000 7fc9a15dc640 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5610b84629c0 0x5610b8464e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.125+0000 7fc9a15dc640 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5610b84629c0 0x5610b8464e40 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1dc4ca30504ba5 server_cookie=ec985b59dacd3ad7 in_seq=0 out_seq=0 2024-09-19T10:00:47.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.125+0000 7fc9857fa640 10 client.17457 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:47.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.128+0000 7fc9857fa640 1 -- 172.21.15.18:0/1493733623 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610b83a3d60 con 0x5610b84629c0 2024-09-19T10:00:47.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.128+0000 7fc9857fa640 10 client.17457 handle_command_reply: tid=0 2024-09-19T10:00:47.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.129+0000 7fc9a641a740 1 client.17457 shutdown 2024-09-19T10:00:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.131+0000 7fc9a641a740 1 -- 172.21.15.18:0/1493733623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8436f90 msgr2=0x5610b8440fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.131+0000 7fc9a641a740 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8436f90 0x5610b8440fa0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc99400a010 tx=0x7fc99400af90 comp rx=0 tx=0).stop 2024-09-19T10:00:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.131+0000 7fc9a641a740 1 -- 172.21.15.18:0/1493733623 shutdown_connections 2024-09-19T10:00:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.131+0000 7fc9a641a740 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5610b84629c0 0x5610b8464e40 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.131+0000 7fc9a641a740 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b843e790 0x5610b843ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.131+0000 7fc9a641a740 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8441850 0x5610b843e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.131+0000 7fc9a641a740 1 --2- 172.21.15.18:0/1493733623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8436f90 0x5610b8440fa0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.131+0000 7fc9a641a740 1 -- 172.21.15.18:0/1493733623 >> 172.21.15.18:0/1493733623 conn(0x5610b8432c00 msgr2=0x5610b8438140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.132+0000 7fc9857fa640 0 client.17457 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:47.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.138+0000 7fc9a641a740 1 -- 172.21.15.18:0/1493733623 shutdown_connections 2024-09-19T10:00:47.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.142+0000 7fc9a641a740 1 -- 172.21.15.18:0/1493733623 wait complete. 2024-09-19T10:00:47.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.143+0000 7fc9a641a740 20 client.17457 trim_cache size 0 max 16384 2024-09-19T10:00:47.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.211+0000 7fc9a641a740 1 Processor -- start 2024-09-19T10:00:47.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.213+0000 7fc9a641a740 1 -- start start 2024-09-19T10:00:47.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.214+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b843e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.214+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b843e790 0x5610b8432530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.214+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8441850 0x5610b8439260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.214+0000 7fc9a641a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c118930 con 0x5610b843e790 2024-09-19T10:00:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.214+0000 7fc9a1ddd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b843e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.215+0000 7fc9a1ddd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b843e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:45278/0 (socket says 172.21.15.18:45278) 2024-09-19T10:00:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.215+0000 7fc9a1ddd640 1 -- 172.21.15.18:0/501057823 learned_addr learned my addr 172.21.15.18:0/501057823 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.215+0000 7fc9a25de640 1 --2- 172.21.15.18:0/501057823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8441850 0x5610b8439260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.215+0000 7fc9a641a740 1 -- 172.21.15.18:0/501057823 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c1b5140 con 0x5610b8436f90 2024-09-19T10:00:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.215+0000 7fc9a641a740 1 -- 172.21.15.18:0/501057823 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c1b3ed0 con 0x5610b8441850 2024-09-19T10:00:47.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.216+0000 7fc9a15dc640 1 --2- 172.21.15.18:0/501057823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b843e790 0x5610b8432530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.216+0000 7fc9a25de640 1 -- 172.21.15.18:0/501057823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 msgr2=0x5610b843e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:47.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.216+0000 7fc9a25de640 1 --2- 172.21.15.18:0/501057823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b843e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.216+0000 7fc9a25de640 1 -- 172.21.15.18:0/501057823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b843e790 msgr2=0x5610b8432530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:47.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.216+0000 7fc9a25de640 1 --2- 172.21.15.18:0/501057823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b843e790 0x5610b8432530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.216+0000 7fc9a25de640 1 -- 172.21.15.18:0/501057823 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610b8441310 con 0x5610b8441850 2024-09-19T10:00:47.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.216+0000 7fc9a1ddd640 1 --2- 172.21.15.18:0/501057823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b843e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:47.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.216+0000 7fc9a25de640 1 --2- 172.21.15.18:0/501057823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8441850 0x5610b8439260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc994020c00 tx=0x7fc99400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd5d1808e0385d08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:47.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.217+0000 7fc9877fe640 1 -- 172.21.15.18:0/501057823 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99401a040 con 0x5610b8441850 2024-09-19T10:00:47.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.217+0000 7fc9877fe640 1 -- 172.21.15.18:0/501057823 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc994025070 con 0x5610b8441850 2024-09-19T10:00:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.218+0000 7fc9a641a740 1 -- 172.21.15.18:0/501057823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8441850 msgr2=0x5610b8439260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.218+0000 7fc9a641a740 1 --2- 172.21.15.18:0/501057823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8441850 0x5610b8439260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc994020c00 tx=0x7fc99400c7f0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.218+0000 7fc9a641a740 1 -- 172.21.15.18:0/501057823 shutdown_connections 2024-09-19T10:00:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.218+0000 7fc9a641a740 1 --2- 172.21.15.18:0/501057823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b8441850 0x5610b8439260 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.218+0000 7fc9a641a740 1 --2- 172.21.15.18:0/501057823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b843e790 0x5610b8432530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.218+0000 7fc9a641a740 1 --2- 172.21.15.18:0/501057823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b843e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.218+0000 7fc9a641a740 1 -- 172.21.15.18:0/501057823 >> 172.21.15.18:0/501057823 conn(0x5610b8432c00 msgr2=0x5610b843db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.219+0000 7fc9a641a740 1 -- 172.21.15.18:0/501057823 shutdown_connections 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.219+0000 7fc9a641a740 1 -- 172.21.15.18:0/501057823 wait complete. 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.219+0000 7fc9a641a740 1 -- start start 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.219+0000 7fc9a641a740 1 Processor -- start 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.220+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b84498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.221+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b843e790 0x5610b8449e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.221+0000 7fc9a641a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8441850 0x5610b843b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.221+0000 7fc9a1ddd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b84498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.221+0000 7fc9a1ddd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b84498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:45288/0 (socket says 172.21.15.18:45288) 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.221+0000 7fc9a1ddd640 1 -- 172.21.15.18:0/3177480115 learned_addr learned my addr 172.21.15.18:0/3177480115 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.221+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c1b4a70 con 0x5610b8441850 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.222+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c1b43a0 con 0x5610b8436f90 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.222+0000 7fc9a15dc640 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b843e790 0x5610b8449e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.222+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c1096f0 con 0x5610b843e790 2024-09-19T10:00:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.222+0000 7fc9a641a740 10 client.0 _ll_register_callbacks cb 0x7fc994018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.223+0000 7fc9a15dc640 1 -- 172.21.15.18:0/3177480115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 msgr2=0x5610b84498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.223+0000 7fc9a15dc640 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b84498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.223+0000 7fc9a15dc640 1 -- 172.21.15.18:0/3177480115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8441850 msgr2=0x5610b843b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.223+0000 7fc9a15dc640 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8441850 0x5610b843b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.223+0000 7fc9a15dc640 1 -- 172.21.15.18:0/3177480115 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610b844a4f0 con 0x5610b843e790 2024-09-19T10:00:47.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.225+0000 7fc9a15dc640 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b843e790 0x5610b8449e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc98c010fd0 tx=0x7fc98c097440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c7323b7c490f107 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:47.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.225+0000 7fc9857fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:47.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.225+0000 7fc9857fa640 1 -- 172.21.15.18:0/3177480115 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c09b860 con 0x5610b843e790 2024-09-19T10:00:47.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.226+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc994025070 con 0x5610b843e790 2024-09-19T10:00:47.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.226+0000 7fc9857fa640 1 -- 172.21.15.18:0/3177480115 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc98c097ed0 con 0x5610b843e790 2024-09-19T10:00:47.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.226+0000 7fc9857fa640 1 -- 172.21.15.18:0/3177480115 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc98c09fc10 con 0x5610b843e790 2024-09-19T10:00:47.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.226+0000 7fc9a641a740 10 client.26917 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:47.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.226+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5610b8442240 con 0x5610b843e790 2024-09-19T10:00:47.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.226+0000 7fc9857fa640 1 -- 172.21.15.18:0/3177480115 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc994025070 con 0x5610b843e790 2024-09-19T10:00:47.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.227+0000 7fc9857fa640 1 -- 172.21.15.18:0/3177480115 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc98c0219d0 con 0x5610b843e790 2024-09-19T10:00:47.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.227+0000 7fc9a641a740 10 client.26917 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:47.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.227+0000 7fc9a641a740 10 client.26917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:47.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.227+0000 7fc9a641a740 20 client.26917 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:47.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.227+0000 7fc9a641a740 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5610b84cd720 0x5610b84cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:47.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.227+0000 7fc9a641a740 4 client.26917 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T10:00:47.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.227+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5610b8320210 con 0x5610b84cd720 2024-09-19T10:00:47.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.227+0000 7fc9a1ddd640 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5610b84cd720 0x5610b84cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.234+0000 7fc9a1ddd640 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5610b84cd720 0x5610b84cfb10 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7cbff5ce4a72131 server_cookie=a804010a9db36611 in_seq=0 out_seq=0 2024-09-19T10:00:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.234+0000 7fc9857fa640 10 client.26917 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.238+0000 7fc9857fa640 1 -- 172.21.15.18:0/3177480115 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5610b8320210 con 0x5610b84cd720 2024-09-19T10:00:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.238+0000 7fc9857fa640 10 client.26917 handle_command_reply: tid=0 2024-09-19T10:00:47.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.238+0000 7fc9a641a740 1 client.26917 shutdown 2024-09-19T10:00:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.238+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b843e790 msgr2=0x5610b8449e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.238+0000 7fc9a641a740 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b843e790 0x5610b8449e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc98c010fd0 tx=0x7fc98c097440 comp rx=0 tx=0).stop 2024-09-19T10:00:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.239+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 shutdown_connections 2024-09-19T10:00:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.239+0000 7fc9a641a740 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5610b84cd720 0x5610b84cfb10 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.239+0000 7fc9a641a740 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5610b8441850 0x5610b843b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.239+0000 7fc9a641a740 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610b843e790 0x5610b8449e00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.239+0000 7fc9a641a740 1 --2- 172.21.15.18:0/3177480115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5610b8436f90 0x5610b84498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.239+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 >> 172.21.15.18:0/3177480115 conn(0x5610b8432c00 msgr2=0x5610b84380c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.239+0000 7fc9857fa640 0 client.26917 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.239+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 shutdown_connections 2024-09-19T10:00:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.240+0000 7fc9a641a740 1 -- 172.21.15.18:0/3177480115 wait complete. 2024-09-19T10:00:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.240+0000 7fc9a641a740 20 client.26917 trim_cache size 0 max 16384 2024-09-19T10:00:47.245 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:00:47.245 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T10:00:47.245 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T10:00:47.245 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:00:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.242+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2264518722 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9880a3200 msgr2=0x7fc9880a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.242+0000 7fc9a2ddf640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9880a3200 0x7fc9880a56c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x5610b843f890 tx=0x7fc998005fd0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.242+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2264518722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc99c110190 msgr2=0x7fc99c1a76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.242+0000 7fc9a2ddf640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc99c110190 0x7fc99c1a76c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00d950 tx=0x7fc98c00de10 comp rx=0 tx=0).stop 2024-09-19T10:00:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.243+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2264518722 shutdown_connections 2024-09-19T10:00:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.243+0000 7fc9a2ddf640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc9880a3200 0x7fc9880a56c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.243+0000 7fc9a2ddf640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc99c11b140 0x7fc99c1aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.243+0000 7fc9a2ddf640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc99c110190 0x7fc99c1a76c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.243+0000 7fc9a2ddf640 1 --2- 172.21.15.18:0/2264518722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c06ea30 0x7fc99c1a7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:47.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.243+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2264518722 >> 172.21.15.18:0/2264518722 conn(0x7fc99c073180 msgr2=0x7fc99c10e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:47.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.245+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2264518722 shutdown_connections 2024-09-19T10:00:47.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:47.245+0000 7fc9a2ddf640 1 -- 172.21.15.18:0/2264518722 wait complete. 2024-09-19T10:00:48.236 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T10:00:48.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:00:48.374 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:48 smithi018 ceph-mon[30956]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 130 MiB/s wr, 362 op/s 2024-09-19T10:00:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:48 smithi049 ceph-mon[34858]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 130 MiB/s wr, 362 op/s 2024-09-19T10:00:48.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:48 smithi162 ceph-mon[35174]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 130 MiB/s wr, 362 op/s 2024-09-19T10:00:49.241 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:49.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.915+0000 7f8827a45640 1 -- 172.21.15.18:0/2119679584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8820103d60 msgr2=0x7f8820104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.915+0000 7f8827a45640 1 --2- 172.21.15.18:0/2119679584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8820103d60 0x7f8820104160 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f881c009900 tx=0x7f881c02a410 comp rx=0 tx=0).stop 2024-09-19T10:00:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.916+0000 7f8827a45640 1 -- 172.21.15.18:0/2119679584 shutdown_connections 2024-09-19T10:00:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.916+0000 7f8827a45640 1 --2- 172.21.15.18:0/2119679584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8820105910 0x7f882010c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.916+0000 7f8827a45640 1 --2- 172.21.15.18:0/2119679584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8820104f50 0x7f88201053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.916+0000 7f8827a45640 1 --2- 172.21.15.18:0/2119679584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8820103d60 0x7f8820104160 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.916+0000 7f8827a45640 1 -- 172.21.15.18:0/2119679584 >> 172.21.15.18:0/2119679584 conn(0x7f88200ff4e0 msgr2=0x7f8820101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.916+0000 7f8827a45640 1 -- 172.21.15.18:0/2119679584 shutdown_connections 2024-09-19T10:00:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.916+0000 7f8827a45640 1 -- 172.21.15.18:0/2119679584 wait complete. 2024-09-19T10:00:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.917+0000 7f8827a45640 1 Processor -- start 2024-09-19T10:00:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.917+0000 7f8827a45640 1 -- start start 2024-09-19T10:00:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8827a45640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8820103d60 0x7f8820070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8827a45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8820104f50 0x7f8820071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8827a45640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8820105910 0x7f88201aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8827a45640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f882010fad0 con 0x7f8820104f50 2024-09-19T10:00:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8827a45640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f882010f950 con 0x7f8820103d60 2024-09-19T10:00:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8827a45640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f882010fc50 con 0x7f8820105910 2024-09-19T10:00:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8824fe0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8820104f50 0x7f8820071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8824fe0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8820104f50 0x7f8820071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37332/0 (socket says 172.21.15.18:37332) 2024-09-19T10:00:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8825fe2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8820105910 0x7f88201aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8825fe2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8820105910 0x7f88201aa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50882/0 (socket says 172.21.15.18:50882) 2024-09-19T10:00:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.918+0000 7f8825fe2640 1 -- 172.21.15.18:0/1614345130 learned_addr learned my addr 172.21.15.18:0/1614345130 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.919+0000 7f8824fe0640 1 -- 172.21.15.18:0/1614345130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8820105910 msgr2=0x7f88201aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.919+0000 7f8824fe0640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8820105910 0x7f88201aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.919+0000 7f8824fe0640 1 -- 172.21.15.18:0/1614345130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8820103d60 msgr2=0x7f8820070ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T10:00:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.919+0000 7f8824fe0640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8820103d60 0x7f8820070ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.920+0000 7f8824fe0640 1 -- 172.21.15.18:0/1614345130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88200741a0 con 0x7f8820104f50 2024-09-19T10:00:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.920+0000 7f8825fe2640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8820105910 0x7f88201aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:00:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.921+0000 7f8824fe0640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8820104f50 0x7f8820071020 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8810009fd0 tx=0x7f881000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.922+0000 7f88167fc640 1 -- 172.21.15.18:0/1614345130 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810015020 con 0x7f8820104f50 2024-09-19T10:00:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.922+0000 7f88167fc640 1 -- 172.21.15.18:0/1614345130 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8810011d10 con 0x7f8820104f50 2024-09-19T10:00:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.922+0000 7f88167fc640 1 -- 172.21.15.18:0/1614345130 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881000f2e0 con 0x7f8820104f50 2024-09-19T10:00:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.922+0000 7f8827a45640 1 -- 172.21.15.18:0/1614345130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88201aa7e0 con 0x7f8820104f50 2024-09-19T10:00:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.922+0000 7f8827a45640 1 -- 172.21.15.18:0/1614345130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88201aad30 con 0x7f8820104f50 2024-09-19T10:00:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.927+0000 7f882a7da740 1 Processor -- start 2024-09-19T10:00:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.927+0000 7f882a7da740 1 -- start start 2024-09-19T10:00:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.928+0000 7f882a7da740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 0x564941aa35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.928+0000 7f882a7da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 0x564941aa85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.928+0000 7f882a7da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa8b80 0x564941aab040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.928+0000 7f882a7da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5649419fe2f0 con 0x564941aa3af0 2024-09-19T10:00:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.928+0000 7f882a7da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5649419a6270 con 0x564941aa8b80 2024-09-19T10:00:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.928+0000 7f882a7da740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5649419fa2b0 con 0x564941aa31b0 2024-09-19T10:00:49.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.929+0000 7f8825fe2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 0x564941aa35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:49.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.929+0000 7f8825fe2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 0x564941aa35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50896/0 (socket says 172.21.15.18:50896) 2024-09-19T10:00:49.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.929+0000 7f8825fe2640 1 -- 172.21.15.18:0/1962032401 learned_addr learned my addr 172.21.15.18:0/1962032401 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:49.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.929+0000 7f88257e1640 1 --2- 172.21.15.18:0/1962032401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 0x564941aa85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.931+0000 7f8825fe2640 1 -- 172.21.15.18:0/1962032401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa8b80 msgr2=0x564941aab040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:00:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.931+0000 7f8825fe2640 1 --2- 172.21.15.18:0/1962032401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa8b80 0x564941aab040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.931+0000 7f8825fe2640 1 -- 172.21.15.18:0/1962032401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 msgr2=0x564941aa85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.931+0000 7f8825fe2640 1 --2- 172.21.15.18:0/1962032401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 0x564941aa85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.932+0000 7f8825fe2640 1 -- 172.21.15.18:0/1962032401 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649419a5340 con 0x564941aa31b0 2024-09-19T10:00:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.932+0000 7f88167fc640 1 -- 172.21.15.18:0/1614345130 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8810018020 con 0x7f8820104f50 2024-09-19T10:00:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.934+0000 7f88167fc640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f880c0a3530 0x7f880c0a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.934+0000 7f88167fc640 1 -- 172.21.15.18:0/1614345130 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f88100d0120 con 0x7f8820104f50 2024-09-19T10:00:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.935+0000 7f88257e1640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f880c0a3530 0x7f880c0a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.935+0000 7f8825fe2640 1 --2- 172.21.15.18:0/1962032401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 0x564941aa35b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f88180117e0 tx=0x7f8818011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=956cb5c052706ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:49.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.936+0000 7f88257e1640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f880c0a3530 0x7f880c0a59f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f881c031610 tx=0x7f881c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.937+0000 7f880b7fe640 1 -- 172.21.15.18:0/1962032401 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881800fac0 con 0x564941aa31b0 2024-09-19T10:00:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.937+0000 7f880b7fe640 1 -- 172.21.15.18:0/1962032401 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f881800fc60 con 0x564941aa31b0 2024-09-19T10:00:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.937+0000 7f880b7fe640 1 -- 172.21.15.18:0/1962032401 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818010630 con 0x564941aa31b0 2024-09-19T10:00:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.939+0000 7f882a7da740 1 -- 172.21.15.18:0/1962032401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 msgr2=0x564941aa35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.939+0000 7f882a7da740 1 --2- 172.21.15.18:0/1962032401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 0x564941aa35b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f88180117e0 tx=0x7f8818011ca0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.939+0000 7f882a7da740 1 -- 172.21.15.18:0/1962032401 shutdown_connections 2024-09-19T10:00:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.939+0000 7f882a7da740 1 --2- 172.21.15.18:0/1962032401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa8b80 0x564941aab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.939+0000 7f882a7da740 1 --2- 172.21.15.18:0/1962032401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 0x564941aa85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.939+0000 7f882a7da740 1 --2- 172.21.15.18:0/1962032401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 0x564941aa35b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.939+0000 7f882a7da740 1 -- 172.21.15.18:0/1962032401 >> 172.21.15.18:0/1962032401 conn(0x564941a9e820 msgr2=0x564941a9ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.939+0000 7f882a7da740 1 -- 172.21.15.18:0/1962032401 shutdown_connections 2024-09-19T10:00:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.939+0000 7f882a7da740 1 -- 172.21.15.18:0/1962032401 wait complete. 2024-09-19T10:00:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.940+0000 7f882a7da740 1 -- start start 2024-09-19T10:00:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.940+0000 7f882a7da740 1 Processor -- start 2024-09-19T10:00:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.941+0000 7f882a7da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa31b0 0x564941aad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.941+0000 7f882a7da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 0x564941aada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.941+0000 7f882a7da740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa8b80 0x564941ab4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.941+0000 7f882a7da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564941aabb50 con 0x564941aa3af0 2024-09-19T10:00:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.941+0000 7f882a7da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564941987290 con 0x564941aa31b0 2024-09-19T10:00:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.941+0000 7f882a7da740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564941aabcd0 con 0x564941aa8b80 2024-09-19T10:00:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.941+0000 7f882a7da740 10 client.0 _ll_register_callbacks cb 0x5649419b8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.942+0000 7f8824fe0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 0x564941aada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.942+0000 7f8824fe0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 0x564941aada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37344/0 (socket says 172.21.15.18:37344) 2024-09-19T10:00:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.942+0000 7f8824fe0640 1 -- 172.21.15.18:0/7492560 learned_addr learned my addr 172.21.15.18:0/7492560 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.942+0000 7f88257e1640 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa31b0 0x564941aad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.943+0000 7f8824fe0640 1 -- 172.21.15.18:0/7492560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa8b80 msgr2=0x564941ab4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.943+0000 7f8824fe0640 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa8b80 0x564941ab4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.943+0000 7f8824fe0640 1 -- 172.21.15.18:0/7492560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa31b0 msgr2=0x564941aad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.943+0000 7f8824fe0640 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa31b0 0x564941aad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.943+0000 7f8824fe0640 1 -- 172.21.15.18:0/7492560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564941711210 con 0x564941aa3af0 2024-09-19T10:00:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.944+0000 7f8824fe0640 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 0x564941aada30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f88100983f0 tx=0x7f881009c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c8c5851d1d8816 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.954+0000 7f8808ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.955+0000 7f8808ff9640 1 -- 172.21.15.18:0/7492560 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88100b4070 con 0x564941aa3af0 2024-09-19T10:00:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.955+0000 7f8808ff9640 1 -- 172.21.15.18:0/7492560 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f881009bb60 con 0x564941aa3af0 2024-09-19T10:00:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.955+0000 7f882a7da740 1 -- 172.21.15.18:0/7492560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f881800fc60 con 0x564941aa3af0 2024-09-19T10:00:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.956+0000 7f8808ff9640 1 -- 172.21.15.18:0/7492560 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f88100bb020 con 0x564941aa3af0 2024-09-19T10:00:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.957+0000 7f882a7da740 10 client.17472 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.957+0000 7f882a7da740 1 -- 172.21.15.18:0/7492560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5649417dd620 con 0x564941aa3af0 2024-09-19T10:00:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.958+0000 7f8808ff9640 1 -- 172.21.15.18:0/7492560 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f881800fc60 con 0x564941aa3af0 2024-09-19T10:00:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.959+0000 7f8808ff9640 1 -- 172.21.15.18:0/7492560 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8810098460 con 0x564941aa3af0 2024-09-19T10:00:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.960+0000 7f882a7da740 10 client.17472 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.960+0000 7f882a7da740 10 client.17472 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.960+0000 7f882a7da740 20 client.17472 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.960+0000 7f882a7da740 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564941ab9620 0x564941abba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.960+0000 7f882a7da740 4 client.17472 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.960+0000 7f882a7da740 1 -- 172.21.15.18:0/7492560 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564941a0ba20 con 0x564941ab9620 2024-09-19T10:00:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.960+0000 7f88257e1640 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564941ab9620 0x564941abba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.966+0000 7f88257e1640 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564941ab9620 0x564941abba60 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd8523e469dd1d24 server_cookie=5613c9d38200f087 in_seq=0 out_seq=0 2024-09-19T10:00:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.966+0000 7f8808ff9640 10 client.17472 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.969+0000 7f8808ff9640 1 -- 172.21.15.18:0/7492560 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564941a0ba20 con 0x564941ab9620 2024-09-19T10:00:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.969+0000 7f8808ff9640 10 client.17472 handle_command_reply: tid=0 2024-09-19T10:00:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.969+0000 7f882a7da740 1 client.17472 shutdown 2024-09-19T10:00:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.969+0000 7f882a7da740 1 -- 172.21.15.18:0/7492560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 msgr2=0x564941aada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.969+0000 7f882a7da740 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 0x564941aada30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f88100983f0 tx=0x7f881009c310 comp rx=0 tx=0).stop 2024-09-19T10:00:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.969+0000 7f882a7da740 1 -- 172.21.15.18:0/7492560 shutdown_connections 2024-09-19T10:00:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.969+0000 7f882a7da740 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564941ab9620 0x564941abba60 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.969+0000 7f882a7da740 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa8b80 0x564941ab4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.969+0000 7f882a7da740 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa3af0 0x564941aada30 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.969+0000 7f882a7da740 1 --2- 172.21.15.18:0/7492560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa31b0 0x564941aad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.970+0000 7f882a7da740 1 -- 172.21.15.18:0/7492560 >> 172.21.15.18:0/7492560 conn(0x564941a9e820 msgr2=0x564941aa0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.970+0000 7f8808ff9640 0 client.17472 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.970+0000 7f882a7da740 1 -- 172.21.15.18:0/7492560 shutdown_connections 2024-09-19T10:00:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.970+0000 7f882a7da740 1 -- 172.21.15.18:0/7492560 wait complete. 2024-09-19T10:00:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:49.970+0000 7f882a7da740 20 client.17472 trim_cache size 0 max 16384 2024-09-19T10:00:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.006+0000 7f882a7da740 1 Processor -- start 2024-09-19T10:00:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.006+0000 7f882a7da740 1 -- start start 2024-09-19T10:00:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.007+0000 7f882a7da740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 0x564941a9ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.007+0000 7f882a7da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa3af0 0x564941ab4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.007+0000 7f882a7da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa8b80 0x564941a9f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.008+0000 7f8824fe0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa3af0 0x564941ab4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.008+0000 7f8824fe0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa3af0 0x564941ab4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:45328/0 (socket says 172.21.15.18:45328) 2024-09-19T10:00:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.008+0000 7f8824fe0640 1 -- 172.21.15.18:0/72163180 learned_addr learned my addr 172.21.15.18:0/72163180 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.008+0000 7f882a7da740 1 -- 172.21.15.18:0/72163180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f880400e340 con 0x564941aa8b80 2024-09-19T10:00:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.008+0000 7f88257e1640 1 --2- 172.21.15.18:0/72163180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 0x564941a9ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.008+0000 7f882a7da740 1 -- 172.21.15.18:0/72163180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f880400fe80 con 0x564941aa3af0 2024-09-19T10:00:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.008+0000 7f882a7da740 1 -- 172.21.15.18:0/72163180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f880400ea10 con 0x564941aa31b0 2024-09-19T10:00:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.010+0000 7f8825fe2640 1 --2- 172.21.15.18:0/72163180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa8b80 0x564941a9f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.010+0000 7f8824fe0640 1 -- 172.21.15.18:0/72163180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 msgr2=0x564941a9ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.010+0000 7f8824fe0640 1 --2- 172.21.15.18:0/72163180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 0x564941a9ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.010+0000 7f8824fe0640 1 -- 172.21.15.18:0/72163180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa8b80 msgr2=0x564941a9f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.010+0000 7f8824fe0640 1 --2- 172.21.15.18:0/72163180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa8b80 0x564941a9f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.010+0000 7f8824fe0640 1 -- 172.21.15.18:0/72163180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564941aa3fd0 con 0x564941aa3af0 2024-09-19T10:00:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.012+0000 7f8824fe0640 1 --2- 172.21.15.18:0/72163180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa3af0 0x564941ab4a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8810098800 tx=0x7f88100982f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e802a967ed78f02f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.013+0000 7f880affd640 1 -- 172.21.15.18:0/72163180 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88100b4070 con 0x564941aa3af0 2024-09-19T10:00:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.013+0000 7f880affd640 1 -- 172.21.15.18:0/72163180 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f881009c710 con 0x564941aa3af0 2024-09-19T10:00:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.015+0000 7f882a7da740 1 -- 172.21.15.18:0/72163180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa3af0 msgr2=0x564941ab4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.015+0000 7f882a7da740 1 --2- 172.21.15.18:0/72163180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa3af0 0x564941ab4a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8810098800 tx=0x7f88100982f0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.015+0000 7f882a7da740 1 -- 172.21.15.18:0/72163180 shutdown_connections 2024-09-19T10:00:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.015+0000 7f882a7da740 1 --2- 172.21.15.18:0/72163180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa8b80 0x564941a9f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.015+0000 7f882a7da740 1 --2- 172.21.15.18:0/72163180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa3af0 0x564941ab4a30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.015+0000 7f882a7da740 1 --2- 172.21.15.18:0/72163180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941aa31b0 0x564941a9ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.015+0000 7f882a7da740 1 -- 172.21.15.18:0/72163180 >> 172.21.15.18:0/72163180 conn(0x564941a9e820 msgr2=0x564941aa4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.017+0000 7f882a7da740 1 -- 172.21.15.18:0/72163180 shutdown_connections 2024-09-19T10:00:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.017+0000 7f882a7da740 1 -- 172.21.15.18:0/72163180 wait complete. 2024-09-19T10:00:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.018+0000 7f882a7da740 1 -- start start 2024-09-19T10:00:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.018+0000 7f882a7da740 1 Processor -- start 2024-09-19T10:00:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.019+0000 7f882a7da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa31b0 0x564941ab16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.019+0000 7f882a7da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa8b80 0x564941ab1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.019+0000 7f882a7da740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941b20320 0x564941b22710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.019+0000 7f882a7da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f880400f7b0 con 0x564941aa31b0 2024-09-19T10:00:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.019+0000 7f882a7da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f880400f0e0 con 0x564941aa8b80 2024-09-19T10:00:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.019+0000 7f882a7da740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f880400c3d0 con 0x564941b20320 2024-09-19T10:00:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.019+0000 7f882a7da740 10 client.0 _ll_register_callbacks cb 0x7f8810098a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.020+0000 7f88257e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa31b0 0x564941ab16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:50.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.020+0000 7f88257e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa31b0 0x564941ab16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37356/0 (socket says 172.21.15.18:37356) 2024-09-19T10:00:50.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.020+0000 7f88257e1640 1 -- 172.21.15.18:0/255363426 learned_addr learned my addr 172.21.15.18:0/255363426 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:50.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.020+0000 7f8824fe0640 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa8b80 0x564941ab1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:50.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.020+0000 7f8825fe2640 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941b20320 0x564941b22710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:50.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.021+0000 7f88257e1640 1 -- 172.21.15.18:0/255363426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941b20320 msgr2=0x564941b22710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:50.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.021+0000 7f88257e1640 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941b20320 0x564941b22710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.021+0000 7f88257e1640 1 -- 172.21.15.18:0/255363426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa8b80 msgr2=0x564941ab1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:50.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.021+0000 7f88257e1640 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa8b80 0x564941ab1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.021+0000 7f88257e1640 1 -- 172.21.15.18:0/255363426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564941ab4d10 con 0x564941aa31b0 2024-09-19T10:00:50.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.021+0000 7f88257e1640 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa31b0 0x564941ab16e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f881c005ab0 tx=0x7f881c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85b3e0e5b24da85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:50.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.021+0000 7f8808ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:00:50.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.022+0000 7f8808ff9640 1 -- 172.21.15.18:0/255363426 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c035040 con 0x564941aa31b0 2024-09-19T10:00:50.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.022+0000 7f882a7da740 1 -- 172.21.15.18:0/255363426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564941a05d70 con 0x564941aa31b0 2024-09-19T10:00:50.025 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.022+0000 7f8808ff9640 1 -- 172.21.15.18:0/255363426 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f881c005480 con 0x564941aa31b0 2024-09-19T10:00:50.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.023+0000 7f8808ff9640 1 -- 172.21.15.18:0/255363426 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f881c061070 con 0x564941aa31b0 2024-09-19T10:00:50.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.023+0000 7f882a7da740 10 client.17478 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:50.026 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.023+0000 7f882a7da740 1 -- 172.21.15.18:0/255363426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564941a96c00 con 0x564941aa31b0 2024-09-19T10:00:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.024+0000 7f8808ff9640 1 -- 172.21.15.18:0/255363426 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564941a05d70 con 0x564941aa31b0 2024-09-19T10:00:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.025+0000 7f8808ff9640 1 -- 172.21.15.18:0/255363426 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f881c032a60 con 0x564941aa31b0 2024-09-19T10:00:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.025+0000 7f882a7da740 10 client.17478 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.025+0000 7f882a7da740 10 client.17478 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:00:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.025+0000 7f882a7da740 20 client.17478 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.025+0000 7f882a7da740 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564941a97630 0x564941a99a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.025+0000 7f882a7da740 4 client.17478 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:00:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.025+0000 7f882a7da740 1 -- 172.21.15.18:0/255363426 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564941982900 con 0x564941a97630 2024-09-19T10:00:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.025+0000 7f8824fe0640 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564941a97630 0x564941a99a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:50.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.028+0000 7f8808ff9640 10 client.17478 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:50.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:50.028+0000 7f8824fe0640 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564941a97630 0x564941a99a50 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00d64d55e7b7a0e server_cookie=9b0a63dc221d1dd1 in_seq=0 out_seq=0 2024-09-19T10:00:50.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.276+0000 7f9516f66640 1 -- 172.21.15.18:0/933873741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9510110220 msgr2=0x7f951006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:50.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.276+0000 7f9516f66640 1 --2- 172.21.15.18:0/933873741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9510110220 0x7f951006e4f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f9508009ca0 tx=0x7f950802a8f0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.280 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:50 smithi018 ceph-mon[30956]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 186 MiB/s wr, 563 op/s 2024-09-19T10:00:50.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.281+0000 7f9516f66640 1 -- 172.21.15.18:0/933873741 shutdown_connections 2024-09-19T10:00:50.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.281+0000 7f9516f66640 1 --2- 172.21.15.18:0/933873741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f951011b140 0x7f951011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.281+0000 7f9516f66640 1 --2- 172.21.15.18:0/933873741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f951006ea30 0x7f951006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.281+0000 7f9516f66640 1 --2- 172.21.15.18:0/933873741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9510110220 0x7f951006e4f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.281+0000 7f9516f66640 1 -- 172.21.15.18:0/933873741 >> 172.21.15.18:0/933873741 conn(0x7f9510073210 msgr2=0x7f9510073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.283+0000 7f9516f66640 1 -- 172.21.15.18:0/933873741 shutdown_connections 2024-09-19T10:00:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.283+0000 7f9516f66640 1 -- 172.21.15.18:0/933873741 wait complete. 2024-09-19T10:00:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.284+0000 7f9516f66640 1 Processor -- start 2024-09-19T10:00:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.285+0000 7f9516f66640 1 -- start start 2024-09-19T10:00:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.286+0000 7f9516f66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f951006ea30 0x7f95101196e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.286+0000 7f9516f66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9510110220 0x7f9510112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.286+0000 7f9516f66640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f951011b140 0x7f9510112cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.286+0000 7f9516f66640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9510120d60 con 0x7f951011b140 2024-09-19T10:00:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.286+0000 7f9516f66640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9510120be0 con 0x7f9510110220 2024-09-19T10:00:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.286+0000 7f9516f66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9510120ee0 con 0x7f951006ea30 2024-09-19T10:00:50.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.299+0000 7f950ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9510110220 0x7f9510112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.299+0000 7f9514d02640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f951006ea30 0x7f95101196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.299+0000 7f9514d02640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f951006ea30 0x7f95101196e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50942/0 (socket says 172.21.15.18:50942) 2024-09-19T10:00:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.299+0000 7f9514d02640 1 -- 172.21.15.18:0/3772409923 learned_addr learned my addr 172.21.15.18:0/3772409923 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.301+0000 7f9514d02640 1 -- 172.21.15.18:0/3772409923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9510110220 msgr2=0x7f9510112770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.302+0000 7f9514d02640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9510110220 0x7f9510112770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.302+0000 7f9514d02640 1 -- 172.21.15.18:0/3772409923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f951011b140 msgr2=0x7f9510112cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.302+0000 7f9514d02640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f951011b140 0x7f9510112cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.302+0000 7f9514d02640 1 -- 172.21.15.18:0/3772409923 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9510113270 con 0x7f951006ea30 2024-09-19T10:00:50.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.307+0000 7f9514d02640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f951006ea30 0x7f95101196e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9508006010 tx=0x7f9508030870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:50.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.310+0000 7f950dffb640 1 -- 172.21.15.18:0/3772409923 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508030df0 con 0x7f951006ea30 2024-09-19T10:00:50.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.311+0000 7f950dffb640 1 -- 172.21.15.18:0/3772409923 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f950802d070 con 0x7f951006ea30 2024-09-19T10:00:50.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.311+0000 7f9516f66640 1 -- 172.21.15.18:0/3772409923 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9510113500 con 0x7f951006ea30 2024-09-19T10:00:50.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.311+0000 7f9516f66640 1 -- 172.21.15.18:0/3772409923 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95101174f0 con 0x7f951006ea30 2024-09-19T10:00:50.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.314+0000 7f950dffb640 1 -- 172.21.15.18:0/3772409923 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950803b830 con 0x7f951006ea30 2024-09-19T10:00:50.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.316+0000 7f94f77fe640 1 -- 172.21.15.18:0/3772409923 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94fc0052c0 con 0x7f951006ea30 2024-09-19T10:00:50.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.321+0000 7f950dffb640 1 -- 172.21.15.18:0/3772409923 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9508004b40 con 0x7f951006ea30 2024-09-19T10:00:50.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.323+0000 7f950dffb640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94f80a3380 0x7f94f80a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:50.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.323+0000 7f950dffb640 1 -- 172.21.15.18:0/3772409923 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f95080f1230 con 0x7f951006ea30 2024-09-19T10:00:50.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.324+0000 7f950ffff640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94f80a3380 0x7f94f80a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:50.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.325+0000 7f950ffff640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94f80a3380 0x7f94f80a5840 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9510113f30 tx=0x7f950000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:50.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.329+0000 7f950dffb640 1 -- 172.21.15.18:0/3772409923 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f950804b060 con 0x7f951006ea30 2024-09-19T10:00:50.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:50 smithi049 ceph-mon[34858]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 186 MiB/s wr, 563 op/s 2024-09-19T10:00:50.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:50 smithi162 ceph-mon[35174]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 186 MiB/s wr, 563 op/s 2024-09-19T10:00:50.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.878+0000 7f94f77fe640 1 -- 172.21.15.18:0/3772409923 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94fc0055b0 con 0x7f951006ea30 2024-09-19T10:00:50.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.882+0000 7f950dffb640 1 -- 172.21.15.18:0/3772409923 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f95080bdf20 con 0x7f951006ea30 2024-09-19T10:00:50.886 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:00:50.887 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:00:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.891+0000 7f94f77fe640 1 -- 172.21.15.18:0/3772409923 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94f80a3380 msgr2=0x7f94f80a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.891+0000 7f94f77fe640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94f80a3380 0x7f94f80a5840 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9510113f30 tx=0x7f950000a2d0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.891+0000 7f94f77fe640 1 -- 172.21.15.18:0/3772409923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f951006ea30 msgr2=0x7f95101196e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.891+0000 7f94f77fe640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f951006ea30 0x7f95101196e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9508006010 tx=0x7f9508030870 comp rx=0 tx=0).stop 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.892+0000 7f94f77fe640 1 -- 172.21.15.18:0/3772409923 shutdown_connections 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.892+0000 7f94f77fe640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94f80a3380 0x7f94f80a5840 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.892+0000 7f94f77fe640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f951011b140 0x7f9510112cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.892+0000 7f94f77fe640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9510110220 0x7f9510112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.893+0000 7f94f77fe640 1 --2- 172.21.15.18:0/3772409923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f951006ea30 0x7f95101196e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.893+0000 7f94f77fe640 1 -- 172.21.15.18:0/3772409923 >> 172.21.15.18:0/3772409923 conn(0x7f9510073210 msgr2=0x7f951006b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.893+0000 7f94f77fe640 1 -- 172.21.15.18:0/3772409923 shutdown_connections 2024-09-19T10:00:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:50.893+0000 7f94f77fe640 1 -- 172.21.15.18:0/3772409923 wait complete. 2024-09-19T10:00:52.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:52 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3772409923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:52.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T10:00:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:52 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3772409923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:52 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3772409923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:00:53.229 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:53.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:53 smithi018 ceph-mon[30956]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 296 MiB/s wr, 928 op/s 2024-09-19T10:00:53.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:53 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:00:53.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:53 smithi049 ceph-mon[34858]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 296 MiB/s wr, 928 op/s 2024-09-19T10:00:53.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:53 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:00:53.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:53 smithi162 ceph-mon[35174]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 296 MiB/s wr, 928 op/s 2024-09-19T10:00:53.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:53 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:00:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.060+0000 7fa4bb95e640 1 -- 172.21.15.18:0/3748691659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b406ea30 msgr2=0x7fa4b406ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.060+0000 7fa4bb95e640 1 --2- 172.21.15.18:0/3748691659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b406ea30 0x7fa4b406ee90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009860 tx=0x7fa4b002a380 comp rx=0 tx=0).stop 2024-09-19T10:00:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.061+0000 7fa4bb95e640 1 -- 172.21.15.18:0/3748691659 shutdown_connections 2024-09-19T10:00:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.061+0000 7fa4bb95e640 1 --2- 172.21.15.18:0/3748691659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4b411b140 0x7fa4b411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.061+0000 7fa4bb95e640 1 --2- 172.21.15.18:0/3748691659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b406ea30 0x7fa4b406ee90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.061+0000 7fa4bb95e640 1 --2- 172.21.15.18:0/3748691659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4b4110220 0x7fa4b406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.061+0000 7fa4bb95e640 1 -- 172.21.15.18:0/3748691659 >> 172.21.15.18:0/3748691659 conn(0x7fa4b4073210 msgr2=0x7fa4b4073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.061+0000 7fa4bb95e640 1 -- 172.21.15.18:0/3748691659 shutdown_connections 2024-09-19T10:00:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.061+0000 7fa4bb95e640 1 -- 172.21.15.18:0/3748691659 wait complete. 2024-09-19T10:00:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.062+0000 7fa4bb95e640 1 Processor -- start 2024-09-19T10:00:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.063+0000 7fa4bb95e640 1 -- start start 2024-09-19T10:00:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.063+0000 7fa4bb95e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4b4110220 0x7fa4b41a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.063+0000 7fa4bb95e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4b411b140 0x7fa4b41a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.063+0000 7fa4bb95e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b41ab830 0x7fa4b41abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.063+0000 7fa4bb95e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b4120d20 con 0x7fa4b411b140 2024-09-19T10:00:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.063+0000 7fa4bb95e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b4120ba0 con 0x7fa4b4110220 2024-09-19T10:00:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.063+0000 7fa4bb95e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b4120ea0 con 0x7fa4b41ab830 2024-09-19T10:00:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.064+0000 7fa4b8ef9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4b411b140 0x7fa4b41a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.064+0000 7fa4b8ef9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4b411b140 0x7fa4b41a74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37390/0 (socket says 172.21.15.18:37390) 2024-09-19T10:00:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.064+0000 7fa4b8ef9640 1 -- 172.21.15.18:0/2609261123 learned_addr learned my addr 172.21.15.18:0/2609261123 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.064+0000 7fa4b96fa640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4b4110220 0x7fa4b41a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.066+0000 7fa4b96fa640 1 -- 172.21.15.18:0/2609261123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b41ab830 msgr2=0x7fa4b41abce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T10:00:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.066+0000 7fa4b96fa640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b41ab830 0x7fa4b41abce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.066+0000 7fa4b96fa640 1 -- 172.21.15.18:0/2609261123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4b411b140 msgr2=0x7fa4b41a74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.066+0000 7fa4b96fa640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4b411b140 0x7fa4b41a74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.066+0000 7fa4b96fa640 1 -- 172.21.15.18:0/2609261123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b41ac380 con 0x7fa4b4110220 2024-09-19T10:00:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.067+0000 7fa4b96fa640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4b4110220 0x7fa4b41a6f60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00eb00 tx=0x7fa4ac00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.068+0000 7fa4aa7fc640 1 -- 172.21.15.18:0/2609261123 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac010430 con 0x7fa4b4110220 2024-09-19T10:00:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.068+0000 7fa4aa7fc640 1 -- 172.21.15.18:0/2609261123 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4ac010ab0 con 0x7fa4b4110220 2024-09-19T10:00:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.068+0000 7fa4aa7fc640 1 -- 172.21.15.18:0/2609261123 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac017b70 con 0x7fa4b4110220 2024-09-19T10:00:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.069+0000 7fa4bb95e640 1 -- 172.21.15.18:0/2609261123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b41ac670 con 0x7fa4b4110220 2024-09-19T10:00:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.069+0000 7fa4bb95e640 1 -- 172.21.15.18:0/2609261123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b4110c40 con 0x7fa4b4110220 2024-09-19T10:00:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.077+0000 7fa4bdd37740 1 Processor -- start 2024-09-19T10:00:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.080+0000 7fa4bdd37740 1 -- start start 2024-09-19T10:00:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.081+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d940cf0 0x55ed2d93f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.081+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d93f780 0x55ed2d93fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.082+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 0x55ed2d94c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.082+0000 7fa4bdd37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ed2d8a52f0 con 0x55ed2d94a520 2024-09-19T10:00:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.082+0000 7fa4bdd37740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ed2d84ccf0 con 0x55ed2d940cf0 2024-09-19T10:00:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.082+0000 7fa4b9efb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d940cf0 0x55ed2d93f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.082+0000 7fa4b9efb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d940cf0 0x55ed2d93f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:45400/0 (socket says 172.21.15.18:45400) 2024-09-19T10:00:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.082+0000 7fa4b9efb640 1 -- 172.21.15.18:0/3479035028 learned_addr learned my addr 172.21.15.18:0/3479035028 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.082+0000 7fa4bdd37740 1 -- 172.21.15.18:0/3479035028 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ed2d8a12b0 con 0x55ed2d93f780 2024-09-19T10:00:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.082+0000 7fa4aa7fc640 1 -- 172.21.15.18:0/2609261123 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa4ac017d10 con 0x7fa4b4110220 2024-09-19T10:00:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.083+0000 7fa4b8ef9640 1 --2- 172.21.15.18:0/3479035028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 0x55ed2d94c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.084+0000 7fa4b9efb640 1 -- 172.21.15.18:0/3479035028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d93f780 msgr2=0x55ed2d93fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.084+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/3479035028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d93f780 0x55ed2d93fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.084+0000 7fa4b9efb640 1 -- 172.21.15.18:0/3479035028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 msgr2=0x55ed2d94c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.084+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/3479035028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 0x55ed2d94c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.084+0000 7fa4b9efb640 1 -- 172.21.15.18:0/3479035028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed2d8313a0 con 0x55ed2d940cf0 2024-09-19T10:00:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.085+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/3479035028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d940cf0 0x55ed2d93f240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009a30 tx=0x7fa4a4009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e15025cc24860a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.086+0000 7fa4aa7fc640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa4a00a3450 0x7fa4a00a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.086+0000 7fa49f7fe640 1 -- 172.21.15.18:0/3479035028 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400ec30 con 0x55ed2d940cf0 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.086+0000 7fa49f7fe640 1 -- 172.21.15.18:0/3479035028 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4a400edd0 con 0x55ed2d940cf0 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.086+0000 7fa49f7fe640 1 -- 172.21.15.18:0/3479035028 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4010690 con 0x55ed2d940cf0 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.088+0000 7fa4b96fa640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa4a00a3450 0x7fa4a00a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.089+0000 7fa4bdd37740 1 -- 172.21.15.18:0/3479035028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d940cf0 msgr2=0x55ed2d93f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.089+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/3479035028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d940cf0 0x55ed2d93f240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009a30 tx=0x7fa4a4009ef0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.090+0000 7fa4aa7fc640 1 -- 172.21.15.18:0/2609261123 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa4ac0d06d0 con 0x7fa4b4110220 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.090+0000 7fa4bdd37740 1 -- 172.21.15.18:0/3479035028 shutdown_connections 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.090+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/3479035028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 0x55ed2d94c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.090+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/3479035028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d93f780 0x55ed2d93fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.090+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/3479035028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d940cf0 0x55ed2d93f240 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.090+0000 7fa4bdd37740 1 -- 172.21.15.18:0/3479035028 >> 172.21.15.18:0/3479035028 conn(0x55ed2d908310 msgr2=0x55ed2d93be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:54.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.091+0000 7fa4bdd37740 1 -- 172.21.15.18:0/3479035028 shutdown_connections 2024-09-19T10:00:54.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.091+0000 7fa4bdd37740 1 -- 172.21.15.18:0/3479035028 wait complete. 2024-09-19T10:00:54.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.092+0000 7fa4bdd37740 1 -- start start 2024-09-19T10:00:54.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.092+0000 7fa4bdd37740 1 Processor -- start 2024-09-19T10:00:54.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.094+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d93f780 0x55ed2d949f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.094+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 0x55ed2d947220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.094+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 0x55ed2d9479b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.095+0000 7fa4b9efb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 0x55ed2d9479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.096+0000 7fa4b9efb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d93f780 0x55ed2d949f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.096+0000 7fa4b9efb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 0x55ed2d9479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37408/0 (socket says 172.21.15.18:37408) 2024-09-19T10:00:54.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.096+0000 7fa4b9efb640 1 -- 172.21.15.18:0/461502555 learned_addr learned my addr 172.21.15.18:0/461502555 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:54.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.096+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ed2d94d220 con 0x55ed2d94a520 2024-09-19T10:00:54.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.096+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ed2d860060 con 0x55ed2d93f780 2024-09-19T10:00:54.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.096+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ed2d94d3a0 con 0x55ed2d940cf0 2024-09-19T10:00:54.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.096+0000 7fa4bdd37740 10 client.0 _ll_register_callbacks cb 0x55ed2d5b38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:54.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.096+0000 7fa4b8ef9640 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 0x55ed2d947220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.098+0000 7fa4b96fa640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa4a00a3450 0x7fa4a00a5910 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0176e0 tx=0x7fa4ac0107c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:54.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.100+0000 7fa4b8ef9640 1 -- 172.21.15.18:0/461502555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d93f780 msgr2=0x55ed2d949f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:54.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.100+0000 7fa4b8ef9640 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d93f780 0x55ed2d949f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.100+0000 7fa4b8ef9640 1 -- 172.21.15.18:0/461502555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 msgr2=0x55ed2d9479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:54.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.100+0000 7fa4b8ef9640 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 0x55ed2d9479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.100+0000 7fa4b8ef9640 1 -- 172.21.15.18:0/461502555 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed2d6163c0 con 0x55ed2d940cf0 2024-09-19T10:00:54.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.102+0000 7fa4b8ef9640 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 0x55ed2d947220 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0000c00 tx=0x7fa4b0030ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f52d799da4648da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:54.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.102+0000 7fa49cff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:54.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.123+0000 7fa49cff9640 1 -- 172.21.15.18:0/461502555 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0037040 con 0x55ed2d940cf0 2024-09-19T10:00:54.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.124+0000 7fa49cff9640 1 -- 172.21.15.18:0/461502555 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa4b0030680 con 0x55ed2d940cf0 2024-09-19T10:00:54.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.124+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4a400edd0 con 0x55ed2d940cf0 2024-09-19T10:00:54.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.124+0000 7fa49cff9640 1 -- 172.21.15.18:0/461502555 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4b0004040 con 0x55ed2d940cf0 2024-09-19T10:00:54.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.125+0000 7fa4bdd37740 10 client.26941 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:54.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.125+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ed2d958da0 con 0x55ed2d940cf0 2024-09-19T10:00:54.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.126+0000 7fa49cff9640 1 -- 172.21.15.18:0/461502555 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4b0005510 con 0x55ed2d940cf0 2024-09-19T10:00:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.126+0000 7fa49cff9640 1 -- 172.21.15.18:0/461502555 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4b0045030 con 0x55ed2d940cf0 2024-09-19T10:00:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.126+0000 7fa4bdd37740 10 client.26941 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.126+0000 7fa4bdd37740 10 client.26941 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T10:00:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.126+0000 7fa4bdd37740 20 client.26941 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.126+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55ed2d95a320 0x55ed2d95c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.126+0000 7fa4bdd37740 4 client.26941 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.126+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa4a400edd0 con 0x55ed2d95a320 2024-09-19T10:00:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.127+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55ed2d95a320 0x55ed2d95c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.127+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55ed2d95a320 0x55ed2d95c740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=45108bcdee5420fd server_cookie=1286036e6e7ede18 in_seq=0 out_seq=0 2024-09-19T10:00:54.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.127+0000 7fa49cff9640 10 client.26941 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T10:00:54.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.129+0000 7fa49cff9640 1 -- 172.21.15.18:0/461502555 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa4a400edd0 con 0x55ed2d95a320 2024-09-19T10:00:54.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.129+0000 7fa49cff9640 10 client.26941 handle_command_reply: tid=0 2024-09-19T10:00:54.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.129+0000 7fa4bdd37740 1 client.26941 shutdown 2024-09-19T10:00:54.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.130+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 msgr2=0x55ed2d947220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:54.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.130+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 0x55ed2d947220 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0000c00 tx=0x7fa4b0030ad0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.130+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 shutdown_connections 2024-09-19T10:00:54.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.130+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55ed2d95a320 0x55ed2d95c740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.130+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d94a520 0x55ed2d9479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.130+0000 7fa49cff9640 0 client.26941 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T10:00:54.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.130+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 0x55ed2d947220 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.130+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/461502555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d93f780 0x55ed2d949f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.130+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 >> 172.21.15.18:0/461502555 conn(0x55ed2d908310 msgr2=0x55ed2d941ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:54.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.131+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 shutdown_connections 2024-09-19T10:00:54.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.131+0000 7fa4bdd37740 1 -- 172.21.15.18:0/461502555 wait complete. 2024-09-19T10:00:54.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.131+0000 7fa4bdd37740 20 client.26941 trim_cache size 0 max 16384 2024-09-19T10:00:54.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.167+0000 7fa4bdd37740 1 Processor -- start 2024-09-19T10:00:54.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.167+0000 7fa4bdd37740 1 -- start start 2024-09-19T10:00:54.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.168+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d93f780 0x55ed2d946200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.168+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 0x55ed2d9422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.168+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d94a520 0x55ed2d942810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.168+0000 7fa4bdd37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa49800e380 con 0x55ed2d93f780 2024-09-19T10:00:54.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.168+0000 7fa4bdd37740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa49800fec0 con 0x55ed2d94a520 2024-09-19T10:00:54.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.168+0000 7fa4bdd37740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa49800ea50 con 0x55ed2d940cf0 2024-09-19T10:00:54.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.168+0000 7fa4b9efb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d93f780 0x55ed2d946200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.168+0000 7fa4b9efb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d93f780 0x55ed2d946200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37414/0 (socket says 172.21.15.18:37414) 2024-09-19T10:00:54.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.168+0000 7fa4b9efb640 1 -- 172.21.15.18:0/399714436 learned_addr learned my addr 172.21.15.18:0/399714436 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.168+0000 7fa4b8ef9640 1 --2- 172.21.15.18:0/399714436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 0x55ed2d9422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.169+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/399714436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d94a520 0x55ed2d942810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.169+0000 7fa4b9efb640 1 -- 172.21.15.18:0/399714436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 msgr2=0x55ed2d9422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.169+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/399714436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 0x55ed2d9422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.169+0000 7fa4b9efb640 1 -- 172.21.15.18:0/399714436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d94a520 msgr2=0x55ed2d942810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.169+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/399714436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d94a520 0x55ed2d942810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.170+0000 7fa4b9efb640 1 -- 172.21.15.18:0/399714436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed2d947d20 con 0x55ed2d93f780 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.170+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/399714436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d93f780 0x55ed2d946200 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4004c40 tx=0x7fa4a4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61fbabe51bb78bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.170+0000 7fa49effd640 1 -- 172.21.15.18:0/399714436 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a401d040 con 0x55ed2d93f780 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.171+0000 7fa49effd640 1 -- 172.21.15.18:0/399714436 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4a401e040 con 0x55ed2d93f780 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.171+0000 7fa49effd640 1 -- 172.21.15.18:0/399714436 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4003c50 con 0x55ed2d93f780 2024-09-19T10:00:54.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.172+0000 7fa4bdd37740 1 -- 172.21.15.18:0/399714436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d93f780 msgr2=0x55ed2d946200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:54.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.172+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/399714436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d93f780 0x55ed2d946200 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4004c40 tx=0x7fa4a4000bc0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.173+0000 7fa4bdd37740 1 -- 172.21.15.18:0/399714436 shutdown_connections 2024-09-19T10:00:54.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.173+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/399714436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d94a520 0x55ed2d942810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.173+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/399714436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d940cf0 0x55ed2d9422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.173+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/399714436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d93f780 0x55ed2d946200 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.173+0000 7fa4bdd37740 1 -- 172.21.15.18:0/399714436 >> 172.21.15.18:0/399714436 conn(0x55ed2d908310 msgr2=0x55ed2d945af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:54.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.173+0000 7fa4bdd37740 1 -- 172.21.15.18:0/399714436 shutdown_connections 2024-09-19T10:00:54.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.173+0000 7fa4bdd37740 1 -- 172.21.15.18:0/399714436 wait complete. 2024-09-19T10:00:54.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.174+0000 7fa4bdd37740 1 -- start start 2024-09-19T10:00:54.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.174+0000 7fa4bdd37740 1 Processor -- start 2024-09-19T10:00:54.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.176+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d93f780 0x55ed2d952af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.176+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d940cf0 0x55ed2d94de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.176+0000 7fa4bdd37740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d94a520 0x55ed2d94e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.176+0000 7fa4bdd37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa49800f7f0 con 0x55ed2d940cf0 2024-09-19T10:00:54.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.176+0000 7fa4bdd37740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa49800f120 con 0x55ed2d93f780 2024-09-19T10:00:54.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.176+0000 7fa4bdd37740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa49800c360 con 0x55ed2d94a520 2024-09-19T10:00:54.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.177+0000 7fa4b9efb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d94a520 0x55ed2d94e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.177+0000 7fa4b9efb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d94a520 0x55ed2d94e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50992/0 (socket says 172.21.15.18:50992) 2024-09-19T10:00:54.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.177+0000 7fa4b9efb640 1 -- 172.21.15.18:0/4006573474 learned_addr learned my addr 172.21.15.18:0/4006573474 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:54.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.177+0000 7fa4b8ef9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d940cf0 0x55ed2d94de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.178+0000 7fa4bdd37740 10 client.0 _ll_register_callbacks cb 0x7fa4a4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:54.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.178+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d93f780 0x55ed2d952af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.178+0000 7fa4b9efb640 1 -- 172.21.15.18:0/4006573474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d93f780 msgr2=0x55ed2d952af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:54.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.178+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d93f780 0x55ed2d952af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.178+0000 7fa4b9efb640 1 -- 172.21.15.18:0/4006573474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d940cf0 msgr2=0x55ed2d94de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:54.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.178+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d940cf0 0x55ed2d94de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.178+0000 7fa4b9efb640 1 -- 172.21.15.18:0/4006573474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed2d94e8a0 con 0x55ed2d94a520 2024-09-19T10:00:54.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.179+0000 7fa4b9efb640 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d94a520 0x55ed2d94e360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40047c0 tx=0x7fa4a401a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e599e95a21000bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:54.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.180+0000 7fa49cff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:54.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.180+0000 7fa49cff9640 1 -- 172.21.15.18:0/4006573474 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4053640 con 0x55ed2d94a520 2024-09-19T10:00:54.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.180+0000 7fa49cff9640 1 -- 172.21.15.18:0/4006573474 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa4a40537e0 con 0x55ed2d94a520 2024-09-19T10:00:54.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.180+0000 7fa4bdd37740 1 -- 172.21.15.18:0/4006573474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4a401e040 con 0x55ed2d94a520 2024-09-19T10:00:54.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.182+0000 7fa49cff9640 1 -- 172.21.15.18:0/4006573474 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4a4065050 con 0x55ed2d94a520 2024-09-19T10:00:54.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.182+0000 7fa4bdd37740 10 client.26947 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:54.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.182+0000 7fa4bdd37740 1 -- 172.21.15.18:0/4006573474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ed2d9c4c70 con 0x55ed2d94a520 2024-09-19T10:00:54.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.183+0000 7fa49cff9640 1 -- 172.21.15.18:0/4006573474 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4a4028440 con 0x55ed2d94a520 2024-09-19T10:00:54.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.183+0000 7fa49cff9640 1 -- 172.21.15.18:0/4006573474 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4a4051020 con 0x55ed2d94a520 2024-09-19T10:00:54.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.183+0000 7fa4bdd37740 10 client.26947 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:54.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.183+0000 7fa4bdd37740 10 client.26947 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T10:00:54.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.183+0000 7fa4bdd37740 20 client.26947 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:54.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.183+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55ed2d9c50a0 0x55ed2d9c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:54.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.184+0000 7fa4bdd37740 4 client.26947 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:00:54.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.184+0000 7fa4bdd37740 1 -- 172.21.15.18:0/4006573474 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa4a401e040 con 0x55ed2d9c50a0 2024-09-19T10:00:54.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.184+0000 7fa4b8ef9640 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55ed2d9c50a0 0x55ed2d9c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:54.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.185+0000 7fa4b8ef9640 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55ed2d9c50a0 0x55ed2d9c7490 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=62811f3c8c50aa46 server_cookie=a03f9441db4110ff in_seq=0 out_seq=0 2024-09-19T10:00:54.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.185+0000 7fa49cff9640 10 client.26947 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T10:00:54.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.186+0000 7fa49cff9640 1 -- 172.21.15.18:0/4006573474 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa4b00046c0 con 0x55ed2d9c50a0 2024-09-19T10:00:54.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.186+0000 7fa49cff9640 10 client.26947 handle_command_reply: tid=0 2024-09-19T10:00:54.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.186+0000 7fa4bdd37740 1 client.26947 shutdown 2024-09-19T10:00:54.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.201+0000 7fa4bdd37740 1 -- 172.21.15.18:0/4006573474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d94a520 msgr2=0x55ed2d94e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:54.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.201+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d94a520 0x55ed2d94e360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40047c0 tx=0x7fa4a401a040 comp rx=0 tx=0).stop 2024-09-19T10:00:54.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.201+0000 7fa4bdd37740 1 -- 172.21.15.18:0/4006573474 shutdown_connections 2024-09-19T10:00:54.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.201+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55ed2d9c50a0 0x55ed2d9c7490 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.201+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed2d94a520 0x55ed2d94e360 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.201+0000 7fa49cff9640 0 client.26947 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T10:00:54.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.201+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed2d940cf0 0x55ed2d94de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.201+0000 7fa4bdd37740 1 --2- 172.21.15.18:0/4006573474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ed2d93f780 0x55ed2d952af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.202+0000 7fa4bdd37740 1 -- 172.21.15.18:0/4006573474 >> 172.21.15.18:0/4006573474 conn(0x55ed2d908310 msgr2=0x55ed2d946310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:54.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.202+0000 7fa4bdd37740 1 -- 172.21.15.18:0/4006573474 shutdown_connections 2024-09-19T10:00:54.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.202+0000 7fa4bdd37740 1 -- 172.21.15.18:0/4006573474 wait complete. 2024-09-19T10:00:54.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.202+0000 7fa4bdd37740 20 client.26947 trim_cache size 0 max 16384 2024-09-19T10:00:54.212 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:00:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.207+0000 7fa4bb95e640 1 -- 172.21.15.18:0/2609261123 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa4a00a3450 msgr2=0x7fa4a00a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.207+0000 7fa4bb95e640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa4a00a3450 0x7fa4a00a5910 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0176e0 tx=0x7fa4ac0107c0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.207+0000 7fa4bb95e640 1 -- 172.21.15.18:0/2609261123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4b4110220 msgr2=0x7fa4b41a6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.207+0000 7fa4bb95e640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4b4110220 0x7fa4b41a6f60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00eb00 tx=0x7fa4ac00c2d0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.208+0000 7fa4bb95e640 1 -- 172.21.15.18:0/2609261123 shutdown_connections 2024-09-19T10:00:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.208+0000 7fa4bb95e640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa4a00a3450 0x7fa4a00a5910 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.208+0000 7fa4bb95e640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b41ab830 0x7fa4b41abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.208+0000 7fa4bb95e640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4b411b140 0x7fa4b41a74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.208+0000 7fa4bb95e640 1 --2- 172.21.15.18:0/2609261123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4b4110220 0x7fa4b41a6f60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.208+0000 7fa4bb95e640 1 -- 172.21.15.18:0/2609261123 >> 172.21.15.18:0/2609261123 conn(0x7fa4b4073210 msgr2=0x7fa4b41193c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.208+0000 7fa4bb95e640 1 -- 172.21.15.18:0/2609261123 shutdown_connections 2024-09-19T10:00:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:54.208+0000 7fa4bb95e640 1 -- 172.21.15.18:0/2609261123 wait complete. 2024-09-19T10:00:54.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:54 smithi018 ceph-mon[30956]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 493 MiB/s wr, 1.46k op/s 2024-09-19T10:00:54.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:00:54.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:00:54.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:54 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:00:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:54 smithi049 ceph-mon[34858]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 493 MiB/s wr, 1.46k op/s 2024-09-19T10:00:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:00:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:00:54.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:54 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:00:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:54 smithi162 ceph-mon[35174]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 493 MiB/s wr, 1.46k op/s 2024-09-19T10:00:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:00:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:00:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:54 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:00:55.204 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T10:00:56.104 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:00:56.499 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:56 smithi018 ceph-mon[30956]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 600 MiB/s wr, 1.67k op/s 2024-09-19T10:00:56.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:56 smithi049 ceph-mon[34858]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 600 MiB/s wr, 1.67k op/s 2024-09-19T10:00:56.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:56 smithi162 ceph-mon[35174]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 600 MiB/s wr, 1.67k op/s 2024-09-19T10:00:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.253+0000 7f94effff640 1 -- 172.21.15.18:0/1468120652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f006ea30 msgr2=0x7f94f006ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.253+0000 7f94effff640 1 --2- 172.21.15.18:0/1468120652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f006ea30 0x7f94f006ee70 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009900 tx=0x7f94e002a3f0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.253+0000 7f94effff640 1 -- 172.21.15.18:0/1468120652 shutdown_connections 2024-09-19T10:00:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.253+0000 7f94effff640 1 --2- 172.21.15.18:0/1468120652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94f011b140 0x7f94f011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.253+0000 7f94effff640 1 --2- 172.21.15.18:0/1468120652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f006ea30 0x7f94f006ee70 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.253+0000 7f94effff640 1 --2- 172.21.15.18:0/1468120652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f0110190 0x7f94f006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.253+0000 7f94effff640 1 -- 172.21.15.18:0/1468120652 >> 172.21.15.18:0/1468120652 conn(0x7f94f0073180 msgr2=0x7f94f0073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.253+0000 7f94effff640 1 -- 172.21.15.18:0/1468120652 shutdown_connections 2024-09-19T10:00:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.253+0000 7f94effff640 1 -- 172.21.15.18:0/1468120652 wait complete. 2024-09-19T10:00:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.254+0000 7f94effff640 1 Processor -- start 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.254+0000 7f94effff640 1 -- start start 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.254+0000 7f94effff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f006ea30 0x7f94f007a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.254+0000 7f94effff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0110190 0x7f94f007a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.254+0000 7f94effff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94f011b140 0x7f94f00752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.254+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0110190 0x7f94f007a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.255+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0110190 0x7f94f007a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51862/0 (socket says 172.21.15.18:51862) 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.255+0000 7f94e7fff640 1 -- 172.21.15.18:0/2118288611 learned_addr learned my addr 172.21.15.18:0/2118288611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.255+0000 7f94effff640 1 -- 172.21.15.18:0/2118288611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94f0120be0 con 0x7f94f0110190 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.255+0000 7f94effff640 1 -- 172.21.15.18:0/2118288611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f94f0120a60 con 0x7f94f011b140 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.255+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94f011b140 0x7f94f00752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.255+0000 7f94effff640 1 -- 172.21.15.18:0/2118288611 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94f0120d60 con 0x7f94f006ea30 2024-09-19T10:00:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.255+0000 7f94eeffd640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f006ea30 0x7f94f007a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.262+0000 7f94ef7fe640 1 -- 172.21.15.18:0/2118288611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f006ea30 msgr2=0x7f94f007a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.262+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f006ea30 0x7f94f007a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.262+0000 7f94ef7fe640 1 -- 172.21.15.18:0/2118288611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0110190 msgr2=0x7f94f007a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.262+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0110190 0x7f94f007a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.262+0000 7f94ef7fe640 1 -- 172.21.15.18:0/2118288611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f0075b90 con 0x7f94f011b140 2024-09-19T10:00:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.270+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94f011b140 0x7f94f00752d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94f006b4a0 tx=0x7f94e800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.276+0000 7f94ecff9640 1 -- 172.21.15.18:0/2118288611 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e800cd50 con 0x7f94f011b140 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.276+0000 7f94effff640 1 -- 172.21.15.18:0/2118288611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f0075e80 con 0x7f94f011b140 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.276+0000 7f94effff640 1 -- 172.21.15.18:0/2118288611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f00820b0 con 0x7f94f011b140 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.294+0000 7f94f76b4740 1 Processor -- start 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.294+0000 7f94f76b4740 1 -- start start 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.296+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2d60 0x55c4d04b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.297+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 0x55c4d04b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.297+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04be860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.297+0000 7f94f76b4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c4d04172f0 con 0x55c4d04b2080 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.297+0000 7f94f76b4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c4d03becf0 con 0x55c4d04b2d60 2024-09-19T10:00:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.297+0000 7f94f76b4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c4d04132b0 con 0x55c4d04b1600 2024-09-19T10:00:57.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.297+0000 7f94ecff9640 1 -- 172.21.15.18:0/2118288611 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94e8005020 con 0x7f94f011b140 2024-09-19T10:00:57.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.298+0000 7f94ecff9640 1 -- 172.21.15.18:0/2118288611 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8010690 con 0x7f94f011b140 2024-09-19T10:00:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.299+0000 7f94eeffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 0x55c4d04b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.299+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2d60 0x55c4d04b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.299+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2d60 0x55c4d04b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:46434/0 (socket says 172.21.15.18:46434) 2024-09-19T10:00:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.299+0000 7f94e7fff640 1 -- 172.21.15.18:0/2395726939 learned_addr learned my addr 172.21.15.18:0/2395726939 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.305+0000 7f94e7fff640 1 -- 172.21.15.18:0/2395726939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 msgr2=0x55c4d04b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.305+0000 7f94e7fff640 1 --2- 172.21.15.18:0/2395726939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 0x55c4d04b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.305+0000 7f94e7fff640 1 -- 172.21.15.18:0/2395726939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 msgr2=0x55c4d04be860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.305+0000 7f94e7fff640 1 --2- 172.21.15.18:0/2395726939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04be860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.305+0000 7f94e7fff640 1 -- 172.21.15.18:0/2395726939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4d03a33a0 con 0x55c4d04b2d60 2024-09-19T10:00:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.306+0000 7f94ecff9640 1 -- 172.21.15.18:0/2118288611 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f94e8004b20 con 0x7f94f011b140 2024-09-19T10:00:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.308+0000 7f94ecff9640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94d00a3450 0x7f94d00a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.309+0000 7f94ecff9640 1 -- 172.21.15.18:0/2118288611 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f94e80cfe80 con 0x7f94f011b140 2024-09-19T10:00:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.309+0000 7f94e7fff640 1 --2- 172.21.15.18:0/2395726939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2d60 0x55c4d04b3140 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f94e0006010 tx=0x7f94e0031450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47ac32d855cc8a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:57.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.311+0000 7f94effff640 1 -- 172.21.15.18:0/2395726939 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0041020 con 0x55c4d04b2d60 2024-09-19T10:00:57.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.311+0000 7f94effff640 1 -- 172.21.15.18:0/2395726939 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94e0005510 con 0x55c4d04b2d60 2024-09-19T10:00:57.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.311+0000 7f94effff640 1 -- 172.21.15.18:0/2395726939 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0035040 con 0x55c4d04b2d60 2024-09-19T10:00:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.315+0000 7f94f76b4740 1 -- 172.21.15.18:0/2395726939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2d60 msgr2=0x55c4d04b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.315+0000 7f94f76b4740 1 --2- 172.21.15.18:0/2395726939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2d60 0x55c4d04b3140 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f94e0006010 tx=0x7f94e0031450 comp rx=0 tx=0).stop 2024-09-19T10:00:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.316+0000 7f94f76b4740 1 -- 172.21.15.18:0/2395726939 shutdown_connections 2024-09-19T10:00:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.316+0000 7f94f76b4740 1 --2- 172.21.15.18:0/2395726939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04be860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.316+0000 7f94f76b4740 1 --2- 172.21.15.18:0/2395726939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 0x55c4d04b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.316+0000 7f94f76b4740 1 --2- 172.21.15.18:0/2395726939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2d60 0x55c4d04b3140 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.316+0000 7f94f76b4740 1 -- 172.21.15.18:0/2395726939 >> 172.21.15.18:0/2395726939 conn(0x55c4d047a310 msgr2=0x55c4d04ae140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.316+0000 7f94f76b4740 1 -- 172.21.15.18:0/2395726939 shutdown_connections 2024-09-19T10:00:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.316+0000 7f94f76b4740 1 -- 172.21.15.18:0/2395726939 wait complete. 2024-09-19T10:00:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.317+0000 7f94f76b4740 1 -- start start 2024-09-19T10:00:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.317+0000 7f94f76b4740 1 Processor -- start 2024-09-19T10:00:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.319+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b1600 0x55c4d04be830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.319+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.319+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04bc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.319+0000 7f94f76b4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c4d04bf230 con 0x55c4d04b2080 2024-09-19T10:00:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.319+0000 7f94f76b4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c4d03d2060 con 0x55c4d04b1600 2024-09-19T10:00:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.319+0000 7f94f76b4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c4d04bf3b0 con 0x55c4d04b2d60 2024-09-19T10:00:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.320+0000 7f94f76b4740 10 client.0 _ll_register_callbacks cb 0x55c4d01258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:57.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.323+0000 7f94ef7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.323+0000 7f94ef7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04bc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58692/0 (socket says 172.21.15.18:58692) 2024-09-19T10:00:57.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.323+0000 7f94ef7fe640 1 -- 172.21.15.18:0/693115756 learned_addr learned my addr 172.21.15.18:0/693115756 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.327+0000 7f94e7fff640 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.327+0000 7f94ef7fe640 1 -- 172.21.15.18:0/693115756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b1600 msgr2=0x55c4d04be830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.327+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b1600 0x55c4d04be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.327+0000 7f94ef7fe640 1 -- 172.21.15.18:0/693115756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 msgr2=0x55c4d04bbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.327+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04bbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.327+0000 7f94ef7fe640 1 -- 172.21.15.18:0/693115756 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4d01883c0 con 0x55c4d04b2d60 2024-09-19T10:00:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.328+0000 7f94eeffd640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94d00a3450 0x7f94d00a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.334+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04bc270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94e8098e40 tx=0x7f94e809ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c13d08cb1727c262 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:57.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.334+0000 7f94de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:57.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.336+0000 7f94eeffd640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94d00a3450 0x7f94d00a5910 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f94d80058c0 tx=0x7f94d8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:57.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.336+0000 7f94de7fc640 1 -- 172.21.15.18:0/693115756 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e80b5220 con 0x55c4d04b2d60 2024-09-19T10:00:57.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.336+0000 7f94f76b4740 1 -- 172.21.15.18:0/693115756 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94e0005510 con 0x55c4d04b2d60 2024-09-19T10:00:57.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.336+0000 7f94de7fc640 1 -- 172.21.15.18:0/693115756 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f94e80b53c0 con 0x55c4d04b2d60 2024-09-19T10:00:57.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.340+0000 7f94de7fc640 1 -- 172.21.15.18:0/693115756 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94e80a4c50 con 0x55c4d04b2d60 2024-09-19T10:00:57.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.340+0000 7f94f76b4740 10 client.26959 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:57.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.340+0000 7f94f76b4740 1 -- 172.21.15.18:0/693115756 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c4d04dbe10 con 0x55c4d04b2d60 2024-09-19T10:00:57.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.343+0000 7f94de7fc640 1 -- 172.21.15.18:0/693115756 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94e0005510 con 0x55c4d04b2d60 2024-09-19T10:00:57.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.343+0000 7f94de7fc640 1 -- 172.21.15.18:0/693115756 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f94e809b330 con 0x55c4d04b2d60 2024-09-19T10:00:57.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.343+0000 7f94f76b4740 10 client.26959 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:57.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.343+0000 7f94f76b4740 10 client.26959 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:00:57.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.343+0000 7f94f76b4740 20 client.26959 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:57.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.343+0000 7f94f76b4740 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55c4d04dd710 0x55c4d04dfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.343+0000 7f94f76b4740 4 client.26959 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:00:57.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.343+0000 7f94f76b4740 1 -- 172.21.15.18:0/693115756 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4d0424860 con 0x55c4d04dd710 2024-09-19T10:00:57.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.346+0000 7f94eeffd640 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55c4d04dd710 0x55c4d04dfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.354+0000 7f94eeffd640 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55c4d04dd710 0x55c4d04dfb50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4afcd3c00d71c904 server_cookie=f7eefbdd75faf6fb in_seq=0 out_seq=0 2024-09-19T10:00:57.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.354+0000 7f94de7fc640 10 client.26959 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.356+0000 7f94de7fc640 1 -- 172.21.15.18:0/693115756 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4d0424860 con 0x55c4d04dd710 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.356+0000 7f94de7fc640 10 client.26959 handle_command_reply: tid=0 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.356+0000 7f94f76b4740 1 client.26959 shutdown 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.356+0000 7f94f76b4740 1 -- 172.21.15.18:0/693115756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 msgr2=0x55c4d04bc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.356+0000 7f94f76b4740 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04bc270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94e8098e40 tx=0x7f94e809ccb0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.357+0000 7f94f76b4740 1 -- 172.21.15.18:0/693115756 shutdown_connections 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.357+0000 7f94f76b4740 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55c4d04dd710 0x55c4d04dfb50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.357+0000 7f94f76b4740 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04bc270 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.357+0000 7f94f76b4740 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.357+0000 7f94f76b4740 1 --2- 172.21.15.18:0/693115756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b1600 0x55c4d04be830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.357+0000 7f94f76b4740 1 -- 172.21.15.18:0/693115756 >> 172.21.15.18:0/693115756 conn(0x55c4d047a310 msgr2=0x55c4d04b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.357+0000 7f94de7fc640 0 client.26959 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:00:57.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.357+0000 7f94f76b4740 1 -- 172.21.15.18:0/693115756 shutdown_connections 2024-09-19T10:00:57.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.357+0000 7f94f76b4740 1 -- 172.21.15.18:0/693115756 wait complete. 2024-09-19T10:00:57.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.358+0000 7f94f76b4740 20 client.26959 trim_cache size 0 max 16384 2024-09-19T10:00:57.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.403+0000 7f94f76b4740 1 Processor -- start 2024-09-19T10:00:57.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.404+0000 7f94f76b4740 1 -- start start 2024-09-19T10:00:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.405+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b1600 0x55c4d04bda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.405+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.406+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.407+0000 7f94f76b4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94d400e480 con 0x55c4d04b2080 2024-09-19T10:00:57.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.407+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.407+0000 7f94f76b4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f94d400ffc0 con 0x55c4d04b1600 2024-09-19T10:00:57.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.407+0000 7f94f76b4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94d400eb50 con 0x55c4d04b2d60 2024-09-19T10:00:57.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.407+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51902/0 (socket says 172.21.15.18:51902) 2024-09-19T10:00:57.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.407+0000 7f94e7fff640 1 -- 172.21.15.18:0/3906649620 learned_addr learned my addr 172.21.15.18:0/3906649620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:57.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.408+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/3906649620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.409+0000 7f94ef7fe640 1 -- 172.21.15.18:0/3906649620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b1600 msgr2=0x55c4d04bda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:57.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.409+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/3906649620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b1600 0x55c4d04bda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.409+0000 7f94ef7fe640 1 -- 172.21.15.18:0/3906649620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 msgr2=0x55c4d04adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:57.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.409+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/3906649620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.409+0000 7f94ef7fe640 1 -- 172.21.15.18:0/3906649620 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4d04beba0 con 0x55c4d04b2d60 2024-09-19T10:00:57.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.410+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/3906649620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04ae030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009fd0 tx=0x7f94e800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d5d4173357365a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:57.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.411+0000 7f94e4ff9640 1 -- 172.21.15.18:0/3906649620 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e80a1b00 con 0x55c4d04b2d60 2024-09-19T10:00:57.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.411+0000 7f94e4ff9640 1 -- 172.21.15.18:0/3906649620 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94e80b5070 con 0x55c4d04b2d60 2024-09-19T10:00:57.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.411+0000 7f94e4ff9640 1 -- 172.21.15.18:0/3906649620 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e80b5220 con 0x55c4d04b2d60 2024-09-19T10:00:57.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.413+0000 7f94f76b4740 1 -- 172.21.15.18:0/3906649620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 msgr2=0x55c4d04ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:57.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.413+0000 7f94f76b4740 1 --2- 172.21.15.18:0/3906649620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04ae030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009fd0 tx=0x7f94e800ef90 comp rx=0 tx=0).stop 2024-09-19T10:00:57.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.414+0000 7f94f76b4740 1 -- 172.21.15.18:0/3906649620 shutdown_connections 2024-09-19T10:00:57.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.414+0000 7f94f76b4740 1 --2- 172.21.15.18:0/3906649620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b2d60 0x55c4d04ae030 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.414+0000 7f94f76b4740 1 --2- 172.21.15.18:0/3906649620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2080 0x55c4d04adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.414+0000 7f94f76b4740 1 --2- 172.21.15.18:0/3906649620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b1600 0x55c4d04bda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.414+0000 7f94f76b4740 1 -- 172.21.15.18:0/3906649620 >> 172.21.15.18:0/3906649620 conn(0x55c4d047a310 msgr2=0x55c4d04bd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:57.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.414+0000 7f94f76b4740 1 -- 172.21.15.18:0/3906649620 shutdown_connections 2024-09-19T10:00:57.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.414+0000 7f94f76b4740 1 -- 172.21.15.18:0/3906649620 wait complete. 2024-09-19T10:00:57.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.415+0000 7f94f76b4740 1 -- start start 2024-09-19T10:00:57.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.416+0000 7f94f76b4740 1 Processor -- start 2024-09-19T10:00:57.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.417+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 0x55c4d04bf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.417+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2080 0x55c4d04bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.419+0000 7f94eeffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 0x55c4d04bf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.419+0000 7f94f76b4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2d60 0x55c4d04c0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.419+0000 7f94f76b4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94d400f8f0 con 0x55c4d04b2d60 2024-09-19T10:00:57.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.419+0000 7f94f76b4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f94d400f220 con 0x55c4d04b2080 2024-09-19T10:00:57.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.419+0000 7f94f76b4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94d400c460 con 0x55c4d04b1600 2024-09-19T10:00:57.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.419+0000 7f94f76b4740 10 client.0 _ll_register_callbacks cb 0x7f94e8098050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:00:57.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.419+0000 7f94eeffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 0x55c4d04bf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58720/0 (socket says 172.21.15.18:58720) 2024-09-19T10:00:57.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.419+0000 7f94eeffd640 1 -- 172.21.15.18:0/4265759291 learned_addr learned my addr 172.21.15.18:0/4265759291 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:00:57.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.420+0000 7f94e7fff640 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2080 0x55c4d04bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.422+0000 7f94ef7fe640 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2d60 0x55c4d04c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.422+0000 7f94eeffd640 1 -- 172.21.15.18:0/4265759291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2080 msgr2=0x55c4d04bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:57.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.422+0000 7f94eeffd640 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2080 0x55c4d04bfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.422+0000 7f94eeffd640 1 -- 172.21.15.18:0/4265759291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2d60 msgr2=0x55c4d04c0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:00:57.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.422+0000 7f94eeffd640 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2d60 0x55c4d04c0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.422+0000 7f94eeffd640 1 -- 172.21.15.18:0/4265759291 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4d05466f0 con 0x55c4d04b1600 2024-09-19T10:00:57.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.430+0000 7f94eeffd640 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 0x55c4d04bf690 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f94d8004700 tx=0x7f94d8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20cff5e766f2eeba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:00:57.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.430+0000 7f94de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:00:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.430+0000 7f94de7fc640 1 -- 172.21.15.18:0/4265759291 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d802d060 con 0x55c4d04b1600 2024-09-19T10:00:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.430+0000 7f94de7fc640 1 -- 172.21.15.18:0/4265759291 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f94d80285f0 con 0x55c4d04b1600 2024-09-19T10:00:57.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.431+0000 7f94f76b4740 1 -- 172.21.15.18:0/4265759291 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94e80b5070 con 0x55c4d04b1600 2024-09-19T10:00:57.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.446+0000 7f94de7fc640 1 -- 172.21.15.18:0/4265759291 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94d80287f0 con 0x55c4d04b1600 2024-09-19T10:00:57.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.448+0000 7f94f76b4740 10 client.26965 fetch_fsmap learned FSMap version 28 2024-09-19T10:00:57.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.448+0000 7f94f76b4740 1 -- 172.21.15.18:0/4265759291 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c4d0547a50 con 0x55c4d04b1600 2024-09-19T10:00:57.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.449+0000 7f94de7fc640 1 -- 172.21.15.18:0/4265759291 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94d801c3f0 con 0x55c4d04b1600 2024-09-19T10:00:57.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.449+0000 7f94de7fc640 1 -- 172.21.15.18:0/4265759291 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f94d8027070 con 0x55c4d04b1600 2024-09-19T10:00:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.453+0000 7f94f76b4740 10 client.26965 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:00:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.453+0000 7f94f76b4740 10 client.26965 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:00:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.453+0000 7f94f76b4740 20 client.26965 populate_metadata read hostname 'smithi018' 2024-09-19T10:00:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.453+0000 7f94f76b4740 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55c4d0548170 0x55c4d054a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:00:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.453+0000 7f94f76b4740 4 client.26965 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:00:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.453+0000 7f94f76b4740 1 -- 172.21.15.18:0/4265759291 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f94e80b5070 con 0x55c4d0548170 2024-09-19T10:00:57.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.454+0000 7f94e7fff640 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55c4d0548170 0x55c4d054a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:00:57.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.463+0000 7f94e7fff640 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55c4d0548170 0x55c4d054a560 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c31f91e10ec9a6ad server_cookie=e56c0ac91ac3b691 in_seq=0 out_seq=0 2024-09-19T10:00:57.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.463+0000 7f94de7fc640 10 client.26965 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:00:57.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.468+0000 7f94de7fc640 1 -- 172.21.15.18:0/4265759291 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f94e00043e0 con 0x55c4d0548170 2024-09-19T10:00:57.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.468+0000 7f94de7fc640 10 client.26965 handle_command_reply: tid=0 2024-09-19T10:00:57.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.468+0000 7f94f76b4740 1 client.26965 shutdown 2024-09-19T10:00:57.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.468+0000 7f94f76b4740 1 -- 172.21.15.18:0/4265759291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 msgr2=0x55c4d04bf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:57.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.468+0000 7f94f76b4740 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 0x55c4d04bf690 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f94d8004700 tx=0x7f94d8004730 comp rx=0 tx=0).stop 2024-09-19T10:00:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.471+0000 7f94f76b4740 1 -- 172.21.15.18:0/4265759291 shutdown_connections 2024-09-19T10:00:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.471+0000 7f94f76b4740 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55c4d0548170 0x55c4d054a560 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.471+0000 7f94f76b4740 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c4d04b2d60 0x55c4d04c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.471+0000 7f94f76b4740 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c4d04b2080 0x55c4d04bfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.471+0000 7f94f76b4740 1 --2- 172.21.15.18:0/4265759291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c4d04b1600 0x55c4d04bf690 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.471+0000 7f94de7fc640 0 client.26965 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:00:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.471+0000 7f94f76b4740 1 -- 172.21.15.18:0/4265759291 >> 172.21.15.18:0/4265759291 conn(0x55c4d047a310 msgr2=0x55c4d04bdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.471+0000 7f94f76b4740 1 -- 172.21.15.18:0/4265759291 shutdown_connections 2024-09-19T10:00:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.471+0000 7f94f76b4740 1 -- 172.21.15.18:0/4265759291 wait complete. 2024-09-19T10:00:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.471+0000 7f94f76b4740 20 client.26965 trim_cache size 0 max 16384 2024-09-19T10:00:57.475 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:00:57.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.474+0000 7f94e5ffb640 1 -- 172.21.15.18:0/2118288611 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94d00a3450 msgr2=0x7f94d00a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:57.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.474+0000 7f94e5ffb640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94d00a3450 0x7f94d00a5910 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f94d80058c0 tx=0x7f94d8005850 comp rx=0 tx=0).stop 2024-09-19T10:00:57.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.475+0000 7f94e5ffb640 1 -- 172.21.15.18:0/2118288611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94f011b140 msgr2=0x7f94f00752d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:57.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.475+0000 7f94e5ffb640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94f011b140 0x7f94f00752d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94f006b4a0 tx=0x7f94e800ee60 comp rx=0 tx=0).stop 2024-09-19T10:00:57.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.477+0000 7f94e5ffb640 1 -- 172.21.15.18:0/2118288611 shutdown_connections 2024-09-19T10:00:57.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.477+0000 7f94e5ffb640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94d00a3450 0x7f94d00a5910 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.477+0000 7f94e5ffb640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94f011b140 0x7f94f00752d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.477+0000 7f94e5ffb640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94f0110190 0x7f94f007a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.477+0000 7f94e5ffb640 1 --2- 172.21.15.18:0/2118288611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94f006ea30 0x7f94f007a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:57.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.477+0000 7f94e5ffb640 1 -- 172.21.15.18:0/2118288611 >> 172.21.15.18:0/2118288611 conn(0x7f94f0073180 msgr2=0x7f94f0119370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:57.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.480+0000 7f94e5ffb640 1 -- 172.21.15.18:0/2118288611 shutdown_connections 2024-09-19T10:00:57.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:00:57.481+0000 7f94e5ffb640 1 -- 172.21.15.18:0/2118288611 wait complete. 2024-09-19T10:00:57.887 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:00:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:00:57.425+0000 7f02bd7f1640 -1 bdev(0x55f98da5cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 9 2024-09-19T10:00:57.887 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:00:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:00:57.426+0000 7f02c0ff8640 -1 bdev(0x55f98da5cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 6 2024-09-19T10:00:57.888 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:00:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:00:57.430+0000 7f02bcff0640 -1 bdev(0x55f98da5cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 8 2024-09-19T10:00:57.888 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:00:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:00:57.448+0000 7f02bbfee640 -1 bdev(0x55f98da5cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 8 2024-09-19T10:00:58.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:00:58 smithi018 ceph-mon[30956]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 716 MiB/s wr, 1.86k op/s 2024-09-19T10:00:58.425 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T10:00:58.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:00:58 smithi049 ceph-mon[34858]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 716 MiB/s wr, 1.86k op/s 2024-09-19T10:00:58.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:00:58 smithi162 ceph-mon[35174]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 716 MiB/s wr, 1.86k op/s 2024-09-19T10:00:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.240+0000 7f8808ff9640 1 -- 172.21.15.18:0/255363426 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564941982900 con 0x564941a97630 2024-09-19T10:00:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.240+0000 7f8808ff9640 10 client.17478 handle_command_reply: tid=0 2024-09-19T10:00:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.241+0000 7f882a7da740 1 client.17478 shutdown 2024-09-19T10:00:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.241+0000 7f882a7da740 1 -- 172.21.15.18:0/255363426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa31b0 msgr2=0x564941ab16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.241+0000 7f882a7da740 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa31b0 0x564941ab16e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f881c005ab0 tx=0x7f881c02a410 comp rx=0 tx=0).stop 2024-09-19T10:00:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.241+0000 7f882a7da740 1 -- 172.21.15.18:0/255363426 shutdown_connections 2024-09-19T10:00:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.241+0000 7f882a7da740 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564941a97630 0x564941a99a50 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.241+0000 7f882a7da740 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564941b20320 0x564941b22710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.241+0000 7f882a7da740 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564941aa8b80 0x564941ab1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.241+0000 7f882a7da740 1 --2- 172.21.15.18:0/255363426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564941aa31b0 0x564941ab16e0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.241+0000 7f882a7da740 1 -- 172.21.15.18:0/255363426 >> 172.21.15.18:0/255363426 conn(0x564941a9e820 msgr2=0x564941a949a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.241+0000 7f8808ff9640 0 client.17478 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:00:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.244+0000 7f882a7da740 1 -- 172.21.15.18:0/255363426 shutdown_connections 2024-09-19T10:00:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.244+0000 7f882a7da740 1 -- 172.21.15.18:0/255363426 wait complete. 2024-09-19T10:00:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.244+0000 7f882a7da740 20 client.17478 trim_cache size 0 max 16384 2024-09-19T10:00:59.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:00:59.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:00:59.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:00:59.248 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:00:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.247+0000 7f8827a45640 1 -- 172.21.15.18:0/1614345130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f880c0a3530 msgr2=0x7f880c0a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.247+0000 7f8827a45640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f880c0a3530 0x7f880c0a59f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f881c031610 tx=0x7f881c000bc0 comp rx=0 tx=0).stop 2024-09-19T10:00:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.247+0000 7f8827a45640 1 -- 172.21.15.18:0/1614345130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8820104f50 msgr2=0x7f8820071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:00:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.247+0000 7f8827a45640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8820104f50 0x7f8820071020 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8810009fd0 tx=0x7f881000b870 comp rx=0 tx=0).stop 2024-09-19T10:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.265+0000 7f8827a45640 1 -- 172.21.15.18:0/1614345130 shutdown_connections 2024-09-19T10:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.265+0000 7f8827a45640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f880c0a3530 0x7f880c0a59f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.265+0000 7f8827a45640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8820105910 0x7f88201aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.266+0000 7f8827a45640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8820104f50 0x7f8820071020 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.266+0000 7f8827a45640 1 --2- 172.21.15.18:0/1614345130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8820103d60 0x7f8820070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:00:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.267+0000 7f8827a45640 1 -- 172.21.15.18:0/1614345130 >> 172.21.15.18:0/1614345130 conn(0x7f88200ff4e0 msgr2=0x7f8820108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:00:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.267+0000 7f8827a45640 1 -- 172.21.15.18:0/1614345130 shutdown_connections 2024-09-19T10:00:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:00:59.267+0000 7f8827a45640 1 -- 172.21.15.18:0/1614345130 wait complete. 2024-09-19T10:00:59.416 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:01:00.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.317+0000 7f8a8bfff640 1 -- 172.21.15.18:0/2520784529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a8c084bd0 msgr2=0x7f8a8c07bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:00.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.317+0000 7f8a8bfff640 1 --2- 172.21.15.18:0/2520784529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a8c084bd0 0x7f8a8c07bbe0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009cd0 tx=0x7f8a8402a8f0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.317+0000 7f8a8bfff640 1 -- 172.21.15.18:0/2520784529 shutdown_connections 2024-09-19T10:01:00.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.317+0000 7f8a8bfff640 1 --2- 172.21.15.18:0/2520784529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a8c080680 0x7f8a8c080b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.317+0000 7f8a8bfff640 1 --2- 172.21.15.18:0/2520784529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8c07c120 0x7f8a8c07c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.317+0000 7f8a8bfff640 1 --2- 172.21.15.18:0/2520784529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a8c084bd0 0x7f8a8c07bbe0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.317+0000 7f8a8bfff640 1 -- 172.21.15.18:0/2520784529 >> 172.21.15.18:0/2520784529 conn(0x7f8a8c077a10 msgr2=0x7f8a8c079e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:00.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.318+0000 7f8a8bfff640 1 -- 172.21.15.18:0/2520784529 shutdown_connections 2024-09-19T10:01:00.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.318+0000 7f8a8bfff640 1 -- 172.21.15.18:0/2520784529 wait complete. 2024-09-19T10:01:00.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.320+0000 7f8a8bfff640 1 Processor -- start 2024-09-19T10:01:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.321+0000 7f8a8bfff640 1 -- start start 2024-09-19T10:01:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.321+0000 7f8a8bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a8c07c120 0x7f8a8c0736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.321+0000 7f8a8bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a8c080680 0x7f8a8c073c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.321+0000 7f8a8bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8c06c840 0x7f8a8c06ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.321+0000 7f8a8bfff640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c120c00 con 0x7f8a8c07c120 2024-09-19T10:01:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.321+0000 7f8a8bfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c120a80 con 0x7f8a8c080680 2024-09-19T10:01:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.321+0000 7f8a8bfff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c120d80 con 0x7f8a8c06c840 2024-09-19T10:01:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.333+0000 7f8a8affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a8c07c120 0x7f8a8c0736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.333+0000 7f8a8affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a8c07c120 0x7f8a8c0736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51930/0 (socket says 172.21.15.18:51930) 2024-09-19T10:01:00.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.333+0000 7f8a8affd640 1 -- 172.21.15.18:0/4144778360 learned_addr learned my addr 172.21.15.18:0/4144778360 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:00.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.334+0000 7f8a8b7fe640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8c06c840 0x7f8a8c06ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.335+0000 7f8a8a7fc640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a8c080680 0x7f8a8c073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.339+0000 7f8a8b7fe640 1 -- 172.21.15.18:0/4144778360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a8c080680 msgr2=0x7f8a8c073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.339+0000 7f8a8b7fe640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a8c080680 0x7f8a8c073c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.339+0000 7f8a8b7fe640 1 -- 172.21.15.18:0/4144778360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a8c07c120 msgr2=0x7f8a8c0736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.339+0000 7f8a8b7fe640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a8c07c120 0x7f8a8c0736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.339+0000 7f8a8b7fe640 1 -- 172.21.15.18:0/4144778360 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8c06d510 con 0x7f8a8c06c840 2024-09-19T10:01:00.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.346+0000 7f8a8b7fe640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8c06c840 0x7f8a8c06ccf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000e740 tx=0x7f8a8000ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.356+0000 7f8a73fff640 1 -- 172.21.15.18:0/4144778360 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8000ccc0 con 0x7f8a8c06c840 2024-09-19T10:01:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.356+0000 7f8a73fff640 1 -- 172.21.15.18:0/4144778360 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8000ee50 con 0x7f8a8c06c840 2024-09-19T10:01:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.356+0000 7f8a73fff640 1 -- 172.21.15.18:0/4144778360 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80004a00 con 0x7f8a8c06c840 2024-09-19T10:01:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.364+0000 7f8a8bfff640 1 -- 172.21.15.18:0/4144778360 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8c071290 con 0x7f8a8c06c840 2024-09-19T10:01:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.364+0000 7f8a8bfff640 1 -- 172.21.15.18:0/4144778360 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8c071750 con 0x7f8a8c06c840 2024-09-19T10:01:00.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.369+0000 7f8a93949740 1 Processor -- start 2024-09-19T10:01:00.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.376+0000 7f8a93949740 1 -- start start 2024-09-19T10:01:00.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.376+0000 7f8a93949740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1d20 0x56117f3e2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.376+0000 7f8a93949740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 0x56117f3e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.376+0000 7f8a93949740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1040 0x56117f3ed820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.376+0000 7f8a93949740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56117f3462f0 con 0x56117f3e05c0 2024-09-19T10:01:00.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.376+0000 7f8a93949740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56117f2edcf0 con 0x56117f3e1d20 2024-09-19T10:01:00.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.376+0000 7f8a93949740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56117f3422b0 con 0x56117f3e1040 2024-09-19T10:01:00.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.379+0000 7f8a8affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 0x56117f3e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.379+0000 7f8a8affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 0x56117f3e0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51934/0 (socket says 172.21.15.18:51934) 2024-09-19T10:01:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.379+0000 7f8a8affd640 1 -- 172.21.15.18:0/3881898574 learned_addr learned my addr 172.21.15.18:0/3881898574 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.381+0000 7f8a8affd640 1 -- 172.21.15.18:0/3881898574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1040 msgr2=0x56117f3ed820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:01:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.381+0000 7f8a8affd640 1 --2- 172.21.15.18:0/3881898574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1040 0x56117f3ed820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.381+0000 7f8a8affd640 1 -- 172.21.15.18:0/3881898574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1d20 msgr2=0x56117f3e2100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:01:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.381+0000 7f8a8affd640 1 --2- 172.21.15.18:0/3881898574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1d20 0x56117f3e2100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.381+0000 7f8a8affd640 1 -- 172.21.15.18:0/3881898574 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56117f2d23a0 con 0x56117f3e05c0 2024-09-19T10:01:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.381+0000 7f8a73fff640 1 -- 172.21.15.18:0/4144778360 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8a80004ba0 con 0x7f8a8c06c840 2024-09-19T10:01:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.383+0000 7f8a73fff640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a740a3450 0x7f8a740a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.383+0000 7f8a73fff640 1 -- 172.21.15.18:0/4144778360 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8a800cf8e0 con 0x7f8a8c06c840 2024-09-19T10:01:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.384+0000 7f8a8affd640 1 --2- 172.21.15.18:0/3881898574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 0x56117f3e0a20 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8a84000f80 tx=0x7f8a84009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70613386b97873e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:00.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.385+0000 7f8a8bfff640 1 -- 172.21.15.18:0/3881898574 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84048070 con 0x56117f3e05c0 2024-09-19T10:01:00.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.386+0000 7f8a8bfff640 1 -- 172.21.15.18:0/3881898574 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84036040 con 0x56117f3e05c0 2024-09-19T10:01:00.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.387+0000 7f8a93949740 1 -- 172.21.15.18:0/3881898574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 msgr2=0x56117f3e0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:00.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.387+0000 7f8a93949740 1 --2- 172.21.15.18:0/3881898574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 0x56117f3e0a20 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8a84000f80 tx=0x7f8a84009280 comp rx=0 tx=0).stop 2024-09-19T10:01:00.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.388+0000 7f8a8a7fc640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a740a3450 0x7f8a740a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.392+0000 7f8a93949740 1 -- 172.21.15.18:0/3881898574 shutdown_connections 2024-09-19T10:01:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.392+0000 7f8a93949740 1 --2- 172.21.15.18:0/3881898574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1040 0x56117f3ed820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.392+0000 7f8a93949740 1 --2- 172.21.15.18:0/3881898574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 0x56117f3e0a20 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.392+0000 7f8a93949740 1 --2- 172.21.15.18:0/3881898574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1d20 0x56117f3e2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.392+0000 7f8a93949740 1 -- 172.21.15.18:0/3881898574 >> 172.21.15.18:0/3881898574 conn(0x56117f3a9310 msgr2=0x56117f3dd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:00.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.395+0000 7f8a93949740 1 -- 172.21.15.18:0/3881898574 shutdown_connections 2024-09-19T10:01:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.403+0000 7f8a93949740 1 -- 172.21.15.18:0/3881898574 wait complete. 2024-09-19T10:01:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.403+0000 7f8a8a7fc640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a740a3450 0x7f8a740a5910 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c07b320 tx=0x7f8a7c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:00.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.403+0000 7f8a93949740 1 -- start start 2024-09-19T10:01:00.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.404+0000 7f8a93949740 1 Processor -- start 2024-09-19T10:01:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.415+0000 7f8a93949740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e05c0 0x56117f3ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.415+0000 7f8a93949740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e1040 0x56117f3ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.416+0000 7f8a93949740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1d20 0x56117f3eade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.416+0000 7f8a93949740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56117f3ee290 con 0x56117f3e1040 2024-09-19T10:01:00.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.416+0000 7f8a93949740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56117f301060 con 0x56117f3e1d20 2024-09-19T10:01:00.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.416+0000 7f8a93949740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56117f3ee410 con 0x56117f3e05c0 2024-09-19T10:01:00.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.416+0000 7f8a93949740 10 client.0 _ll_register_callbacks cb 0x56117f0548c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:00.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.416+0000 7f8a8b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1d20 0x56117f3eade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.418+0000 7f8a8affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e05c0 0x56117f3ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.418+0000 7f8a8affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e05c0 0x56117f3ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58764/0 (socket says 172.21.15.18:58764) 2024-09-19T10:01:00.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.418+0000 7f8a8affd640 1 -- 172.21.15.18:0/114139182 learned_addr learned my addr 172.21.15.18:0/114139182 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:00.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.418+0000 7f8a8b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1d20 0x56117f3eade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:46492/0 (socket says 172.21.15.18:46492) 2024-09-19T10:01:00.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.423+0000 7f8a8affd640 1 -- 172.21.15.18:0/114139182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1d20 msgr2=0x56117f3eade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:00.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.423+0000 7f8a8affd640 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1d20 0x56117f3eade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.423+0000 7f8a8affd640 1 -- 172.21.15.18:0/114139182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e1040 msgr2=0x56117f3ea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:00.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.423+0000 7f8a8affd640 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e1040 0x56117f3ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.423+0000 7f8a8affd640 1 -- 172.21.15.18:0/114139182 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56117f0b73c0 con 0x56117f3e05c0 2024-09-19T10:01:00.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.427+0000 7f8a8affd640 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e05c0 0x56117f3ed5f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a84046040 tx=0x7f8a84030b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ba434f1048efeab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:00.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.428+0000 7f8a6eff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:01:00.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.429+0000 7f8a6eff5640 1 -- 172.21.15.18:0/114139182 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84048040 con 0x56117f3e05c0 2024-09-19T10:01:00.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.429+0000 7f8a6eff5640 1 -- 172.21.15.18:0/114139182 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8a840303a0 con 0x56117f3e05c0 2024-09-19T10:01:00.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.431+0000 7f8a93949740 1 -- 172.21.15.18:0/114139182 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a84036040 con 0x56117f3e05c0 2024-09-19T10:01:00.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.431+0000 7f8a6eff5640 1 -- 172.21.15.18:0/114139182 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8a840305a0 con 0x56117f3e05c0 2024-09-19T10:01:00.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.431+0000 7f8a93949740 10 client.26974 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:00.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.431+0000 7f8a93949740 1 -- 172.21.15.18:0/114139182 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56117f3ee290 con 0x56117f3e05c0 2024-09-19T10:01:00.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.432+0000 7f8a6eff5640 1 -- 172.21.15.18:0/114139182 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84030740 con 0x56117f3e05c0 2024-09-19T10:01:00.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.434+0000 7f8a6eff5640 1 -- 172.21.15.18:0/114139182 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8a84005760 con 0x56117f3e05c0 2024-09-19T10:01:00.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.434+0000 7f8a93949740 10 client.26974 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:00.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.434+0000 7f8a93949740 10 client.26974 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:01:00.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.435+0000 7f8a93949740 20 client.26974 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:00.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.435+0000 7f8a93949740 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x56117f3fb0a0 0x56117f3fd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.435+0000 7f8a93949740 4 client.26974 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:00.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.435+0000 7f8a93949740 1 -- 172.21.15.18:0/114139182 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a84036040 con 0x56117f3fb0a0 2024-09-19T10:01:00.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.436+0000 7f8a8a7fc640 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x56117f3fb0a0 0x56117f3fd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.439+0000 7f8a8a7fc640 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x56117f3fb0a0 0x56117f3fd4d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c750f6460b705f2c server_cookie=f4fe77d788e5b83b in_seq=0 out_seq=0 2024-09-19T10:01:00.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.440+0000 7f8a6eff5640 10 client.26974 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:01:00.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.446+0000 7f8a6eff5640 1 -- 172.21.15.18:0/114139182 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8a84036040 con 0x56117f3fb0a0 2024-09-19T10:01:00.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.446+0000 7f8a6eff5640 10 client.26974 handle_command_reply: tid=0 2024-09-19T10:01:00.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.446+0000 7f8a93949740 1 client.26974 shutdown 2024-09-19T10:01:00.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.447+0000 7f8a93949740 1 -- 172.21.15.18:0/114139182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e05c0 msgr2=0x56117f3ed5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:00.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.447+0000 7f8a93949740 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e05c0 0x56117f3ed5f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a84046040 tx=0x7f8a84030b80 comp rx=0 tx=0).stop 2024-09-19T10:01:00.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.453+0000 7f8a93949740 1 -- 172.21.15.18:0/114139182 shutdown_connections 2024-09-19T10:01:00.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.453+0000 7f8a93949740 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x56117f3fb0a0 0x56117f3fd4d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.453+0000 7f8a93949740 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1d20 0x56117f3eade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.453+0000 7f8a93949740 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e1040 0x56117f3ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.453+0000 7f8a93949740 1 --2- 172.21.15.18:0/114139182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e05c0 0x56117f3ed5f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.453+0000 7f8a93949740 1 -- 172.21.15.18:0/114139182 >> 172.21.15.18:0/114139182 conn(0x56117f3a9310 msgr2=0x56117f3dc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:00.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.453+0000 7f8a6eff5640 0 client.26974 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:01:00.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.453+0000 7f8a93949740 1 -- 172.21.15.18:0/114139182 shutdown_connections 2024-09-19T10:01:00.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.453+0000 7f8a93949740 1 -- 172.21.15.18:0/114139182 wait complete. 2024-09-19T10:01:00.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.453+0000 7f8a93949740 20 client.26974 trim_cache size 0 max 16384 2024-09-19T10:01:00.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.490+0000 7f8a93949740 1 Processor -- start 2024-09-19T10:01:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.491+0000 7f8a93949740 1 -- start start 2024-09-19T10:01:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.492+0000 7f8a93949740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e05c0 0x56117f3f7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.492+0000 7f8a93949740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1040 0x56117f3e3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.492+0000 7f8a93949740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e1d20 0x56117f3e4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.493+0000 7f8a93949740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c1b3b80 con 0x56117f3e1d20 2024-09-19T10:01:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.493+0000 7f8a93949740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c1b56c0 con 0x56117f3e05c0 2024-09-19T10:01:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.493+0000 7f8a93949740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c1b4250 con 0x56117f3e1040 2024-09-19T10:01:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.495+0000 7f8a8affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e05c0 0x56117f3f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.495+0000 7f8a8a7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1040 0x56117f3e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.495+0000 7f8a8affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e05c0 0x56117f3f7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:46498/0 (socket says 172.21.15.18:46498) 2024-09-19T10:01:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.495+0000 7f8a8affd640 1 -- 172.21.15.18:0/304636783 learned_addr learned my addr 172.21.15.18:0/304636783 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.498+0000 7f8a8b7fe640 1 --2- 172.21.15.18:0/304636783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e1d20 0x56117f3e4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.498+0000 7f8a8affd640 1 -- 172.21.15.18:0/304636783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1040 msgr2=0x56117f3e3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.498+0000 7f8a8affd640 1 --2- 172.21.15.18:0/304636783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1040 0x56117f3e3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.498+0000 7f8a8affd640 1 -- 172.21.15.18:0/304636783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e1d20 msgr2=0x56117f3e4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.498+0000 7f8a8affd640 1 --2- 172.21.15.18:0/304636783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e1d20 0x56117f3e4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.498+0000 7f8a8affd640 1 -- 172.21.15.18:0/304636783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56117f3dd9f0 con 0x56117f3e05c0 2024-09-19T10:01:00.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.502+0000 7f8a8affd640 1 --2- 172.21.15.18:0/304636783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e05c0 0x56117f3f7580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009ca0 tx=0x7f8a84049000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b156a314988643e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:00.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.504+0000 7f8a70ff9640 1 -- 172.21.15.18:0/304636783 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84048070 con 0x56117f3e05c0 2024-09-19T10:01:00.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.504+0000 7f8a70ff9640 1 -- 172.21.15.18:0/304636783 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84036070 con 0x56117f3e05c0 2024-09-19T10:01:00.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.504+0000 7f8a70ff9640 1 -- 172.21.15.18:0/304636783 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8404e680 con 0x56117f3e05c0 2024-09-19T10:01:00.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.506+0000 7f8a93949740 1 -- 172.21.15.18:0/304636783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e05c0 msgr2=0x56117f3f7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:00.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.507+0000 7f8a93949740 1 --2- 172.21.15.18:0/304636783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e05c0 0x56117f3f7580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009ca0 tx=0x7f8a84049000 comp rx=0 tx=0).stop 2024-09-19T10:01:00.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.507+0000 7f8a93949740 1 -- 172.21.15.18:0/304636783 shutdown_connections 2024-09-19T10:01:00.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.508+0000 7f8a93949740 1 --2- 172.21.15.18:0/304636783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e1d20 0x56117f3e4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.508+0000 7f8a93949740 1 --2- 172.21.15.18:0/304636783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1040 0x56117f3e3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.508+0000 7f8a93949740 1 --2- 172.21.15.18:0/304636783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e05c0 0x56117f3f7580 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.508+0000 7f8a93949740 1 -- 172.21.15.18:0/304636783 >> 172.21.15.18:0/304636783 conn(0x56117f3a9310 msgr2=0x56117f3dc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:00.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.508+0000 7f8a93949740 1 -- 172.21.15.18:0/304636783 shutdown_connections 2024-09-19T10:01:00.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.508+0000 7f8a93949740 1 -- 172.21.15.18:0/304636783 wait complete. 2024-09-19T10:01:00.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.509+0000 7f8a93949740 1 -- start start 2024-09-19T10:01:00.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.510+0000 7f8a93949740 1 Processor -- start 2024-09-19T10:01:00.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.512+0000 7f8a93949740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 0x56117f3f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.512+0000 7f8a93949740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1040 0x56117f3e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.512+0000 7f8a93949740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1d20 0x56117f3e52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.512+0000 7f8a93949740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c1b4ff0 con 0x56117f3e05c0 2024-09-19T10:01:00.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.513+0000 7f8a8a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1040 0x56117f3e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.513+0000 7f8a8a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1040 0x56117f3e4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:46504/0 (socket says 172.21.15.18:46504) 2024-09-19T10:01:00.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.513+0000 7f8a8a7fc640 1 -- 172.21.15.18:0/1703269806 learned_addr learned my addr 172.21.15.18:0/1703269806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:00.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.514+0000 7f8a8b7fe640 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1d20 0x56117f3e52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.514+0000 7f8a8affd640 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 0x56117f3f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.514+0000 7f8a93949740 1 -- 172.21.15.18:0/1703269806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c1b4920 con 0x56117f3e1040 2024-09-19T10:01:00.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.514+0000 7f8a93949740 1 -- 172.21.15.18:0/1703269806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c1b1b60 con 0x56117f3e1d20 2024-09-19T10:01:00.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.515+0000 7f8a93949740 10 client.0 _ll_register_callbacks cb 0x7f8a84046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:00.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.515+0000 7f8a8a7fc640 1 -- 172.21.15.18:0/1703269806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1d20 msgr2=0x56117f3e52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:00.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.515+0000 7f8a8a7fc640 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1d20 0x56117f3e52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.515+0000 7f8a8a7fc640 1 -- 172.21.15.18:0/1703269806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 msgr2=0x56117f3f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:00.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.515+0000 7f8a8a7fc640 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 0x56117f3f3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.515+0000 7f8a8a7fc640 1 -- 172.21.15.18:0/1703269806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56117f3e5830 con 0x56117f3e1040 2024-09-19T10:01:00.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.516+0000 7f8a8a7fc640 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1040 0x56117f3e4db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x56117f3ea130 tx=0x7f8a7c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89fe4d63851ea25a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:00.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.516+0000 7f8a6eff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:01:00.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.517+0000 7f8a6eff5640 1 -- 172.21.15.18:0/1703269806 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c01e630 con 0x56117f3e1040 2024-09-19T10:01:00.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.517+0000 7f8a6eff5640 1 -- 172.21.15.18:0/1703269806 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8a7c01e7d0 con 0x56117f3e1040 2024-09-19T10:01:00.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.517+0000 7f8a93949740 1 -- 172.21.15.18:0/1703269806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a84036070 con 0x56117f3e1040 2024-09-19T10:01:00.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.518+0000 7f8a6eff5640 1 -- 172.21.15.18:0/1703269806 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8a7c01e9d0 con 0x56117f3e1040 2024-09-19T10:01:00.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.518+0000 7f8a93949740 10 client.26957 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:00.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.518+0000 7f8a93949740 1 -- 172.21.15.18:0/1703269806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56117f3f3390 con 0x56117f3e1040 2024-09-19T10:01:00.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.519+0000 7f8a6eff5640 1 -- 172.21.15.18:0/1703269806 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a7c02a070 con 0x56117f3e1040 2024-09-19T10:01:00.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.520+0000 7f8a6eff5640 1 -- 172.21.15.18:0/1703269806 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8a7c01d3b0 con 0x56117f3e1040 2024-09-19T10:01:00.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.520+0000 7f8a93949740 10 client.26957 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:00.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.520+0000 7f8a93949740 10 client.26957 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:01:00.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.520+0000 7f8a93949740 20 client.26957 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:00.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.520+0000 7f8a93949740 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x56117f466190 0x56117f4685b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:00.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.520+0000 7f8a93949740 4 client.26957 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:01:00.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.520+0000 7f8a93949740 1 -- 172.21.15.18:0/1703269806 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8a84036070 con 0x56117f466190 2024-09-19T10:01:00.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.521+0000 7f8a8affd640 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x56117f466190 0x56117f4685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:00.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.527+0000 7f8a8affd640 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x56117f466190 0x56117f4685b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=16b5893775b1697d server_cookie=ec557ed990a3bbed in_seq=0 out_seq=0 2024-09-19T10:01:00.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.528+0000 7f8a6eff5640 10 client.26957 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:01:00.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.528+0000 7f8a6eff5640 1 -- 172.21.15.18:0/1703269806 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8a84036070 con 0x56117f466190 2024-09-19T10:01:00.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.529+0000 7f8a6eff5640 10 client.26957 handle_command_reply: tid=0 2024-09-19T10:01:00.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.529+0000 7f8a93949740 1 client.26957 shutdown 2024-09-19T10:01:00.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.529+0000 7f8a93949740 1 -- 172.21.15.18:0/1703269806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1040 msgr2=0x56117f3e4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:00.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.530+0000 7f8a93949740 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1040 0x56117f3e4db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x56117f3ea130 tx=0x7f8a7c004730 comp rx=0 tx=0).stop 2024-09-19T10:01:00.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.530+0000 7f8a93949740 1 -- 172.21.15.18:0/1703269806 shutdown_connections 2024-09-19T10:01:00.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.530+0000 7f8a93949740 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x56117f466190 0x56117f4685b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.530+0000 7f8a93949740 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56117f3e1d20 0x56117f3e52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.530+0000 7f8a6eff5640 0 client.26957 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:01:00.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.530+0000 7f8a93949740 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56117f3e1040 0x56117f3e4db0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.530+0000 7f8a93949740 1 --2- 172.21.15.18:0/1703269806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56117f3e05c0 0x56117f3f3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.530+0000 7f8a93949740 1 -- 172.21.15.18:0/1703269806 >> 172.21.15.18:0/1703269806 conn(0x56117f3a9310 msgr2=0x56117f3ec100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.531+0000 7f8a93949740 1 -- 172.21.15.18:0/1703269806 shutdown_connections 2024-09-19T10:01:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.531+0000 7f8a93949740 1 -- 172.21.15.18:0/1703269806 wait complete. 2024-09-19T10:01:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.531+0000 7f8a93949740 20 client.26957 trim_cache size 0 max 16384 2024-09-19T10:01:00.537 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:01:00.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.533+0000 7f8a71ffb640 1 -- 172.21.15.18:0/4144778360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a740a3450 msgr2=0x7f8a740a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:00.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.533+0000 7f8a71ffb640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a740a3450 0x7f8a740a5910 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c07b320 tx=0x7f8a7c00b390 comp rx=0 tx=0).stop 2024-09-19T10:01:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.534+0000 7f8a71ffb640 1 -- 172.21.15.18:0/4144778360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8c06c840 msgr2=0x7f8a8c06ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.534+0000 7f8a71ffb640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8c06c840 0x7f8a8c06ccf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000e740 tx=0x7f8a8000ec00 comp rx=0 tx=0).stop 2024-09-19T10:01:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.534+0000 7f8a71ffb640 1 -- 172.21.15.18:0/4144778360 shutdown_connections 2024-09-19T10:01:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.534+0000 7f8a71ffb640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f8a740a3450 0x7f8a740a5910 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.534+0000 7f8a71ffb640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a8c06c840 0x7f8a8c06ccf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.534+0000 7f8a71ffb640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a8c080680 0x7f8a8c073c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.534+0000 7f8a71ffb640 1 --2- 172.21.15.18:0/4144778360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a8c07c120 0x7f8a8c0736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.534+0000 7f8a71ffb640 1 -- 172.21.15.18:0/4144778360 >> 172.21.15.18:0/4144778360 conn(0x7f8a8c077a10 msgr2=0x7f8a8c07fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.535+0000 7f8a71ffb640 1 -- 172.21.15.18:0/4144778360 shutdown_connections 2024-09-19T10:01:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:00.536+0000 7f8a71ffb640 1 -- 172.21.15.18:0/4144778360 wait complete. 2024-09-19T10:01:00.584 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:00 smithi018 ceph-mon[30956]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 746 MiB/s wr, 1.79k op/s 2024-09-19T10:01:00.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:00 smithi049 ceph-mon[34858]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 746 MiB/s wr, 1.79k op/s 2024-09-19T10:01:00.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:00 smithi162 ceph-mon[35174]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 746 MiB/s wr, 1.79k op/s 2024-09-19T10:01:02.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T10:01:02.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:02 smithi018 ceph-mon[30956]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 790 MiB/s wr, 1.73k op/s 2024-09-19T10:01:02.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:02 smithi049 ceph-mon[34858]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 790 MiB/s wr, 1.73k op/s 2024-09-19T10:01:02.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:02 smithi162 ceph-mon[35174]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 790 MiB/s wr, 1.73k op/s 2024-09-19T10:01:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:01:04.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:04 smithi018 ceph-mon[30956]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 890 MiB/s wr, 1.72k op/s 2024-09-19T10:01:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.133+0000 7fc3da59b640 1 -- 172.21.15.18:0/2719425679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc0aa230 msgr2=0x7fc3cc0aa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.133+0000 7fc3da59b640 1 --2- 172.21.15.18:0/2719425679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc0aa230 0x7fc3cc0aa610 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009900 tx=0x7fc3d002a410 comp rx=0 tx=0).stop 2024-09-19T10:01:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.134+0000 7fc3da59b640 1 -- 172.21.15.18:0/2719425679 shutdown_connections 2024-09-19T10:01:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.134+0000 7fc3da59b640 1 --2- 172.21.15.18:0/2719425679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc0a4d30 0x7fc3cc0a51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.134+0000 7fc3da59b640 1 --2- 172.21.15.18:0/2719425679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0aab50 0x7fc3cc0a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.134+0000 7fc3da59b640 1 --2- 172.21.15.18:0/2719425679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc0aa230 0x7fc3cc0aa610 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.134+0000 7fc3da59b640 1 -- 172.21.15.18:0/2719425679 >> 172.21.15.18:0/2719425679 conn(0x7fc3cc01a0a0 msgr2=0x7fc3cc01a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.134+0000 7fc3da59b640 1 -- 172.21.15.18:0/2719425679 shutdown_connections 2024-09-19T10:01:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.134+0000 7fc3da59b640 1 -- 172.21.15.18:0/2719425679 wait complete. 2024-09-19T10:01:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.135+0000 7fc3da59b640 1 Processor -- start 2024-09-19T10:01:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.136+0000 7fc3da59b640 1 -- start start 2024-09-19T10:01:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.136+0000 7fc3da59b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc0a4d30 0x7fc3cc0ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.136+0000 7fc3da59b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc0aa230 0x7fc3cc0ba800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.136+0000 7fc3d9599640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc0a4d30 0x7fc3cc0ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.136+0000 7fc3d9599640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc0a4d30 0x7fc3cc0ba2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:46520/0 (socket says 172.21.15.18:46520) 2024-09-19T10:01:05.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.136+0000 7fc3d9599640 1 -- 172.21.15.18:0/165366449 learned_addr learned my addr 172.21.15.18:0/165366449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:05.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.137+0000 7fc3da59b640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0aab50 0x7fc3cc0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.137+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc0bd060 con 0x7fc3cc0aa230 2024-09-19T10:01:05.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.137+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0aab50 0x7fc3cc0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.137+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc0bcee0 con 0x7fc3cc0a4d30 2024-09-19T10:01:05.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.137+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc0bd1e0 con 0x7fc3cc0aab50 2024-09-19T10:01:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.138+0000 7fc3d9d9a640 1 -- 172.21.15.18:0/165366449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc0a4d30 msgr2=0x7fc3cc0ba2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.138+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc0a4d30 0x7fc3cc0ba2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.138+0000 7fc3d9d9a640 1 -- 172.21.15.18:0/165366449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc0aa230 msgr2=0x7fc3cc0ba800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.138+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc0aa230 0x7fc3cc0ba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.138+0000 7fc3d9d9a640 1 -- 172.21.15.18:0/165366449 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc0b3b50 con 0x7fc3cc0aab50 2024-09-19T10:01:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.138+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0aab50 0x7fc3cc0b3350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4051790 tx=0x7fc3d406dc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.139+0000 7fc3ca7fc640 1 -- 172.21.15.18:0/165366449 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d407e070 con 0x7fc3cc0aab50 2024-09-19T10:01:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.139+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc0b3e40 con 0x7fc3cc0aab50 2024-09-19T10:01:05.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.139+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc0b7df0 con 0x7fc3cc0aab50 2024-09-19T10:01:05.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.139+0000 7fc3ca7fc640 1 -- 172.21.15.18:0/165366449 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d406bc70 con 0x7fc3cc0aab50 2024-09-19T10:01:05.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.141+0000 7fc3ca7fc640 1 -- 172.21.15.18:0/165366449 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4076560 con 0x7fc3cc0aab50 2024-09-19T10:01:05.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.143+0000 7fc3ca7fc640 1 -- 172.21.15.18:0/165366449 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc3d4077360 con 0x7fc3cc0aab50 2024-09-19T10:01:05.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:04 smithi049 ceph-mon[34858]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 890 MiB/s wr, 1.72k op/s 2024-09-19T10:01:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.147+0000 7fc3ca7fc640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3c00a3300 0x7fc3c00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.148+0000 7fc3ca7fc640 1 -- 172.21.15.18:0/165366449 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc3d4132be0 con 0x7fc3cc0aab50 2024-09-19T10:01:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.148+0000 7fc3ddbd6740 1 Processor -- start 2024-09-19T10:01:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.148+0000 7fc3ddbd6740 1 -- start start 2024-09-19T10:01:05.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.149+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 0x55797f420270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.149+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f4207b0 0x55797f420bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.149+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 0x55797f42d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.149+0000 7fc3ddbd6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55797f3862f0 con 0x55797f42b550 2024-09-19T10:01:05.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.149+0000 7fc3ddbd6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55797f32dcf0 con 0x55797f421d20 2024-09-19T10:01:05.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.149+0000 7fc3ddbd6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55797f3822b0 con 0x55797f4207b0 2024-09-19T10:01:05.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.150+0000 7fc3d9599640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 0x55797f420270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.150+0000 7fc3d9599640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 0x55797f420270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:46536/0 (socket says 172.21.15.18:46536) 2024-09-19T10:01:05.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.150+0000 7fc3d9599640 1 -- 172.21.15.18:0/1987922498 learned_addr learned my addr 172.21.15.18:0/1987922498 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:05.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.150+0000 7fc3d8d98640 1 --2- 172.21.15.18:0/1987922498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f4207b0 0x55797f420bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.150+0000 7fc3d9599640 1 -- 172.21.15.18:0/1987922498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f4207b0 msgr2=0x55797f420bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:05.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.150+0000 7fc3d9599640 1 --2- 172.21.15.18:0/1987922498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f4207b0 0x55797f420bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.150+0000 7fc3d9599640 1 -- 172.21.15.18:0/1987922498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 msgr2=0x55797f42d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:05.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.150+0000 7fc3d9599640 1 --2- 172.21.15.18:0/1987922498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 0x55797f42d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.150+0000 7fc3d9599640 1 -- 172.21.15.18:0/1987922498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55797f3123a0 con 0x55797f421d20 2024-09-19T10:01:05.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.150+0000 7fc3d9599640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3c00a3300 0x7fc3c00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.151+0000 7fc3d8d98640 1 --2- 172.21.15.18:0/1987922498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f4207b0 0x55797f420bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:01:05.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.152+0000 7fc3d9599640 1 --2- 172.21.15.18:0/1987922498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 0x55797f420270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0031520 tx=0x7fc3d0032640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4efb634b787badf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:05.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.152+0000 7fc3bf7fe640 1 -- 172.21.15.18:0/1987922498 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d004e070 con 0x55797f421d20 2024-09-19T10:01:05.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.152+0000 7fc3bf7fe640 1 -- 172.21.15.18:0/1987922498 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d003cbb0 con 0x55797f421d20 2024-09-19T10:01:05.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.152+0000 7fc3bf7fe640 1 -- 172.21.15.18:0/1987922498 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0035040 con 0x55797f421d20 2024-09-19T10:01:05.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.153+0000 7fc3d9599640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3c00a3300 0x7fc3c00a57c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc3d004b000 tx=0x7fc3d003dea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:05.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.153+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/1987922498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 msgr2=0x55797f420270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:05.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.153+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/1987922498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 0x55797f420270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0031520 tx=0x7fc3d0032640 comp rx=0 tx=0).stop 2024-09-19T10:01:05.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.153+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/1987922498 shutdown_connections 2024-09-19T10:01:05.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.153+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/1987922498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 0x55797f42d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.153+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/1987922498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f4207b0 0x55797f420bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.153+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/1987922498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 0x55797f420270 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.153+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/1987922498 >> 172.21.15.18:0/1987922498 conn(0x55797f3e9310 msgr2=0x55797f41ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:05.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.153+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/1987922498 shutdown_connections 2024-09-19T10:01:05.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.153+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/1987922498 wait complete. 2024-09-19T10:01:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.154+0000 7fc3ddbd6740 1 -- start start 2024-09-19T10:01:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.154+0000 7fc3ddbd6740 1 Processor -- start 2024-09-19T10:01:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.155+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f4207b0 0x55797f42af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.155+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 0x55797f428200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.156+0000 7fc3d9599640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f4207b0 0x55797f42af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.156+0000 7fc3d9599640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f4207b0 0x55797f42af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51994/0 (socket says 172.21.15.18:51994) 2024-09-19T10:01:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.156+0000 7fc3d9599640 1 -- 172.21.15.18:0/260459966 learned_addr learned my addr 172.21.15.18:0/260459966 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:05.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.156+0000 7fc3d8d98640 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 0x55797f428200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.156+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f42b550 0x55797f4287f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.156+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55797f42e250 con 0x55797f4207b0 2024-09-19T10:01:05.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.156+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f42b550 0x55797f4287f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.156+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55797f341060 con 0x55797f421d20 2024-09-19T10:01:05.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.156+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55797f42e3d0 con 0x55797f42b550 2024-09-19T10:01:05.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.156+0000 7fc3ddbd6740 10 client.0 _ll_register_callbacks cb 0x55797f0948c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:05.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.157+0000 7fc3d9d9a640 1 -- 172.21.15.18:0/260459966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 msgr2=0x55797f428200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:05.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.157+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 0x55797f428200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.157+0000 7fc3d9d9a640 1 -- 172.21.15.18:0/260459966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f4207b0 msgr2=0x55797f42af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:05.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.157+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f4207b0 0x55797f42af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.157+0000 7fc3d9d9a640 1 -- 172.21.15.18:0/260459966 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55797f0f73c0 con 0x55797f42b550 2024-09-19T10:01:05.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.157+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f42b550 0x55797f4287f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55797f421250 tx=0x7fc3d40fedd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67c007a5c16d9901 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:05.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.157+0000 7fc3bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:01:05.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.157+0000 7fc3bcff9640 1 -- 172.21.15.18:0/260459966 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4103370 con 0x55797f42b550 2024-09-19T10:01:05.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.157+0000 7fc3bcff9640 1 -- 172.21.15.18:0/260459966 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc3d41079b0 con 0x55797f42b550 2024-09-19T10:01:05.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.158+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3d003cbb0 con 0x55797f42b550 2024-09-19T10:01:05.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.158+0000 7fc3bcff9640 1 -- 172.21.15.18:0/260459966 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc3d40ff8d0 con 0x55797f42b550 2024-09-19T10:01:05.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.158+0000 7fc3ddbd6740 10 client.26986 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:05.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.158+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55797f439cf0 con 0x55797f42b550 2024-09-19T10:01:05.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.158+0000 7fc3bcff9640 1 -- 172.21.15.18:0/260459966 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d40ff1d0 con 0x55797f42b550 2024-09-19T10:01:05.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.159+0000 7fc3bcff9640 1 -- 172.21.15.18:0/260459966 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc3d40fe620 con 0x55797f42b550 2024-09-19T10:01:05.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.159+0000 7fc3ddbd6740 10 client.26986 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:05.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.159+0000 7fc3ddbd6740 10 client.26986 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:01:05.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.159+0000 7fc3ddbd6740 20 client.26986 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:05.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.159+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55797f43b200 0x55797f43d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.159+0000 7fc3ddbd6740 4 client.26986 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:05.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:04 smithi162 ceph-mon[35174]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 890 MiB/s wr, 1.72k op/s 2024-09-19T10:01:05.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.159+0000 7fc3d9599640 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55797f43b200 0x55797f43d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.160+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc3d003cbb0 con 0x55797f43b200 2024-09-19T10:01:05.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.160+0000 7fc3d9599640 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55797f43b200 0x55797f43d5f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d18e8e0d85e95fd8 server_cookie=5f863d144e108e02 in_seq=0 out_seq=0 2024-09-19T10:01:05.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.160+0000 7fc3bcff9640 10 client.26986 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:01:05.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.161+0000 7fc3bcff9640 1 -- 172.21.15.18:0/260459966 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc3d003cbb0 con 0x55797f43b200 2024-09-19T10:01:05.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.161+0000 7fc3bcff9640 10 client.26986 handle_command_reply: tid=0 2024-09-19T10:01:05.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.161+0000 7fc3ddbd6740 1 client.26986 shutdown 2024-09-19T10:01:05.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.161+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f42b550 msgr2=0x55797f4287f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:05.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.161+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f42b550 0x55797f4287f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55797f421250 tx=0x7fc3d40fedd0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.161+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 shutdown_connections 2024-09-19T10:01:05.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.161+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55797f43b200 0x55797f43d5f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.161+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f42b550 0x55797f4287f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.161+0000 7fc3bcff9640 0 client.26986 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:01:05.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.162+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f421d20 0x55797f428200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.162+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/260459966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f4207b0 0x55797f42af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.162+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 >> 172.21.15.18:0/260459966 conn(0x55797f3e9310 msgr2=0x55797f422b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:05.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.162+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 shutdown_connections 2024-09-19T10:01:05.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.162+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/260459966 wait complete. 2024-09-19T10:01:05.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.162+0000 7fc3ddbd6740 20 client.26986 trim_cache size 0 max 16384 2024-09-19T10:01:05.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.192+0000 7fc3ddbd6740 1 Processor -- start 2024-09-19T10:01:05.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.192+0000 7fc3ddbd6740 1 -- start start 2024-09-19T10:01:05.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.192+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f4207b0 0x55797f41cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.192+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f421d20 0x55797f42a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.193+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f42b550 0x55797f423300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.193+0000 7fc3ddbd6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b800e440 con 0x55797f421d20 2024-09-19T10:01:05.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.193+0000 7fc3ddbd6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b800ff80 con 0x55797f4207b0 2024-09-19T10:01:05.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.193+0000 7fc3ddbd6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b800eb10 con 0x55797f42b550 2024-09-19T10:01:05.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.193+0000 7fc3d8d98640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f421d20 0x55797f42a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.193+0000 7fc3d8d98640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f421d20 0x55797f42a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52002/0 (socket says 172.21.15.18:52002) 2024-09-19T10:01:05.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.193+0000 7fc3d8d98640 1 -- 172.21.15.18:0/4235448030 learned_addr learned my addr 172.21.15.18:0/4235448030 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:05.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.194+0000 7fc3d8d98640 1 -- 172.21.15.18:0/4235448030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f42b550 msgr2=0x55797f423300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:01:05.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.194+0000 7fc3d8d98640 1 --2- 172.21.15.18:0/4235448030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f42b550 0x55797f423300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.194+0000 7fc3d8d98640 1 -- 172.21.15.18:0/4235448030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f4207b0 msgr2=0x55797f41cf50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:01:05.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.194+0000 7fc3d8d98640 1 --2- 172.21.15.18:0/4235448030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f4207b0 0x55797f41cf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.194+0000 7fc3d8d98640 1 -- 172.21.15.18:0/4235448030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55797f4204b0 con 0x55797f421d20 2024-09-19T10:01:05.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.194+0000 7fc3d8d98640 1 --2- 172.21.15.18:0/4235448030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f421d20 0x55797f42a170 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0b4b10 tx=0x7fc3c400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49017a265bf01277 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:05.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.194+0000 7fc3beffd640 1 -- 172.21.15.18:0/4235448030 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400fd20 con 0x55797f421d20 2024-09-19T10:01:05.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.195+0000 7fc3beffd640 1 -- 172.21.15.18:0/4235448030 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c4013920 con 0x55797f421d20 2024-09-19T10:01:05.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.195+0000 7fc3beffd640 1 -- 172.21.15.18:0/4235448030 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40129b0 con 0x55797f421d20 2024-09-19T10:01:05.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.196+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/4235448030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f421d20 msgr2=0x55797f42a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:05.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.196+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/4235448030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f421d20 0x55797f42a170 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0b4b10 tx=0x7fc3c400aec0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.199+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/4235448030 shutdown_connections 2024-09-19T10:01:05.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.199+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/4235448030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f42b550 0x55797f423300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.199+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/4235448030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f421d20 0x55797f42a170 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.199+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/4235448030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f4207b0 0x55797f41cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.199+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/4235448030 >> 172.21.15.18:0/4235448030 conn(0x55797f3e9310 msgr2=0x55797f429a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:05.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.201+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/4235448030 shutdown_connections 2024-09-19T10:01:05.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.201+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/4235448030 wait complete. 2024-09-19T10:01:05.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.202+0000 7fc3ddbd6740 1 -- start start 2024-09-19T10:01:05.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.202+0000 7fc3ddbd6740 1 Processor -- start 2024-09-19T10:01:05.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.203+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f4207b0 0x55797f433f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.203+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f421d20 0x55797f42f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.203+0000 7fc3ddbd6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 0x55797f42faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.204+0000 7fc3ddbd6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b800f8b0 con 0x55797f42b550 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.204+0000 7fc3ddbd6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b800f1e0 con 0x55797f4207b0 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.204+0000 7fc3ddbd6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b800c420 con 0x55797f421d20 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.204+0000 7fc3ddbd6740 10 client.0 _ll_register_callbacks cb 0x7fc3d40fefa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.204+0000 7fc3d9d9a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 0x55797f42faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.204+0000 7fc3d9d9a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 0x55797f42faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52018/0 (socket says 172.21.15.18:52018) 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.204+0000 7fc3d9d9a640 1 -- 172.21.15.18:0/79049333 learned_addr learned my addr 172.21.15.18:0/79049333 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.204+0000 7fc3d9599640 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f4207b0 0x55797f433f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.205+0000 7fc3d8d98640 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f421d20 0x55797f42f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.205+0000 7fc3d9d9a640 1 -- 172.21.15.18:0/79049333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f421d20 msgr2=0x55797f42f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:05.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.205+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f421d20 0x55797f42f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.205+0000 7fc3d9d9a640 1 -- 172.21.15.18:0/79049333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f4207b0 msgr2=0x55797f433f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:05.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.205+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f4207b0 0x55797f433f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.205+0000 7fc3d9d9a640 1 -- 172.21.15.18:0/79049333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55797f4a4e70 con 0x55797f42b550 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.205+0000 7fc3d9d9a640 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 0x55797f42faa0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4067bf0 tx=0x7fc3d41033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39329b40ee13e1c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.205+0000 7fc3bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.206+0000 7fc3bcff9640 1 -- 172.21.15.18:0/79049333 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4077850 con 0x55797f42b550 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.206+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/79049333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c4013920 con 0x55797f42b550 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.206+0000 7fc3bcff9640 1 -- 172.21.15.18:0/79049333 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc3d40faf20 con 0x55797f42b550 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.206+0000 7fc3bcff9640 1 -- 172.21.15.18:0/79049333 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc3d406be20 con 0x55797f42b550 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.206+0000 7fc3ddbd6740 10 client.17541 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.206+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/79049333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55797f4a5fc0 con 0x55797f42b550 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.207+0000 7fc3bcff9640 1 -- 172.21.15.18:0/79049333 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d4107bc0 con 0x55797f42b550 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.207+0000 7fc3bcff9640 1 -- 172.21.15.18:0/79049333 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc3d4104710 con 0x55797f42b550 2024-09-19T10:01:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.208+0000 7fc3ddbd6740 10 client.17541 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.208+0000 7fc3ddbd6740 10 client.17541 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:01:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.208+0000 7fc3ddbd6740 20 client.17541 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.208+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55797f43b200 0x55797f4a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.208+0000 7fc3ddbd6740 4 client.17541 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:01:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.208+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/79049333 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fc3c4013920 con 0x55797f43b200 2024-09-19T10:01:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.209+0000 7fc3d9599640 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55797f43b200 0x55797f4a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.210+0000 7fc3d9599640 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55797f43b200 0x55797f4a85a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=86dbfb030d0b6dbe server_cookie=8d1826c924d66d5f in_seq=0 out_seq=0 2024-09-19T10:01:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.214+0000 7fc3bcff9640 10 client.17541 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:01:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.214+0000 7fc3bcff9640 1 -- 172.21.15.18:0/79049333 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc3c4013920 con 0x55797f43b200 2024-09-19T10:01:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.214+0000 7fc3bcff9640 10 client.17541 handle_command_reply: tid=0 2024-09-19T10:01:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.214+0000 7fc3ddbd6740 1 client.17541 shutdown 2024-09-19T10:01:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.214+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/79049333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 msgr2=0x55797f42faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.214+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 0x55797f42faa0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4067bf0 tx=0x7fc3d41033a0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.215+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/79049333 shutdown_connections 2024-09-19T10:01:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.215+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55797f43b200 0x55797f4a85a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.215+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55797f42b550 0x55797f42faa0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.215+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55797f421d20 0x55797f42f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.215+0000 7fc3ddbd6740 1 --2- 172.21.15.18:0/79049333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55797f4207b0 0x55797f433f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.215+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/79049333 >> 172.21.15.18:0/79049333 conn(0x55797f3e9310 msgr2=0x55797f428080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.215+0000 7fc3bcff9640 0 client.17541 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:01:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.216+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/79049333 shutdown_connections 2024-09-19T10:01:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.216+0000 7fc3ddbd6740 1 -- 172.21.15.18:0/79049333 wait complete. 2024-09-19T10:01:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.216+0000 7fc3ddbd6740 20 client.17541 trim_cache size 0 max 16384 2024-09-19T10:01:05.223 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:01:05.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.220+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3c00a3300 msgr2=0x7fc3c00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:05.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.220+0000 7fc3da59b640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3c00a3300 0x7fc3c00a57c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc3d004b000 tx=0x7fc3d003dea0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.220+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0aab50 msgr2=0x7fc3cc0b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:05.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.220+0000 7fc3da59b640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0aab50 0x7fc3cc0b3350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4051790 tx=0x7fc3d406dc50 comp rx=0 tx=0).stop 2024-09-19T10:01:05.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.220+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 shutdown_connections 2024-09-19T10:01:05.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.220+0000 7fc3da59b640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fc3c00a3300 0x7fc3c00a57c0 secure :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc3d004b000 tx=0x7fc3d003dea0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.220+0000 7fc3da59b640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3cc0aab50 0x7fc3cc0b3350 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.220+0000 7fc3da59b640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3cc0aa230 0x7fc3cc0ba800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.220+0000 7fc3da59b640 1 --2- 172.21.15.18:0/165366449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3cc0a4d30 0x7fc3cc0ba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:05.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.220+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 >> 172.21.15.18:0/165366449 conn(0x7fc3cc01a0a0 msgr2=0x7fc3cc0a6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:05.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.221+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 shutdown_connections 2024-09-19T10:01:05.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:05.221+0000 7fc3da59b640 1 -- 172.21.15.18:0/165366449 wait complete. 2024-09-19T10:01:06.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:05 smithi018 ceph-mon[30956]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 784 MiB/s wr, 1.35k op/s 2024-09-19T10:01:06.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:05 smithi049 ceph-mon[34858]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 784 MiB/s wr, 1.35k op/s 2024-09-19T10:01:06.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:05 smithi162 ceph-mon[35174]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 784 MiB/s wr, 1.35k op/s 2024-09-19T10:01:06.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T10:01:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:01:08.120 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:07 smithi018 ceph-mon[30956]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 840 MiB/s wr, 1.47k op/s 2024-09-19T10:01:08.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:07 smithi049 ceph-mon[34858]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 840 MiB/s wr, 1.47k op/s 2024-09-19T10:01:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:07 smithi162 ceph-mon[35174]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 840 MiB/s wr, 1.47k op/s 2024-09-19T10:01:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.583+0000 7fe49bfff640 1 -- 172.21.15.18:0/234620811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe49c1068d0 msgr2=0x7fe49c106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.583+0000 7fe49bfff640 1 --2- 172.21.15.18:0/234620811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe49c1068d0 0x7fe49c106cb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe494009cd0 tx=0x7fe49402c7e0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.583+0000 7fe49bfff640 1 -- 172.21.15.18:0/234620811 shutdown_connections 2024-09-19T10:01:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.583+0000 7fe49bfff640 1 --2- 172.21.15.18:0/234620811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49c101270 0x7fe49c10d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.583+0000 7fe49bfff640 1 --2- 172.21.15.18:0/234620811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe49c1008d0 0x7fe49c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.583+0000 7fe49bfff640 1 --2- 172.21.15.18:0/234620811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe49c1068d0 0x7fe49c106cb0 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe494009cd0 tx=0x7fe49402c7e0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.583+0000 7fe49bfff640 1 -- 172.21.15.18:0/234620811 >> 172.21.15.18:0/234620811 conn(0x7fe49c0fc610 msgr2=0x7fe49c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.590+0000 7fe49bfff640 1 -- 172.21.15.18:0/234620811 shutdown_connections 2024-09-19T10:01:08.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.593+0000 7fe49bfff640 1 -- 172.21.15.18:0/234620811 wait complete. 2024-09-19T10:01:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.595+0000 7fe49bfff640 1 Processor -- start 2024-09-19T10:01:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.595+0000 7fe49bfff640 1 -- start start 2024-09-19T10:01:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.596+0000 7fe49bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe49c1008d0 0x7fe49c1a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.596+0000 7fe49bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49c101270 0x7fe49c1a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.596+0000 7fe49bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe49c19e8f0 0x7fe49c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.596+0000 7fe49bfff640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1183f0 con 0x7fe49c101270 2024-09-19T10:01:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.596+0000 7fe49bfff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c118270 con 0x7fe49c1008d0 2024-09-19T10:01:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.596+0000 7fe49bfff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c118570 con 0x7fe49c19e8f0 2024-09-19T10:01:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.598+0000 7fe49affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe49c1008d0 0x7fe49c1a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.601+0000 7fe49affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe49c1008d0 0x7fe49c1a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50612/0 (socket says 172.21.15.18:50612) 2024-09-19T10:01:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.601+0000 7fe49affd640 1 -- 172.21.15.18:0/3578665134 learned_addr learned my addr 172.21.15.18:0/3578665134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:08.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.605+0000 7fe49b7fe640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe49c19e8f0 0x7fe49c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.606+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49c101270 0x7fe49c1a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.606+0000 7fe49affd640 1 -- 172.21.15.18:0/3578665134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe49c19e8f0 msgr2=0x7fe49c19eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:08.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.606+0000 7fe49affd640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe49c19e8f0 0x7fe49c19eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.606+0000 7fe49affd640 1 -- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49c101270 msgr2=0x7fe49c1a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:08.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.606+0000 7fe49affd640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49c101270 0x7fe49c1a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.609+0000 7fe49affd640 1 -- 172.21.15.18:0/3578665134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c19f410 con 0x7fe49c1008d0 2024-09-19T10:01:08.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.609+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49c101270 0x7fe49c1a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:01:08.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.618+0000 7fe49affd640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe49c1008d0 0x7fe49c1a4730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe494009ca0 tx=0x7fe494031ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.620+0000 7fe483fff640 1 -- 172.21.15.18:0/3578665134 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494041020 con 0x7fe49c1008d0 2024-09-19T10:01:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.620+0000 7fe483fff640 1 -- 172.21.15.18:0/3578665134 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4940339f0 con 0x7fe49c1008d0 2024-09-19T10:01:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.620+0000 7fe483fff640 1 -- 172.21.15.18:0/3578665134 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494004800 con 0x7fe49c1008d0 2024-09-19T10:01:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.621+0000 7fe49bfff640 1 -- 172.21.15.18:0/3578665134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49c19f6a0 con 0x7fe49c1008d0 2024-09-19T10:01:08.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.621+0000 7fe49bfff640 1 -- 172.21.15.18:0/3578665134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49c1ab7d0 con 0x7fe49c1008d0 2024-09-19T10:01:08.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.627+0000 7fe4a3913740 1 Processor -- start 2024-09-19T10:01:08.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.627+0000 7fe4a3913740 1 -- start start 2024-09-19T10:01:08.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.627+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f81020 0x555f93f7f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.627+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f7fab0 0x555f93f7fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.627+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f9b860 0x555f93f9dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.627+0000 7fe4a3913740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555f93ee52f0 con 0x555f93f9b860 2024-09-19T10:01:08.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.627+0000 7fe4a3913740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555f93e8ccf0 con 0x555f93f81020 2024-09-19T10:01:08.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.627+0000 7fe4a3913740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555f93ee12b0 con 0x555f93f7fab0 2024-09-19T10:01:08.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.630+0000 7fe49a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f9b860 0x555f93f9dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.630+0000 7fe49a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f9b860 0x555f93f9dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48926/0 (socket says 172.21.15.18:48926) 2024-09-19T10:01:08.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.630+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1733206587 learned_addr learned my addr 172.21.15.18:0/1733206587 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:08.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.630+0000 7fe49b7fe640 1 --2- 172.21.15.18:0/1733206587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f81020 0x555f93f7f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.631+0000 7fe49affd640 1 --2- 172.21.15.18:0/1733206587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f7fab0 0x555f93f7fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.634+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1733206587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f7fab0 msgr2=0x555f93f7fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.634+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/1733206587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f7fab0 0x555f93f7fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.634+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1733206587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f81020 msgr2=0x555f93f7f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.634+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/1733206587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f81020 0x555f93f7f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.635+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1733206587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f93e713a0 con 0x555f93f9b860 2024-09-19T10:01:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.637+0000 7fe483fff640 1 -- 172.21.15.18:0/3578665134 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe494044020 con 0x7fe49c1008d0 2024-09-19T10:01:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.639+0000 7fe483fff640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4840a34a0 0x7fe4840a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.639+0000 7fe483fff640 1 -- 172.21.15.18:0/3578665134 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe4940f42b0 con 0x7fe49c1008d0 2024-09-19T10:01:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.641+0000 7fe49b7fe640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4840a34a0 0x7fe4840a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.643+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/1733206587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f9b860 0x555f93f9dc50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fe490009ca0 tx=0x7fe490010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbdbbdcdbfc2c0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.644+0000 7fe49b7fe640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4840a34a0 0x7fe4840a5960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009bc0 tx=0x7fe48c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.644+0000 7fe480ff9640 1 -- 172.21.15.18:0/1733206587 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490004030 con 0x555f93f9b860 2024-09-19T10:01:08.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.651+0000 7fe480ff9640 1 -- 172.21.15.18:0/1733206587 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4900041d0 con 0x555f93f9b860 2024-09-19T10:01:08.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.651+0000 7fe480ff9640 1 -- 172.21.15.18:0/1733206587 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490012780 con 0x555f93f9b860 2024-09-19T10:01:08.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.653+0000 7fe4a3913740 1 -- 172.21.15.18:0/1733206587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f9b860 msgr2=0x555f93f9dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:08.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.653+0000 7fe4a3913740 1 --2- 172.21.15.18:0/1733206587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f9b860 0x555f93f9dc50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fe490009ca0 tx=0x7fe490010740 comp rx=0 tx=0).stop 2024-09-19T10:01:08.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.653+0000 7fe4a3913740 1 -- 172.21.15.18:0/1733206587 shutdown_connections 2024-09-19T10:01:08.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.653+0000 7fe4a3913740 1 --2- 172.21.15.18:0/1733206587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f9b860 0x555f93f9dc50 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.653+0000 7fe4a3913740 1 --2- 172.21.15.18:0/1733206587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f7fab0 0x555f93f7fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.653+0000 7fe4a3913740 1 --2- 172.21.15.18:0/1733206587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f81020 0x555f93f7f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.653+0000 7fe4a3913740 1 -- 172.21.15.18:0/1733206587 >> 172.21.15.18:0/1733206587 conn(0x555f93f48310 msgr2=0x555f93f7c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.654+0000 7fe4a3913740 1 -- 172.21.15.18:0/1733206587 shutdown_connections 2024-09-19T10:01:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.655+0000 7fe4a3913740 1 -- 172.21.15.18:0/1733206587 wait complete. 2024-09-19T10:01:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.655+0000 7fe4a3913740 1 -- start start 2024-09-19T10:01:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.656+0000 7fe4a3913740 1 Processor -- start 2024-09-19T10:01:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.657+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f7fab0 0x555f93f9b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.658+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 0x555f93f982f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.658+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f9b860 0x555f93f98830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.658+0000 7fe4a3913740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555f93f9e470 con 0x555f93f81020 2024-09-19T10:01:08.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.658+0000 7fe4a3913740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555f93ea0060 con 0x555f93f9b860 2024-09-19T10:01:08.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.658+0000 7fe4a3913740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555f93f9e5f0 con 0x555f93f7fab0 2024-09-19T10:01:08.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.658+0000 7fe4a3913740 10 client.0 _ll_register_callbacks cb 0x555f93bf38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:08.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.659+0000 7fe49a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 0x555f93f982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.659+0000 7fe49a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 0x555f93f982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48934/0 (socket says 172.21.15.18:48934) 2024-09-19T10:01:08.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.659+0000 7fe49a7fc640 1 -- 172.21.15.18:0/3914137442 learned_addr learned my addr 172.21.15.18:0/3914137442 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:08.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.660+0000 7fe49b7fe640 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f9b860 0x555f93f98830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.661+0000 7fe49a7fc640 1 -- 172.21.15.18:0/3914137442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f7fab0 msgr2=0x555f93f9b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:08.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.661+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f7fab0 0x555f93f9b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.661+0000 7fe49a7fc640 1 -- 172.21.15.18:0/3914137442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f9b860 msgr2=0x555f93f98830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:08.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.661+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f9b860 0x555f93f98830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.661+0000 7fe49a7fc640 1 -- 172.21.15.18:0/3914137442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f93c563c0 con 0x555f93f81020 2024-09-19T10:01:08.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.664+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 0x555f93f982f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fe490003e60 tx=0x7fe490009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728c3b16dec79764 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:08.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.664+0000 7fe47eff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:01:08.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.665+0000 7fe47eff5640 1 -- 172.21.15.18:0/3914137442 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490004000 con 0x555f93f81020 2024-09-19T10:01:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.665+0000 7fe4a3913740 1 -- 172.21.15.18:0/3914137442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4900041d0 con 0x555f93f81020 2024-09-19T10:01:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.665+0000 7fe47eff5640 1 -- 172.21.15.18:0/3914137442 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe490004380 con 0x555f93f81020 2024-09-19T10:01:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.666+0000 7fe47eff5640 1 -- 172.21.15.18:0/3914137442 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe490005030 con 0x555f93f81020 2024-09-19T10:01:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.666+0000 7fe4a3913740 10 client.17550 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.666+0000 7fe4a3913740 1 -- 172.21.15.18:0/3914137442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555f93fa9d40 con 0x555f93f81020 2024-09-19T10:01:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.668+0000 7fe47eff5640 1 -- 172.21.15.18:0/3914137442 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4900041d0 con 0x555f93f81020 2024-09-19T10:01:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.675+0000 7fe47eff5640 1 -- 172.21.15.18:0/3914137442 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe49000f040 con 0x555f93f81020 2024-09-19T10:01:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.675+0000 7fe4a3913740 10 client.17550 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.675+0000 7fe4a3913740 10 client.17550 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.675+0000 7fe4a3913740 20 client.17550 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.675+0000 7fe4a3913740 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555f93fab520 0x555f93fad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.675+0000 7fe4a3913740 4 client.17550 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.675+0000 7fe4a3913740 1 -- 172.21.15.18:0/3914137442 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f93ef2860 con 0x555f93fab520 2024-09-19T10:01:08.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.679+0000 7fe49affd640 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555f93fab520 0x555f93fad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.686+0000 7fe47eff5640 10 client.17550 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.686+0000 7fe49affd640 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555f93fab520 0x555f93fad990 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3d0e704609de108 server_cookie=812f6dfc1d000ee6 in_seq=0 out_seq=0 2024-09-19T10:01:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.690+0000 7fe47eff5640 1 -- 172.21.15.18:0/3914137442 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f93ef2860 con 0x555f93fab520 2024-09-19T10:01:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.691+0000 7fe47eff5640 10 client.17550 handle_command_reply: tid=0 2024-09-19T10:01:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.691+0000 7fe4a3913740 1 client.17550 shutdown 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.692+0000 7fe4a3913740 1 -- 172.21.15.18:0/3914137442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 msgr2=0x555f93f982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.692+0000 7fe4a3913740 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 0x555f93f982f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fe490003e60 tx=0x7fe490009fc0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.693+0000 7fe4a3913740 1 -- 172.21.15.18:0/3914137442 shutdown_connections 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.693+0000 7fe4a3913740 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555f93fab520 0x555f93fad990 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.693+0000 7fe4a3913740 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f9b860 0x555f93f98830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.693+0000 7fe4a3913740 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 0x555f93f982f0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.693+0000 7fe4a3913740 1 --2- 172.21.15.18:0/3914137442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f7fab0 0x555f93f9b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.693+0000 7fe4a3913740 1 -- 172.21.15.18:0/3914137442 >> 172.21.15.18:0/3914137442 conn(0x555f93f48310 msgr2=0x555f93f81e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.693+0000 7fe47eff5640 0 client.17550 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.693+0000 7fe4a3913740 1 -- 172.21.15.18:0/3914137442 shutdown_connections 2024-09-19T10:01:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.693+0000 7fe4a3913740 1 -- 172.21.15.18:0/3914137442 wait complete. 2024-09-19T10:01:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.698+0000 7fe4a3913740 20 client.17550 trim_cache size 0 max 16384 2024-09-19T10:01:08.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.746+0000 7fe4a3913740 1 Processor -- start 2024-09-19T10:01:08.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.747+0000 7fe4a3913740 1 -- start start 2024-09-19T10:01:08.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.748+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f48310 0x555f93f7c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.749+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f7fab0 0x555f93fb32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.749+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f81020 0x555f93fb37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.750+0000 7fe49affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f48310 0x555f93f7c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.750+0000 7fe49affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f48310 0x555f93f7c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48950/0 (socket says 172.21.15.18:48950) 2024-09-19T10:01:08.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.750+0000 7fe4a3913740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c074070 con 0x555f93f48310 2024-09-19T10:01:08.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.750+0000 7fe4a3913740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1ad190 con 0x555f93f7fab0 2024-09-19T10:01:08.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.751+0000 7fe4a3913740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1abd20 con 0x555f93f81020 2024-09-19T10:01:08.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.751+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f81020 0x555f93fb37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.751+0000 7fe49a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f7fab0 0x555f93fb32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.751+0000 7fe49a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f7fab0 0x555f93fb32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50626/0 (socket says 172.21.15.18:50626) 2024-09-19T10:01:08.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.751+0000 7fe49a7fc640 1 -- 172.21.15.18:0/2004054525 learned_addr learned my addr 172.21.15.18:0/2004054525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:08.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.755+0000 7fe49a7fc640 1 -- 172.21.15.18:0/2004054525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f81020 msgr2=0x555f93fb37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:08.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.755+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/2004054525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f81020 0x555f93fb37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.755+0000 7fe49a7fc640 1 -- 172.21.15.18:0/2004054525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f48310 msgr2=0x555f93f7c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:08.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.755+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/2004054525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f48310 0x555f93f7c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.755+0000 7fe49a7fc640 1 -- 172.21.15.18:0/2004054525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f93e201e0 con 0x555f93f7fab0 2024-09-19T10:01:08.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.761+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/2004054525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f7fab0 0x555f93fb32a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe490010c40 tx=0x7fe490003d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c701531cb3ecf85b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:08.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.764+0000 7fe4807f8640 1 -- 172.21.15.18:0/2004054525 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490004d60 con 0x555f93f7fab0 2024-09-19T10:01:08.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.764+0000 7fe4807f8640 1 -- 172.21.15.18:0/2004054525 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe490004650 con 0x555f93f7fab0 2024-09-19T10:01:08.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.764+0000 7fe4807f8640 1 -- 172.21.15.18:0/2004054525 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490004160 con 0x555f93f7fab0 2024-09-19T10:01:08.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.765+0000 7fe4a3913740 1 -- 172.21.15.18:0/2004054525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f7fab0 msgr2=0x555f93fb32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:08.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.766+0000 7fe4a3913740 1 --2- 172.21.15.18:0/2004054525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f7fab0 0x555f93fb32a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe490010c40 tx=0x7fe490003d40 comp rx=0 tx=0).stop 2024-09-19T10:01:08.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.766+0000 7fe4a3913740 1 -- 172.21.15.18:0/2004054525 shutdown_connections 2024-09-19T10:01:08.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.766+0000 7fe4a3913740 1 --2- 172.21.15.18:0/2004054525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f81020 0x555f93fb37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.766+0000 7fe4a3913740 1 --2- 172.21.15.18:0/2004054525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f7fab0 0x555f93fb32a0 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe490010c40 tx=0x7fe490003d40 comp rx=0 tx=0).stop 2024-09-19T10:01:08.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.766+0000 7fe4a3913740 1 --2- 172.21.15.18:0/2004054525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f48310 0x555f93f7c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.766+0000 7fe4a3913740 1 -- 172.21.15.18:0/2004054525 >> 172.21.15.18:0/2004054525 conn(0x555f93f98990 msgr2=0x555f93f7bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:08.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.767+0000 7fe4a3913740 1 -- 172.21.15.18:0/2004054525 shutdown_connections 2024-09-19T10:01:08.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.767+0000 7fe4a3913740 1 -- 172.21.15.18:0/2004054525 wait complete. 2024-09-19T10:01:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.768+0000 7fe4a3913740 1 -- start start 2024-09-19T10:01:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.768+0000 7fe4a3913740 1 Processor -- start 2024-09-19T10:01:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.769+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f48310 0x555f93f9f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.769+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 0x555f93f9fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.770+0000 7fe4a3913740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f9b860 0x555f93f9ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.770+0000 7fe4a3913740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1acac0 con 0x555f93f81020 2024-09-19T10:01:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.770+0000 7fe4a3913740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1ac3f0 con 0x555f93f48310 2024-09-19T10:01:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.770+0000 7fe4a3913740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c072100 con 0x555f93f9b860 2024-09-19T10:01:08.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.771+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f9b860 0x555f93f9ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.771+0000 7fe4a3913740 10 client.0 _ll_register_callbacks cb 0x7fe490009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:08.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.771+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f9b860 0x555f93f9ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:38920/0 (socket says 172.21.15.18:38920) 2024-09-19T10:01:08.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.771+0000 7fe49b7fe640 1 -- 172.21.15.18:0/1556838545 learned_addr learned my addr 172.21.15.18:0/1556838545 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:08.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.772+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 0x555f93f9fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.772+0000 7fe49b7fe640 1 -- 172.21.15.18:0/1556838545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f48310 msgr2=0x555f93f9f530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:01:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.772+0000 7fe49b7fe640 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f48310 0x555f93f9f530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.772+0000 7fe49b7fe640 1 -- 172.21.15.18:0/1556838545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 msgr2=0x555f93f9fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.772+0000 7fe49b7fe640 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 0x555f93f9fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.772+0000 7fe49b7fe640 1 -- 172.21.15.18:0/1556838545 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f94015270 con 0x555f93f9b860 2024-09-19T10:01:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.774+0000 7fe49b7fe640 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f9b860 0x555f93f9ffb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe48c011d30 tx=0x7fe48c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b958f1a61763ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.774+0000 7fe47eff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:01:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.775+0000 7fe47eff5640 1 -- 172.21.15.18:0/1556838545 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c02d060 con 0x555f93f9b860 2024-09-19T10:01:08.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.775+0000 7fe4a3913740 1 -- 172.21.15.18:0/1556838545 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe490004650 con 0x555f93f9b860 2024-09-19T10:01:08.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.775+0000 7fe47eff5640 1 -- 172.21.15.18:0/1556838545 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe48c028620 con 0x555f93f9b860 2024-09-19T10:01:08.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.776+0000 7fe47eff5640 1 -- 172.21.15.18:0/1556838545 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe48c028820 con 0x555f93f9b860 2024-09-19T10:01:08.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.776+0000 7fe4a3913740 10 client.26998 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:08.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.776+0000 7fe4a3913740 1 -- 172.21.15.18:0/1556838545 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555f94016560 con 0x555f93f9b860 2024-09-19T10:01:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.779+0000 7fe47eff5640 1 -- 172.21.15.18:0/1556838545 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe48c01b3d0 con 0x555f93f9b860 2024-09-19T10:01:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.780+0000 7fe47eff5640 1 -- 172.21.15.18:0/1556838545 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe48c01a040 con 0x555f93f9b860 2024-09-19T10:01:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.781+0000 7fe4a3913740 10 client.26998 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.781+0000 7fe4a3913740 10 client.26998 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.781+0000 7fe4a3913740 20 client.26998 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.781+0000 7fe4a3913740 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555f94016c90 0x555f940190d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.781+0000 7fe4a3913740 4 client.26998 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:01:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.781+0000 7fe4a3913740 1 -- 172.21.15.18:0/1556838545 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe490004650 con 0x555f94016c90 2024-09-19T10:01:08.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.787+0000 7fe49affd640 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555f94016c90 0x555f940190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:08.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.801+0000 7fe49affd640 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555f94016c90 0x555f940190d0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=480d27548eeeec6e server_cookie=725d5a52543610e7 in_seq=0 out_seq=0 2024-09-19T10:01:08.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.802+0000 7fe47eff5640 10 client.26998 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:08.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.809+0000 7fe47eff5640 1 -- 172.21.15.18:0/1556838545 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe490004650 con 0x555f94016c90 2024-09-19T10:01:08.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.809+0000 7fe47eff5640 10 client.26998 handle_command_reply: tid=0 2024-09-19T10:01:08.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.809+0000 7fe4a3913740 1 client.26998 shutdown 2024-09-19T10:01:08.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.810+0000 7fe4a3913740 1 -- 172.21.15.18:0/1556838545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f9b860 msgr2=0x555f93f9ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:08.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.810+0000 7fe4a3913740 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f9b860 0x555f93f9ffb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe48c011d30 tx=0x7fe48c016000 comp rx=0 tx=0).stop 2024-09-19T10:01:08.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.810+0000 7fe4a3913740 1 -- 172.21.15.18:0/1556838545 shutdown_connections 2024-09-19T10:01:08.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.810+0000 7fe4a3913740 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555f94016c90 0x555f940190d0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.810+0000 7fe4a3913740 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f93f9b860 0x555f93f9ffb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.810+0000 7fe4a3913740 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555f93f81020 0x555f93f9fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.810+0000 7fe4a3913740 1 --2- 172.21.15.18:0/1556838545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f93f48310 0x555f93f9f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.811+0000 7fe4a3913740 1 -- 172.21.15.18:0/1556838545 >> 172.21.15.18:0/1556838545 conn(0x555f93f98990 msgr2=0x555f93f7aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:08.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.811+0000 7fe47eff5640 0 client.26998 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:08.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.811+0000 7fe4a3913740 1 -- 172.21.15.18:0/1556838545 shutdown_connections 2024-09-19T10:01:08.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.811+0000 7fe4a3913740 1 -- 172.21.15.18:0/1556838545 wait complete. 2024-09-19T10:01:08.817 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:01:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.811+0000 7fe4a3913740 20 client.26998 trim_cache size 0 max 16384 2024-09-19T10:01:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.813+0000 7fe481ffb640 1 -- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4840a34a0 msgr2=0x7fe4840a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.813+0000 7fe481ffb640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4840a34a0 0x7fe4840a5960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009bc0 tx=0x7fe48c005f90 comp rx=0 tx=0).stop 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.813+0000 7fe481ffb640 1 -- 172.21.15.18:0/3578665134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe49c1008d0 msgr2=0x7fe49c1a4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.813+0000 7fe481ffb640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe49c1008d0 0x7fe49c1a4730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe494009ca0 tx=0x7fe494031ab0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.813+0000 7fe481ffb640 1 -- 172.21.15.18:0/3578665134 shutdown_connections 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.813+0000 7fe481ffb640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4840a34a0 0x7fe4840a5960 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.813+0000 7fe481ffb640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe49c19e8f0 0x7fe49c19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.813+0000 7fe481ffb640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49c101270 0x7fe49c1a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.813+0000 7fe481ffb640 1 --2- 172.21.15.18:0/3578665134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe49c1008d0 0x7fe49c1a4730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.813+0000 7fe481ffb640 1 -- 172.21.15.18:0/3578665134 >> 172.21.15.18:0/3578665134 conn(0x7fe49c0fc610 msgr2=0x7fe49c0fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.814+0000 7fe481ffb640 1 -- 172.21.15.18:0/3578665134 shutdown_connections 2024-09-19T10:01:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:08.814+0000 7fe481ffb640 1 -- 172.21.15.18:0/3578665134 wait complete. 2024-09-19T10:01:10.143 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:09 smithi018 ceph-mon[30956]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 810 MiB/s wr, 1.45k op/s 2024-09-19T10:01:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:09 smithi049 ceph-mon[34858]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 810 MiB/s wr, 1.45k op/s 2024-09-19T10:01:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:09 smithi162 ceph-mon[35174]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 810 MiB/s wr, 1.45k op/s 2024-09-19T10:01:10.861 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T10:01:10.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T10:01:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:01:12.232 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:11 smithi018 ceph-mon[30956]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 833 MiB/s wr, 1.53k op/s 2024-09-19T10:01:12.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:11 smithi049 ceph-mon[34858]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 833 MiB/s wr, 1.53k op/s 2024-09-19T10:01:12.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:11 smithi162 ceph-mon[35174]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 833 MiB/s wr, 1.53k op/s 2024-09-19T10:01:12.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.659+0000 7f9a34e36640 1 -- 172.21.15.18:0/2618274704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a3011b140 msgr2=0x7f9a3011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.659+0000 7f9a34e36640 1 --2- 172.21.15.18:0/2618274704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a3011b140 0x7f9a3011d530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009be0 tx=0x7f9a2802a6d0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.660+0000 7f9a34e36640 1 -- 172.21.15.18:0/2618274704 shutdown_connections 2024-09-19T10:01:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.660+0000 7f9a34e36640 1 --2- 172.21.15.18:0/2618274704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a3011b140 0x7f9a3011d530 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.660+0000 7f9a34e36640 1 --2- 172.21.15.18:0/2618274704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a30109830 0x7f9a30109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.660+0000 7f9a34e36640 1 --2- 172.21.15.18:0/2618274704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a30109450 0x7f9a30110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.660+0000 7f9a34e36640 1 -- 172.21.15.18:0/2618274704 >> 172.21.15.18:0/2618274704 conn(0x7f9a3006e140 msgr2=0x7f9a3006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:12.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.660+0000 7f9a34e36640 1 -- 172.21.15.18:0/2618274704 shutdown_connections 2024-09-19T10:01:12.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.660+0000 7f9a34e36640 1 -- 172.21.15.18:0/2618274704 wait complete. 2024-09-19T10:01:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.662+0000 7f9a34e36640 1 Processor -- start 2024-09-19T10:01:12.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.665+0000 7f9a34e36640 1 -- start start 2024-09-19T10:01:12.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.665+0000 7f9a34e36640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a30109450 0x7f9a30118690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.665+0000 7f9a34e36640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a30109830 0x7f9a30118bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.665+0000 7f9a34e36640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3011b140 0x7f9a301118e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.665+0000 7f9a34e36640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a30120da0 con 0x7f9a3011b140 2024-09-19T10:01:12.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.665+0000 7f9a34e36640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9a30120c20 con 0x7f9a30109830 2024-09-19T10:01:12.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.665+0000 7f9a34e36640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a30120f20 con 0x7f9a30109450 2024-09-19T10:01:12.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.666+0000 7f9a2ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3011b140 0x7f9a301118e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.666+0000 7f9a2ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3011b140 0x7f9a301118e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48974/0 (socket says 172.21.15.18:48974) 2024-09-19T10:01:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.667+0000 7f9a2ed9d640 1 -- 172.21.15.18:0/4293607315 learned_addr learned my addr 172.21.15.18:0/4293607315 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.667+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a30109830 0x7f9a30118bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.668+0000 7f9a2e59c640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a30109450 0x7f9a30118690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.668+0000 7f9a2ed9d640 1 -- 172.21.15.18:0/4293607315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a30109450 msgr2=0x7f9a30118690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.668+0000 7f9a2ed9d640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a30109450 0x7f9a30118690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.668+0000 7f9a2ed9d640 1 -- 172.21.15.18:0/4293607315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a30109830 msgr2=0x7f9a30118bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.668+0000 7f9a2ed9d640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a30109830 0x7f9a30118bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.669+0000 7f9a2ed9d640 1 -- 172.21.15.18:0/4293607315 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a301121a0 con 0x7f9a3011b140 2024-09-19T10:01:12.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.669+0000 7f9a2ed9d640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3011b140 0x7f9a301118e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009b30 tx=0x7f9a280319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:12.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.673+0000 7f9a27fff640 1 -- 172.21.15.18:0/4293607315 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28041020 con 0x7f9a3011b140 2024-09-19T10:01:12.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.674+0000 7f9a34e36640 1 -- 172.21.15.18:0/4293607315 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a30112430 con 0x7f9a3011b140 2024-09-19T10:01:12.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.674+0000 7f9a34e36640 1 -- 172.21.15.18:0/4293607315 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a301163e0 con 0x7f9a3011b140 2024-09-19T10:01:12.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.679+0000 7f9a3720f740 1 Processor -- start 2024-09-19T10:01:12.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.679+0000 7f9a27fff640 1 -- 172.21.15.18:0/4293607315 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a28003e50 con 0x7f9a3011b140 2024-09-19T10:01:12.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.679+0000 7f9a27fff640 1 -- 172.21.15.18:0/4293607315 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28036040 con 0x7f9a3011b140 2024-09-19T10:01:12.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.681+0000 7f9a3720f740 1 -- start start 2024-09-19T10:01:12.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.681+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 0x5594aaa60f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.682+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 0x5594aaa6b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.682+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 0x5594aaa6e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.682+0000 7f9a3720f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5594aa9c6280 con 0x5594aaa60b60 2024-09-19T10:01:12.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.682+0000 7f9a3720f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5594aa96db10 con 0x5594aaa61480 2024-09-19T10:01:12.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.682+0000 7f9a3720f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5594aa9c2240 con 0x5594aaa6bd40 2024-09-19T10:01:12.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.689+0000 7f9a2e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 0x5594aaa6b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.690+0000 7f9a25d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 0x5594aaa60f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.690+0000 7f9a25d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 0x5594aaa60f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48982/0 (socket says 172.21.15.18:48982) 2024-09-19T10:01:12.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.690+0000 7f9a25d9b640 1 -- 172.21.15.18:0/521139911 learned_addr learned my addr 172.21.15.18:0/521139911 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:12.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.690+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/521139911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 0x5594aaa6e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.691+0000 7f9a25d9b640 1 -- 172.21.15.18:0/521139911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 msgr2=0x5594aaa6b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.691+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/521139911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 0x5594aaa6b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.691+0000 7f9a25d9b640 1 -- 172.21.15.18:0/521139911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 msgr2=0x5594aaa60f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.691+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/521139911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 0x5594aaa60f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.691+0000 7f9a25d9b640 1 -- 172.21.15.18:0/521139911 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594aa97a1f0 con 0x5594aaa6bd40 2024-09-19T10:01:12.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.691+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/521139911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 0x5594aaa6e130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800af60 tx=0x7f9a1800a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=408e60a6849e6c72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.692+0000 7f9a24d99640 1 -- 172.21.15.18:0/521139911 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18004220 con 0x5594aaa6bd40 2024-09-19T10:01:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.692+0000 7f9a24d99640 1 -- 172.21.15.18:0/521139911 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a180043c0 con 0x5594aaa6bd40 2024-09-19T10:01:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.693+0000 7f9a24d99640 1 -- 172.21.15.18:0/521139911 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800f6f0 con 0x5594aaa6bd40 2024-09-19T10:01:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.694+0000 7f9a3720f740 1 -- 172.21.15.18:0/521139911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 msgr2=0x5594aaa6e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.694+0000 7f9a3720f740 1 --2- 172.21.15.18:0/521139911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 0x5594aaa6e130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800af60 tx=0x7f9a1800a2d0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.696+0000 7f9a27fff640 1 -- 172.21.15.18:0/4293607315 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9a28044020 con 0x7f9a3011b140 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.696+0000 7f9a3720f740 1 -- 172.21.15.18:0/521139911 shutdown_connections 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.696+0000 7f9a3720f740 1 --2- 172.21.15.18:0/521139911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 0x5594aaa6e130 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.696+0000 7f9a3720f740 1 --2- 172.21.15.18:0/521139911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 0x5594aaa6b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.696+0000 7f9a3720f740 1 --2- 172.21.15.18:0/521139911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 0x5594aaa60f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.696+0000 7f9a3720f740 1 -- 172.21.15.18:0/521139911 >> 172.21.15.18:0/521139911 conn(0x5594aaa5d0f0 msgr2=0x5594aaa5d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.697+0000 7f9a3720f740 1 -- 172.21.15.18:0/521139911 shutdown_connections 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.697+0000 7f9a3720f740 1 -- 172.21.15.18:0/521139911 wait complete. 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.698+0000 7f9a3720f740 1 -- start start 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.700+0000 7f9a3720f740 1 Processor -- start 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.700+0000 7f9a27fff640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a1c0a3250 0x7f9a1c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.701+0000 7f9a27fff640 1 -- 172.21.15.18:0/4293607315 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9a280efbe0 con 0x7f9a3011b140 2024-09-19T10:01:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.701+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 0x5594aaa68bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.702+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 0x5594aaa690f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.702+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 0x5594aaa69630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.702+0000 7f9a3720f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5594aaa6e960 con 0x5594aaa60b60 2024-09-19T10:01:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.702+0000 7f9a3720f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5594aa980f10 con 0x5594aaa61480 2024-09-19T10:01:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.702+0000 7f9a3720f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5594aaa6eae0 con 0x5594aaa6bd40 2024-09-19T10:01:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.702+0000 7f9a3720f740 10 client.0 _ll_register_callbacks cb 0x5594aa949a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:12.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.704+0000 7f9a25d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 0x5594aaa690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.705+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a1c0a3250 0x7f9a1c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.706+0000 7f9a25d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 0x5594aaa690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50680/0 (socket says 172.21.15.18:50680) 2024-09-19T10:01:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.706+0000 7f9a25d9b640 1 -- 172.21.15.18:0/1677982373 learned_addr learned my addr 172.21.15.18:0/1677982373 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.708+0000 7f9a2ed9d640 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 0x5594aaa69630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.708+0000 7f9a2e59c640 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 0x5594aaa68bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.708+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a1c0a3250 0x7f9a1c0a5710 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x5594aaa5e470 tx=0x7f9a180049e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.708+0000 7f9a25d9b640 1 -- 172.21.15.18:0/1677982373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 msgr2=0x5594aaa69630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.708+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 0x5594aaa69630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.708+0000 7f9a25d9b640 1 -- 172.21.15.18:0/1677982373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 msgr2=0x5594aaa68bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.708+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 0x5594aaa68bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.708+0000 7f9a25d9b640 1 -- 172.21.15.18:0/1677982373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594aa7376a0 con 0x5594aaa61480 2024-09-19T10:01:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.710+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 0x5594aaa690f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800b010 tx=0x7f9a1802a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c378062eebe13cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:12.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.714+0000 7f9a15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:01:12.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.714+0000 7f9a15ffb640 1 -- 172.21.15.18:0/1677982373 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800fb40 con 0x5594aaa61480 2024-09-19T10:01:12.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.714+0000 7f9a3720f740 1 -- 172.21.15.18:0/1677982373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a180043c0 con 0x5594aaa61480 2024-09-19T10:01:12.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.714+0000 7f9a15ffb640 1 -- 172.21.15.18:0/1677982373 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9a1800fce0 con 0x5594aaa61480 2024-09-19T10:01:12.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.719+0000 7f9a15ffb640 1 -- 172.21.15.18:0/1677982373 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a1803b070 con 0x5594aaa61480 2024-09-19T10:01:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.720+0000 7f9a3720f740 10 client.26987 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:12.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.720+0000 7f9a3720f740 1 -- 172.21.15.18:0/1677982373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5594aaa7a5d0 con 0x5594aaa61480 2024-09-19T10:01:12.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.724+0000 7f9a15ffb640 1 -- 172.21.15.18:0/1677982373 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a180043c0 con 0x5594aaa61480 2024-09-19T10:01:12.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.725+0000 7f9a15ffb640 1 -- 172.21.15.18:0/1677982373 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9a1801b030 con 0x5594aaa61480 2024-09-19T10:01:12.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.725+0000 7f9a3720f740 10 client.26987 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:12.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.725+0000 7f9a3720f740 10 client.26987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:12.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.725+0000 7f9a3720f740 20 client.26987 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.725+0000 7f9a3720f740 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5594aaa7bd50 0x5594aaa7e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.725+0000 7f9a3720f740 4 client.26987 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.725+0000 7f9a3720f740 1 -- 172.21.15.18:0/1677982373 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594aa9d37f0 con 0x5594aaa7bd50 2024-09-19T10:01:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.729+0000 7f9a2e59c640 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5594aaa7bd50 0x5594aaa7e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.736+0000 7f9a2e59c640 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5594aaa7bd50 0x5594aaa7e210 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb91f1b9c6e58fe4 server_cookie=f2ffcdaca43484c1 in_seq=0 out_seq=0 2024-09-19T10:01:12.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.736+0000 7f9a15ffb640 10 client.26987 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:12.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.742+0000 7f9a15ffb640 1 -- 172.21.15.18:0/1677982373 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594aa9d37f0 con 0x5594aaa7bd50 2024-09-19T10:01:12.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.742+0000 7f9a15ffb640 10 client.26987 handle_command_reply: tid=0 2024-09-19T10:01:12.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.745+0000 7f9a3720f740 1 client.26987 shutdown 2024-09-19T10:01:12.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.746+0000 7f9a3720f740 1 -- 172.21.15.18:0/1677982373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 msgr2=0x5594aaa690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.746+0000 7f9a3720f740 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 0x5594aaa690f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800b010 tx=0x7f9a1802a000 comp rx=0 tx=0).stop 2024-09-19T10:01:12.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.746+0000 7f9a3720f740 1 -- 172.21.15.18:0/1677982373 shutdown_connections 2024-09-19T10:01:12.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.746+0000 7f9a3720f740 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5594aaa7bd50 0x5594aaa7e210 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.746+0000 7f9a3720f740 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa6bd40 0x5594aaa69630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.746+0000 7f9a3720f740 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa61480 0x5594aaa690f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.746+0000 7f9a3720f740 1 --2- 172.21.15.18:0/1677982373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa60b60 0x5594aaa68bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.746+0000 7f9a3720f740 1 -- 172.21.15.18:0/1677982373 >> 172.21.15.18:0/1677982373 conn(0x5594aaa5d0f0 msgr2=0x5594aaa62e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:12.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.747+0000 7f9a15ffb640 0 client.26987 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:12.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.749+0000 7f9a3720f740 1 -- 172.21.15.18:0/1677982373 shutdown_connections 2024-09-19T10:01:12.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.752+0000 7f9a3720f740 1 -- 172.21.15.18:0/1677982373 wait complete. 2024-09-19T10:01:12.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.753+0000 7f9a3720f740 20 client.26987 trim_cache size 0 max 16384 2024-09-19T10:01:12.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.827+0000 7f9a3720f740 1 Processor -- start 2024-09-19T10:01:12.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.827+0000 7f9a3720f740 1 -- start start 2024-09-19T10:01:12.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.828+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa83ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.828+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 0x5594aaa84020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.828+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa6bd40 0x5594aaa5ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.829+0000 7f9a2e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa83ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.829+0000 7f9a2e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa83ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50694/0 (socket says 172.21.15.18:50694) 2024-09-19T10:01:12.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.829+0000 7f9a2e59c640 1 -- 172.21.15.18:0/3887428192 learned_addr learned my addr 172.21.15.18:0/3887428192 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:12.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.831+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 0x5594aaa84020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.831+0000 7f9a2ed9d640 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa6bd40 0x5594aaa5ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.831+0000 7f9a3720f740 1 -- 172.21.15.18:0/3887428192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1000e4a0 con 0x5594aaa6bd40 2024-09-19T10:01:12.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.831+0000 7f9a3720f740 1 -- 172.21.15.18:0/3887428192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1000ffe0 con 0x5594aaa60b60 2024-09-19T10:01:12.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.831+0000 7f9a3720f740 1 -- 172.21.15.18:0/3887428192 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1000eb70 con 0x5594aaa61480 2024-09-19T10:01:12.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.833+0000 7f9a2e59c640 1 -- 172.21.15.18:0/3887428192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 msgr2=0x5594aaa84020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.833+0000 7f9a2e59c640 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 0x5594aaa84020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.833+0000 7f9a2e59c640 1 -- 172.21.15.18:0/3887428192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa6bd40 msgr2=0x5594aaa5ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.833+0000 7f9a2e59c640 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa6bd40 0x5594aaa5ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.833+0000 7f9a2e59c640 1 -- 172.21.15.18:0/3887428192 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594aaa58ac0 con 0x5594aaa60b60 2024-09-19T10:01:12.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.833+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 0x5594aaa84020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:01:12.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.833+0000 7f9a2e59c640 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa83ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009aa0 tx=0x7f9a20014840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=115eb6fafd03a906 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.836+0000 7ff83957e640 1 -- 172.21.15.18:0/2556834554 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8300319b0 con 0x7ff82c0a4ec0 2024-09-19T10:01:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.836+0000 7ff83b582640 1 -- 172.21.15.18:0/2556834554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff82c0a4ec0 msgr2=0x7ff82c0a72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.836+0000 7ff83b582640 1 --2- 172.21.15.18:0/2556834554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff82c0a4ec0 0x7ff82c0a72d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff830009900 tx=0x7ff83002a410 comp rx=0 tx=0).stop 2024-09-19T10:01:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.837+0000 7ff83b582640 1 -- 172.21.15.18:0/2556834554 shutdown_connections 2024-09-19T10:01:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.837+0000 7ff83b582640 1 --2- 172.21.15.18:0/2556834554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c0aa1c0 0x7ff82c0aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.837+0000 7ff83b582640 1 --2- 172.21.15.18:0/2556834554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff82c0a7810 0x7ff82c0a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.837+0000 7ff83b582640 1 --2- 172.21.15.18:0/2556834554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff82c0a4ec0 0x7ff82c0a72d0 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff830009900 tx=0x7ff83002a410 comp rx=0 tx=0).stop 2024-09-19T10:01:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.837+0000 7ff83b582640 1 -- 172.21.15.18:0/2556834554 >> 172.21.15.18:0/2556834554 conn(0x7ff82c0a0c90 msgr2=0x7ff82c0a30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:12.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.836+0000 7f9a17fff640 1 -- 172.21.15.18:0/3887428192 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2001d460 con 0x5594aaa60b60 2024-09-19T10:01:12.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.836+0000 7f9a17fff640 1 -- 172.21.15.18:0/3887428192 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a2001dae0 con 0x5594aaa60b60 2024-09-19T10:01:12.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.836+0000 7f9a17fff640 1 -- 172.21.15.18:0/3887428192 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a20012af0 con 0x5594aaa60b60 2024-09-19T10:01:12.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.836+0000 7f9a2ed9d640 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa6bd40 0x5594aaa5ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:01:12.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.843+0000 7f9a3720f740 1 -- 172.21.15.18:0/3887428192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 msgr2=0x5594aaa83ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.843+0000 7f9a3720f740 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa83ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009aa0 tx=0x7f9a20014840 comp rx=0 tx=0).stop 2024-09-19T10:01:12.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.844+0000 7f9a3720f740 1 -- 172.21.15.18:0/3887428192 shutdown_connections 2024-09-19T10:01:12.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.844+0000 7f9a3720f740 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa6bd40 0x5594aaa5ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.844+0000 7f9a3720f740 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 0x5594aaa84020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.844+0000 7f9a3720f740 1 --2- 172.21.15.18:0/3887428192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa83ae0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.847+0000 7f9a3720f740 1 -- 172.21.15.18:0/3887428192 >> 172.21.15.18:0/3887428192 conn(0x5594aaa5d0f0 msgr2=0x5594aaa67ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:12.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.847+0000 7f9a3720f740 1 -- 172.21.15.18:0/3887428192 shutdown_connections 2024-09-19T10:01:12.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.847+0000 7f9a3720f740 1 -- 172.21.15.18:0/3887428192 wait complete. 2024-09-19T10:01:12.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.848+0000 7f9a3720f740 1 -- start start 2024-09-19T10:01:12.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.848+0000 7f9a3720f740 1 Processor -- start 2024-09-19T10:01:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.862+0000 7ff83b582640 1 -- 172.21.15.18:0/2556834554 shutdown_connections 2024-09-19T10:01:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.862+0000 7ff83b582640 1 -- 172.21.15.18:0/2556834554 wait complete. 2024-09-19T10:01:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.864+0000 7ff83b582640 1 Processor -- start 2024-09-19T10:01:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.864+0000 7ff83b582640 1 -- start start 2024-09-19T10:01:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.864+0000 7ff83b582640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c0a7810 0x7ff82c143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.864+0000 7ff83b582640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff82c0aa1c0 0x7ff82c143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.864+0000 7ff83b582640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff82c1487c0 0x7ff82c14abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.864+0000 7ff83b582640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c0b8970 con 0x7ff82c0aa1c0 2024-09-19T10:01:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.864+0000 7ff83b582640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c0b87f0 con 0x7ff82c0a7810 2024-09-19T10:01:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.864+0000 7ff83b582640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c0b8af0 con 0x7ff82c1487c0 2024-09-19T10:01:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.865+0000 7ff83a580640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c0a7810 0x7ff82c143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.865+0000 7ff839d7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff82c0aa1c0 0x7ff82c143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.865+0000 7ff839d7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff82c0aa1c0 0x7ff82c143760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49006/0 (socket says 172.21.15.18:49006) 2024-09-19T10:01:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.865+0000 7ff83a580640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c0a7810 0x7ff82c143220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50714/0 (socket says 172.21.15.18:50714) 2024-09-19T10:01:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.865+0000 7ff839d7f640 1 -- 172.21.15.18:0/3094378237 learned_addr learned my addr 172.21.15.18:0/3094378237 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.859+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa6edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.867+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 0x5594aaa6f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.867+0000 7f9a3720f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa6bd40 0x5594aaa6f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.867+0000 7f9a3720f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1000f910 con 0x5594aaa6bd40 2024-09-19T10:01:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.867+0000 7f9a3720f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1000f240 con 0x5594aaa60b60 2024-09-19T10:01:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.867+0000 7f9a3720f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1000c480 con 0x5594aaa61480 2024-09-19T10:01:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.867+0000 7f9a3720f740 10 client.0 _ll_register_callbacks cb 0x7f9a18011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.868+0000 7f9a2e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa6edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.868+0000 7f9a2e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa6edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50722/0 (socket says 172.21.15.18:50722) 2024-09-19T10:01:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.868+0000 7f9a2e59c640 1 -- 172.21.15.18:0/4230891259 learned_addr learned my addr 172.21.15.18:0/4230891259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.868+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 0x5594aaa6f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.869+0000 7ff83ad81640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff82c1487c0 0x7ff82c14abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.871+0000 7ff839d7f640 1 -- 172.21.15.18:0/3094378237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff82c1487c0 msgr2=0x7ff82c14abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.871+0000 7ff839d7f640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff82c1487c0 0x7ff82c14abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.871+0000 7ff839d7f640 1 -- 172.21.15.18:0/3094378237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c0a7810 msgr2=0x7ff82c143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.871+0000 7ff839d7f640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c0a7810 0x7ff82c143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.871+0000 7ff839d7f640 1 -- 172.21.15.18:0/3094378237 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82c14b220 con 0x7ff82c0aa1c0 2024-09-19T10:01:12.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.872+0000 7f9a2e59c640 1 -- 172.21.15.18:0/4230891259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 msgr2=0x5594aaa6f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.872+0000 7f9a2e59c640 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 0x5594aaa6f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.872+0000 7f9a2e59c640 1 -- 172.21.15.18:0/4230891259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa6bd40 msgr2=0x5594aaa6f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.872+0000 7f9a2e59c640 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa6bd40 0x5594aaa6f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.874+0000 7f9a2e59c640 1 -- 172.21.15.18:0/4230891259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594aaae4aa0 con 0x5594aaa60b60 2024-09-19T10:01:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.877+0000 7ff839d7f640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff82c0aa1c0 0x7ff82c143760 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff82400b4a0 tx=0x7ff82400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:12.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.877+0000 7f9a2e59c640 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa6edd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097d0 tx=0x7f9a20009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8983c59fae3a1734 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:12.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.878+0000 7f9a15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:01:12.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.878+0000 7f9a15ffb640 1 -- 172.21.15.18:0/4230891259 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a20004230 con 0x5594aaa60b60 2024-09-19T10:01:12.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.878+0000 7f9a15ffb640 1 -- 172.21.15.18:0/4230891259 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9a200043d0 con 0x5594aaa60b60 2024-09-19T10:01:12.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.878+0000 7f9a3720f740 1 -- 172.21.15.18:0/4230891259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a2001dae0 con 0x5594aaa60b60 2024-09-19T10:01:12.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.879+0000 7f9a15ffb640 1 -- 172.21.15.18:0/4230891259 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a20037050 con 0x5594aaa60b60 2024-09-19T10:01:12.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.879+0000 7f9a3720f740 10 client.26999 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:12.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.879+0000 7f9a3720f740 1 -- 172.21.15.18:0/4230891259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5594aaae5cb0 con 0x5594aaa60b60 2024-09-19T10:01:12.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.879+0000 7f9a15ffb640 1 -- 172.21.15.18:0/4230891259 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a2002c030 con 0x5594aaa60b60 2024-09-19T10:01:12.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.880+0000 7f9a15ffb640 1 -- 172.21.15.18:0/4230891259 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9a20012770 con 0x5594aaa60b60 2024-09-19T10:01:12.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.880+0000 7f9a3720f740 10 client.26999 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:12.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.880+0000 7f9a3720f740 10 client.26999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:12.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.880+0000 7f9a3720f740 20 client.26999 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:12.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.880+0000 7f9a3720f740 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5594aaae6300 0x5594aaae8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.880+0000 7f9a3720f740 4 client.26999 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T10:01:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.880+0000 7f9a3720f740 1 -- 172.21.15.18:0/4230891259 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f9a2001dae0 con 0x5594aaae6300 2024-09-19T10:01:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.881+0000 7ff82b7fe640 1 -- 172.21.15.18:0/3094378237 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff824014070 con 0x7ff82c0aa1c0 2024-09-19T10:01:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.881+0000 7ff82b7fe640 1 -- 172.21.15.18:0/3094378237 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff824010af0 con 0x7ff82c0aa1c0 2024-09-19T10:01:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.881+0000 7ff82b7fe640 1 -- 172.21.15.18:0/3094378237 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff824017d10 con 0x7ff82c0aa1c0 2024-09-19T10:01:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.882+0000 7ff83b582640 1 -- 172.21.15.18:0/3094378237 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82c14b510 con 0x7ff82c0aa1c0 2024-09-19T10:01:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.882+0000 7ff83b582640 1 -- 172.21.15.18:0/3094378237 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff82c14ba10 con 0x7ff82c0aa1c0 2024-09-19T10:01:12.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.882+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5594aaae6300 0x5594aaae8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.883+0000 7f9a25d9b640 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5594aaae6300 0x5594aaae8720 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85aa5676cd7df667 server_cookie=dae37ffdb0456a70 in_seq=0 out_seq=0 2024-09-19T10:01:12.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:12.883+0000 7f9a15ffb640 10 client.26999 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.888+0000 7ff83f658740 1 Processor -- start 2024-09-19T10:01:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.889+0000 7ff83f658740 1 -- start start 2024-09-19T10:01:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.889+0000 7ff83f658740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 0x5624329a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.890+0000 7ff83f658740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329abf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.890+0000 7ff83f658740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329ac540 0x5624329aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.890+0000 7ff83f658740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56243290a2f0 con 0x5624329ac540 2024-09-19T10:01:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.890+0000 7ff83f658740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5624328b2270 con 0x5624329a74b0 2024-09-19T10:01:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.890+0000 7ff83f658740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5624329062b0 con 0x5624329a6b70 2024-09-19T10:01:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.890+0000 7ff82b7fe640 1 -- 172.21.15.18:0/3094378237 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff824017070 con 0x7ff82c0aa1c0 2024-09-19T10:01:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.891+0000 7ff83ad81640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 0x5624329a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.891+0000 7ff83ad81640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 0x5624329a6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:38976/0 (socket says 172.21.15.18:38976) 2024-09-19T10:01:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.891+0000 7ff83ad81640 1 -- 172.21.15.18:0/2756463789 learned_addr learned my addr 172.21.15.18:0/2756463789 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.891+0000 7ff83ad81640 1 -- 172.21.15.18:0/2756463789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 msgr2=0x5624329abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.891+0000 7ff83ad81640 1 --2- 172.21.15.18:0/2756463789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.891+0000 7ff83ad81640 1 -- 172.21.15.18:0/2756463789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329ac540 msgr2=0x5624329aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.891+0000 7ff83ad81640 1 --2- 172.21.15.18:0/2756463789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329ac540 0x5624329aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.891+0000 7ff83ad81640 1 -- 172.21.15.18:0/2756463789 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624328b1340 con 0x5624329a6b70 2024-09-19T10:01:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.898+0000 7ff82b7fe640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8200a33d0 0x7ff8200a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.898+0000 7ff82b7fe640 1 -- 172.21.15.18:0/3094378237 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff8240ceb90 con 0x7ff82c0aa1c0 2024-09-19T10:01:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.900+0000 7ff83ad81640 1 --2- 172.21.15.18:0/2756463789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 0x5624329a6f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff834050d60 tx=0x7ff8340732f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7444126471187e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.903+0000 7ff83a580640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8200a33d0 0x7ff8200a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.904+0000 7ff828ff9640 1 -- 172.21.15.18:0/2756463789 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83407a070 con 0x5624329a6b70 2024-09-19T10:01:12.907 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.904+0000 7ff828ff9640 1 -- 172.21.15.18:0/2756463789 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff834073c90 con 0x5624329a6b70 2024-09-19T10:01:12.908 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.904+0000 7ff828ff9640 1 -- 172.21.15.18:0/2756463789 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8340757d0 con 0x5624329a6b70 2024-09-19T10:01:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.919+0000 7ff83a580640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8200a33d0 0x7ff8200a5890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff830009230 tx=0x7ff830005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:12.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.927+0000 7ff83f658740 1 -- 172.21.15.18:0/2756463789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 msgr2=0x5624329a6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.930 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.927+0000 7ff83f658740 1 --2- 172.21.15.18:0/2756463789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 0x5624329a6f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff834050d60 tx=0x7ff8340732f0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.928+0000 7ff83f658740 1 -- 172.21.15.18:0/2756463789 shutdown_connections 2024-09-19T10:01:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.928+0000 7ff83f658740 1 --2- 172.21.15.18:0/2756463789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329ac540 0x5624329aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.928+0000 7ff83f658740 1 --2- 172.21.15.18:0/2756463789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.928+0000 7ff83f658740 1 --2- 172.21.15.18:0/2756463789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 0x5624329a6f70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.928+0000 7ff83f658740 1 -- 172.21.15.18:0/2756463789 >> 172.21.15.18:0/2756463789 conn(0x5624329a21e0 msgr2=0x5624329a25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:12.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.933+0000 7ff83f658740 1 -- 172.21.15.18:0/2756463789 shutdown_connections 2024-09-19T10:01:12.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.933+0000 7ff83f658740 1 -- 172.21.15.18:0/2756463789 wait complete. 2024-09-19T10:01:12.937 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.934+0000 7ff83f658740 1 -- start start 2024-09-19T10:01:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.934+0000 7ff83f658740 1 Processor -- start 2024-09-19T10:01:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.934+0000 7ff83f658740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 0x5624329b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.934+0000 7ff83f658740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.934+0000 7ff83f658740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329ac540 0x5624329b8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.934+0000 7ff83f658740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5624329af510 con 0x5624329ac540 2024-09-19T10:01:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.934+0000 7ff83f658740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562432893290 con 0x5624329a74b0 2024-09-19T10:01:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.934+0000 7ff83f658740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5624329af690 con 0x5624329a6b70 2024-09-19T10:01:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.935+0000 7ff83f658740 10 client.0 _ll_register_callbacks cb 0x5624328c4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.935+0000 7ff839d7f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.935+0000 7ff839d7f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50748/0 (socket says 172.21.15.18:50748) 2024-09-19T10:01:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.935+0000 7ff839d7f640 1 -- 172.21.15.18:0/2398846255 learned_addr learned my addr 172.21.15.18:0/2398846255 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:12.939 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.935+0000 7ff83a580640 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 0x5624329b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.936+0000 7ff839d7f640 1 -- 172.21.15.18:0/2398846255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 msgr2=0x5624329b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.936+0000 7ff839d7f640 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 0x5624329b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.936+0000 7ff839d7f640 1 -- 172.21.15.18:0/2398846255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329ac540 msgr2=0x5624329b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.936+0000 7ff839d7f640 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329ac540 0x5624329b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.936+0000 7ff839d7f640 1 -- 172.21.15.18:0/2398846255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56243261d210 con 0x5624329a74b0 2024-09-19T10:01:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.936+0000 7ff839d7f640 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b1330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff82400b470 tx=0x7ff82409b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79790c428e455791 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.937+0000 7ff81dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:01:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.937+0000 7ff81dffb640 1 -- 172.21.15.18:0/2398846255 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82401e050 con 0x5624329a74b0 2024-09-19T10:01:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.937+0000 7ff83f658740 1 -- 172.21.15.18:0/2398846255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff834073c90 con 0x5624329a74b0 2024-09-19T10:01:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.937+0000 7ff81dffb640 1 -- 172.21.15.18:0/2398846255 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff824097850 con 0x5624329a74b0 2024-09-19T10:01:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.938+0000 7ff81dffb640 1 -- 172.21.15.18:0/2398846255 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff82409f590 con 0x5624329a74b0 2024-09-19T10:01:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.939+0000 7ff83f658740 10 client.27002 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.939+0000 7ff83f658740 1 -- 172.21.15.18:0/2398846255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5624326e9620 con 0x5624329a74b0 2024-09-19T10:01:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.941+0000 7ff81dffb640 1 -- 172.21.15.18:0/2398846255 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff834073c90 con 0x5624329a74b0 2024-09-19T10:01:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.942+0000 7ff81dffb640 1 -- 172.21.15.18:0/2398846255 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff8240ccb80 con 0x5624329a74b0 2024-09-19T10:01:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.942+0000 7ff83f658740 10 client.27002 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.942+0000 7ff83f658740 10 client.27002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.942+0000 7ff83f658740 20 client.27002 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.942+0000 7ff83f658740 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5624329cdf40 0x5624329d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.943+0000 7ff83f658740 4 client.27002 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.943+0000 7ff83f658740 1 -- 172.21.15.18:0/2398846255 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562432917a20 con 0x5624329cdf40 2024-09-19T10:01:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.944+0000 7ff83a580640 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5624329cdf40 0x5624329d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.947+0000 7ff83a580640 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5624329cdf40 0x5624329d0370 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b117d71d63fb09df server_cookie=720122d409284a77 in_seq=0 out_seq=0 2024-09-19T10:01:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.947+0000 7ff81dffb640 10 client.27002 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.951+0000 7ff81dffb640 1 -- 172.21.15.18:0/2398846255 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562432917a20 con 0x5624329cdf40 2024-09-19T10:01:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.951+0000 7ff81dffb640 10 client.27002 handle_command_reply: tid=0 2024-09-19T10:01:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.951+0000 7ff83f658740 1 client.27002 shutdown 2024-09-19T10:01:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.951+0000 7ff83f658740 1 -- 172.21.15.18:0/2398846255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 msgr2=0x5624329b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.951+0000 7ff83f658740 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b1330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff82400b470 tx=0x7ff82409b8e0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.952+0000 7ff83f658740 1 -- 172.21.15.18:0/2398846255 shutdown_connections 2024-09-19T10:01:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.952+0000 7ff83f658740 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5624329cdf40 0x5624329d0370 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.952+0000 7ff83f658740 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329ac540 0x5624329b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.952+0000 7ff83f658740 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b1330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.952+0000 7ff83f658740 1 --2- 172.21.15.18:0/2398846255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a6b70 0x5624329b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.952+0000 7ff83f658740 1 -- 172.21.15.18:0/2398846255 >> 172.21.15.18:0/2398846255 conn(0x5624329a21e0 msgr2=0x5624329a39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.952+0000 7ff81dffb640 0 client.27002 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.952+0000 7ff83f658740 1 -- 172.21.15.18:0/2398846255 shutdown_connections 2024-09-19T10:01:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.952+0000 7ff83f658740 1 -- 172.21.15.18:0/2398846255 wait complete. 2024-09-19T10:01:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:12.952+0000 7ff83f658740 20 client.27002 trim_cache size 0 max 16384 2024-09-19T10:01:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.029+0000 7ff83f658740 1 Processor -- start 2024-09-19T10:01:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.029+0000 7ff83f658740 1 -- start start 2024-09-19T10:01:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.030+0000 7ff83f658740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329a6b70 0x5624329a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.030+0000 7ff83f658740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.030+0000 7ff83f658740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329ac540 0x5624329a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.030+0000 7ff83f658740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c14bea0 con 0x5624329a6b70 2024-09-19T10:01:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.030+0000 7ff83f658740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c14d9e0 con 0x5624329a74b0 2024-09-19T10:01:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.030+0000 7ff83a580640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329a6b70 0x5624329a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.030+0000 7ff83f658740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c14c570 con 0x5624329ac540 2024-09-19T10:01:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.030+0000 7ff83a580640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329a6b70 0x5624329a11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49062/0 (socket says 172.21.15.18:49062) 2024-09-19T10:01:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.030+0000 7ff83a580640 1 -- 172.21.15.18:0/1986864009 learned_addr learned my addr 172.21.15.18:0/1986864009 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.031+0000 7ff839d7f640 1 --2- 172.21.15.18:0/1986864009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.032+0000 7ff839d7f640 1 -- 172.21.15.18:0/1986864009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329ac540 msgr2=0x5624329a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.032+0000 7ff839d7f640 1 --2- 172.21.15.18:0/1986864009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329ac540 0x5624329a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.032+0000 7ff839d7f640 1 -- 172.21.15.18:0/1986864009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329a6b70 msgr2=0x5624329a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.032+0000 7ff839d7f640 1 --2- 172.21.15.18:0/1986864009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329a6b70 0x5624329a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.032+0000 7ff839d7f640 1 -- 172.21.15.18:0/1986864009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624329a2000 con 0x5624329a74b0 2024-09-19T10:01:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.034+0000 7ff839d7f640 1 --2- 172.21.15.18:0/1986864009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b8330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff82400be60 tx=0x7ff8240ccf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab3b53de5b13d6a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:13.040 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.037+0000 7ff81ffff640 1 -- 172.21.15.18:0/1986864009 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82401e070 con 0x5624329a74b0 2024-09-19T10:01:13.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.037+0000 7ff81ffff640 1 -- 172.21.15.18:0/1986864009 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8240a3e50 con 0x5624329a74b0 2024-09-19T10:01:13.041 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.037+0000 7ff81ffff640 1 -- 172.21.15.18:0/1986864009 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82409f0f0 con 0x5624329a74b0 2024-09-19T10:01:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.038+0000 7ff83f658740 1 -- 172.21.15.18:0/1986864009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 msgr2=0x5624329b8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.039+0000 7ff83f658740 1 --2- 172.21.15.18:0/1986864009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b8330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff82400be60 tx=0x7ff8240ccf90 comp rx=0 tx=0).stop 2024-09-19T10:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.039+0000 7ff83f658740 1 -- 172.21.15.18:0/1986864009 shutdown_connections 2024-09-19T10:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.039+0000 7ff83f658740 1 --2- 172.21.15.18:0/1986864009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329ac540 0x5624329a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.039+0000 7ff83f658740 1 --2- 172.21.15.18:0/1986864009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329a74b0 0x5624329b8330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.040+0000 7ff83f658740 1 --2- 172.21.15.18:0/1986864009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329a6b70 0x5624329a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.040+0000 7ff83f658740 1 -- 172.21.15.18:0/1986864009 >> 172.21.15.18:0/1986864009 conn(0x5624329a21e0 msgr2=0x5624329a0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:13.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.040+0000 7ff83f658740 1 -- 172.21.15.18:0/1986864009 shutdown_connections 2024-09-19T10:01:13.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.040+0000 7ff83f658740 1 -- 172.21.15.18:0/1986864009 wait complete. 2024-09-19T10:01:13.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.041+0000 7ff83f658740 1 -- start start 2024-09-19T10:01:13.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.041+0000 7ff83f658740 1 Processor -- start 2024-09-19T10:01:13.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.042+0000 7ff83f658740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329a6b70 0x5624329b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:13.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.042+0000 7ff83f658740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a74b0 0x5624329b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:13.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.042+0000 7ff83f658740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329ac540 0x562432a36c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:13.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.042+0000 7ff83f658740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c14d310 con 0x5624329a6b70 2024-09-19T10:01:13.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.043+0000 7ff83f658740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c14cc40 con 0x5624329ac540 2024-09-19T10:01:13.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.043+0000 7ff83f658740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c0b1f80 con 0x5624329a74b0 2024-09-19T10:01:13.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.043+0000 7ff839d7f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a74b0 0x5624329b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:13.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.043+0000 7ff839d7f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a74b0 0x5624329b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:39010/0 (socket says 172.21.15.18:39010) 2024-09-19T10:01:13.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.043+0000 7ff839d7f640 1 -- 172.21.15.18:0/1408384391 learned_addr learned my addr 172.21.15.18:0/1408384391 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:13.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.043+0000 7ff83ad81640 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329ac540 0x562432a36c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:13.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.043+0000 7ff83f658740 10 client.0 _ll_register_callbacks cb 0x7ff824017630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:13.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.044+0000 7ff839d7f640 1 -- 172.21.15.18:0/1408384391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329ac540 msgr2=0x562432a36c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:13.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.044+0000 7ff839d7f640 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329ac540 0x562432a36c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.044+0000 7ff839d7f640 1 -- 172.21.15.18:0/1408384391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329a6b70 msgr2=0x5624329b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.044+0000 7ff839d7f640 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329a6b70 0x5624329b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.044+0000 7ff839d7f640 1 -- 172.21.15.18:0/1408384391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562432a37230 con 0x5624329a74b0 2024-09-19T10:01:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.044+0000 7ff83f658740 1 -- 172.21.15.18:0/1408384391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8240a3e50 con 0x5624329a74b0 2024-09-19T10:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.048+0000 7ff839d7f640 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a74b0 0x5624329b5810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff82409b3a0 tx=0x7ff8240996f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee958fbaffcc03eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.048+0000 7ff81dffb640 10 client.27028 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:01:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.046+0000 7f9a15ffb640 1 -- 172.21.15.18:0/4230891259 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f9a2001dae0 con 0x5594aaae6300 2024-09-19T10:01:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.047+0000 7f9a15ffb640 10 client.26999 handle_command_reply: tid=0 2024-09-19T10:01:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.047+0000 7f9a3720f740 1 client.26999 shutdown 2024-09-19T10:01:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.047+0000 7f9a3720f740 1 -- 172.21.15.18:0/4230891259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 msgr2=0x5594aaa6edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.047+0000 7f9a3720f740 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa6edd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097d0 tx=0x7f9a20009800 comp rx=0 tx=0).stop 2024-09-19T10:01:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.047+0000 7f9a3720f740 1 -- 172.21.15.18:0/4230891259 shutdown_connections 2024-09-19T10:01:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.047+0000 7f9a3720f740 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5594aaae6300 0x5594aaae8720 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.048+0000 7f9a3720f740 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594aaa6bd40 0x5594aaa6f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.048+0000 7f9a15ffb640 0 client.26999 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.048+0000 7f9a3720f740 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5594aaa61480 0x5594aaa6f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.048+0000 7f9a3720f740 1 --2- 172.21.15.18:0/4230891259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5594aaa60b60 0x5594aaa6edd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.054 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:01:13.054 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T10:01:13.054 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "33549593-5868-4763-bb11-29282c805239", 2024-09-19T10:01:13.055 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T10:01:13.055 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:01:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.048+0000 7f9a3720f740 1 -- 172.21.15.18:0/4230891259 >> 172.21.15.18:0/4230891259 conn(0x5594aaa5d0f0 msgr2=0x5594aaa5ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.048+0000 7f9a3720f740 1 -- 172.21.15.18:0/4230891259 shutdown_connections 2024-09-19T10:01:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.048+0000 7f9a3720f740 1 -- 172.21.15.18:0/4230891259 wait complete. 2024-09-19T10:01:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.048+0000 7f9a3720f740 20 client.26999 trim_cache size 0 max 16384 2024-09-19T10:01:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.049+0000 7f9a34e36640 1 -- 172.21.15.18:0/4293607315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a1c0a3250 msgr2=0x7f9a1c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.049+0000 7f9a34e36640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a1c0a3250 0x7f9a1c0a5710 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x5594aaa5e470 tx=0x7f9a180049e0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.050+0000 7f9a34e36640 1 -- 172.21.15.18:0/4293607315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3011b140 msgr2=0x7f9a301118e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.050+0000 7f9a34e36640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3011b140 0x7f9a301118e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009b30 tx=0x7f9a280319b0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.050+0000 7f9a34e36640 1 -- 172.21.15.18:0/4293607315 shutdown_connections 2024-09-19T10:01:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.050+0000 7f9a34e36640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9a1c0a3250 0x7f9a1c0a5710 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.050+0000 7f9a34e36640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3011b140 0x7f9a301118e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.050+0000 7f9a34e36640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a30109830 0x7f9a30118bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.051+0000 7f9a34e36640 1 --2- 172.21.15.18:0/4293607315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a30109450 0x7f9a30118690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.051+0000 7f9a34e36640 1 -- 172.21.15.18:0/4293607315 >> 172.21.15.18:0/4293607315 conn(0x7f9a3006e140 msgr2=0x7f9a3011be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.052+0000 7ff81dffb640 1 -- 172.21.15.18:0/1408384391 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82401e040 con 0x5624329a74b0 2024-09-19T10:01:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.052+0000 7ff81dffb640 1 -- 172.21.15.18:0/1408384391 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff824010610 con 0x5624329a74b0 2024-09-19T10:01:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.052+0000 7ff81dffb640 1 -- 172.21.15.18:0/1408384391 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff82409afb0 con 0x5624329a74b0 2024-09-19T10:01:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.052+0000 7ff83f658740 10 client.27028 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.052+0000 7ff83f658740 1 -- 172.21.15.18:0/1408384391 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=28}) -- 0x562432a38400 con 0x5624329a74b0 2024-09-19T10:01:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.054+0000 7f9a34e36640 1 -- 172.21.15.18:0/4293607315 shutdown_connections 2024-09-19T10:01:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.056+0000 7ff81dffb640 1 -- 172.21.15.18:0/1408384391 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff824096f30 con 0x5624329a74b0 2024-09-19T10:01:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.056+0000 7ff83f658740 10 client.27028 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.056+0000 7ff83f658740 10 client.27028 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.056+0000 7ff83f658740 20 client.27028 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.056+0000 7ff83f658740 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562432a38a50 0x562432a3ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.057+0000 7ff83f658740 4 client.27028 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:01:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.057+0000 7ff83f658740 1 -- 172.21.15.18:0/1408384391 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562432911d70 con 0x562432a38a50 2024-09-19T10:01:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.063+0000 7ff83a580640 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562432a38a50 0x562432a3ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:13.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:13.056+0000 7f9a34e36640 1 -- 172.21.15.18:0/4293607315 wait complete. 2024-09-19T10:01:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.080+0000 7ff83a580640 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562432a38a50 0x562432a3ae70 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3624c04c7539fb4 server_cookie=ec633f5d1e20ac7e in_seq=0 out_seq=0 2024-09-19T10:01:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:13.080+0000 7ff81dffb640 10 client.27028 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:14.023 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T10:01:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:14 smithi018 ceph-mon[30956]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 921 MiB/s wr, 1.71k op/s 2024-09-19T10:01:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:14 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T10:01:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:14 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T10:01:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:14 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T10:01:14.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:14 smithi049 ceph-mon[34858]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 921 MiB/s wr, 1.71k op/s 2024-09-19T10:01:14.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:14 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T10:01:14.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:14 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T10:01:14.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:14 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T10:01:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:14 smithi162 ceph-mon[35174]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 921 MiB/s wr, 1.71k op/s 2024-09-19T10:01:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:14 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T10:01:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:14 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T10:01:14.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:14 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T10:01:14.972 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:01:15.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.838+0000 7f534f59e640 1 -- 172.21.15.18:0/3514738393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534809a550 msgr2=0x7f534809a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:15.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.838+0000 7f534f59e640 1 --2- 172.21.15.18:0/3514738393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534809a550 0x7f534809a930 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5340009900 tx=0x7f534002a410 comp rx=0 tx=0).stop 2024-09-19T10:01:15.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.839+0000 7f534f59e640 1 -- 172.21.15.18:0/3514738393 shutdown_connections 2024-09-19T10:01:15.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.839+0000 7f534f59e640 1 --2- 172.21.15.18:0/3514738393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53480952d0 0x7f53480a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.839+0000 7f534f59e640 1 --2- 172.21.15.18:0/3514738393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5348094930 0x7f5348094d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.839+0000 7f534f59e640 1 --2- 172.21.15.18:0/3514738393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534809a550 0x7f534809a930 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.839+0000 7f534f59e640 1 -- 172.21.15.18:0/3514738393 >> 172.21.15.18:0/3514738393 conn(0x7f534800a1f0 msgr2=0x7f534800a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:15.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.840+0000 7f534f59e640 1 -- 172.21.15.18:0/3514738393 shutdown_connections 2024-09-19T10:01:15.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.840+0000 7f534f59e640 1 -- 172.21.15.18:0/3514738393 wait complete. 2024-09-19T10:01:15.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.842+0000 7f534f59e640 1 Processor -- start 2024-09-19T10:01:15.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.842+0000 7f534f59e640 1 -- start start 2024-09-19T10:01:15.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.843+0000 7f534f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348094930 0x7f534812ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.843+0000 7f534f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53480952d0 0x7f534812b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.843+0000 7f534e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348094930 0x7f534812ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.843+0000 7f534e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348094930 0x7f534812ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50786/0 (socket says 172.21.15.18:50786) 2024-09-19T10:01:15.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.843+0000 7f534f59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f534809a550 0x7f534812f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.845+0000 7f534dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53480952d0 0x7f534812b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.845+0000 7f534dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53480952d0 0x7f534812b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49074/0 (socket says 172.21.15.18:49074) 2024-09-19T10:01:15.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.846+0000 7f534e59c640 1 -- 172.21.15.18:0/682824849 learned_addr learned my addr 172.21.15.18:0/682824849 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:15.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.846+0000 7f534ed9d640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f534809a550 0x7f534812f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.847+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f53480a4910 con 0x7f53480952d0 2024-09-19T10:01:15.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.847+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f53480a4790 con 0x7f5348094930 2024-09-19T10:01:15.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.847+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53480a4a90 con 0x7f534809a550 2024-09-19T10:01:15.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.852+0000 7f534e59c640 1 -- 172.21.15.18:0/682824849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f534809a550 msgr2=0x7f534812f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:15.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.852+0000 7f534e59c640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f534809a550 0x7f534812f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.852+0000 7f534e59c640 1 -- 172.21.15.18:0/682824849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53480952d0 msgr2=0x7f534812b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:15.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.852+0000 7f534e59c640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53480952d0 0x7f534812b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.852+0000 7f534e59c640 1 -- 172.21.15.18:0/682824849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534812fe20 con 0x7f5348094930 2024-09-19T10:01:15.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.856+0000 7f534e59c640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348094930 0x7f534812ae70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5340006010 tx=0x7f5340003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:15.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.857+0000 7f533f7fe640 1 -- 172.21.15.18:0/682824849 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534003f070 con 0x7f5348094930 2024-09-19T10:01:15.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.858+0000 7f533f7fe640 1 -- 172.21.15.18:0/682824849 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5340031e30 con 0x7f5348094930 2024-09-19T10:01:15.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.858+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53481300b0 con 0x7f5348094930 2024-09-19T10:01:15.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.858+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53481304d0 con 0x7f5348094930 2024-09-19T10:01:15.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.858+0000 7f533f7fe640 1 -- 172.21.15.18:0/682824849 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340035030 con 0x7f5348094930 2024-09-19T10:01:15.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.864+0000 7f5356cd9740 1 Processor -- start 2024-09-19T10:01:15.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.864+0000 7f5356cd9740 1 -- start start 2024-09-19T10:01:15.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.865+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9018b0 0x558c6f901c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.865+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f9021d0 0x558c6f8fc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.865+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f8fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.865+0000 7f5356cd9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558c6f8582e0 con 0x558c6f9021d0 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.865+0000 7f5356cd9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558c6f7ffce0 con 0x558c6f9018b0 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.865+0000 7f5356cd9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558c6f8542a0 con 0x558c6f8fc870 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.866+0000 7f534ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9018b0 0x558c6f901c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.866+0000 7f534ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9018b0 0x558c6f901c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50788/0 (socket says 172.21.15.18:50788) 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.866+0000 7f534ed9d640 1 -- 172.21.15.18:0/2635446283 learned_addr learned my addr 172.21.15.18:0/2635446283 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.867+0000 7f534dd9b640 1 --2- 172.21.15.18:0/2635446283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f8fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.867+0000 7f534ed9d640 1 -- 172.21.15.18:0/2635446283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 msgr2=0x558c6f8fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.867+0000 7f534ed9d640 1 --2- 172.21.15.18:0/2635446283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f8fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.867+0000 7f534ed9d640 1 -- 172.21.15.18:0/2635446283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f9021d0 msgr2=0x558c6f8fc200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.867+0000 7f534ed9d640 1 --2- 172.21.15.18:0/2635446283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f9021d0 0x558c6f8fc200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.867+0000 7f534ed9d640 1 -- 172.21.15.18:0/2635446283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c6f7e4440 con 0x558c6f9018b0 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.868+0000 7f534ed9d640 1 --2- 172.21.15.18:0/2635446283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9018b0 0x558c6f901c90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5350067fb0 tx=0x7f53500505a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a342cc94e001d514 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.868+0000 7f533cff9640 1 -- 172.21.15.18:0/2635446283 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535006cb70 con 0x558c6f9018b0 2024-09-19T10:01:15.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.868+0000 7f533cff9640 1 -- 172.21.15.18:0/2635446283 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f535006cd10 con 0x558c6f9018b0 2024-09-19T10:01:15.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.869+0000 7f5356cd9740 1 -- 172.21.15.18:0/2635446283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9018b0 msgr2=0x558c6f901c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:15.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.869+0000 7f5356cd9740 1 --2- 172.21.15.18:0/2635446283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9018b0 0x558c6f901c90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5350067fb0 tx=0x7f53500505a0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.870+0000 7f5356cd9740 1 -- 172.21.15.18:0/2635446283 shutdown_connections 2024-09-19T10:01:15.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.870+0000 7f5356cd9740 1 --2- 172.21.15.18:0/2635446283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f8fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.870+0000 7f5356cd9740 1 --2- 172.21.15.18:0/2635446283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f9021d0 0x558c6f8fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.870+0000 7f5356cd9740 1 --2- 172.21.15.18:0/2635446283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9018b0 0x558c6f901c90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.870+0000 7f5356cd9740 1 -- 172.21.15.18:0/2635446283 >> 172.21.15.18:0/2635446283 conn(0x558c6f8ee6b0 msgr2=0x558c6f8eea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:15.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.874+0000 7f533f7fe640 1 -- 172.21.15.18:0/682824849 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5340042070 con 0x7f5348094930 2024-09-19T10:01:15.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.876+0000 7f533f7fe640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53380a33a0 0x7f53380a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.876+0000 7f533f7fe640 1 -- 172.21.15.18:0/682824849 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f53400efe50 con 0x7f5348094930 2024-09-19T10:01:15.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.877+0000 7f534dd9b640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53380a33a0 0x7f53380a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.878+0000 7f534dd9b640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53380a33a0 0x7f53380a5860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x558c6f8eff00 tx=0x7f534400b320 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:15.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.879+0000 7f5356cd9740 1 -- 172.21.15.18:0/2635446283 shutdown_connections 2024-09-19T10:01:15.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.879+0000 7f5356cd9740 1 -- 172.21.15.18:0/2635446283 wait complete. 2024-09-19T10:01:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.879+0000 7f5356cd9740 1 -- start start 2024-09-19T10:01:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.879+0000 7f5356cd9740 1 Processor -- start 2024-09-19T10:01:15.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.880+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f8fc870 0x558c6f907fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.880+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f905730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.880+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f905c70 0x558c6f912030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.880+0000 7f5356cd9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558c6f908a00 con 0x558c6f8fc870 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.880+0000 7f5356cd9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558c6f813050 con 0x558c6f9052b0 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.880+0000 7f5356cd9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558c6f908b80 con 0x558c6f905c70 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.880+0000 7f5356cd9740 10 client.0 _ll_register_callbacks cb 0x558c6f853160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.881+0000 7f534e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f8fc870 0x558c6f907fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.881+0000 7f534e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f8fc870 0x558c6f907fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49078/0 (socket says 172.21.15.18:49078) 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.881+0000 7f534e59c640 1 -- 172.21.15.18:0/3611295052 learned_addr learned my addr 172.21.15.18:0/3611295052 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.881+0000 7f534e59c640 1 -- 172.21.15.18:0/3611295052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f905c70 msgr2=0x558c6f912030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.881+0000 7f534e59c640 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f905c70 0x558c6f912030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.881+0000 7f534e59c640 1 -- 172.21.15.18:0/3611295052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 msgr2=0x558c6f905730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:01:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.881+0000 7f534e59c640 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f905730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.881+0000 7f534e59c640 1 -- 172.21.15.18:0/3611295052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c6f5c93c0 con 0x558c6f8fc870 2024-09-19T10:01:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.882+0000 7f534e59c640 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f8fc870 0x558c6f907fb0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f53400edcf0 tx=0x7f53400bc330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b79a055ee3621c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.882+0000 7f5335ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:01:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.882+0000 7f5335ffb640 1 -- 172.21.15.18:0/3611295052 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340049040 con 0x558c6f8fc870 2024-09-19T10:01:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.882+0000 7f5335ffb640 1 -- 172.21.15.18:0/3611295052 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f53400bc700 con 0x558c6f8fc870 2024-09-19T10:01:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.883+0000 7f5356cd9740 1 -- 172.21.15.18:0/3611295052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558c6f865850 con 0x558c6f8fc870 2024-09-19T10:01:15.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.884+0000 7f5335ffb640 1 -- 172.21.15.18:0/3611295052 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53400bc4a0 con 0x558c6f8fc870 2024-09-19T10:01:15.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.884+0000 7f5356cd9740 10 client.17580 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:15.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.884+0000 7f5356cd9740 1 -- 172.21.15.18:0/3611295052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c6f914d80 con 0x558c6f8fc870 2024-09-19T10:01:15.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.885+0000 7f5335ffb640 1 -- 172.21.15.18:0/3611295052 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558c6f865850 con 0x558c6f8fc870 2024-09-19T10:01:15.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.886+0000 7f5335ffb640 1 -- 172.21.15.18:0/3611295052 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53400c4c80 con 0x558c6f8fc870 2024-09-19T10:01:15.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.886+0000 7f5356cd9740 10 client.17580 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:15.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.886+0000 7f5356cd9740 10 client.17580 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:15.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.886+0000 7f5356cd9740 20 client.17580 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:15.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.886+0000 7f5356cd9740 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c6f916520 0x558c6f9189a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.886+0000 7f5356cd9740 4 client.17580 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:15.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.886+0000 7f5356cd9740 1 -- 172.21.15.18:0/3611295052 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c6f85fd60 con 0x558c6f916520 2024-09-19T10:01:15.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.888+0000 7f534dd9b640 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c6f916520 0x558c6f9189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.896+0000 7f534dd9b640 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c6f916520 0x558c6f9189a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e95fc144f597ee77 server_cookie=d3d897801225b4ca in_seq=0 out_seq=0 2024-09-19T10:01:15.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.896+0000 7f5335ffb640 10 client.17580 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:15.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.904+0000 7f5335ffb640 1 -- 172.21.15.18:0/3611295052 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c6f85fd60 con 0x558c6f916520 2024-09-19T10:01:15.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.904+0000 7f5335ffb640 10 client.17580 handle_command_reply: tid=0 2024-09-19T10:01:15.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.905+0000 7f5356cd9740 1 client.17580 shutdown 2024-09-19T10:01:15.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.905+0000 7f5356cd9740 1 -- 172.21.15.18:0/3611295052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f8fc870 msgr2=0x558c6f907fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:15.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.905+0000 7f5356cd9740 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f8fc870 0x558c6f907fb0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f53400edcf0 tx=0x7f53400bc330 comp rx=0 tx=0).stop 2024-09-19T10:01:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.905+0000 7f5356cd9740 1 -- 172.21.15.18:0/3611295052 shutdown_connections 2024-09-19T10:01:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.905+0000 7f5356cd9740 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c6f916520 0x558c6f9189a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.905+0000 7f5356cd9740 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f905c70 0x558c6f912030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.905+0000 7f5356cd9740 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f905730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.905+0000 7f5356cd9740 1 --2- 172.21.15.18:0/3611295052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f8fc870 0x558c6f907fb0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.905+0000 7f5356cd9740 1 -- 172.21.15.18:0/3611295052 >> 172.21.15.18:0/3611295052 conn(0x558c6f8ee6b0 msgr2=0x558c6f8ed500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.906+0000 7f5335ffb640 0 client.17580 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.906+0000 7f5356cd9740 1 -- 172.21.15.18:0/3611295052 shutdown_connections 2024-09-19T10:01:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.906+0000 7f5356cd9740 1 -- 172.21.15.18:0/3611295052 wait complete. 2024-09-19T10:01:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.906+0000 7f5356cd9740 20 client.17580 trim_cache size 0 max 16384 2024-09-19T10:01:15.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.967+0000 7f5356cd9740 1 Processor -- start 2024-09-19T10:01:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.967+0000 7f5356cd9740 1 -- start start 2024-09-19T10:01:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.967+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f8edc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.968+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f911e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.968+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f905c70 0x558c6f91e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.968+0000 7f5356cd9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5330030470 con 0x558c6f905c70 2024-09-19T10:01:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.968+0000 7f5356cd9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5330031fb0 con 0x558c6f9052b0 2024-09-19T10:01:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.968+0000 7f5356cd9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5330030b40 con 0x558c6f8fc870 2024-09-19T10:01:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.971+0000 7f534ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f905c70 0x558c6f91e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.971+0000 7f534ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f905c70 0x558c6f91e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49082/0 (socket says 172.21.15.18:49082) 2024-09-19T10:01:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.971+0000 7f534ed9d640 1 -- 172.21.15.18:0/564673742 learned_addr learned my addr 172.21.15.18:0/564673742 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.971+0000 7f534dd9b640 1 --2- 172.21.15.18:0/564673742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f911e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.971+0000 7f534e59c640 1 --2- 172.21.15.18:0/564673742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f8edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:15.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.974+0000 7f534ed9d640 1 -- 172.21.15.18:0/564673742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 msgr2=0x558c6f8edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:15.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.974+0000 7f534ed9d640 1 --2- 172.21.15.18:0/564673742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f8edc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.974+0000 7f534ed9d640 1 -- 172.21.15.18:0/564673742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 msgr2=0x558c6f911e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.974+0000 7f534ed9d640 1 --2- 172.21.15.18:0/564673742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f911e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.974+0000 7f534ed9d640 1 -- 172.21.15.18:0/564673742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c6f903800 con 0x558c6f905c70 2024-09-19T10:01:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.975+0000 7f534ed9d640 1 --2- 172.21.15.18:0/564673742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f905c70 0x558c6f91e9f0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f5350051220 tx=0x7f5350067d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b7df80aa88b5e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.988+0000 7f5337fff640 1 -- 172.21.15.18:0/564673742 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535006cb70 con 0x558c6f905c70 2024-09-19T10:01:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.989+0000 7f5337fff640 1 -- 172.21.15.18:0/564673742 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5350050ea0 con 0x558c6f905c70 2024-09-19T10:01:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.990+0000 7f5356cd9740 1 -- 172.21.15.18:0/564673742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f905c70 msgr2=0x558c6f91e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.990+0000 7f5356cd9740 1 --2- 172.21.15.18:0/564673742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f905c70 0x558c6f91e9f0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f5350051220 tx=0x7f5350067d60 comp rx=0 tx=0).stop 2024-09-19T10:01:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.990+0000 7f5356cd9740 1 -- 172.21.15.18:0/564673742 shutdown_connections 2024-09-19T10:01:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.990+0000 7f5356cd9740 1 --2- 172.21.15.18:0/564673742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f905c70 0x558c6f91e9f0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.990+0000 7f5356cd9740 1 --2- 172.21.15.18:0/564673742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f911e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.990+0000 7f5356cd9740 1 --2- 172.21.15.18:0/564673742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f8edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.990+0000 7f5356cd9740 1 -- 172.21.15.18:0/564673742 >> 172.21.15.18:0/564673742 conn(0x558c6f8ee6b0 msgr2=0x558c6f8ed500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:15.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.994+0000 7f5356cd9740 1 -- 172.21.15.18:0/564673742 shutdown_connections 2024-09-19T10:01:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.995+0000 7f5356cd9740 1 -- 172.21.15.18:0/564673742 wait complete. 2024-09-19T10:01:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.996+0000 7f5356cd9740 1 -- start start 2024-09-19T10:01:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.996+0000 7f5356cd9740 1 Processor -- start 2024-09-19T10:01:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.998+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f90e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.998+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f90e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.998+0000 7f5356cd9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f97cad0 0x558c6f97cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.998+0000 7f5356cd9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f53300318e0 con 0x558c6f97cad0 2024-09-19T10:01:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.998+0000 7f5356cd9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5330031210 con 0x558c6f9052b0 2024-09-19T10:01:16.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.998+0000 7f5356cd9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f533002e450 con 0x558c6f8fc870 2024-09-19T10:01:16.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:15.998+0000 7f5356cd9740 10 client.0 _ll_register_callbacks cb 0x7f5340005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:16.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.004+0000 7f534dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f90e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:16.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.004+0000 7f534dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f90e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50830/0 (socket says 172.21.15.18:50830) 2024-09-19T10:01:16.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.004+0000 7f534dd9b640 1 -- 172.21.15.18:0/912477049 learned_addr learned my addr 172.21.15.18:0/912477049 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:16.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.004+0000 7f534e59c640 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f90e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:16.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.005+0000 7f534dd9b640 1 -- 172.21.15.18:0/912477049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 msgr2=0x558c6f90e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:16.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.005+0000 7f534dd9b640 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f90e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.005+0000 7f534dd9b640 1 -- 172.21.15.18:0/912477049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f97cad0 msgr2=0x558c6f97cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:16.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.005+0000 7f534dd9b640 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f97cad0 0x558c6f97cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.005+0000 7f534dd9b640 1 -- 172.21.15.18:0/912477049 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c6f97d760 con 0x558c6f9052b0 2024-09-19T10:01:16.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.006+0000 7f534dd9b640 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f90e790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x558c6f919210 tx=0x7f53440047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee62d6f8fc9755a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:16.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.006+0000 7f5335ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:01:16.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.006+0000 7f5335ffb640 1 -- 172.21.15.18:0/912477049 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534401e620 con 0x558c6f9052b0 2024-09-19T10:01:16.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.007+0000 7f5356cd9740 1 -- 172.21.15.18:0/912477049 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558c6f7dc210 con 0x558c6f9052b0 2024-09-19T10:01:16.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.007+0000 7f5335ffb640 1 -- 172.21.15.18:0/912477049 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f534401e7c0 con 0x558c6f9052b0 2024-09-19T10:01:16.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.007+0000 7f5335ffb640 1 -- 172.21.15.18:0/912477049 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5344034020 con 0x558c6f9052b0 2024-09-19T10:01:16.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.007+0000 7f5356cd9740 10 client.27020 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:16.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.007+0000 7f5356cd9740 1 -- 172.21.15.18:0/912477049 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c6f90d240 con 0x558c6f9052b0 2024-09-19T10:01:16.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.008+0000 7f5335ffb640 1 -- 172.21.15.18:0/912477049 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558c6f7dc210 con 0x558c6f9052b0 2024-09-19T10:01:16.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.010+0000 7f5335ffb640 1 -- 172.21.15.18:0/912477049 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f534400e040 con 0x558c6f9052b0 2024-09-19T10:01:16.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.010+0000 7f5356cd9740 10 client.27020 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:16.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.010+0000 7f5356cd9740 10 client.27020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:16.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.011+0000 7f5356cd9740 20 client.27020 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:16.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.011+0000 7f5356cd9740 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c6f90d980 0x558c6f8fa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:16.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.011+0000 7f5356cd9740 4 client.27020 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T10:01:16.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.011+0000 7f5356cd9740 1 -- 172.21.15.18:0/912477049 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c6f8299a0 con 0x558c6f90d980 2024-09-19T10:01:16.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.014+0000 7f534e59c640 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c6f90d980 0x558c6f8fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:16.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.016+0000 7f5335ffb640 10 client.27020 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:16.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.016+0000 7f534e59c640 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c6f90d980 0x558c6f8fa910 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce6447e0f9c84e3c server_cookie=688b3b19777ed55a in_seq=0 out_seq=0 2024-09-19T10:01:16.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.021+0000 7f5335ffb640 1 -- 172.21.15.18:0/912477049 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x558c6f8299a0 con 0x558c6f90d980 2024-09-19T10:01:16.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.021+0000 7f5335ffb640 10 client.27020 handle_command_reply: tid=0 2024-09-19T10:01:16.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.021+0000 7f5356cd9740 1 client.27020 shutdown 2024-09-19T10:01:16.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5356cd9740 1 -- 172.21.15.18:0/912477049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 msgr2=0x558c6f90e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:16.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5356cd9740 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f90e790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x558c6f919210 tx=0x7f53440047d0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5356cd9740 1 -- 172.21.15.18:0/912477049 shutdown_connections 2024-09-19T10:01:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5356cd9740 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558c6f90d980 0x558c6f8fa910 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5356cd9740 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6f97cad0 0x558c6f97cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5356cd9740 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c6f9052b0 0x558c6f90e790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5356cd9740 1 --2- 172.21.15.18:0/912477049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c6f8fc870 0x558c6f90e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5356cd9740 1 -- 172.21.15.18:0/912477049 >> 172.21.15.18:0/912477049 conn(0x558c6f8ee6b0 msgr2=0x558c6f9025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5335ffb640 0 client.27020 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5356cd9740 1 -- 172.21.15.18:0/912477049 shutdown_connections 2024-09-19T10:01:16.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.023+0000 7f5356cd9740 1 -- 172.21.15.18:0/912477049 wait complete. 2024-09-19T10:01:16.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.024+0000 7f5356cd9740 20 client.27020 trim_cache size 0 max 16384 2024-09-19T10:01:16.030 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:01:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "scrub active (15 inodes in the stack)", 2024-09-19T10:01:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T10:01:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "33549593-5868-4763-bb11-29282c805239": { 2024-09-19T10:01:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T10:01:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "33549593-5868-4763-bb11-29282c805239", 2024-09-19T10:01:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T10:01:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:01:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:01:16.031 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:01:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.027+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53380a33a0 msgr2=0x7f53380a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.027+0000 7f534f59e640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53380a33a0 0x7f53380a5860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x558c6f8eff00 tx=0x7f534400b320 comp rx=0 tx=0).stop 2024-09-19T10:01:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.027+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348094930 msgr2=0x7f534812ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.027+0000 7f534f59e640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348094930 0x7f534812ae70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5340006010 tx=0x7f5340003c80 comp rx=0 tx=0).stop 2024-09-19T10:01:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.027+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 shutdown_connections 2024-09-19T10:01:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.027+0000 7f534f59e640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f53380a33a0 0x7f53380a5860 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.027+0000 7f534f59e640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f534809a550 0x7f534812f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.027+0000 7f534f59e640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53480952d0 0x7f534812b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.027+0000 7f534f59e640 1 --2- 172.21.15.18:0/682824849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5348094930 0x7f534812ae70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.027+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 >> 172.21.15.18:0/682824849 conn(0x7f534800a1f0 msgr2=0x7f53480936d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.029+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 shutdown_connections 2024-09-19T10:01:16.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:16.029+0000 7f534f59e640 1 -- 172.21.15.18:0/682824849 wait complete. 2024-09-19T10:01:16.389 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:16 smithi018 ceph-mon[30956]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 798 MiB/s wr, 1.50k op/s 2024-09-19T10:01:16.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:16 smithi049 ceph-mon[34858]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 798 MiB/s wr, 1.50k op/s 2024-09-19T10:01:16.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:16 smithi162 ceph-mon[35174]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 798 MiB/s wr, 1.50k op/s 2024-09-19T10:01:17.114 INFO:tasks.cephfs.filesystem:scrub status for tag:33549593-5868-4763-bb11-29282c805239 - {'path': '/', 'tag': '33549593-5868-4763-bb11-29282c805239', 'options': 'recursive,force'} 2024-09-19T10:01:18.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:18 smithi018 ceph-mon[30956]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 878 MiB/s wr, 1.62k op/s 2024-09-19T10:01:18.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:18 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T10:01:18.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:18 smithi049 ceph-mon[34858]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 878 MiB/s wr, 1.62k op/s 2024-09-19T10:01:18.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:18 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T10:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.748+0000 7ff81dffb640 1 -- 172.21.15.18:0/1408384391 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562432911d70 con 0x562432a38a50 2024-09-19T10:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.748+0000 7ff81dffb640 10 client.27028 handle_command_reply: tid=0 2024-09-19T10:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.748+0000 7ff83f658740 1 client.27028 shutdown 2024-09-19T10:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 1 -- 172.21.15.18:0/1408384391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a74b0 msgr2=0x5624329b5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a74b0 0x5624329b5810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff82409b3a0 tx=0x7ff8240996f0 comp rx=0 tx=0).stop 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 1 -- 172.21.15.18:0/1408384391 shutdown_connections 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562432a38a50 0x562432a3ae70 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624329ac540 0x562432a36c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624329a74b0 0x5624329b5810 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 1 --2- 172.21.15.18:0/1408384391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5624329a6b70 0x5624329b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 1 -- 172.21.15.18:0/1408384391 >> 172.21.15.18:0/1408384391 conn(0x5624329a21e0 msgr2=0x5624329a12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff81dffb640 0 client.27028 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 1 -- 172.21.15.18:0/1408384391 shutdown_connections 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 1 -- 172.21.15.18:0/1408384391 wait complete. 2024-09-19T10:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.749+0000 7ff83f658740 20 client.27028 trim_cache size 0 max 16384 2024-09-19T10:01:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:01:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:01:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:01:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:01:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.752+0000 7ff83b582640 1 -- 172.21.15.18:0/3094378237 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8200a33d0 msgr2=0x7ff8200a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.752+0000 7ff83b582640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8200a33d0 0x7ff8200a5890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff830009230 tx=0x7ff830005fd0 comp rx=0 tx=0).stop 2024-09-19T10:01:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.752+0000 7ff83b582640 1 -- 172.21.15.18:0/3094378237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff82c0aa1c0 msgr2=0x7ff82c143760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.752+0000 7ff83b582640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff82c0aa1c0 0x7ff82c143760 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff82400b4a0 tx=0x7ff82400b960 comp rx=0 tx=0).stop 2024-09-19T10:01:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.753+0000 7ff83b582640 1 -- 172.21.15.18:0/3094378237 shutdown_connections 2024-09-19T10:01:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.753+0000 7ff83b582640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff8200a33d0 0x7ff8200a5890 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.753+0000 7ff83b582640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff82c1487c0 0x7ff82c14abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.753+0000 7ff83b582640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff82c0aa1c0 0x7ff82c143760 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.753+0000 7ff83b582640 1 --2- 172.21.15.18:0/3094378237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff82c0a7810 0x7ff82c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.753+0000 7ff83b582640 1 -- 172.21.15.18:0/3094378237 >> 172.21.15.18:0/3094378237 conn(0x7ff82c0a0c90 msgr2=0x7ff82c0a5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:18.759 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.756+0000 7ff83b582640 1 -- 172.21.15.18:0/3094378237 shutdown_connections 2024-09-19T10:01:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:18.756+0000 7ff83b582640 1 -- 172.21.15.18:0/3094378237 wait complete. 2024-09-19T10:01:18.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:18 smithi162 ceph-mon[35174]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 878 MiB/s wr, 1.62k op/s 2024-09-19T10:01:18.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:18 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T10:01:20.715 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:20 smithi162 ceph-mon[35174]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 793 MiB/s wr, 1.42k op/s 2024-09-19T10:01:20.715 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:20 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T10:01:20.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:20 smithi018 ceph-mon[30956]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 793 MiB/s wr, 1.42k op/s 2024-09-19T10:01:20.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:20 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T10:01:20.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:20 smithi049 ceph-mon[34858]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 793 MiB/s wr, 1.42k op/s 2024-09-19T10:01:20.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:20 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T10:01:22.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:22 smithi018 ceph-mon[30956]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 800 MiB/s wr, 1.42k op/s 2024-09-19T10:01:22.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:22 smithi049 ceph-mon[34858]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 800 MiB/s wr, 1.42k op/s 2024-09-19T10:01:22.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:22 smithi162 ceph-mon[35174]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 800 MiB/s wr, 1.42k op/s 2024-09-19T10:01:24.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:24 smithi018 ceph-mon[30956]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 883 MiB/s wr, 1.75k op/s 2024-09-19T10:01:24.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:24 smithi049 ceph-mon[34858]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 883 MiB/s wr, 1.75k op/s 2024-09-19T10:01:24.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:24 smithi162 ceph-mon[35174]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 883 MiB/s wr, 1.75k op/s 2024-09-19T10:01:27.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:26 smithi018 ceph-mon[30956]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 792 MiB/s wr, 1.67k op/s 2024-09-19T10:01:27.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:26 smithi049 ceph-mon[34858]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 792 MiB/s wr, 1.67k op/s 2024-09-19T10:01:27.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:26 smithi162 ceph-mon[35174]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 792 MiB/s wr, 1.67k op/s 2024-09-19T10:01:29.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:28 smithi018 ceph-mon[30956]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 846 MiB/s wr, 1.70k op/s 2024-09-19T10:01:29.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:28 smithi049 ceph-mon[34858]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 846 MiB/s wr, 1.70k op/s 2024-09-19T10:01:29.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:28 smithi162 ceph-mon[35174]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 846 MiB/s wr, 1.70k op/s 2024-09-19T10:01:30.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:29 smithi018 ceph-mon[30956]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 810 MiB/s wr, 1.65k op/s 2024-09-19T10:01:30.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:29 smithi049 ceph-mon[34858]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 810 MiB/s wr, 1.65k op/s 2024-09-19T10:01:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:29 smithi162 ceph-mon[35174]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 810 MiB/s wr, 1.65k op/s 2024-09-19T10:01:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.994+0000 7f7d222d0640 1 -- 172.21.15.18:0/1192225129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d1c101b60 msgr2=0x7f7d1c101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.994+0000 7f7d222d0640 1 --2- 172.21.15.18:0/1192225129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d1c101b60 0x7f7d1c101f60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009900 tx=0x7f7d0c02a410 comp rx=0 tx=0).stop 2024-09-19T10:01:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.994+0000 7f7d222d0640 1 -- 172.21.15.18:0/1192225129 shutdown_connections 2024-09-19T10:01:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.994+0000 7f7d222d0640 1 --2- 172.21.15.18:0/1192225129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d1c103710 0x7f7d1c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.994+0000 7f7d222d0640 1 --2- 172.21.15.18:0/1192225129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c102d50 0x7f7d1c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.994+0000 7f7d222d0640 1 --2- 172.21.15.18:0/1192225129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d1c101b60 0x7f7d1c101f60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.994+0000 7f7d222d0640 1 -- 172.21.15.18:0/1192225129 >> 172.21.15.18:0/1192225129 conn(0x7f7d1c0fd2e0 msgr2=0x7f7d1c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.994+0000 7f7d222d0640 1 -- 172.21.15.18:0/1192225129 shutdown_connections 2024-09-19T10:01:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.994+0000 7f7d222d0640 1 -- 172.21.15.18:0/1192225129 wait complete. 2024-09-19T10:01:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.995+0000 7f7d222d0640 1 Processor -- start 2024-09-19T10:01:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.995+0000 7f7d222d0640 1 -- start start 2024-09-19T10:01:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.995+0000 7f7d222d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d1c101b60 0x7f7d1c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.995+0000 7f7d222d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c102d50 0x7f7d1c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.995+0000 7f7d222d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d1c103710 0x7f7d1c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d222d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c10d810 con 0x7f7d1c103710 2024-09-19T10:01:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d222d0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c10d690 con 0x7f7d1c101b60 2024-09-19T10:01:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d222d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c10d990 con 0x7f7d1c102d50 2024-09-19T10:01:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d2086d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d1c103710 0x7f7d1c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d2086d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d1c103710 0x7f7d1c074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34172/0 (socket says 172.21.15.18:34172) 2024-09-19T10:01:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d2086d640 1 -- 172.21.15.18:0/2038033799 learned_addr learned my addr 172.21.15.18:0/2038033799 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d1b7fe640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c102d50 0x7f7d1c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d1c101b60 0x7f7d1c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d2086d640 1 -- 172.21.15.18:0/2038033799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c102d50 msgr2=0x7f7d1c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d2086d640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c102d50 0x7f7d1c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d2086d640 1 -- 172.21.15.18:0/2038033799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d1c101b60 msgr2=0x7f7d1c075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d2086d640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d1c101b60 0x7f7d1c075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d2086d640 1 -- 172.21.15.18:0/2038033799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1c0753b0 con 0x7f7d1c103710 2024-09-19T10:01:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d1c101b60 0x7f7d1c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:01:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.996+0000 7f7d2086d640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d1c103710 0x7f7d1c074b20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400efd0 tx=0x7f7d1400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.997+0000 7f7d197fa640 1 -- 172.21.15.18:0/2038033799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14003b70 con 0x7f7d1c103710 2024-09-19T10:01:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.997+0000 7f7d197fa640 1 -- 172.21.15.18:0/2038033799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d14003d10 con 0x7f7d1c103710 2024-09-19T10:01:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.997+0000 7f7d197fa640 1 -- 172.21.15.18:0/2038033799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d140109f0 con 0x7f7d1c103710 2024-09-19T10:01:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.997+0000 7f7d222d0640 1 -- 172.21.15.18:0/2038033799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1c1a1f20 con 0x7f7d1c103710 2024-09-19T10:01:32.002 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:31.997+0000 7f7d222d0640 1 -- 172.21.15.18:0/2038033799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1c1a2330 con 0x7f7d1c103710 2024-09-19T10:01:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.001+0000 7f7d197fa640 1 -- 172.21.15.18:0/2038033799 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7d14004020 con 0x7f7d1c103710 2024-09-19T10:01:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.001+0000 7f7d25065740 1 Processor -- start 2024-09-19T10:01:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.001+0000 7f7d25065740 1 -- start start 2024-09-19T10:01:32.005 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.001+0000 7f7d25065740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.001+0000 7f7d25065740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 0x5606e49bbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.001+0000 7f7d25065740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49be830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.001+0000 7f7d25065740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606e491a2f0 con 0x5606e49b72e0 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.001+0000 7f7d25065740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5606e48c2270 con 0x5606e49b69a0 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.001+0000 7f7d25065740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5606e49162b0 con 0x5606e49bc370 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d1b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d1b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49be830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:35308/0 (socket says 172.21.15.18:35308) 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d1b7fe640 1 -- 172.21.15.18:0/1079213425 learned_addr learned my addr 172.21.15.18:0/1079213425 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/1079213425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 0x5606e49bbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d1b7fe640 1 -- 172.21.15.18:0/1079213425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 msgr2=0x5606e49b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d1b7fe640 1 --2- 172.21.15.18:0/1079213425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.006 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d1b7fe640 1 -- 172.21.15.18:0/1079213425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 msgr2=0x5606e49bbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d1b7fe640 1 --2- 172.21.15.18:0/1079213425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 0x5606e49bbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d1b7fe640 1 -- 172.21.15.18:0/1079213425 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606e48c1340 con 0x5606e49bc370 2024-09-19T10:01:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d1b7fe640 1 --2- 172.21.15.18:0/1079213425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49be830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000be30 tx=0x7f7d100127c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6536a3be37d3826 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.002+0000 7f7d027fc640 1 -- 172.21.15.18:0/1079213425 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10004220 con 0x5606e49bc370 2024-09-19T10:01:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.003+0000 7f7d027fc640 1 -- 172.21.15.18:0/1079213425 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d100043c0 con 0x5606e49bc370 2024-09-19T10:01:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.003+0000 7f7d027fc640 1 -- 172.21.15.18:0/1079213425 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d100109b0 con 0x5606e49bc370 2024-09-19T10:01:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.003+0000 7f7d197fa640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d040a3370 0x7f7d040a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.003+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d040a3370 0x7f7d040a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.007 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.003+0000 7f7d197fa640 1 -- 172.21.15.18:0/2038033799 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7d140cff90 con 0x7f7d1c103710 2024-09-19T10:01:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d25065740 1 -- 172.21.15.18:0/1079213425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 msgr2=0x5606e49be830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d25065740 1 --2- 172.21.15.18:0/1079213425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49be830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000be30 tx=0x7f7d100127c0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d040a3370 0x7f7d040a5830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c02aa00 tx=0x7f7d0c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d25065740 1 -- 172.21.15.18:0/1079213425 shutdown_connections 2024-09-19T10:01:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d25065740 1 --2- 172.21.15.18:0/1079213425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49be830 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d25065740 1 --2- 172.21.15.18:0/1079213425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 0x5606e49bbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d25065740 1 --2- 172.21.15.18:0/1079213425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d25065740 1 -- 172.21.15.18:0/1079213425 >> 172.21.15.18:0/1079213425 conn(0x5606e49b2010 msgr2=0x5606e49b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d25065740 1 -- 172.21.15.18:0/1079213425 shutdown_connections 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d25065740 1 -- 172.21.15.18:0/1079213425 wait complete. 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.004+0000 7f7d25065740 1 -- start start 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d25065740 1 Processor -- start 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d25065740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b69a0 0x5606e49c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d25065740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b72e0 0x5606e49c1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d25065740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d1bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b69a0 0x5606e49c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d1bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b69a0 0x5606e49c0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34192/0 (socket says 172.21.15.18:34192) 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d1b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b72e0 0x5606e49c1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d1b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b72e0 0x5606e49c1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43344/0 (socket says 172.21.15.18:43344) 2024-09-19T10:01:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d1bfff640 1 -- 172.21.15.18:0/2439231806 learned_addr learned my addr 172.21.15.18:0/2439231806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606e49bf340 con 0x5606e49b69a0 2024-09-19T10:01:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5606e48a3290 con 0x5606e49b72e0 2024-09-19T10:01:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.005+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5606e49bf4c0 con 0x5606e49bc370 2024-09-19T10:01:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7d2086d640 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7d25065740 10 client.0 _ll_register_callbacks cb 0x5606e48d4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7d2086d640 1 -- 172.21.15.18:0/2439231806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b72e0 msgr2=0x5606e49c1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7d2086d640 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b72e0 0x5606e49c1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7d2086d640 1 -- 172.21.15.18:0/2439231806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b69a0 msgr2=0x5606e49c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7d2086d640 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b69a0 0x5606e49c0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7d2086d640 1 -- 172.21.15.18:0/2439231806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606e462d210 con 0x5606e49bc370 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b69a0 0x5606e49c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7d1b7fe640 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b72e0 0x5606e49c1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7d2086d640 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c81a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7d140cdbb0 tx=0x7f7d1409bfe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac240fbab67bb92c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7cfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2439231806 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1409c680 con 0x5606e49bc370 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.006+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2439231806 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7d14004310 con 0x5606e49bc370 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.007+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d100043c0 con 0x5606e49bc370 2024-09-19T10:01:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.007+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2439231806 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d140a0a30 con 0x5606e49bc370 2024-09-19T10:01:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.007+0000 7f7d25065740 10 client.27052 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.007+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5606e46f9620 con 0x5606e49bc370 2024-09-19T10:01:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.007+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2439231806 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d140a52f0 con 0x5606e49bc370 2024-09-19T10:01:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.008+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2439231806 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d140b0ca0 con 0x5606e49bc370 2024-09-19T10:01:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.008+0000 7f7d25065740 10 client.27052 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.008+0000 7f7d25065740 10 client.27052 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.008+0000 7f7d25065740 20 client.27052 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.008+0000 7f7d25065740 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5606e49cc8c0 0x5606e49cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.008+0000 7f7d25065740 4 client.27052 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.008+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7d100043c0 con 0x5606e49cc8c0 2024-09-19T10:01:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.008+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5606e49cc8c0 0x5606e49cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.009+0000 7f7cfb7fe640 10 client.27052 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.009+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5606e49cc8c0 0x5606e49cecb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=491c08bb7a93ca4a server_cookie=be0d2477a97ad1 in_seq=0 out_seq=0 2024-09-19T10:01:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2439231806 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7d100043c0 con 0x5606e49cc8c0 2024-09-19T10:01:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7cfb7fe640 10 client.27052 handle_command_reply: tid=0 2024-09-19T10:01:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 client.27052 shutdown 2024-09-19T10:01:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 msgr2=0x5606e49c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c81a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7d140cdbb0 tx=0x7f7d1409bfe0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 shutdown_connections 2024-09-19T10:01:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5606e49cc8c0 0x5606e49cecb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7cfb7fe640 0 client.27052 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c81a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b72e0 0x5606e49c1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 --2- 172.21.15.18:0/2439231806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b69a0 0x5606e49c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 >> 172.21.15.18:0/2439231806 conn(0x5606e49b2010 msgr2=0x5606e49b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 shutdown_connections 2024-09-19T10:01:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 1 -- 172.21.15.18:0/2439231806 wait complete. 2024-09-19T10:01:32.018 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.011+0000 7f7d25065740 20 client.27052 trim_cache size 0 max 16384 2024-09-19T10:01:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d25065740 1 Processor -- start 2024-09-19T10:01:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d25065740 1 -- start start 2024-09-19T10:01:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d25065740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d25065740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49b72e0 0x5606e49c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d25065740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49bc370 0x5606e49b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d25065740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c1aaf50 con 0x5606e49bc370 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d25065740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c1aca90 con 0x5606e49b69a0 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d25065740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c1ab620 con 0x5606e49b72e0 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d2086d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49bc370 0x5606e49b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d1b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49b72e0 0x5606e49c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d2086d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49bc370 0x5606e49b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34194/0 (socket says 172.21.15.18:34194) 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d2086d640 1 -- 172.21.15.18:0/745011376 learned_addr learned my addr 172.21.15.18:0/745011376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.028+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/745011376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.029+0000 7f7d1b7fe640 1 -- 172.21.15.18:0/745011376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 msgr2=0x5606e49b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.029+0000 7f7d1b7fe640 1 --2- 172.21.15.18:0/745011376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.029+0000 7f7d1b7fe640 1 -- 172.21.15.18:0/745011376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49bc370 msgr2=0x5606e49b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.029+0000 7f7d1b7fe640 1 --2- 172.21.15.18:0/745011376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49bc370 0x5606e49b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.029+0000 7f7d1b7fe640 1 -- 172.21.15.18:0/745011376 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606e49c1300 con 0x5606e49b72e0 2024-09-19T10:01:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.029+0000 7f7d1b7fe640 1 --2- 172.21.15.18:0/745011376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49b72e0 0x5606e49c8160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7d10001eb0 tx=0x7f7d1000b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5236658d19b1dcaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.040+0000 7f7d01ffb640 1 -- 172.21.15.18:0/745011376 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10004020 con 0x5606e49b72e0 2024-09-19T10:01:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.040+0000 7f7d01ffb640 1 -- 172.21.15.18:0/745011376 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d10005520 con 0x5606e49b72e0 2024-09-19T10:01:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.040+0000 7f7d01ffb640 1 -- 172.21.15.18:0/745011376 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10004920 con 0x5606e49b72e0 2024-09-19T10:01:32.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.041+0000 7f7d25065740 1 -- 172.21.15.18:0/745011376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49b72e0 msgr2=0x5606e49c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:32.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.041+0000 7f7d25065740 1 --2- 172.21.15.18:0/745011376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49b72e0 0x5606e49c8160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7d10001eb0 tx=0x7f7d1000b930 comp rx=0 tx=0).stop 2024-09-19T10:01:32.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.041+0000 7f7d25065740 1 -- 172.21.15.18:0/745011376 shutdown_connections 2024-09-19T10:01:32.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.041+0000 7f7d25065740 1 --2- 172.21.15.18:0/745011376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49bc370 0x5606e49b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.041+0000 7f7d25065740 1 --2- 172.21.15.18:0/745011376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49b72e0 0x5606e49c8160 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.041+0000 7f7d25065740 1 --2- 172.21.15.18:0/745011376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.041+0000 7f7d25065740 1 -- 172.21.15.18:0/745011376 >> 172.21.15.18:0/745011376 conn(0x5606e49b2010 msgr2=0x5606e49c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:32.044 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.041+0000 7f7d25065740 1 -- 172.21.15.18:0/745011376 shutdown_connections 2024-09-19T10:01:32.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.041+0000 7f7d25065740 1 -- 172.21.15.18:0/745011376 wait complete. 2024-09-19T10:01:32.045 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.042+0000 7f7d25065740 1 -- start start 2024-09-19T10:01:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.042+0000 7f7d25065740 1 Processor -- start 2024-09-19T10:01:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.042+0000 7f7d25065740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.042+0000 7f7d25065740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 0x5606e49c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.042+0000 7f7d25065740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.042+0000 7f7d25065740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c1ac3c0 con 0x5606e49b72e0 2024-09-19T10:01:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.042+0000 7f7d25065740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c1abcf0 con 0x5606e49b69a0 2024-09-19T10:01:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.042+0000 7f7d25065740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c1a8f30 con 0x5606e49bc370 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d25065740 10 client.0 _ll_register_callbacks cb 0x7f7d14009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d1bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d2086d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d1b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 0x5606e49c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d2086d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:35348/0 (socket says 172.21.15.18:35348) 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d1bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:43352/0 (socket says 172.21.15.18:43352) 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d2086d640 1 -- 172.21.15.18:0/2626309234 learned_addr learned my addr 172.21.15.18:0/2626309234 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d2086d640 1 -- 172.21.15.18:0/2626309234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 msgr2=0x5606e49c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d2086d640 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d2086d640 1 -- 172.21.15.18:0/2626309234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 msgr2=0x5606e49c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d2086d640 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 0x5606e49c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d2086d640 1 -- 172.21.15.18:0/2626309234 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606e49c6ce0 con 0x5606e49bc370 2024-09-19T10:01:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d1b7fe640 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 0x5606e49c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:01:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7d2086d640 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c66d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7d1409c610 tx=0x7f7d140bb1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9216def0eeb4260f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.043+0000 7f7cfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:01:32.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.054+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2626309234 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14082060 con 0x5606e49bc370 2024-09-19T10:01:32.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.054+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2626309234 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7d140b0da0 con 0x5606e49bc370 2024-09-19T10:01:32.057 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.054+0000 7f7d25065740 1 -- 172.21.15.18:0/2626309234 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d10005520 con 0x5606e49bc370 2024-09-19T10:01:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.054+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2626309234 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d1409c450 con 0x5606e49bc370 2024-09-19T10:01:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.054+0000 7f7d25065740 10 client.27058 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.054+0000 7f7d25065740 1 -- 172.21.15.18:0/2626309234 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5606e49c8060 con 0x5606e49bc370 2024-09-19T10:01:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.055+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2626309234 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d10005520 con 0x5606e49bc370 2024-09-19T10:01:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.055+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2626309234 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d1409bad0 con 0x5606e49bc370 2024-09-19T10:01:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.055+0000 7f7d25065740 10 client.27058 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.055+0000 7f7d25065740 10 client.27058 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.055+0000 7f7d25065740 20 client.27058 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.055+0000 7f7d25065740 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5606e49cc8c0 0x5606e4a39770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:32.058 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.055+0000 7f7d25065740 4 client.27058 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:01:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.055+0000 7f7d25065740 1 -- 172.21.15.18:0/2626309234 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5606e4927a20 con 0x5606e49cc8c0 2024-09-19T10:01:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.055+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5606e49cc8c0 0x5606e4a39770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.056+0000 7f7cfb7fe640 10 client.27058 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:32.059 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:32.056+0000 7f7d1bfff640 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5606e49cc8c0 0x5606e4a39770 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee7b502809ad6a52 server_cookie=2794c482118fff7a in_seq=0 out_seq=0 2024-09-19T10:01:32.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:32 smithi018 ceph-mon[30956]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 791 MiB/s wr, 1.72k op/s 2024-09-19T10:01:32.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:32 smithi049 ceph-mon[34858]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 791 MiB/s wr, 1.72k op/s 2024-09-19T10:01:32.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:32 smithi162 ceph-mon[35174]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 791 MiB/s wr, 1.72k op/s 2024-09-19T10:01:34.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:34 smithi018 ceph-mon[30956]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 921 MiB/s wr, 2.47k op/s 2024-09-19T10:01:34.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:34 smithi049 ceph-mon[34858]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 921 MiB/s wr, 2.47k op/s 2024-09-19T10:01:34.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:34 smithi162 ceph-mon[35174]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 921 MiB/s wr, 2.47k op/s 2024-09-19T10:01:36.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:36 smithi018 ceph-mon[30956]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 821 MiB/s wr, 2.29k op/s 2024-09-19T10:01:36.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:36 smithi049 ceph-mon[34858]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 821 MiB/s wr, 2.29k op/s 2024-09-19T10:01:36.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:36 smithi162 ceph-mon[35174]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 821 MiB/s wr, 2.29k op/s 2024-09-19T10:01:38.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:38 smithi049 ceph-mon[34858]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 845 MiB/s wr, 2.31k op/s 2024-09-19T10:01:38.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:38 smithi162 ceph-mon[35174]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 845 MiB/s wr, 2.31k op/s 2024-09-19T10:01:38.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:38 smithi018 ceph-mon[30956]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 845 MiB/s wr, 2.31k op/s 2024-09-19T10:01:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7cfb7fe640 1 -- 172.21.15.18:0/2626309234 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5606e4927a20 con 0x5606e49cc8c0 2024-09-19T10:01:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7cfb7fe640 10 client.27058 handle_command_reply: tid=0 2024-09-19T10:01:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 client.27058 shutdown 2024-09-19T10:01:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 -- 172.21.15.18:0/2626309234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 msgr2=0x5606e49c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c66d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7d1409c610 tx=0x7f7d140bb1a0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 -- 172.21.15.18:0/2626309234 shutdown_connections 2024-09-19T10:01:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5606e49cc8c0 0x5606e4a39770 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5606e49bc370 0x5606e49c66d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606e49b72e0 0x5606e49c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 --2- 172.21.15.18:0/2626309234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606e49b69a0 0x5606e49c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 -- 172.21.15.18:0/2626309234 >> 172.21.15.18:0/2626309234 conn(0x5606e49b2010 msgr2=0x5606e49b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7cfb7fe640 0 client.27058 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 -- 172.21.15.18:0/2626309234 shutdown_connections 2024-09-19T10:01:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.747+0000 7f7d25065740 1 -- 172.21.15.18:0/2626309234 wait complete. 2024-09-19T10:01:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.748+0000 7f7d25065740 20 client.27058 trim_cache size 0 max 16384 2024-09-19T10:01:38.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:01:38.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:01:38.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:01:38.755 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:01:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.757+0000 7f7d222d0640 1 -- 172.21.15.18:0/2038033799 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d040a3370 msgr2=0x7f7d040a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.757+0000 7f7d222d0640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d040a3370 0x7f7d040a5830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c02aa00 tx=0x7f7d0c0315b0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.757+0000 7f7d222d0640 1 -- 172.21.15.18:0/2038033799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d1c103710 msgr2=0x7f7d1c074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.757+0000 7f7d222d0640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d1c103710 0x7f7d1c074b20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400efd0 tx=0x7f7d1400c6a0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.757+0000 7f7d222d0640 1 -- 172.21.15.18:0/2038033799 shutdown_connections 2024-09-19T10:01:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.757+0000 7f7d222d0640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f7d040a3370 0x7f7d040a5830 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.757+0000 7f7d222d0640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d1c103710 0x7f7d1c074b20 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.757+0000 7f7d222d0640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d1c102d50 0x7f7d1c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.757+0000 7f7d222d0640 1 --2- 172.21.15.18:0/2038033799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d1c101b60 0x7f7d1c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.757+0000 7f7d222d0640 1 -- 172.21.15.18:0/2038033799 >> 172.21.15.18:0/2038033799 conn(0x7f7d1c0fd2e0 msgr2=0x7f7d1c106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.758+0000 7f7d222d0640 1 -- 172.21.15.18:0/2038033799 shutdown_connections 2024-09-19T10:01:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:38.759+0000 7f7d222d0640 1 -- 172.21.15.18:0/2038033799 wait complete. 2024-09-19T10:01:40.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:40 smithi018 ceph-mon[30956]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 836 MiB/s wr, 2.44k op/s 2024-09-19T10:01:40.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:40 smithi049 ceph-mon[34858]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 836 MiB/s wr, 2.44k op/s 2024-09-19T10:01:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:40 smithi162 ceph-mon[35174]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 2.5 MiB/s rd, 836 MiB/s wr, 2.44k op/s 2024-09-19T10:01:42.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:42 smithi018 ceph-mon[30956]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 768 MiB/s wr, 2.27k op/s 2024-09-19T10:01:42.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:42 smithi049 ceph-mon[34858]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 768 MiB/s wr, 2.27k op/s 2024-09-19T10:01:42.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:42 smithi162 ceph-mon[35174]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 72 GiB used, 1000 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 768 MiB/s wr, 2.27k op/s 2024-09-19T10:01:44.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:44 smithi049 ceph-mon[34858]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 997 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 923 MiB/s wr, 2.45k op/s 2024-09-19T10:01:44.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:44 smithi162 ceph-mon[35174]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 997 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 923 MiB/s wr, 2.45k op/s 2024-09-19T10:01:45.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:44 smithi018 ceph-mon[30956]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 997 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 923 MiB/s wr, 2.45k op/s 2024-09-19T10:01:47.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T10:01:47.140 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:46 smithi018 ceph-mon[30956]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 808 MiB/s wr, 1.74k op/s 2024-09-19T10:01:47.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:46 smithi049 ceph-mon[34858]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 808 MiB/s wr, 1.74k op/s 2024-09-19T10:01:47.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:46 smithi162 ceph-mon[35174]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 808 MiB/s wr, 1.74k op/s 2024-09-19T10:01:48.139 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:47 smithi018 ceph-mon[30956]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 842 MiB/s wr, 1.65k op/s 2024-09-19T10:01:48.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:47 smithi049 ceph-mon[34858]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 842 MiB/s wr, 1.65k op/s 2024-09-19T10:01:48.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:47 smithi162 ceph-mon[35174]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 842 MiB/s wr, 1.65k op/s 2024-09-19T10:01:48.257 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:01:49.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.342+0000 7f87ecabf640 1 -- 172.21.15.18:0/1751007402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e8100e20 msgr2=0x7f87e8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:49.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.342+0000 7f87ecabf640 1 --2- 172.21.15.18:0/1751007402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e8100e20 0x7f87e8101200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009cd0 tx=0x7f87d802a9c0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.344+0000 7f87ecabf640 1 -- 172.21.15.18:0/1751007402 shutdown_connections 2024-09-19T10:01:49.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.344+0000 7f87ecabf640 1 --2- 172.21.15.18:0/1751007402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87e8102ef0 0x7f87e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.344+0000 7f87ecabf640 1 --2- 172.21.15.18:0/1751007402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87e8102570 0x7f87e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.344+0000 7f87ecabf640 1 --2- 172.21.15.18:0/1751007402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e8100e20 0x7f87e8101200 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.344+0000 7f87ecabf640 1 -- 172.21.15.18:0/1751007402 >> 172.21.15.18:0/1751007402 conn(0x7f87e80fc7d0 msgr2=0x7f87e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.344+0000 7f87ecabf640 1 -- 172.21.15.18:0/1751007402 shutdown_connections 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.345+0000 7f87ecabf640 1 -- 172.21.15.18:0/1751007402 wait complete. 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.348+0000 7f87ecabf640 1 Processor -- start 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.349+0000 7f87ecabf640 1 -- start start 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.350+0000 7f87ecabf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e8100e20 0x7f87e8073920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.350+0000 7f87ecabf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87e8102570 0x7f87e8073e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.350+0000 7f87ecabf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87e8102ef0 0x7f87e806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.352+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87e8102570 0x7f87e8073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.353+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87e8102570 0x7f87e8073e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50430/0 (socket says 172.21.15.18:50430) 2024-09-19T10:01:49.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.354+0000 7f87e659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e8100e20 0x7f87e8073920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.354+0000 7f87ddd9b640 1 -- 172.21.15.18:0/3748149817 learned_addr learned my addr 172.21.15.18:0/3748149817 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.354+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87e806c620 con 0x7f87e8102ef0 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.354+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f87e806c4a0 con 0x7f87e8100e20 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.354+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87e806c7a0 con 0x7f87e8102570 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.358+0000 7f87ddd9b640 1 -- 172.21.15.18:0/3748149817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e8100e20 msgr2=0x7f87e8073920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.358+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e8100e20 0x7f87e8073920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.358+0000 7f87ddd9b640 1 -- 172.21.15.18:0/3748149817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87e8102ef0 msgr2=0x7f87e806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.358+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87e8102ef0 0x7f87e806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.358+0000 7f87ddd9b640 1 -- 172.21.15.18:0/3748149817 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e806e3c0 con 0x7f87e8102570 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.361+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87e8102570 0x7f87e8073e60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c890 tx=0x7f87d000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.362+0000 7f87dffff640 1 -- 172.21.15.18:0/3748149817 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0004220 con 0x7f87e8102570 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.362+0000 7f87dffff640 1 -- 172.21.15.18:0/3748149817 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d00043c0 con 0x7f87e8102570 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.364+0000 7f87dffff640 1 -- 172.21.15.18:0/3748149817 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d00049c0 con 0x7f87e8102570 2024-09-19T10:01:49.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.364+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e806e6b0 con 0x7f87e8102570 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.364+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e806a140 con 0x7f87e8102570 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.372+0000 7f87dffff640 1 -- 172.21.15.18:0/3748149817 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f87d00079b0 con 0x7f87e8102570 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.373+0000 7f87dffff640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87d40a32e0 0x7f87d40a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.374+0000 7f87dffff640 1 -- 172.21.15.18:0/3748149817 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f87d00cf850 con 0x7f87e8102570 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.377+0000 7f87eee98740 1 Processor -- start 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.377+0000 7f87eee98740 1 -- start start 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.378+0000 7f87eee98740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae844a0 0x55faaae84880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.378+0000 7f87e659c640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87d40a32e0 0x7f87d40a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.379+0000 7f87eee98740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae84dc0 0x55faaae8f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.379+0000 7f87eee98740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae8f680 0x55faaae91a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.379+0000 7f87eee98740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55faaadea2e0 con 0x55faaae844a0 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.379+0000 7f87eee98740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55faaad91ce0 con 0x55faaae84dc0 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.379+0000 7f87eee98740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55faaade62a0 con 0x55faaae8f680 2024-09-19T10:01:49.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.379+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae84dc0 0x55faaae8f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.380+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae84dc0 0x55faaae8f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60118/0 (socket says 172.21.15.18:60118) 2024-09-19T10:01:49.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.380+0000 7f87ddd9b640 1 -- 172.21.15.18:0/247226439 learned_addr learned my addr 172.21.15.18:0/247226439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:49.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.380+0000 7f87e6d9d640 1 --2- 172.21.15.18:0/247226439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae8f680 0x55faaae91a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.381+0000 7f87ddd9b640 1 -- 172.21.15.18:0/247226439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae8f680 msgr2=0x55faaae91a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:49.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.381+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/247226439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae8f680 0x55faaae91a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.381+0000 7f87ddd9b640 1 -- 172.21.15.18:0/247226439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae844a0 msgr2=0x55faaae84880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:49.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.381+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/247226439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae844a0 0x55faaae84880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.381+0000 7f87ddd9b640 1 -- 172.21.15.18:0/247226439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faaad76440 con 0x55faaae84dc0 2024-09-19T10:01:49.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.382+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/247226439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae84dc0 0x55faaae8f140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f87d00a4600 tx=0x7f87d009c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=629fbeb1c0c3a137 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:49.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.383+0000 7f87dcd99640 1 -- 172.21.15.18:0/247226439 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d00a4b30 con 0x55faaae84dc0 2024-09-19T10:01:49.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.383+0000 7f87dcd99640 1 -- 172.21.15.18:0/247226439 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d00cd430 con 0x55faaae84dc0 2024-09-19T10:01:49.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.383+0000 7f87dcd99640 1 -- 172.21.15.18:0/247226439 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d009b310 con 0x55faaae84dc0 2024-09-19T10:01:49.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.384+0000 7f87eee98740 1 -- 172.21.15.18:0/247226439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae84dc0 msgr2=0x55faaae8f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:49.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.384+0000 7f87eee98740 1 --2- 172.21.15.18:0/247226439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae84dc0 0x55faaae8f140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f87d00a4600 tx=0x7f87d009c680 comp rx=0 tx=0).stop 2024-09-19T10:01:49.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.384+0000 7f87eee98740 1 -- 172.21.15.18:0/247226439 shutdown_connections 2024-09-19T10:01:49.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.384+0000 7f87eee98740 1 --2- 172.21.15.18:0/247226439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae8f680 0x55faaae91a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.384+0000 7f87eee98740 1 --2- 172.21.15.18:0/247226439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae84dc0 0x55faaae8f140 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.384+0000 7f87eee98740 1 --2- 172.21.15.18:0/247226439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae844a0 0x55faaae84880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.385+0000 7f87eee98740 1 -- 172.21.15.18:0/247226439 >> 172.21.15.18:0/247226439 conn(0x55faaae80a30 msgr2=0x55faaae80e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:49.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.386+0000 7f87eee98740 1 -- 172.21.15.18:0/247226439 shutdown_connections 2024-09-19T10:01:49.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.386+0000 7f87eee98740 1 -- 172.21.15.18:0/247226439 wait complete. 2024-09-19T10:01:49.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.386+0000 7f87eee98740 1 -- start start 2024-09-19T10:01:49.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.387+0000 7f87eee98740 1 Processor -- start 2024-09-19T10:01:49.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.387+0000 7f87eee98740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae8ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.388+0000 7f87eee98740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 0x55faaae8c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.388+0000 7f87eee98740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae8f680 0x55faaae8c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.388+0000 7f87eee98740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55faaae96660 con 0x55faaae8f680 2024-09-19T10:01:49.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.388+0000 7f87e659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae8ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.388+0000 7f87e659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae8ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60132/0 (socket says 172.21.15.18:60132) 2024-09-19T10:01:49.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.388+0000 7f87e659c640 1 -- 172.21.15.18:0/730403015 learned_addr learned my addr 172.21.15.18:0/730403015 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:49.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.388+0000 7f87eee98740 1 -- 172.21.15.18:0/730403015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55faaada5050 con 0x55faaae844a0 2024-09-19T10:01:49.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.389+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 0x55faaae8c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.389+0000 7f87eee98740 1 -- 172.21.15.18:0/730403015 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55faaae967e0 con 0x55faaae84dc0 2024-09-19T10:01:49.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.389+0000 7f87eee98740 10 client.0 _ll_register_callbacks cb 0x55faaade5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:49.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.395+0000 7f87e659c640 1 -- 172.21.15.18:0/730403015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 msgr2=0x55faaae8c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:49.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.395+0000 7f87e659c640 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 0x55faaae8c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.395+0000 7f87e659c640 1 -- 172.21.15.18:0/730403015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae8f680 msgr2=0x55faaae8c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:49.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.395+0000 7f87e659c640 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae8f680 0x55faaae8c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.395+0000 7f87e659c640 1 -- 172.21.15.18:0/730403015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faaab5b3c0 con 0x55faaae844a0 2024-09-19T10:01:49.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.400+0000 7f87e659c640 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae8ef60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f87d8035000 tx=0x7f87d802f6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=583d569fe5104b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:49.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.400+0000 7f87cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:01:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.401+0000 7f87cdffb640 1 -- 172.21.15.18:0/730403015 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d804e060 con 0x55faaae844a0 2024-09-19T10:01:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.401+0000 7f87cdffb640 1 -- 172.21.15.18:0/730403015 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f87d8030880 con 0x55faaae844a0 2024-09-19T10:01:49.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.402+0000 7f87eee98740 1 -- 172.21.15.18:0/730403015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87d00cd430 con 0x55faaae844a0 2024-09-19T10:01:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.404+0000 7f87cdffb640 1 -- 172.21.15.18:0/730403015 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f87d8043050 con 0x55faaae844a0 2024-09-19T10:01:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.404+0000 7f87eee98740 10 client.27047 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:49.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.404+0000 7f87eee98740 1 -- 172.21.15.18:0/730403015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55faaaea2030 con 0x55faaae844a0 2024-09-19T10:01:49.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.406+0000 7f87cdffb640 1 -- 172.21.15.18:0/730403015 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d803e070 con 0x55faaae844a0 2024-09-19T10:01:49.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.407+0000 7f87cdffb640 1 -- 172.21.15.18:0/730403015 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f87d803a430 con 0x55faaae844a0 2024-09-19T10:01:49.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.407+0000 7f87eee98740 10 client.27047 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:49.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.407+0000 7f87eee98740 10 client.27047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:49.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.407+0000 7f87eee98740 20 client.27047 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:49.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.407+0000 7f87eee98740 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55faaaea3440 0x55faaaea5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.407+0000 7f87eee98740 4 client.27047 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:49.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.408+0000 7f87eee98740 1 -- 172.21.15.18:0/730403015 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f87d00cd430 con 0x55faaaea3440 2024-09-19T10:01:49.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.411+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55faaaea3440 0x55faaaea5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.419+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55faaaea3440 0x55faaaea5830 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13027e65c56710a3 server_cookie=f8aff689ee09b31e in_seq=0 out_seq=0 2024-09-19T10:01:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.419+0000 7f87cdffb640 10 client.27047 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.424+0000 7f87e659c640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87d40a32e0 0x7f87d40a57a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f87d80366b0 tx=0x7f87d80045b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.427+0000 7f87cdffb640 1 -- 172.21.15.18:0/730403015 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f87d00cd430 con 0x55faaaea3440 2024-09-19T10:01:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.427+0000 7f87cdffb640 10 client.27047 handle_command_reply: tid=0 2024-09-19T10:01:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.427+0000 7f87eee98740 1 client.27047 shutdown 2024-09-19T10:01:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.427+0000 7f87eee98740 1 -- 172.21.15.18:0/730403015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 msgr2=0x55faaae8ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.427+0000 7f87eee98740 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae8ef60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f87d8035000 tx=0x7f87d802f6d0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.429+0000 7f87eee98740 1 -- 172.21.15.18:0/730403015 shutdown_connections 2024-09-19T10:01:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.429+0000 7f87eee98740 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55faaaea3440 0x55faaaea5830 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.429+0000 7f87cdffb640 0 client.27047 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.429+0000 7f87eee98740 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae8f680 0x55faaae8c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.429+0000 7f87eee98740 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 0x55faaae8c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.429+0000 7f87eee98740 1 --2- 172.21.15.18:0/730403015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae8ef60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.429+0000 7f87eee98740 1 -- 172.21.15.18:0/730403015 >> 172.21.15.18:0/730403015 conn(0x55faaae80a30 msgr2=0x55faaae86760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.429+0000 7f87eee98740 1 -- 172.21.15.18:0/730403015 shutdown_connections 2024-09-19T10:01:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.429+0000 7f87eee98740 1 -- 172.21.15.18:0/730403015 wait complete. 2024-09-19T10:01:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.429+0000 7f87eee98740 20 client.27047 trim_cache size 0 max 16384 2024-09-19T10:01:49.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.480+0000 7f87eee98740 1 Processor -- start 2024-09-19T10:01:49.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.480+0000 7f87eee98740 1 -- start start 2024-09-19T10:01:49.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.480+0000 7f87eee98740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae844a0 0x55faaae9f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.480+0000 7f87eee98740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 0x55faaae8e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.480+0000 7f87eee98740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae8f680 0x55faaae8e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.480+0000 7f87eee98740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b3790 con 0x55faaae844a0 2024-09-19T10:01:49.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.480+0000 7f87eee98740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b52d0 con 0x55faaae8f680 2024-09-19T10:01:49.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.480+0000 7f87eee98740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b3e60 con 0x55faaae84dc0 2024-09-19T10:01:49.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.481+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 0x55faaae8e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.481+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 0x55faaae8e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50454/0 (socket says 172.21.15.18:50454) 2024-09-19T10:01:49.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.481+0000 7f87ddd9b640 1 -- 172.21.15.18:0/1510265285 learned_addr learned my addr 172.21.15.18:0/1510265285 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:49.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.481+0000 7f87e6d9d640 1 --2- 172.21.15.18:0/1510265285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae8f680 0x55faaae8e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.482+0000 7f87ddd9b640 1 -- 172.21.15.18:0/1510265285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae8f680 msgr2=0x55faaae8e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:49.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.482+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/1510265285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae8f680 0x55faaae8e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.482+0000 7f87ddd9b640 1 -- 172.21.15.18:0/1510265285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae844a0 msgr2=0x55faaae9f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:49.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.482+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/1510265285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae844a0 0x55faaae9f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.482+0000 7f87ddd9b640 1 -- 172.21.15.18:0/1510265285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faaae80200 con 0x55faaae84dc0 2024-09-19T10:01:49.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.483+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/1510265285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 0x55faaae8e180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87d0098890 tx=0x7f87d0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa269950ef9f8023 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:49.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.484+0000 7f87cffff640 1 -- 172.21.15.18:0/1510265285 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d00b0170 con 0x55faaae84dc0 2024-09-19T10:01:49.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.484+0000 7f87cffff640 1 -- 172.21.15.18:0/1510265285 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d00aa070 con 0x55faaae84dc0 2024-09-19T10:01:49.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.484+0000 7f87cffff640 1 -- 172.21.15.18:0/1510265285 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d009b310 con 0x55faaae84dc0 2024-09-19T10:01:49.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.486+0000 7f87eee98740 1 -- 172.21.15.18:0/1510265285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 msgr2=0x55faaae8e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:49.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.486+0000 7f87eee98740 1 --2- 172.21.15.18:0/1510265285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 0x55faaae8e180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87d0098890 tx=0x7f87d0000bc0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.492+0000 7f87eee98740 1 -- 172.21.15.18:0/1510265285 shutdown_connections 2024-09-19T10:01:49.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.492+0000 7f87eee98740 1 --2- 172.21.15.18:0/1510265285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae8f680 0x55faaae8e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.492+0000 7f87eee98740 1 --2- 172.21.15.18:0/1510265285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae84dc0 0x55faaae8e180 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.492+0000 7f87eee98740 1 --2- 172.21.15.18:0/1510265285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae844a0 0x55faaae9f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.492+0000 7f87eee98740 1 -- 172.21.15.18:0/1510265285 >> 172.21.15.18:0/1510265285 conn(0x55faaae80a30 msgr2=0x55faaae8da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:49.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.492+0000 7f87eee98740 1 -- 172.21.15.18:0/1510265285 shutdown_connections 2024-09-19T10:01:49.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.492+0000 7f87eee98740 1 -- 172.21.15.18:0/1510265285 wait complete. 2024-09-19T10:01:49.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.494+0000 7f87eee98740 1 -- start start 2024-09-19T10:01:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.497+0000 7f87eee98740 1 Processor -- start 2024-09-19T10:01:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.500+0000 7f87eee98740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae9c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.502+0000 7f87eee98740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae84dc0 0x55faaae94fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.502+0000 7f87e659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae9c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.505+0000 7f87e659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae9c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60144/0 (socket says 172.21.15.18:60144) 2024-09-19T10:01:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.505+0000 7f87e659c640 1 -- 172.21.15.18:0/1252880483 learned_addr learned my addr 172.21.15.18:0/1252880483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.505+0000 7f87eee98740 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae8f680 0x55faaae95650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.505+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b4c00 con 0x55faaae84dc0 2024-09-19T10:01:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.505+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b4530 con 0x55faaae844a0 2024-09-19T10:01:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.505+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b1770 con 0x55faaae8f680 2024-09-19T10:01:49.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.505+0000 7f87eee98740 10 client.0 _ll_register_callbacks cb 0x7f87d8003d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:49.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.506+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae84dc0 0x55faaae94fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.507+0000 7f87e6d9d640 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae8f680 0x55faaae95650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.507+0000 7f87ddd9b640 1 -- 172.21.15.18:0/1252880483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae8f680 msgr2=0x55faaae95650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.507+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae8f680 0x55faaae95650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.507+0000 7f87ddd9b640 1 -- 172.21.15.18:0/1252880483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 msgr2=0x55faaae9c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:49.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.507+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae9c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.507+0000 7f87ddd9b640 1 -- 172.21.15.18:0/1252880483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faaae99d90 con 0x55faaae84dc0 2024-09-19T10:01:49.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.510+0000 7f87ddd9b640 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae84dc0 0x55faaae94fd0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x55faaae7bc80 tx=0x7f87d00b02b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f9ba9524aa8643 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:49.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.511+0000 7f87cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:01:49.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.511+0000 7f87cdffb640 1 -- 172.21.15.18:0/1252880483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d00a46a0 con 0x55faaae84dc0 2024-09-19T10:01:49.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.511+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87d00aa070 con 0x55faaae84dc0 2024-09-19T10:01:49.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.512+0000 7f87cdffb640 1 -- 172.21.15.18:0/1252880483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f87d00a4840 con 0x55faaae84dc0 2024-09-19T10:01:49.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.512+0000 7f87cdffb640 1 -- 172.21.15.18:0/1252880483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f87d007ab70 con 0x55faaae84dc0 2024-09-19T10:01:49.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.513+0000 7f87eee98740 10 client.17607 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:49.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.513+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55faaaf12a20 con 0x55faaae84dc0 2024-09-19T10:01:49.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.516+0000 7f87cdffb640 1 -- 172.21.15.18:0/1252880483 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d00aa070 con 0x55faaae84dc0 2024-09-19T10:01:49.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.516+0000 7f87cdffb640 1 -- 172.21.15.18:0/1252880483 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f87d009ad80 con 0x55faaae84dc0 2024-09-19T10:01:49.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.518+0000 7f87eee98740 10 client.17607 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:49.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.518+0000 7f87eee98740 10 client.17607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:49.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.518+0000 7f87eee98740 20 client.17607 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:49.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.518+0000 7f87eee98740 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55faaaea3440 0x55faaaf14a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:49.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.519+0000 7f87eee98740 4 client.17607 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T10:01:49.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.519+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55faaadf7850 con 0x55faaaea3440 2024-09-19T10:01:49.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.521+0000 7f87e659c640 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55faaaea3440 0x55faaaf14a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:49.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.523+0000 7f87e659c640 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55faaaea3440 0x55faaaf14a30 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72ade722a38d3559 server_cookie=d34dbdee5cad5bad in_seq=0 out_seq=0 2024-09-19T10:01:49.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.523+0000 7f87cdffb640 10 client.17607 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:49.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.534+0000 7f87cdffb640 1 -- 172.21.15.18:0/1252880483 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55faaadf7850 con 0x55faaaea3440 2024-09-19T10:01:49.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.534+0000 7f87cdffb640 10 client.17607 handle_command_reply: tid=0 2024-09-19T10:01:49.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.534+0000 7f87eee98740 1 client.17607 shutdown 2024-09-19T10:01:49.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.537+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae84dc0 msgr2=0x55faaae94fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:49.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.537+0000 7f87eee98740 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae84dc0 0x55faaae94fd0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x55faaae7bc80 tx=0x7f87d00b02b0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.539+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 shutdown_connections 2024-09-19T10:01:49.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.539+0000 7f87eee98740 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55faaaea3440 0x55faaaf14a30 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.539+0000 7f87eee98740 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55faaae8f680 0x55faaae95650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.539+0000 7f87cdffb640 0 client.17607 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:49.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.540+0000 7f87eee98740 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55faaae84dc0 0x55faaae94fd0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.540+0000 7f87eee98740 1 --2- 172.21.15.18:0/1252880483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55faaae844a0 0x55faaae9c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.540+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 >> 172.21.15.18:0/1252880483 conn(0x55faaae80a30 msgr2=0x55faaae8e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:49.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.540+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 shutdown_connections 2024-09-19T10:01:49.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.540+0000 7f87eee98740 1 -- 172.21.15.18:0/1252880483 wait complete. 2024-09-19T10:01:49.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.540+0000 7f87eee98740 20 client.17607 trim_cache size 0 max 16384 2024-09-19T10:01:49.545 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:01:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T10:01:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T10:01:49.546 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:01:49.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87d40a32e0 msgr2=0x7f87d40a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:49.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87d40a32e0 0x7f87d40a57a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f87d80366b0 tx=0x7f87d80045b0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87e8102570 msgr2=0x7f87e8073e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:49.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87e8102570 0x7f87e8073e60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c890 tx=0x7f87d000cd50 comp rx=0 tx=0).stop 2024-09-19T10:01:49.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 shutdown_connections 2024-09-19T10:01:49.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87d40a32e0 0x7f87d40a57a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87e8102ef0 0x7f87e806dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87e8102570 0x7f87e8073e60 secure :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c890 tx=0x7f87d000cd50 comp rx=0 tx=0).stop 2024-09-19T10:01:49.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 --2- 172.21.15.18:0/3748149817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87e8100e20 0x7f87e8073920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:49.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 >> 172.21.15.18:0/3748149817 conn(0x7f87e80fc7d0 msgr2=0x7f87e80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:49.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.544+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 shutdown_connections 2024-09-19T10:01:49.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:49.545+0000 7f87ecabf640 1 -- 172.21.15.18:0/3748149817 wait complete. 2024-09-19T10:01:50.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:49 smithi049 ceph-mon[34858]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 992 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 849 MiB/s wr, 1.62k op/s 2024-09-19T10:01:50.211 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:49 smithi018 ceph-mon[30956]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 992 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 849 MiB/s wr, 1.62k op/s 2024-09-19T10:01:50.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:49 smithi162 ceph-mon[35174]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 992 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 849 MiB/s wr, 1.62k op/s 2024-09-19T10:01:50.798 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T10:01:50.798 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:01:51.734 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:01:52.247 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:51 smithi018 ceph-mon[30956]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 992 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 785 MiB/s wr, 1.44k op/s 2024-09-19T10:01:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.325+0000 7f7650c43640 1 -- 172.21.15.18:0/606720444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f764c072cb0 msgr2=0x7f764c0730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.325+0000 7f7650c43640 1 --2- 172.21.15.18:0/606720444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f764c072cb0 0x7f764c0730b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7644009ca0 tx=0x7f764402a8b0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.326+0000 7f7650c43640 1 -- 172.21.15.18:0/606720444 shutdown_connections 2024-09-19T10:01:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.326+0000 7f7650c43640 1 --2- 172.21.15.18:0/606720444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f764c10dbb0 0x7f764c110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.326+0000 7f7650c43640 1 --2- 172.21.15.18:0/606720444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f764c073680 0x7f764c10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.326+0000 7f7650c43640 1 --2- 172.21.15.18:0/606720444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f764c072cb0 0x7f764c0730b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.326+0000 7f7650c43640 1 -- 172.21.15.18:0/606720444 >> 172.21.15.18:0/606720444 conn(0x7f764c06eb50 msgr2=0x7f764c070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.327+0000 7f7650c43640 1 -- 172.21.15.18:0/606720444 shutdown_connections 2024-09-19T10:01:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.327+0000 7f7650c43640 1 -- 172.21.15.18:0/606720444 wait complete. 2024-09-19T10:01:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.328+0000 7f7650c43640 1 Processor -- start 2024-09-19T10:01:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.328+0000 7f7650c43640 1 -- start start 2024-09-19T10:01:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.329+0000 7f7650c43640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f764c072cb0 0x7f764c1a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.329+0000 7f7650c43640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f764c073680 0x7f764c1a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.329+0000 7f7650c43640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f764c10dbb0 0x7f764c07a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.329+0000 7f7650c43640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f764c11c420 con 0x7f764c10dbb0 2024-09-19T10:01:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.329+0000 7f7650c43640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f764c11c2a0 con 0x7f764c072cb0 2024-09-19T10:01:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.329+0000 7f7650c43640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f764c11c5a0 con 0x7f764c073680 2024-09-19T10:01:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.330+0000 7f764affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f764c073680 0x7f764c1a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.330+0000 7f764affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f764c073680 0x7f764c1a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50486/0 (socket says 172.21.15.18:50486) 2024-09-19T10:01:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.330+0000 7f764affd640 1 -- 172.21.15.18:0/3753939779 learned_addr learned my addr 172.21.15.18:0/3753939779 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.330+0000 7f764b7fe640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f764c072cb0 0x7f764c1a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.331+0000 7f764affd640 1 -- 172.21.15.18:0/3753939779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f764c072cb0 msgr2=0x7f764c1a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.331+0000 7f764affd640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f764c072cb0 0x7f764c1a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.331+0000 7f764affd640 1 -- 172.21.15.18:0/3753939779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f764c10dbb0 msgr2=0x7f764c07a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.331+0000 7f764affd640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f764c10dbb0 0x7f764c07a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.331+0000 7f764affd640 1 -- 172.21.15.18:0/3753939779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c07aac0 con 0x7f764c073680 2024-09-19T10:01:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.332+0000 7f764affd640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f764c073680 0x7f764c1a6fb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c970 tx=0x7f763c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.337+0000 7f7648ff9640 1 -- 172.21.15.18:0/3753939779 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c007bb0 con 0x7f764c073680 2024-09-19T10:01:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.337+0000 7f7648ff9640 1 -- 172.21.15.18:0/3753939779 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f763c007d50 con 0x7f764c073680 2024-09-19T10:01:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.338+0000 7f7648ff9640 1 -- 172.21.15.18:0/3753939779 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c00f450 con 0x7f764c073680 2024-09-19T10:01:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.338+0000 7f7650c43640 1 -- 172.21.15.18:0/3753939779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764c07adb0 con 0x7f764c073680 2024-09-19T10:01:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.338+0000 7f7650c43640 1 -- 172.21.15.18:0/3753939779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f764c07b280 con 0x7f764c073680 2024-09-19T10:01:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.344+0000 7f7654c45740 1 Processor -- start 2024-09-19T10:01:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.344+0000 7f7654c45740 1 -- start start 2024-09-19T10:01:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.347+0000 7f7654c45740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe1632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.347+0000 7f7654c45740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe150f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.347+0000 7f7654c45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe151520 0x55a5fe1539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.347+0000 7f7654c45740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe0b52f0 con 0x55a5fe162ec0 2024-09-19T10:01:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.347+0000 7f7654c45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe05d270 con 0x55a5fe151520 2024-09-19T10:01:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.347+0000 7f7654c45740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe0b12b0 con 0x55a5fe163800 2024-09-19T10:01:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.348+0000 7f764b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.348+0000 7f764b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50496/0 (socket says 172.21.15.18:50496) 2024-09-19T10:01:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.348+0000 7f764b7fe640 1 -- 172.21.15.18:0/887751708 learned_addr learned my addr 172.21.15.18:0/887751708 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.350+0000 7f764affd640 1 --2- 172.21.15.18:0/887751708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe151520 0x55a5fe1539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.350+0000 7f7648ff9640 1 -- 172.21.15.18:0/3753939779 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f763c004f50 con 0x7f764c073680 2024-09-19T10:01:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.351+0000 7f764b7fe640 1 -- 172.21.15.18:0/887751708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe151520 msgr2=0x55a5fe1539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.351+0000 7f764b7fe640 1 --2- 172.21.15.18:0/887751708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe151520 0x55a5fe1539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.352+0000 7f764b7fe640 1 -- 172.21.15.18:0/887751708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 msgr2=0x55a5fe1632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.352+0000 7f764bfff640 1 --2- 172.21.15.18:0/887751708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe1632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.353+0000 7f764b7fe640 1 --2- 172.21.15.18:0/887751708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe1632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.353+0000 7f764b7fe640 1 -- 172.21.15.18:0/887751708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5fe05c340 con 0x55a5fe163800 2024-09-19T10:01:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.353+0000 7f764bfff640 1 --2- 172.21.15.18:0/887751708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe1632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:01:52.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:51 smithi049 ceph-mon[34858]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 992 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 785 MiB/s wr, 1.44k op/s 2024-09-19T10:01:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.355+0000 7f7648ff9640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76340a3340 0x7f76340a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.357+0000 7f764bfff640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76340a3340 0x7f76340a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.358+0000 7f7648ff9640 1 -- 172.21.15.18:0/3753939779 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f763c0d1980 con 0x7f764c073680 2024-09-19T10:01:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.366+0000 7f764bfff640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76340a3340 0x7f76340a5800 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7640005fd0 tx=0x7f7640005d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:52.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:51 smithi162 ceph-mon[35174]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 80 GiB used, 992 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 785 MiB/s wr, 1.44k op/s 2024-09-19T10:01:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.557+0000 7f764b7fe640 1 --2- 172.21.15.18:0/887751708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe150f00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7644035000 tx=0x7f76440309b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fef033dc9c17565 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.558+0000 7f76317fa640 1 -- 172.21.15.18:0/887751708 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76440303a0 con 0x55a5fe163800 2024-09-19T10:01:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.559+0000 7f76317fa640 1 -- 172.21.15.18:0/887751708 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7644036030 con 0x55a5fe163800 2024-09-19T10:01:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.559+0000 7f76317fa640 1 -- 172.21.15.18:0/887751708 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76440047b0 con 0x55a5fe163800 2024-09-19T10:01:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.560+0000 7f7654c45740 1 -- 172.21.15.18:0/887751708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 msgr2=0x55a5fe150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.560+0000 7f7654c45740 1 --2- 172.21.15.18:0/887751708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe150f00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7644035000 tx=0x7f76440309b0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.561+0000 7f7654c45740 1 -- 172.21.15.18:0/887751708 shutdown_connections 2024-09-19T10:01:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.561+0000 7f7654c45740 1 --2- 172.21.15.18:0/887751708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe151520 0x55a5fe1539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.561+0000 7f7654c45740 1 --2- 172.21.15.18:0/887751708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe150f00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.561+0000 7f7654c45740 1 --2- 172.21.15.18:0/887751708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe1632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.561+0000 7f7654c45740 1 -- 172.21.15.18:0/887751708 >> 172.21.15.18:0/887751708 conn(0x55a5fe15e530 msgr2=0x55a5fe15e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.561+0000 7f7654c45740 1 -- 172.21.15.18:0/887751708 shutdown_connections 2024-09-19T10:01:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.561+0000 7f7654c45740 1 -- 172.21.15.18:0/887751708 wait complete. 2024-09-19T10:01:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.562+0000 7f7654c45740 1 -- start start 2024-09-19T10:01:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.562+0000 7f7654c45740 1 Processor -- start 2024-09-19T10:01:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.562+0000 7f7654c45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe151520 0x55a5fe155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.562+0000 7f7654c45740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.562+0000 7f7654c45740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe15d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.562+0000 7f7654c45740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe1543c0 con 0x55a5fe162ec0 2024-09-19T10:01:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.562+0000 7f7654c45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe03e290 con 0x55a5fe151520 2024-09-19T10:01:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.562+0000 7f7654c45740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe154540 con 0x55a5fe163800 2024-09-19T10:01:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.563+0000 7f7654c45740 10 client.0 _ll_register_callbacks cb 0x55a5fe06f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.572+0000 7f764bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.572+0000 7f764b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe151520 0x55a5fe155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.575+0000 7f764affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.575+0000 7f764affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38694/0 (socket says 172.21.15.18:38694) 2024-09-19T10:01:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.575+0000 7f764affd640 1 -- 172.21.15.18:0/3333073213 learned_addr learned my addr 172.21.15.18:0/3333073213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.576+0000 7f764affd640 1 -- 172.21.15.18:0/3333073213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 msgr2=0x55a5fe15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.576+0000 7f764affd640 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe15d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.576+0000 7f764affd640 1 -- 172.21.15.18:0/3333073213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe151520 msgr2=0x55a5fe155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.576+0000 7f764affd640 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe151520 0x55a5fe155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.576+0000 7f764affd640 1 -- 172.21.15.18:0/3333073213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5fddc8210 con 0x55a5fe162ec0 2024-09-19T10:01:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.577+0000 7f764affd640 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe156030 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f763c0a6710 tx=0x7f763c09dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcc2ef57910970d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.577+0000 7f762f7f6640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:01:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.577+0000 7f762f7f6640 1 -- 172.21.15.18:0/3333073213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c0a2380 con 0x55a5fe162ec0 2024-09-19T10:01:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.578+0000 7f7654c45740 1 -- 172.21.15.18:0/3333073213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7644036030 con 0x55a5fe162ec0 2024-09-19T10:01:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.578+0000 7f762f7f6640 1 -- 172.21.15.18:0/3333073213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f763c004680 con 0x55a5fe162ec0 2024-09-19T10:01:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.579+0000 7f762f7f6640 1 -- 172.21.15.18:0/3333073213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f763c0a6c40 con 0x55a5fe162ec0 2024-09-19T10:01:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.579+0000 7f7654c45740 10 client.17613 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.579+0000 7f7654c45740 1 -- 172.21.15.18:0/3333073213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a5fde94620 con 0x55a5fe162ec0 2024-09-19T10:01:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.579+0000 7f762f7f6640 1 -- 172.21.15.18:0/3333073213 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7644036030 con 0x55a5fe162ec0 2024-09-19T10:01:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.581+0000 7f762f7f6640 1 -- 172.21.15.18:0/3333073213 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f763c09d420 con 0x55a5fe162ec0 2024-09-19T10:01:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.581+0000 7f7654c45740 10 client.17613 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.581+0000 7f7654c45740 10 client.17613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.581+0000 7f7654c45740 20 client.17613 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.581+0000 7f7654c45740 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a5fe189ef0 0x55a5fe18c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.581+0000 7f7654c45740 4 client.17613 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.581+0000 7f7654c45740 1 -- 172.21.15.18:0/3333073213 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5fe0c2a20 con 0x55a5fe189ef0 2024-09-19T10:01:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.582+0000 7f764b7fe640 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a5fe189ef0 0x55a5fe18c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.613+0000 7f762f7f6640 10 client.17613 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.613+0000 7f764b7fe640 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a5fe189ef0 0x55a5fe18c310 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb8f6e8efd0ce619 server_cookie=d13fa2550c79d2b2 in_seq=0 out_seq=0 2024-09-19T10:01:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.625+0000 7f762f7f6640 1 -- 172.21.15.18:0/3333073213 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5fe0c2a20 con 0x55a5fe189ef0 2024-09-19T10:01:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.625+0000 7f762f7f6640 10 client.17613 handle_command_reply: tid=0 2024-09-19T10:01:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.626+0000 7f7654c45740 1 client.17613 shutdown 2024-09-19T10:01:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.627+0000 7f7654c45740 1 -- 172.21.15.18:0/3333073213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 msgr2=0x55a5fe156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.627+0000 7f7654c45740 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe156030 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f763c0a6710 tx=0x7f763c09dbd0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.629+0000 7f7654c45740 1 -- 172.21.15.18:0/3333073213 shutdown_connections 2024-09-19T10:01:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.629+0000 7f7654c45740 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a5fe189ef0 0x55a5fe18c310 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.629+0000 7f7654c45740 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.629+0000 7f7654c45740 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe162ec0 0x55a5fe156030 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.629+0000 7f7654c45740 1 --2- 172.21.15.18:0/3333073213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe151520 0x55a5fe155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.629+0000 7f7654c45740 1 -- 172.21.15.18:0/3333073213 >> 172.21.15.18:0/3333073213 conn(0x55a5fe15e530 msgr2=0x55a5fe15fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.630+0000 7f762f7f6640 0 client.17613 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.630+0000 7f7654c45740 1 -- 172.21.15.18:0/3333073213 shutdown_connections 2024-09-19T10:01:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.635+0000 7f7654c45740 1 -- 172.21.15.18:0/3333073213 wait complete. 2024-09-19T10:01:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.635+0000 7f7654c45740 20 client.17613 trim_cache size 0 max 16384 2024-09-19T10:01:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.711+0000 7f7654c45740 1 Processor -- start 2024-09-19T10:01:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.712+0000 7f7654c45740 1 -- start start 2024-09-19T10:01:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.713+0000 7f7654c45740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 0x55a5fe148350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.713+0000 7f7654c45740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe162ec0 0x55a5fe15d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.713+0000 7f7654c45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe163800 0x55a5fe14d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.713+0000 7f7654c45740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f764c07b5a0 con 0x55a5fe151520 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.713+0000 7f7654c45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f764c07d0e0 con 0x55a5fe163800 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.713+0000 7f7654c45740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f764c07bc70 con 0x55a5fe162ec0 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.713+0000 7f764b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 0x55a5fe148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.713+0000 7f764b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 0x55a5fe148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38700/0 (socket says 172.21.15.18:38700) 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.713+0000 7f764b7fe640 1 -- 172.21.15.18:0/1698668396 learned_addr learned my addr 172.21.15.18:0/1698668396 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.714+0000 7f764b7fe640 1 -- 172.21.15.18:0/1698668396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe162ec0 msgr2=0x55a5fe15d030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.714+0000 7f764b7fe640 1 --2- 172.21.15.18:0/1698668396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe162ec0 0x55a5fe15d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.714+0000 7f764b7fe640 1 -- 172.21.15.18:0/1698668396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe163800 msgr2=0x55a5fe14d780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:01:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.714+0000 7f764b7fe640 1 --2- 172.21.15.18:0/1698668396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe163800 0x55a5fe14d780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.714+0000 7f764b7fe640 1 -- 172.21.15.18:0/1698668396 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5fe122700 con 0x55a5fe151520 2024-09-19T10:01:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.715+0000 7f764b7fe640 1 --2- 172.21.15.18:0/1698668396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 0x55a5fe148350 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f7644035000 tx=0x7f7644009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3547d68d298ee5b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.715+0000 7f7630ff9640 1 -- 172.21.15.18:0/1698668396 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644030c00 con 0x55a5fe151520 2024-09-19T10:01:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.715+0000 7f7630ff9640 1 -- 172.21.15.18:0/1698668396 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7644036040 con 0x55a5fe151520 2024-09-19T10:01:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.717+0000 7f7654c45740 1 -- 172.21.15.18:0/1698668396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 msgr2=0x55a5fe148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.717+0000 7f7654c45740 1 --2- 172.21.15.18:0/1698668396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 0x55a5fe148350 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f7644035000 tx=0x7f7644009a20 comp rx=0 tx=0).stop 2024-09-19T10:01:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f7654c45740 1 -- 172.21.15.18:0/1698668396 shutdown_connections 2024-09-19T10:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f7654c45740 1 --2- 172.21.15.18:0/1698668396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe163800 0x55a5fe14d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f7654c45740 1 --2- 172.21.15.18:0/1698668396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe162ec0 0x55a5fe15d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f7654c45740 1 --2- 172.21.15.18:0/1698668396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 0x55a5fe148350 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f7654c45740 1 -- 172.21.15.18:0/1698668396 >> 172.21.15.18:0/1698668396 conn(0x55a5fe15e530 msgr2=0x55a5fe155af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.725+0000 7f2cadbc5640 1 -- 172.21.15.18:0/1674865977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8110190 msgr2=0x7f2ca806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.725+0000 7f2cadbc5640 1 --2- 172.21.15.18:0/1674865977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8110190 0x7f2ca806e4f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2c98009900 tx=0x7f2c9802a410 comp rx=0 tx=0).stop 2024-09-19T10:01:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f2cadbc5640 1 -- 172.21.15.18:0/1674865977 shutdown_connections 2024-09-19T10:01:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f2cadbc5640 1 --2- 172.21.15.18:0/1674865977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca811b140 0x7f2ca811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f2cadbc5640 1 --2- 172.21.15.18:0/1674865977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ca806ea30 0x7f2ca806ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f2cadbc5640 1 --2- 172.21.15.18:0/1674865977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8110190 0x7f2ca806e4f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f2cadbc5640 1 -- 172.21.15.18:0/1674865977 >> 172.21.15.18:0/1674865977 conn(0x7f2ca8073180 msgr2=0x7f2ca8073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f2cadbc5640 1 -- 172.21.15.18:0/1674865977 shutdown_connections 2024-09-19T10:01:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.726+0000 7f2cadbc5640 1 -- 172.21.15.18:0/1674865977 wait complete. 2024-09-19T10:01:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.727+0000 7f2cadbc5640 1 Processor -- start 2024-09-19T10:01:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.727+0000 7f2cadbc5640 1 -- start start 2024-09-19T10:01:52.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.727+0000 7f2cadbc5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ca806ea30 0x7f2ca81a7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.727+0000 7f2cadbc5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8110190 0x7f2ca81a7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.728+0000 7f2cadbc5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca811b140 0x7f2ca81abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.728+0000 7f2cadbc5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8120cc0 con 0x7f2ca811b140 2024-09-19T10:01:52.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.728+0000 7f2cadbc5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8120b40 con 0x7f2ca806ea30 2024-09-19T10:01:52.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.728+0000 7f2cadbc5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8120e40 con 0x7f2ca8110190 2024-09-19T10:01:52.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.730+0000 7f2ca7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8110190 0x7f2ca81a7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.730+0000 7f2ca7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8110190 0x7f2ca81a7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50534/0 (socket says 172.21.15.18:50534) 2024-09-19T10:01:52.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.730+0000 7f2ca7fff640 1 -- 172.21.15.18:0/1753200604 learned_addr learned my addr 172.21.15.18:0/1753200604 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:52.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.731+0000 7f2cacbc3640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ca806ea30 0x7f2ca81a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.731+0000 7f7654c45740 1 -- 172.21.15.18:0/1698668396 shutdown_connections 2024-09-19T10:01:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.731+0000 7f7654c45740 1 -- 172.21.15.18:0/1698668396 wait complete. 2024-09-19T10:01:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.731+0000 7f2ca7fff640 1 -- 172.21.15.18:0/1753200604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ca806ea30 msgr2=0x7f2ca81a7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.731+0000 7f2ca7fff640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ca806ea30 0x7f2ca81a7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.731+0000 7f2ca7fff640 1 -- 172.21.15.18:0/1753200604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca811b140 msgr2=0x7f2ca81abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.731+0000 7f2ca7fff640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca811b140 0x7f2ca81abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.731+0000 7f2ca7fff640 1 -- 172.21.15.18:0/1753200604 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca81ac2d0 con 0x7f2ca8110190 2024-09-19T10:01:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.733+0000 7f7654c45740 1 -- start start 2024-09-19T10:01:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.733+0000 7f7654c45740 1 Processor -- start 2024-09-19T10:01:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.734+0000 7f7654c45740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 0x55a5fe15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.734+0000 7f2ca7fff640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8110190 0x7f2ca81a7840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00b4a0 tx=0x7f2c9c00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.734+0000 7f7654c45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe162ec0 0x55a5fe159880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.735+0000 7f7654c45740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.735+0000 7f7654c45740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f764c07ca10 con 0x55a5fe151520 2024-09-19T10:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.735+0000 7f7654c45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f764c07c340 con 0x55a5fe162ec0 2024-09-19T10:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.735+0000 7f7654c45740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f764c117120 con 0x55a5fe163800 2024-09-19T10:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.735+0000 7f764affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe162ec0 0x55a5fe159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.735+0000 7f764bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.735+0000 7f764bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:50536/0 (socket says 172.21.15.18:50536) 2024-09-19T10:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.735+0000 7f764bfff640 1 -- 172.21.15.18:0/1850384423 learned_addr learned my addr 172.21.15.18:0/1850384423 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.736+0000 7f7654c45740 10 client.0 _ll_register_callbacks cb 0x7f763c00a4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.736+0000 7f764bfff640 1 -- 172.21.15.18:0/1850384423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe162ec0 msgr2=0x55a5fe159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.736+0000 7f764bfff640 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe162ec0 0x55a5fe159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.736+0000 7f764bfff640 1 -- 172.21.15.18:0/1850384423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 msgr2=0x55a5fe15cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.736+0000 7f764bfff640 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 0x55a5fe15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.736+0000 7f764bfff640 1 -- 172.21.15.18:0/1850384423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5fe15a430 con 0x55a5fe163800 2024-09-19T10:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.739+0000 7f764bfff640 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe159dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f764000f770 tx=0x7f76400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=381e60bbc448e735 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:52.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.734+0000 7f2ca5ffb640 1 -- 172.21.15.18:0/1753200604 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c014070 con 0x7f2ca8110190 2024-09-19T10:01:52.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.734+0000 7f2ca5ffb640 1 -- 172.21.15.18:0/1753200604 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c9c010af0 con 0x7f2ca8110190 2024-09-19T10:01:52.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.734+0000 7f2ca5ffb640 1 -- 172.21.15.18:0/1753200604 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c017d10 con 0x7f2ca8110190 2024-09-19T10:01:52.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.735+0000 7f2cadbc5640 1 -- 172.21.15.18:0/1753200604 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca81ac5c0 con 0x7f2ca8110190 2024-09-19T10:01:52.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.735+0000 7f2cadbc5640 1 -- 172.21.15.18:0/1753200604 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca8110920 con 0x7f2ca8110190 2024-09-19T10:01:52.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.737+0000 7f2c8f7fe640 1 -- 172.21.15.18:0/1753200604 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca81096f0 con 0x7f2ca8110190 2024-09-19T10:01:52.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.741+0000 7f2ca5ffb640 1 -- 172.21.15.18:0/1753200604 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2c9c017070 con 0x7f2ca8110190 2024-09-19T10:01:52.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.742+0000 7f2ca5ffb640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2c900a3450 0x7f2c900a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.743+0000 7f2ca5ffb640 1 -- 172.21.15.18:0/1753200604 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2c9c0ceca0 con 0x7f2ca8110190 2024-09-19T10:01:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.744+0000 7f762f7f6640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:01:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.744+0000 7f762f7f6640 1 -- 172.21.15.18:0/1850384423 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764000e9b0 con 0x55a5fe163800 2024-09-19T10:01:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.744+0000 7f762f7f6640 1 -- 172.21.15.18:0/1850384423 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f764000eb50 con 0x55a5fe163800 2024-09-19T10:01:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.746+0000 7f7654c45740 1 -- 172.21.15.18:0/1850384423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7644036040 con 0x55a5fe163800 2024-09-19T10:01:52.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.746+0000 7f2cacbc3640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2c900a3450 0x7f2c900a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.749+0000 7f2ca5ffb640 1 -- 172.21.15.18:0/1753200604 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c9c09b990 con 0x7f2ca8110190 2024-09-19T10:01:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:52.750+0000 7f2cacbc3640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2c900a3450 0x7f2c900a5910 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2c98005c40 tx=0x7f2c98005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:52.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.756+0000 7f762f7f6640 1 -- 172.21.15.18:0/1850384423 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f764000ed50 con 0x55a5fe163800 2024-09-19T10:01:52.760 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.758+0000 7f7654c45740 10 client.27085 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.758+0000 7f7654c45740 1 -- 172.21.15.18:0/1850384423 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a5fe1f3da0 con 0x55a5fe163800 2024-09-19T10:01:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.762+0000 7f762f7f6640 1 -- 172.21.15.18:0/1850384423 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f764002e900 con 0x55a5fe163800 2024-09-19T10:01:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.763+0000 7f762f7f6640 1 -- 172.21.15.18:0/1850384423 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f764001c7a0 con 0x55a5fe163800 2024-09-19T10:01:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.767+0000 7f7654c45740 10 client.27085 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.767+0000 7f7654c45740 10 client.27085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:01:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.767+0000 7f7654c45740 20 client.27085 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.767+0000 7f7654c45740 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a5fe1f4660 0x55a5fe1f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.767+0000 7f7654c45740 4 client.27085 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:01:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.767+0000 7f7654c45740 1 -- 172.21.15.18:0/1850384423 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f7644036040 con 0x55a5fe1f4660 2024-09-19T10:01:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.772+0000 7f764b7fe640 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a5fe1f4660 0x55a5fe1f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.786+0000 7f764b7fe640 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a5fe1f4660 0x55a5fe1f6a80 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5d09be8ce191aa2 server_cookie=8c7713948973020d in_seq=0 out_seq=0 2024-09-19T10:01:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:52.786+0000 7f762f7f6640 10 client.27085 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:53.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.337+0000 7f2c8f7fe640 1 -- 172.21.15.18:0/1753200604 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ca81a8660 con 0x7f2ca8110190 2024-09-19T10:01:53.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.338+0000 7f2ca5ffb640 1 -- 172.21.15.18:0/1753200604 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f2c9c09b290 con 0x7f2ca8110190 2024-09-19T10:01:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:01:53.343 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:01:53.343 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:01:53.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 -- 172.21.15.18:0/1753200604 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2c900a3450 msgr2=0x7f2c900a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:53.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2c900a3450 0x7f2c900a5910 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2c98005c40 tx=0x7f2c98005fd0 comp rx=0 tx=0).stop 2024-09-19T10:01:53.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 -- 172.21.15.18:0/1753200604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8110190 msgr2=0x7f2ca81a7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:53.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8110190 0x7f2ca81a7840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00b4a0 tx=0x7f2c9c00b960 comp rx=0 tx=0).stop 2024-09-19T10:01:53.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 -- 172.21.15.18:0/1753200604 shutdown_connections 2024-09-19T10:01:53.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2c900a3450 0x7f2c900a5910 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:53.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ca811b140 0x7f2ca81abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:53.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8110190 0x7f2ca81a7840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:53.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 --2- 172.21.15.18:0/1753200604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ca806ea30 0x7f2ca81a7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:53.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 -- 172.21.15.18:0/1753200604 >> 172.21.15.18:0/1753200604 conn(0x7f2ca8073180 msgr2=0x7f2ca8119370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:53.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 -- 172.21.15.18:0/1753200604 shutdown_connections 2024-09-19T10:01:53.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:53.344+0000 7f2c8f7fe640 1 -- 172.21.15.18:0/1753200604 wait complete. 2024-09-19T10:01:53.982 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:53 smithi018 ceph-mon[30956]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 942 MiB/s wr, 1.75k op/s 2024-09-19T10:01:53.983 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:53 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1753200604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:01:54.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T10:01:54.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:53 smithi049 ceph-mon[34858]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 942 MiB/s wr, 1.75k op/s 2024-09-19T10:01:54.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:53 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1753200604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:01:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:53 smithi162 ceph-mon[35174]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 83 GiB used, 989 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 942 MiB/s wr, 1.75k op/s 2024-09-19T10:01:54.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:53 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1753200604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:01:55.392 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:55 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:01:55.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:55 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:01:55.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:55 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:01:55.430 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:01:56.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:56 smithi018 ceph-mon[30956]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 840 MiB/s wr, 1.59k op/s 2024-09-19T10:01:56.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:56 smithi049 ceph-mon[34858]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 840 MiB/s wr, 1.59k op/s 2024-09-19T10:01:56.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:56 smithi162 ceph-mon[35174]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 2.4 MiB/s rd, 840 MiB/s wr, 1.59k op/s 2024-09-19T10:01:56.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.425+0000 7fb11d183640 1 -- 172.21.15.18:0/2882188695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb110095510 msgr2=0x7fb110099120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:56.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.427+0000 7fb11d183640 1 --2- 172.21.15.18:0/2882188695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb110095510 0x7fb110099120 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fb104009930 tx=0x7fb10402a440 comp rx=0 tx=0).stop 2024-09-19T10:01:56.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.428+0000 7fb11d183640 1 -- 172.21.15.18:0/2882188695 shutdown_connections 2024-09-19T10:01:56.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.428+0000 7fb11d183640 1 --2- 172.21.15.18:0/2882188695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb110099880 0x7fb1100a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.428+0000 7fb11d183640 1 --2- 172.21.15.18:0/2882188695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb110095510 0x7fb110099120 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.428+0000 7fb11d183640 1 --2- 172.21.15.18:0/2882188695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb110094b60 0x7fb110094f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.428+0000 7fb11d183640 1 -- 172.21.15.18:0/2882188695 >> 172.21.15.18:0/2882188695 conn(0x7fb11000a1b0 msgr2=0x7fb11000a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.428+0000 7fb11d183640 1 -- 172.21.15.18:0/2882188695 shutdown_connections 2024-09-19T10:01:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.428+0000 7fb11d183640 1 -- 172.21.15.18:0/2882188695 wait complete. 2024-09-19T10:01:56.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.436+0000 7fb11d183640 1 Processor -- start 2024-09-19T10:01:56.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.436+0000 7fb11d183640 1 -- start start 2024-09-19T10:01:56.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.438+0000 7fb11d183640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb110094b60 0x7fb11012add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.439+0000 7fb11d183640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb110095510 0x7fb11012b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.439+0000 7fb117fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb110094b60 0x7fb11012add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.439+0000 7fb11d183640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb110099880 0x7fb11012f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.439+0000 7fb11d183640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1100a4870 con 0x7fb110094b60 2024-09-19T10:01:56.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.439+0000 7fb11d183640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb1100a46f0 con 0x7fb110099880 2024-09-19T10:01:56.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.439+0000 7fb11d183640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1100a49f0 con 0x7fb110095510 2024-09-19T10:01:56.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.439+0000 7fb117fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb110094b60 0x7fb11012add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43342/0 (socket says 172.21.15.18:43342) 2024-09-19T10:01:56.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.439+0000 7fb117fff640 1 -- 172.21.15.18:0/479146774 learned_addr learned my addr 172.21.15.18:0/479146774 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:56.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.440+0000 7fb117fff640 1 -- 172.21.15.18:0/479146774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb110095510 msgr2=0x7fb11012b310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T10:01:56.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.441+0000 7fb117fff640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb110095510 0x7fb11012b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.441+0000 7fb117fff640 1 -- 172.21.15.18:0/479146774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb110099880 msgr2=0x7fb11012f6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T10:01:56.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.441+0000 7fb117fff640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb110099880 0x7fb11012f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.441+0000 7fb117fff640 1 -- 172.21.15.18:0/479146774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11012fd80 con 0x7fb110094b60 2024-09-19T10:01:56.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.442+0000 7fb117fff640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb110094b60 0x7fb11012add0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00e9f0 tx=0x7fb10c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:56.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.443+0000 7fb1157fa640 1 -- 172.21.15.18:0/479146774 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c00cd80 con 0x7fb110094b60 2024-09-19T10:01:56.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.443+0000 7fb1157fa640 1 -- 172.21.15.18:0/479146774 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb10c010910 con 0x7fb110094b60 2024-09-19T10:01:56.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.443+0000 7fb11d183640 1 -- 172.21.15.18:0/479146774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb110130070 con 0x7fb110094b60 2024-09-19T10:01:56.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.444+0000 7fb1157fa640 1 -- 172.21.15.18:0/479146774 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0188b0 con 0x7fb110094b60 2024-09-19T10:01:56.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.444+0000 7fb11d183640 1 -- 172.21.15.18:0/479146774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb110004740 con 0x7fb110094b60 2024-09-19T10:01:56.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.451+0000 7fb1157fa640 1 -- 172.21.15.18:0/479146774 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb10c018b50 con 0x7fb110094b60 2024-09-19T10:01:56.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.453+0000 7fb1157fa640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb1080a3450 0x7fb1080a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.454+0000 7fb1177fe640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb1080a3450 0x7fb1080a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.454+0000 7fb1157fa640 1 -- 172.21.15.18:0/479146774 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb10c0d0d20 con 0x7fb110094b60 2024-09-19T10:01:56.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.459+0000 7fb1177fe640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb1080a3450 0x7fb1080a5910 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb104005c20 tx=0x7fb104005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:56.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.459+0000 7fb1207be740 1 Processor -- start 2024-09-19T10:01:56.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.461+0000 7fb1207be740 1 -- start start 2024-09-19T10:01:56.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.462+0000 7fb1207be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc8fb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.462+0000 7fb1207be740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.463+0000 7fb1207be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc908940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.463+0000 7fb1207be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560acc8612f0 con 0x560acc8fcd20 2024-09-19T10:01:56.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.463+0000 7fb1207be740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560acc808cf0 con 0x560acc8fb7b0 2024-09-19T10:01:56.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.463+0000 7fb1207be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560acc85d2b0 con 0x560acc906550 2024-09-19T10:01:56.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.463+0000 7fb117fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc8fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.463+0000 7fb117fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc8fb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43358/0 (socket says 172.21.15.18:43358) 2024-09-19T10:01:56.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.463+0000 7fb117fff640 1 -- 172.21.15.18:0/2684748897 learned_addr learned my addr 172.21.15.18:0/2684748897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:56.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.466+0000 7fb1177fe640 1 --2- 172.21.15.18:0/2684748897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.466+0000 7fb11c982640 1 --2- 172.21.15.18:0/2684748897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc908940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.469+0000 7fb1177fe640 1 -- 172.21.15.18:0/2684748897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 msgr2=0x560acc908940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:56.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.469+0000 7fb1177fe640 1 --2- 172.21.15.18:0/2684748897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc908940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.469+0000 7fb1177fe640 1 -- 172.21.15.18:0/2684748897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 msgr2=0x560acc8fb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:56.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.469+0000 7fb1177fe640 1 --2- 172.21.15.18:0/2684748897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc8fb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.469+0000 7fb1177fe640 1 -- 172.21.15.18:0/2684748897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560acc7ed3a0 con 0x560acc8fb7b0 2024-09-19T10:01:56.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.472+0000 7fb1177fe640 1 --2- 172.21.15.18:0/2684748897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8fbbf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb10402aa30 tx=0x7fb10403a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=733bf2b57c88c769 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.474+0000 7fb1027fc640 1 -- 172.21.15.18:0/2684748897 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104040070 con 0x560acc8fb7b0 2024-09-19T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.475+0000 7fb1027fc640 1 -- 172.21.15.18:0/2684748897 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb10404c070 con 0x560acc8fb7b0 2024-09-19T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.476+0000 7fb1207be740 1 -- 172.21.15.18:0/2684748897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 msgr2=0x560acc8fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.476+0000 7fb1207be740 1 --2- 172.21.15.18:0/2684748897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8fbbf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb10402aa30 tx=0x7fb10403a000 comp rx=0 tx=0).stop 2024-09-19T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.477+0000 7fb1207be740 1 -- 172.21.15.18:0/2684748897 shutdown_connections 2024-09-19T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.477+0000 7fb1207be740 1 --2- 172.21.15.18:0/2684748897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc908940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.477+0000 7fb1207be740 1 --2- 172.21.15.18:0/2684748897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8fbbf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.477+0000 7fb1207be740 1 --2- 172.21.15.18:0/2684748897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc8fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.477+0000 7fb1207be740 1 -- 172.21.15.18:0/2684748897 >> 172.21.15.18:0/2684748897 conn(0x560acc8c4310 msgr2=0x560acc8f7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.477+0000 7fb1207be740 1 -- 172.21.15.18:0/2684748897 shutdown_connections 2024-09-19T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.477+0000 7fb1207be740 1 -- 172.21.15.18:0/2684748897 wait complete. 2024-09-19T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.477+0000 7fb1207be740 1 -- start start 2024-09-19T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.478+0000 7fb1207be740 1 Processor -- start 2024-09-19T10:01:56.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.479+0000 7fb1207be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc8fb7b0 0x560acc905e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.479+0000 7fb1207be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc9030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.483+0000 7fb117fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc8fb7b0 0x560acc905e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.483+0000 7fb1207be740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc906550 0x560acc903600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.483+0000 7fb1207be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560acc909240 con 0x560acc8fcd20 2024-09-19T10:01:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.483+0000 7fb1207be740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560acc81c060 con 0x560acc906550 2024-09-19T10:01:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.483+0000 7fb1207be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560acc9093c0 con 0x560acc8fb7b0 2024-09-19T10:01:56.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.484+0000 7fb117fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc8fb7b0 0x560acc905e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52012/0 (socket says 172.21.15.18:52012) 2024-09-19T10:01:56.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.484+0000 7fb117fff640 1 -- 172.21.15.18:0/2900168279 learned_addr learned my addr 172.21.15.18:0/2900168279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:56.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.484+0000 7fb1207be740 10 client.0 _ll_register_callbacks cb 0x560acc56f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.485+0000 7fb11c982640 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc906550 0x560acc903600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.487+0000 7fb117fff640 1 -- 172.21.15.18:0/2900168279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc906550 msgr2=0x560acc903600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.487+0000 7fb117fff640 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc906550 0x560acc903600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.487+0000 7fb117fff640 1 -- 172.21.15.18:0/2900168279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 msgr2=0x560acc9030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.487+0000 7fb117fff640 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc9030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.487+0000 7fb117fff640 1 -- 172.21.15.18:0/2900168279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560acc5d23c0 con 0x560acc8fb7b0 2024-09-19T10:01:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.490+0000 7fb117fff640 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc8fb7b0 0x560acc905e10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00c6a0 tx=0x7fb10c09b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d350af075ee6d7ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.490+0000 7fb0f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:01:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.492+0000 7fb0f77fe640 1 -- 172.21.15.18:0/2900168279 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0a5f80 con 0x560acc8fb7b0 2024-09-19T10:01:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.493+0000 7fb1207be740 1 -- 172.21.15.18:0/2900168279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb10404c070 con 0x560acc8fb7b0 2024-09-19T10:01:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.493+0000 7fb0f77fe640 1 -- 172.21.15.18:0/2900168279 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb10c099980 con 0x560acc8fb7b0 2024-09-19T10:01:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.495+0000 7fb0f77fe640 1 -- 172.21.15.18:0/2900168279 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb10c09c760 con 0x560acc8fb7b0 2024-09-19T10:01:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.495+0000 7fb1207be740 10 client.27094 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.495+0000 7fb1207be740 1 -- 172.21.15.18:0/2900168279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560acc91d4c0 con 0x560acc8fb7b0 2024-09-19T10:01:56.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.497+0000 7fb0f77fe640 1 -- 172.21.15.18:0/2900168279 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb10404c070 con 0x560acc8fb7b0 2024-09-19T10:01:56.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.497+0000 7fb0f77fe640 1 -- 172.21.15.18:0/2900168279 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb10c0bd0b0 con 0x560acc8fb7b0 2024-09-19T10:01:56.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.498+0000 7fb1207be740 10 client.27094 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:56.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.498+0000 7fb1207be740 10 client.27094 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T10:01:56.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.498+0000 7fb1207be740 20 client.27094 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:56.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.498+0000 7fb1207be740 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x560acc91ee60 0x560acc9212f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.498+0000 7fb1207be740 4 client.27094 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:56.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.498+0000 7fb1207be740 1 -- 172.21.15.18:0/2900168279 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560acc86e860 con 0x560acc91ee60 2024-09-19T10:01:56.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.499+0000 7fb1177fe640 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x560acc91ee60 0x560acc9212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.499+0000 7fb1177fe640 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x560acc91ee60 0x560acc9212f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d7eaf533a56767c server_cookie=94478364f4eb0dd6 in_seq=0 out_seq=0 2024-09-19T10:01:56.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.500+0000 7fb0f77fe640 10 client.27094 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T10:01:56.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.501+0000 7fb0f77fe640 1 -- 172.21.15.18:0/2900168279 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560acc86e860 con 0x560acc91ee60 2024-09-19T10:01:56.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.501+0000 7fb0f77fe640 10 client.27094 handle_command_reply: tid=0 2024-09-19T10:01:56.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.502+0000 7fb1207be740 1 client.27094 shutdown 2024-09-19T10:01:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.502+0000 7fb1207be740 1 -- 172.21.15.18:0/2900168279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc8fb7b0 msgr2=0x560acc905e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.502+0000 7fb1207be740 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc8fb7b0 0x560acc905e10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00c6a0 tx=0x7fb10c09b820 comp rx=0 tx=0).stop 2024-09-19T10:01:56.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.513+0000 7fb1207be740 1 -- 172.21.15.18:0/2900168279 shutdown_connections 2024-09-19T10:01:56.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.513+0000 7fb1207be740 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x560acc91ee60 0x560acc9212f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.513+0000 7fb1207be740 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc906550 0x560acc903600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.513+0000 7fb1207be740 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc9030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.513+0000 7fb1207be740 1 --2- 172.21.15.18:0/2900168279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc8fb7b0 0x560acc905e10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.513+0000 7fb1207be740 1 -- 172.21.15.18:0/2900168279 >> 172.21.15.18:0/2900168279 conn(0x560acc8c4310 msgr2=0x560acc8fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:56.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.513+0000 7fb0f77fe640 0 client.27094 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T10:01:56.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.513+0000 7fb1207be740 1 -- 172.21.15.18:0/2900168279 shutdown_connections 2024-09-19T10:01:56.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.513+0000 7fb1207be740 1 -- 172.21.15.18:0/2900168279 wait complete. 2024-09-19T10:01:56.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.513+0000 7fb1207be740 20 client.27094 trim_cache size 0 max 16384 2024-09-19T10:01:56.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.559+0000 7fb1207be740 1 Processor -- start 2024-09-19T10:01:56.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.560+0000 7fb1207be740 1 -- start start 2024-09-19T10:01:56.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.560+0000 7fb1207be740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.560+0000 7fb1207be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc8fe300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.561+0000 7fb117fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.561+0000 7fb117fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8f6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55308/0 (socket says 172.21.15.18:55308) 2024-09-19T10:01:56.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.561+0000 7fb117fff640 1 -- 172.21.15.18:0/1303080315 learned_addr learned my addr 172.21.15.18:0/1303080315 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:56.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.561+0000 7fb1207be740 1 --2- 172.21.15.18:0/1303080315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc8fe840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.561+0000 7fb1207be740 1 -- 172.21.15.18:0/1303080315 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb11013edf0 con 0x560acc8fcd20 2024-09-19T10:01:56.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.561+0000 7fb11c982640 1 --2- 172.21.15.18:0/1303080315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc8fe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.561+0000 7fb1207be740 1 -- 172.21.15.18:0/1303080315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb110140930 con 0x560acc8fb7b0 2024-09-19T10:01:56.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.561+0000 7fb1207be740 1 -- 172.21.15.18:0/1303080315 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb11013f4c0 con 0x560acc906550 2024-09-19T10:01:56.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.562+0000 7fb117fff640 1 -- 172.21.15.18:0/1303080315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 msgr2=0x560acc8fe840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:56.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.562+0000 7fb117fff640 1 --2- 172.21.15.18:0/1303080315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc8fe840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.562+0000 7fb117fff640 1 -- 172.21.15.18:0/1303080315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 msgr2=0x560acc8fe300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:56.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.562+0000 7fb117fff640 1 --2- 172.21.15.18:0/1303080315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc8fe300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.562+0000 7fb117fff640 1 -- 172.21.15.18:0/1303080315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560acc909460 con 0x560acc8fb7b0 2024-09-19T10:01:56.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.562+0000 7fb117fff640 1 --2- 172.21.15.18:0/1303080315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8f6e90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb10c099720 tx=0x7fb10c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32a95e055012b55b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:56.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.563+0000 7fb101ffb640 1 -- 172.21.15.18:0/1303080315 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0b0070 con 0x560acc8fb7b0 2024-09-19T10:01:56.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.564+0000 7fb101ffb640 1 -- 172.21.15.18:0/1303080315 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb10c0b6070 con 0x560acc8fb7b0 2024-09-19T10:01:56.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.565+0000 7fb1207be740 1 -- 172.21.15.18:0/1303080315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 msgr2=0x560acc8f6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:56.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.565+0000 7fb1207be740 1 --2- 172.21.15.18:0/1303080315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8f6e90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb10c099720 tx=0x7fb10c000bc0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.565+0000 7fb1207be740 1 -- 172.21.15.18:0/1303080315 shutdown_connections 2024-09-19T10:01:56.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.565+0000 7fb1207be740 1 --2- 172.21.15.18:0/1303080315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc8fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.565+0000 7fb1207be740 1 --2- 172.21.15.18:0/1303080315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc8fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.565+0000 7fb1207be740 1 --2- 172.21.15.18:0/1303080315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc8fb7b0 0x560acc8f6e90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.565+0000 7fb1207be740 1 -- 172.21.15.18:0/1303080315 >> 172.21.15.18:0/1303080315 conn(0x560acc8c4310 msgr2=0x560acc8f6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:56.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.566+0000 7fb1207be740 1 -- 172.21.15.18:0/1303080315 shutdown_connections 2024-09-19T10:01:56.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.566+0000 7fb1207be740 1 -- 172.21.15.18:0/1303080315 wait complete. 2024-09-19T10:01:56.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.566+0000 7fb1207be740 1 -- start start 2024-09-19T10:01:56.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.567+0000 7fb1207be740 1 Processor -- start 2024-09-19T10:01:56.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.567+0000 7fb1207be740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc916f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.567+0000 7fb1207be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc9174d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.567+0000 7fb1207be740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc917a10 0x560acc8ff430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.567+0000 7fb1207be740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb110140260 con 0x560acc8fcd20 2024-09-19T10:01:56.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.567+0000 7fb1207be740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb11013fb90 con 0x560acc917a10 2024-09-19T10:01:56.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.567+0000 7fb1207be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb11013cdd0 con 0x560acc906550 2024-09-19T10:01:56.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.567+0000 7fb1207be740 10 client.0 _ll_register_callbacks cb 0x7fb10c0bbf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:56.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.568+0000 7fb11c982640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc917a10 0x560acc8ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.568+0000 7fb11c982640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc917a10 0x560acc8ff430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55310/0 (socket says 172.21.15.18:55310) 2024-09-19T10:01:56.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.568+0000 7fb11c982640 1 -- 172.21.15.18:0/1991792279 learned_addr learned my addr 172.21.15.18:0/1991792279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:56.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.568+0000 7fb1177fe640 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc9174d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.569+0000 7fb11c982640 1 -- 172.21.15.18:0/1991792279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 msgr2=0x560acc9174d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:56.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.569+0000 7fb11c982640 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc9174d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.569+0000 7fb11c982640 1 -- 172.21.15.18:0/1991792279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 msgr2=0x560acc916f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T10:01:56.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.569+0000 7fb11c982640 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc916f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.569+0000 7fb11c982640 1 -- 172.21.15.18:0/1991792279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560acc8ffc10 con 0x560acc917a10 2024-09-19T10:01:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.570+0000 7fb11c982640 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc917a10 0x560acc8ff430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb118000b60 tx=0x7fb118080730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf2372a5c4274eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.570+0000 7fb0f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:01:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.570+0000 7fb0f77fe640 1 -- 172.21.15.18:0/1991792279 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118086060 con 0x560acc917a10 2024-09-19T10:01:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.570+0000 7fb1207be740 1 -- 172.21.15.18:0/1991792279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560acc868d70 con 0x560acc917a10 2024-09-19T10:01:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.570+0000 7fb0f77fe640 1 -- 172.21.15.18:0/1991792279 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb11806f820 con 0x560acc917a10 2024-09-19T10:01:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.571+0000 7fb0f77fe640 1 -- 172.21.15.18:0/1991792279 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb11806fa20 con 0x560acc917a10 2024-09-19T10:01:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.571+0000 7fb1207be740 10 client.27077 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.571+0000 7fb1207be740 1 -- 172.21.15.18:0/1991792279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560acc99a750 con 0x560acc917a10 2024-09-19T10:01:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.571+0000 7fb0f77fe640 1 -- 172.21.15.18:0/1991792279 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560acc868d70 con 0x560acc917a10 2024-09-19T10:01:56.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.573+0000 7fb0f77fe640 1 -- 172.21.15.18:0/1991792279 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb11806ed00 con 0x560acc917a10 2024-09-19T10:01:56.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.573+0000 7fb1207be740 10 client.27077 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:56.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.573+0000 7fb1207be740 10 client.27077 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T10:01:56.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.573+0000 7fb1207be740 20 client.27077 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:56.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.573+0000 7fb1207be740 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x560acc99ae70 0x560acc99d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:56.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.573+0000 7fb1207be740 4 client.27077 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:01:56.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.573+0000 7fb1207be740 1 -- 172.21.15.18:0/1991792279 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560acc7e5170 con 0x560acc99ae70 2024-09-19T10:01:56.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.575+0000 7fb117fff640 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x560acc99ae70 0x560acc99d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:56.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.579+0000 7fb0f77fe640 10 client.27077 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T10:01:56.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.579+0000 7fb117fff640 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x560acc99ae70 0x560acc99d290 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=49aa4a92ef6419a7 server_cookie=23408455345e6707 in_seq=0 out_seq=0 2024-09-19T10:01:56.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.581+0000 7fb0f77fe640 1 -- 172.21.15.18:0/1991792279 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb10c0b6040 con 0x560acc99ae70 2024-09-19T10:01:56.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.581+0000 7fb0f77fe640 10 client.27077 handle_command_reply: tid=0 2024-09-19T10:01:56.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.582+0000 7fb1207be740 1 client.27077 shutdown 2024-09-19T10:01:56.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.582+0000 7fb1207be740 1 -- 172.21.15.18:0/1991792279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc917a10 msgr2=0x560acc8ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:56.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.582+0000 7fb1207be740 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc917a10 0x560acc8ff430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb118000b60 tx=0x7fb118080730 comp rx=0 tx=0).stop 2024-09-19T10:01:56.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.582+0000 7fb1207be740 1 -- 172.21.15.18:0/1991792279 shutdown_connections 2024-09-19T10:01:56.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.582+0000 7fb1207be740 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x560acc99ae70 0x560acc99d290 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.582+0000 7fb1207be740 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560acc917a10 0x560acc8ff430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.582+0000 7fb1207be740 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560acc906550 0x560acc9174d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.582+0000 7fb1207be740 1 --2- 172.21.15.18:0/1991792279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560acc8fcd20 0x560acc916f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.582+0000 7fb1207be740 1 -- 172.21.15.18:0/1991792279 >> 172.21.15.18:0/1991792279 conn(0x560acc8c4310 msgr2=0x560acc8f6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:56.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.583+0000 7fb0f77fe640 0 client.27077 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T10:01:56.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.583+0000 7fb1207be740 1 -- 172.21.15.18:0/1991792279 shutdown_connections 2024-09-19T10:01:56.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.583+0000 7fb1207be740 1 -- 172.21.15.18:0/1991792279 wait complete. 2024-09-19T10:01:56.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.584+0000 7fb1207be740 20 client.27077 trim_cache size 0 max 16384 2024-09-19T10:01:56.589 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:01:56.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.587+0000 7fb11d183640 1 -- 172.21.15.18:0/479146774 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb1080a3450 msgr2=0x7fb1080a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:56.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.587+0000 7fb11d183640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb1080a3450 0x7fb1080a5910 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb104005c20 tx=0x7fb104005fd0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.587+0000 7fb11d183640 1 -- 172.21.15.18:0/479146774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb110094b60 msgr2=0x7fb11012add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:56.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.587+0000 7fb11d183640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb110094b60 0x7fb11012add0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00e9f0 tx=0x7fb10c00eeb0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.587+0000 7fb11d183640 1 -- 172.21.15.18:0/479146774 shutdown_connections 2024-09-19T10:01:56.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.587+0000 7fb11d183640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb1080a3450 0x7fb1080a5910 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.587+0000 7fb11d183640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb110099880 0x7fb11012f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.587+0000 7fb11d183640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb110095510 0x7fb11012b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.587+0000 7fb11d183640 1 --2- 172.21.15.18:0/479146774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb110094b60 0x7fb11012add0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:56.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.587+0000 7fb11d183640 1 -- 172.21.15.18:0/479146774 >> 172.21.15.18:0/479146774 conn(0x7fb11000a1b0 msgr2=0x7fb110092c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:56.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.588+0000 7fb11d183640 1 -- 172.21.15.18:0/479146774 shutdown_connections 2024-09-19T10:01:56.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:56.588+0000 7fb11d183640 1 -- 172.21.15.18:0/479146774 wait complete. 2024-09-19T10:01:57.391 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:57 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:01:57.391 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:57 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:01:57.391 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:57 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:01:57.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:57 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:01:57.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:57 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:01:57.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:57 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:01:57.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:57 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:01:57.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:57 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:01:57.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:57 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:01:57.611 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T10:01:58.282 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:01:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.588+0000 7f762f7f6640 1 -- 172.21.15.18:0/1850384423 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f7644036040 con 0x55a5fe1f4660 2024-09-19T10:01:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.588+0000 7f762f7f6640 10 client.27085 handle_command_reply: tid=0 2024-09-19T10:01:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.588+0000 7f7654c45740 1 client.27085 shutdown 2024-09-19T10:01:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.590+0000 7f7654c45740 1 -- 172.21.15.18:0/1850384423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 msgr2=0x55a5fe159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.590+0000 7f7654c45740 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe159dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f764000f770 tx=0x7f76400046c0 comp rx=0 tx=0).stop 2024-09-19T10:01:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.591+0000 7f7654c45740 1 -- 172.21.15.18:0/1850384423 shutdown_connections 2024-09-19T10:01:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.591+0000 7f7654c45740 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a5fe1f4660 0x55a5fe1f6a80 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.591+0000 7f7654c45740 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5fe163800 0x55a5fe159dc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.591+0000 7f7654c45740 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a5fe162ec0 0x55a5fe159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.591+0000 7f7654c45740 1 --2- 172.21.15.18:0/1850384423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fe151520 0x55a5fe15cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.591+0000 7f7654c45740 1 -- 172.21.15.18:0/1850384423 >> 172.21.15.18:0/1850384423 conn(0x55a5fe15e530 msgr2=0x55a5fe14beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.591+0000 7f762f7f6640 0 client.27085 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:01:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.591+0000 7f7654c45740 1 -- 172.21.15.18:0/1850384423 shutdown_connections 2024-09-19T10:01:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.591+0000 7f7654c45740 1 -- 172.21.15.18:0/1850384423 wait complete. 2024-09-19T10:01:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.591+0000 7f7654c45740 20 client.27085 trim_cache size 0 max 16384 2024-09-19T10:01:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:01:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:01:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:01:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:01:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.594+0000 7f76327fc640 1 -- 172.21.15.18:0/3753939779 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76340a3340 msgr2=0x7f76340a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.594+0000 7f76327fc640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76340a3340 0x7f76340a5800 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7640005fd0 tx=0x7f7640005d60 comp rx=0 tx=0).stop 2024-09-19T10:01:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.594+0000 7f76327fc640 1 -- 172.21.15.18:0/3753939779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f764c073680 msgr2=0x7f764c1a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.594+0000 7f76327fc640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f764c073680 0x7f764c1a6fb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c970 tx=0x7f763c00ce30 comp rx=0 tx=0).stop 2024-09-19T10:01:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.594+0000 7f76327fc640 1 -- 172.21.15.18:0/3753939779 shutdown_connections 2024-09-19T10:01:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.594+0000 7f76327fc640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76340a3340 0x7f76340a5800 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.594+0000 7f76327fc640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f764c10dbb0 0x7f764c07a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.594+0000 7f76327fc640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f764c073680 0x7f764c1a6fb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.594+0000 7f76327fc640 1 --2- 172.21.15.18:0/3753939779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f764c072cb0 0x7f764c1a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.594+0000 7f76327fc640 1 -- 172.21.15.18:0/3753939779 >> 172.21.15.18:0/3753939779 conn(0x7f764c06eb50 msgr2=0x7f764c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.596+0000 7f76327fc640 1 -- 172.21.15.18:0/3753939779 shutdown_connections 2024-09-19T10:01:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:01:58.596+0000 7f76327fc640 1 -- 172.21.15.18:0/3753939779 wait complete. 2024-09-19T10:01:58.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:01:58 smithi018 ceph-mon[30956]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 847 MiB/s wr, 1.61k op/s 2024-09-19T10:01:58.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:01:58 smithi049 ceph-mon[34858]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 847 MiB/s wr, 1.61k op/s 2024-09-19T10:01:58.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:01:58 smithi162 ceph-mon[35174]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 847 MiB/s wr, 1.61k op/s 2024-09-19T10:01:59.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.315+0000 7fca925a7640 1 -- 172.21.15.18:0/2825909440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8c110190 msgr2=0x7fca8c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:59.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.315+0000 7fca925a7640 1 --2- 172.21.15.18:0/2825909440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8c110190 0x7fca8c06e4f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fca88009860 tx=0x7fca8802a380 comp rx=0 tx=0).stop 2024-09-19T10:01:59.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.320+0000 7fca925a7640 1 -- 172.21.15.18:0/2825909440 shutdown_connections 2024-09-19T10:01:59.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.320+0000 7fca925a7640 1 --2- 172.21.15.18:0/2825909440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca8c11b140 0x7fca8c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.320+0000 7fca925a7640 1 --2- 172.21.15.18:0/2825909440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca8c06ea30 0x7fca8c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.320+0000 7fca925a7640 1 --2- 172.21.15.18:0/2825909440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8c110190 0x7fca8c06e4f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.320+0000 7fca925a7640 1 -- 172.21.15.18:0/2825909440 >> 172.21.15.18:0/2825909440 conn(0x7fca8c073180 msgr2=0x7fca8c073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:59.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.322+0000 7fca925a7640 1 -- 172.21.15.18:0/2825909440 shutdown_connections 2024-09-19T10:01:59.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.322+0000 7fca925a7640 1 -- 172.21.15.18:0/2825909440 wait complete. 2024-09-19T10:01:59.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.323+0000 7fca925a7640 1 Processor -- start 2024-09-19T10:01:59.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.324+0000 7fca925a7640 1 -- start start 2024-09-19T10:01:59.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.324+0000 7fca925a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca8c06ea30 0x7fca8c11a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.324+0000 7fca925a7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca8c110190 0x7fca8c116990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.324+0000 7fca925a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8c11b140 0x7fca8c116ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.324+0000 7fca925a7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c113300 con 0x7fca8c06ea30 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.324+0000 7fca925a7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c113180 con 0x7fca8c11b140 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.324+0000 7fca925a7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c113480 con 0x7fca8c110190 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.325+0000 7fca91da6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8c11b140 0x7fca8c116ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.325+0000 7fca91da6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8c11b140 0x7fca8c116ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55332/0 (socket says 172.21.15.18:55332) 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.325+0000 7fca91da6640 1 -- 172.21.15.18:0/2897240417 learned_addr learned my addr 172.21.15.18:0/2897240417 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.325+0000 7fca90da4640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca8c110190 0x7fca8c116990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.326+0000 7fca91da6640 1 -- 172.21.15.18:0/2897240417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca8c110190 msgr2=0x7fca8c116990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.326+0000 7fca91da6640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca8c110190 0x7fca8c116990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.326+0000 7fca91da6640 1 -- 172.21.15.18:0/2897240417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca8c06ea30 msgr2=0x7fca8c11a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:59.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.326+0000 7fca91da6640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca8c06ea30 0x7fca8c11a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.327+0000 7fca91da6640 1 -- 172.21.15.18:0/2897240417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c117650 con 0x7fca8c11b140 2024-09-19T10:01:59.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.328+0000 7fca91da6640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8c11b140 0x7fca8c116ed0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fca8401fb30 tx=0x7fca8401d380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:59.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.329+0000 7fca827fc640 1 -- 172.21.15.18:0/2897240417 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84011030 con 0x7fca8c11b140 2024-09-19T10:01:59.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.329+0000 7fca925a7640 1 -- 172.21.15.18:0/2897240417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8c1aaf60 con 0x7fca8c11b140 2024-09-19T10:01:59.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.329+0000 7fca925a7640 1 -- 172.21.15.18:0/2897240417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8c1ab410 con 0x7fca8c11b140 2024-09-19T10:01:59.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.333+0000 7fca95be2740 1 Processor -- start 2024-09-19T10:01:59.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.333+0000 7fca827fc640 1 -- 172.21.15.18:0/2897240417 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca8401ddc0 con 0x7fca8c11b140 2024-09-19T10:01:59.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.333+0000 7fca827fc640 1 -- 172.21.15.18:0/2897240417 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca840044f0 con 0x7fca8c11b140 2024-09-19T10:01:59.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.334+0000 7fca95be2740 1 -- start start 2024-09-19T10:01:59.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.336+0000 7fca95be2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4bd20 0x55b5eab4c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.336+0000 7fca95be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab4aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.336+0000 7fca95be2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 0x55b5eab57820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.336+0000 7fca90da4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4bd20 0x55b5eab4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.336+0000 7fca90da4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4bd20 0x55b5eab4c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55340/0 (socket says 172.21.15.18:55340) 2024-09-19T10:01:59.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.337+0000 7fca90da4640 1 -- 172.21.15.18:0/3856659016 learned_addr learned my addr 172.21.15.18:0/3856659016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:59.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.337+0000 7fca95be2740 1 -- 172.21.15.18:0/3856659016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b5eaab02f0 con 0x55b5eab4b040 2024-09-19T10:01:59.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.337+0000 7fca95be2740 1 -- 172.21.15.18:0/3856659016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b5eaa57cf0 con 0x55b5eab4bd20 2024-09-19T10:01:59.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.337+0000 7fca95be2740 1 -- 172.21.15.18:0/3856659016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b5eaaac2b0 con 0x55b5eab4a5c0 2024-09-19T10:01:59.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.337+0000 7fca90da4640 1 -- 172.21.15.18:0/3856659016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 msgr2=0x55b5eab4aa20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T10:01:59.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.337+0000 7fca90da4640 1 --2- 172.21.15.18:0/3856659016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab4aa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.337+0000 7fca90da4640 1 -- 172.21.15.18:0/3856659016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 msgr2=0x55b5eab57820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:59.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.337+0000 7fca90da4640 1 --2- 172.21.15.18:0/3856659016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 0x55b5eab57820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.337+0000 7fca90da4640 1 -- 172.21.15.18:0/3856659016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5eaa3c3a0 con 0x55b5eab4bd20 2024-09-19T10:01:59.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.338+0000 7fca90da4640 1 --2- 172.21.15.18:0/3856659016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4bd20 0x55b5eab4c100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00bd20 tx=0x7fca7c0127c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19625774a92e8283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:59.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.338+0000 7fca925a7640 1 -- 172.21.15.18:0/3856659016 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c004030 con 0x55b5eab4bd20 2024-09-19T10:01:59.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.339+0000 7fca925a7640 1 -- 172.21.15.18:0/3856659016 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca7c0041d0 con 0x55b5eab4bd20 2024-09-19T10:01:59.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.339+0000 7fca925a7640 1 -- 172.21.15.18:0/3856659016 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c01b950 con 0x55b5eab4bd20 2024-09-19T10:01:59.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.340+0000 7fca95be2740 1 -- 172.21.15.18:0/3856659016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4bd20 msgr2=0x55b5eab4c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.340+0000 7fca95be2740 1 --2- 172.21.15.18:0/3856659016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4bd20 0x55b5eab4c100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00bd20 tx=0x7fca7c0127c0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.345+0000 7fca95be2740 1 -- 172.21.15.18:0/3856659016 shutdown_connections 2024-09-19T10:01:59.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.345+0000 7fca95be2740 1 --2- 172.21.15.18:0/3856659016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 0x55b5eab57820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.345+0000 7fca95be2740 1 --2- 172.21.15.18:0/3856659016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab4aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.345+0000 7fca95be2740 1 --2- 172.21.15.18:0/3856659016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4bd20 0x55b5eab4c100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.345+0000 7fca95be2740 1 -- 172.21.15.18:0/3856659016 >> 172.21.15.18:0/3856659016 conn(0x55b5eab13310 msgr2=0x55b5eab47100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.346+0000 7fca827fc640 1 -- 172.21.15.18:0/2897240417 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fca84004b20 con 0x7fca8c11b140 2024-09-19T10:01:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.347+0000 7fca827fc640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fca780a3380 0x7fca780a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.348+0000 7fca827fc640 1 -- 172.21.15.18:0/2897240417 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fca840f1a70 con 0x7fca8c11b140 2024-09-19T10:01:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.349+0000 7fca915a5640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fca780a3380 0x7fca780a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.350+0000 7fca915a5640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fca780a3380 0x7fca780a5840 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fca88030550 tx=0x7fca88009510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:59.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.351+0000 7fca95be2740 1 -- 172.21.15.18:0/3856659016 shutdown_connections 2024-09-19T10:01:59.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.351+0000 7fca95be2740 1 -- 172.21.15.18:0/3856659016 wait complete. 2024-09-19T10:01:59.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.351+0000 7fca95be2740 1 -- start start 2024-09-19T10:01:59.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.352+0000 7fca95be2740 1 Processor -- start 2024-09-19T10:01:59.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.359+0000 7fca95be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab57680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.359+0000 7fca95be2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4b040 0x55b5eab54930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.360+0000 7fca95be2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 0x55b5eab54e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.362+0000 7fca95be2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b5eab58250 con 0x55b5eab4bd20 2024-09-19T10:01:59.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.362+0000 7fca95be2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b5eaa6b060 con 0x55b5eab4b040 2024-09-19T10:01:59.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.363+0000 7fca95be2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b5eab583d0 con 0x55b5eab4a5c0 2024-09-19T10:01:59.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.363+0000 7fca95be2740 10 client.0 _ll_register_callbacks cb 0x55b5ea7be8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.365+0000 7fca90da4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4b040 0x55b5eab54930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.365+0000 7fca90da4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4b040 0x55b5eab54930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55352/0 (socket says 172.21.15.18:55352) 2024-09-19T10:01:59.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.365+0000 7fca90da4640 1 -- 172.21.15.18:0/149038077 learned_addr learned my addr 172.21.15.18:0/149038077 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.366+0000 7fca91da6640 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 0x55b5eab54e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.366+0000 7fca915a5640 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab57680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.371+0000 7fca91da6640 1 -- 172.21.15.18:0/149038077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 msgr2=0x55b5eab57680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:59.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.372+0000 7fca91da6640 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab57680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.372+0000 7fca91da6640 1 -- 172.21.15.18:0/149038077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4b040 msgr2=0x55b5eab54930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:59.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.372+0000 7fca91da6640 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4b040 0x55b5eab54930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.372+0000 7fca91da6640 1 -- 172.21.15.18:0/149038077 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ea8213c0 con 0x55b5eab4bd20 2024-09-19T10:01:59.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.375+0000 7fca91da6640 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 0x55b5eab54e70 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fca8401d880 tx=0x7fca840be760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a511a727c0d82e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:59.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.375+0000 7fca74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:01:59.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.376+0000 7fca74ff9640 1 -- 172.21.15.18:0/149038077 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca840c6cd0 con 0x55b5eab4bd20 2024-09-19T10:01:59.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.376+0000 7fca95be2740 1 -- 172.21.15.18:0/149038077 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca7c0041d0 con 0x55b5eab4bd20 2024-09-19T10:01:59.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.377+0000 7fca74ff9640 1 -- 172.21.15.18:0/149038077 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fca840ef650 con 0x55b5eab4bd20 2024-09-19T10:01:59.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.378+0000 7fca74ff9640 1 -- 172.21.15.18:0/149038077 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca84004e10 con 0x55b5eab4bd20 2024-09-19T10:01:59.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.378+0000 7fca95be2740 10 client.17631 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:59.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.378+0000 7fca95be2740 1 -- 172.21.15.18:0/149038077 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5eab63ca0 con 0x55b5eab4bd20 2024-09-19T10:01:59.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.380+0000 7fca74ff9640 1 -- 172.21.15.18:0/149038077 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca7c0041d0 con 0x55b5eab4bd20 2024-09-19T10:01:59.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.380+0000 7fca74ff9640 1 -- 172.21.15.18:0/149038077 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca840d9020 con 0x55b5eab4bd20 2024-09-19T10:01:59.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.382+0000 7fca95be2740 10 client.17631 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:59.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.382+0000 7fca95be2740 10 client.17631 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:01:59.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.382+0000 7fca95be2740 20 client.17631 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:59.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.382+0000 7fca95be2740 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b5eab65600 0x55b5eab67a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.382+0000 7fca95be2740 4 client.17631 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:01:59.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.382+0000 7fca95be2740 1 -- 172.21.15.18:0/149038077 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5eaabd860 con 0x55b5eab65600 2024-09-19T10:01:59.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.393+0000 7fca915a5640 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b5eab65600 0x55b5eab67a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.397+0000 7fca915a5640 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b5eab65600 0x55b5eab67a60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9e508616f7e6f595 server_cookie=26cfa56af9ac3d0a in_seq=0 out_seq=0 2024-09-19T10:01:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca74ff9640 10 client.17631 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:01:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca74ff9640 1 -- 172.21.15.18:0/149038077 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5eaabd860 con 0x55b5eab65600 2024-09-19T10:01:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca74ff9640 10 client.17631 handle_command_reply: tid=0 2024-09-19T10:01:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca95be2740 1 client.17631 shutdown 2024-09-19T10:01:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca95be2740 1 -- 172.21.15.18:0/149038077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 msgr2=0x55b5eab54e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca95be2740 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 0x55b5eab54e70 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fca8401d880 tx=0x7fca840be760 comp rx=0 tx=0).stop 2024-09-19T10:01:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca95be2740 1 -- 172.21.15.18:0/149038077 shutdown_connections 2024-09-19T10:01:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca95be2740 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b5eab65600 0x55b5eab67a60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca95be2740 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 0x55b5eab54e70 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca95be2740 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4b040 0x55b5eab54930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca95be2740 1 --2- 172.21.15.18:0/149038077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab57680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca95be2740 1 -- 172.21.15.18:0/149038077 >> 172.21.15.18:0/149038077 conn(0x55b5eab13310 msgr2=0x55b5eab46300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.400+0000 7fca74ff9640 0 client.17631 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:01:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.401+0000 7fca95be2740 1 -- 172.21.15.18:0/149038077 shutdown_connections 2024-09-19T10:01:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.403+0000 7fca95be2740 1 -- 172.21.15.18:0/149038077 wait complete. 2024-09-19T10:01:59.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.403+0000 7fca95be2740 20 client.17631 trim_cache size 0 max 16384 2024-09-19T10:01:59.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.437+0000 7fca95be2740 1 Processor -- start 2024-09-19T10:01:59.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.437+0000 7fca95be2740 1 -- start start 2024-09-19T10:01:59.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.438+0000 7fca95be2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab13310 0x55b5eab61580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.438+0000 7fca95be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab4d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.438+0000 7fca95be2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 0x55b5eab548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.438+0000 7fca95be2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca7000e490 con 0x55b5eab4b040 2024-09-19T10:01:59.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.438+0000 7fca95be2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fca7000ffd0 con 0x55b5eab13310 2024-09-19T10:01:59.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.438+0000 7fca95be2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca7000eb60 con 0x55b5eab4a5c0 2024-09-19T10:01:59.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.438+0000 7fca91da6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 0x55b5eab548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.438+0000 7fca91da6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 0x55b5eab548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43438/0 (socket says 172.21.15.18:43438) 2024-09-19T10:01:59.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.438+0000 7fca91da6640 1 -- 172.21.15.18:0/1459650074 learned_addr learned my addr 172.21.15.18:0/1459650074 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:59.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.439+0000 7fca90da4640 1 --2- 172.21.15.18:0/1459650074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab4d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.439+0000 7fca91da6640 1 -- 172.21.15.18:0/1459650074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 msgr2=0x55b5eab4d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:59.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.439+0000 7fca91da6640 1 --2- 172.21.15.18:0/1459650074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab4d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.439+0000 7fca91da6640 1 -- 172.21.15.18:0/1459650074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab13310 msgr2=0x55b5eab61580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:01:59.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.439+0000 7fca91da6640 1 --2- 172.21.15.18:0/1459650074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab13310 0x55b5eab61580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.439+0000 7fca91da6640 1 -- 172.21.15.18:0/1459650074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5eab41dc0 con 0x55b5eab4b040 2024-09-19T10:01:59.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.439+0000 7fca91da6640 1 --2- 172.21.15.18:0/1459650074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 0x55b5eab548f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fca840baa30 tx=0x7fca8401da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef760ae21fb49317 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:59.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.440+0000 7fca76ffd640 1 -- 172.21.15.18:0/1459650074 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca840bc360 con 0x55b5eab4b040 2024-09-19T10:01:59.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.440+0000 7fca76ffd640 1 -- 172.21.15.18:0/1459650074 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca840c20d0 con 0x55b5eab4b040 2024-09-19T10:01:59.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.440+0000 7fca76ffd640 1 -- 172.21.15.18:0/1459650074 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca840bcf20 con 0x55b5eab4b040 2024-09-19T10:01:59.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.441+0000 7fca95be2740 1 -- 172.21.15.18:0/1459650074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 msgr2=0x55b5eab548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:59.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.441+0000 7fca95be2740 1 --2- 172.21.15.18:0/1459650074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 0x55b5eab548f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fca840baa30 tx=0x7fca8401da50 comp rx=0 tx=0).stop 2024-09-19T10:01:59.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.441+0000 7fca95be2740 1 -- 172.21.15.18:0/1459650074 shutdown_connections 2024-09-19T10:01:59.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.441+0000 7fca95be2740 1 --2- 172.21.15.18:0/1459650074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4b040 0x55b5eab548f0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.441+0000 7fca95be2740 1 --2- 172.21.15.18:0/1459650074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4a5c0 0x55b5eab4d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.441+0000 7fca95be2740 1 --2- 172.21.15.18:0/1459650074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab13310 0x55b5eab61580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.441+0000 7fca95be2740 1 -- 172.21.15.18:0/1459650074 >> 172.21.15.18:0/1459650074 conn(0x55b5eab54fd0 msgr2=0x55b5eab569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:59.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.443+0000 7fca95be2740 1 -- 172.21.15.18:0/1459650074 shutdown_connections 2024-09-19T10:01:59.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.443+0000 7fca95be2740 1 -- 172.21.15.18:0/1459650074 wait complete. 2024-09-19T10:01:59.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.444+0000 7fca95be2740 1 -- start start 2024-09-19T10:01:59.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.444+0000 7fca95be2740 1 Processor -- start 2024-09-19T10:01:59.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.446+0000 7fca95be2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4a5c0 0x55b5eab6c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.446+0000 7fca95be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4b040 0x55b5eab6ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.446+0000 7fca915a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4a5c0 0x55b5eab6c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.447+0000 7fca915a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4a5c0 0x55b5eab6c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55368/0 (socket says 172.21.15.18:55368) 2024-09-19T10:01:59.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.447+0000 7fca90da4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4b040 0x55b5eab6ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.447+0000 7fca915a5640 1 -- 172.21.15.18:0/1361300425 learned_addr learned my addr 172.21.15.18:0/1361300425 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:01:59.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.447+0000 7fca90da4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4b040 0x55b5eab6ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52074/0 (socket says 172.21.15.18:52074) 2024-09-19T10:01:59.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.447+0000 7fca95be2740 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 0x55b5eab5c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.447+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca7000f900 con 0x55b5eab4bd20 2024-09-19T10:01:59.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.447+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fca7000f230 con 0x55b5eab4a5c0 2024-09-19T10:01:59.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.447+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca7000c470 con 0x55b5eab4b040 2024-09-19T10:01:59.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.447+0000 7fca95be2740 10 client.0 _ll_register_callbacks cb 0x7fca840bdbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:01:59.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.449+0000 7fca91da6640 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 0x55b5eab5c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.449+0000 7fca90da4640 1 -- 172.21.15.18:0/1361300425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4a5c0 msgr2=0x55b5eab6c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:59.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.449+0000 7fca90da4640 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4a5c0 0x55b5eab6c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.449+0000 7fca90da4640 1 -- 172.21.15.18:0/1361300425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 msgr2=0x55b5eab5c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:01:59.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.449+0000 7fca90da4640 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 0x55b5eab5c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.449+0000 7fca90da4640 1 -- 172.21.15.18:0/1361300425 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5eab5cd90 con 0x55b5eab4b040 2024-09-19T10:01:59.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.449+0000 7fca915a5640 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4a5c0 0x55b5eab6c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:01:59.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.450+0000 7fca91da6640 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 0x55b5eab5c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:01:59.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.450+0000 7fca90da4640 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4b040 0x55b5eab6ce40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55b5eab541c0 tx=0x7fca7c0055e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f3fec565e6b4845 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:01:59.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.450+0000 7fca74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:01:59.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.450+0000 7fca74ff9640 1 -- 172.21.15.18:0/1361300425 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c02a070 con 0x55b5eab4b040 2024-09-19T10:01:59.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.450+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca840c20d0 con 0x55b5eab4b040 2024-09-19T10:01:59.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.451+0000 7fca74ff9640 1 -- 172.21.15.18:0/1361300425 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fca7c003a00 con 0x55b5eab4b040 2024-09-19T10:01:59.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.451+0000 7fca74ff9640 1 -- 172.21.15.18:0/1361300425 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca7c003c40 con 0x55b5eab4b040 2024-09-19T10:01:59.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.451+0000 7fca95be2740 10 client.27112 fetch_fsmap learned FSMap version 28 2024-09-19T10:01:59.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.451+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5eab5e030 con 0x55b5eab4b040 2024-09-19T10:01:59.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.451+0000 7fca74ff9640 1 -- 172.21.15.18:0/1361300425 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca7c003de0 con 0x55b5eab4b040 2024-09-19T10:01:59.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.452+0000 7fca74ff9640 1 -- 172.21.15.18:0/1361300425 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca7c02d020 con 0x55b5eab4b040 2024-09-19T10:01:59.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.452+0000 7fca95be2740 10 client.27112 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:01:59.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.452+0000 7fca95be2740 10 client.27112 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:01:59.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.452+0000 7fca95be2740 20 client.27112 populate_metadata read hostname 'smithi018' 2024-09-19T10:01:59.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.452+0000 7fca95be2740 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b5eabd0340 0x55b5eabd2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:01:59.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.452+0000 7fca95be2740 4 client.27112 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:01:59.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.452+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fca840c20d0 con 0x55b5eabd0340 2024-09-19T10:01:59.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.453+0000 7fca915a5640 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b5eabd0340 0x55b5eabd2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:01:59.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.453+0000 7fca915a5640 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b5eabd0340 0x55b5eabd2730 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=90ec8beeeffe2049 server_cookie=86af35e017398872 in_seq=0 out_seq=0 2024-09-19T10:01:59.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.453+0000 7fca74ff9640 10 client.27112 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:01:59.459 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:01:59.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.454+0000 7fca74ff9640 1 -- 172.21.15.18:0/1361300425 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fca840c20d0 con 0x55b5eabd0340 2024-09-19T10:01:59.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.454+0000 7fca74ff9640 10 client.27112 handle_command_reply: tid=0 2024-09-19T10:01:59.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.454+0000 7fca95be2740 1 client.27112 shutdown 2024-09-19T10:01:59.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.454+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4b040 msgr2=0x55b5eab6ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:59.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.454+0000 7fca95be2740 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4b040 0x55b5eab6ce40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55b5eab541c0 tx=0x7fca7c0055e0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.454+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 shutdown_connections 2024-09-19T10:01:59.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.454+0000 7fca95be2740 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b5eabd0340 0x55b5eabd2730 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.454+0000 7fca74ff9640 0 client.27112 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:01:59.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.455+0000 7fca95be2740 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b5eab4bd20 0x55b5eab5c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.455+0000 7fca95be2740 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b5eab4b040 0x55b5eab6ce40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.455+0000 7fca95be2740 1 --2- 172.21.15.18:0/1361300425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5eab4a5c0 0x55b5eab6c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.455+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 >> 172.21.15.18:0/1361300425 conn(0x55b5eab54fd0 msgr2=0x55b5eab4d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:59.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.455+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 shutdown_connections 2024-09-19T10:01:59.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.455+0000 7fca95be2740 1 -- 172.21.15.18:0/1361300425 wait complete. 2024-09-19T10:01:59.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.455+0000 7fca95be2740 20 client.27112 trim_cache size 0 max 16384 2024-09-19T10:01:59.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.457+0000 7fca77fff640 1 -- 172.21.15.18:0/2897240417 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fca780a3380 msgr2=0x7fca780a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:59.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.457+0000 7fca77fff640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fca780a3380 0x7fca780a5840 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fca88030550 tx=0x7fca88009510 comp rx=0 tx=0).stop 2024-09-19T10:01:59.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.457+0000 7fca77fff640 1 -- 172.21.15.18:0/2897240417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8c11b140 msgr2=0x7fca8c116ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:01:59.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.457+0000 7fca77fff640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8c11b140 0x7fca8c116ed0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fca8401fb30 tx=0x7fca8401d380 comp rx=0 tx=0).stop 2024-09-19T10:01:59.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.458+0000 7fca77fff640 1 -- 172.21.15.18:0/2897240417 shutdown_connections 2024-09-19T10:01:59.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.458+0000 7fca77fff640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fca780a3380 0x7fca780a5840 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.458+0000 7fca77fff640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca8c11b140 0x7fca8c116ed0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.458+0000 7fca77fff640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca8c110190 0x7fca8c116990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.458+0000 7fca77fff640 1 --2- 172.21.15.18:0/2897240417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca8c06ea30 0x7fca8c11a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:01:59.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.458+0000 7fca77fff640 1 -- 172.21.15.18:0/2897240417 >> 172.21.15.18:0/2897240417 conn(0x7fca8c073180 msgr2=0x7fca8c11b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:01:59.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.459+0000 7fca77fff640 1 -- 172.21.15.18:0/2897240417 shutdown_connections 2024-09-19T10:01:59.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:01:59.459+0000 7fca77fff640 1 -- 172.21.15.18:0/2897240417 wait complete. 2024-09-19T10:02:00.312 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:00 smithi018 ceph-mon[30956]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 840 MiB/s wr, 1.62k op/s 2024-09-19T10:02:00.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T10:02:00.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:00 smithi049 ceph-mon[34858]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 840 MiB/s wr, 1.62k op/s 2024-09-19T10:02:00.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:00 smithi162 ceph-mon[35174]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 840 MiB/s wr, 1.62k op/s 2024-09-19T10:02:01.647 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.544+0000 7f6a7b04b640 1 -- 172.21.15.18:0/2569316966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a7411b140 msgr2=0x7f6a7411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.544+0000 7f6a7b04b640 1 --2- 172.21.15.18:0/2569316966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a7411b140 0x7f6a7411d530 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009be0 tx=0x7f6a6c02a6c0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.546+0000 7f6a7b04b640 1 -- 172.21.15.18:0/2569316966 shutdown_connections 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.546+0000 7f6a7b04b640 1 --2- 172.21.15.18:0/2569316966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a7411b140 0x7f6a7411d530 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.546+0000 7f6a7b04b640 1 --2- 172.21.15.18:0/2569316966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7406ea30 0x7f6a7406ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.546+0000 7f6a7b04b640 1 --2- 172.21.15.18:0/2569316966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a74110220 0x7f6a7406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.546+0000 7f6a7b04b640 1 -- 172.21.15.18:0/2569316966 >> 172.21.15.18:0/2569316966 conn(0x7f6a74073210 msgr2=0x7f6a74073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.546+0000 7f6a7b04b640 1 -- 172.21.15.18:0/2569316966 shutdown_connections 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.547+0000 7f6a7b04b640 1 -- 172.21.15.18:0/2569316966 wait complete. 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.548+0000 7f6a7b04b640 1 Processor -- start 2024-09-19T10:02:02.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.548+0000 7f6a7b04b640 1 -- start start 2024-09-19T10:02:02.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.548+0000 7f6a7b04b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a7406ea30 0x7f6a74119680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.548+0000 7f6a7b04b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a74110220 0x7f6a74119bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.548+0000 7f6a7b04b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7411b140 0x7f6a74112940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.548+0000 7f6a7b04b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74120cd0 con 0x7f6a7406ea30 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.548+0000 7f6a7b04b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74120b50 con 0x7f6a7411b140 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.548+0000 7f6a7b04b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74120e50 con 0x7f6a74110220 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.549+0000 7f6a73fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a74110220 0x7f6a74119bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.549+0000 7f6a78de7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a7406ea30 0x7f6a74119680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.549+0000 7f6a73fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a74110220 0x7f6a74119bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52084/0 (socket says 172.21.15.18:52084) 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.549+0000 7f6a73fff640 1 -- 172.21.15.18:0/820259939 learned_addr learned my addr 172.21.15.18:0/820259939 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.549+0000 7f6a795e8640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7411b140 0x7f6a74112940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.549+0000 7f6a78de7640 1 -- 172.21.15.18:0/820259939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a74110220 msgr2=0x7f6a74119bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:02.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.549+0000 7f6a78de7640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a74110220 0x7f6a74119bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.549+0000 7f6a78de7640 1 -- 172.21.15.18:0/820259939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7411b140 msgr2=0x7f6a74112940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:02.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.549+0000 7f6a78de7640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7411b140 0x7f6a74112940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.550+0000 7f6a78de7640 1 -- 172.21.15.18:0/820259939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a74113200 con 0x7f6a7406ea30 2024-09-19T10:02:02.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.550+0000 7f6a795e8640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7411b140 0x7f6a74112940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:02:02.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.550+0000 7f6a73fff640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a74110220 0x7f6a74119bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:02:02.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.551+0000 7f6a78de7640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a7406ea30 0x7f6a74119680 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400e790 tx=0x7f6a6400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:02.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.552+0000 7f6a71ffb640 1 -- 172.21.15.18:0/820259939 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400eea0 con 0x7f6a7406ea30 2024-09-19T10:02:02.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.552+0000 7f6a71ffb640 1 -- 172.21.15.18:0/820259939 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a6400ccc0 con 0x7f6a7406ea30 2024-09-19T10:02:02.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.552+0000 7f6a71ffb640 1 -- 172.21.15.18:0/820259939 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64018780 con 0x7f6a7406ea30 2024-09-19T10:02:02.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.552+0000 7f6a7b04b640 1 -- 172.21.15.18:0/820259939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a741134f0 con 0x7f6a7406ea30 2024-09-19T10:02:02.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.553+0000 7f6a7b04b640 1 -- 172.21.15.18:0/820259939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a74117440 con 0x7f6a7406ea30 2024-09-19T10:02:02.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.557+0000 7f6a7d424740 1 Processor -- start 2024-09-19T10:02:02.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.558+0000 7f6a7d424740 1 -- start start 2024-09-19T10:02:02.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.558+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559827115cf0 0x559827114240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.558+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827114780 0x559827114bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.561+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55982711f520 0x559827121910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.561+0000 7f6a795e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559827115cf0 0x559827114240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.561+0000 7f6a7d424740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55982707a2f0 con 0x559827115cf0 2024-09-19T10:02:02.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.561+0000 7f6a7d424740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559827021cf0 con 0x559827114780 2024-09-19T10:02:02.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.561+0000 7f6a7d424740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5598270762b0 con 0x55982711f520 2024-09-19T10:02:02.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.561+0000 7f6a795e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559827115cf0 0x559827114240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43482/0 (socket says 172.21.15.18:43482) 2024-09-19T10:02:02.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.561+0000 7f6a795e8640 1 -- 172.21.15.18:0/1489507565 learned_addr learned my addr 172.21.15.18:0/1489507565 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:02.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.562+0000 7f6a78de7640 1 --2- 172.21.15.18:0/1489507565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827114780 0x559827114bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.562+0000 7f6a71ffb640 1 -- 172.21.15.18:0/820259939 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6a64018920 con 0x7f6a7406ea30 2024-09-19T10:02:02.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.563+0000 7f6a73fff640 1 --2- 172.21.15.18:0/1489507565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55982711f520 0x559827121910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.563+0000 7f6a71ffb640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a5c0a3380 0x7f6a5c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.563+0000 7f6a71ffb640 1 -- 172.21.15.18:0/820259939 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6a640cfa40 con 0x7f6a7406ea30 2024-09-19T10:02:02.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.564+0000 7f6a73fff640 1 -- 172.21.15.18:0/1489507565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827114780 msgr2=0x559827114bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:02.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.564+0000 7f6a73fff640 1 --2- 172.21.15.18:0/1489507565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827114780 0x559827114bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.564+0000 7f6a73fff640 1 -- 172.21.15.18:0/1489507565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559827115cf0 msgr2=0x559827114240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:02.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.564+0000 7f6a73fff640 1 --2- 172.21.15.18:0/1489507565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559827115cf0 0x559827114240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.564+0000 7f6a73fff640 1 -- 172.21.15.18:0/1489507565 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598270063a0 con 0x55982711f520 2024-09-19T10:02:02.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.565+0000 7f6a795e8640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a5c0a3380 0x7f6a5c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.565+0000 7f6a73fff640 1 --2- 172.21.15.18:0/1489507565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55982711f520 0x559827121910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a74113f60 tx=0x7f6a68011950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef165e0d0e9b9e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:02.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.565+0000 7f6a5affd640 1 -- 172.21.15.18:0/1489507565 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6801e070 con 0x55982711f520 2024-09-19T10:02:02.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.565+0000 7f6a795e8640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a5c0a3380 0x7f6a5c0a5840 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0099a0 tx=0x7f6a6c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:02.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.565+0000 7f6a5affd640 1 -- 172.21.15.18:0/1489507565 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a680035f0 con 0x55982711f520 2024-09-19T10:02:02.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.565+0000 7f6a5affd640 1 -- 172.21.15.18:0/1489507565 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800f7a0 con 0x55982711f520 2024-09-19T10:02:02.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.567+0000 7f6a7d424740 1 -- 172.21.15.18:0/1489507565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55982711f520 msgr2=0x559827121910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:02.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.567+0000 7f6a7d424740 1 --2- 172.21.15.18:0/1489507565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55982711f520 0x559827121910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a74113f60 tx=0x7f6a68011950 comp rx=0 tx=0).stop 2024-09-19T10:02:02.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.570+0000 7f6a7d424740 1 -- 172.21.15.18:0/1489507565 shutdown_connections 2024-09-19T10:02:02.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.570+0000 7f6a7d424740 1 --2- 172.21.15.18:0/1489507565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55982711f520 0x559827121910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.570+0000 7f6a7d424740 1 --2- 172.21.15.18:0/1489507565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827114780 0x559827114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.570+0000 7f6a7d424740 1 --2- 172.21.15.18:0/1489507565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559827115cf0 0x559827114240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.570+0000 7f6a7d424740 1 -- 172.21.15.18:0/1489507565 >> 172.21.15.18:0/1489507565 conn(0x5598270dd310 msgr2=0x559827110e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:02.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.571+0000 7f6a7d424740 1 -- 172.21.15.18:0/1489507565 shutdown_connections 2024-09-19T10:02:02.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.571+0000 7f6a7d424740 1 -- 172.21.15.18:0/1489507565 wait complete. 2024-09-19T10:02:02.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.572+0000 7f6a7d424740 1 -- start start 2024-09-19T10:02:02.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.572+0000 7f6a7d424740 1 Processor -- start 2024-09-19T10:02:02.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.573+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x55982711ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.573+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827115cf0 0x55982711c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.573+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x55982711c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.573+0000 7f6a7d424740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559827122220 con 0x55982711f520 2024-09-19T10:02:02.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.573+0000 7f6a7d424740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559827035060 con 0x559827115cf0 2024-09-19T10:02:02.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.573+0000 7f6a7d424740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5598271223a0 con 0x559827114780 2024-09-19T10:02:02.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.573+0000 7f6a7d424740 10 client.0 _ll_register_callbacks cb 0x559826d888c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.574+0000 7f6a795e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x55982711c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.574+0000 7f6a795e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x55982711c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43492/0 (socket says 172.21.15.18:43492) 2024-09-19T10:02:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.574+0000 7f6a795e8640 1 -- 172.21.15.18:0/589542561 learned_addr learned my addr 172.21.15.18:0/589542561 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.574+0000 7f6a78de7640 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x55982711ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.574+0000 7f6a795e8640 1 -- 172.21.15.18:0/589542561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 msgr2=0x55982711ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:02.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.574+0000 7f6a795e8640 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x55982711ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.574+0000 7f6a795e8640 1 -- 172.21.15.18:0/589542561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827115cf0 msgr2=0x55982711c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:02.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.575+0000 7f6a795e8640 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827115cf0 0x55982711c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.575+0000 7f6a795e8640 1 -- 172.21.15.18:0/589542561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559826deb3c0 con 0x55982711f520 2024-09-19T10:02:02.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.575+0000 7f6a795e8640 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x55982711c5d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c030620 tx=0x7f6a6c031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372d03ac7be51142 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:02.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.575+0000 7f6a53fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:02.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.576+0000 7f6a53fff640 1 -- 172.21.15.18:0/589542561 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c036040 con 0x55982711f520 2024-09-19T10:02:02.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.576+0000 7f6a53fff640 1 -- 172.21.15.18:0/589542561 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6a6c004240 con 0x55982711f520 2024-09-19T10:02:02.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.576+0000 7f6a7d424740 1 -- 172.21.15.18:0/589542561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a680035f0 con 0x55982711f520 2024-09-19T10:02:02.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.576+0000 7f6a53fff640 1 -- 172.21.15.18:0/589542561 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6a6c004480 con 0x55982711f520 2024-09-19T10:02:02.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.576+0000 7f6a7d424740 10 client.17646 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:02.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.576+0000 7f6a7d424740 1 -- 172.21.15.18:0/589542561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55982712dc40 con 0x55982711f520 2024-09-19T10:02:02.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.577+0000 7f6a53fff640 1 -- 172.21.15.18:0/589542561 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a680035f0 con 0x55982711f520 2024-09-19T10:02:02.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.578+0000 7f6a53fff640 1 -- 172.21.15.18:0/589542561 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6a6c052030 con 0x55982711f520 2024-09-19T10:02:02.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.578+0000 7f6a7d424740 10 client.17646 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:02.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.578+0000 7f6a7d424740 10 client.17646 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:02:02.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.578+0000 7f6a7d424740 20 client.17646 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:02.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.578+0000 7f6a7d424740 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55982712f1c0 0x559827131680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.578+0000 7f6a7d424740 4 client.17646 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:02.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.578+0000 7f6a7d424740 1 -- 172.21.15.18:0/589542561 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559827087860 con 0x55982712f1c0 2024-09-19T10:02:02.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.579+0000 7f6a78de7640 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55982712f1c0 0x559827131680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.581+0000 7f6a53fff640 10 client.17646 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:02:02.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.581+0000 7f6a78de7640 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55982712f1c0 0x559827131680 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce640aa5da616a2e server_cookie=e3b40d2af4cc8b22 in_seq=0 out_seq=0 2024-09-19T10:02:02.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.583+0000 7f6a53fff640 1 -- 172.21.15.18:0/589542561 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559827087860 con 0x55982712f1c0 2024-09-19T10:02:02.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.583+0000 7f6a53fff640 10 client.17646 handle_command_reply: tid=0 2024-09-19T10:02:02.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.583+0000 7f6a7d424740 1 client.17646 shutdown 2024-09-19T10:02:02.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.584+0000 7f6a7d424740 1 -- 172.21.15.18:0/589542561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 msgr2=0x55982711c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:02.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.584+0000 7f6a7d424740 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x55982711c5d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c030620 tx=0x7f6a6c031000 comp rx=0 tx=0).stop 2024-09-19T10:02:02.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.584+0000 7f6a7d424740 1 -- 172.21.15.18:0/589542561 shutdown_connections 2024-09-19T10:02:02.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.584+0000 7f6a7d424740 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55982712f1c0 0x559827131680 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.584+0000 7f6a7d424740 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x55982711c5d0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.584+0000 7f6a7d424740 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827115cf0 0x55982711c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.584+0000 7f6a7d424740 1 --2- 172.21.15.18:0/589542561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x55982711ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.584+0000 7f6a7d424740 1 -- 172.21.15.18:0/589542561 >> 172.21.15.18:0/589542561 conn(0x5598270dd310 msgr2=0x559827116ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:02.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.584+0000 7f6a53fff640 0 client.17646 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:02:02.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.585+0000 7f6a7d424740 1 -- 172.21.15.18:0/589542561 shutdown_connections 2024-09-19T10:02:02.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.585+0000 7f6a7d424740 1 -- 172.21.15.18:0/589542561 wait complete. 2024-09-19T10:02:02.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.585+0000 7f6a7d424740 20 client.17646 trim_cache size 0 max 16384 2024-09-19T10:02:02.615 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:02 smithi018 ceph-mon[30956]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 768 MiB/s wr, 1.61k op/s 2024-09-19T10:02:02.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.612+0000 7f6a7d424740 1 Processor -- start 2024-09-19T10:02:02.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.613+0000 7f6a7d424740 1 -- start start 2024-09-19T10:02:02.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.614+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x55982711e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.614+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827115cf0 0x5598271172d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.614+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x559827117810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.614+0000 7f6a7d424740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000e3b0 con 0x55982711f520 2024-09-19T10:02:02.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.614+0000 7f6a7d424740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000fef0 con 0x559827115cf0 2024-09-19T10:02:02.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.614+0000 7f6a7d424740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000ea80 con 0x559827114780 2024-09-19T10:02:02.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.621+0000 7f6a795e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x559827117810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.621+0000 7f6a795e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x559827117810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43504/0 (socket says 172.21.15.18:43504) 2024-09-19T10:02:02.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.621+0000 7f6a795e8640 1 -- 172.21.15.18:0/4142970216 learned_addr learned my addr 172.21.15.18:0/4142970216 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:02.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.622+0000 7f6a795e8640 1 -- 172.21.15.18:0/4142970216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 msgr2=0x55982711e000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:02:02.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.622+0000 7f6a795e8640 1 --2- 172.21.15.18:0/4142970216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x55982711e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.622+0000 7f6a795e8640 1 -- 172.21.15.18:0/4142970216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827115cf0 msgr2=0x5598271172d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:02:02.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.622+0000 7f6a795e8640 1 --2- 172.21.15.18:0/4142970216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827115cf0 0x5598271172d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.622+0000 7f6a795e8640 1 -- 172.21.15.18:0/4142970216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55982711f150 con 0x55982711f520 2024-09-19T10:02:02.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.623+0000 7f6a795e8640 1 --2- 172.21.15.18:0/4142970216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x559827117810 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c006010 tx=0x7f6a6c031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c726bc0a63902c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:02.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.624+0000 7f6a5a7fc640 1 -- 172.21.15.18:0/4142970216 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c036040 con 0x55982711f520 2024-09-19T10:02:02.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.624+0000 7f6a5a7fc640 1 -- 172.21.15.18:0/4142970216 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a6c037040 con 0x55982711f520 2024-09-19T10:02:02.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.624+0000 7f6a5a7fc640 1 -- 172.21.15.18:0/4142970216 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c04a450 con 0x55982711f520 2024-09-19T10:02:02.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.626+0000 7f6a7d424740 1 -- 172.21.15.18:0/4142970216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 msgr2=0x559827117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:02.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.626+0000 7f6a7d424740 1 --2- 172.21.15.18:0/4142970216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x559827117810 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c006010 tx=0x7f6a6c031740 comp rx=0 tx=0).stop 2024-09-19T10:02:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.644+0000 7f6a7d424740 1 -- 172.21.15.18:0/4142970216 shutdown_connections 2024-09-19T10:02:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.644+0000 7f6a7d424740 1 --2- 172.21.15.18:0/4142970216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982711f520 0x559827117810 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.644+0000 7f6a7d424740 1 --2- 172.21.15.18:0/4142970216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559827115cf0 0x5598271172d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.644+0000 7f6a7d424740 1 --2- 172.21.15.18:0/4142970216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x55982711e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.644+0000 7f6a7d424740 1 -- 172.21.15.18:0/4142970216 >> 172.21.15.18:0/4142970216 conn(0x5598270dd310 msgr2=0x55982711d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:02.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:02 smithi049 ceph-mon[34858]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 768 MiB/s wr, 1.61k op/s 2024-09-19T10:02:02.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.649+0000 7f6a7d424740 1 -- 172.21.15.18:0/4142970216 shutdown_connections 2024-09-19T10:02:02.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.649+0000 7f6a7d424740 1 -- 172.21.15.18:0/4142970216 wait complete. 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.649+0000 7f6a7d424740 1 -- start start 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.649+0000 7f6a7d424740 1 Processor -- start 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.650+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x5598271233e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.650+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559827115cf0 0x559827123920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.650+0000 7f6a7d424740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55982711f520 0x559827123e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.651+0000 7f6a7d424740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000f820 con 0x559827115cf0 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.651+0000 7f6a7d424740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000f150 con 0x55982711f520 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.651+0000 7f6a7d424740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000c390 con 0x559827114780 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.651+0000 7f6a7d424740 10 client.0 _ll_register_callbacks cb 0x7f6a7406f5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.651+0000 7f6a78de7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x5598271233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.651+0000 7f6a78de7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x5598271233e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52118/0 (socket says 172.21.15.18:52118) 2024-09-19T10:02:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.651+0000 7f6a78de7640 1 -- 172.21.15.18:0/4144315600 learned_addr learned my addr 172.21.15.18:0/4144315600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.651+0000 7f6a795e8640 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55982711f520 0x559827123e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:02 smithi162 ceph-mon[35174]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 768 MiB/s wr, 1.61k op/s 2024-09-19T10:02:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.661+0000 7f6a78de7640 1 -- 172.21.15.18:0/4144315600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55982711f520 msgr2=0x559827123e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.661+0000 7f6a78de7640 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55982711f520 0x559827123e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.661+0000 7f6a78de7640 1 -- 172.21.15.18:0/4144315600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559827115cf0 msgr2=0x559827123920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.661+0000 7f6a78de7640 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559827115cf0 0x559827123920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.661+0000 7f6a78de7640 1 -- 172.21.15.18:0/4144315600 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559827198f20 con 0x559827114780 2024-09-19T10:02:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.666+0000 7f6a78de7640 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x5598271233e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6a64098490 tx=0x7f6a64098350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94b61ee8ae788e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.666+0000 7f6a53fff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:02:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.666+0000 7f6a53fff640 1 -- 172.21.15.18:0/4144315600 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a640a4ca0 con 0x559827114780 2024-09-19T10:02:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.666+0000 7f6a53fff640 1 -- 172.21.15.18:0/4144315600 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6a640cd620 con 0x559827114780 2024-09-19T10:02:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.666+0000 7f6a7d424740 1 -- 172.21.15.18:0/4144315600 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a6c037040 con 0x559827114780 2024-09-19T10:02:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.667+0000 7f6a53fff640 1 -- 172.21.15.18:0/4144315600 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6a640a00d0 con 0x559827114780 2024-09-19T10:02:02.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.674+0000 7f6a7d424740 10 client.27127 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:02.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.675+0000 7f6a7d424740 1 -- 172.21.15.18:0/4144315600 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55982719a260 con 0x559827114780 2024-09-19T10:02:02.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.675+0000 7f6a53fff640 1 -- 172.21.15.18:0/4144315600 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a640986a0 con 0x559827114780 2024-09-19T10:02:02.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.675+0000 7f6a53fff640 1 -- 172.21.15.18:0/4144315600 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6a6409b480 con 0x559827114780 2024-09-19T10:02:02.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.675+0000 7f6a7d424740 10 client.27127 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:02.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.676+0000 7f6a7d424740 10 client.27127 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:02:02.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.676+0000 7f6a7d424740 20 client.27127 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:02.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.676+0000 7f6a7d424740 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55982719a9d0 0x55982719cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:02.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.676+0000 7f6a7d424740 4 client.27127 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:02:02.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.676+0000 7f6a7d424740 1 -- 172.21.15.18:0/4144315600 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6a6c037040 con 0x55982719a9d0 2024-09-19T10:02:02.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.677+0000 7f6a73fff640 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55982719a9d0 0x55982719cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:02.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.680+0000 7f6a73fff640 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55982719a9d0 0x55982719cdf0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=550b8710fb741bbf server_cookie=46350ce670f0fcbe in_seq=0 out_seq=0 2024-09-19T10:02:02.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.680+0000 7f6a53fff640 10 client.27127 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:02:02.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.681+0000 7f6a53fff640 1 -- 172.21.15.18:0/4144315600 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6a6c037040 con 0x55982719a9d0 2024-09-19T10:02:02.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.681+0000 7f6a53fff640 10 client.27127 handle_command_reply: tid=0 2024-09-19T10:02:02.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.681+0000 7f6a7d424740 1 client.27127 shutdown 2024-09-19T10:02:02.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.682+0000 7f6a7d424740 1 -- 172.21.15.18:0/4144315600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 msgr2=0x5598271233e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:02.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.682+0000 7f6a7d424740 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x5598271233e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6a64098490 tx=0x7f6a64098350 comp rx=0 tx=0).stop 2024-09-19T10:02:02.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.682+0000 7f6a7d424740 1 -- 172.21.15.18:0/4144315600 shutdown_connections 2024-09-19T10:02:02.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.682+0000 7f6a7d424740 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55982719a9d0 0x55982719cdf0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.682+0000 7f6a7d424740 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55982711f520 0x559827123e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.682+0000 7f6a7d424740 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559827115cf0 0x559827123920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.682+0000 7f6a7d424740 1 --2- 172.21.15.18:0/4144315600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559827114780 0x5598271233e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.682+0000 7f6a7d424740 1 -- 172.21.15.18:0/4144315600 >> 172.21.15.18:0/4144315600 conn(0x5598270dd310 msgr2=0x55982710feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:02.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.682+0000 7f6a53fff640 0 client.27127 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:02:02.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.683+0000 7f6a7d424740 1 -- 172.21.15.18:0/4144315600 shutdown_connections 2024-09-19T10:02:02.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.683+0000 7f6a7d424740 1 -- 172.21.15.18:0/4144315600 wait complete. 2024-09-19T10:02:02.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.684+0000 7f6a7d424740 20 client.27127 trim_cache size 0 max 16384 2024-09-19T10:02:02.691 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:02:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.687+0000 7f6a7b04b640 1 -- 172.21.15.18:0/820259939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a5c0a3380 msgr2=0x7f6a5c0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.687+0000 7f6a7b04b640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a5c0a3380 0x7f6a5c0a5840 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0099a0 tx=0x7f6a6c009500 comp rx=0 tx=0).stop 2024-09-19T10:02:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.687+0000 7f6a7b04b640 1 -- 172.21.15.18:0/820259939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a7406ea30 msgr2=0x7f6a74119680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.687+0000 7f6a7b04b640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a7406ea30 0x7f6a74119680 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400e790 tx=0x7f6a6400ec50 comp rx=0 tx=0).stop 2024-09-19T10:02:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.687+0000 7f6a7b04b640 1 -- 172.21.15.18:0/820259939 shutdown_connections 2024-09-19T10:02:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.687+0000 7f6a7b04b640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6a5c0a3380 0x7f6a5c0a5840 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.687+0000 7f6a7b04b640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7411b140 0x7f6a74112940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.687+0000 7f6a7b04b640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a74110220 0x7f6a74119bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.687+0000 7f6a7b04b640 1 --2- 172.21.15.18:0/820259939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a7406ea30 0x7f6a74119680 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.687+0000 7f6a7b04b640 1 -- 172.21.15.18:0/820259939 >> 172.21.15.18:0/820259939 conn(0x7f6a74073210 msgr2=0x7f6a7406b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.688+0000 7f6a7b04b640 1 -- 172.21.15.18:0/820259939 shutdown_connections 2024-09-19T10:02:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:02.688+0000 7f6a7b04b640 1 -- 172.21.15.18:0/820259939 wait complete. 2024-09-19T10:02:03.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T10:02:04.581 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:04.797 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:04 smithi018 ceph-mon[30956]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 868 MiB/s wr, 2.00k op/s 2024-09-19T10:02:04.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:04 smithi049 ceph-mon[34858]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 868 MiB/s wr, 2.00k op/s 2024-09-19T10:02:04.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:04 smithi162 ceph-mon[35174]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 868 MiB/s wr, 2.00k op/s 2024-09-19T10:02:05.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.470+0000 7f79d2d60640 1 -- 172.21.15.18:0/3373156280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79cc11b140 msgr2=0x7f79cc11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:05.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.470+0000 7f79d2d60640 1 --2- 172.21.15.18:0/3373156280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79cc11b140 0x7f79cc11d530 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009860 tx=0x7f79bc02a340 comp rx=0 tx=0).stop 2024-09-19T10:02:05.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.471+0000 7f79d2d60640 1 -- 172.21.15.18:0/3373156280 shutdown_connections 2024-09-19T10:02:05.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.471+0000 7f79d2d60640 1 --2- 172.21.15.18:0/3373156280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79cc11b140 0x7f79cc11d530 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.471+0000 7f79d2d60640 1 --2- 172.21.15.18:0/3373156280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc109830 0x7f79cc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.471+0000 7f79d2d60640 1 --2- 172.21.15.18:0/3373156280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79cc109450 0x7f79cc110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.471+0000 7f79d2d60640 1 -- 172.21.15.18:0/3373156280 >> 172.21.15.18:0/3373156280 conn(0x7f79cc06e140 msgr2=0x7f79cc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:05.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.475+0000 7f79d2d60640 1 -- 172.21.15.18:0/3373156280 shutdown_connections 2024-09-19T10:02:05.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.475+0000 7f79d2d60640 1 -- 172.21.15.18:0/3373156280 wait complete. 2024-09-19T10:02:05.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.477+0000 7f79d2d60640 1 Processor -- start 2024-09-19T10:02:05.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.477+0000 7f79d2d60640 1 -- start start 2024-09-19T10:02:05.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.477+0000 7f79d2d60640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79cc109450 0x7f79cc1a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.477+0000 7f79d2d60640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc109830 0x7f79cc1a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.477+0000 7f79d2d60640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79cc11b140 0x7f79cc1abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.477+0000 7f79d2d60640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc120df0 con 0x7f79cc109450 2024-09-19T10:02:05.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.477+0000 7f79d2d60640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc120c70 con 0x7f79cc11b140 2024-09-19T10:02:05.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.477+0000 7f79d2d60640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc120f70 con 0x7f79cc109830 2024-09-19T10:02:05.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.478+0000 7f79d12fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79cc11b140 0x7f79cc1abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.478+0000 7f79d12fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79cc11b140 0x7f79cc1abaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55422/0 (socket says 172.21.15.18:55422) 2024-09-19T10:02:05.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.478+0000 7f79d12fd640 1 -- 172.21.15.18:0/493852052 learned_addr learned my addr 172.21.15.18:0/493852052 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:05.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.479+0000 7f79d0afc640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79cc109450 0x7f79cc1a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.479+0000 7f79cbfff640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc109830 0x7f79cc1a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.480+0000 7f79d12fd640 1 -- 172.21.15.18:0/493852052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc109830 msgr2=0x7f79cc1a7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:05.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.480+0000 7f79d12fd640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc109830 0x7f79cc1a7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.480+0000 7f79d12fd640 1 -- 172.21.15.18:0/493852052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79cc109450 msgr2=0x7f79cc1a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:05.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.480+0000 7f79d12fd640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79cc109450 0x7f79cc1a71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.480+0000 7f79d12fd640 1 -- 172.21.15.18:0/493852052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc1ac1a0 con 0x7f79cc11b140 2024-09-19T10:02:05.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.481+0000 7f79d12fd640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79cc11b140 0x7f79cc1abaa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0328f0 tx=0x7f79bc033d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.482+0000 7f79c9ffb640 1 -- 172.21.15.18:0/493852052 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc037040 con 0x7f79cc11b140 2024-09-19T10:02:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.482+0000 7f79d2d60640 1 -- 172.21.15.18:0/493852052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79cc1ac430 con 0x7f79cc11b140 2024-09-19T10:02:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.483+0000 7f79d2d60640 1 -- 172.21.15.18:0/493852052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79cc110920 con 0x7f79cc11b140 2024-09-19T10:02:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.487+0000 7f79d5139740 1 Processor -- start 2024-09-19T10:02:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.488+0000 7f79c9ffb640 1 -- 172.21.15.18:0/493852052 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79bc040070 con 0x7f79cc11b140 2024-09-19T10:02:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.488+0000 7f79c9ffb640 1 -- 172.21.15.18:0/493852052 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc037040 con 0x7f79cc11b140 2024-09-19T10:02:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.489+0000 7f79d5139740 1 -- start start 2024-09-19T10:02:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.494+0000 7f79d5139740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2bbb40 0x5591ad2ba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.494+0000 7f79d5139740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2ba5d0 0x5591ad2baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.495+0000 7f79d5139740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 0x5591ad2c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.495+0000 7f79d5139740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5591ad2202f0 con 0x5591ad2c5370 2024-09-19T10:02:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.495+0000 7f79d5139740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5591ad1c7cf0 con 0x5591ad2ba5d0 2024-09-19T10:02:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.495+0000 7f79d5139740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5591ad21c2b0 con 0x5591ad2bbb40 2024-09-19T10:02:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.495+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 0x5591ad2c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.496+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 0x5591ad2c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43542/0 (socket says 172.21.15.18:43542) 2024-09-19T10:02:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.496+0000 7f79cbfff640 1 -- 172.21.15.18:0/1058695273 learned_addr learned my addr 172.21.15.18:0/1058695273 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.497+0000 7f79cbfff640 1 --2- 172.21.15.18:0/1058695273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2bbb40 0x5591ad2ba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.497+0000 7f79d0afc640 1 --2- 172.21.15.18:0/1058695273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2ba5d0 0x5591ad2baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.501+0000 7f79c9ffb640 1 -- 172.21.15.18:0/493852052 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f79bc004250 con 0x7f79cc11b140 2024-09-19T10:02:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.502+0000 7f79cbfff640 1 -- 172.21.15.18:0/1058695273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2ba5d0 msgr2=0x5591ad2baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.502+0000 7f79cbfff640 1 --2- 172.21.15.18:0/1058695273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2ba5d0 0x5591ad2baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.502+0000 7f79cbfff640 1 -- 172.21.15.18:0/1058695273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 msgr2=0x5591ad2c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.502+0000 7f79cbfff640 1 --2- 172.21.15.18:0/1058695273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 0x5591ad2c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.502+0000 7f79cbfff640 1 -- 172.21.15.18:0/1058695273 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ad1ac3a0 con 0x5591ad2bbb40 2024-09-19T10:02:05.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.502+0000 7f79c9ffb640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b40a3510 0x7f79b40a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.506+0000 7f79c9ffb640 1 -- 172.21.15.18:0/493852052 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f79bc0b9550 con 0x7f79cc11b140 2024-09-19T10:02:05.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.507+0000 7f79d0afc640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b40a3510 0x7f79b40a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.507+0000 7f79cbfff640 1 --2- 172.21.15.18:0/1058695273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2bbb40 0x5591ad2ba090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5591ad2bb070 tx=0x7f79c0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38d4a1463bfe6f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:05.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.508+0000 7f79d0afc640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b40a3510 0x7f79b40a59d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x5591ad2b7ac0 tx=0x7f79c4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.509+0000 7f79b2ffd640 1 -- 172.21.15.18:0/1058695273 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0017070 con 0x5591ad2bbb40 2024-09-19T10:02:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.510+0000 7f79b2ffd640 1 -- 172.21.15.18:0/1058695273 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79c000f8f0 con 0x5591ad2bbb40 2024-09-19T10:02:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.510+0000 7f79b2ffd640 1 -- 172.21.15.18:0/1058695273 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c000d900 con 0x5591ad2bbb40 2024-09-19T10:02:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.511+0000 7f79d5139740 1 -- 172.21.15.18:0/1058695273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2bbb40 msgr2=0x5591ad2ba090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.511+0000 7f79d5139740 1 --2- 172.21.15.18:0/1058695273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2bbb40 0x5591ad2ba090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5591ad2bb070 tx=0x7f79c0009260 comp rx=0 tx=0).stop 2024-09-19T10:02:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.512+0000 7f79d5139740 1 -- 172.21.15.18:0/1058695273 shutdown_connections 2024-09-19T10:02:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.512+0000 7f79d5139740 1 --2- 172.21.15.18:0/1058695273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 0x5591ad2c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.512+0000 7f79d5139740 1 --2- 172.21.15.18:0/1058695273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2ba5d0 0x5591ad2baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.512+0000 7f79d5139740 1 --2- 172.21.15.18:0/1058695273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2bbb40 0x5591ad2ba090 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.512+0000 7f79d5139740 1 -- 172.21.15.18:0/1058695273 >> 172.21.15.18:0/1058695273 conn(0x5591ad283310 msgr2=0x5591ad2b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.512+0000 7f79d5139740 1 -- 172.21.15.18:0/1058695273 shutdown_connections 2024-09-19T10:02:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.512+0000 7f79d5139740 1 -- 172.21.15.18:0/1058695273 wait complete. 2024-09-19T10:02:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.513+0000 7f79d5139740 1 -- start start 2024-09-19T10:02:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.514+0000 7f79d5139740 1 Processor -- start 2024-09-19T10:02:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.515+0000 7f79d5139740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 0x5591ad2c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.515+0000 7f79d5139740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.516+0000 7f79d5139740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 0x5591ad2c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.516+0000 7f79d5139740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5591ad2c80c0 con 0x5591ad2ba5d0 2024-09-19T10:02:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.516+0000 7f79d5139740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5591ad1db060 con 0x5591ad2bbb40 2024-09-19T10:02:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.516+0000 7f79d5139740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5591ad2c8240 con 0x5591ad2c5370 2024-09-19T10:02:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.516+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.516+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2c1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55434/0 (socket says 172.21.15.18:55434) 2024-09-19T10:02:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.516+0000 7f79cbfff640 1 -- 172.21.15.18:0/2851625786 learned_addr learned my addr 172.21.15.18:0/2851625786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.516+0000 7f79d5139740 10 client.0 _ll_register_callbacks cb 0x5591acf2e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:05.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.518+0000 7f79d0afc640 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 0x5591ad2c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.519+0000 7f79d12fd640 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 0x5591ad2c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.521+0000 7f79cbfff640 1 -- 172.21.15.18:0/2851625786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 msgr2=0x5591ad2c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:05.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.521+0000 7f79cbfff640 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 0x5591ad2c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.521+0000 7f79cbfff640 1 -- 172.21.15.18:0/2851625786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 msgr2=0x5591ad2c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:05.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.521+0000 7f79cbfff640 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 0x5591ad2c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.521+0000 7f79cbfff640 1 -- 172.21.15.18:0/2851625786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591acf913c0 con 0x5591ad2bbb40 2024-09-19T10:02:05.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.528+0000 7f79abfff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:02:05.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.528+0000 7f79cbfff640 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2c1f70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f79c000fcd0 tx=0x7f79c000fd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ede620c2874cc5e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:05.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.533+0000 7f79abfff640 1 -- 172.21.15.18:0/2851625786 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0017070 con 0x5591ad2bbb40 2024-09-19T10:02:05.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.533+0000 7f79d5139740 1 -- 172.21.15.18:0/2851625786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79c000f8f0 con 0x5591ad2bbb40 2024-09-19T10:02:05.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.534+0000 7f79abfff640 1 -- 172.21.15.18:0/2851625786 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f79c0004450 con 0x5591ad2bbb40 2024-09-19T10:02:05.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.565+0000 7f79abfff640 1 -- 172.21.15.18:0/2851625786 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f79c0012020 con 0x5591ad2bbb40 2024-09-19T10:02:05.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.565+0000 7f79d5139740 10 client.27113 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:05.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.565+0000 7f79d5139740 1 -- 172.21.15.18:0/2851625786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5591ad2d3b90 con 0x5591ad2bbb40 2024-09-19T10:02:05.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.570+0000 7f79abfff640 1 -- 172.21.15.18:0/2851625786 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79c000f8f0 con 0x5591ad2bbb40 2024-09-19T10:02:05.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.570+0000 7f79abfff640 1 -- 172.21.15.18:0/2851625786 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f79c0026020 con 0x5591ad2bbb40 2024-09-19T10:02:05.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.572+0000 7f79d5139740 10 client.27113 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:05.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.572+0000 7f79d5139740 10 client.27113 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:02:05.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.572+0000 7f79d5139740 20 client.27113 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:05.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.572+0000 7f79d5139740 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5591ad2d4ee0 0x5591ad2d72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.572+0000 7f79d5139740 4 client.27113 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:05.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.573+0000 7f79d5139740 1 -- 172.21.15.18:0/2851625786 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591ad22d860 con 0x5591ad2d4ee0 2024-09-19T10:02:05.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.578+0000 7f79d0afc640 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5591ad2d4ee0 0x5591ad2d72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.591+0000 7f79d0afc640 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5591ad2d4ee0 0x5591ad2d72d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=195a81d5249a23e0 server_cookie=6a565d7e6ed07763 in_seq=0 out_seq=0 2024-09-19T10:02:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.591+0000 7f79abfff640 10 client.27113 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:02:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.593+0000 7f79abfff640 1 -- 172.21.15.18:0/2851625786 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591ad22d860 con 0x5591ad2d4ee0 2024-09-19T10:02:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.593+0000 7f79abfff640 10 client.27113 handle_command_reply: tid=0 2024-09-19T10:02:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.594+0000 7f79d5139740 1 client.27113 shutdown 2024-09-19T10:02:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.594+0000 7f79d5139740 1 -- 172.21.15.18:0/2851625786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 msgr2=0x5591ad2c1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.594+0000 7f79d5139740 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2c1f70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f79c000fcd0 tx=0x7f79c000fd00 comp rx=0 tx=0).stop 2024-09-19T10:02:05.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.594+0000 7f79d5139740 1 -- 172.21.15.18:0/2851625786 shutdown_connections 2024-09-19T10:02:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.594+0000 7f79d5139740 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5591ad2d4ee0 0x5591ad2d72d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.594+0000 7f79d5139740 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 0x5591ad2c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.594+0000 7f79d5139740 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2c1f70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.594+0000 7f79d5139740 1 --2- 172.21.15.18:0/2851625786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 0x5591ad2c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.594+0000 7f79d5139740 1 -- 172.21.15.18:0/2851625786 >> 172.21.15.18:0/2851625786 conn(0x5591ad283310 msgr2=0x5591ad2bc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.595+0000 7f79abfff640 0 client.27113 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:02:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.595+0000 7f79d5139740 1 -- 172.21.15.18:0/2851625786 shutdown_connections 2024-09-19T10:02:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.595+0000 7f79d5139740 1 -- 172.21.15.18:0/2851625786 wait complete. 2024-09-19T10:02:05.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.595+0000 7f79d5139740 20 client.27113 trim_cache size 0 max 16384 2024-09-19T10:02:05.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.633+0000 7f79d5139740 1 Processor -- start 2024-09-19T10:02:05.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.633+0000 7f79d5139740 1 -- start start 2024-09-19T10:02:05.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.634+0000 7f79d5139740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2ba5d0 0x5591ad2d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.634+0000 7f79d5139740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2dcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.634+0000 7f79d5139740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 0x5591ad2dd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.634+0000 7f79d0afc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2ba5d0 0x5591ad2d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.634+0000 7f79d0afc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2ba5d0 0x5591ad2d1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52150/0 (socket says 172.21.15.18:52150) 2024-09-19T10:02:05.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.634+0000 7f79d0afc640 1 -- 172.21.15.18:0/497615691 learned_addr learned my addr 172.21.15.18:0/497615691 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.635+0000 7f79d5139740 1 -- 172.21.15.18:0/497615691 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79b800e3d0 con 0x5591ad2c5370 2024-09-19T10:02:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.638+0000 7f79cbfff640 1 --2- 172.21.15.18:0/497615691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2dcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.638+0000 7f79d12fd640 1 --2- 172.21.15.18:0/497615691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 0x5591ad2dd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.639+0000 7f79d5139740 1 -- 172.21.15.18:0/497615691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f79b800ff10 con 0x5591ad2bbb40 2024-09-19T10:02:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.639+0000 7f79d5139740 1 -- 172.21.15.18:0/497615691 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79b800eaa0 con 0x5591ad2ba5d0 2024-09-19T10:02:05.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.640+0000 7f79d0afc640 1 -- 172.21.15.18:0/497615691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 msgr2=0x5591ad2dcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:05.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.640+0000 7f79d0afc640 1 --2- 172.21.15.18:0/497615691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2dcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.640+0000 7f79d0afc640 1 -- 172.21.15.18:0/497615691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 msgr2=0x5591ad2dd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:05.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.640+0000 7f79d0afc640 1 --2- 172.21.15.18:0/497615691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 0x5591ad2dd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.640+0000 7f79d0afc640 1 -- 172.21.15.18:0/497615691 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ad2c2ad0 con 0x5591ad2ba5d0 2024-09-19T10:02:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.644+0000 7f79d0afc640 1 --2- 172.21.15.18:0/497615691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2ba5d0 0x5591ad2d1440 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f79c4020540 tx=0x7f79c4016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59d6d327e627e450 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:05.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.647+0000 7f79b27fc640 1 -- 172.21.15.18:0/497615691 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4020110 con 0x5591ad2ba5d0 2024-09-19T10:02:05.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.647+0000 7f79b27fc640 1 -- 172.21.15.18:0/497615691 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79c4029940 con 0x5591ad2ba5d0 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.647+0000 7f79b27fc640 1 -- 172.21.15.18:0/497615691 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c401ea50 con 0x5591ad2ba5d0 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.649+0000 7f79d5139740 1 -- 172.21.15.18:0/497615691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2ba5d0 msgr2=0x5591ad2d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.649+0000 7f79d5139740 1 --2- 172.21.15.18:0/497615691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2ba5d0 0x5591ad2d1440 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f79c4020540 tx=0x7f79c4016000 comp rx=0 tx=0).stop 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.649+0000 7f79d5139740 1 -- 172.21.15.18:0/497615691 shutdown_connections 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.649+0000 7f79d5139740 1 --2- 172.21.15.18:0/497615691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2c5370 0x5591ad2dd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.649+0000 7f79d5139740 1 --2- 172.21.15.18:0/497615691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2dcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.649+0000 7f79d5139740 1 --2- 172.21.15.18:0/497615691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2ba5d0 0x5591ad2d1440 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.649+0000 7f79d5139740 1 -- 172.21.15.18:0/497615691 >> 172.21.15.18:0/497615691 conn(0x5591ad283310 msgr2=0x5591ad2c0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.650+0000 7f79d5139740 1 -- 172.21.15.18:0/497615691 shutdown_connections 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.650+0000 7f79d5139740 1 -- 172.21.15.18:0/497615691 wait complete. 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.651+0000 7f79d5139740 1 -- start start 2024-09-19T10:02:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.651+0000 7f79d5139740 1 Processor -- start 2024-09-19T10:02:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.655+0000 7f79d5139740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 0x5591ad2cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.656+0000 7f79d5139740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.656+0000 7f79d5139740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 0x5591ad2c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.656+0000 7f79d5139740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79b800f840 con 0x5591ad2ba5d0 2024-09-19T10:02:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.656+0000 7f79d5139740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f79b800f170 con 0x5591ad2bbb40 2024-09-19T10:02:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.657+0000 7f79d5139740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79b800c3b0 con 0x5591ad2c5370 2024-09-19T10:02:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.657+0000 7f79d12fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 0x5591ad2c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.657+0000 7f79d12fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 0x5591ad2c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52152/0 (socket says 172.21.15.18:52152) 2024-09-19T10:02:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.657+0000 7f79d12fd640 1 -- 172.21.15.18:0/3756662912 learned_addr learned my addr 172.21.15.18:0/3756662912 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.659+0000 7f79d0afc640 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 0x5591ad2cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.659+0000 7f79cbfff640 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.659+0000 7f79d5139740 10 client.0 _ll_register_callbacks cb 0x7f79c0009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:05.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.663+0000 7f79d0afc640 1 -- 172.21.15.18:0/3756662912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 msgr2=0x5591ad2c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:05.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.663+0000 7f79d0afc640 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 0x5591ad2c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.663+0000 7f79d0afc640 1 -- 172.21.15.18:0/3756662912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 msgr2=0x5591ad2cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:05.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.663+0000 7f79d0afc640 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.663+0000 7f79d0afc640 1 -- 172.21.15.18:0/3756662912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ad2c9330 con 0x5591ad2ba5d0 2024-09-19T10:02:05.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.667+0000 7f79d0afc640 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 0x5591ad2cd660 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f79c4020540 tx=0x7f79c4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4e8a99b3a4b582 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:05.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.667+0000 7f79abfff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:05.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.668+0000 7f79abfff640 1 -- 172.21.15.18:0/3756662912 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4038020 con 0x5591ad2ba5d0 2024-09-19T10:02:05.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.668+0000 7f79d5139740 1 -- 172.21.15.18:0/3756662912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79c4029940 con 0x5591ad2ba5d0 2024-09-19T10:02:05.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.669+0000 7f79abfff640 1 -- 172.21.15.18:0/3756662912 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f79c4029660 con 0x5591ad2ba5d0 2024-09-19T10:02:05.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.670+0000 7f79abfff640 1 -- 172.21.15.18:0/3756662912 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f79c4029af0 con 0x5591ad2ba5d0 2024-09-19T10:02:05.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.670+0000 7f79d5139740 10 client.17667 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:05.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.671+0000 7f79d5139740 1 -- 172.21.15.18:0/3756662912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5591ad33f500 con 0x5591ad2ba5d0 2024-09-19T10:02:05.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.671+0000 7f79abfff640 1 -- 172.21.15.18:0/3756662912 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79c4029c90 con 0x5591ad2ba5d0 2024-09-19T10:02:05.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.672+0000 7f79abfff640 1 -- 172.21.15.18:0/3756662912 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f79c401eb80 con 0x5591ad2ba5d0 2024-09-19T10:02:05.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.672+0000 7f79d5139740 10 client.17667 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:05.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.672+0000 7f79d5139740 10 client.17667 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:02:05.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.672+0000 7f79d5139740 20 client.17667 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:05.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.673+0000 7f79d5139740 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5591ad33fbb0 0x5591ad341fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:05.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.673+0000 7f79d5139740 4 client.17667 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:02:05.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.673+0000 7f79d5139740 1 -- 172.21.15.18:0/3756662912 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f79c4029940 con 0x5591ad33fbb0 2024-09-19T10:02:05.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.675+0000 7f79cbfff640 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5591ad33fbb0 0x5591ad341fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:05.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.679+0000 7f79cbfff640 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5591ad33fbb0 0x5591ad341fd0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=467f8c31259ce813 server_cookie=1f0ae1b10aa3734e in_seq=0 out_seq=0 2024-09-19T10:02:05.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.679+0000 7f79abfff640 10 client.17667 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:02:05.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.679+0000 7f79abfff640 1 -- 172.21.15.18:0/3756662912 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f79c4029940 con 0x5591ad33fbb0 2024-09-19T10:02:05.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.680+0000 7f79abfff640 10 client.17667 handle_command_reply: tid=0 2024-09-19T10:02:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.680+0000 7f79d5139740 1 client.17667 shutdown 2024-09-19T10:02:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.681+0000 7f79d5139740 1 -- 172.21.15.18:0/3756662912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 msgr2=0x5591ad2cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.681+0000 7f79d5139740 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 0x5591ad2cd660 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f79c4020540 tx=0x7f79c4005fd0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.681+0000 7f79d5139740 1 -- 172.21.15.18:0/3756662912 shutdown_connections 2024-09-19T10:02:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.681+0000 7f79d5139740 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5591ad33fbb0 0x5591ad341fd0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.681+0000 7f79d5139740 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5591ad2c5370 0x5591ad2c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.681+0000 7f79d5139740 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5591ad2bbb40 0x5591ad2cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.681+0000 7f79d5139740 1 --2- 172.21.15.18:0/3756662912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591ad2ba5d0 0x5591ad2cd660 secure :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f79c4020540 tx=0x7f79c4005fd0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.681+0000 7f79d5139740 1 -- 172.21.15.18:0/3756662912 >> 172.21.15.18:0/3756662912 conn(0x5591ad283310 msgr2=0x5591ad2c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.681+0000 7f79abfff640 0 client.17667 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:02:05.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.685+0000 7f79d5139740 1 -- 172.21.15.18:0/3756662912 shutdown_connections 2024-09-19T10:02:05.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.685+0000 7f79d5139740 1 -- 172.21.15.18:0/3756662912 wait complete. 2024-09-19T10:02:05.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.685+0000 7f79d5139740 20 client.17667 trim_cache size 0 max 16384 2024-09-19T10:02:05.688 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:02:05.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.692+0000 7f79d2d60640 1 -- 172.21.15.18:0/493852052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b40a3510 msgr2=0x7f79b40a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:05.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.692+0000 7f79d2d60640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b40a3510 0x7f79b40a59d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x5591ad2b7ac0 tx=0x7f79c4009500 comp rx=0 tx=0).stop 2024-09-19T10:02:05.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.692+0000 7f79d2d60640 1 -- 172.21.15.18:0/493852052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79cc11b140 msgr2=0x7f79cc1abaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:05.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.692+0000 7f79d2d60640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79cc11b140 0x7f79cc1abaa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0328f0 tx=0x7f79bc033d10 comp rx=0 tx=0).stop 2024-09-19T10:02:05.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.692+0000 7f79d2d60640 1 -- 172.21.15.18:0/493852052 shutdown_connections 2024-09-19T10:02:05.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.692+0000 7f79d2d60640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f79b40a3510 0x7f79b40a59d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.692+0000 7f79d2d60640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79cc11b140 0x7f79cc1abaa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.692+0000 7f79d2d60640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79cc109830 0x7f79cc1a7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.692+0000 7f79d2d60640 1 --2- 172.21.15.18:0/493852052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79cc109450 0x7f79cc1a71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:05.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.692+0000 7f79d2d60640 1 -- 172.21.15.18:0/493852052 >> 172.21.15.18:0/493852052 conn(0x7f79cc06e140 msgr2=0x7f79cc11bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:05.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.693+0000 7f79d2d60640 1 -- 172.21.15.18:0/493852052 shutdown_connections 2024-09-19T10:02:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:05.694+0000 7f79d2d60640 1 -- 172.21.15.18:0/493852052 wait complete. 2024-09-19T10:02:06.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:06 smithi018 ceph-mon[30956]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 798 MiB/s wr, 1.90k op/s 2024-09-19T10:02:06.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T10:02:06.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:06 smithi049 ceph-mon[34858]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 798 MiB/s wr, 1.90k op/s 2024-09-19T10:02:06.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:06 smithi162 ceph-mon[35174]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 92 GiB used, 980 GiB / 1.0 TiB avail; 2.7 MiB/s rd, 798 MiB/s wr, 1.90k op/s 2024-09-19T10:02:07.842 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:08.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.795+0000 7f3a20a7c640 1 -- 172.21.15.18:0/2079259168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a1c101460 msgr2=0x7f3a1c105930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:08.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.795+0000 7f3a20a7c640 1 --2- 172.21.15.18:0/2079259168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a1c101460 0x7f3a1c105930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009900 tx=0x7f3a1002a490 comp rx=0 tx=0).stop 2024-09-19T10:02:08.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.796+0000 7f3a20a7c640 1 -- 172.21.15.18:0/2079259168 shutdown_connections 2024-09-19T10:02:08.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.796+0000 7f3a20a7c640 1 --2- 172.21.15.18:0/2079259168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a1c105f50 0x7f3a1c1063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.796+0000 7f3a20a7c640 1 --2- 172.21.15.18:0/2079259168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a1c101460 0x7f3a1c105930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.796+0000 7f3a20a7c640 1 --2- 172.21.15.18:0/2079259168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c100b40 0x7f3a1c100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.796+0000 7f3a20a7c640 1 -- 172.21.15.18:0/2079259168 >> 172.21.15.18:0/2079259168 conn(0x7f3a1c0fc7d0 msgr2=0x7f3a1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:08.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.796+0000 7f3a20a7c640 1 -- 172.21.15.18:0/2079259168 shutdown_connections 2024-09-19T10:02:08.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.796+0000 7f3a20a7c640 1 -- 172.21.15.18:0/2079259168 wait complete. 2024-09-19T10:02:08.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.797+0000 7f3a20a7c640 1 Processor -- start 2024-09-19T10:02:08.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.797+0000 7f3a20a7c640 1 -- start start 2024-09-19T10:02:08.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.797+0000 7f3a20a7c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c100b40 0x7f3a1c10f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.797+0000 7f3a20a7c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a1c101460 0x7f3a1c106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.797+0000 7f3a20a7c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a1c105f50 0x7f3a1c107510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.797+0000 7f3a20a7c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c118640 con 0x7f3a1c105f50 2024-09-19T10:02:08.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.797+0000 7f3a20a7c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c1184c0 con 0x7f3a1c100b40 2024-09-19T10:02:08.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.797+0000 7f3a20a7c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c1187c0 con 0x7f3a1c101460 2024-09-19T10:02:08.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.798+0000 7f3a1a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c100b40 0x7f3a1c10f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.798+0000 7f3a1a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c100b40 0x7f3a1c10f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55692/0 (socket says 172.21.15.18:55692) 2024-09-19T10:02:08.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.798+0000 7f3a1a59c640 1 -- 172.21.15.18:0/637374770 learned_addr learned my addr 172.21.15.18:0/637374770 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:08.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.798+0000 7f3a19d9b640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a1c101460 0x7f3a1c106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.798+0000 7f3a1a59c640 1 -- 172.21.15.18:0/637374770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a1c101460 msgr2=0x7f3a1c106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:08.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.798+0000 7f3a1a59c640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a1c101460 0x7f3a1c106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.798+0000 7f3a1a59c640 1 -- 172.21.15.18:0/637374770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a1c105f50 msgr2=0x7f3a1c107510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:08.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.798+0000 7f3a1a59c640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a1c105f50 0x7f3a1c107510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.798+0000 7f3a1a59c640 1 -- 172.21.15.18:0/637374770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c107d30 con 0x7f3a1c100b40 2024-09-19T10:02:08.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.801+0000 7f3a1a59c640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c100b40 0x7f3a1c10f000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c02d4a0 tx=0x7f3a0c02d960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:08.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.802+0000 7f3a0b7fe640 1 -- 172.21.15.18:0/637374770 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c036070 con 0x7f3a1c100b40 2024-09-19T10:02:08.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.802+0000 7f3a20a7c640 1 -- 172.21.15.18:0/637374770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1c19e960 con 0x7f3a1c100b40 2024-09-19T10:02:08.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.802+0000 7f3a20a7c640 1 -- 172.21.15.18:0/637374770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1c19eea0 con 0x7f3a1c100b40 2024-09-19T10:02:08.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.807+0000 7f3a0b7fe640 1 -- 172.21.15.18:0/637374770 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a0c032af0 con 0x7f3a1c100b40 2024-09-19T10:02:08.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.812+0000 7f3a0b7fe640 1 -- 172.21.15.18:0/637374770 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c039d00 con 0x7f3a1c100b40 2024-09-19T10:02:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.814+0000 7f3a0b7fe640 1 -- 172.21.15.18:0/637374770 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3a0c039070 con 0x7f3a1c100b40 2024-09-19T10:02:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.816+0000 7f3a0b7fe640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3a040a3480 0x7f3a040a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.816+0000 7f3a0b7fe640 1 -- 172.21.15.18:0/637374770 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3a0c0f1d70 con 0x7f3a1c100b40 2024-09-19T10:02:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.818+0000 7f3a22e55740 1 Processor -- start 2024-09-19T10:02:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.819+0000 7f3a22e55740 1 -- start start 2024-09-19T10:02:08.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.820+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f096090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.820+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f096a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.821+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f0a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.821+0000 7f3a22e55740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c28effc2f0 con 0x55c28f097b40 2024-09-19T10:02:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.822+0000 7f3a1ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f0a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.822+0000 7f3a19d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.822+0000 7f3a19d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f096a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:40632/0 (socket says 172.21.15.18:40632) 2024-09-19T10:02:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.822+0000 7f3a1ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f0a3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55696/0 (socket says 172.21.15.18:55696) 2024-09-19T10:02:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.822+0000 7f3a1ad9d640 1 -- 172.21.15.18:0/3075109800 learned_addr learned my addr 172.21.15.18:0/3075109800 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.822+0000 7f3a22e55740 1 -- 172.21.15.18:0/3075109800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c28efa3cf0 con 0x55c28f0a1370 2024-09-19T10:02:08.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.822+0000 7f3a22e55740 1 -- 172.21.15.18:0/3075109800 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c28eff82b0 con 0x55c28f0965d0 2024-09-19T10:02:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.827+0000 7f3a1ad9d640 1 -- 172.21.15.18:0/3075109800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 msgr2=0x55c28f096a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.827+0000 7f3a1ad9d640 1 --2- 172.21.15.18:0/3075109800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f096a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.827+0000 7f3a1ad9d640 1 -- 172.21.15.18:0/3075109800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 msgr2=0x55c28f096090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.827+0000 7f3a1ad9d640 1 --2- 172.21.15.18:0/3075109800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f096090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.827+0000 7f3a1ad9d640 1 -- 172.21.15.18:0/3075109800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c28ef883a0 con 0x55c28f0a1370 2024-09-19T10:02:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.827+0000 7f3a19d9b640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3a040a3480 0x7f3a040a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.829+0000 7f3a1ad9d640 1 --2- 172.21.15.18:0/3075109800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f0a3760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009d30 tx=0x7f3a1400d6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6b632ac2c9c0609 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.832+0000 7f3a08ff9640 1 -- 172.21.15.18:0/3075109800 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14003970 con 0x55c28f0a1370 2024-09-19T10:02:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.832+0000 7f3a08ff9640 1 -- 172.21.15.18:0/3075109800 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a14004020 con 0x55c28f0a1370 2024-09-19T10:02:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.832+0000 7f3a08ff9640 1 -- 172.21.15.18:0/3075109800 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14010820 con 0x55c28f0a1370 2024-09-19T10:02:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.833+0000 7f3a22e55740 1 -- 172.21.15.18:0/3075109800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 msgr2=0x55c28f0a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.833+0000 7f3a22e55740 1 --2- 172.21.15.18:0/3075109800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f0a3760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009d30 tx=0x7f3a1400d6b0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.834+0000 7f3a22e55740 1 -- 172.21.15.18:0/3075109800 shutdown_connections 2024-09-19T10:02:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.834+0000 7f3a22e55740 1 --2- 172.21.15.18:0/3075109800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f0a3760 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.834+0000 7f3a22e55740 1 --2- 172.21.15.18:0/3075109800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f096a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.834+0000 7f3a22e55740 1 --2- 172.21.15.18:0/3075109800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f096090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.834+0000 7f3a22e55740 1 -- 172.21.15.18:0/3075109800 >> 172.21.15.18:0/3075109800 conn(0x55c28f05f310 msgr2=0x55c28f092c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:08.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.835+0000 7f3a22e55740 1 -- 172.21.15.18:0/3075109800 shutdown_connections 2024-09-19T10:02:08.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.835+0000 7f3a22e55740 1 -- 172.21.15.18:0/3075109800 wait complete. 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.835+0000 7f3a22e55740 1 -- start start 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.836+0000 7f3a22e55740 1 Processor -- start 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.838+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f0a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.838+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f09e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.838+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f09e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.838+0000 7f3a22e55740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c28f0a4070 con 0x55c28f097b40 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.838+0000 7f3a22e55740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c28efb7060 con 0x55c28f0a1370 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.838+0000 7f3a22e55740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c28f0a41f0 con 0x55c28f0965d0 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.839+0000 7f3a22e55740 10 client.0 _ll_register_callbacks cb 0x55c28ed0a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.839+0000 7f3a1ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f09e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.839+0000 7f3a1a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f0a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.839+0000 7f3a1a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f0a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:40642/0 (socket says 172.21.15.18:40642) 2024-09-19T10:02:08.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.839+0000 7f3a1a59c640 1 -- 172.21.15.18:0/4066431336 learned_addr learned my addr 172.21.15.18:0/4066431336 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:08.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.841+0000 7f3a19d9b640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3a040a3480 0x7f3a040a5940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3a1002aa80 tx=0x7f3a10005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:08.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.842+0000 7f3a1ad9d640 1 -- 172.21.15.18:0/4066431336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 msgr2=0x55c28f0a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:08.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.842+0000 7f3a1ad9d640 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f0a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.842+0000 7f3a1ad9d640 1 -- 172.21.15.18:0/4066431336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 msgr2=0x55c28f09e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:08.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.842+0000 7f3a1ad9d640 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f09e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.842+0000 7f3a1ad9d640 1 -- 172.21.15.18:0/4066431336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c28ed6d3c0 con 0x55c28f0a1370 2024-09-19T10:02:08.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.844+0000 7f3a1ad9d640 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f09e7e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009d30 tx=0x7f3a14000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d2ad38d58a2eef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:08.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.844+0000 7f3a01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:02:08.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.845+0000 7f3a01ffb640 1 -- 172.21.15.18:0/4066431336 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14009950 con 0x55c28f0a1370 2024-09-19T10:02:08.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.845+0000 7f3a22e55740 1 -- 172.21.15.18:0/4066431336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a14004020 con 0x55c28f0a1370 2024-09-19T10:02:08.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.845+0000 7f3a01ffb640 1 -- 172.21.15.18:0/4066431336 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3a14003b80 con 0x55c28f0a1370 2024-09-19T10:02:08.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.846+0000 7f3a01ffb640 1 -- 172.21.15.18:0/4066431336 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a14003d80 con 0x55c28f0a1370 2024-09-19T10:02:08.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.846+0000 7f3a22e55740 10 client.27128 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:08.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.846+0000 7f3a22e55740 1 -- 172.21.15.18:0/4066431336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c28f0afbe0 con 0x55c28f0a1370 2024-09-19T10:02:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.847+0000 7f3a01ffb640 1 -- 172.21.15.18:0/4066431336 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a14004020 con 0x55c28f0a1370 2024-09-19T10:02:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.849+0000 7f3a01ffb640 1 -- 172.21.15.18:0/4066431336 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3a14022070 con 0x55c28f0a1370 2024-09-19T10:02:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.849+0000 7f3a22e55740 10 client.27128 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.850+0000 7f3a22e55740 10 client.27128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:08.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.850+0000 7f3a22e55740 20 client.27128 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.850+0000 7f3a22e55740 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c28f0b1300 0x55c28f0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.850+0000 7f3a22e55740 4 client.27128 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.850+0000 7f3a22e55740 1 -- 172.21.15.18:0/4066431336 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c28f009860 con 0x55c28f0b1300 2024-09-19T10:02:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.855+0000 7f3a1a59c640 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c28f0b1300 0x55c28f0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.857+0000 7f3a1a59c640 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c28f0b1300 0x55c28f0b3720 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8727422e2874c19 server_cookie=fde49a6f5f1f894c in_seq=0 out_seq=0 2024-09-19T10:02:08.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.857+0000 7f3a01ffb640 10 client.27128 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.861+0000 7f3a01ffb640 1 -- 172.21.15.18:0/4066431336 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c28f009860 con 0x55c28f0b1300 2024-09-19T10:02:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.861+0000 7f3a01ffb640 10 client.27128 handle_command_reply: tid=0 2024-09-19T10:02:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.861+0000 7f3a22e55740 1 client.27128 shutdown 2024-09-19T10:02:08.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.865+0000 7f3a22e55740 1 -- 172.21.15.18:0/4066431336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 msgr2=0x55c28f09e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:08.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.865+0000 7f3a22e55740 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f09e7e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009d30 tx=0x7f3a14000f40 comp rx=0 tx=0).stop 2024-09-19T10:02:08.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.865+0000 7f3a22e55740 1 -- 172.21.15.18:0/4066431336 shutdown_connections 2024-09-19T10:02:08.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.865+0000 7f3a22e55740 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c28f0b1300 0x55c28f0b3720 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.865+0000 7f3a22e55740 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f09e7e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.865+0000 7f3a22e55740 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f09e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.865+0000 7f3a22e55740 1 --2- 172.21.15.18:0/4066431336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f0a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.865+0000 7f3a22e55740 1 -- 172.21.15.18:0/4066431336 >> 172.21.15.18:0/4066431336 conn(0x55c28f05f310 msgr2=0x55c28f098930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:08.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.866+0000 7f3a01ffb640 0 client.27128 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:08.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.866+0000 7f3a22e55740 1 -- 172.21.15.18:0/4066431336 shutdown_connections 2024-09-19T10:02:08.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.866+0000 7f3a22e55740 1 -- 172.21.15.18:0/4066431336 wait complete. 2024-09-19T10:02:08.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.866+0000 7f3a22e55740 20 client.27128 trim_cache size 0 max 16384 2024-09-19T10:02:08.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.900+0000 7f3a22e55740 1 Processor -- start 2024-09-19T10:02:08.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.900+0000 7f3a22e55740 1 -- start start 2024-09-19T10:02:08.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.901+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f09d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.901+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f099310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.902+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f099850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.902+0000 7f3a22e55740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc00e1f0 con 0x55c28f097b40 2024-09-19T10:02:08.907 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:08 smithi018 ceph-mon[30956]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 772 MiB/s wr, 1.79k op/s 2024-09-19T10:02:08.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.902+0000 7f3a1a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f09d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.902+0000 7f3a1a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f09d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:40654/0 (socket says 172.21.15.18:40654) 2024-09-19T10:02:08.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.902+0000 7f3a1a59c640 1 -- 172.21.15.18:0/596196888 learned_addr learned my addr 172.21.15.18:0/596196888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:08.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.902+0000 7f3a22e55740 1 -- 172.21.15.18:0/596196888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc00fd30 con 0x55c28f0a1370 2024-09-19T10:02:08.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.902+0000 7f3a22e55740 1 -- 172.21.15.18:0/596196888 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc00e8c0 con 0x55c28f0965d0 2024-09-19T10:02:08.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.902+0000 7f3a1ad9d640 1 --2- 172.21.15.18:0/596196888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.903+0000 7f3a1ad9d640 1 -- 172.21.15.18:0/596196888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 msgr2=0x55c28f09d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:08.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.903+0000 7f3a1ad9d640 1 --2- 172.21.15.18:0/596196888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f09d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.903+0000 7f3a1ad9d640 1 -- 172.21.15.18:0/596196888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 msgr2=0x55c28f099310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:08.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.903+0000 7f3a1ad9d640 1 --2- 172.21.15.18:0/596196888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f099310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.903+0000 7f3a1ad9d640 1 -- 172.21.15.18:0/596196888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c28f09c5c0 con 0x55c28f0a1370 2024-09-19T10:02:08.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.905+0000 7f3a1ad9d640 1 --2- 172.21.15.18:0/596196888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f099850 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3a14006010 tx=0x7f3a14005df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c553210d13f48fa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:08.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.909+0000 7f3a03fff640 1 -- 172.21.15.18:0/596196888 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14003b80 con 0x55c28f0a1370 2024-09-19T10:02:08.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.909+0000 7f3a03fff640 1 -- 172.21.15.18:0/596196888 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a14033020 con 0x55c28f0a1370 2024-09-19T10:02:08.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.910+0000 7f3a22e55740 1 -- 172.21.15.18:0/596196888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 msgr2=0x55c28f099850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:08.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.911+0000 7f3a22e55740 1 --2- 172.21.15.18:0/596196888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f099850 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3a14006010 tx=0x7f3a14005df0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.911+0000 7f3a22e55740 1 -- 172.21.15.18:0/596196888 shutdown_connections 2024-09-19T10:02:08.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.911+0000 7f3a22e55740 1 --2- 172.21.15.18:0/596196888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0a1370 0x55c28f099850 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.911+0000 7f3a22e55740 1 --2- 172.21.15.18:0/596196888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f099310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.911+0000 7f3a22e55740 1 --2- 172.21.15.18:0/596196888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0965d0 0x55c28f09d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.911+0000 7f3a22e55740 1 -- 172.21.15.18:0/596196888 >> 172.21.15.18:0/596196888 conn(0x55c28f05f310 msgr2=0x55c28f08da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:08.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.912+0000 7f3a22e55740 1 -- 172.21.15.18:0/596196888 shutdown_connections 2024-09-19T10:02:08.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.912+0000 7f3a22e55740 1 -- 172.21.15.18:0/596196888 wait complete. 2024-09-19T10:02:08.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.913+0000 7f3a22e55740 1 -- start start 2024-09-19T10:02:08.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.913+0000 7f3a22e55740 1 Processor -- start 2024-09-19T10:02:08.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.915+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0965d0 0x55c28f0a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.915+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f0a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.916+0000 7f3a22e55740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0a9e70 0x55c28f09a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.916+0000 7f3a22e55740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc00f660 con 0x55c28f097b40 2024-09-19T10:02:08.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.917+0000 7f3a22e55740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc00ef90 con 0x55c28f0965d0 2024-09-19T10:02:08.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.917+0000 7f3a22e55740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc00c280 con 0x55c28f0a9e70 2024-09-19T10:02:08.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.918+0000 7f3a22e55740 10 client.0 _ll_register_callbacks cb 0x7f3a1c06b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.919+0000 7f3a19d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f0a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.919+0000 7f3a19d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f0a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57110/0 (socket says 172.21.15.18:57110) 2024-09-19T10:02:08.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.919+0000 7f3a19d9b640 1 -- 172.21.15.18:0/2518248770 learned_addr learned my addr 172.21.15.18:0/2518248770 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:08.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.921+0000 7f3a19d9b640 1 -- 172.21.15.18:0/2518248770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0a9e70 msgr2=0x55c28f09a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:08.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.921+0000 7f3a19d9b640 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0a9e70 0x55c28f09a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.921+0000 7f3a19d9b640 1 -- 172.21.15.18:0/2518248770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0965d0 msgr2=0x55c28f0a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:08.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.921+0000 7f3a19d9b640 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0965d0 0x55c28f0a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.921+0000 7f3a19d9b640 1 -- 172.21.15.18:0/2518248770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c28f09a850 con 0x55c28f097b40 2024-09-19T10:02:08.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.924+0000 7f3a19d9b640 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f0a9930 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009850 tx=0x7f3a10003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d85e78d2e32c7c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:08.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.924+0000 7f3a01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:08.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.925+0000 7f3a01ffb640 1 -- 172.21.15.18:0/2518248770 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1004c020 con 0x55c28f097b40 2024-09-19T10:02:08.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.925+0000 7f3a22e55740 1 -- 172.21.15.18:0/2518248770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c28f003d70 con 0x55c28f097b40 2024-09-19T10:02:08.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.926+0000 7f3a01ffb640 1 -- 172.21.15.18:0/2518248770 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3a10031c90 con 0x55c28f097b40 2024-09-19T10:02:08.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.927+0000 7f3a01ffb640 1 -- 172.21.15.18:0/2518248770 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a10035040 con 0x55c28f097b40 2024-09-19T10:02:08.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.927+0000 7f3a22e55740 10 client.17673 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:08.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.927+0000 7f3a22e55740 1 -- 172.21.15.18:0/2518248770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c28f11b890 con 0x55c28f097b40 2024-09-19T10:02:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.929+0000 7f3a01ffb640 1 -- 172.21.15.18:0/2518248770 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c28f003d70 con 0x55c28f097b40 2024-09-19T10:02:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.929+0000 7f3a01ffb640 1 -- 172.21.15.18:0/2518248770 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3a1003a040 con 0x55c28f097b40 2024-09-19T10:02:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.929+0000 7f3a22e55740 10 client.17673 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.929+0000 7f3a22e55740 10 client.17673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.929+0000 7f3a22e55740 20 client.17673 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.929+0000 7f3a22e55740 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c28f11c090 0x55c28f11e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.929+0000 7f3a22e55740 4 client.17673 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:02:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.929+0000 7f3a22e55740 1 -- 172.21.15.18:0/2518248770 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c28ef80170 con 0x55c28f11c090 2024-09-19T10:02:08.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.939+0000 7f3a1a59c640 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c28f11c090 0x55c28f11e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:08.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.953+0000 7f3a1a59c640 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c28f11c090 0x55c28f11e4d0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b388a2ded0d9f6cf server_cookie=980850afb3b3ca5e in_seq=0 out_seq=0 2024-09-19T10:02:08.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.953+0000 7f3a01ffb640 10 client.17673 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:08.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.963+0000 7f3a01ffb640 1 -- 172.21.15.18:0/2518248770 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c28ef80170 con 0x55c28f11c090 2024-09-19T10:02:08.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.963+0000 7f3a01ffb640 10 client.17673 handle_command_reply: tid=0 2024-09-19T10:02:08.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.963+0000 7f3a22e55740 1 client.17673 shutdown 2024-09-19T10:02:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.965+0000 7f3a22e55740 1 -- 172.21.15.18:0/2518248770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 msgr2=0x55c28f0a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.965+0000 7f3a22e55740 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f0a9930 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009850 tx=0x7f3a10003d20 comp rx=0 tx=0).stop 2024-09-19T10:02:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.965+0000 7f3a22e55740 1 -- 172.21.15.18:0/2518248770 shutdown_connections 2024-09-19T10:02:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.965+0000 7f3a22e55740 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c28f11c090 0x55c28f11e4d0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.965+0000 7f3a22e55740 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c28f0a9e70 0x55c28f09a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.965+0000 7f3a22e55740 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c28f097b40 0x55c28f0a9930 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.965+0000 7f3a22e55740 1 --2- 172.21.15.18:0/2518248770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c28f0965d0 0x55c28f0a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.965+0000 7f3a22e55740 1 -- 172.21.15.18:0/2518248770 >> 172.21.15.18:0/2518248770 conn(0x55c28f05f310 msgr2=0x55c28f0992f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.966+0000 7f3a01ffb640 0 client.17673 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:08.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.967+0000 7f3a22e55740 1 -- 172.21.15.18:0/2518248770 shutdown_connections 2024-09-19T10:02:08.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.967+0000 7f3a22e55740 1 -- 172.21.15.18:0/2518248770 wait complete. 2024-09-19T10:02:08.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.967+0000 7f3a22e55740 20 client.17673 trim_cache size 0 max 16384 2024-09-19T10:02:08.975 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:02:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.971+0000 7f3a20a7c640 1 -- 172.21.15.18:0/637374770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3a040a3480 msgr2=0x7f3a040a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.971+0000 7f3a20a7c640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3a040a3480 0x7f3a040a5940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3a1002aa80 tx=0x7f3a10005fd0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.971+0000 7f3a20a7c640 1 -- 172.21.15.18:0/637374770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c100b40 msgr2=0x7f3a1c10f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.971+0000 7f3a20a7c640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c100b40 0x7f3a1c10f000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c02d4a0 tx=0x7f3a0c02d960 comp rx=0 tx=0).stop 2024-09-19T10:02:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.972+0000 7f3a20a7c640 1 -- 172.21.15.18:0/637374770 shutdown_connections 2024-09-19T10:02:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.972+0000 7f3a20a7c640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3a040a3480 0x7f3a040a5940 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.972+0000 7f3a20a7c640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a1c105f50 0x7f3a1c107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.972+0000 7f3a20a7c640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a1c101460 0x7f3a1c106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.972+0000 7f3a20a7c640 1 --2- 172.21.15.18:0/637374770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c100b40 0x7f3a1c10f000 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.972+0000 7f3a20a7c640 1 -- 172.21.15.18:0/637374770 >> 172.21.15.18:0/637374770 conn(0x7f3a1c0fc7d0 msgr2=0x7f3a1c10f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.973+0000 7f3a20a7c640 1 -- 172.21.15.18:0/637374770 shutdown_connections 2024-09-19T10:02:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:08.973+0000 7f3a20a7c640 1 -- 172.21.15.18:0/637374770 wait complete. 2024-09-19T10:02:09.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:08 smithi049 ceph-mon[34858]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 772 MiB/s wr, 1.79k op/s 2024-09-19T10:02:09.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:08 smithi162 ceph-mon[35174]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 772 MiB/s wr, 1.79k op/s 2024-09-19T10:02:10.388 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:09 smithi018 ceph-mon[30956]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 822 MiB/s wr, 1.86k op/s 2024-09-19T10:02:10.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:09 smithi049 ceph-mon[34858]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 822 MiB/s wr, 1.86k op/s 2024-09-19T10:02:10.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:09 smithi162 ceph-mon[35174]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 822 MiB/s wr, 1.86k op/s 2024-09-19T10:02:10.828 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T10:02:10.828 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T10:02:11.790 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.907+0000 7f10285e8640 1 -- 172.21.15.18:0/404203507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180a4570 msgr2=0x7f10180a4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.907+0000 7f10285e8640 1 --2- 172.21.15.18:0/404203507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180a4570 0x7f10180a4970 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1020067960 tx=0x7f102008e4c0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.908+0000 7f10285e8640 1 -- 172.21.15.18:0/404203507 shutdown_connections 2024-09-19T10:02:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.908+0000 7f10285e8640 1 --2- 172.21.15.18:0/404203507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10180a6060 0x7f10180aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.908+0000 7f10285e8640 1 --2- 172.21.15.18:0/404203507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10180a56a0 0x7f10180a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.908+0000 7f10285e8640 1 --2- 172.21.15.18:0/404203507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180a4570 0x7f10180a4970 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.908+0000 7f10285e8640 1 -- 172.21.15.18:0/404203507 >> 172.21.15.18:0/404203507 conn(0x7f101809fbd0 msgr2=0x7f10180a2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.911+0000 7f10285e8640 1 -- 172.21.15.18:0/404203507 shutdown_connections 2024-09-19T10:02:11.915 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.911+0000 7f10285e8640 1 -- 172.21.15.18:0/404203507 wait complete. 2024-09-19T10:02:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.912+0000 7f10285e8640 1 Processor -- start 2024-09-19T10:02:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.912+0000 7f10285e8640 1 -- start start 2024-09-19T10:02:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.912+0000 7f10285e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10180a4570 0x7f1018142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.912+0000 7f10285e8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180a56a0 0x7f1018143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.912+0000 7f10285e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10180a6060 0x7f101800b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.912+0000 7f10285e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10180b88e0 con 0x7f10180a4570 2024-09-19T10:02:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.912+0000 7f10285e8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f10180b8760 con 0x7f10180a56a0 2024-09-19T10:02:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.912+0000 7f10285e8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10180b8a60 con 0x7f10180a6060 2024-09-19T10:02:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.913+0000 7f1026b85640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10180a6060 0x7f101800b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.913+0000 7f1026b85640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10180a6060 0x7f101800b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:40692/0 (socket says 172.21.15.18:40692) 2024-09-19T10:02:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.913+0000 7f1026b85640 1 -- 172.21.15.18:0/3790899465 learned_addr learned my addr 172.21.15.18:0/3790899465 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.913+0000 7f1026b85640 1 -- 172.21.15.18:0/3790899465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180a56a0 msgr2=0x7f1018143470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T10:02:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.913+0000 7f1026b85640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180a56a0 0x7f1018143470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.913+0000 7f1026b85640 1 -- 172.21.15.18:0/3790899465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10180a4570 msgr2=0x7f1018142f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T10:02:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.913+0000 7f1026b85640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10180a4570 0x7f1018142f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.913+0000 7f1026b85640 1 -- 172.21.15.18:0/3790899465 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101800beb0 con 0x7f10180a6060 2024-09-19T10:02:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.913+0000 7f1026b85640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10180a6060 0x7f101800b810 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f101c00d750 tx=0x7f101c00dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.922+0000 7f10177fe640 1 -- 172.21.15.18:0/3790899465 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c017070 con 0x7f10180a6060 2024-09-19T10:02:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.922+0000 7f10177fe640 1 -- 172.21.15.18:0/3790899465 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f101c005500 con 0x7f10180a6060 2024-09-19T10:02:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.922+0000 7f10177fe640 1 -- 172.21.15.18:0/3790899465 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c004d60 con 0x7f10180a6060 2024-09-19T10:02:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.926+0000 7f10285e8640 1 -- 172.21.15.18:0/3790899465 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101800c1a0 con 0x7f10180a6060 2024-09-19T10:02:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.927+0000 7f10285e8640 1 -- 172.21.15.18:0/3790899465 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101800c6a0 con 0x7f10180a6060 2024-09-19T10:02:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.932+0000 7f102b460740 1 Processor -- start 2024-09-19T10:02:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.934+0000 7f10177fe640 1 -- 172.21.15.18:0/3790899465 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f101c010460 con 0x7f10180a6060 2024-09-19T10:02:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.934+0000 7f102b460740 1 -- start start 2024-09-19T10:02:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.935+0000 7f10177fe640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f100c0a33a0 0x7f100c0a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.936+0000 7f10177fe640 1 -- 172.21.15.18:0/3790899465 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f101c0d0250 con 0x7f10180a6060 2024-09-19T10:02:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.936+0000 7f102b460740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1763db70 0x562d1763df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.937+0000 7f102b460740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763e4b0 0x562d17642f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.937+0000 7f102b460740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d17643540 0x562d17645a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.937+0000 7f102b460740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d175a12f0 con 0x562d1763db70 2024-09-19T10:02:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.937+0000 7f102b460740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562d17549270 con 0x562d17643540 2024-09-19T10:02:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.937+0000 7f102b460740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562d1759d2b0 con 0x562d1763e4b0 2024-09-19T10:02:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.946+0000 7f1026b85640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d17643540 0x562d17645a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:11.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.946+0000 7f1026b85640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d17643540 0x562d17645a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55736/0 (socket says 172.21.15.18:55736) 2024-09-19T10:02:11.949 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.946+0000 7f1026b85640 1 -- 172.21.15.18:0/3035979238 learned_addr learned my addr 172.21.15.18:0/3035979238 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.947+0000 7f1026b85640 1 -- 172.21.15.18:0/3035979238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763e4b0 msgr2=0x562d17642f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:02:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.947+0000 7f1026b85640 1 --2- 172.21.15.18:0/3035979238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763e4b0 0x562d17642f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.947+0000 7f1026b85640 1 -- 172.21.15.18:0/3035979238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1763db70 msgr2=0x562d1763df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.947+0000 7f1026b85640 1 --2- 172.21.15.18:0/3035979238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1763db70 0x562d1763df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.947+0000 7f1026b85640 1 -- 172.21.15.18:0/3035979238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d17548340 con 0x562d17643540 2024-09-19T10:02:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.948+0000 7f1025b83640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f100c0a33a0 0x7f100c0a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.948+0000 7f1026b85640 1 --2- 172.21.15.18:0/3035979238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d17643540 0x562d17645a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f101c099270 tx=0x7f101c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca2e25d60ed0f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.949+0000 7f1014bfe640 1 -- 172.21.15.18:0/3035979238 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c0b5070 con 0x562d17643540 2024-09-19T10:02:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.949+0000 7f1014bfe640 1 -- 172.21.15.18:0/3035979238 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f101c0a5510 con 0x562d17643540 2024-09-19T10:02:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.950+0000 7f102b460740 1 -- 172.21.15.18:0/3035979238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d17643540 msgr2=0x562d17645a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:11.963 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.950+0000 7f102b460740 1 --2- 172.21.15.18:0/3035979238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d17643540 0x562d17645a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f101c099270 tx=0x7f101c009bd0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.960+0000 7f102b460740 1 -- 172.21.15.18:0/3035979238 shutdown_connections 2024-09-19T10:02:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.960+0000 7f102b460740 1 --2- 172.21.15.18:0/3035979238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d17643540 0x562d17645a00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.960+0000 7f102b460740 1 --2- 172.21.15.18:0/3035979238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763e4b0 0x562d17642f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.960+0000 7f102b460740 1 --2- 172.21.15.18:0/3035979238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1763db70 0x562d1763df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.964 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.960+0000 7f102b460740 1 -- 172.21.15.18:0/3035979238 >> 172.21.15.18:0/3035979238 conn(0x562d176391e0 msgr2=0x562d176395e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:11.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.968+0000 7f102b460740 1 -- 172.21.15.18:0/3035979238 shutdown_connections 2024-09-19T10:02:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.968+0000 7f102b460740 1 -- 172.21.15.18:0/3035979238 wait complete. 2024-09-19T10:02:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.971+0000 7f102b460740 1 -- start start 2024-09-19T10:02:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.972+0000 7f102b460740 1 Processor -- start 2024-09-19T10:02:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.972+0000 7f102b460740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1763db70 0x562d17658de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.973+0000 7f102b460740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d17659320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.973+0000 7f102b460740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1765e350 0x562d17660740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.973+0000 7f102b460740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d17657570 con 0x562d1763db70 2024-09-19T10:02:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.973+0000 7f102b460740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562d1752a290 con 0x562d1763e4b0 2024-09-19T10:02:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.973+0000 7f102b460740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562d176576f0 con 0x562d1765e350 2024-09-19T10:02:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.973+0000 7f102b460740 10 client.0 _ll_register_callbacks cb 0x562d1755b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.975+0000 7f1026384640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1763db70 0x562d17658de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.976+0000 7f1026b85640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1765e350 0x562d17660740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.976+0000 7f1026b85640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1765e350 0x562d17660740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:40700/0 (socket says 172.21.15.18:40700) 2024-09-19T10:02:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.976+0000 7f1026b85640 1 -- 172.21.15.18:0/513587037 learned_addr learned my addr 172.21.15.18:0/513587037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.977+0000 7f1025b83640 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d17659320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.981+0000 7f1026384640 1 -- 172.21.15.18:0/513587037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1765e350 msgr2=0x562d17660740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.981+0000 7f1026384640 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1765e350 0x562d17660740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.981+0000 7f1026384640 1 -- 172.21.15.18:0/513587037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 msgr2=0x562d17659320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.982+0000 7f1026384640 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d17659320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.982+0000 7f1026384640 1 -- 172.21.15.18:0/513587037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d172b4210 con 0x562d1763db70 2024-09-19T10:02:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.983+0000 7f1025b83640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f100c0a33a0 0x7f100c0a5860 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x562d1763eee0 tx=0x7f1010005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.983+0000 7f1026384640 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1763db70 0x562d17658de0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f10200506f0 tx=0x7f1020095460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b35dd9f8dfb5e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.984+0000 7f1009ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.985+0000 7f1009ffb640 1 -- 172.21.15.18:0/513587037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200a8060 con 0x562d1763db70 2024-09-19T10:02:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.985+0000 7f102b460740 1 -- 172.21.15.18:0/513587037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d175aea20 con 0x562d1763db70 2024-09-19T10:02:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.985+0000 7f1009ffb640 1 -- 172.21.15.18:0/513587037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1020063250 con 0x562d1763db70 2024-09-19T10:02:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.986+0000 7f1009ffb640 1 -- 172.21.15.18:0/513587037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1020063450 con 0x562d1763db70 2024-09-19T10:02:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.986+0000 7f102b460740 10 client.17679 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.986+0000 7f102b460740 1 -- 172.21.15.18:0/513587037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d17380620 con 0x562d1763db70 2024-09-19T10:02:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.987+0000 7f1009ffb640 1 -- 172.21.15.18:0/513587037 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562d175aea20 con 0x562d1763db70 2024-09-19T10:02:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.987+0000 7f1009ffb640 1 -- 172.21.15.18:0/513587037 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1020062c20 con 0x562d1763db70 2024-09-19T10:02:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.987+0000 7f102b460740 10 client.17679 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.987+0000 7f102b460740 10 client.17679 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.987+0000 7f102b460740 20 client.17679 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.988+0000 7f102b460740 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d176491f0 0x562d1764b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.988+0000 7f102b460740 4 client.17679 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.988+0000 7f102b460740 1 -- 172.21.15.18:0/513587037 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d175a8d70 con 0x562d176491f0 2024-09-19T10:02:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.988+0000 7f1025b83640 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d176491f0 0x562d1764b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.990+0000 7f1025b83640 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d176491f0 0x562d1764b630 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba8431bb0fabdd90 server_cookie=2875e7de07bc4cf9 in_seq=0 out_seq=0 2024-09-19T10:02:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:11.990+0000 7f1009ffb640 10 client.17679 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.009+0000 7f1009ffb640 1 -- 172.21.15.18:0/513587037 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d175a8d70 con 0x562d176491f0 2024-09-19T10:02:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.009+0000 7f1009ffb640 10 client.17679 handle_command_reply: tid=0 2024-09-19T10:02:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.009+0000 7f102b460740 1 client.17679 shutdown 2024-09-19T10:02:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.010+0000 7f102b460740 1 -- 172.21.15.18:0/513587037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1763db70 msgr2=0x562d17658de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.010+0000 7f102b460740 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1763db70 0x562d17658de0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f10200506f0 tx=0x7f1020095460 comp rx=0 tx=0).stop 2024-09-19T10:02:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.010+0000 7f102b460740 1 -- 172.21.15.18:0/513587037 shutdown_connections 2024-09-19T10:02:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.010+0000 7f102b460740 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d176491f0 0x562d1764b630 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.010+0000 7f102b460740 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1765e350 0x562d17660740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.010+0000 7f102b460740 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d17659320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.010+0000 7f102b460740 1 --2- 172.21.15.18:0/513587037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1763db70 0x562d17658de0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.010+0000 7f102b460740 1 -- 172.21.15.18:0/513587037 >> 172.21.15.18:0/513587037 conn(0x562d176391e0 msgr2=0x562d1763aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.010+0000 7f1009ffb640 0 client.17679 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.010+0000 7f102b460740 1 -- 172.21.15.18:0/513587037 shutdown_connections 2024-09-19T10:02:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.011+0000 7f102b460740 1 -- 172.21.15.18:0/513587037 wait complete. 2024-09-19T10:02:12.017 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.012+0000 7f102b460740 20 client.17679 trim_cache size 0 max 16384 2024-09-19T10:02:12.103 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.100+0000 7f102b460740 1 Processor -- start 2024-09-19T10:02:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.100+0000 7f102b460740 1 -- start start 2024-09-19T10:02:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.108+0000 7f102b460740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d17658b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.109+0000 7f102b460740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d176590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.110+0000 7f1026384640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d17658b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.110+0000 7f1026384640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d17658b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:40714/0 (socket says 172.21.15.18:40714) 2024-09-19T10:02:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.110+0000 7f1026384640 1 -- 172.21.15.18:0/2220381102 learned_addr learned my addr 172.21.15.18:0/2220381102 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.110+0000 7f102b460740 1 --2- 172.21.15.18:0/2220381102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1765e350 0x562d17637a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.111+0000 7f102b460740 1 -- 172.21.15.18:0/2220381102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f101800cd50 con 0x562d1765e350 2024-09-19T10:02:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.111+0000 7f102b460740 1 -- 172.21.15.18:0/2220381102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f101800e890 con 0x562d1763e4b0 2024-09-19T10:02:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.111+0000 7f102b460740 1 -- 172.21.15.18:0/2220381102 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f101800d420 con 0x562d1763db70 2024-09-19T10:02:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.112+0000 7f1026384640 1 -- 172.21.15.18:0/2220381102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 msgr2=0x562d176590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.112+0000 7f1026384640 1 --2- 172.21.15.18:0/2220381102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d176590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.112+0000 7f1026384640 1 -- 172.21.15.18:0/2220381102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1765e350 msgr2=0x562d17637a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.112+0000 7f1026384640 1 --2- 172.21.15.18:0/2220381102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1765e350 0x562d17637a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.112+0000 7f1026384640 1 -- 172.21.15.18:0/2220381102 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d176432e0 con 0x562d1763db70 2024-09-19T10:02:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.119+0000 7f1026384640 1 --2- 172.21.15.18:0/2220381102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d17658b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1020067f00 tx=0x7f10200635f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd248c5e806851bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.121+0000 7f100bfff640 1 -- 172.21.15.18:0/2220381102 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200a8040 con 0x562d1763db70 2024-09-19T10:02:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.121+0000 7f100bfff640 1 -- 172.21.15.18:0/2220381102 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f102009c040 con 0x562d1763db70 2024-09-19T10:02:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.122+0000 7f100bfff640 1 -- 172.21.15.18:0/2220381102 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020095a40 con 0x562d1763db70 2024-09-19T10:02:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.123+0000 7f102b460740 1 -- 172.21.15.18:0/2220381102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 msgr2=0x562d17658b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.123+0000 7f102b460740 1 --2- 172.21.15.18:0/2220381102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d17658b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1020067f00 tx=0x7f10200635f0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.124+0000 7f102b460740 1 -- 172.21.15.18:0/2220381102 shutdown_connections 2024-09-19T10:02:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.124+0000 7f102b460740 1 --2- 172.21.15.18:0/2220381102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1765e350 0x562d17637a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.124+0000 7f102b460740 1 --2- 172.21.15.18:0/2220381102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d176590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.124+0000 7f102b460740 1 --2- 172.21.15.18:0/2220381102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d17658b90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.124+0000 7f102b460740 1 -- 172.21.15.18:0/2220381102 >> 172.21.15.18:0/2220381102 conn(0x562d176391e0 msgr2=0x562d1763f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.137+0000 7f102b460740 1 -- 172.21.15.18:0/2220381102 shutdown_connections 2024-09-19T10:02:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.137+0000 7f102b460740 1 -- 172.21.15.18:0/2220381102 wait complete. 2024-09-19T10:02:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.138+0000 7f102b460740 1 -- start start 2024-09-19T10:02:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.139+0000 7f102b460740 1 Processor -- start 2024-09-19T10:02:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.141+0000 7f102b460740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d1764ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.141+0000 7f102b460740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d1764f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.141+0000 7f102b460740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1765e350 0x562d176500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.142+0000 7f102b460740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f101800e1c0 con 0x562d1765e350 2024-09-19T10:02:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.142+0000 7f1026b85640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1765e350 0x562d176500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.143+0000 7f1026b85640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1765e350 0x562d176500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57170/0 (socket says 172.21.15.18:57170) 2024-09-19T10:02:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.143+0000 7f1026b85640 1 -- 172.21.15.18:0/3041738185 learned_addr learned my addr 172.21.15.18:0/3041738185 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:12.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.144+0000 7f1025b83640 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d1764f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.149 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.144+0000 7f1026384640 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d1764ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.157+0000 7f102b460740 1 -- 172.21.15.18:0/3041738185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f101800daf0 con 0x562d1763e4b0 2024-09-19T10:02:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.157+0000 7f102b460740 1 -- 172.21.15.18:0/3041738185 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10180b2d00 con 0x562d1763db70 2024-09-19T10:02:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.158+0000 7f102b460740 10 client.0 _ll_register_callbacks cb 0x7f1010005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.167+0000 7f1026384640 1 -- 172.21.15.18:0/3041738185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 msgr2=0x562d1764f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.167+0000 7f1026384640 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d1764f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.167+0000 7f1026384640 1 -- 172.21.15.18:0/3041738185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1765e350 msgr2=0x562d176500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.167+0000 7f1026384640 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1765e350 0x562d176500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.167+0000 7f1026384640 1 -- 172.21.15.18:0/3041738185 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d176506e0 con 0x562d1763db70 2024-09-19T10:02:12.184 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.181+0000 7f1026384640 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d1764ebf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1020067f00 tx=0x7f1020068340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d5a63c9fd31f89f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.202+0000 7f1009ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:02:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.202+0000 7f1009ffb640 1 -- 172.21.15.18:0/3041738185 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200a8070 con 0x562d1763db70 2024-09-19T10:02:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.203+0000 7f102b460740 1 -- 172.21.15.18:0/3041738185 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f102009c040 con 0x562d1763db70 2024-09-19T10:02:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.203+0000 7f1009ffb640 1 -- 172.21.15.18:0/3041738185 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f10200b5040 con 0x562d1763db70 2024-09-19T10:02:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.204+0000 7f1009ffb640 1 -- 172.21.15.18:0/3041738185 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1020050ea0 con 0x562d1763db70 2024-09-19T10:02:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.204+0000 7f102b460740 10 client.27172 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.204+0000 7f102b460740 1 -- 172.21.15.18:0/3041738185 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d176519f0 con 0x562d1763db70 2024-09-19T10:02:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.211+0000 7f1009ffb640 1 -- 172.21.15.18:0/3041738185 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10200bd020 con 0x562d1763db70 2024-09-19T10:02:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.211+0000 7f1009ffb640 1 -- 172.21.15.18:0/3041738185 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1020062740 con 0x562d1763db70 2024-09-19T10:02:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.211+0000 7f102b460740 10 client.27172 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.211+0000 7f102b460740 10 client.27172 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.211+0000 7f102b460740 20 client.27172 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.211+0000 7f102b460740 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d176e0790 0x562d176e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.211+0000 7f102b460740 4 client.27172 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:02:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.211+0000 7f102b460740 1 -- 172.21.15.18:0/3041738185 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f102009c040 con 0x562d176e0790 2024-09-19T10:02:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.213+0000 7f1025b83640 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d176e0790 0x562d176e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.215+0000 7f1025b83640 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d176e0790 0x562d176e2bb0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80f46b14d974c13e server_cookie=42b6dd20dc04d7ec in_seq=0 out_seq=0 2024-09-19T10:02:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:12.216+0000 7f1009ffb640 10 client.27172 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:12.425 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:12 smithi018 ceph-mon[30956]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 767 MiB/s wr, 1.73k op/s 2024-09-19T10:02:12.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:12 smithi049 ceph-mon[34858]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 767 MiB/s wr, 1.73k op/s 2024-09-19T10:02:12.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:12 smithi162 ceph-mon[35174]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 767 MiB/s wr, 1.73k op/s 2024-09-19T10:02:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.819+0000 7fcbc5728640 1 -- 172.21.15.18:0/485888689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbb809c6c0 msgr2=0x7fcbb809caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.819+0000 7fcbc5728640 1 --2- 172.21.15.18:0/485888689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbb809c6c0 0x7fcbb809caa0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009890 tx=0x7fcbb402a3b0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.820+0000 7fcbc5728640 1 -- 172.21.15.18:0/485888689 shutdown_connections 2024-09-19T10:02:12.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.820+0000 7fcbc5728640 1 --2- 172.21.15.18:0/485888689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb80a0f40 0x7fcbb80a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.820+0000 7fcbc5728640 1 --2- 172.21.15.18:0/485888689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb809d070 0x7fcbb80a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.820+0000 7fcbc5728640 1 --2- 172.21.15.18:0/485888689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbb809c6c0 0x7fcbb809caa0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.820+0000 7fcbc5728640 1 -- 172.21.15.18:0/485888689 >> 172.21.15.18:0/485888689 conn(0x7fcbb8009f30 msgr2=0x7fcbb800a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:12.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.820+0000 7fcbc5728640 1 -- 172.21.15.18:0/485888689 shutdown_connections 2024-09-19T10:02:12.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.821+0000 7fcbc5728640 1 -- 172.21.15.18:0/485888689 wait complete. 2024-09-19T10:02:12.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.822+0000 7fcbc5728640 1 Processor -- start 2024-09-19T10:02:12.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.822+0000 7fcbc5728640 1 -- start start 2024-09-19T10:02:12.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.823+0000 7fcbc5728640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbb809c6c0 0x7fcbb81434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.823+0000 7fcbc5728640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb809d070 0x7fcbb81439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.823+0000 7fcbc5728640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb80a0f40 0x7fcbb8147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.823+0000 7fcbc5728640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb80abfb0 con 0x7fcbb809c6c0 2024-09-19T10:02:12.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.823+0000 7fcbc5728640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb80abe30 con 0x7fcbb80a0f40 2024-09-19T10:02:12.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.823+0000 7fcbc5728640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb80ac130 con 0x7fcbb809d070 2024-09-19T10:02:12.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.824+0000 7fcbbffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbb809c6c0 0x7fcbb81434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.824+0000 7fcbbffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbb809c6c0 0x7fcbb81434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57186/0 (socket says 172.21.15.18:57186) 2024-09-19T10:02:12.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.824+0000 7fcbbffff640 1 -- 172.21.15.18:0/4062086990 learned_addr learned my addr 172.21.15.18:0/4062086990 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:12.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.825+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb80a0f40 0x7fcbb8147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.826+0000 7fcbbf7fe640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb809d070 0x7fcbb81439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.827+0000 7fcbc4f27640 1 -- 172.21.15.18:0/4062086990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb809d070 msgr2=0x7fcbb81439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:12.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.827+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb809d070 0x7fcbb81439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.827+0000 7fcbc4f27640 1 -- 172.21.15.18:0/4062086990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbb809c6c0 msgr2=0x7fcbb81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:12.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.827+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbb809c6c0 0x7fcbb81434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.827+0000 7fcbc4f27640 1 -- 172.21.15.18:0/4062086990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb8148470 con 0x7fcbb80a0f40 2024-09-19T10:02:12.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.827+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb80a0f40 0x7fcbb8147d70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00d610 tx=0x7fcbac00dad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:12.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.828+0000 7fcbbd7fa640 1 -- 172.21.15.18:0/4062086990 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac005220 con 0x7fcbb80a0f40 2024-09-19T10:02:12.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.828+0000 7fcbbd7fa640 1 -- 172.21.15.18:0/4062086990 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbac004c80 con 0x7fcbb80a0f40 2024-09-19T10:02:12.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.828+0000 7fcbbd7fa640 1 -- 172.21.15.18:0/4062086990 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac009db0 con 0x7fcbb80a0f40 2024-09-19T10:02:12.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.831+0000 7fcbc5728640 1 -- 172.21.15.18:0/4062086990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb8148760 con 0x7fcbb80a0f40 2024-09-19T10:02:12.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.831+0000 7fcbc5728640 1 -- 172.21.15.18:0/4062086990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb800ce70 con 0x7fcbb80a0f40 2024-09-19T10:02:12.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.839+0000 7fcbc8d63740 1 Processor -- start 2024-09-19T10:02:12.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.847+0000 7fcbc8d63740 1 -- start start 2024-09-19T10:02:12.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.847+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3ed70 0x564b3ba3f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.847+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba3f690 0x564b3ba49a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.847+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba49f50 0x564b3ba4c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.847+0000 7fcbc8d63740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564b3b9a4280 con 0x564b3ba3ed70 2024-09-19T10:02:12.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.847+0000 7fcbc8d63740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564b3b94bb10 con 0x564b3ba49f50 2024-09-19T10:02:12.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.847+0000 7fcbc8d63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564b3b9a0240 con 0x564b3ba3f690 2024-09-19T10:02:12.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.849+0000 7fcbbf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3ed70 0x564b3ba3f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.849+0000 7fcbbf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3ed70 0x564b3ba3f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57198/0 (socket says 172.21.15.18:57198) 2024-09-19T10:02:12.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.849+0000 7fcbbf7fe640 1 -- 172.21.15.18:0/882514441 learned_addr learned my addr 172.21.15.18:0/882514441 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:12.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.850+0000 7fcbbf7fe640 1 -- 172.21.15.18:0/882514441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba3f690 msgr2=0x564b3ba49a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:02:12.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.850+0000 7fcbbf7fe640 1 --2- 172.21.15.18:0/882514441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba3f690 0x564b3ba49a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.850+0000 7fcbbf7fe640 1 -- 172.21.15.18:0/882514441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba49f50 msgr2=0x564b3ba4c340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:02:12.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.850+0000 7fcbbf7fe640 1 --2- 172.21.15.18:0/882514441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba49f50 0x564b3ba4c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.850+0000 7fcbbf7fe640 1 -- 172.21.15.18:0/882514441 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b3b9581f0 con 0x564b3ba3ed70 2024-09-19T10:02:12.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.852+0000 7fcbbf7fe640 1 --2- 172.21.15.18:0/882514441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3ed70 0x564b3ba3f150 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0067960 tx=0x7fcbc00691c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cc51251a961e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:12.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.854+0000 7fcbbd7fa640 1 -- 172.21.15.18:0/4062086990 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcbac0046c0 con 0x7fcbb80a0f40 2024-09-19T10:02:12.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.856+0000 7fcbbd7fa640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcbb00a33a0 0x7fcbb00a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.857+0000 7fcbbd7fa640 1 -- 172.21.15.18:0/4062086990 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcbac0cf960 con 0x7fcbb80a0f40 2024-09-19T10:02:12.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.860+0000 7fcbbffff640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcbb00a33a0 0x7fcbb00a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.860+0000 7fcbaa7fc640 1 -- 172.21.15.18:0/882514441 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc006fc80 con 0x564b3ba3ed70 2024-09-19T10:02:12.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.860+0000 7fcbaa7fc640 1 -- 172.21.15.18:0/882514441 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbc006fe20 con 0x564b3ba3ed70 2024-09-19T10:02:12.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.862+0000 7fcbc8d63740 1 -- 172.21.15.18:0/882514441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3ed70 msgr2=0x564b3ba3f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:12.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.862+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/882514441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3ed70 0x564b3ba3f150 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0067960 tx=0x7fcbc00691c0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.862+0000 7fcbc8d63740 1 -- 172.21.15.18:0/882514441 shutdown_connections 2024-09-19T10:02:12.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.862+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/882514441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba49f50 0x564b3ba4c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.862+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/882514441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba3f690 0x564b3ba49a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.862+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/882514441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3ed70 0x564b3ba3f150 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.862+0000 7fcbc8d63740 1 -- 172.21.15.18:0/882514441 >> 172.21.15.18:0/882514441 conn(0x564b3ba3b300 msgr2=0x564b3ba3b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.862+0000 7fcbc8d63740 1 -- 172.21.15.18:0/882514441 shutdown_connections 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.863+0000 7fcbc8d63740 1 -- 172.21.15.18:0/882514441 wait complete. 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.863+0000 7fcbc8d63740 1 -- start start 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.863+0000 7fcbc8d63740 1 Processor -- start 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.864+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba3f690 0x564b3ba499e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.864+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba49f50 0x564b3ba46c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.865+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba47380 0x564b3ba56060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.865+0000 7fcbc8d63740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564b3ba4cb70 con 0x564b3ba49f50 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.865+0000 7fcbc8d63740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564b3b95ef10 con 0x564b3ba47380 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.865+0000 7fcbc8d63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564b3ba4ccf0 con 0x564b3ba3f690 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.865+0000 7fcbc8d63740 10 client.0 _ll_register_callbacks cb 0x564b3b927a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:12.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.865+0000 7fcbc4f27640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba47380 0x564b3ba56060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.865+0000 7fcbc4f27640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba47380 0x564b3ba56060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55794/0 (socket says 172.21.15.18:55794) 2024-09-19T10:02:12.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.865+0000 7fcbc4f27640 1 -- 172.21.15.18:0/48026327 learned_addr learned my addr 172.21.15.18:0/48026327 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.866+0000 7fcbc4f27640 1 -- 172.21.15.18:0/48026327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba3f690 msgr2=0x564b3ba499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.866+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba3f690 0x564b3ba499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.866+0000 7fcbc4f27640 1 -- 172.21.15.18:0/48026327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba49f50 msgr2=0x564b3ba46c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.866+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba49f50 0x564b3ba46c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.866+0000 7fcbc4f27640 1 -- 172.21.15.18:0/48026327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b3b7156a0 con 0x564b3ba47380 2024-09-19T10:02:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.867+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba47380 0x564b3ba56060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009780 tx=0x7fcbac004ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8944c747dfddcb29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.867+0000 7fcb9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:02:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.867+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/48026327 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac020050 con 0x564b3ba47380 2024-09-19T10:02:12.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.867+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/48026327 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcbac0049b0 con 0x564b3ba47380 2024-09-19T10:02:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.870+0000 7fcbc8d63740 1 -- 172.21.15.18:0/48026327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564b3b9b17f0 con 0x564b3ba47380 2024-09-19T10:02:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.871+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/48026327 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcbac0a0390 con 0x564b3ba47380 2024-09-19T10:02:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.871+0000 7fcbc8d63740 10 client.27152 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:12.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.871+0000 7fcbc8d63740 1 -- 172.21.15.18:0/48026327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b3ba58bc0 con 0x564b3ba47380 2024-09-19T10:02:12.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.873+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/48026327 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564b3b9b17f0 con 0x564b3ba47380 2024-09-19T10:02:12.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.873+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/48026327 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcbac019070 con 0x564b3ba47380 2024-09-19T10:02:12.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.873+0000 7fcbc8d63740 10 client.27152 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:12.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.873+0000 7fcbc8d63740 10 client.27152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:12.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.873+0000 7fcbc8d63740 20 client.27152 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:12.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.873+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564b3ba5a080 0x564b3ba5c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.873+0000 7fcbc8d63740 4 client.27152 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:12.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.873+0000 7fcbc8d63740 1 -- 172.21.15.18:0/48026327 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b3b9abd00 con 0x564b3ba5a080 2024-09-19T10:02:12.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.880+0000 7fcbbffff640 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564b3ba5a080 0x564b3ba5c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.881+0000 7fcbbffff640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcbb00a33a0 0x7fcbb00a5860 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcbb402a920 tx=0x7fcbb402c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.882+0000 7fcbbffff640 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564b3ba5a080 0x564b3ba5c4d0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b57b041a68ab8681 server_cookie=f9be5b4499be8342 in_seq=0 out_seq=0 2024-09-19T10:02:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.883+0000 7fcb9f7fe640 10 client.27152 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:12.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.888+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/48026327 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b3b9abd00 con 0x564b3ba5a080 2024-09-19T10:02:12.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.888+0000 7fcb9f7fe640 10 client.27152 handle_command_reply: tid=0 2024-09-19T10:02:12.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.888+0000 7fcbc8d63740 1 client.27152 shutdown 2024-09-19T10:02:12.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.889+0000 7fcbc8d63740 1 -- 172.21.15.18:0/48026327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba47380 msgr2=0x564b3ba56060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:12.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.889+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba47380 0x564b3ba56060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009780 tx=0x7fcbac004ef0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.889+0000 7fcbc8d63740 1 -- 172.21.15.18:0/48026327 shutdown_connections 2024-09-19T10:02:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.889+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564b3ba5a080 0x564b3ba5c4d0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.889+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba47380 0x564b3ba56060 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.889+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba49f50 0x564b3ba46c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.889+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/48026327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba3f690 0x564b3ba499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.889+0000 7fcbc8d63740 1 -- 172.21.15.18:0/48026327 >> 172.21.15.18:0/48026327 conn(0x564b3ba3b300 msgr2=0x564b3ba40860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.889+0000 7fcb9f7fe640 0 client.27152 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.890+0000 7fcbc8d63740 1 -- 172.21.15.18:0/48026327 shutdown_connections 2024-09-19T10:02:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.890+0000 7fcbc8d63740 1 -- 172.21.15.18:0/48026327 wait complete. 2024-09-19T10:02:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.890+0000 7fcbc8d63740 20 client.27152 trim_cache size 0 max 16384 2024-09-19T10:02:12.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.946+0000 7fcbc8d63740 1 Processor -- start 2024-09-19T10:02:12.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.947+0000 7fcbc8d63740 1 -- start start 2024-09-19T10:02:12.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.948+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3f690 0x564b3ba55e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.949+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 0x564b3ba56390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.949+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba49f50 0x564b3ba46550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.950+0000 7fcbc8d63740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb80153d0 con 0x564b3ba3f690 2024-09-19T10:02:12.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.952+0000 7fcbbffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3f690 0x564b3ba55e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.953+0000 7fcbbffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3f690 0x564b3ba55e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57210/0 (socket says 172.21.15.18:57210) 2024-09-19T10:02:12.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.953+0000 7fcbbffff640 1 -- 172.21.15.18:0/1044173397 learned_addr learned my addr 172.21.15.18:0/1044173397 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:12.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.957+0000 7fcbbf7fe640 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 0x564b3ba56390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.957+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba49f50 0x564b3ba46550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.957+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1044173397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb81628d0 con 0x564b3ba49f50 2024-09-19T10:02:12.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.957+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1044173397 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb8161460 con 0x564b3ba47380 2024-09-19T10:02:12.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.960+0000 7fcbc4f27640 1 -- 172.21.15.18:0/1044173397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 msgr2=0x564b3ba56390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:12.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.960+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 0x564b3ba56390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.960+0000 7fcbc4f27640 1 -- 172.21.15.18:0/1044173397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3f690 msgr2=0x564b3ba55e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:12.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.960+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3f690 0x564b3ba55e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.960+0000 7fcbc4f27640 1 -- 172.21.15.18:0/1044173397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b3ba3bf00 con 0x564b3ba49f50 2024-09-19T10:02:12.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.961+0000 7fcbbffff640 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3f690 0x564b3ba55e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:02:12.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.961+0000 7fcbbf7fe640 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 0x564b3ba56390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:02:12.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.964+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba49f50 0x564b3ba46550 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0a4930 tx=0x7fcbac0097d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b456368e3efe22a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.966+0000 7fcba9ffb640 1 -- 172.21.15.18:0/1044173397 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac07e030 con 0x564b3ba49f50 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.966+0000 7fcba9ffb640 1 -- 172.21.15.18:0/1044173397 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbac005790 con 0x564b3ba49f50 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.966+0000 7fcba9ffb640 1 -- 172.21.15.18:0/1044173397 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac020050 con 0x564b3ba49f50 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.967+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1044173397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba49f50 msgr2=0x564b3ba46550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.967+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba49f50 0x564b3ba46550 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0a4930 tx=0x7fcbac0097d0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.968+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1044173397 shutdown_connections 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.968+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba49f50 0x564b3ba46550 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.968+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 0x564b3ba56390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.968+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/1044173397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba3f690 0x564b3ba55e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.968+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1044173397 >> 172.21.15.18:0/1044173397 conn(0x564b3ba3b300 msgr2=0x564b3ba45560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.968+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1044173397 shutdown_connections 2024-09-19T10:02:12.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.968+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1044173397 wait complete. 2024-09-19T10:02:12.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.970+0000 7fcbc8d63740 1 -- start start 2024-09-19T10:02:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.971+0000 7fcbc8d63740 1 Processor -- start 2024-09-19T10:02:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.972+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba3f690 0x564b3ba527f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.973+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 0x564b3ba4ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.973+0000 7fcbc8d63740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba4b310 0x564b3ba4b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.973+0000 7fcbc8d63740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb8162200 con 0x564b3ba4b310 2024-09-19T10:02:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.973+0000 7fcbc8d63740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb8161b30 con 0x564b3ba3f690 2024-09-19T10:02:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.973+0000 7fcbbf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 0x564b3ba4ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.973+0000 7fcbbf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 0x564b3ba4ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:40754/0 (socket says 172.21.15.18:40754) 2024-09-19T10:02:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.973+0000 7fcbbf7fe640 1 -- 172.21.15.18:0/1098682966 learned_addr learned my addr 172.21.15.18:0/1098682966 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.974+0000 7fcbbffff640 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba3f690 0x564b3ba527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.974+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1098682966 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb809caa0 con 0x564b3ba47380 2024-09-19T10:02:12.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.974+0000 7fcbc8d63740 10 client.0 _ll_register_callbacks cb 0x7fcbac0096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:12.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.979+0000 7fcbc4f27640 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba4b310 0x564b3ba4b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:12.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.982+0000 7fcbbffff640 1 -- 172.21.15.18:0/1098682966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 msgr2=0x564b3ba4ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:12.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.982+0000 7fcbbffff640 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 0x564b3ba4ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.982+0000 7fcbbffff640 1 -- 172.21.15.18:0/1098682966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba4b310 msgr2=0x564b3ba4b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:12.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.982+0000 7fcbbffff640 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba4b310 0x564b3ba4b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:12.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.982+0000 7fcbbffff640 1 -- 172.21.15.18:0/1098682966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b3ba504e0 con 0x564b3ba3f690 2024-09-19T10:02:12.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.995+0000 7fcbbffff640 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba3f690 0x564b3ba527f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcbb402c010 tx=0x7fcbb4005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a010d1ab6029cdce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.996+0000 7fcb9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:02:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.997+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/1098682966 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4058060 con 0x564b3ba3f690 2024-09-19T10:02:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.998+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1098682966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbac005790 con 0x564b3ba3f690 2024-09-19T10:02:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:12.998+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/1098682966 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcbb4005030 con 0x564b3ba3f690 2024-09-19T10:02:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.000+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/1098682966 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcbb4045040 con 0x564b3ba3f690 2024-09-19T10:02:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.000+0000 7fcbc8d63740 10 client.27158 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.000+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1098682966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b3bac5200 con 0x564b3ba3f690 2024-09-19T10:02:13.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.002+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/1098682966 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbac005790 con 0x564b3ba3f690 2024-09-19T10:02:13.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.004+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/1098682966 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcbb40035f0 con 0x564b3ba3f690 2024-09-19T10:02:13.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.005+0000 7fcbc8d63740 10 client.27158 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:13.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.005+0000 7fcbc8d63740 10 client.27158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:13.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.005+0000 7fcbc8d63740 20 client.27158 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:13.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.005+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564b3bac58b0 0x564b3bac7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:13.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.005+0000 7fcbc8d63740 4 client.27158 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T10:02:13.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.005+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1098682966 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564b3ba5c860 con 0x564b3bac58b0 2024-09-19T10:02:13.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.008+0000 7fcbbf7fe640 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564b3bac58b0 0x564b3bac7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:13.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.017+0000 7fcbbf7fe640 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564b3bac58b0 0x564b3bac7cd0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f6554f36dc597ee server_cookie=46a81402eed4a0f1 in_seq=0 out_seq=0 2024-09-19T10:02:13.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.017+0000 7fcb9f7fe640 10 client.27158 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.900+0000 7fcb9f7fe640 1 -- 172.21.15.18:0/1098682966 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564b3ba5c860 con 0x564b3bac58b0 2024-09-19T10:02:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.900+0000 7fcb9f7fe640 10 client.27158 handle_command_reply: tid=0 2024-09-19T10:02:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.900+0000 7fcbc8d63740 1 client.27158 shutdown 2024-09-19T10:02:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.900+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1098682966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba3f690 msgr2=0x564b3ba527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.900+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba3f690 0x564b3ba527f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcbb402c010 tx=0x7fcbb4005f90 comp rx=0 tx=0).stop 2024-09-19T10:02:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.901+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1098682966 shutdown_connections 2024-09-19T10:02:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.901+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x564b3bac58b0 0x564b3bac7cd0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.901+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564b3ba4b310 0x564b3ba4b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.901+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b3ba47380 0x564b3ba4ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.901+0000 7fcbc8d63740 1 --2- 172.21.15.18:0/1098682966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564b3ba3f690 0x564b3ba527f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.901+0000 7fcb9f7fe640 0 client.27158 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.901+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1098682966 >> 172.21.15.18:0/1098682966 conn(0x564b3ba3b300 msgr2=0x564b3ba407c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.901+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1098682966 shutdown_connections 2024-09-19T10:02:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.901+0000 7fcbc8d63740 1 -- 172.21.15.18:0/1098682966 wait complete. 2024-09-19T10:02:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.901+0000 7fcbc8d63740 20 client.27158 trim_cache size 0 max 16384 2024-09-19T10:02:13.906 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:02:13.907 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T10:02:13.907 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "6f904d41-02f9-4180-bda1-239f21e9772a", 2024-09-19T10:02:13.907 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T10:02:13.907 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.902+0000 7fcbc5728640 1 -- 172.21.15.18:0/4062086990 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcbb00a33a0 msgr2=0x7fcbb00a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.902+0000 7fcbc5728640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcbb00a33a0 0x7fcbb00a5860 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcbb402a920 tx=0x7fcbb402c040 comp rx=0 tx=0).stop 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.902+0000 7fcbc5728640 1 -- 172.21.15.18:0/4062086990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb80a0f40 msgr2=0x7fcbb8147d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.902+0000 7fcbc5728640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb80a0f40 0x7fcbb8147d70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00d610 tx=0x7fcbac00dad0 comp rx=0 tx=0).stop 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.902+0000 7fcbc5728640 1 -- 172.21.15.18:0/4062086990 shutdown_connections 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.902+0000 7fcbc5728640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcbb00a33a0 0x7fcbb00a5860 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.902+0000 7fcbc5728640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbb80a0f40 0x7fcbb8147d70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.902+0000 7fcbc5728640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb809d070 0x7fcbb81439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.903+0000 7fcbc5728640 1 --2- 172.21.15.18:0/4062086990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbb809c6c0 0x7fcbb81434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.903+0000 7fcbc5728640 1 -- 172.21.15.18:0/4062086990 >> 172.21.15.18:0/4062086990 conn(0x7fcbb8009f30 msgr2=0x7fcbb809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.903+0000 7fcbc5728640 1 -- 172.21.15.18:0/4062086990 shutdown_connections 2024-09-19T10:02:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:13.903+0000 7fcbc5728640 1 -- 172.21.15.18:0/4062086990 wait complete. 2024-09-19T10:02:14.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:14 smithi018 ceph-mon[30956]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 885 MiB/s wr, 1.82k op/s 2024-09-19T10:02:14.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:14 smithi049 ceph-mon[34858]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 885 MiB/s wr, 1.82k op/s 2024-09-19T10:02:14.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:14 smithi162 ceph-mon[35174]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 885 MiB/s wr, 1.82k op/s 2024-09-19T10:02:14.907 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T10:02:15.641 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:15 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T10:02:15.641 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:15 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T10:02:15.642 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:15 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T10:02:15.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:15 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T10:02:15.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:15 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T10:02:15.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:15 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T10:02:15.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:15 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T10:02:15.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:15 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T10:02:15.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:15 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T10:02:15.948 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:16.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.758+0000 7efc728f5640 1 -- 172.21.15.18:0/2495812150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c100e20 msgr2=0x7efc6c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:16.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.758+0000 7efc728f5640 1 --2- 172.21.15.18:0/2495812150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c100e20 0x7efc6c101200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009930 tx=0x7efc5c02a4d0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.758+0000 7efc728f5640 1 -- 172.21.15.18:0/2495812150 shutdown_connections 2024-09-19T10:02:16.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.758+0000 7efc728f5640 1 --2- 172.21.15.18:0/2495812150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc6c102ef0 0x7efc6c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.758+0000 7efc728f5640 1 --2- 172.21.15.18:0/2495812150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c102570 0x7efc6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.758+0000 7efc728f5640 1 --2- 172.21.15.18:0/2495812150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c100e20 0x7efc6c101200 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.758+0000 7efc728f5640 1 -- 172.21.15.18:0/2495812150 >> 172.21.15.18:0/2495812150 conn(0x7efc6c0fc7d0 msgr2=0x7efc6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.758+0000 7efc728f5640 1 -- 172.21.15.18:0/2495812150 shutdown_connections 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.758+0000 7efc728f5640 1 -- 172.21.15.18:0/2495812150 wait complete. 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.760+0000 7efc728f5640 1 Processor -- start 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.760+0000 7efc728f5640 1 -- start start 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.761+0000 7efc728f5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c100e20 0x7efc6c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.761+0000 7efc728f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc6c102570 0x7efc6c19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.761+0000 7efc728f5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c102ef0 0x7efc6c19f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.761+0000 7efc728f5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c111010 con 0x7efc6c100e20 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.761+0000 7efc728f5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c110e90 con 0x7efc6c102ef0 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.761+0000 7efc728f5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c111190 con 0x7efc6c102570 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.764+0000 7efc70e92640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c102ef0 0x7efc6c19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.764+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc6c102570 0x7efc6c19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.764+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc6c102570 0x7efc6c19ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41424/0 (socket says 172.21.15.18:41424) 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.764+0000 7efc6b7fe640 1 -- 172.21.15.18:0/917770212 learned_addr learned my addr 172.21.15.18:0/917770212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.764+0000 7efc70e92640 1 -- 172.21.15.18:0/917770212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc6c102570 msgr2=0x7efc6c19ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.765+0000 7efc70e92640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc6c102570 0x7efc6c19ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.765+0000 7efc70e92640 1 -- 172.21.15.18:0/917770212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c100e20 msgr2=0x7efc6c19a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.765+0000 7efc70e92640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c100e20 0x7efc6c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.765+0000 7efc70e92640 1 -- 172.21.15.18:0/917770212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c19f6e0 con 0x7efc6c102ef0 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.765+0000 7efc70e92640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c102ef0 0x7efc6c19f000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efc64009fd0 tx=0x7efc6400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.766+0000 7efc697fa640 1 -- 172.21.15.18:0/917770212 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6400ce20 con 0x7efc6c102ef0 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.766+0000 7efc728f5640 1 -- 172.21.15.18:0/917770212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6c19f9d0 con 0x7efc6c102ef0 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.766+0000 7efc728f5640 1 -- 172.21.15.18:0/917770212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6c1a72b0 con 0x7efc6c102ef0 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.767+0000 7efc697fa640 1 -- 172.21.15.18:0/917770212 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc64005020 con 0x7efc6c102ef0 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.768+0000 7efc697fa640 1 -- 172.21.15.18:0/917770212 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64010720 con 0x7efc6c102ef0 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.772+0000 7efc74cce740 1 Processor -- start 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.774+0000 7efc697fa640 1 -- 172.21.15.18:0/917770212 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efc64004a00 con 0x7efc6c102ef0 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.774+0000 7efc74cce740 1 -- start start 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.775+0000 7efc74cce740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 0x555c32283720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.775+0000 7efc74cce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283c60 0x555c3229f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.775+0000 7efc74cce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 0x555c322a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.775+0000 7efc74cce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555c321e92e0 con 0x555c32283c60 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.775+0000 7efc74cce740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555c32190ce0 con 0x555c32283340 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.775+0000 7efc74cce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555c321e52a0 con 0x555c3229f690 2024-09-19T10:02:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.778+0000 7efc697fa640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efc540a3240 0x7efc540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.781+0000 7efc697fa640 1 -- 172.21.15.18:0/917770212 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efc640cfdc0 con 0x7efc6c102ef0 2024-09-19T10:02:16.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.782+0000 7efc70e92640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efc540a3240 0x7efc540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.783+0000 7efc70e92640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efc540a3240 0x7efc540a5700 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc64098de0 tx=0x7efc64098040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:16.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.785+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 0x555c32283720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.785+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 0x555c32283720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:57998/0 (socket says 172.21.15.18:57998) 2024-09-19T10:02:16.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.785+0000 7efc6b7fe640 1 -- 172.21.15.18:0/869329146 learned_addr learned my addr 172.21.15.18:0/869329146 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:16.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.791+0000 7efc6bfff640 1 --2- 172.21.15.18:0/869329146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283c60 0x555c3229f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.791+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/869329146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 0x555c322a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.796+0000 7efc6b7fe640 1 -- 172.21.15.18:0/869329146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 msgr2=0x555c322a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.796+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/869329146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 0x555c322a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.796+0000 7efc6b7fe640 1 -- 172.21.15.18:0/869329146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283c60 msgr2=0x555c3229f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.796+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/869329146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283c60 0x555c3229f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.796+0000 7efc6b7fe640 1 -- 172.21.15.18:0/869329146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c32175440 con 0x555c32283340 2024-09-19T10:02:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.803+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/869329146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 0x555c32283720 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efc60007fd0 tx=0x7efc60007220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efac6f9a84f81a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:16.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.805+0000 7efc527fc640 1 -- 172.21.15.18:0/869329146 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60014850 con 0x555c32283340 2024-09-19T10:02:16.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.805+0000 7efc527fc640 1 -- 172.21.15.18:0/869329146 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc60010040 con 0x555c32283340 2024-09-19T10:02:16.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.806+0000 7efc74cce740 1 -- 172.21.15.18:0/869329146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 msgr2=0x555c32283720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:16.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.806+0000 7efc74cce740 1 --2- 172.21.15.18:0/869329146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 0x555c32283720 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efc60007fd0 tx=0x7efc60007220 comp rx=0 tx=0).stop 2024-09-19T10:02:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.810+0000 7efc74cce740 1 -- 172.21.15.18:0/869329146 shutdown_connections 2024-09-19T10:02:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.810+0000 7efc74cce740 1 --2- 172.21.15.18:0/869329146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 0x555c322a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.810+0000 7efc74cce740 1 --2- 172.21.15.18:0/869329146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283c60 0x555c3229f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.810+0000 7efc74cce740 1 --2- 172.21.15.18:0/869329146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 0x555c32283720 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.810+0000 7efc74cce740 1 -- 172.21.15.18:0/869329146 >> 172.21.15.18:0/869329146 conn(0x555c3227fa30 msgr2=0x555c3227fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.811+0000 7efc74cce740 1 -- 172.21.15.18:0/869329146 shutdown_connections 2024-09-19T10:02:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.811+0000 7efc74cce740 1 -- 172.21.15.18:0/869329146 wait complete. 2024-09-19T10:02:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.811+0000 7efc74cce740 1 -- start start 2024-09-19T10:02:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.812+0000 7efc74cce740 1 Processor -- start 2024-09-19T10:02:16.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.812+0000 7efc74cce740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 0x555c3229eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.812+0000 7efc74cce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283c60 0x555c3229c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.812+0000 7efc74cce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 0x555c3229c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.812+0000 7efc74cce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555c322a22b0 con 0x555c32283c60 2024-09-19T10:02:16.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.812+0000 7efc74cce740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555c321a4050 con 0x555c32283340 2024-09-19T10:02:16.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.812+0000 7efc74cce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555c322a2430 con 0x555c3229f690 2024-09-19T10:02:16.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.812+0000 7efc74cce740 10 client.0 _ll_register_callbacks cb 0x555c321e4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:16.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.817+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 0x555c3229c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.817+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 0x555c3229c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41448/0 (socket says 172.21.15.18:41448) 2024-09-19T10:02:16.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.817+0000 7efc6b7fe640 1 -- 172.21.15.18:0/4081958090 learned_addr learned my addr 172.21.15.18:0/4081958090 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:16.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.817+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 0x555c3229eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.817+0000 7efc6b7fe640 1 -- 172.21.15.18:0/4081958090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 msgr2=0x555c3229eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:16.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.817+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 0x555c3229eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.817+0000 7efc6b7fe640 1 -- 172.21.15.18:0/4081958090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283c60 msgr2=0x555c3229c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:16.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.817+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283c60 0x555c3229c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.817+0000 7efc6b7fe640 1 -- 172.21.15.18:0/4081958090 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c31f5a3c0 con 0x555c3229f690 2024-09-19T10:02:16.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.818+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 0x555c3229c6e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efc600071e0 tx=0x7efc600187d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba4ecbb5ad07d0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:16.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.818+0000 7efc4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:02:16.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.818+0000 7efc4b7fe640 1 -- 172.21.15.18:0/4081958090 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60014850 con 0x555c3229f690 2024-09-19T10:02:16.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.818+0000 7efc74cce740 1 -- 172.21.15.18:0/4081958090 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc60010040 con 0x555c3229f690 2024-09-19T10:02:16.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.819+0000 7efc4b7fe640 1 -- 172.21.15.18:0/4081958090 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efc600149f0 con 0x555c3229f690 2024-09-19T10:02:16.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.819+0000 7efc4b7fe640 1 -- 172.21.15.18:0/4081958090 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efc60014bf0 con 0x555c3229f690 2024-09-19T10:02:16.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.819+0000 7efc74cce740 10 client.27190 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:16.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.819+0000 7efc74cce740 1 -- 172.21.15.18:0/4081958090 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c322b64d0 con 0x555c3229f690 2024-09-19T10:02:16.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.819+0000 7efc4b7fe640 1 -- 172.21.15.18:0/4081958090 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc60010040 con 0x555c3229f690 2024-09-19T10:02:16.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.821+0000 7efc4b7fe640 1 -- 172.21.15.18:0/4081958090 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efc60006420 con 0x555c3229f690 2024-09-19T10:02:16.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.821+0000 7efc74cce740 10 client.27190 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:16.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.821+0000 7efc74cce740 10 client.27190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:16.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.821+0000 7efc74cce740 20 client.27190 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:16.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.821+0000 7efc74cce740 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555c322b7a70 0x555c322b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.821+0000 7efc74cce740 4 client.27190 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:16.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.821+0000 7efc74cce740 1 -- 172.21.15.18:0/4081958090 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c321f6850 con 0x555c322b7a70 2024-09-19T10:02:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.825+0000 7efc6bfff640 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555c322b7a70 0x555c322b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.832+0000 7efc6bfff640 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555c322b7a70 0x555c322b9ec0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76a7398e5ecc50a5 server_cookie=f6e2c6efe95e20c1 in_seq=0 out_seq=0 2024-09-19T10:02:16.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.832+0000 7efc4b7fe640 10 client.27190 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:16.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.836+0000 7efc4b7fe640 1 -- 172.21.15.18:0/4081958090 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c321f6850 con 0x555c322b7a70 2024-09-19T10:02:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.836+0000 7efc4b7fe640 10 client.27190 handle_command_reply: tid=0 2024-09-19T10:02:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.836+0000 7efc74cce740 1 client.27190 shutdown 2024-09-19T10:02:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.837+0000 7efc74cce740 1 -- 172.21.15.18:0/4081958090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 msgr2=0x555c3229c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.837+0000 7efc74cce740 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 0x555c3229c6e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efc600071e0 tx=0x7efc600187d0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.837+0000 7efc74cce740 1 -- 172.21.15.18:0/4081958090 shutdown_connections 2024-09-19T10:02:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.837+0000 7efc74cce740 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555c322b7a70 0x555c322b9ec0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.837+0000 7efc74cce740 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3229f690 0x555c3229c6e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.837+0000 7efc74cce740 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283c60 0x555c3229c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.837+0000 7efc74cce740 1 --2- 172.21.15.18:0/4081958090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283340 0x555c3229eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.837+0000 7efc74cce740 1 -- 172.21.15.18:0/4081958090 >> 172.21.15.18:0/4081958090 conn(0x555c3227fa30 msgr2=0x555c32285790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:16.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.838+0000 7efc4b7fe640 0 client.27190 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:16.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.838+0000 7efc74cce740 1 -- 172.21.15.18:0/4081958090 shutdown_connections 2024-09-19T10:02:16.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.838+0000 7efc74cce740 1 -- 172.21.15.18:0/4081958090 wait complete. 2024-09-19T10:02:16.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.840+0000 7efc74cce740 20 client.27190 trim_cache size 0 max 16384 2024-09-19T10:02:16.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.906+0000 7efc74cce740 1 Processor -- start 2024-09-19T10:02:16.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.909+0000 7efc74cce740 1 -- start start 2024-09-19T10:02:16.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.910+0000 7efc74cce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3227fa30 0x555c3229aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.910+0000 7efc74cce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283340 0x555c3229e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.910+0000 7efc74cce740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283c60 0x555c322bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.910+0000 7efc74cce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc5800e330 con 0x555c32283340 2024-09-19T10:02:16.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.910+0000 7efc74cce740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efc5800fe70 con 0x555c32283c60 2024-09-19T10:02:16.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.910+0000 7efc74cce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc5800ea00 con 0x555c3227fa30 2024-09-19T10:02:16.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.911+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283c60 0x555c322bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.911+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283c60 0x555c322bf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:58020/0 (socket says 172.21.15.18:58020) 2024-09-19T10:02:16.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.911+0000 7efc6b7fe640 1 -- 172.21.15.18:0/2727007454 learned_addr learned my addr 172.21.15.18:0/2727007454 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:16.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.912+0000 7efc6bfff640 1 --2- 172.21.15.18:0/2727007454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283340 0x555c3229e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.917 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:16 smithi018 ceph-mon[30956]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 843 MiB/s wr, 1.50k op/s 2024-09-19T10:02:16.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.912+0000 7efc6bfff640 1 -- 172.21.15.18:0/2727007454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3227fa30 msgr2=0x555c3229aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:16.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.912+0000 7efc6bfff640 1 --2- 172.21.15.18:0/2727007454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3227fa30 0x555c3229aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.912+0000 7efc6bfff640 1 -- 172.21.15.18:0/2727007454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283c60 msgr2=0x555c322bf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:16.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.912+0000 7efc6bfff640 1 --2- 172.21.15.18:0/2727007454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283c60 0x555c322bf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.912+0000 7efc6bfff640 1 -- 172.21.15.18:0/2727007454 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c3229b150 con 0x555c32283340 2024-09-19T10:02:16.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.913+0000 7efc6bfff640 1 --2- 172.21.15.18:0/2727007454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283340 0x555c3229e110 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7efc5c02aac0 tx=0x7efc5c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690b6281b0b471ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:16.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.914+0000 7efc51ffb640 1 -- 172.21.15.18:0/2727007454 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c047020 con 0x555c32283340 2024-09-19T10:02:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.915+0000 7efc51ffb640 1 -- 172.21.15.18:0/2727007454 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc5c005520 con 0x555c32283340 2024-09-19T10:02:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.916+0000 7efc74cce740 1 -- 172.21.15.18:0/2727007454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283340 msgr2=0x555c3229e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.916+0000 7efc74cce740 1 --2- 172.21.15.18:0/2727007454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283340 0x555c3229e110 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7efc5c02aac0 tx=0x7efc5c005e50 comp rx=0 tx=0).stop 2024-09-19T10:02:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.916+0000 7efc74cce740 1 -- 172.21.15.18:0/2727007454 shutdown_connections 2024-09-19T10:02:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.916+0000 7efc74cce740 1 --2- 172.21.15.18:0/2727007454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c32283c60 0x555c322bf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.916+0000 7efc74cce740 1 --2- 172.21.15.18:0/2727007454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c32283340 0x555c3229e110 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.916+0000 7efc74cce740 1 --2- 172.21.15.18:0/2727007454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c3227fa30 0x555c3229aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.916+0000 7efc74cce740 1 -- 172.21.15.18:0/2727007454 >> 172.21.15.18:0/2727007454 conn(0x555c3229c840 msgr2=0x555c3229da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.917+0000 7efc74cce740 1 -- 172.21.15.18:0/2727007454 shutdown_connections 2024-09-19T10:02:16.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.917+0000 7efc74cce740 1 -- 172.21.15.18:0/2727007454 wait complete. 2024-09-19T10:02:16.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.917+0000 7efc74cce740 1 -- start start 2024-09-19T10:02:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.920+0000 7efc74cce740 1 Processor -- start 2024-09-19T10:02:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.921+0000 7efc74cce740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c3227fa30 0x555c322a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.921+0000 7efc74cce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c32283c60 0x555c32298e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.921+0000 7efc74cce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c3229f690 0x555c32299390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.921+0000 7efc74cce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc5800f7a0 con 0x555c3229f690 2024-09-19T10:02:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.921+0000 7efc74cce740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efc5800f0d0 con 0x555c3227fa30 2024-09-19T10:02:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.921+0000 7efc74cce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc5800c3c0 con 0x555c32283c60 2024-09-19T10:02:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.922+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c3227fa30 0x555c322a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.922+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c3227fa30 0x555c322a7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:58030/0 (socket says 172.21.15.18:58030) 2024-09-19T10:02:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.922+0000 7efc6b7fe640 1 -- 172.21.15.18:0/3379811598 learned_addr learned my addr 172.21.15.18:0/3379811598 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.922+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c3229f690 0x555c32299390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.923+0000 7efc6bfff640 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c32283c60 0x555c32298e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.923+0000 7efc74cce740 10 client.0 _ll_register_callbacks cb 0x7efc640093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.924+0000 7efc6bfff640 1 -- 172.21.15.18:0/3379811598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c3227fa30 msgr2=0x555c322a7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.924+0000 7efc6bfff640 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c3227fa30 0x555c322a7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.924+0000 7efc6bfff640 1 -- 172.21.15.18:0/3379811598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c3229f690 msgr2=0x555c32299390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.924+0000 7efc6bfff640 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c3229f690 0x555c32299390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.924+0000 7efc6bfff640 1 -- 172.21.15.18:0/3379811598 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c32299b70 con 0x555c32283c60 2024-09-19T10:02:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.926+0000 7efc6bfff640 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c32283c60 0x555c32298e50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x555c3227f920 tx=0x7efc5c005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98e17cbc9404ec59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.927+0000 7efc4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:02:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.929+0000 7efc4b7fe640 1 -- 172.21.15.18:0/3379811598 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c0042a0 con 0x555c32283c60 2024-09-19T10:02:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.929+0000 7efc74cce740 1 -- 172.21.15.18:0/3379811598 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c321f0d60 con 0x555c32283c60 2024-09-19T10:02:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.929+0000 7efc4b7fe640 1 -- 172.21.15.18:0/3379811598 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efc5c004440 con 0x555c32283c60 2024-09-19T10:02:16.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.930+0000 7efc4b7fe640 1 -- 172.21.15.18:0/3379811598 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efc5c0315b0 con 0x555c32283c60 2024-09-19T10:02:16.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.931+0000 7efc74cce740 10 client.27193 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:16.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.931+0000 7efc74cce740 1 -- 172.21.15.18:0/3379811598 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c323227b0 con 0x555c32283c60 2024-09-19T10:02:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.932+0000 7efc4b7fe640 1 -- 172.21.15.18:0/3379811598 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555c321f0d60 con 0x555c32283c60 2024-09-19T10:02:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.932+0000 7efc4b7fe640 1 -- 172.21.15.18:0/3379811598 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efc5c0051d0 con 0x555c32283c60 2024-09-19T10:02:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.932+0000 7efc74cce740 10 client.27193 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.932+0000 7efc74cce740 10 client.27193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.932+0000 7efc74cce740 20 client.27193 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.932+0000 7efc74cce740 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555c32322df0 0x555c32325210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.933+0000 7efc74cce740 4 client.27193 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T10:02:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.933+0000 7efc74cce740 1 -- 172.21.15.18:0/3379811598 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c3216d210 con 0x555c32322df0 2024-09-19T10:02:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.935+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555c32322df0 0x555c32325210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.938+0000 7efc6b7fe640 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555c32322df0 0x555c32325210 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42c0e116fef120b8 server_cookie=67f272eb9ce56d71 in_seq=0 out_seq=0 2024-09-19T10:02:16.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.938+0000 7efc4b7fe640 10 client.27193 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:16.955 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:02:16.955 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "scrub active (13 inodes in the stack)", 2024-09-19T10:02:16.955 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stdout: "6f904d41-02f9-4180-bda1-239f21e9772a": { 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "6f904d41-02f9-4180-bda1-239f21e9772a", 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.942+0000 7efc4b7fe640 1 -- 172.21.15.18:0/3379811598 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x555c3216d210 con 0x555c32322df0 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.942+0000 7efc4b7fe640 10 client.27193 handle_command_reply: tid=0 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.942+0000 7efc74cce740 1 client.27193 shutdown 2024-09-19T10:02:16.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.942+0000 7efc74cce740 1 -- 172.21.15.18:0/3379811598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c32283c60 msgr2=0x555c32298e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.942+0000 7efc74cce740 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c32283c60 0x555c32298e50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x555c3227f920 tx=0x7efc5c005de0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.943+0000 7efc74cce740 1 -- 172.21.15.18:0/3379811598 shutdown_connections 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.943+0000 7efc74cce740 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x555c32322df0 0x555c32325210 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.943+0000 7efc74cce740 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c3229f690 0x555c32299390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.943+0000 7efc74cce740 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555c32283c60 0x555c32298e50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.943+0000 7efc74cce740 1 --2- 172.21.15.18:0/3379811598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555c3227fa30 0x555c322a7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.943+0000 7efc74cce740 1 -- 172.21.15.18:0/3379811598 >> 172.21.15.18:0/3379811598 conn(0x555c3229c840 msgr2=0x555c3227e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.943+0000 7efc4b7fe640 0 client.27193 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.943+0000 7efc74cce740 1 -- 172.21.15.18:0/3379811598 shutdown_connections 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.943+0000 7efc74cce740 1 -- 172.21.15.18:0/3379811598 wait complete. 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.943+0000 7efc74cce740 20 client.27193 trim_cache size 0 max 16384 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.945+0000 7efc728f5640 1 -- 172.21.15.18:0/917770212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efc540a3240 msgr2=0x7efc540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:16.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.945+0000 7efc728f5640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efc540a3240 0x7efc540a5700 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc64098de0 tx=0x7efc64098040 comp rx=0 tx=0).stop 2024-09-19T10:02:16.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.945+0000 7efc728f5640 1 -- 172.21.15.18:0/917770212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c102ef0 msgr2=0x7efc6c19f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:16.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.945+0000 7efc728f5640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c102ef0 0x7efc6c19f000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efc64009fd0 tx=0x7efc6400ef10 comp rx=0 tx=0).stop 2024-09-19T10:02:16.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.945+0000 7efc728f5640 1 -- 172.21.15.18:0/917770212 shutdown_connections 2024-09-19T10:02:16.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.946+0000 7efc728f5640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efc540a3240 0x7efc540a5700 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.946+0000 7efc728f5640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c102ef0 0x7efc6c19f000 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.946+0000 7efc728f5640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc6c102570 0x7efc6c19ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.946+0000 7efc728f5640 1 --2- 172.21.15.18:0/917770212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c100e20 0x7efc6c19a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:16.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.946+0000 7efc728f5640 1 -- 172.21.15.18:0/917770212 >> 172.21.15.18:0/917770212 conn(0x7efc6c0fc7d0 msgr2=0x7efc6c06a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:16.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.946+0000 7efc728f5640 1 -- 172.21.15.18:0/917770212 shutdown_connections 2024-09-19T10:02:16.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:16.946+0000 7efc728f5640 1 -- 172.21.15.18:0/917770212 wait complete. 2024-09-19T10:02:17.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:16 smithi049 ceph-mon[34858]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 843 MiB/s wr, 1.50k op/s 2024-09-19T10:02:17.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:16 smithi162 ceph-mon[35174]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 843 MiB/s wr, 1.50k op/s 2024-09-19T10:02:17.993 INFO:tasks.cephfs.filesystem:scrub status for tag:6f904d41-02f9-4180-bda1-239f21e9772a - {'path': '/', 'tag': '6f904d41-02f9-4180-bda1-239f21e9772a', 'options': 'recursive,force'} 2024-09-19T10:02:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.637+0000 7f1009ffb640 1 -- 172.21.15.18:0/3041738185 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f102009c040 con 0x562d176e0790 2024-09-19T10:02:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.637+0000 7f1009ffb640 10 client.27172 handle_command_reply: tid=0 2024-09-19T10:02:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.637+0000 7f102b460740 1 client.27172 shutdown 2024-09-19T10:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.653+0000 7f102b460740 1 -- 172.21.15.18:0/3041738185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 msgr2=0x562d1764ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.653+0000 7f102b460740 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d1764ebf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1020067f00 tx=0x7f1020068340 comp rx=0 tx=0).stop 2024-09-19T10:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.653+0000 7f102b460740 1 -- 172.21.15.18:0/3041738185 shutdown_connections 2024-09-19T10:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.653+0000 7f102b460740 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562d176e0790 0x562d176e2bb0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.653+0000 7f102b460740 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1765e350 0x562d176500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.653+0000 7f102b460740 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562d1763e4b0 0x562d1764f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.653+0000 7f102b460740 1 --2- 172.21.15.18:0/3041738185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562d1763db70 0x562d1764ebf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.653+0000 7f102b460740 1 -- 172.21.15.18:0/3041738185 >> 172.21.15.18:0/3041738185 conn(0x562d176391e0 msgr2=0x562d17658b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.653+0000 7f1009ffb640 0 client.27172 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.654+0000 7f102b460740 1 -- 172.21.15.18:0/3041738185 shutdown_connections 2024-09-19T10:02:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.655+0000 7f102b460740 1 -- 172.21.15.18:0/3041738185 wait complete. 2024-09-19T10:02:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.655+0000 7f102b460740 20 client.27172 trim_cache size 0 max 16384 2024-09-19T10:02:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:02:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:02:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:02:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:02:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.664+0000 7f10285e8640 1 -- 172.21.15.18:0/3790899465 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f100c0a33a0 msgr2=0x7f100c0a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.664+0000 7f10285e8640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f100c0a33a0 0x7f100c0a5860 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x562d1763eee0 tx=0x7f1010005f90 comp rx=0 tx=0).stop 2024-09-19T10:02:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.664+0000 7f10285e8640 1 -- 172.21.15.18:0/3790899465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10180a6060 msgr2=0x7f101800b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.664+0000 7f10285e8640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10180a6060 0x7f101800b810 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f101c00d750 tx=0x7f101c00dc10 comp rx=0 tx=0).stop 2024-09-19T10:02:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.666+0000 7f10285e8640 1 -- 172.21.15.18:0/3790899465 shutdown_connections 2024-09-19T10:02:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.666+0000 7f10285e8640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f100c0a33a0 0x7f100c0a5860 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.666+0000 7f10285e8640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10180a6060 0x7f101800b810 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.666+0000 7f10285e8640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10180a56a0 0x7f1018143470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.666+0000 7f10285e8640 1 --2- 172.21.15.18:0/3790899465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10180a4570 0x7f1018142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.666+0000 7f10285e8640 1 -- 172.21.15.18:0/3790899465 >> 172.21.15.18:0/3790899465 conn(0x7f101809fbd0 msgr2=0x7f10180a07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.666+0000 7f10285e8640 1 -- 172.21.15.18:0/3790899465 shutdown_connections 2024-09-19T10:02:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:18.666+0000 7f10285e8640 1 -- 172.21.15.18:0/3790899465 wait complete. 2024-09-19T10:02:19.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:18 smithi018 ceph-mon[30956]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 779 MiB/s wr, 1.36k op/s 2024-09-19T10:02:19.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:18 smithi049 ceph-mon[34858]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 779 MiB/s wr, 1.36k op/s 2024-09-19T10:02:19.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:18 smithi162 ceph-mon[35174]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 779 MiB/s wr, 1.36k op/s 2024-09-19T10:02:21.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:20 smithi018 ceph-mon[30956]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 853 MiB/s wr, 1.52k op/s 2024-09-19T10:02:21.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:20 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T10:02:21.137 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:20 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T10:02:21.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:20 smithi049 ceph-mon[34858]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 853 MiB/s wr, 1.52k op/s 2024-09-19T10:02:21.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:20 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T10:02:21.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:20 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T10:02:21.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:20 smithi162 ceph-mon[35174]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 853 MiB/s wr, 1.52k op/s 2024-09-19T10:02:21.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:20 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T10:02:21.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:20 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T10:02:21.731 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T10:02:21.731 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T10:02:21.731 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:02:22.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:22 smithi018 ceph-mon[30956]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 754 MiB/s wr, 1.32k op/s 2024-09-19T10:02:22.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:22 smithi049 ceph-mon[34858]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 754 MiB/s wr, 1.32k op/s 2024-09-19T10:02:22.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:22 smithi162 ceph-mon[35174]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 754 MiB/s wr, 1.32k op/s 2024-09-19T10:02:22.458 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.366+0000 7f223e0ed640 1 -- 172.21.15.18:0/3488002763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22300aa230 msgr2=0x7f22300aa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.366+0000 7f223e0ed640 1 --2- 172.21.15.18:0/3488002763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22300aa230 0x7f22300aa610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f222c009900 tx=0x7f222c02a410 comp rx=0 tx=0).stop 2024-09-19T10:02:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.368+0000 7f223e0ed640 1 -- 172.21.15.18:0/3488002763 shutdown_connections 2024-09-19T10:02:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.368+0000 7f223e0ed640 1 --2- 172.21.15.18:0/3488002763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22300a4d30 0x7f22300a51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.368+0000 7f223e0ed640 1 --2- 172.21.15.18:0/3488002763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22300aab50 0x7f22300a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.368+0000 7f223e0ed640 1 --2- 172.21.15.18:0/3488002763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22300aa230 0x7f22300aa610 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.368+0000 7f223e0ed640 1 -- 172.21.15.18:0/3488002763 >> 172.21.15.18:0/3488002763 conn(0x7f223001a0a0 msgr2=0x7f223001a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.373+0000 7f223e0ed640 1 -- 172.21.15.18:0/3488002763 shutdown_connections 2024-09-19T10:02:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.373+0000 7f223e0ed640 1 -- 172.21.15.18:0/3488002763 wait complete. 2024-09-19T10:02:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.374+0000 7f223e0ed640 1 Processor -- start 2024-09-19T10:02:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.374+0000 7f223e0ed640 1 -- start start 2024-09-19T10:02:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.375+0000 7f223e0ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22300a4d30 0x7f22300ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.375+0000 7f223e0ed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22300aa230 0x7f22300baa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.375+0000 7f223e0ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22300aab50 0x7f22300b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.375+0000 7f223e0ed640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22300bd020 con 0x7f22300aab50 2024-09-19T10:02:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.375+0000 7f223e0ed640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f22300bcea0 con 0x7f22300a4d30 2024-09-19T10:02:23.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.375+0000 7f223e0ed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22300bd1a0 con 0x7f22300aa230 2024-09-19T10:02:23.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.379+0000 7f2236ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22300aa230 0x7f22300baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:23.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.379+0000 7f2236ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22300aa230 0x7f22300baa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41494/0 (socket says 172.21.15.18:41494) 2024-09-19T10:02:23.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.379+0000 7f2236ffd640 1 -- 172.21.15.18:0/519954276 learned_addr learned my addr 172.21.15.18:0/519954276 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:23.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.379+0000 7f22377fe640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22300a4d30 0x7f22300ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:23.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.380+0000 7f2236ffd640 1 -- 172.21.15.18:0/519954276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22300a4d30 msgr2=0x7f22300ba4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:23.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.380+0000 7f2236ffd640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22300a4d30 0x7f22300ba4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.380+0000 7f2236ffd640 1 -- 172.21.15.18:0/519954276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22300aab50 msgr2=0x7f22300b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.380+0000 7f2236ffd640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22300aab50 0x7f22300b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.380+0000 7f2236ffd640 1 -- 172.21.15.18:0/519954276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22300b3f40 con 0x7f22300aa230 2024-09-19T10:02:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.380+0000 7f2236ffd640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22300aa230 0x7f22300baa10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f222400b4a0 tx=0x7f222400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.381+0000 7f2234ff9640 1 -- 172.21.15.18:0/519954276 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2224014070 con 0x7f22300aa230 2024-09-19T10:02:23.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.381+0000 7f223e0ed640 1 -- 172.21.15.18:0/519954276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22300b4230 con 0x7f22300aa230 2024-09-19T10:02:23.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.381+0000 7f223e0ed640 1 -- 172.21.15.18:0/519954276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22300b8220 con 0x7f22300aa230 2024-09-19T10:02:23.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.382+0000 7f2234ff9640 1 -- 172.21.15.18:0/519954276 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2224010af0 con 0x7f22300aa230 2024-09-19T10:02:23.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.382+0000 7f2234ff9640 1 -- 172.21.15.18:0/519954276 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2224017d20 con 0x7f22300aa230 2024-09-19T10:02:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.387+0000 7f2234ff9640 1 -- 172.21.15.18:0/519954276 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2224017070 con 0x7f22300aa230 2024-09-19T10:02:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.388+0000 7f2234ff9640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22280a3390 0x7f22280a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.389+0000 7f2234ff9640 1 -- 172.21.15.18:0/519954276 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f22240ced30 con 0x7f22300aa230 2024-09-19T10:02:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.390+0000 7f22377fe640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22280a3390 0x7f22280a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.399+0000 7f223e0ed640 1 -- 172.21.15.18:0/519954276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221c005290 con 0x7f22300aa230 2024-09-19T10:02:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.401+0000 7f22377fe640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22280a3390 0x7f22280a5850 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f222c009230 tx=0x7f222c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:23.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:23.412+0000 7f2234ff9640 1 -- 172.21.15.18:0/519954276 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f222409ba20 con 0x7f22300aa230 2024-09-19T10:02:24.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.079+0000 7f223e0ed640 1 -- 172.21.15.18:0/519954276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f221c005580 con 0x7f22300aa230 2024-09-19T10:02:24.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.083+0000 7f2234ff9640 1 -- 172.21.15.18:0/519954276 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f222409b320 con 0x7f22300aa230 2024-09-19T10:02:24.087 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:02:24.087 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:02:24.088 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:02:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.090+0000 7f22227fc640 1 -- 172.21.15.18:0/519954276 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22280a3390 msgr2=0x7f22280a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.090+0000 7f22227fc640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22280a3390 0x7f22280a5850 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f222c009230 tx=0x7f222c000bc0 comp rx=0 tx=0).stop 2024-09-19T10:02:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.090+0000 7f22227fc640 1 -- 172.21.15.18:0/519954276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22300aa230 msgr2=0x7f22300baa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.090+0000 7f22227fc640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22300aa230 0x7f22300baa10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f222400b4a0 tx=0x7f222400b960 comp rx=0 tx=0).stop 2024-09-19T10:02:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.090+0000 7f22227fc640 1 -- 172.21.15.18:0/519954276 shutdown_connections 2024-09-19T10:02:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.090+0000 7f22227fc640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22280a3390 0x7f22280a5850 secure :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f222c009230 tx=0x7f222c000bc0 comp rx=0 tx=0).stop 2024-09-19T10:02:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.090+0000 7f22227fc640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22300aab50 0x7f22300b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:24.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.090+0000 7f22227fc640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22300aa230 0x7f22300baa10 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f222400b4a0 tx=0x7f222400b960 comp rx=0 tx=0).stop 2024-09-19T10:02:24.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.090+0000 7f22227fc640 1 --2- 172.21.15.18:0/519954276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22300a4d30 0x7f22300ba4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:24.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.090+0000 7f22227fc640 1 -- 172.21.15.18:0/519954276 >> 172.21.15.18:0/519954276 conn(0x7f223001a0a0 msgr2=0x7f22300a69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:24.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.091+0000 7f22227fc640 1 -- 172.21.15.18:0/519954276 shutdown_connections 2024-09-19T10:02:24.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:24.092+0000 7f22227fc640 1 -- 172.21.15.18:0/519954276 wait complete. 2024-09-19T10:02:24.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:24 smithi018 ceph-mon[30956]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 817 MiB/s wr, 1.59k op/s 2024-09-19T10:02:24.384 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:24 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/519954276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:02:24.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:24 smithi049 ceph-mon[34858]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 817 MiB/s wr, 1.59k op/s 2024-09-19T10:02:24.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:24 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/519954276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:02:24.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:24 smithi162 ceph-mon[35174]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 1.7 MiB/s rd, 817 MiB/s wr, 1.59k op/s 2024-09-19T10:02:24.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:24 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/519954276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:02:25.069 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T10:02:25.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T10:02:25.266 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:25 smithi018 ceph-mon[30956]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 105 GiB used, 968 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 804 MiB/s wr, 1.94k op/s 2024-09-19T10:02:25.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:25 smithi049 ceph-mon[34858]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 105 GiB used, 968 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 804 MiB/s wr, 1.94k op/s 2024-09-19T10:02:25.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:25 smithi162 ceph-mon[35174]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 105 GiB used, 968 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 804 MiB/s wr, 1.94k op/s 2024-09-19T10:02:25.987 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:26.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.883+0000 7f95030b1640 1 -- 172.21.15.18:0/1499023110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94fc06e4f0 msgr2=0x7f94fc06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.883+0000 7f95030b1640 1 --2- 172.21.15.18:0/1499023110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94fc06e4f0 0x7f94fc06e950 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f94f400afd0 tx=0x7f94f40085b0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.883+0000 7f95030b1640 1 -- 172.21.15.18:0/1499023110 shutdown_connections 2024-09-19T10:02:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.883+0000 7f95030b1640 1 --2- 172.21.15.18:0/1499023110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94fc06ee90 0x7f94fc07a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.883+0000 7f95030b1640 1 --2- 172.21.15.18:0/1499023110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94fc06e4f0 0x7f94fc06e950 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.883+0000 7f95030b1640 1 --2- 172.21.15.18:0/1499023110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc10e150 0x7f94fc10e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.883+0000 7f95030b1640 1 -- 172.21.15.18:0/1499023110 >> 172.21.15.18:0/1499023110 conn(0x7f94fc073210 msgr2=0x7f94fc073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.883+0000 7f95030b1640 1 -- 172.21.15.18:0/1499023110 shutdown_connections 2024-09-19T10:02:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.884+0000 7f95030b1640 1 -- 172.21.15.18:0/1499023110 wait complete. 2024-09-19T10:02:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.884+0000 7f95030b1640 1 Processor -- start 2024-09-19T10:02:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.885+0000 7f95030b1640 1 -- start start 2024-09-19T10:02:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.885+0000 7f95030b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc06ee90 0x7f94fc0821e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.885+0000 7f95030b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94fc10e150 0x7f94fc082720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.885+0000 7f95030b1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94fc07d4a0 0x7f94fc07d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.885+0000 7f95030b1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc131ca0 con 0x7f94fc10e150 2024-09-19T10:02:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.885+0000 7f95030b1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc131b20 con 0x7f94fc06ee90 2024-09-19T10:02:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.885+0000 7f95030b1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc131e20 con 0x7f94fc07d4a0 2024-09-19T10:02:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.886+0000 7f950164e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94fc07d4a0 0x7f94fc07d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.886+0000 7f950164e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94fc07d4a0 0x7f94fc07d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47444/0 (socket says 172.21.15.18:47444) 2024-09-19T10:02:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.886+0000 7f950164e640 1 -- 172.21.15.18:0/3597616869 learned_addr learned my addr 172.21.15.18:0/3597616869 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.886+0000 7f9500e4d640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc06ee90 0x7f94fc0821e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.886+0000 7f94fbfff640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94fc10e150 0x7f94fc082720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.886+0000 7f950164e640 1 -- 172.21.15.18:0/3597616869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc06ee90 msgr2=0x7f94fc0821e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.886+0000 7f950164e640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc06ee90 0x7f94fc0821e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.886+0000 7f950164e640 1 -- 172.21.15.18:0/3597616869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94fc10e150 msgr2=0x7f94fc082720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.886+0000 7f950164e640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94fc10e150 0x7f94fc082720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.886+0000 7f950164e640 1 -- 172.21.15.18:0/3597616869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc07e080 con 0x7f94fc07d4a0 2024-09-19T10:02:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.887+0000 7f950164e640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94fc07d4a0 0x7f94fc07d950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94f000d680 tx=0x7f94f000db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.888+0000 7f94f9ffb640 1 -- 172.21.15.18:0/3597616869 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0017070 con 0x7f94fc07d4a0 2024-09-19T10:02:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.888+0000 7f95030b1640 1 -- 172.21.15.18:0/3597616869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94fc080f50 con 0x7f94fc07d4a0 2024-09-19T10:02:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.888+0000 7f95030b1640 1 -- 172.21.15.18:0/3597616869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94fc081460 con 0x7f94fc07d4a0 2024-09-19T10:02:26.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.893+0000 7f950548a740 1 Processor -- start 2024-09-19T10:02:26.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.893+0000 7f950548a740 1 -- start start 2024-09-19T10:02:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.894+0000 7f950548a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 0x5586d0b6fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.894+0000 7f950548a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b7a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.896+0000 7f9500e4d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b7a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.896+0000 7f94fbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 0x5586d0b6fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.896+0000 7f9500e4d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b7a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55110/0 (socket says 172.21.15.18:55110) 2024-09-19T10:02:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.896+0000 7f94fbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 0x5586d0b6fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47452/0 (socket says 172.21.15.18:47452) 2024-09-19T10:02:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.896+0000 7f950548a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b7ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.896+0000 7f9500e4d640 1 -- 172.21.15.18:0/3532818383 learned_addr learned my addr 172.21.15.18:0/3532818383 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.896+0000 7f950548a740 1 -- 172.21.15.18:0/3532818383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5586d0ad52a0 con 0x5586d0b7aae0 2024-09-19T10:02:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.896+0000 7f950548a740 1 -- 172.21.15.18:0/3532818383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5586d0a7cb10 con 0x5586d0b70220 2024-09-19T10:02:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.896+0000 7f950548a740 1 -- 172.21.15.18:0/3532818383 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5586d0ad1260 con 0x5586d0b6f900 2024-09-19T10:02:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.897+0000 7f9500e4d640 1 -- 172.21.15.18:0/3532818383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 msgr2=0x5586d0b6fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.897+0000 7f9500e4d640 1 --2- 172.21.15.18:0/3532818383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 0x5586d0b6fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.897+0000 7f9500e4d640 1 -- 172.21.15.18:0/3532818383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 msgr2=0x5586d0b7ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.897+0000 7f9500e4d640 1 --2- 172.21.15.18:0/3532818383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b7ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.897+0000 7f9500e4d640 1 -- 172.21.15.18:0/3532818383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d0846b90 con 0x5586d0b70220 2024-09-19T10:02:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.898+0000 7f94f9ffb640 1 -- 172.21.15.18:0/3597616869 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94f0009820 con 0x7f94fc07d4a0 2024-09-19T10:02:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.898+0000 7f94f9ffb640 1 -- 172.21.15.18:0/3597616869 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0004d00 con 0x7f94fc07d4a0 2024-09-19T10:02:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.898+0000 7f94f9ffb640 1 -- 172.21.15.18:0/3597616869 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f94f0010460 con 0x7f94fc07d4a0 2024-09-19T10:02:26.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.898+0000 7f9500e4d640 1 --2- 172.21.15.18:0/3532818383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b7a5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f94ec004570 tx=0x7f94ec005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4142e0bc167e751 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:26.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.899+0000 7f94f9ffb640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94e40a3490 0x7f94e40a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.900+0000 7f94f9ffb640 1 -- 172.21.15.18:0/3597616869 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f94f00d0210 con 0x7f94fc07d4a0 2024-09-19T10:02:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.900+0000 7f94fbfff640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94e40a3490 0x7f94e40a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.901+0000 7f94e2ffd640 1 -- 172.21.15.18:0/3532818383 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00be00 con 0x5586d0b70220 2024-09-19T10:02:26.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.902+0000 7f94e2ffd640 1 -- 172.21.15.18:0/3532818383 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ec005500 con 0x5586d0b70220 2024-09-19T10:02:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.903+0000 7f950548a740 1 -- 172.21.15.18:0/3532818383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 msgr2=0x5586d0b7a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.903+0000 7f950548a740 1 --2- 172.21.15.18:0/3532818383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b7a5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f94ec004570 tx=0x7f94ec005f90 comp rx=0 tx=0).stop 2024-09-19T10:02:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.903+0000 7f950548a740 1 -- 172.21.15.18:0/3532818383 shutdown_connections 2024-09-19T10:02:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.903+0000 7f950548a740 1 --2- 172.21.15.18:0/3532818383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b7ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.903+0000 7f950548a740 1 --2- 172.21.15.18:0/3532818383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b7a5a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.903+0000 7f950548a740 1 --2- 172.21.15.18:0/3532818383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 0x5586d0b6fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.903+0000 7f950548a740 1 -- 172.21.15.18:0/3532818383 >> 172.21.15.18:0/3532818383 conn(0x5586d0b6be90 msgr2=0x5586d0b6c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.908+0000 7f950548a740 1 -- 172.21.15.18:0/3532818383 shutdown_connections 2024-09-19T10:02:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.908+0000 7f950548a740 1 -- 172.21.15.18:0/3532818383 wait complete. 2024-09-19T10:02:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.909+0000 7f950548a740 1 -- start start 2024-09-19T10:02:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.909+0000 7f950548a740 1 Processor -- start 2024-09-19T10:02:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.909+0000 7f950548a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b6f900 0x5586d0b77930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.909+0000 7f950548a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b77e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.909+0000 7f950548a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b7aae0 0x5586d0b783b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.909+0000 7f950548a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5586d0b7d700 con 0x5586d0b6f900 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.909+0000 7f950548a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5586d0a5d6e0 con 0x5586d0b70220 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.909+0000 7f950548a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5586d0b7d880 con 0x5586d0b7aae0 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.909+0000 7f950548a740 10 client.0 _ll_register_callbacks cb 0x5586d0a81a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.910+0000 7f9500e4d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b6f900 0x5586d0b77930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.910+0000 7f9500e4d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b6f900 0x5586d0b77930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34214/0 (socket says 172.21.15.18:34214) 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.910+0000 7f9500e4d640 1 -- 172.21.15.18:0/3265957579 learned_addr learned my addr 172.21.15.18:0/3265957579 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.910+0000 7f94fbfff640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94e40a3490 0x7f94e40a5950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f94fc07eca0 tx=0x7f94f4005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.911+0000 7f9500e4d640 1 -- 172.21.15.18:0/3265957579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b7aae0 msgr2=0x5586d0b783b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:02:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.911+0000 7f9500e4d640 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b7aae0 0x5586d0b783b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.911+0000 7f9500e4d640 1 -- 172.21.15.18:0/3265957579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 msgr2=0x5586d0b77e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:02:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.911+0000 7f9500e4d640 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b77e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.911+0000 7f9500e4d640 1 -- 172.21.15.18:0/3265957579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d0b86c20 con 0x5586d0b6f900 2024-09-19T10:02:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.912+0000 7f9500e4d640 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b6f900 0x5586d0b77930 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f94ec005260 tx=0x7f94ec005290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9476294361485f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.912+0000 7f94e07f8640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:26.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.925+0000 7f94e07f8640 1 -- 172.21.15.18:0/3265957579 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec024030 con 0x5586d0b6f900 2024-09-19T10:02:26.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.925+0000 7f950548a740 1 -- 172.21.15.18:0/3265957579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94ec005500 con 0x5586d0b6f900 2024-09-19T10:02:26.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.925+0000 7f94e07f8640 1 -- 172.21.15.18:0/3265957579 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f94ec01b070 con 0x5586d0b6f900 2024-09-19T10:02:26.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.926+0000 7f94e07f8640 1 -- 172.21.15.18:0/3265957579 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94ec00be00 con 0x5586d0b6f900 2024-09-19T10:02:26.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.926+0000 7f950548a740 10 client.17712 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:26.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.926+0000 7f950548a740 1 -- 172.21.15.18:0/3265957579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586d0b89590 con 0x5586d0b6f900 2024-09-19T10:02:26.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.927+0000 7f94e07f8640 1 -- 172.21.15.18:0/3265957579 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ec005500 con 0x5586d0b6f900 2024-09-19T10:02:26.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.927+0000 7f94e07f8640 1 -- 172.21.15.18:0/3265957579 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f94ec020860 con 0x5586d0b6f900 2024-09-19T10:02:26.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.929+0000 7f950548a740 10 client.17712 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:26.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.929+0000 7f950548a740 10 client.17712 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:02:26.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.929+0000 7f950548a740 20 client.17712 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:26.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.929+0000 7f950548a740 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5586d0b8ace0 0x5586d0b8d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.929+0000 7f950548a740 4 client.17712 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:26.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.929+0000 7f950548a740 1 -- 172.21.15.18:0/3265957579 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586d0ae29d0 con 0x5586d0b8ace0 2024-09-19T10:02:26.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.931+0000 7f94fbfff640 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5586d0b8ace0 0x5586d0b8d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.934+0000 7f94fbfff640 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5586d0b8ace0 0x5586d0b8d180 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f17c8de60aa18053 server_cookie=1fa7019e9c1b3715 in_seq=0 out_seq=0 2024-09-19T10:02:26.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.934+0000 7f94e07f8640 10 client.17712 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.937+0000 7f94e07f8640 1 -- 172.21.15.18:0/3265957579 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586d0ae29d0 con 0x5586d0b8ace0 2024-09-19T10:02:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.937+0000 7f94e07f8640 10 client.17712 handle_command_reply: tid=0 2024-09-19T10:02:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.937+0000 7f950548a740 1 client.17712 shutdown 2024-09-19T10:02:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.937+0000 7f950548a740 1 -- 172.21.15.18:0/3265957579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b6f900 msgr2=0x5586d0b77930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:26.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.937+0000 7f950548a740 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b6f900 0x5586d0b77930 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f94ec005260 tx=0x7f94ec005290 comp rx=0 tx=0).stop 2024-09-19T10:02:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.938+0000 7f950548a740 1 -- 172.21.15.18:0/3265957579 shutdown_connections 2024-09-19T10:02:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.938+0000 7f950548a740 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5586d0b8ace0 0x5586d0b8d180 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.938+0000 7f950548a740 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b7aae0 0x5586d0b783b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.938+0000 7f950548a740 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b77e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.938+0000 7f950548a740 1 --2- 172.21.15.18:0/3265957579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b6f900 0x5586d0b77930 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.938+0000 7f950548a740 1 -- 172.21.15.18:0/3265957579 >> 172.21.15.18:0/3265957579 conn(0x5586d0b6be90 msgr2=0x5586d0b6b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.938+0000 7f94e07f8640 0 client.17712 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.938+0000 7f950548a740 1 -- 172.21.15.18:0/3265957579 shutdown_connections 2024-09-19T10:02:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.938+0000 7f950548a740 1 -- 172.21.15.18:0/3265957579 wait complete. 2024-09-19T10:02:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.938+0000 7f950548a740 20 client.17712 trim_cache size 0 max 16384 2024-09-19T10:02:26.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.980+0000 7f950548a740 1 Processor -- start 2024-09-19T10:02:26.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.981+0000 7f950548a740 1 -- start start 2024-09-19T10:02:26.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.981+0000 7f950548a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b6f900 0x5586d0b92a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.982+0000 7f950548a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b70220 0x5586d0b92fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.982+0000 7f950548a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b74b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.982+0000 7f9500e4d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b6f900 0x5586d0b92a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.982+0000 7f9500e4d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b6f900 0x5586d0b92a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:55132/0 (socket says 172.21.15.18:55132) 2024-09-19T10:02:26.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.983+0000 7f9500e4d640 1 -- 172.21.15.18:0/1526352158 learned_addr learned my addr 172.21.15.18:0/1526352158 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:26.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.983+0000 7f94fbfff640 1 --2- 172.21.15.18:0/1526352158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b70220 0x5586d0b92fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.983+0000 7f950164e640 1 --2- 172.21.15.18:0/1526352158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b74b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.983+0000 7f950548a740 1 -- 172.21.15.18:0/1526352158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94e800e420 con 0x5586d0b7aae0 2024-09-19T10:02:26.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.984+0000 7f950548a740 1 -- 172.21.15.18:0/1526352158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f94e800ff60 con 0x5586d0b6f900 2024-09-19T10:02:26.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.984+0000 7f950548a740 1 -- 172.21.15.18:0/1526352158 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94e800eaf0 con 0x5586d0b70220 2024-09-19T10:02:26.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.984+0000 7f950164e640 1 -- 172.21.15.18:0/1526352158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b70220 msgr2=0x5586d0b92fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:26.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.984+0000 7f950164e640 1 --2- 172.21.15.18:0/1526352158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b70220 0x5586d0b92fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.984+0000 7f950164e640 1 -- 172.21.15.18:0/1526352158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b6f900 msgr2=0x5586d0b92a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.984+0000 7f950164e640 1 --2- 172.21.15.18:0/1526352158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b6f900 0x5586d0b92a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.984+0000 7f950164e640 1 -- 172.21.15.18:0/1526352158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d0b6a480 con 0x5586d0b7aae0 2024-09-19T10:02:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.985+0000 7f950164e640 1 --2- 172.21.15.18:0/1526352158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b74b60 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f94f00cdd60 tx=0x7f94f009cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7ab305851702bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.986+0000 7f94e27fc640 1 -- 172.21.15.18:0/1526352158 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f00b5070 con 0x5586d0b7aae0 2024-09-19T10:02:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.986+0000 7f94e27fc640 1 -- 172.21.15.18:0/1526352158 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94f00a54f0 con 0x5586d0b7aae0 2024-09-19T10:02:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.986+0000 7f94e27fc640 1 -- 172.21.15.18:0/1526352158 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0020040 con 0x5586d0b7aae0 2024-09-19T10:02:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.987+0000 7f950548a740 1 -- 172.21.15.18:0/1526352158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 msgr2=0x5586d0b74b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.987+0000 7f950548a740 1 --2- 172.21.15.18:0/1526352158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b74b60 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f94f00cdd60 tx=0x7f94f009cf80 comp rx=0 tx=0).stop 2024-09-19T10:02:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.988+0000 7f950548a740 1 -- 172.21.15.18:0/1526352158 shutdown_connections 2024-09-19T10:02:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.988+0000 7f950548a740 1 --2- 172.21.15.18:0/1526352158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b74b60 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.988+0000 7f950548a740 1 --2- 172.21.15.18:0/1526352158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b70220 0x5586d0b92fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.988+0000 7f950548a740 1 --2- 172.21.15.18:0/1526352158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b6f900 0x5586d0b92a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.988+0000 7f950548a740 1 -- 172.21.15.18:0/1526352158 >> 172.21.15.18:0/1526352158 conn(0x5586d0b6be90 msgr2=0x5586d0b799b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.988+0000 7f950548a740 1 -- 172.21.15.18:0/1526352158 shutdown_connections 2024-09-19T10:02:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.988+0000 7f950548a740 1 -- 172.21.15.18:0/1526352158 wait complete. 2024-09-19T10:02:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.990+0000 7f950548a740 1 -- start start 2024-09-19T10:02:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.991+0000 7f950548a740 1 Processor -- start 2024-09-19T10:02:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.992+0000 7f950548a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 0x5586d0b7bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.992+0000 7f950548a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b7c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.992+0000 7f950548a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b7c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.992+0000 7f950548a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94e800f890 con 0x5586d0b7aae0 2024-09-19T10:02:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.992+0000 7f950548a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f94e800f1c0 con 0x5586d0b70220 2024-09-19T10:02:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.992+0000 7f950548a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94e800c400 con 0x5586d0b6f900 2024-09-19T10:02:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.992+0000 7f950548a740 10 client.0 _ll_register_callbacks cb 0x7f94ec003ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.993+0000 7f9500e4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 0x5586d0b7bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.993+0000 7f94fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b7c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:26.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.993+0000 7f9500e4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 0x5586d0b7bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47476/0 (socket says 172.21.15.18:47476) 2024-09-19T10:02:26.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.993+0000 7f9500e4d640 1 -- 172.21.15.18:0/2852344406 learned_addr learned my addr 172.21.15.18:0/2852344406 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:26.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.994+0000 7f950164e640 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b7c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.995+0000 7f950164e640 1 -- 172.21.15.18:0/2852344406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 msgr2=0x5586d0b7bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.995+0000 7f950164e640 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 0x5586d0b7bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.995+0000 7f950164e640 1 -- 172.21.15.18:0/2852344406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 msgr2=0x5586d0b7c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.995+0000 7f950164e640 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b7c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.995+0000 7f950164e640 1 -- 172.21.15.18:0/2852344406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d0b810a0 con 0x5586d0b7aae0 2024-09-19T10:02:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.997+0000 7f950164e640 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b7c690 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f94f009c580 tx=0x7f94f00ce0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d876f22b73925b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.997+0000 7f94e07f8640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:27.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.998+0000 7f94e07f8640 1 -- 172.21.15.18:0/2852344406 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0020070 con 0x5586d0b7aae0 2024-09-19T10:02:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.999+0000 7f94e07f8640 1 -- 172.21.15.18:0/2852344406 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f94f009ddc0 con 0x5586d0b7aae0 2024-09-19T10:02:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.999+0000 7f950548a740 1 -- 172.21.15.18:0/2852344406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94f00a54f0 con 0x5586d0b7aae0 2024-09-19T10:02:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:26.999+0000 7f94e07f8640 1 -- 172.21.15.18:0/2852344406 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94f00b5040 con 0x5586d0b7aae0 2024-09-19T10:02:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.000+0000 7f950548a740 10 client.17718 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.000+0000 7f950548a740 1 -- 172.21.15.18:0/2852344406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586d0bf5ce0 con 0x5586d0b7aae0 2024-09-19T10:02:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.002+0000 7f94e07f8640 1 -- 172.21.15.18:0/2852344406 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94f00a54f0 con 0x5586d0b7aae0 2024-09-19T10:02:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.002+0000 7f94e07f8640 1 -- 172.21.15.18:0/2852344406 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f94f0098040 con 0x5586d0b7aae0 2024-09-19T10:02:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.002+0000 7f950548a740 10 client.17718 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.002+0000 7f950548a740 10 client.17718 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:02:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.002+0000 7f950548a740 20 client.17718 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.002+0000 7f950548a740 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5586d0bf6320 0x5586d0bf8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.002+0000 7f950548a740 4 client.17718 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T10:02:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.002+0000 7f950548a740 1 -- 172.21.15.18:0/2852344406 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5586d0adcd20 con 0x5586d0bf6320 2024-09-19T10:02:27.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.002+0000 7f9500e4d640 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5586d0bf6320 0x5586d0bf8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.005+0000 7f9500e4d640 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5586d0bf6320 0x5586d0bf8710 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=593a95c645954101 server_cookie=b35c5ba61b9b3527 in_seq=0 out_seq=0 2024-09-19T10:02:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.005+0000 7f94e07f8640 10 client.17718 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:27.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:26 smithi018 ceph-mon[30956]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 106 GiB used, 966 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 760 MiB/s wr, 1.95k op/s 2024-09-19T10:02:27.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:26 smithi049 ceph-mon[34858]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 106 GiB used, 966 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 760 MiB/s wr, 1.95k op/s 2024-09-19T10:02:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:26 smithi162 ceph-mon[35174]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 106 GiB used, 966 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 760 MiB/s wr, 1.95k op/s 2024-09-19T10:02:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f94e07f8640 1 -- 172.21.15.18:0/2852344406 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5586d0adcd20 con 0x5586d0bf6320 2024-09-19T10:02:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f94e07f8640 10 client.17718 handle_command_reply: tid=0 2024-09-19T10:02:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 client.17718 shutdown 2024-09-19T10:02:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 -- 172.21.15.18:0/2852344406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 msgr2=0x5586d0b7c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b7c690 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f94f009c580 tx=0x7f94f00ce0a0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 -- 172.21.15.18:0/2852344406 shutdown_connections 2024-09-19T10:02:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5586d0bf6320 0x5586d0bf8710 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5586d0b7aae0 0x5586d0b7c690 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5586d0b70220 0x5586d0b7c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f94e07f8640 0 client.17718 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 --2- 172.21.15.18:0/2852344406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586d0b6f900 0x5586d0b7bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 -- 172.21.15.18:0/2852344406 >> 172.21.15.18:0/2852344406 conn(0x5586d0b6be90 msgr2=0x5586d0b799b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 -- 172.21.15.18:0/2852344406 shutdown_connections 2024-09-19T10:02:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 1 -- 172.21.15.18:0/2852344406 wait complete. 2024-09-19T10:02:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.594+0000 7f950548a740 20 client.17718 trim_cache size 0 max 16384 2024-09-19T10:02:27.599 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:02:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T10:02:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T10:02:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 34, 2024-09-19T10:02:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T10:02:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "8a2ec461": { 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 34, 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 150.0, 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T10:02:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:02:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T10:02:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:02:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:27.601 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 -- 172.21.15.18:0/3597616869 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94e40a3490 msgr2=0x7f94e40a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94e40a3490 0x7f94e40a5950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f94fc07eca0 tx=0x7f94f4005d80 comp rx=0 tx=0).stop 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 -- 172.21.15.18:0/3597616869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94fc07d4a0 msgr2=0x7f94fc07d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94fc07d4a0 0x7f94fc07d950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94f000d680 tx=0x7f94f000db40 comp rx=0 tx=0).stop 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 -- 172.21.15.18:0/3597616869 shutdown_connections 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f94e40a3490 0x7f94e40a5950 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94fc07d4a0 0x7f94fc07d950 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94fc10e150 0x7f94fc082720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 --2- 172.21.15.18:0/3597616869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc06ee90 0x7f94fc0821e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 -- 172.21.15.18:0/3597616869 >> 172.21.15.18:0/3597616869 conn(0x7f94fc073210 msgr2=0x7f94fc06ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 -- 172.21.15.18:0/3597616869 shutdown_connections 2024-09-19T10:02:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:27.595+0000 7f95030b1640 1 -- 172.21.15.18:0/3597616869 wait complete. 2024-09-19T10:02:28.516 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8a2ec461', quiesce took 6.8 seconds. Will release after: 23.2 2024-09-19T10:02:29.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:28 smithi049 ceph-mon[34858]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 795 MiB/s wr, 2.04k op/s 2024-09-19T10:02:29.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:28 smithi162 ceph-mon[35174]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 795 MiB/s wr, 2.04k op/s 2024-09-19T10:02:29.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:28 smithi018 ceph-mon[30956]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 795 MiB/s wr, 2.04k op/s 2024-09-19T10:02:31.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:30 smithi049 ceph-mon[34858]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 667 MiB/s wr, 1.77k op/s 2024-09-19T10:02:31.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:30 smithi162 ceph-mon[35174]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 667 MiB/s wr, 1.77k op/s 2024-09-19T10:02:31.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:30 smithi018 ceph-mon[30956]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 667 MiB/s wr, 1.77k op/s 2024-09-19T10:02:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.799+0000 7f541cf31640 1 -- 172.21.15.18:0/3679038062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5418100a50 msgr2=0x7f5418100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.799+0000 7f541cf31640 1 --2- 172.21.15.18:0/3679038062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5418100a50 0x7f5418100e50 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5408009860 tx=0x7f540802a340 comp rx=0 tx=0).stop 2024-09-19T10:02:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.799+0000 7f541cf31640 1 -- 172.21.15.18:0/3679038062 shutdown_connections 2024-09-19T10:02:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.799+0000 7f541cf31640 1 --2- 172.21.15.18:0/3679038062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5418102600 0x7f5418108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.799+0000 7f541cf31640 1 --2- 172.21.15.18:0/3679038062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5418101c40 0x7f54181020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.799+0000 7f541cf31640 1 --2- 172.21.15.18:0/3679038062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5418100a50 0x7f5418100e50 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.799+0000 7f541cf31640 1 -- 172.21.15.18:0/3679038062 >> 172.21.15.18:0/3679038062 conn(0x7f54180fc1b0 msgr2=0x7f54180fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.799+0000 7f541cf31640 1 -- 172.21.15.18:0/3679038062 shutdown_connections 2024-09-19T10:02:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.799+0000 7f541cf31640 1 -- 172.21.15.18:0/3679038062 wait complete. 2024-09-19T10:02:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f541cf31640 1 Processor -- start 2024-09-19T10:02:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f541cf31640 1 -- start start 2024-09-19T10:02:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f541cf31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5418100a50 0x7f5418197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f541cf31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5418101c40 0x7f5418198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f541cf31640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5418102600 0x7f541819f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f541cf31640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f541810d820 con 0x7f5418101c40 2024-09-19T10:02:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f541cf31640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f541810d6a0 con 0x7f5418102600 2024-09-19T10:02:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f541cf31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f541810d9a0 con 0x7f5418100a50 2024-09-19T10:02:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f5415d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5418101c40 0x7f5418198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f5415d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5418101c40 0x7f5418198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34240/0 (socket says 172.21.15.18:34240) 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f5415d9b640 1 -- 172.21.15.18:0/2015380474 learned_addr learned my addr 172.21.15.18:0/2015380474 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f541659c640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5418100a50 0x7f5418197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.800+0000 7f5416d9d640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5418102600 0x7f541819f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f5415d9b640 1 -- 172.21.15.18:0/2015380474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5418100a50 msgr2=0x7f5418197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f5415d9b640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5418100a50 0x7f5418197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f5415d9b640 1 -- 172.21.15.18:0/2015380474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5418102600 msgr2=0x7f541819f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f5415d9b640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5418102600 0x7f541819f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f5415d9b640 1 -- 172.21.15.18:0/2015380474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541819fa00 con 0x7f5418101c40 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f5416d9d640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5418102600 0x7f541819f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f5415d9b640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5418101c40 0x7f5418198320 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f540c00e9c0 tx=0x7f540c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f54077fe640 1 -- 172.21.15.18:0/2015380474 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c00cde0 con 0x7f5418101c40 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f54077fe640 1 -- 172.21.15.18:0/2015380474 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f540c0035f0 con 0x7f5418101c40 2024-09-19T10:02:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f541cf31640 1 -- 172.21.15.18:0/2015380474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541819fcf0 con 0x7f5418101c40 2024-09-19T10:02:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f54077fe640 1 -- 172.21.15.18:0/2015380474 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c010690 con 0x7f5418101c40 2024-09-19T10:02:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.801+0000 7f541cf31640 1 -- 172.21.15.18:0/2015380474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54181a01e0 con 0x7f5418101c40 2024-09-19T10:02:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.804+0000 7f54077fe640 1 -- 172.21.15.18:0/2015380474 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f540c0037a0 con 0x7f5418101c40 2024-09-19T10:02:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.804+0000 7f541fccd740 1 Processor -- start 2024-09-19T10:02:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.804+0000 7f541fccd740 1 -- start start 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.804+0000 7f541fccd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564b9a0 0x56391564bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.804+0000 7f541fccd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x563915650da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.804+0000 7f541fccd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x563915653830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.804+0000 7f541fccd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5639155af2f0 con 0x563915651370 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.804+0000 7f541fccd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563915557270 con 0x56391564b9a0 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.804+0000 7f541fccd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5639155ab2b0 con 0x56391564c2e0 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5415d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x563915653830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f54077fe640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54000a32f0 0x7f54000a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5415d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x563915653830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34246/0 (socket says 172.21.15.18:34246) 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5415d9b640 1 -- 172.21.15.18:0/3658516592 learned_addr learned my addr 172.21.15.18:0/3658516592 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f541659c640 1 --2- 172.21.15.18:0/3658516592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x563915650da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5416d9d640 1 --2- 172.21.15.18:0/3658516592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564b9a0 0x56391564bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5416d9d640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54000a32f0 0x7f54000a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f54077fe640 1 -- 172.21.15.18:0/2015380474 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f540c0cfbd0 con 0x7f5418101c40 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5415d9b640 1 -- 172.21.15.18:0/3658516592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 msgr2=0x563915650da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5415d9b640 1 --2- 172.21.15.18:0/3658516592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x563915650da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5415d9b640 1 -- 172.21.15.18:0/3658516592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564b9a0 msgr2=0x56391564bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5415d9b640 1 --2- 172.21.15.18:0/3658516592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564b9a0 0x56391564bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5415d9b640 1 -- 172.21.15.18:0/3658516592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563915556340 con 0x563915651370 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5415d9b640 1 --2- 172.21.15.18:0/3658516592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x563915653830 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f540c0cd640 tx=0x7f540c009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64547b3dbb7dc76f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.805+0000 7f5416d9d640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54000a32f0 0x7f54000a57b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f54100099e0 tx=0x7f5410009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f5404ff9640 1 -- 172.21.15.18:0/3658516592 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c0bae60 con 0x563915651370 2024-09-19T10:02:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f5404ff9640 1 -- 172.21.15.18:0/3658516592 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f540c09c920 con 0x563915651370 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f5404ff9640 1 -- 172.21.15.18:0/3658516592 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c098890 con 0x563915651370 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f541fccd740 1 -- 172.21.15.18:0/3658516592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 msgr2=0x563915653830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f541fccd740 1 --2- 172.21.15.18:0/3658516592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x563915653830 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f540c0cd640 tx=0x7f540c009660 comp rx=0 tx=0).stop 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f541fccd740 1 -- 172.21.15.18:0/3658516592 shutdown_connections 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f541fccd740 1 --2- 172.21.15.18:0/3658516592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x563915653830 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f541fccd740 1 --2- 172.21.15.18:0/3658516592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x563915650da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f541fccd740 1 --2- 172.21.15.18:0/3658516592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564b9a0 0x56391564bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f541fccd740 1 -- 172.21.15.18:0/3658516592 >> 172.21.15.18:0/3658516592 conn(0x563915647010 msgr2=0x563915647410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.806+0000 7f541fccd740 1 -- 172.21.15.18:0/3658516592 shutdown_connections 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541fccd740 1 -- 172.21.15.18:0/3658516592 wait complete. 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541fccd740 1 -- start start 2024-09-19T10:02:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541fccd740 1 Processor -- start 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541fccd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541fccd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x563915655fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541fccd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563915651370 0x56391565cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541fccd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563915654280 con 0x56391564b9a0 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541fccd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563915538290 con 0x563915651370 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541fccd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563915654400 con 0x56391564c2e0 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541fccd740 10 client.0 _ll_register_callbacks cb 0x563915569140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34258/0 (socket says 172.21.15.18:34258) 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f541659c640 1 -- 172.21.15.18:0/1711096206 learned_addr learned my addr 172.21.15.18:0/1711096206 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.807+0000 7f5415d9b640 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x563915655fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.817 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f5416d9d640 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563915651370 0x56391565cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f541659c640 1 -- 172.21.15.18:0/1711096206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 msgr2=0x563915655fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f541659c640 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x563915655fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f541659c640 1 -- 172.21.15.18:0/1711096206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563915651370 msgr2=0x56391565cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f541659c640 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563915651370 0x56391565cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f541659c640 1 -- 172.21.15.18:0/1711096206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639152c2210 con 0x56391564b9a0 2024-09-19T10:02:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f5416d9d640 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563915651370 0x56391565cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:02:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f541659c640 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655a70 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f5408009860 tx=0x7f5408005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554d344c2a156010 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:31.818 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f53fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f53fdffb640 1 -- 172.21.15.18:0/1711096206 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408037040 con 0x56391564b9a0 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f53fdffb640 1 -- 172.21.15.18:0/1711096206 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5408004240 con 0x56391564b9a0 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f541fccd740 1 -- 172.21.15.18:0/1711096206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f540c09c920 con 0x56391564b9a0 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f53fdffb640 1 -- 172.21.15.18:0/1711096206 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5408004440 con 0x56391564b9a0 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f541fccd740 10 client.17730 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.808+0000 7f541fccd740 1 -- 172.21.15.18:0/1711096206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56391538e620 con 0x56391564b9a0 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.809+0000 7f53fdffb640 1 -- 172.21.15.18:0/1711096206 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f540c09c920 con 0x56391564b9a0 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.809+0000 7f53fdffb640 1 -- 172.21.15.18:0/1711096206 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5408004ad0 con 0x56391564b9a0 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.809+0000 7f541fccd740 10 client.17730 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.809+0000 7f541fccd740 10 client.17730 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.809+0000 7f541fccd740 20 client.17730 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:31.819 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.809+0000 7f541fccd740 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563915661730 0x563915663b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.809+0000 7f541fccd740 4 client.17730 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.809+0000 7f541fccd740 1 -- 172.21.15.18:0/1711096206 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639155bca20 con 0x563915661730 2024-09-19T10:02:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.809+0000 7f5415d9b640 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563915661730 0x563915663b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.810+0000 7f5415d9b640 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563915661730 0x563915663b80 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c6ca4642f890c7d server_cookie=a4ec9014ba1ed9c9 in_seq=0 out_seq=0 2024-09-19T10:02:31.820 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.810+0000 7f53fdffb640 10 client.17730 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.810+0000 7f53fdffb640 1 -- 172.21.15.18:0/1711096206 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f540c07ae50 con 0x563915661730 2024-09-19T10:02:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.810+0000 7f53fdffb640 10 client.17730 handle_command_reply: tid=0 2024-09-19T10:02:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 client.17730 shutdown 2024-09-19T10:02:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 -- 172.21.15.18:0/1711096206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 msgr2=0x563915655a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655a70 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f5408009860 tx=0x7f5408005d20 comp rx=0 tx=0).stop 2024-09-19T10:02:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 -- 172.21.15.18:0/1711096206 shutdown_connections 2024-09-19T10:02:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563915661730 0x563915663b80 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563915651370 0x56391565cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x563915655fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f53fdffb640 0 client.17730 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 --2- 172.21.15.18:0/1711096206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655a70 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 -- 172.21.15.18:0/1711096206 >> 172.21.15.18:0/1711096206 conn(0x563915647010 msgr2=0x563915648820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 -- 172.21.15.18:0/1711096206 shutdown_connections 2024-09-19T10:02:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 1 -- 172.21.15.18:0/1711096206 wait complete. 2024-09-19T10:02:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.811+0000 7f541fccd740 20 client.17730 trim_cache size 0 max 16384 2024-09-19T10:02:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541fccd740 1 Processor -- start 2024-09-19T10:02:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541fccd740 1 -- start start 2024-09-19T10:02:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541fccd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541fccd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564c2e0 0x56391565cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541fccd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563915651370 0x563915655d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541fccd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f54181a8f60 con 0x56391564b9a0 2024-09-19T10:02:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541fccd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f54181aaaa0 con 0x56391564c2e0 2024-09-19T10:02:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541fccd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54181a9630 con 0x563915651370 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34264/0 (socket says 172.21.15.18:34264) 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541659c640 1 -- 172.21.15.18:0/1042121685 learned_addr learned my addr 172.21.15.18:0/1042121685 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f5416d9d640 1 --2- 172.21.15.18:0/1042121685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563915651370 0x563915655d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541659c640 1 -- 172.21.15.18:0/1042121685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563915651370 msgr2=0x563915655d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541659c640 1 --2- 172.21.15.18:0/1042121685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563915651370 0x563915655d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f5415d9b640 1 --2- 172.21.15.18:0/1042121685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564c2e0 0x56391565cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541659c640 1 -- 172.21.15.18:0/1042121685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564c2e0 msgr2=0x56391565cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541659c640 1 --2- 172.21.15.18:0/1042121685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564c2e0 0x56391565cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541659c640 1 -- 172.21.15.18:0/1042121685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639156506f0 con 0x56391564b9a0 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f5415d9b640 1 --2- 172.21.15.18:0/1042121685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564c2e0 0x56391565cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:02:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.826+0000 7f541659c640 1 --2- 172.21.15.18:0/1042121685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655820 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f540802a860 tx=0x7f5408000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75cbdc4f5ee79d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f53fffff640 1 -- 172.21.15.18:0/1042121685 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408056070 con 0x56391564b9a0 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f53fffff640 1 -- 172.21.15.18:0/1042121685 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5408009450 con 0x56391564b9a0 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f53fffff640 1 -- 172.21.15.18:0/1042121685 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408037070 con 0x56391564b9a0 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f541fccd740 1 -- 172.21.15.18:0/1042121685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 msgr2=0x563915655820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f541fccd740 1 --2- 172.21.15.18:0/1042121685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655820 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f540802a860 tx=0x7f5408000bc0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f541fccd740 1 -- 172.21.15.18:0/1042121685 shutdown_connections 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f541fccd740 1 --2- 172.21.15.18:0/1042121685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563915651370 0x563915655d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f541fccd740 1 --2- 172.21.15.18:0/1042121685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564c2e0 0x56391565cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f541fccd740 1 --2- 172.21.15.18:0/1042121685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56391564b9a0 0x563915655820 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f541fccd740 1 -- 172.21.15.18:0/1042121685 >> 172.21.15.18:0/1042121685 conn(0x563915647010 msgr2=0x56391564d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f541fccd740 1 -- 172.21.15.18:0/1042121685 shutdown_connections 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f541fccd740 1 -- 172.21.15.18:0/1042121685 wait complete. 2024-09-19T10:02:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.827+0000 7f541fccd740 1 -- start start 2024-09-19T10:02:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f541fccd740 1 Processor -- start 2024-09-19T10:02:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f541fccd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564b9a0 0x56391565a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f541fccd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x56391565adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f541fccd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x56391565bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f541fccd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f54181aa3d0 con 0x563915651370 2024-09-19T10:02:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f541fccd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f54181a9d00 con 0x56391564b9a0 2024-09-19T10:02:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f541fccd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54181a6f40 con 0x56391564c2e0 2024-09-19T10:02:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f541fccd740 10 client.0 _ll_register_callbacks cb 0x7f540c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f5416d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x56391565bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f5416d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x56391565bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34276/0 (socket says 172.21.15.18:34276) 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f5416d9d640 1 -- 172.21.15.18:0/1729262512 learned_addr learned my addr 172.21.15.18:0/1729262512 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f541659c640 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564b9a0 0x56391565a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f5415d9b640 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x56391565adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f5416d9d640 1 -- 172.21.15.18:0/1729262512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 msgr2=0x56391565adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f5416d9d640 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x56391565adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f5416d9d640 1 -- 172.21.15.18:0/1729262512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564b9a0 msgr2=0x56391565a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f5416d9d640 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564b9a0 0x56391565a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f5416d9d640 1 -- 172.21.15.18:0/1729262512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391565c3d0 con 0x563915651370 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f5416d9d640 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x56391565bdc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f5410003f40 tx=0x7f5410004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52032730d1f8c1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.828+0000 7f53fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f53fdffb640 1 -- 172.21.15.18:0/1729262512 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410011220 con 0x563915651370 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f53fdffb640 1 -- 172.21.15.18:0/1729262512 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f541001f680 con 0x563915651370 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f541fccd740 1 -- 172.21.15.18:0/1729262512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5408009450 con 0x563915651370 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f53fdffb640 1 -- 172.21.15.18:0/1729262512 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f541001f880 con 0x563915651370 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f541fccd740 10 client.17736 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f541fccd740 1 -- 172.21.15.18:0/1729262512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5639156cc530 con 0x563915651370 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f53fdffb640 1 -- 172.21.15.18:0/1729262512 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5408009450 con 0x563915651370 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f53fdffb640 1 -- 172.21.15.18:0/1729262512 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f541001d040 con 0x563915651370 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f541fccd740 10 client.17736 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f541fccd740 10 client.17736 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f541fccd740 20 client.17736 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f541fccd740 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5639156ccf10 0x5639156cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f541fccd740 4 client.17736 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:02:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.829+0000 7f541fccd740 1 -- 172.21.15.18:0/1729262512 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5639155b6d70 con 0x5639156ccf10 2024-09-19T10:02:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.830+0000 7f541659c640 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5639156ccf10 0x5639156cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.830+0000 7f541659c640 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5639156ccf10 0x5639156cf330 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fb3fddaa4f1964 server_cookie=eb782fbc112ec403 in_seq=0 out_seq=0 2024-09-19T10:02:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.830+0000 7f53fdffb640 10 client.17736 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.846+0000 7f53fdffb640 1 -- 172.21.15.18:0/1729262512 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5639155b6d70 con 0x5639156ccf10 2024-09-19T10:02:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.846+0000 7f53fdffb640 10 client.17736 handle_command_reply: tid=0 2024-09-19T10:02:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.846+0000 7f541fccd740 1 client.17736 shutdown 2024-09-19T10:02:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.847+0000 7f541fccd740 1 -- 172.21.15.18:0/1729262512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 msgr2=0x56391565bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.847+0000 7f541fccd740 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x56391565bdc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f5410003f40 tx=0x7f5410004ab0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.847+0000 7f541fccd740 1 -- 172.21.15.18:0/1729262512 shutdown_connections 2024-09-19T10:02:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.847+0000 7f541fccd740 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5639156ccf10 0x5639156cf330 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.848+0000 7f541fccd740 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563915651370 0x56391565bdc0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.848+0000 7f53fdffb640 0 client.17736 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.848+0000 7f541fccd740 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391564c2e0 0x56391565adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.848+0000 7f541fccd740 1 --2- 172.21.15.18:0/1729262512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56391564b9a0 0x56391565a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.848+0000 7f541fccd740 1 -- 172.21.15.18:0/1729262512 >> 172.21.15.18:0/1729262512 conn(0x563915647010 msgr2=0x563915655820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.848+0000 7f541fccd740 1 -- 172.21.15.18:0/1729262512 shutdown_connections 2024-09-19T10:02:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.848+0000 7f541fccd740 1 -- 172.21.15.18:0/1729262512 wait complete. 2024-09-19T10:02:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.848+0000 7f541fccd740 20 client.17736 trim_cache size 0 max 16384 2024-09-19T10:02:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:02:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:02:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:02:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:02:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 -- 172.21.15.18:0/2015380474 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54000a32f0 msgr2=0x7f54000a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54000a32f0 0x7f54000a57b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f54100099e0 tx=0x7f5410009500 comp rx=0 tx=0).stop 2024-09-19T10:02:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 -- 172.21.15.18:0/2015380474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5418101c40 msgr2=0x7f5418198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5418101c40 0x7f5418198320 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f540c00e9c0 tx=0x7f540c00ee80 comp rx=0 tx=0).stop 2024-09-19T10:02:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 -- 172.21.15.18:0/2015380474 shutdown_connections 2024-09-19T10:02:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f54000a32f0 0x7f54000a57b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5418102600 0x7f541819f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5418101c40 0x7f5418198320 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 --2- 172.21.15.18:0/2015380474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5418100a50 0x7f5418197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 -- 172.21.15.18:0/2015380474 >> 172.21.15.18:0/2015380474 conn(0x7f54180fc1b0 msgr2=0x7f5418104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 -- 172.21.15.18:0/2015380474 shutdown_connections 2024-09-19T10:02:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:31.849+0000 7f541cf31640 1 -- 172.21.15.18:0/2015380474 wait complete. 2024-09-19T10:02:33.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:32 smithi018 ceph-mon[30956]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 94 GiB used, 978 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 620 MiB/s wr, 1.65k op/s 2024-09-19T10:02:33.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:32 smithi049 ceph-mon[34858]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 94 GiB used, 978 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 620 MiB/s wr, 1.65k op/s 2024-09-19T10:02:33.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:32 smithi162 ceph-mon[35174]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 94 GiB used, 978 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 620 MiB/s wr, 1.65k op/s 2024-09-19T10:02:35.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:34 smithi049 ceph-mon[34858]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 84 GiB used, 989 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 498 MiB/s wr, 1.24k op/s 2024-09-19T10:02:35.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:34 smithi162 ceph-mon[35174]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 84 GiB used, 989 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 498 MiB/s wr, 1.24k op/s 2024-09-19T10:02:35.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:34 smithi018 ceph-mon[30956]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 84 GiB used, 989 GiB / 1.0 TiB avail; 1.6 MiB/s rd, 498 MiB/s wr, 1.24k op/s 2024-09-19T10:02:37.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:36 smithi049 ceph-mon[34858]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 968 KiB/s rd, 338 MiB/s wr, 548 op/s 2024-09-19T10:02:37.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:36 smithi162 ceph-mon[35174]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 968 KiB/s rd, 338 MiB/s wr, 548 op/s 2024-09-19T10:02:37.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:36 smithi018 ceph-mon[30956]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 968 KiB/s rd, 338 MiB/s wr, 548 op/s 2024-09-19T10:02:39.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:38 smithi049 ceph-mon[34858]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 968 KiB/s rd, 262 MiB/s wr, 340 op/s 2024-09-19T10:02:39.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:38 smithi162 ceph-mon[35174]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 968 KiB/s rd, 262 MiB/s wr, 340 op/s 2024-09-19T10:02:39.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:38 smithi018 ceph-mon[30956]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 968 KiB/s rd, 262 MiB/s wr, 340 op/s 2024-09-19T10:02:42.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:41 smithi018 ceph-mon[30956]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 38 KiB/s rd, 132 MiB/s wr, 100 op/s 2024-09-19T10:02:42.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:41 smithi049 ceph-mon[34858]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 38 KiB/s rd, 132 MiB/s wr, 100 op/s 2024-09-19T10:02:42.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:41 smithi162 ceph-mon[35174]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 38 KiB/s rd, 132 MiB/s wr, 100 op/s 2024-09-19T10:02:43.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:42 smithi049 ceph-mon[34858]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 37 KiB/s rd, 95 MiB/s wr, 77 op/s 2024-09-19T10:02:43.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:42 smithi162 ceph-mon[35174]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 37 KiB/s rd, 95 MiB/s wr, 77 op/s 2024-09-19T10:02:43.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:42 smithi018 ceph-mon[30956]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 37 KiB/s rd, 95 MiB/s wr, 77 op/s 2024-09-19T10:02:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.951+0000 7f8739e5e640 1 -- 172.21.15.18:0/178607362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734103710 msgr2=0x7f8734109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.951+0000 7f8739e5e640 1 --2- 172.21.15.18:0/178607362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734103710 0x7f8734109fa0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f872c009ca0 tx=0x7f872c02a8c0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.951+0000 7f8739e5e640 1 -- 172.21.15.18:0/178607362 shutdown_connections 2024-09-19T10:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.951+0000 7f8739e5e640 1 --2- 172.21.15.18:0/178607362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734103710 0x7f8734109fa0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.951+0000 7f8739e5e640 1 --2- 172.21.15.18:0/178607362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734102d50 0x7f87341031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.951+0000 7f8739e5e640 1 --2- 172.21.15.18:0/178607362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8734101b60 0x7f8734101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.951+0000 7f8739e5e640 1 -- 172.21.15.18:0/178607362 >> 172.21.15.18:0/178607362 conn(0x7f87340fd2e0 msgr2=0x7f87340ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.951+0000 7f8739e5e640 1 -- 172.21.15.18:0/178607362 shutdown_connections 2024-09-19T10:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.951+0000 7f8739e5e640 1 -- 172.21.15.18:0/178607362 wait complete. 2024-09-19T10:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f8739e5e640 1 Processor -- start 2024-09-19T10:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f8739e5e640 1 -- start start 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f8739e5e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8734101b60 0x7f8734075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f8739e5e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734102d50 0x7f87340745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f8739e5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734103710 0x7f8734074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f8739e5e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f873410d7c0 con 0x7f8734102d50 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f8739e5e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f873410d640 con 0x7f8734101b60 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f8739e5e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f873410d940 con 0x7f8734103710 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f872bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734102d50 0x7f87340745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f872bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734102d50 0x7f87340745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44804/0 (socket says 172.21.15.18:44804) 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f872bfff640 1 -- 172.21.15.18:0/1191444584 learned_addr learned my addr 172.21.15.18:0/1191444584 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f87337fe640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8734101b60 0x7f8734075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f8733fff640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734103710 0x7f8734074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f872bfff640 1 -- 172.21.15.18:0/1191444584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734103710 msgr2=0x7f8734074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f872bfff640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734103710 0x7f8734074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f872bfff640 1 -- 172.21.15.18:0/1191444584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8734101b60 msgr2=0x7f8734075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.952+0000 7f872bfff640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8734101b60 0x7f8734075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.953+0000 7f872bfff640 1 -- 172.21.15.18:0/1191444584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87340753b0 con 0x7f8734102d50 2024-09-19T10:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.953+0000 7f872bfff640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734102d50 0x7f87340745e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f871c00e9f0 tx=0x7f871c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.953+0000 7f87317fa640 1 -- 172.21.15.18:0/1191444584 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c00cd80 con 0x7f8734102d50 2024-09-19T10:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.953+0000 7f87317fa640 1 -- 172.21.15.18:0/1191444584 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f871c010910 con 0x7f8734102d50 2024-09-19T10:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.953+0000 7f87317fa640 1 -- 172.21.15.18:0/1191444584 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c018990 con 0x7f8734102d50 2024-09-19T10:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.953+0000 7f8739e5e640 1 -- 172.21.15.18:0/1191444584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87341a1e50 con 0x7f8734102d50 2024-09-19T10:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.953+0000 7f8739e5e640 1 -- 172.21.15.18:0/1191444584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87341a22c0 con 0x7f8734102d50 2024-09-19T10:02:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f87317fa640 1 -- 172.21.15.18:0/1191444584 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f871c010ac0 con 0x7f8734102d50 2024-09-19T10:02:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f873cbfd740 1 Processor -- start 2024-09-19T10:02:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f873cbfd740 1 -- start start 2024-09-19T10:02:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8aa370 0x55e37a8ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f873cbfd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e37a8082f0 con 0x55e37a8a49a0 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f873cbfd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e37a7b0270 con 0x55e37a8a52e0 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f873cbfd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e37a8042b0 con 0x55e37a8aa370 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f8733fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f8733fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8a4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44818/0 (socket says 172.21.15.18:44818) 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f8733fff640 1 -- 172.21.15.18:0/640876581 learned_addr learned my addr 172.21.15.18:0/640876581 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f87337fe640 1 --2- 172.21.15.18:0/640876581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.956+0000 7f872bfff640 1 --2- 172.21.15.18:0/640876581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8aa370 0x55e37a8ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f8733fff640 1 -- 172.21.15.18:0/640876581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8aa370 msgr2=0x55e37a8ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f87317fa640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87200a3370 0x7f87200a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f8733fff640 1 --2- 172.21.15.18:0/640876581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8aa370 0x55e37a8ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f8733fff640 1 -- 172.21.15.18:0/640876581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 msgr2=0x55e37a8a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f8733fff640 1 --2- 172.21.15.18:0/640876581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f8733fff640 1 -- 172.21.15.18:0/640876581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e37a7af340 con 0x55e37a8a49a0 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f87337fe640 1 --2- 172.21.15.18:0/640876581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f87317fa640 1 -- 172.21.15.18:0/1191444584 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f871c0cfb10 con 0x7f8734102d50 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f8733fff640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87200a3370 0x7f87200a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f8733fff640 1 --2- 172.21.15.18:0/640876581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8a4da0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f872c009ca0 tx=0x7f872c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b20a1ab6a2bd854 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f8729ffb640 1 -- 172.21.15.18:0/640876581 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c031450 con 0x55e37a8a49a0 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f8729ffb640 1 -- 172.21.15.18:0/640876581 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f872c036040 con 0x55e37a8a49a0 2024-09-19T10:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.957+0000 7f8729ffb640 1 -- 172.21.15.18:0/640876581 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c045400 con 0x55e37a8a49a0 2024-09-19T10:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f873cbfd740 1 -- 172.21.15.18:0/640876581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 msgr2=0x55e37a8a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f8733fff640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87200a3370 0x7f87200a5830 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f872c04a000 tx=0x7f872c04b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f873cbfd740 1 --2- 172.21.15.18:0/640876581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8a4da0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f872c009ca0 tx=0x7f872c009360 comp rx=0 tx=0).stop 2024-09-19T10:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f873cbfd740 1 -- 172.21.15.18:0/640876581 shutdown_connections 2024-09-19T10:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f873cbfd740 1 --2- 172.21.15.18:0/640876581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8aa370 0x55e37a8ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f873cbfd740 1 --2- 172.21.15.18:0/640876581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f873cbfd740 1 --2- 172.21.15.18:0/640876581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8a4da0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f873cbfd740 1 -- 172.21.15.18:0/640876581 >> 172.21.15.18:0/640876581 conn(0x55e37a8a0010 msgr2=0x55e37a8a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f873cbfd740 1 -- 172.21.15.18:0/640876581 shutdown_connections 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f873cbfd740 1 -- 172.21.15.18:0/640876581 wait complete. 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.958+0000 7f873cbfd740 1 -- start start 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f873cbfd740 1 Processor -- start 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8a49a0 0x55e37a8ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8aef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f873cbfd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e37a8ad160 con 0x55e37a8aa370 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f873cbfd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e37a791290 con 0x55e37a8a52e0 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f873cbfd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e37a8ad2e0 con 0x55e37a8a49a0 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f873cbfd740 10 client.0 _ll_register_callbacks cb 0x55e37a7c2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f8733fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f8733fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44826/0 (socket says 172.21.15.18:44826) 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f8733fff640 1 -- 172.21.15.18:0/3689701161 learned_addr learned my addr 172.21.15.18:0/3689701161 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f872bfff640 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f87337fe640 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8a49a0 0x55e37a8ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f8733fff640 1 -- 172.21.15.18:0/3689701161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8a49a0 msgr2=0x55e37a8ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f8733fff640 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8a49a0 0x55e37a8ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f8733fff640 1 -- 172.21.15.18:0/3689701161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 msgr2=0x55e37a8aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.959+0000 7f8733fff640 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8aef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f8733fff640 1 -- 172.21.15.18:0/3689701161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e37a51b210 con 0x55e37a8aa370 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f8733fff640 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8b5f60 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f872c031ae0 tx=0x7f872c02b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bded646d6469ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f8712ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f8712ffd640 1 -- 172.21.15.18:0/3689701161 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c045400 con 0x55e37a8aa370 2024-09-19T10:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f873cbfd740 1 -- 172.21.15.18:0/3689701161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f872c036040 con 0x55e37a8aa370 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f8712ffd640 1 -- 172.21.15.18:0/3689701161 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f872c02fb70 con 0x55e37a8aa370 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f8712ffd640 1 -- 172.21.15.18:0/3689701161 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f872c02fd70 con 0x55e37a8aa370 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f873cbfd740 10 client.17748 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f873cbfd740 1 -- 172.21.15.18:0/3689701161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e37a5e7620 con 0x55e37a8aa370 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f8712ffd640 1 -- 172.21.15.18:0/3689701161 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f872c036040 con 0x55e37a8aa370 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.960+0000 7f8712ffd640 1 -- 172.21.15.18:0/3689701161 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f872c045c20 con 0x55e37a8aa370 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.961+0000 7f873cbfd740 10 client.17748 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.961+0000 7f873cbfd740 10 client.17748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.961+0000 7f873cbfd740 20 client.17748 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.961+0000 7f873cbfd740 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e37a8ba320 0x55e37a8bc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.961+0000 7f873cbfd740 4 client.17748 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.961+0000 7f873cbfd740 1 -- 172.21.15.18:0/3689701161 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e37a815a20 con 0x55e37a8ba320 2024-09-19T10:02:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.961+0000 7f87337fe640 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e37a8ba320 0x55e37a8bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.961+0000 7f87337fe640 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e37a8ba320 0x55e37a8bc710 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc67e2ac1f09a068 server_cookie=3e3504a31cb3c4df in_seq=0 out_seq=0 2024-09-19T10:02:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.961+0000 7f8712ffd640 10 client.17748 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f8712ffd640 1 -- 172.21.15.18:0/3689701161 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e37a815a20 con 0x55e37a8ba320 2024-09-19T10:02:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f8712ffd640 10 client.17748 handle_command_reply: tid=0 2024-09-19T10:02:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 client.17748 shutdown 2024-09-19T10:02:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 -- 172.21.15.18:0/3689701161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 msgr2=0x55e37a8b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8b5f60 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f872c031ae0 tx=0x7f872c02b040 comp rx=0 tx=0).stop 2024-09-19T10:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 -- 172.21.15.18:0/3689701161 shutdown_connections 2024-09-19T10:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e37a8ba320 0x55e37a8bc710 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8b5f60 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 --2- 172.21.15.18:0/3689701161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8a49a0 0x55e37a8ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f8712ffd640 0 client.17748 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 -- 172.21.15.18:0/3689701161 >> 172.21.15.18:0/3689701161 conn(0x55e37a8a0010 msgr2=0x55e37a8a1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 -- 172.21.15.18:0/3689701161 shutdown_connections 2024-09-19T10:02:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.962+0000 7f873cbfd740 1 -- 172.21.15.18:0/3689701161 wait complete. 2024-09-19T10:02:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.963+0000 7f873cbfd740 20 client.17748 trim_cache size 0 max 16384 2024-09-19T10:02:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.977+0000 7f873cbfd740 1 Processor -- start 2024-09-19T10:02:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.977+0000 7f873cbfd740 1 -- start start 2024-09-19T10:02:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.977+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a49a0 0x55e37a89f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.977+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8a52e0 0x55e37a8b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.977+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.977+0000 7f873cbfd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87341ab100 con 0x55e37a8aa370 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.977+0000 7f873cbfd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f87341acc40 con 0x55e37a8a49a0 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.977+0000 7f873cbfd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87341ab7d0 con 0x55e37a8a52e0 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f8733fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f8733fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8c0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44842/0 (socket says 172.21.15.18:44842) 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f8733fff640 1 -- 172.21.15.18:0/3207329756 learned_addr learned my addr 172.21.15.18:0/3207329756 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f87337fe640 1 --2- 172.21.15.18:0/3207329756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a49a0 0x55e37a89f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f872bfff640 1 --2- 172.21.15.18:0/3207329756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8a52e0 0x55e37a8b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f8733fff640 1 -- 172.21.15.18:0/3207329756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8a52e0 msgr2=0x55e37a8b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f8733fff640 1 --2- 172.21.15.18:0/3207329756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8a52e0 0x55e37a8b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f8733fff640 1 -- 172.21.15.18:0/3207329756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a49a0 msgr2=0x55e37a89f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f8733fff640 1 --2- 172.21.15.18:0/3207329756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a49a0 0x55e37a89f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f8733fff640 1 -- 172.21.15.18:0/3207329756 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e37a8bca80 con 0x55e37a8aa370 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f8733fff640 1 --2- 172.21.15.18:0/3207329756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8c0ff0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f872c002230 tx=0x7f872c031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c2c91223330d98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f87297fa640 1 -- 172.21.15.18:0/3207329756 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c045400 con 0x55e37a8aa370 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f87297fa640 1 -- 172.21.15.18:0/3207329756 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f872c036070 con 0x55e37a8aa370 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.978+0000 7f87297fa640 1 -- 172.21.15.18:0/3207329756 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c0047c0 con 0x55e37a8aa370 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 -- 172.21.15.18:0/3207329756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 msgr2=0x55e37a8c0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 --2- 172.21.15.18:0/3207329756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8c0ff0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f872c002230 tx=0x7f872c031000 comp rx=0 tx=0).stop 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 -- 172.21.15.18:0/3207329756 shutdown_connections 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 --2- 172.21.15.18:0/3207329756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8aa370 0x55e37a8c0ff0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 --2- 172.21.15.18:0/3207329756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8a52e0 0x55e37a8b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 --2- 172.21.15.18:0/3207329756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a49a0 0x55e37a89f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 -- 172.21.15.18:0/3207329756 >> 172.21.15.18:0/3207329756 conn(0x55e37a8a0010 msgr2=0x55e37a89e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 -- 172.21.15.18:0/3207329756 shutdown_connections 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 -- 172.21.15.18:0/3207329756 wait complete. 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 -- start start 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.979+0000 7f873cbfd740 1 Processor -- start 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f873cbfd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8aa370 0x55e37a8b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f873cbfd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87341ac570 con 0x55e37a8a49a0 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f873cbfd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f87341abea0 con 0x55e37a8a52e0 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f873cbfd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87341a90e0 con 0x55e37a8aa370 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f873cbfd740 10 client.0 _ll_register_callbacks cb 0x7f872c004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f87337fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f87337fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44854/0 (socket says 172.21.15.18:44854) 2024-09-19T10:02:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f87337fe640 1 -- 172.21.15.18:0/2961079423 learned_addr learned my addr 172.21.15.18:0/2961079423 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f8733fff640 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8aa370 0x55e37a8b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f872bfff640 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f87337fe640 1 -- 172.21.15.18:0/2961079423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8aa370 msgr2=0x55e37a8b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f87337fe640 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8aa370 0x55e37a8b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f87337fe640 1 -- 172.21.15.18:0/2961079423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 msgr2=0x55e37a8b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f87337fe640 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f87337fe640 1 -- 172.21.15.18:0/2961079423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e37a8b4ec0 con 0x55e37a8a49a0 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f87337fe640 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8b33b0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f8724000c00 tx=0x7f8724004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a4ecec5aebf95e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f8712ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f8712ffd640 1 -- 172.21.15.18:0/2961079423 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724005020 con 0x55e37a8a49a0 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f8712ffd640 1 -- 172.21.15.18:0/2961079423 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f87240051c0 con 0x55e37a8a49a0 2024-09-19T10:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.980+0000 7f873cbfd740 1 -- 172.21.15.18:0/2961079423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f872c036070 con 0x55e37a8a49a0 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f8712ffd640 1 -- 172.21.15.18:0/2961079423 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f872402d050 con 0x55e37a8a49a0 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f873cbfd740 10 client.17754 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f873cbfd740 1 -- 172.21.15.18:0/2961079423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e37a924fd0 con 0x55e37a8a49a0 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f8712ffd640 1 -- 172.21.15.18:0/2961079423 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f872c036070 con 0x55e37a8a49a0 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f8712ffd640 1 -- 172.21.15.18:0/2961079423 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f872401d540 con 0x55e37a8a49a0 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f873cbfd740 10 client.17754 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f873cbfd740 10 client.17754 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f873cbfd740 20 client.17754 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f873cbfd740 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e37a925710 0x55e37a927b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f873cbfd740 4 client.17754 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f873cbfd740 1 -- 172.21.15.18:0/2961079423 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e37a80fd70 con 0x55e37a925710 2024-09-19T10:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.981+0000 7f872bfff640 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e37a925710 0x55e37a927b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.982+0000 7f872bfff640 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e37a925710 0x55e37a927b30 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b931faa59bb83124 server_cookie=aa7fcb90ae2050f in_seq=0 out_seq=0 2024-09-19T10:02:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.982+0000 7f8712ffd640 10 client.17754 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f8712ffd640 1 -- 172.21.15.18:0/2961079423 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e37a80fd70 con 0x55e37a925710 2024-09-19T10:02:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f8712ffd640 10 client.17754 handle_command_reply: tid=0 2024-09-19T10:02:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 client.17754 shutdown 2024-09-19T10:02:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 -- 172.21.15.18:0/2961079423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 msgr2=0x55e37a8b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8b33b0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f8724000c00 tx=0x7f8724004410 comp rx=0 tx=0).stop 2024-09-19T10:02:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 -- 172.21.15.18:0/2961079423 shutdown_connections 2024-09-19T10:02:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55e37a925710 0x55e37a927b30 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e37a8aa370 0x55e37a8b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e37a8a52e0 0x55e37a8b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f8712ffd640 0 client.17754 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 --2- 172.21.15.18:0/2961079423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e37a8a49a0 0x55e37a8b33b0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 -- 172.21.15.18:0/2961079423 >> 172.21.15.18:0/2961079423 conn(0x55e37a8a0010 msgr2=0x55e37a89e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 -- 172.21.15.18:0/2961079423 shutdown_connections 2024-09-19T10:02:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 1 -- 172.21.15.18:0/2961079423 wait complete. 2024-09-19T10:02:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.991+0000 7f873cbfd740 20 client.17754 trim_cache size 0 max 16384 2024-09-19T10:02:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:02:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:02:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:02:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:02:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 -- 172.21.15.18:0/1191444584 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87200a3370 msgr2=0x7f87200a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87200a3370 0x7f87200a5830 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f872c04a000 tx=0x7f872c04b000 comp rx=0 tx=0).stop 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 -- 172.21.15.18:0/1191444584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734102d50 msgr2=0x7f87340745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734102d50 0x7f87340745e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f871c00e9f0 tx=0x7f871c00eeb0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 -- 172.21.15.18:0/1191444584 shutdown_connections 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f87200a3370 0x7f87200a5830 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8734103710 0x7f8734074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8734102d50 0x7f87340745e0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 --2- 172.21.15.18:0/1191444584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8734101b60 0x7f8734075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 -- 172.21.15.18:0/1191444584 >> 172.21.15.18:0/1191444584 conn(0x7f87340fd2e0 msgr2=0x7f8734105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 -- 172.21.15.18:0/1191444584 shutdown_connections 2024-09-19T10:02:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:44.992+0000 7f8739e5e640 1 -- 172.21.15.18:0/1191444584 wait complete. 2024-09-19T10:02:46.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:45 smithi049 ceph-mon[34858]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 38 KiB/s rd, 75 MiB/s wr, 142 op/s 2024-09-19T10:02:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:45 smithi162 ceph-mon[35174]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 38 KiB/s rd, 75 MiB/s wr, 142 op/s 2024-09-19T10:02:46.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:45 smithi018 ceph-mon[30956]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 38 KiB/s rd, 75 MiB/s wr, 142 op/s 2024-09-19T10:02:47.994 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T10:02:48.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:47 smithi162 ceph-mon[35174]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 66 MiB/s wr, 199 op/s 2024-09-19T10:02:48.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:47 smithi018 ceph-mon[30956]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 66 MiB/s wr, 199 op/s 2024-09-19T10:02:48.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:47 smithi049 ceph-mon[34858]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 66 MiB/s wr, 199 op/s 2024-09-19T10:02:48.428 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:49.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.097+0000 7f67a564d640 1 -- 172.21.15.18:0/22993358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67a0101420 msgr2=0x7f67a010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:49.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.097+0000 7f67a564d640 1 --2- 172.21.15.18:0/22993358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67a0101420 0x7f67a010d950 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f6798009cd0 tx=0x7f679802a8e0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.097+0000 7f67a564d640 1 -- 172.21.15.18:0/22993358 shutdown_connections 2024-09-19T10:02:49.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.097+0000 7f67a564d640 1 --2- 172.21.15.18:0/22993358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67a0101420 0x7f67a010d950 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.097+0000 7f67a564d640 1 --2- 172.21.15.18:0/22993358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67a0100a80 0x7f67a0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.097+0000 7f67a564d640 1 --2- 172.21.15.18:0/22993358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67a0106a80 0x7f67a0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.097+0000 7f67a564d640 1 -- 172.21.15.18:0/22993358 >> 172.21.15.18:0/22993358 conn(0x7f67a00fc7a0 msgr2=0x7f67a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:49.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.097+0000 7f67a564d640 1 -- 172.21.15.18:0/22993358 shutdown_connections 2024-09-19T10:02:49.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.097+0000 7f67a564d640 1 -- 172.21.15.18:0/22993358 wait complete. 2024-09-19T10:02:49.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f67a564d640 1 Processor -- start 2024-09-19T10:02:49.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f67a564d640 1 -- start start 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f67a564d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67a0100a80 0x7f67a00fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f67a564d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67a0101420 0x7f67a00fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f67a564d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67a0106a80 0x7f67a00fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f67a564d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0110e80 con 0x7f67a0106a80 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f67a564d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0110d00 con 0x7f67a0100a80 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f67a564d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0111000 con 0x7f67a0101420 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f679f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67a0106a80 0x7f67a00fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f679f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67a0106a80 0x7f67a00fd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41634/0 (socket says 172.21.15.18:41634) 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.098+0000 7f679f7fe640 1 -- 172.21.15.18:0/336409360 learned_addr learned my addr 172.21.15.18:0/336409360 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f6797fff640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67a0101420 0x7f67a00fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f679effd640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67a0100a80 0x7f67a00fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f679f7fe640 1 -- 172.21.15.18:0/336409360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67a0101420 msgr2=0x7f67a00fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f679f7fe640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67a0101420 0x7f67a00fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f679f7fe640 1 -- 172.21.15.18:0/336409360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67a0100a80 msgr2=0x7f67a00fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f679f7fe640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67a0100a80 0x7f67a00fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f679f7fe640 1 -- 172.21.15.18:0/336409360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a01a6960 con 0x7f67a0106a80 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f679f7fe640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67a0106a80 0x7f67a00fd7c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6798005cc0 tx=0x7f6798032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f679cff9640 1 -- 172.21.15.18:0/336409360 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798004040 con 0x7f67a0106a80 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f679cff9640 1 -- 172.21.15.18:0/336409360 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67980046c0 con 0x7f67a0106a80 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f67a564d640 1 -- 172.21.15.18:0/336409360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a01a6bf0 con 0x7f67a0106a80 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f679cff9640 1 -- 172.21.15.18:0/336409360 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798030e00 con 0x7f67a0106a80 2024-09-19T10:02:49.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.099+0000 7f67a564d640 1 -- 172.21.15.18:0/336409360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a01a7130 con 0x7f67a0106a80 2024-09-19T10:02:49.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.101+0000 7f679cff9640 1 -- 172.21.15.18:0/336409360 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f67980305a0 con 0x7f67a0106a80 2024-09-19T10:02:49.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f67a7a26740 1 Processor -- start 2024-09-19T10:02:49.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f67a7a26740 1 -- start start 2024-09-19T10:02:49.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 0x558112cda880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112ce5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112ce5680 0x558112ce7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f67a7a26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558112c402e0 con 0x558112cdadc0 2024-09-19T10:02:49.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f67a7a26740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558112be7ce0 con 0x558112cda4a0 2024-09-19T10:02:49.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f67a7a26740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558112c3c2a0 con 0x558112ce5680 2024-09-19T10:02:49.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f679cff9640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f678c0a3240 0x7f678c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f679effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112ce5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f679effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112ce5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41650/0 (socket says 172.21.15.18:41650) 2024-09-19T10:02:49.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.102+0000 7f679effd640 1 -- 172.21.15.18:0/2368799617 learned_addr learned my addr 172.21.15.18:0/2368799617 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:49.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f6797fff640 1 --2- 172.21.15.18:0/2368799617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 0x558112cda880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f6797fff640 1 --2- 172.21.15.18:0/2368799617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112ce5680 0x558112ce7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f679f7fe640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f678c0a3240 0x7f678c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f679effd640 1 -- 172.21.15.18:0/2368799617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112ce5680 msgr2=0x558112ce7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:49.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f679effd640 1 --2- 172.21.15.18:0/2368799617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112ce5680 0x558112ce7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f679effd640 1 -- 172.21.15.18:0/2368799617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 msgr2=0x558112cda880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:49.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f679effd640 1 --2- 172.21.15.18:0/2368799617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 0x558112cda880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f679effd640 1 -- 172.21.15.18:0/2368799617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558112bcc440 con 0x558112cdadc0 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f679cff9640 1 -- 172.21.15.18:0/336409360 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f679802e030 con 0x7f67a0106a80 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f6797fff640 1 --2- 172.21.15.18:0/2368799617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 0x558112cda880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f679effd640 1 --2- 172.21.15.18:0/2368799617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112ce5140 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f679000dc30 tx=0x7f679000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a01e4e2bcad116b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f679f7fe640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f678c0a3240 0x7f678c0a5700 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f67980bd450 tx=0x7f6798088580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f67957fa640 1 -- 172.21.15.18:0/2368799617 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790011440 con 0x558112cdadc0 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f67957fa640 1 -- 172.21.15.18:0/2368799617 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6790017070 con 0x558112cdadc0 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.103+0000 7f67957fa640 1 -- 172.21.15.18:0/2368799617 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900109c0 con 0x558112cdadc0 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.104+0000 7f67a7a26740 1 -- 172.21.15.18:0/2368799617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 msgr2=0x558112ce5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.104+0000 7f67a7a26740 1 --2- 172.21.15.18:0/2368799617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112ce5140 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f679000dc30 tx=0x7f679000f730 comp rx=0 tx=0).stop 2024-09-19T10:02:49.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.104+0000 7f67a7a26740 1 -- 172.21.15.18:0/2368799617 shutdown_connections 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.104+0000 7f67a7a26740 1 --2- 172.21.15.18:0/2368799617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112ce5680 0x558112ce7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.104+0000 7f67a7a26740 1 --2- 172.21.15.18:0/2368799617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112ce5140 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.104+0000 7f67a7a26740 1 --2- 172.21.15.18:0/2368799617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 0x558112cda880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.104+0000 7f67a7a26740 1 -- 172.21.15.18:0/2368799617 >> 172.21.15.18:0/2368799617 conn(0x558112cd6a30 msgr2=0x558112cd6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.104+0000 7f67a7a26740 1 -- 172.21.15.18:0/2368799617 shutdown_connections 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.104+0000 7f67a7a26740 1 -- 172.21.15.18:0/2368799617 wait complete. 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.104+0000 7f67a7a26740 1 -- start start 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f67a7a26740 1 Processor -- start 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 0x558112ce4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cdadc0 0x558112ce2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112ce5680 0x558112ce2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f67a7a26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558112ce8250 con 0x558112ce5680 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f67a7a26740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558112bfb050 con 0x558112cda4a0 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f67a7a26740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558112ce83d0 con 0x558112cdadc0 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f67a7a26740 10 client.0 _ll_register_callbacks cb 0x558112c3b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f6797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112ce5680 0x558112ce2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f6797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112ce5680 0x558112ce2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41658/0 (socket says 172.21.15.18:41658) 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f6797fff640 1 -- 172.21.15.18:0/1185282870 learned_addr learned my addr 172.21.15.18:0/1185282870 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f679effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cdadc0 0x558112ce2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f6797fff640 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 0x558112ce4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f6797fff640 1 -- 172.21.15.18:0/1185282870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cdadc0 msgr2=0x558112ce2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f6797fff640 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cdadc0 0x558112ce2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f6797fff640 1 -- 172.21.15.18:0/1185282870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 msgr2=0x558112ce4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f6797fff640 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 0x558112ce4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f6797fff640 1 -- 172.21.15.18:0/1185282870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581129b13c0 con 0x558112ce5680 2024-09-19T10:02:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f679effd640 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cdadc0 0x558112ce2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:02:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f6797fff640 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112ce5680 0x558112ce2790 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f6788010b90 tx=0x7f6788012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b2d0169c2d598a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.105+0000 7f67867fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67867fc640 1 -- 172.21.15.18:0/1185282870 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788016070 con 0x558112ce5680 2024-09-19T10:02:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67867fc640 1 -- 172.21.15.18:0/1185282870 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f678801e3d0 con 0x558112ce5680 2024-09-19T10:02:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67a7a26740 1 -- 172.21.15.18:0/1185282870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6790017070 con 0x558112ce5680 2024-09-19T10:02:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67867fc640 1 -- 172.21.15.18:0/1185282870 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6788019040 con 0x558112ce5680 2024-09-19T10:02:49.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67a7a26740 10 client.17766 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67a7a26740 1 -- 172.21.15.18:0/1185282870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558112cf3c60 con 0x558112ce5680 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67867fc640 1 -- 172.21.15.18:0/1185282870 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6790017070 con 0x558112ce5680 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67867fc640 1 -- 172.21.15.18:0/1185282870 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f678801f040 con 0x558112ce5680 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67a7a26740 10 client.17766 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67a7a26740 10 client.17766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67a7a26740 20 client.17766 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67a7a26740 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558112cf5120 0x558112cf7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67a7a26740 4 client.17766 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.106+0000 7f67a7a26740 1 -- 172.21.15.18:0/1185282870 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558112c4d850 con 0x558112cf5120 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.107+0000 7f679effd640 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558112cf5120 0x558112cf7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.107+0000 7f67867fc640 10 client.17766 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.107+0000 7f679effd640 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558112cf5120 0x558112cf7510 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48707f6c01ba6a1f server_cookie=aa25d28609ac2874 in_seq=0 out_seq=0 2024-09-19T10:02:49.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67867fc640 1 -- 172.21.15.18:0/1185282870 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558112c4d850 con 0x558112cf5120 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67867fc640 10 client.17766 handle_command_reply: tid=0 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 client.17766 shutdown 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 -- 172.21.15.18:0/1185282870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112ce5680 msgr2=0x558112ce2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112ce5680 0x558112ce2790 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f6788010b90 tx=0x7f6788012040 comp rx=0 tx=0).stop 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 -- 172.21.15.18:0/1185282870 shutdown_connections 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558112cf5120 0x558112cf7510 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112ce5680 0x558112ce2790 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67867fc640 0 client.17766 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cdadc0 0x558112ce2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 --2- 172.21.15.18:0/1185282870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cda4a0 0x558112ce4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 -- 172.21.15.18:0/1185282870 >> 172.21.15.18:0/1185282870 conn(0x558112cd6a30 msgr2=0x558112cd5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 -- 172.21.15.18:0/1185282870 shutdown_connections 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 1 -- 172.21.15.18:0/1185282870 wait complete. 2024-09-19T10:02:49.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.108+0000 7f67a7a26740 20 client.17766 trim_cache size 0 max 16384 2024-09-19T10:02:49.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f67a7a26740 1 Processor -- start 2024-09-19T10:02:49.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f67a7a26740 1 -- start start 2024-09-19T10:02:49.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cd6a30 0x558112cf14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cda4a0 0x558112cdd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112cfcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f67a7a26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67a01af6a0 con 0x558112cdadc0 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f67a7a26740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f67a01b11e0 con 0x558112cd6a30 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f67a7a26740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f67a01afd70 con 0x558112cda4a0 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f6797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112cfcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f6797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112cfcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41668/0 (socket says 172.21.15.18:41668) 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f6797fff640 1 -- 172.21.15.18:0/119688922 learned_addr learned my addr 172.21.15.18:0/119688922 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f679effd640 1 --2- 172.21.15.18:0/119688922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cda4a0 0x558112cdd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.126+0000 7f6797fff640 1 --2- 172.21.15.18:0/119688922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cd6a30 0x558112cf14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.127+0000 7f6797fff640 1 -- 172.21.15.18:0/119688922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cda4a0 msgr2=0x558112cdd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.127+0000 7f6797fff640 1 --2- 172.21.15.18:0/119688922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cda4a0 0x558112cdd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.127+0000 7f6797fff640 1 -- 172.21.15.18:0/119688922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cd6a30 msgr2=0x558112cf14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:49.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.127+0000 7f6797fff640 1 --2- 172.21.15.18:0/119688922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cd6a30 0x558112cf14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.127+0000 7f6797fff640 1 -- 172.21.15.18:0/119688922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558112ce5310 con 0x558112cdadc0 2024-09-19T10:02:49.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.127+0000 7f6797fff640 1 --2- 172.21.15.18:0/119688922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112cfcdc0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f67880092e0 tx=0x7f6788001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21238200bfca7aef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:49.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.127+0000 7f6794ff9640 1 -- 172.21.15.18:0/119688922 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788016070 con 0x558112cdadc0 2024-09-19T10:02:49.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.127+0000 7f6794ff9640 1 -- 172.21.15.18:0/119688922 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f678801e5d0 con 0x558112cdadc0 2024-09-19T10:02:49.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.127+0000 7f6794ff9640 1 -- 172.21.15.18:0/119688922 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788021410 con 0x558112cdadc0 2024-09-19T10:02:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.128+0000 7f67a7a26740 1 -- 172.21.15.18:0/119688922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 msgr2=0x558112cfcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.128+0000 7f67a7a26740 1 --2- 172.21.15.18:0/119688922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112cfcdc0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f67880092e0 tx=0x7f6788001e70 comp rx=0 tx=0).stop 2024-09-19T10:02:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.128+0000 7f67a7a26740 1 -- 172.21.15.18:0/119688922 shutdown_connections 2024-09-19T10:02:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.128+0000 7f67a7a26740 1 --2- 172.21.15.18:0/119688922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cdadc0 0x558112cfcdc0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.128+0000 7f67a7a26740 1 --2- 172.21.15.18:0/119688922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cda4a0 0x558112cdd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.128+0000 7f67a7a26740 1 --2- 172.21.15.18:0/119688922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cd6a30 0x558112cf14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.128+0000 7f67a7a26740 1 -- 172.21.15.18:0/119688922 >> 172.21.15.18:0/119688922 conn(0x558112ce28f0 msgr2=0x558112cdcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.128+0000 7f67a7a26740 1 -- 172.21.15.18:0/119688922 shutdown_connections 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.128+0000 7f67a7a26740 1 -- 172.21.15.18:0/119688922 wait complete. 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.128+0000 7f67a7a26740 1 -- start start 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f67a7a26740 1 Processor -- start 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cd6a30 0x558112ce9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cda4a0 0x558112ce99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f67a7a26740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cdadc0 0x558112ce9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f67a7a26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67a01b0b10 con 0x558112cd6a30 2024-09-19T10:02:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f67a7a26740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f67a01b0440 con 0x558112cdadc0 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f67a7a26740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f67a01ad6a0 con 0x558112cda4a0 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f67a7a26740 10 client.0 _ll_register_callbacks cb 0x7f6788009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f6797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cd6a30 0x558112ce9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f6797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cd6a30 0x558112ce9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41672/0 (socket says 172.21.15.18:41672) 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f6797fff640 1 -- 172.21.15.18:0/2012952971 learned_addr learned my addr 172.21.15.18:0/2012952971 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f679effd640 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cda4a0 0x558112ce99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f6797fff640 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cdadc0 0x558112ce9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f6797fff640 1 -- 172.21.15.18:0/2012952971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cda4a0 msgr2=0x558112ce99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f6797fff640 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cda4a0 0x558112ce99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f6797fff640 1 -- 172.21.15.18:0/2012952971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cdadc0 msgr2=0x558112ce9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f6797fff640 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cdadc0 0x558112ce9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.129+0000 7f6797fff640 1 -- 172.21.15.18:0/2012952971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558112d5ee60 con 0x558112cd6a30 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f6797fff640 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cd6a30 0x558112ce9470 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f678800fd20 tx=0x7f6788005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbd62e8025cb5d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67867fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67867fc640 1 -- 172.21.15.18:0/2012952971 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788016040 con 0x558112cd6a30 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67867fc640 1 -- 172.21.15.18:0/2012952971 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f678802c630 con 0x558112cd6a30 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67a7a26740 1 -- 172.21.15.18:0/2012952971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f678801e5d0 con 0x558112cd6a30 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67867fc640 1 -- 172.21.15.18:0/2012952971 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f678802de90 con 0x558112cd6a30 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67a7a26740 10 client.17772 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67a7a26740 1 -- 172.21.15.18:0/2012952971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558112d60150 con 0x558112cd6a30 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67867fc640 1 -- 172.21.15.18:0/2012952971 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f678801e5d0 con 0x558112cd6a30 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67867fc640 1 -- 172.21.15.18:0/2012952971 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f67880047a0 con 0x558112cd6a30 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67a7a26740 10 client.17772 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67a7a26740 10 client.17772 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67a7a26740 20 client.17772 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67a7a26740 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558112ce5680 0x558112d62850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67a7a26740 4 client.17772 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.130+0000 7f67a7a26740 1 -- 172.21.15.18:0/2012952971 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558112c47d60 con 0x558112ce5680 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.131+0000 7f679effd640 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558112ce5680 0x558112d62850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.131+0000 7f679effd640 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558112ce5680 0x558112d62850 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bb0d3c69d7d8196 server_cookie=bfc5be519f8fcb9b in_seq=0 out_seq=0 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.131+0000 7f67867fc640 10 client.17772 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.131+0000 7f67867fc640 1 -- 172.21.15.18:0/2012952971 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558112c47d60 con 0x558112ce5680 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.131+0000 7f67867fc640 10 client.17772 handle_command_reply: tid=0 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.131+0000 7f67a7a26740 1 client.17772 shutdown 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 1 -- 172.21.15.18:0/2012952971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cd6a30 msgr2=0x558112ce9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cd6a30 0x558112ce9470 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f678800fd20 tx=0x7f6788005850 comp rx=0 tx=0).stop 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 1 -- 172.21.15.18:0/2012952971 shutdown_connections 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x558112ce5680 0x558112d62850 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67867fc640 0 client.17772 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:49.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558112cdadc0 0x558112ce9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558112cda4a0 0x558112ce99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 1 --2- 172.21.15.18:0/2012952971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558112cd6a30 0x558112ce9470 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 1 -- 172.21.15.18:0/2012952971 >> 172.21.15.18:0/2012952971 conn(0x558112ce28f0 msgr2=0x558112cdd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:49.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 1 -- 172.21.15.18:0/2012952971 shutdown_connections 2024-09-19T10:02:49.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 1 -- 172.21.15.18:0/2012952971 wait complete. 2024-09-19T10:02:49.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a7a26740 20 client.17772 trim_cache size 0 max 16384 2024-09-19T10:02:49.140 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:02:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T10:02:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T10:02:49.141 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:02:49.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a564d640 1 -- 172.21.15.18:0/336409360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f678c0a3240 msgr2=0x7f678c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:49.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a564d640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f678c0a3240 0x7f678c0a5700 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f67980bd450 tx=0x7f6798088580 comp rx=0 tx=0).stop 2024-09-19T10:02:49.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a564d640 1 -- 172.21.15.18:0/336409360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67a0106a80 msgr2=0x7f67a00fd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.132+0000 7f67a564d640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67a0106a80 0x7f67a00fd7c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6798005cc0 tx=0x7f6798032f40 comp rx=0 tx=0).stop 2024-09-19T10:02:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.133+0000 7f67a564d640 1 -- 172.21.15.18:0/336409360 shutdown_connections 2024-09-19T10:02:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.133+0000 7f67a564d640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f678c0a3240 0x7f678c0a5700 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.133+0000 7f67a564d640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67a0106a80 0x7f67a00fd7c0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.133+0000 7f67a564d640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67a0101420 0x7f67a00fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.133+0000 7f67a564d640 1 --2- 172.21.15.18:0/336409360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67a0100a80 0x7f67a00fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.133+0000 7f67a564d640 1 -- 172.21.15.18:0/336409360 >> 172.21.15.18:0/336409360 conn(0x7f67a00fc7a0 msgr2=0x7f67a006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.133+0000 7f67a564d640 1 -- 172.21.15.18:0/336409360 shutdown_connections 2024-09-19T10:02:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:49.133+0000 7f67a564d640 1 -- 172.21.15.18:0/336409360 wait complete. 2024-09-19T10:02:49.917 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:49 smithi018 ceph-mon[30956]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 69 MiB/s wr, 297 op/s 2024-09-19T10:02:49.919 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T10:02:49.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:02:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:49 smithi162 ceph-mon[35174]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 69 MiB/s wr, 297 op/s 2024-09-19T10:02:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:50.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:49 smithi049 ceph-mon[34858]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 69 MiB/s wr, 297 op/s 2024-09-19T10:02:50.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.671+0000 7f5740cf9640 1 -- 172.21.15.18:0/1955481803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f573c100e20 msgr2=0x7f573c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:50.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.671+0000 7f5740cf9640 1 --2- 172.21.15.18:0/1955481803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f573c100e20 0x7f573c101200 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f572c009900 tx=0x7f572c02a480 comp rx=0 tx=0).stop 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.671+0000 7f5740cf9640 1 -- 172.21.15.18:0/1955481803 shutdown_connections 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.671+0000 7f5740cf9640 1 --2- 172.21.15.18:0/1955481803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573c102ef0 0x7f573c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.671+0000 7f5740cf9640 1 --2- 172.21.15.18:0/1955481803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f573c102570 0x7f573c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.671+0000 7f5740cf9640 1 --2- 172.21.15.18:0/1955481803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f573c100e20 0x7f573c101200 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.671+0000 7f5740cf9640 1 -- 172.21.15.18:0/1955481803 >> 172.21.15.18:0/1955481803 conn(0x7f573c0fc7d0 msgr2=0x7f573c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.671+0000 7f5740cf9640 1 -- 172.21.15.18:0/1955481803 shutdown_connections 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.671+0000 7f5740cf9640 1 -- 172.21.15.18:0/1955481803 wait complete. 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5740cf9640 1 Processor -- start 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5740cf9640 1 -- start start 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5740cf9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573c100e20 0x7f573c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5740cf9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f573c102570 0x7f573c198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:50.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5740cf9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f573c102ef0 0x7f573c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5740cf9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f573c110f80 con 0x7f573c102570 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5740cf9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f573c110e00 con 0x7f573c102ef0 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5740cf9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f573c111100 con 0x7f573c100e20 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5739d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f573c102570 0x7f573c198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5739d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f573c102570 0x7f573c198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41692/0 (socket says 172.21.15.18:41692) 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f5739d9b640 1 -- 172.21.15.18:0/3860046674 learned_addr learned my addr 172.21.15.18:0/3860046674 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.672+0000 7f573a59c640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573c100e20 0x7f573c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f573ad9d640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f573c102ef0 0x7f573c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f5739d9b640 1 -- 172.21.15.18:0/3860046674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573c100e20 msgr2=0x7f573c198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f5739d9b640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573c100e20 0x7f573c198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f5739d9b640 1 -- 172.21.15.18:0/3860046674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f573c102ef0 msgr2=0x7f573c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f5739d9b640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f573c102ef0 0x7f573c19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:50.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f5739d9b640 1 -- 172.21.15.18:0/3860046674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573c19d4b0 con 0x7f573c102570 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f573ad9d640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f573c102ef0 0x7f573c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f5739d9b640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f573c102570 0x7f573c198a40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f572400d950 tx=0x7f572400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f57337fe640 1 -- 172.21.15.18:0/3860046674 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5724017070 con 0x7f573c102570 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f57337fe640 1 -- 172.21.15.18:0/3860046674 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5724009c30 con 0x7f573c102570 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f5740cf9640 1 -- 172.21.15.18:0/3860046674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573c19d7a0 con 0x7f573c102570 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f57337fe640 1 -- 172.21.15.18:0/3860046674 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572400f6b0 con 0x7f573c102570 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.673+0000 7f5740cf9640 1 -- 172.21.15.18:0/3860046674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f573c1a5080 con 0x7f573c102570 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.674+0000 7f5740cf9640 1 -- 172.21.15.18:0/3860046674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573c101200 con 0x7f573c102570 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.675+0000 7f57337fe640 1 -- 172.21.15.18:0/3860046674 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f57240109d0 con 0x7f573c102570 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.676+0000 7f57337fe640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57280a3240 0x7f57280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.676+0000 7f573a59c640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57280a3240 0x7f57280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.676+0000 7f57337fe640 1 -- 172.21.15.18:0/3860046674 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f57240cf5d0 con 0x7f573c102570 2024-09-19T10:02:50.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.677+0000 7f573a59c640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57280a3240 0x7f57280a5700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f572c009230 tx=0x7f572c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:50.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.680+0000 7f57337fe640 1 -- 172.21.15.18:0/3860046674 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5724009de0 con 0x7f573c102570 2024-09-19T10:02:50.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.894+0000 7f5740cf9640 1 -- 172.21.15.18:0/3860046674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f573c10a0a0 con 0x7f573c102570 2024-09-19T10:02:50.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.894+0000 7f57337fe640 1 -- 172.21.15.18:0/3860046674 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f572409c2c0 con 0x7f573c102570 2024-09-19T10:02:50.897 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:02:50.897 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:02:50.898 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:02:50.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 -- 172.21.15.18:0/3860046674 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57280a3240 msgr2=0x7f57280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:50.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57280a3240 0x7f57280a5700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f572c009230 tx=0x7f572c0058d0 comp rx=0 tx=0).stop 2024-09-19T10:02:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 -- 172.21.15.18:0/3860046674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f573c102570 msgr2=0x7f573c198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f573c102570 0x7f573c198a40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f572400d950 tx=0x7f572400de10 comp rx=0 tx=0).stop 2024-09-19T10:02:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 -- 172.21.15.18:0/3860046674 shutdown_connections 2024-09-19T10:02:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57280a3240 0x7f57280a5700 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f573c102ef0 0x7f573c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f573c102570 0x7f573c198a40 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 --2- 172.21.15.18:0/3860046674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573c100e20 0x7f573c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 -- 172.21.15.18:0/3860046674 >> 172.21.15.18:0/3860046674 conn(0x7f573c0fc7d0 msgr2=0x7f573c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 -- 172.21.15.18:0/3860046674 shutdown_connections 2024-09-19T10:02:50.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:50.897+0000 7f5740cf9640 1 -- 172.21.15.18:0/3860046674 wait complete. 2024-09-19T10:02:51.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:50 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3860046674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:02:51.194 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:50 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3860046674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:02:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:50 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3860046674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:02:51.602 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T10:02:51.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:02:51.871 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:52.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:51 smithi162 ceph-mon[35174]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 60 MiB/s wr, 316 op/s 2024-09-19T10:02:52.214 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:51 smithi018 ceph-mon[30956]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 60 MiB/s wr, 316 op/s 2024-09-19T10:02:52.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.296+0000 7f6f94b75640 1 -- 172.21.15.18:0/3143122006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90106f10 msgr2=0x7f6f9010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:52.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.296+0000 7f6f94b75640 1 --2- 172.21.15.18:0/3143122006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90106f10 0x7f6f9010ea90 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009ca0 tx=0x7f6f8802a8c0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.296+0000 7f6f94b75640 1 -- 172.21.15.18:0/3143122006 shutdown_connections 2024-09-19T10:02:52.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.296+0000 7f6f94b75640 1 --2- 172.21.15.18:0/3143122006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90106f10 0x7f6f9010ea90 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.296+0000 7f6f94b75640 1 --2- 172.21.15.18:0/3143122006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f90102790 0x7f6f901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.296+0000 7f6f94b75640 1 --2- 172.21.15.18:0/3143122006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f90101de0 0x7f6f901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.296+0000 7f6f94b75640 1 -- 172.21.15.18:0/3143122006 >> 172.21.15.18:0/3143122006 conn(0x7f6f900fd8c0 msgr2=0x7f6f900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.296+0000 7f6f94b75640 1 -- 172.21.15.18:0/3143122006 shutdown_connections 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.296+0000 7f6f94b75640 1 -- 172.21.15.18:0/3143122006 wait complete. 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.297+0000 7f6f94b75640 1 Processor -- start 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.297+0000 7f6f94b75640 1 -- start start 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f94b75640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f90101de0 0x7f6f900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f94b75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90102790 0x7f6f90074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f94b75640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f90106f10 0x7f6f90074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f94b75640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f90111f70 con 0x7f6f90102790 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f94b75640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6f90111df0 con 0x7f6f90101de0 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f94b75640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901120f0 con 0x7f6f90106f10 2024-09-19T10:02:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90102790 0x7f6f90074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90102790 0x7f6f90074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41722/0 (socket says 172.21.15.18:41722) 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/2189376484 learned_addr learned my addr 172.21.15.18:0/2189376484 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8ed9d640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f90106f10 0x7f6f90074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f90101de0 0x7f6f900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/2189376484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f90106f10 msgr2=0x7f6f90074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f90106f10 0x7f6f90074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/2189376484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f90101de0 msgr2=0x7f6f900744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f90101de0 0x7f6f900744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/2189376484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f901a6860 con 0x7f6f90102790 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f90101de0 0x7f6f900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.298+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90102790 0x7f6f90074a30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400e9f0 tx=0x7f6f8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.299+0000 7f6f7f7fe640 1 -- 172.21.15.18:0/2189376484 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400cd80 con 0x7f6f90102790 2024-09-19T10:02:52.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.299+0000 7f6f7f7fe640 1 -- 172.21.15.18:0/2189376484 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f84010910 con 0x7f6f90102790 2024-09-19T10:02:52.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.299+0000 7f6f94b75640 1 -- 172.21.15.18:0/2189376484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f901a6b50 con 0x7f6f90102790 2024-09-19T10:02:52.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.299+0000 7f6f7f7fe640 1 -- 172.21.15.18:0/2189376484 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84018990 con 0x7f6f90102790 2024-09-19T10:02:52.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.299+0000 7f6f94b75640 1 -- 172.21.15.18:0/2189376484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f901a7090 con 0x7f6f90102790 2024-09-19T10:02:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:51 smithi049 ceph-mon[34858]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 60 MiB/s wr, 316 op/s 2024-09-19T10:02:52.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f7f7fe640 1 -- 172.21.15.18:0/2189376484 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6f84010ac0 con 0x7f6f90102790 2024-09-19T10:02:52.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f96f4e740 1 Processor -- start 2024-09-19T10:02:52.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f96f4e740 1 -- start start 2024-09-19T10:02:52.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b2b40 0x55a9583b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b15d0 0x55a9583b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583bc370 0x55a9583be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a9583172f0 con 0x55a9583b15d0 2024-09-19T10:02:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a9582becf0 con 0x55a9583b2b40 2024-09-19T10:02:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a9583132b0 con 0x55a9583bc370 2024-09-19T10:02:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f8e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b15d0 0x55a9583b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f8e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b15d0 0x55a9583b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41736/0 (socket says 172.21.15.18:41736) 2024-09-19T10:02:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f8ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b2b40 0x55a9583b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f8e59c640 1 -- 172.21.15.18:0/578632049 learned_addr learned my addr 172.21.15.18:0/578632049 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.302+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/578632049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583bc370 0x55a9583be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f8e59c640 1 -- 172.21.15.18:0/578632049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583bc370 msgr2=0x55a9583be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/578632049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583bc370 0x55a9583be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f8e59c640 1 -- 172.21.15.18:0/578632049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b2b40 msgr2=0x55a9583b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/578632049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b2b40 0x55a9583b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f8e59c640 1 -- 172.21.15.18:0/578632049 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9582a33a0 con 0x55a9583b15d0 2024-09-19T10:02:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f7f7fe640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6f780a3240 0x7f6f780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f8ed9d640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6f780a3240 0x7f6f780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/578632049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b15d0 0x55a9583b1a10 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000bd40 tx=0x7f6f8000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eaa9a5c0a4f09e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f7f7fe640 1 -- 172.21.15.18:0/2189376484 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6f840cfc20 con 0x7f6f90102790 2024-09-19T10:02:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f7cff9640 1 -- 172.21.15.18:0/578632049 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80015070 con 0x55a9583b15d0 2024-09-19T10:02:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f7cff9640 1 -- 172.21.15.18:0/578632049 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f8000be30 con 0x55a9583b15d0 2024-09-19T10:02:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.303+0000 7f6f7cff9640 1 -- 172.21.15.18:0/578632049 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80011a00 con 0x55a9583b15d0 2024-09-19T10:02:52.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.304+0000 7f6f96f4e740 1 -- 172.21.15.18:0/578632049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b15d0 msgr2=0x55a9583b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:52.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.304+0000 7f6f8ed9d640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6f780a3240 0x7f6f780a5700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6f88004af0 tx=0x7f6f88004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:52.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.304+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/578632049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b15d0 0x55a9583b1a10 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000bd40 tx=0x7f6f8000f730 comp rx=0 tx=0).stop 2024-09-19T10:02:52.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.304+0000 7f6f96f4e740 1 -- 172.21.15.18:0/578632049 shutdown_connections 2024-09-19T10:02:52.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.304+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/578632049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583bc370 0x55a9583be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.304+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/578632049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b15d0 0x55a9583b1a10 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.304+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/578632049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b2b40 0x55a9583b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.304+0000 7f6f96f4e740 1 -- 172.21.15.18:0/578632049 >> 172.21.15.18:0/578632049 conn(0x55a95837a310 msgr2=0x55a9583adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:52.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.304+0000 7f6f96f4e740 1 -- 172.21.15.18:0/578632049 shutdown_connections 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.304+0000 7f6f96f4e740 1 -- 172.21.15.18:0/578632049 wait complete. 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f96f4e740 1 -- start start 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f96f4e740 1 Processor -- start 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b15d0 0x55a9583bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b2b40 0x55a9583b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583bc370 0x55a9583b9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a9583bf070 con 0x55a9583bc370 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a9582d2060 con 0x55a9583b15d0 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a9583bf1f0 con 0x55a9583b2b40 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f96f4e740 10 client.0 _ll_register_callbacks cb 0x55a9580258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f8ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583bc370 0x55a9583b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f8ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583bc370 0x55a9583b9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41752/0 (socket says 172.21.15.18:41752) 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f8ed9d640 1 -- 172.21.15.18:0/438431491 learned_addr learned my addr 172.21.15.18:0/438431491 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b15d0 0x55a9583bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.305+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b2b40 0x55a9583b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f8ed9d640 1 -- 172.21.15.18:0/438431491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b2b40 msgr2=0x55a9583b8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f8ed9d640 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b2b40 0x55a9583b8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f8ed9d640 1 -- 172.21.15.18:0/438431491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b15d0 msgr2=0x55a9583bbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f8ed9d640 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b15d0 0x55a9583bbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f8ed9d640 1 -- 172.21.15.18:0/438431491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9580883c0 con 0x55a9583bc370 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b2b40 0x55a9583b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b15d0 0x55a9583bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f8ed9d640 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583bc370 0x55a9583b9520 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009ca0 tx=0x7f6f8802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379d8836b03e413f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f75ffb640 1 -- 172.21.15.18:0/438431491 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88004250 con 0x55a9583bc370 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f75ffb640 1 -- 172.21.15.18:0/438431491 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6f880043f0 con 0x55a9583bc370 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f96f4e740 1 -- 172.21.15.18:0/438431491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f8000be30 con 0x55a9583bc370 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f75ffb640 1 -- 172.21.15.18:0/438431491 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f880045f0 con 0x55a9583bc370 2024-09-19T10:02:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f96f4e740 10 client.17790 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f96f4e740 1 -- 172.21.15.18:0/438431491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a9583cab20 con 0x55a9583bc370 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f75ffb640 1 -- 172.21.15.18:0/438431491 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f8000be30 con 0x55a9583bc370 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.306+0000 7f6f75ffb640 1 -- 172.21.15.18:0/438431491 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6f880305c0 con 0x55a9583bc370 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.307+0000 7f6f96f4e740 10 client.17790 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.307+0000 7f6f96f4e740 10 client.17790 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.307+0000 7f6f96f4e740 20 client.17790 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.307+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a9583cbfe0 0x55a9583ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.307+0000 7f6f96f4e740 4 client.17790 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.307+0000 7f6f96f4e740 1 -- 172.21.15.18:0/438431491 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a958324860 con 0x55a9583cbfe0 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.307+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a9583cbfe0 0x55a9583ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.307+0000 7f6f75ffb640 10 client.17790 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T10:02:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.307+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a9583cbfe0 0x55a9583ce3f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=742a2da6298ee362 server_cookie=6eb6edfb1ca9f55d in_seq=0 out_seq=0 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f75ffb640 1 -- 172.21.15.18:0/438431491 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a958324860 con 0x55a9583cbfe0 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f75ffb640 10 client.17790 handle_command_reply: tid=0 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 client.17790 shutdown 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 -- 172.21.15.18:0/438431491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583bc370 msgr2=0x55a9583b9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583bc370 0x55a9583b9520 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009ca0 tx=0x7f6f8802a8c0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 -- 172.21.15.18:0/438431491 shutdown_connections 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a9583cbfe0 0x55a9583ce3f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583bc370 0x55a9583b9520 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b2b40 0x55a9583b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/438431491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583b15d0 0x55a9583bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 -- 172.21.15.18:0/438431491 >> 172.21.15.18:0/438431491 conn(0x55a95837a310 msgr2=0x55a9583b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f75ffb640 0 client.17790 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T10:02:52.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 -- 172.21.15.18:0/438431491 shutdown_connections 2024-09-19T10:02:52.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 1 -- 172.21.15.18:0/438431491 wait complete. 2024-09-19T10:02:52.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.308+0000 7f6f96f4e740 20 client.17790 trim_cache size 0 max 16384 2024-09-19T10:02:52.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.321+0000 7f6f96f4e740 1 Processor -- start 2024-09-19T10:02:52.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.321+0000 7f6f96f4e740 1 -- start start 2024-09-19T10:02:52.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.321+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 0x55a9583c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.321+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.321+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583bc370 0x55a9583b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.321+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901af630 con 0x55a9583b2b40 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.321+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901b1170 con 0x55a9583bc370 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.321+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901afd00 con 0x55a9583b15d0 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41766/0 (socket says 172.21.15.18:41766) 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/2613607669 learned_addr learned my addr 172.21.15.18:0/2613607669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8ed9d640 1 --2- 172.21.15.18:0/2613607669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583bc370 0x55a9583b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/2613607669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 0x55a9583c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/2613607669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 msgr2=0x55a9583c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/2613607669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 0x55a9583c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/2613607669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583bc370 msgr2=0x55a9583b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/2613607669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583bc370 0x55a9583b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/2613607669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9583b7550 con 0x55a9583b2b40 2024-09-19T10:02:52.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/2613607669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 0x55a9583c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:02:52.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/2613607669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583b78d0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f6f84098c40 tx=0x7f6f840d3700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87d176477248eb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:52.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f77fff640 1 -- 172.21.15.18:0/2613607669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8409bbd0 con 0x55a9583b2b40 2024-09-19T10:02:52.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f77fff640 1 -- 172.21.15.18:0/2613607669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f8409c970 con 0x55a9583b2b40 2024-09-19T10:02:52.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.322+0000 7f6f77fff640 1 -- 172.21.15.18:0/2613607669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f840a0160 con 0x55a9583b2b40 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 -- 172.21.15.18:0/2613607669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 msgr2=0x55a9583b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/2613607669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583b78d0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f6f84098c40 tx=0x7f6f840d3700 comp rx=0 tx=0).stop 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 -- 172.21.15.18:0/2613607669 shutdown_connections 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/2613607669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583bc370 0x55a9583b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/2613607669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583b78d0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/2613607669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 0x55a9583c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 -- 172.21.15.18:0/2613607669 >> 172.21.15.18:0/2613607669 conn(0x55a95837a310 msgr2=0x55a9583b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 -- 172.21.15.18:0/2613607669 shutdown_connections 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 -- 172.21.15.18:0/2613607669 wait complete. 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 -- start start 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.323+0000 7f6f96f4e740 1 Processor -- start 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 0x55a9583c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f96f4e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583bc370 0x55a9583b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901b0aa0 con 0x55a9583b2b40 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901b03d0 con 0x55a9583bc370 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f96f4e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f901ad610 con 0x55a9583b15d0 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f96f4e740 10 client.0 _ll_register_callbacks cb 0x7f6f88005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41782/0 (socket says 172.21.15.18:41782) 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/3348654554 learned_addr learned my addr 172.21.15.18:0/3348654554 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8ed9d640 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583bc370 0x55a9583b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 0x55a9583c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/3348654554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 msgr2=0x55a9583c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 0x55a9583c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/3348654554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583bc370 msgr2=0x55a9583b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583bc370 0x55a9583b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8dd9b640 1 -- 172.21.15.18:0/3348654554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9583c50e0 con 0x55a9583b2b40 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f8dd9b640 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583c49f0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6f840cdac0 tx=0x7f6f84005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea093b0f5fe7c32e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.324+0000 7f6f75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f75ffb640 1 -- 172.21.15.18:0/3348654554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f840a0620 con 0x55a9583b2b40 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f75ffb640 1 -- 172.21.15.18:0/3348654554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6f840a0160 con 0x55a9583b2b40 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f96f4e740 1 -- 172.21.15.18:0/3348654554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f8409c970 con 0x55a9583b2b40 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f75ffb640 1 -- 172.21.15.18:0/3348654554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f840a4ee0 con 0x55a9583b2b40 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f96f4e740 10 client.17796 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f96f4e740 1 -- 172.21.15.18:0/3348654554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a958436290 con 0x55a9583b2b40 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f75ffb640 1 -- 172.21.15.18:0/3348654554 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f8409c970 con 0x55a9583b2b40 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f75ffb640 1 -- 172.21.15.18:0/3348654554 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6f8409b6c0 con 0x55a9583b2b40 2024-09-19T10:02:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f96f4e740 10 client.17796 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f96f4e740 10 client.17796 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f96f4e740 20 client.17796 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a958436930 0x55a958438d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f96f4e740 4 client.17796 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f96f4e740 1 -- 172.21.15.18:0/3348654554 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a95831ed70 con 0x55a958436930 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.325+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a958436930 0x55a958438d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f75ffb640 10 client.17796 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f8e59c640 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a958436930 0x55a958438d50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=85379b23f6789899 server_cookie=4d49f69b309579a in_seq=0 out_seq=0 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f75ffb640 1 -- 172.21.15.18:0/3348654554 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a95831ed70 con 0x55a958436930 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f75ffb640 10 client.17796 handle_command_reply: tid=0 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 client.17796 shutdown 2024-09-19T10:02:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 -- 172.21.15.18:0/3348654554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 msgr2=0x55a9583c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583c49f0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6f840cdac0 tx=0x7f6f84005c70 comp rx=0 tx=0).stop 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 -- 172.21.15.18:0/3348654554 shutdown_connections 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x55a958436930 0x55a958438d50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a9583bc370 0x55a9583b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9583b2b40 0x55a9583c49f0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 --2- 172.21.15.18:0/3348654554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9583b15d0 0x55a9583c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 -- 172.21.15.18:0/3348654554 >> 172.21.15.18:0/3348654554 conn(0x55a95837a310 msgr2=0x55a9583b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f75ffb640 0 client.17796 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 -- 172.21.15.18:0/3348654554 shutdown_connections 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 1 -- 172.21.15.18:0/3348654554 wait complete. 2024-09-19T10:02:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.326+0000 7f6f96f4e740 20 client.17796 trim_cache size 0 max 16384 2024-09-19T10:02:52.335 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:02:52.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 -- 172.21.15.18:0/2189376484 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6f780a3240 msgr2=0x7f6f780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:52.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6f780a3240 0x7f6f780a5700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6f88004af0 tx=0x7f6f88004a80 comp rx=0 tx=0).stop 2024-09-19T10:02:52.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 -- 172.21.15.18:0/2189376484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90102790 msgr2=0x7f6f90074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:52.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90102790 0x7f6f90074a30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400e9f0 tx=0x7f6f8400eeb0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 -- 172.21.15.18:0/2189376484 shutdown_connections 2024-09-19T10:02:52.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6f780a3240 0x7f6f780a5700 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f90106f10 0x7f6f90074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90102790 0x7f6f90074a30 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 --2- 172.21.15.18:0/2189376484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f90101de0 0x7f6f900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:52.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 -- 172.21.15.18:0/2189376484 >> 172.21.15.18:0/2189376484 conn(0x7f6f900fd8c0 msgr2=0x7f6f900febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:52.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 -- 172.21.15.18:0/2189376484 shutdown_connections 2024-09-19T10:02:52.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:52.327+0000 7f6f94b75640 1 -- 172.21.15.18:0/2189376484 wait complete. 2024-09-19T10:02:53.015 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T10:02:53.052 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:53.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.665+0000 7fa3d9a79640 1 -- 172.21.15.18:0/1552740985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d41012f0 msgr2=0x7fa3d410dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:53.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.665+0000 7fa3d9a79640 1 --2- 172.21.15.18:0/1552740985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d41012f0 0x7fa3d410dfb0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009900 tx=0x7fa3c802a440 comp rx=0 tx=0).stop 2024-09-19T10:02:53.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.665+0000 7fa3d9a79640 1 -- 172.21.15.18:0/1552740985 shutdown_connections 2024-09-19T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.665+0000 7fa3d9a79640 1 --2- 172.21.15.18:0/1552740985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d410e4f0 0x7fa3d41108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.666+0000 7fa3d9a79640 1 --2- 172.21.15.18:0/1552740985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d41012f0 0x7fa3d410dfb0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.666+0000 7fa3d9a79640 1 --2- 172.21.15.18:0/1552740985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d4100940 0x7fa3d4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.666+0000 7fa3d9a79640 1 -- 172.21.15.18:0/1552740985 >> 172.21.15.18:0/1552740985 conn(0x7fa3d40fc790 msgr2=0x7fa3d40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.666+0000 7fa3d9a79640 1 -- 172.21.15.18:0/1552740985 shutdown_connections 2024-09-19T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.667+0000 7fa3d9a79640 1 -- 172.21.15.18:0/1552740985 wait complete. 2024-09-19T10:02:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.668+0000 7fa3d9a79640 1 Processor -- start 2024-09-19T10:02:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.669+0000 7fa3d9a79640 1 -- start start 2024-09-19T10:02:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.670+0000 7fa3d9a79640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d4100940 0x7fa3d410cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.670+0000 7fa3d9a79640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d41012f0 0x7fa3d410d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:53.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.670+0000 7fa3d9a79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d410e4f0 0x7fa3d41a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:53.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.671+0000 7fa3d9a79640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d4103eb0 con 0x7fa3d410e4f0 2024-09-19T10:02:53.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.671+0000 7fa3d9a79640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d4103d30 con 0x7fa3d41012f0 2024-09-19T10:02:53.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.671+0000 7fa3d9a79640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d4104030 con 0x7fa3d4100940 2024-09-19T10:02:53.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.671+0000 7fa3d2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d41012f0 0x7fa3d410d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:53.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.671+0000 7fa3d2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d41012f0 0x7fa3d410d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:47080/0 (socket says 172.21.15.18:47080) 2024-09-19T10:02:53.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.671+0000 7fa3d2ffd640 1 -- 172.21.15.18:0/1455744269 learned_addr learned my addr 172.21.15.18:0/1455744269 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:53.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.671+0000 7fa3d3fff640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d410e4f0 0x7fa3d41a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:53.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.672+0000 7fa3d3fff640 1 -- 172.21.15.18:0/1455744269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d4100940 msgr2=0x7fa3d410cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:53.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.672+0000 7fa3d3fff640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d4100940 0x7fa3d410cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:53.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.672+0000 7fa3d3fff640 1 -- 172.21.15.18:0/1455744269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d41012f0 msgr2=0x7fa3d410d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:53.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.672+0000 7fa3d3fff640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d41012f0 0x7fa3d410d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:53.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.672+0000 7fa3d3fff640 1 -- 172.21.15.18:0/1455744269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d41a3cc0 con 0x7fa3d410e4f0 2024-09-19T10:02:53.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.672+0000 7fa3d2ffd640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d41012f0 0x7fa3d410d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:02:53.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.673+0000 7fa3d3fff640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d410e4f0 0x7fa3d41a35c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4102b20 tx=0x7fa3cc009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:53.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.674+0000 7fa3d0ff9640 1 -- 172.21.15.18:0/1455744269 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc019070 con 0x7fa3d410e4f0 2024-09-19T10:02:53.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.674+0000 7fa3d0ff9640 1 -- 172.21.15.18:0/1455744269 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3cc00ce10 con 0x7fa3d410e4f0 2024-09-19T10:02:53.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.674+0000 7fa3d0ff9640 1 -- 172.21.15.18:0/1455744269 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0128b0 con 0x7fa3d410e4f0 2024-09-19T10:02:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.674+0000 7fa3d9a79640 1 -- 172.21.15.18:0/1455744269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d41a3fb0 con 0x7fa3d410e4f0 2024-09-19T10:02:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.674+0000 7fa3d9a79640 1 -- 172.21.15.18:0/1455744269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d41ab850 con 0x7fa3d410e4f0 2024-09-19T10:02:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.676+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/1455744269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b4005290 con 0x7fa3d410e4f0 2024-09-19T10:02:53.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.683+0000 7fa3d0ff9640 1 -- 172.21.15.18:0/1455744269 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa3cc01c070 con 0x7fa3d410e4f0 2024-09-19T10:02:53.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.684+0000 7fa3d0ff9640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3bc0a3340 0x7fa3bc0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:53.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.684+0000 7fa3d0ff9640 1 -- 172.21.15.18:0/1455744269 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa3cc0cf720 con 0x7fa3d410e4f0 2024-09-19T10:02:53.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.687+0000 7fa3d37fe640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3bc0a3340 0x7fa3bc0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:53.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.688+0000 7fa3d0ff9640 1 -- 172.21.15.18:0/1455744269 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa3cc09c410 con 0x7fa3d410e4f0 2024-09-19T10:02:53.692 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:53.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.689+0000 7fa3d37fe640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3bc0a3340 0x7fa3bc0a5800 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40096f0 tx=0x7fa3c4006c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.920+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/1455744269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3b4005580 con 0x7fa3d410e4f0 2024-09-19T10:02:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.921+0000 7fa3d0ff9640 1 -- 172.21.15.18:0/1455744269 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fa3cc09bd10 con 0x7fa3d410e4f0 2024-09-19T10:02:53.924 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:02:53.924 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:02:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3bc0a3340 msgr2=0x7fa3bc0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3bc0a3340 0x7fa3bc0a5800 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40096f0 tx=0x7fa3c4006c40 comp rx=0 tx=0).stop 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d410e4f0 msgr2=0x7fa3d41a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d410e4f0 0x7fa3d41a35c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4102b20 tx=0x7fa3cc009ef0 comp rx=0 tx=0).stop 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/1455744269 shutdown_connections 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3bc0a3340 0x7fa3bc0a5800 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d410e4f0 0x7fa3d41a35c0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d41012f0 0x7fa3d410d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 --2- 172.21.15.18:0/1455744269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d4100940 0x7fa3d410cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/1455744269 >> 172.21.15.18:0/1455744269 conn(0x7fa3d40fc790 msgr2=0x7fa3d40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/1455744269 shutdown_connections 2024-09-19T10:02:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:53.923+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/1455744269 wait complete. 2024-09-19T10:02:54.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:53 smithi162 ceph-mon[35174]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 68 MiB/s wr, 374 op/s 2024-09-19T10:02:54.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:53 smithi018 ceph-mon[30956]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 68 MiB/s wr, 374 op/s 2024-09-19T10:02:54.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:53 smithi049 ceph-mon[34858]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 68 MiB/s wr, 374 op/s 2024-09-19T10:02:54.808 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --set-id 8a2ec461 --release --await' 2024-09-19T10:02:54.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --set-id 8a2ec461 --release --await 2024-09-19T10:02:55.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:54 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1455744269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:02:55.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.045+0000 7f228d729640 1 -- 172.21.15.18:0/2191649781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2288100e20 msgr2=0x7f2288101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:55.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.045+0000 7f228d729640 1 --2- 172.21.15.18:0/2191649781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2288100e20 0x7f2288101200 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2278009900 tx=0x7f227802a480 comp rx=0 tx=0).stop 2024-09-19T10:02:55.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.045+0000 7f228d729640 1 -- 172.21.15.18:0/2191649781 shutdown_connections 2024-09-19T10:02:55.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.045+0000 7f228d729640 1 --2- 172.21.15.18:0/2191649781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288102ef0 0x7f228810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.045+0000 7f228d729640 1 --2- 172.21.15.18:0/2191649781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2288102570 0x7f22881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.045+0000 7f228d729640 1 --2- 172.21.15.18:0/2191649781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2288100e20 0x7f2288101200 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.045+0000 7f228d729640 1 -- 172.21.15.18:0/2191649781 >> 172.21.15.18:0/2191649781 conn(0x7f22880fc7d0 msgr2=0x7f22880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:55.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.045+0000 7f228d729640 1 -- 172.21.15.18:0/2191649781 shutdown_connections 2024-09-19T10:02:55.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.045+0000 7f228d729640 1 -- 172.21.15.18:0/2191649781 wait complete. 2024-09-19T10:02:55.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.046+0000 7f228d729640 1 Processor -- start 2024-09-19T10:02:55.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f228d729640 1 -- start start 2024-09-19T10:02:55.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f228d729640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288100e20 0x7f22881993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f228d729640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2288102570 0x7f2288199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f228d729640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2288102ef0 0x7f22881a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f22867fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2288102570 0x7f2288199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f22867fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2288102570 0x7f2288199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41816/0 (socket says 172.21.15.18:41816) 2024-09-19T10:02:55.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f22867fc640 1 -- 172.21.15.18:0/3006409191 learned_addr learned my addr 172.21.15.18:0/3006409191 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:55.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2288110ff0 con 0x7f2288102570 2024-09-19T10:02:55.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2288110e70 con 0x7f2288100e20 2024-09-19T10:02:55.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2288111170 con 0x7f2288102ef0 2024-09-19T10:02:55.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f2286ffd640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288100e20 0x7f22881993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f22877fe640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2288102ef0 0x7f22881a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f2286ffd640 1 -- 172.21.15.18:0/3006409191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2288102ef0 msgr2=0x7f22881a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:55.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.047+0000 7f2286ffd640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2288102ef0 0x7f22881a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f2286ffd640 1 -- 172.21.15.18:0/3006409191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2288102570 msgr2=0x7f2288199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:55.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f2286ffd640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2288102570 0x7f2288199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f2286ffd640 1 -- 172.21.15.18:0/3006409191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22881a49a0 con 0x7f2288100e20 2024-09-19T10:02:55.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f22867fc640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2288102570 0x7f2288199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:02:55.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f22877fe640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2288102ef0 0x7f22881a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:02:55.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f2286ffd640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288100e20 0x7f22881993e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f227802a9a0 tx=0x7f2278003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:55.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f226ffff640 1 -- 172.21.15.18:0/3006409191 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227803f070 con 0x7f2288100e20 2024-09-19T10:02:55.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22881a4b70 con 0x7f2288100e20 2024-09-19T10:02:55.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f226ffff640 1 -- 172.21.15.18:0/3006409191 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2278031c20 con 0x7f2288100e20 2024-09-19T10:02:55.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f226ffff640 1 -- 172.21.15.18:0/3006409191 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278035030 con 0x7f2288100e20 2024-09-19T10:02:55.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.048+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22881a4fc0 con 0x7f2288100e20 2024-09-19T10:02:55.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f228fb02740 1 Processor -- start 2024-09-19T10:02:55.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f228fb02740 1 -- start start 2024-09-19T10:02:55.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f226ffff640 1 -- 172.21.15.18:0/3006409191 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2278042070 con 0x7f2288100e20 2024-09-19T10:02:55.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f228fb02740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94c85c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f228fb02740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 0x55ae94c84560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f228fb02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84b80 0x55ae94c99f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f228fb02740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ae94bea2f0 con 0x55ae94c85840 2024-09-19T10:02:55.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f228fb02740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ae94b91cf0 con 0x55ae94c84120 2024-09-19T10:02:55.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f228fb02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ae94be62b0 con 0x55ae94c84b80 2024-09-19T10:02:55.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f22877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94c85c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f22877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94c85c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41828/0 (socket says 172.21.15.18:41828) 2024-09-19T10:02:55.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.051+0000 7f22877fe640 1 -- 172.21.15.18:0/312790295 learned_addr learned my addr 172.21.15.18:0/312790295 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:55.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.052+0000 7f22867fc640 1 --2- 172.21.15.18:0/312790295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84b80 0x55ae94c99f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.052+0000 7f226ffff640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22700a3240 0x7f22700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.052+0000 7f226ffff640 1 -- 172.21.15.18:0/3006409191 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2278031dd0 con 0x7f2288100e20 2024-09-19T10:02:55.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.052+0000 7f22877fe640 1 -- 172.21.15.18:0/312790295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84b80 msgr2=0x55ae94c99f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:55.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.052+0000 7f22877fe640 1 --2- 172.21.15.18:0/312790295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84b80 0x55ae94c99f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.052+0000 7f22877fe640 1 -- 172.21.15.18:0/312790295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 msgr2=0x55ae94c84560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T10:02:55.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.052+0000 7f22877fe640 1 --2- 172.21.15.18:0/312790295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 0x55ae94c84560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.052+0000 7f22877fe640 1 -- 172.21.15.18:0/312790295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae94b763a0 con 0x55ae94c85840 2024-09-19T10:02:55.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.052+0000 7f22877fe640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22700a3240 0x7f22700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.052+0000 7f22877fe640 1 --2- 172.21.15.18:0/312790295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94c85c20 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f228000f390 tx=0x7f228000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef32db082ae4092 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:55.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.053+0000 7f226d7fa640 1 -- 172.21.15.18:0/312790295 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280025640 con 0x55ae94c85840 2024-09-19T10:02:55.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.053+0000 7f22877fe640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22700a3240 0x7f22700a5700 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2280020000 tx=0x7f228001d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:55.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.053+0000 7f226d7fa640 1 -- 172.21.15.18:0/312790295 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f228001a8f0 con 0x55ae94c85840 2024-09-19T10:02:55.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.053+0000 7f226d7fa640 1 -- 172.21.15.18:0/312790295 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280010730 con 0x55ae94c85840 2024-09-19T10:02:55.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.053+0000 7f228fb02740 1 -- 172.21.15.18:0/312790295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 msgr2=0x55ae94c85c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:55.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.053+0000 7f228fb02740 1 --2- 172.21.15.18:0/312790295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94c85c20 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f228000f390 tx=0x7f228000f850 comp rx=0 tx=0).stop 2024-09-19T10:02:55.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.054+0000 7f228fb02740 1 -- 172.21.15.18:0/312790295 shutdown_connections 2024-09-19T10:02:55.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.054+0000 7f228fb02740 1 --2- 172.21.15.18:0/312790295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84b80 0x55ae94c99f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.054+0000 7f228fb02740 1 --2- 172.21.15.18:0/312790295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 0x55ae94c84560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.054+0000 7f228fb02740 1 --2- 172.21.15.18:0/312790295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94c85c20 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.054+0000 7f228fb02740 1 -- 172.21.15.18:0/312790295 >> 172.21.15.18:0/312790295 conn(0x55ae94c4d310 msgr2=0x55ae94c80c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:55.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.054+0000 7f228fb02740 1 -- 172.21.15.18:0/312790295 shutdown_connections 2024-09-19T10:02:55.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.054+0000 7f228fb02740 1 -- 172.21.15.18:0/312790295 wait complete. 2024-09-19T10:02:55.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.054+0000 7f228fb02740 1 -- start start 2024-09-19T10:02:55.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.054+0000 7f228fb02740 1 Processor -- start 2024-09-19T10:02:55.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f228fb02740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84120 0x55ae94c99e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f228fb02740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84b80 0x55ae94c97120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f228fb02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c85840 0x55ae94c97710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f228fb02740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ae94c9a930 con 0x55ae94c84120 2024-09-19T10:02:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f228fb02740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ae94ba5060 con 0x55ae94c84b80 2024-09-19T10:02:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f228fb02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ae94c9aab0 con 0x55ae94c85840 2024-09-19T10:02:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f228fb02740 10 client.0 _ll_register_callbacks cb 0x55ae948f88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84120 0x55ae94c99e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84120 0x55ae94c99e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41830/0 (socket says 172.21.15.18:41830) 2024-09-19T10:02:55.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f2286ffd640 1 -- 172.21.15.18:0/3072004064 learned_addr learned my addr 172.21.15.18:0/3072004064 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:55.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f22877fe640 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c85840 0x55ae94c97710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f22867fc640 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84b80 0x55ae94c97120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f2286ffd640 1 -- 172.21.15.18:0/3072004064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c85840 msgr2=0x55ae94c97710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:55.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f2286ffd640 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c85840 0x55ae94c97710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f2286ffd640 1 -- 172.21.15.18:0/3072004064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84b80 msgr2=0x55ae94c97120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:55.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f2286ffd640 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84b80 0x55ae94c97120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f2286ffd640 1 -- 172.21.15.18:0/3072004064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae9495b3c0 con 0x55ae94c84120 2024-09-19T10:02:55.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f22867fc640 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84b80 0x55ae94c97120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:02:55.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f2286ffd640 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84120 0x55ae94c99e70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f22780c4e40 tx=0x7f22780bce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491d67f72eb85b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:55.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.055+0000 7f226aff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:55.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.056+0000 7f226aff5640 1 -- 172.21.15.18:0/3072004064 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278049040 con 0x55ae94c84120 2024-09-19T10:02:55.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.056+0000 7f226aff5640 1 -- 172.21.15.18:0/3072004064 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f22780b8d70 con 0x55ae94c84120 2024-09-19T10:02:55.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.056+0000 7f228fb02740 1 -- 172.21.15.18:0/3072004064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f228001a8f0 con 0x55ae94c84120 2024-09-19T10:02:55.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.056+0000 7f226aff5640 1 -- 172.21.15.18:0/3072004064 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f22780c5370 con 0x55ae94c84120 2024-09-19T10:02:55.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.056+0000 7f228fb02740 10 client.17814 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:55.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.056+0000 7f228fb02740 1 -- 172.21.15.18:0/3072004064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae94ca63d0 con 0x55ae94c84120 2024-09-19T10:02:55.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.056+0000 7f226aff5640 1 -- 172.21.15.18:0/3072004064 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f228001a8f0 con 0x55ae94c84120 2024-09-19T10:02:55.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.056+0000 7f226aff5640 1 -- 172.21.15.18:0/3072004064 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f22780bbb50 con 0x55ae94c84120 2024-09-19T10:02:55.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.056+0000 7f228fb02740 10 client.17814 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:55.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.056+0000 7f228fb02740 10 client.17814 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:02:55.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.057+0000 7f228fb02740 20 client.17814 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:55.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.057+0000 7f228fb02740 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55ae94ca7830 0x55ae94ca9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.057+0000 7f228fb02740 4 client.17814 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:55.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.057+0000 7f228fb02740 1 -- 172.21.15.18:0/3072004064 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae94bf7860 con 0x55ae94ca7830 2024-09-19T10:02:55.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.057+0000 7f22867fc640 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55ae94ca7830 0x55ae94ca9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.057+0000 7f22867fc640 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55ae94ca7830 0x55ae94ca9c20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bfb5b5f2e6a4c314 server_cookie=5e1eb49eeb4efa1a in_seq=0 out_seq=0 2024-09-19T10:02:55.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.057+0000 7f226aff5640 10 client.17814 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:02:55.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f226aff5640 1 -- 172.21.15.18:0/3072004064 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae94bf7860 con 0x55ae94ca7830 2024-09-19T10:02:55.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f226aff5640 10 client.17814 handle_command_reply: tid=0 2024-09-19T10:02:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 client.17814 shutdown 2024-09-19T10:02:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 -- 172.21.15.18:0/3072004064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84120 msgr2=0x55ae94c99e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84120 0x55ae94c99e70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f22780c4e40 tx=0x7f22780bce00 comp rx=0 tx=0).stop 2024-09-19T10:02:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 -- 172.21.15.18:0/3072004064 shutdown_connections 2024-09-19T10:02:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55ae94ca7830 0x55ae94ca9c20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c85840 0x55ae94c97710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84b80 0x55ae94c97120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 --2- 172.21.15.18:0/3072004064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84120 0x55ae94c99e70 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 -- 172.21.15.18:0/3072004064 >> 172.21.15.18:0/3072004064 conn(0x55ae94c4d310 msgr2=0x55ae94c7fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f226aff5640 0 client.17814 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:02:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 -- 172.21.15.18:0/3072004064 shutdown_connections 2024-09-19T10:02:55.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.058+0000 7f228fb02740 1 -- 172.21.15.18:0/3072004064 wait complete. 2024-09-19T10:02:55.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.059+0000 7f228fb02740 20 client.17814 trim_cache size 0 max 16384 2024-09-19T10:02:55.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f228fb02740 1 Processor -- start 2024-09-19T10:02:55.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f228fb02740 1 -- start start 2024-09-19T10:02:55.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f228fb02740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 0x55ae94ca3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f228fb02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84b80 0x55ae94c7fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f228fb02740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94caf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f228fb02740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22881ab290 con 0x55ae94c85840 2024-09-19T10:02:55.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f228fb02740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f22881acdd0 con 0x55ae94c84120 2024-09-19T10:02:55.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f228fb02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22881ab960 con 0x55ae94c84b80 2024-09-19T10:02:55.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f22877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94caf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 0x55ae94ca3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 0x55ae94ca3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:47112/0 (socket says 172.21.15.18:47112) 2024-09-19T10:02:55.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f22877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94caf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41842/0 (socket says 172.21.15.18:41842) 2024-09-19T10:02:55.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.072+0000 7f2286ffd640 1 -- 172.21.15.18:0/491970559 learned_addr learned my addr 172.21.15.18:0/491970559 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:55.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f22867fc640 1 --2- 172.21.15.18:0/491970559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84b80 0x55ae94c7fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f2286ffd640 1 -- 172.21.15.18:0/491970559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84b80 msgr2=0x55ae94c7fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:55.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f2286ffd640 1 --2- 172.21.15.18:0/491970559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84b80 0x55ae94c7fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f2286ffd640 1 -- 172.21.15.18:0/491970559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 msgr2=0x55ae94caf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:55.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f2286ffd640 1 --2- 172.21.15.18:0/491970559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94caf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f2286ffd640 1 -- 172.21.15.18:0/491970559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae94c95670 con 0x55ae94c84120 2024-09-19T10:02:55.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f22877fe640 1 --2- 172.21.15.18:0/491970559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94caf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:02:55.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f2286ffd640 1 --2- 172.21.15.18:0/491970559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 0x55ae94ca3c00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f227802a4a0 tx=0x7f22780bac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a98b98d371b2377 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:55.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f226cff9640 1 -- 172.21.15.18:0/491970559 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780a1070 con 0x55ae94c84120 2024-09-19T10:02:55.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f226cff9640 1 -- 172.21.15.18:0/491970559 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22780b8d70 con 0x55ae94c84120 2024-09-19T10:02:55.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.073+0000 7f226cff9640 1 -- 172.21.15.18:0/491970559 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278049070 con 0x55ae94c84120 2024-09-19T10:02:55.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.074+0000 7f228fb02740 1 -- 172.21.15.18:0/491970559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 msgr2=0x55ae94ca3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:55.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.074+0000 7f228fb02740 1 --2- 172.21.15.18:0/491970559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 0x55ae94ca3c00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f227802a4a0 tx=0x7f22780bac10 comp rx=0 tx=0).stop 2024-09-19T10:02:55.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.074+0000 7f228fb02740 1 -- 172.21.15.18:0/491970559 shutdown_connections 2024-09-19T10:02:55.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.074+0000 7f228fb02740 1 --2- 172.21.15.18:0/491970559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c85840 0x55ae94caf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.074+0000 7f228fb02740 1 --2- 172.21.15.18:0/491970559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84b80 0x55ae94c7fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.074+0000 7f228fb02740 1 --2- 172.21.15.18:0/491970559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c84120 0x55ae94ca3c00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.074+0000 7f228fb02740 1 -- 172.21.15.18:0/491970559 >> 172.21.15.18:0/491970559 conn(0x55ae94c4d310 msgr2=0x55ae94c7f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:55.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.074+0000 7f228fb02740 1 -- 172.21.15.18:0/491970559 shutdown_connections 2024-09-19T10:02:55.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.074+0000 7f228fb02740 1 -- 172.21.15.18:0/491970559 wait complete. 2024-09-19T10:02:55.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f228fb02740 1 -- start start 2024-09-19T10:02:55.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f228fb02740 1 Processor -- start 2024-09-19T10:02:55.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f228fb02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84120 0x55ae94ca0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f228fb02740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84b80 0x55ae94ca05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f228fb02740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c85840 0x55ae94c9b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f228fb02740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22881ac700 con 0x55ae94c84b80 2024-09-19T10:02:55.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f228fb02740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f22881ac030 con 0x55ae94c85840 2024-09-19T10:02:55.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f228fb02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22881a9290 con 0x55ae94c84120 2024-09-19T10:02:55.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f228fb02740 10 client.0 _ll_register_callbacks cb 0x7f2278009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:55.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f22867fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84b80 0x55ae94ca05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84120 0x55ae94ca0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.075+0000 7f22867fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84b80 0x55ae94ca05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41856/0 (socket says 172.21.15.18:41856) 2024-09-19T10:02:55.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f22867fc640 1 -- 172.21.15.18:0/2024463806 learned_addr learned my addr 172.21.15.18:0/2024463806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:55.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f22877fe640 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c85840 0x55ae94c9b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f2286ffd640 1 -- 172.21.15.18:0/2024463806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c85840 msgr2=0x55ae94c9b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:55.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f2286ffd640 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c85840 0x55ae94c9b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f2286ffd640 1 -- 172.21.15.18:0/2024463806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84b80 msgr2=0x55ae94ca05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:55.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f2286ffd640 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84b80 0x55ae94ca05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f2286ffd640 1 -- 172.21.15.18:0/2024463806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae94c9bca0 con 0x55ae94c84120 2024-09-19T10:02:55.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f22867fc640 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84b80 0x55ae94ca05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:02:55.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f2286ffd640 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84120 0x55ae94ca0070 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f22780bc8c0 tx=0x7f22780bce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9674e941515d1dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:55.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f226aff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:02:55.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f226aff5640 1 -- 172.21.15.18:0/2024463806 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780a1070 con 0x55ae94c84120 2024-09-19T10:02:55.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.076+0000 7f228fb02740 1 -- 172.21.15.18:0/2024463806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22780b8d70 con 0x55ae94c84120 2024-09-19T10:02:55.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f226aff5640 1 -- 172.21.15.18:0/2024463806 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2278031740 con 0x55ae94c84120 2024-09-19T10:02:55.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f226aff5640 1 -- 172.21.15.18:0/2024463806 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2278049030 con 0x55ae94c84120 2024-09-19T10:02:55.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f228fb02740 10 client.27304 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:55.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f228fb02740 1 -- 172.21.15.18:0/2024463806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae94c9bca0 con 0x55ae94c84120 2024-09-19T10:02:55.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f226aff5640 1 -- 172.21.15.18:0/2024463806 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22780b8d70 con 0x55ae94c84120 2024-09-19T10:02:55.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f226aff5640 1 -- 172.21.15.18:0/2024463806 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f22780c1c40 con 0x55ae94c84120 2024-09-19T10:02:55.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f228fb02740 10 client.27304 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:55.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f228fb02740 10 client.27304 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:02:55.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f228fb02740 20 client.27304 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:55.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f228fb02740 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55ae94d122d0 0x55ae94d146c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:55.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f228fb02740 4 client.27304 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:02:55.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.077+0000 7f228fb02740 1 -- 172.21.15.18:0/2024463806 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae94bf1d70 con 0x55ae94d122d0 2024-09-19T10:02:55.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f22867fc640 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55ae94d122d0 0x55ae94d146c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:55.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f22867fc640 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55ae94d122d0 0x55ae94d146c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=74ae82f48776b81b server_cookie=ef985eea3aa0f58a in_seq=0 out_seq=0 2024-09-19T10:02:55.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f226aff5640 10 client.27304 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:02:55.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f226aff5640 1 -- 172.21.15.18:0/2024463806 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae94bf1d70 con 0x55ae94d122d0 2024-09-19T10:02:55.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f226aff5640 10 client.27304 handle_command_reply: tid=0 2024-09-19T10:02:55.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f228fb02740 1 client.27304 shutdown 2024-09-19T10:02:55.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f228fb02740 1 -- 172.21.15.18:0/2024463806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84120 msgr2=0x55ae94ca0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:55.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f228fb02740 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84120 0x55ae94ca0070 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f22780bc8c0 tx=0x7f22780bce00 comp rx=0 tx=0).stop 2024-09-19T10:02:55.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f228fb02740 1 -- 172.21.15.18:0/2024463806 shutdown_connections 2024-09-19T10:02:55.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f228fb02740 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55ae94d122d0 0x55ae94d146c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f228fb02740 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae94c85840 0x55ae94c9b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f228fb02740 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae94c84b80 0x55ae94ca05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f226aff5640 0 client.27304 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:02:55.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.078+0000 7f228fb02740 1 --2- 172.21.15.18:0/2024463806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae94c84120 0x55ae94ca0070 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228fb02740 1 -- 172.21.15.18:0/2024463806 >> 172.21.15.18:0/2024463806 conn(0x55ae94c4d310 msgr2=0x55ae94c7fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:55.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228fb02740 1 -- 172.21.15.18:0/2024463806 shutdown_connections 2024-09-19T10:02:55.113 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:02:55.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228fb02740 1 -- 172.21.15.18:0/2024463806 wait complete. 2024-09-19T10:02:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228fb02740 20 client.27304 trim_cache size 0 max 16384 2024-09-19T10:02:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22700a3240 msgr2=0x7f22700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228d729640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22700a3240 0x7f22700a5700 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2280020000 tx=0x7f228001d000 comp rx=0 tx=0).stop 2024-09-19T10:02:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288100e20 msgr2=0x7f22881993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228d729640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288100e20 0x7f22881993e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f227802a9a0 tx=0x7f2278003b90 comp rx=0 tx=0).stop 2024-09-19T10:02:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 shutdown_connections 2024-09-19T10:02:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228d729640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f22700a3240 0x7f22700a5700 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228d729640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2288102ef0 0x7f22881a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.079+0000 7f228d729640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2288102570 0x7f2288199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.080+0000 7f228d729640 1 --2- 172.21.15.18:0/3006409191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2288100e20 0x7f22881993e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.080+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 >> 172.21.15.18:0/3006409191 conn(0x7f22880fc7d0 msgr2=0x7f22880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.080+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 shutdown_connections 2024-09-19T10:02:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:55.080+0000 7f228d729640 1 -- 172.21.15.18:0/3006409191 wait complete. 2024-09-19T10:02:55.300 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:55.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:54 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1455744269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:02:55.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:54 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1455744269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:02:55.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T10:02:56.057 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:55 smithi018 ceph-mon[30956]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 68 MiB/s wr, 432 op/s 2024-09-19T10:02:56.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.278+0000 7fcada149640 1 -- 172.21.15.18:0/2637277042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad4103760 msgr2=0x7fcad4107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:56.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.278+0000 7fcada149640 1 --2- 172.21.15.18:0/2637277042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad4103760 0x7fcad4107ba0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009930 tx=0x7fcac402a420 comp rx=0 tx=0).stop 2024-09-19T10:02:56.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.279+0000 7fcada149640 1 -- 172.21.15.18:0/2637277042 shutdown_connections 2024-09-19T10:02:56.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.279+0000 7fcada149640 1 --2- 172.21.15.18:0/2637277042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad41082e0 0x7fcad410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.279+0000 7fcada149640 1 --2- 172.21.15.18:0/2637277042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad4103760 0x7fcad4107ba0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.279+0000 7fcada149640 1 --2- 172.21.15.18:0/2637277042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcad4102db0 0x7fcad4103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.279+0000 7fcada149640 1 -- 172.21.15.18:0/2637277042 >> 172.21.15.18:0/2637277042 conn(0x7fcad40fc7d0 msgr2=0x7fcad40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:56.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.279+0000 7fcada149640 1 -- 172.21.15.18:0/2637277042 shutdown_connections 2024-09-19T10:02:56.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.279+0000 7fcada149640 1 -- 172.21.15.18:0/2637277042 wait complete. 2024-09-19T10:02:56.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.279+0000 7fcada149640 1 Processor -- start 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcada149640 1 -- start start 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcada149640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad4102db0 0x7fcad4198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcada149640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcad4103760 0x7fcad4198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcada149640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad41082e0 0x7fcad419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcada149640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41120d0 con 0x7fcad41082e0 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcada149640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcad4111f50 con 0x7fcad4102db0 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcada149640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcad4112250 con 0x7fcad4103760 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad41082e0 0x7fcad419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad41082e0 0x7fcad419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41872/0 (socket says 172.21.15.18:41872) 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad3fff640 1 -- 172.21.15.18:0/4280217531 learned_addr learned my addr 172.21.15.18:0/4280217531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad2ffd640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcad4103760 0x7fcad4198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad37fe640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad4102db0 0x7fcad4198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad3fff640 1 -- 172.21.15.18:0/4280217531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcad4103760 msgr2=0x7fcad4198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad3fff640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcad4103760 0x7fcad4198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad3fff640 1 -- 172.21.15.18:0/4280217531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad4102db0 msgr2=0x7fcad4198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad3fff640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad4102db0 0x7fcad4198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad3fff640 1 -- 172.21.15.18:0/4280217531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad419d620 con 0x7fcad41082e0 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad37fe640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad4102db0 0x7fcad4198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.280+0000 7fcad3fff640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad41082e0 0x7fcad419cf40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009fd0 tx=0x7fcacc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.281+0000 7fcad0ff9640 1 -- 172.21.15.18:0/4280217531 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc017070 con 0x7fcad41082e0 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.281+0000 7fcad0ff9640 1 -- 172.21.15.18:0/4280217531 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcacc003e50 con 0x7fcad41082e0 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.281+0000 7fcada149640 1 -- 172.21.15.18:0/4280217531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad419d910 con 0x7fcad41082e0 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.281+0000 7fcad0ff9640 1 -- 172.21.15.18:0/4280217531 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0106c0 con 0x7fcad41082e0 2024-09-19T10:02:56.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.281+0000 7fcada149640 1 -- 172.21.15.18:0/4280217531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad41a51f0 con 0x7fcad41082e0 2024-09-19T10:02:56.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcad0ff9640 1 -- 172.21.15.18:0/4280217531 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcacc003970 con 0x7fcad41082e0 2024-09-19T10:02:56.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcadc522740 1 Processor -- start 2024-09-19T10:02:56.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcadc522740 1 -- start start 2024-09-19T10:02:56.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcadc522740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bc7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcadc522740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bd1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcadc522740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 0x563346bd4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcadc522740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563346b2c620 con 0x563346bc7980 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcadc522740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563346ad3e50 con 0x563346bc7060 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcadc522740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563346b285e0 con 0x563346bd2240 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcad37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bd1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcad2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bc7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcad37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bd1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41888/0 (socket says 172.21.15.18:41888) 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcad37fe640 1 -- 172.21.15.18:0/2013353645 learned_addr learned my addr 172.21.15.18:0/2013353645 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.284+0000 7fcad2ffd640 1 --2- 172.21.15.18:0/2013353645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 0x563346bd4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcad0ff9640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcac00a3240 0x7fcac00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcad37fe640 1 -- 172.21.15.18:0/2013353645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 msgr2=0x563346bd4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcad37fe640 1 --2- 172.21.15.18:0/2013353645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 0x563346bd4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcad37fe640 1 -- 172.21.15.18:0/2013353645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 msgr2=0x563346bc7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcad0ff9640 1 -- 172.21.15.18:0/4280217531 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcacc0cf750 con 0x7fcad41082e0 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcad37fe640 1 --2- 172.21.15.18:0/2013353645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bc7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcad37fe640 1 -- 172.21.15.18:0/2013353645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563346ac4d40 con 0x563346bc7980 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcad3fff640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcac00a3240 0x7fcac00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcad37fe640 1 --2- 172.21.15.18:0/2013353645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bd1d00 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00aa10 tx=0x7fcabc00aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16eb0c0c671c3a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcac9ffb640 1 -- 172.21.15.18:0/2013353645 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc015070 con 0x563346bc7980 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcac9ffb640 1 -- 172.21.15.18:0/2013353645 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcabc00cc60 con 0x563346bc7980 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.285+0000 7fcac9ffb640 1 -- 172.21.15.18:0/2013353645 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc018560 con 0x563346bc7980 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.286+0000 7fcadc522740 1 -- 172.21.15.18:0/2013353645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 msgr2=0x563346bd1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.286+0000 7fcad3fff640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcac00a3240 0x7fcac00a5700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00dfd0 tx=0x7fcacc0044b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.286+0000 7fcadc522740 1 --2- 172.21.15.18:0/2013353645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bd1d00 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00aa10 tx=0x7fcabc00aed0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.286+0000 7fcadc522740 1 -- 172.21.15.18:0/2013353645 shutdown_connections 2024-09-19T10:02:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.286+0000 7fcadc522740 1 --2- 172.21.15.18:0/2013353645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 0x563346bd4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.286+0000 7fcadc522740 1 --2- 172.21.15.18:0/2013353645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bd1d00 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.286+0000 7fcadc522740 1 --2- 172.21.15.18:0/2013353645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bc7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.286+0000 7fcadc522740 1 -- 172.21.15.18:0/2013353645 >> 172.21.15.18:0/2013353645 conn(0x563346bc35f0 msgr2=0x563346bc39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.286+0000 7fcadc522740 1 -- 172.21.15.18:0/2013353645 shutdown_connections 2024-09-19T10:02:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.287+0000 7fcadc522740 1 -- 172.21.15.18:0/2013353645 wait complete. 2024-09-19T10:02:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.287+0000 7fcadc522740 1 -- start start 2024-09-19T10:02:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.287+0000 7fcadc522740 1 Processor -- start 2024-09-19T10:02:56.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.287+0000 7fcadc522740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bcf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.287+0000 7fcadc522740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bcf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.287+0000 7fcadc522740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 0x563346bcfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.287+0000 7fcadc522740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563346bd9220 con 0x563346bc7980 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.287+0000 7fcadc522740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563346ab4f10 con 0x563346bc7060 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.287+0000 7fcadc522740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563346bd93a0 con 0x563346bd2240 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcadc522740 10 client.0 _ll_register_callbacks cb 0x563346ad8db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcad37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bcf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcad37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bcf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41896/0 (socket says 172.21.15.18:41896) 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcad37fe640 1 -- 172.21.15.18:0/668105801 learned_addr learned my addr 172.21.15.18:0/668105801 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcad2ffd640 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bcf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcad37fe640 1 -- 172.21.15.18:0/668105801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 msgr2=0x563346bcfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcad37fe640 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 0x563346bcfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcad37fe640 1 -- 172.21.15.18:0/668105801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 msgr2=0x563346bcf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcad37fe640 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bcf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcad37fe640 1 -- 172.21.15.18:0/668105801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56334683b580 con 0x563346bc7980 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcad37fe640 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bcf610 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fcabc004700 tx=0x7fcabc011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d2584ab1fca130 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcab2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcab2ffd640 1 -- 172.21.15.18:0/668105801 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc027060 con 0x563346bc7980 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcab2ffd640 1 -- 172.21.15.18:0/668105801 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcabc01a660 con 0x563346bc7980 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.288+0000 7fcadc522740 1 -- 172.21.15.18:0/668105801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcabc00cc60 con 0x563346bc7980 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcab2ffd640 1 -- 172.21.15.18:0/668105801 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcabc015070 con 0x563346bc7980 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcadc522740 10 client.17832 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcadc522740 1 -- 172.21.15.18:0/668105801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563346905960 con 0x563346bc7980 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcab2ffd640 1 -- 172.21.15.18:0/668105801 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcabc00cc60 con 0x563346bc7980 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcab2ffd640 1 -- 172.21.15.18:0/668105801 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcabc021030 con 0x563346bc7980 2024-09-19T10:02:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcadc522740 10 client.17832 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcadc522740 10 client.17832 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:02:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcadc522740 20 client.17832 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcadc522740 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563346be5fd0 0x563346be83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcadc522740 4 client.17832 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.289+0000 7fcadc522740 1 -- 172.21.15.18:0/668105801 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563346b39b90 con 0x563346be5fd0 2024-09-19T10:02:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.290+0000 7fcad2ffd640 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563346be5fd0 0x563346be83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.290+0000 7fcab2ffd640 10 client.17832 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.290+0000 7fcad2ffd640 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563346be5fd0 0x563346be83c0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96d5b0e8f388fad server_cookie=cae19d4e18b9c324 in_seq=0 out_seq=0 2024-09-19T10:02:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcab2ffd640 1 -- 172.21.15.18:0/668105801 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563346b39b90 con 0x563346be5fd0 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcab2ffd640 10 client.17832 handle_command_reply: tid=0 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 client.17832 shutdown 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 -- 172.21.15.18:0/668105801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 msgr2=0x563346bcf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bcf610 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fcabc004700 tx=0x7fcabc011b80 comp rx=0 tx=0).stop 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 -- 172.21.15.18:0/668105801 shutdown_connections 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563346be5fd0 0x563346be83c0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 0x563346bcfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bcf610 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 --2- 172.21.15.18:0/668105801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bcf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 -- 172.21.15.18:0/668105801 >> 172.21.15.18:0/668105801 conn(0x563346bc35f0 msgr2=0x563346bc2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcab2ffd640 0 client.17832 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 -- 172.21.15.18:0/668105801 shutdown_connections 2024-09-19T10:02:56.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 1 -- 172.21.15.18:0/668105801 wait complete. 2024-09-19T10:02:56.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.291+0000 7fcadc522740 20 client.17832 trim_cache size 0 max 16384 2024-09-19T10:02:56.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcadc522740 1 Processor -- start 2024-09-19T10:02:56.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcadc522740 1 -- start start 2024-09-19T10:02:56.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcadc522740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcadc522740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bedb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcadc522740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 0x563346bee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcadc522740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41ab370 con 0x563346bc7980 2024-09-19T10:02:56.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcadc522740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41aceb0 con 0x563346bc7060 2024-09-19T10:02:56.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcadc522740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41aba40 con 0x563346bd2240 2024-09-19T10:02:56.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcad37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bedb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcad37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bedb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41908/0 (socket says 172.21.15.18:41908) 2024-09-19T10:02:56.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcad37fe640 1 -- 172.21.15.18:0/3202636467 learned_addr learned my addr 172.21.15.18:0/3202636467 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:56.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcad2ffd640 1 --2- 172.21.15.18:0/3202636467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcad37fe640 1 -- 172.21.15.18:0/3202636467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 msgr2=0x563346bee0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:02:56.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcad37fe640 1 --2- 172.21.15.18:0/3202636467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 0x563346bee0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.310+0000 7fcad37fe640 1 -- 172.21.15.18:0/3202636467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 msgr2=0x563346bce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:56.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.311+0000 7fcad37fe640 1 --2- 172.21.15.18:0/3202636467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.311+0000 7fcad37fe640 1 -- 172.21.15.18:0/3202636467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563346bc77b0 con 0x563346bc7980 2024-09-19T10:02:56.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.311+0000 7fcad2ffd640 1 --2- 172.21.15.18:0/3202636467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:02:56.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.311+0000 7fcad37fe640 1 --2- 172.21.15.18:0/3202636467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bedb80 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00a8e0 tx=0x7fcabc011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99169886509752f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:56.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.311+0000 7fcac97fa640 1 -- 172.21.15.18:0/3202636467 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc032020 con 0x563346bc7980 2024-09-19T10:02:56.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.311+0000 7fcac97fa640 1 -- 172.21.15.18:0/3202636467 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcabc02d9b0 con 0x563346bc7980 2024-09-19T10:02:56.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.311+0000 7fcac97fa640 1 -- 172.21.15.18:0/3202636467 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc01a8c0 con 0x563346bc7980 2024-09-19T10:02:56.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.312+0000 7fcadc522740 1 -- 172.21.15.18:0/3202636467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 msgr2=0x563346bedb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:56.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.312+0000 7fcadc522740 1 --2- 172.21.15.18:0/3202636467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bedb80 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00a8e0 tx=0x7fcabc011860 comp rx=0 tx=0).stop 2024-09-19T10:02:56.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.312+0000 7fcadc522740 1 -- 172.21.15.18:0/3202636467 shutdown_connections 2024-09-19T10:02:56.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.312+0000 7fcadc522740 1 --2- 172.21.15.18:0/3202636467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bd2240 0x563346bee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.312+0000 7fcadc522740 1 --2- 172.21.15.18:0/3202636467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bc7980 0x563346bedb80 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.312+0000 7fcadc522740 1 --2- 172.21.15.18:0/3202636467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bc7060 0x563346bce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.312+0000 7fcadc522740 1 -- 172.21.15.18:0/3202636467 >> 172.21.15.18:0/3202636467 conn(0x563346bc35f0 msgr2=0x563346bd1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.312+0000 7fcadc522740 1 -- 172.21.15.18:0/3202636467 shutdown_connections 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.312+0000 7fcadc522740 1 -- 172.21.15.18:0/3202636467 wait complete. 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.313+0000 7fcadc522740 1 -- start start 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.313+0000 7fcadc522740 1 Processor -- start 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.313+0000 7fcadc522740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bc7060 0x563346bcbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.313+0000 7fcadc522740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bd2240 0x563346bcc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.313+0000 7fcadc522740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bcca30 0x563346bdca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.313+0000 7fcadc522740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41ac7e0 con 0x563346bcca30 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.313+0000 7fcadc522740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41ac110 con 0x563346bd2240 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.313+0000 7fcadc522740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41a9370 con 0x563346bc7060 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.313+0000 7fcadc522740 10 client.0 _ll_register_callbacks cb 0x7fcabc011790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bcca30 0x563346bdca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bcca30 0x563346bdca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41914/0 (socket says 172.21.15.18:41914) 2024-09-19T10:02:56.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad2ffd640 1 -- 172.21.15.18:0/546066298 learned_addr learned my addr 172.21.15.18:0/546066298 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:56.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad2ffd640 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bc7060 0x563346bcbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad37fe640 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bd2240 0x563346bcc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad37fe640 1 -- 172.21.15.18:0/546066298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bc7060 msgr2=0x563346bcbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad37fe640 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bc7060 0x563346bcbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad37fe640 1 -- 172.21.15.18:0/546066298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bcca30 msgr2=0x563346bdca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad37fe640 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bcca30 0x563346bdca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad37fe640 1 -- 172.21.15.18:0/546066298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563346bdf290 con 0x563346bd2240 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.314+0000 7fcad37fe640 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bd2240 0x563346bcc4f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x563346bd0530 tx=0x7fcabc004660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7274fc26f3154f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.315+0000 7fcab2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.315+0000 7fcab2ffd640 1 -- 172.21.15.18:0/546066298 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc032040 con 0x563346bd2240 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.315+0000 7fcab2ffd640 1 -- 172.21.15.18:0/546066298 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcabc0059c0 con 0x563346bd2240 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.315+0000 7fcadc522740 1 -- 172.21.15.18:0/546066298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcabc02d9b0 con 0x563346bd2240 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.315+0000 7fcab2ffd640 1 -- 172.21.15.18:0/546066298 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcabc027030 con 0x563346bd2240 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.315+0000 7fcadc522740 10 client.27296 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:56.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.315+0000 7fcadc522740 1 -- 172.21.15.18:0/546066298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563346c51140 con 0x563346bd2240 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.315+0000 7fcab2ffd640 1 -- 172.21.15.18:0/546066298 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcabc02d9b0 con 0x563346bd2240 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.316+0000 7fcab2ffd640 1 -- 172.21.15.18:0/546066298 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcabc021040 con 0x563346bd2240 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.316+0000 7fcadc522740 10 client.27296 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.316+0000 7fcadc522740 10 client.27296 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.316+0000 7fcadc522740 20 client.27296 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.316+0000 7fcadc522740 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563346c51750 0x563346c53b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.316+0000 7fcadc522740 4 client.27296 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8a2ec461", "release": true, "await": true}] 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.316+0000 7fcadc522740 1 -- 172.21.15.18:0/546066298 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8a2ec461", "release": true, "await": true}) -- 0x563346b340a0 con 0x563346c51750 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.316+0000 7fcad2ffd640 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563346c51750 0x563346c53b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.316+0000 7fcab2ffd640 10 client.27296 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:56.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.316+0000 7fcad2ffd640 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563346c51750 0x563346c53b40 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0c2dd1acf7c83e7 server_cookie=fe9375d88bf1f2ff in_seq=0 out_seq=0 2024-09-19T10:02:56.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.322+0000 7fcab2ffd640 1 -- 172.21.15.18:0/546066298 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563346b340a0 con 0x563346c51750 2024-09-19T10:02:56.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.322+0000 7fcab2ffd640 10 client.27296 handle_command_reply: tid=0 2024-09-19T10:02:56.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.325+0000 7fcadc522740 1 client.27296 shutdown 2024-09-19T10:02:56.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.325+0000 7fcadc522740 1 -- 172.21.15.18:0/546066298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bd2240 msgr2=0x563346bcc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:56.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.325+0000 7fcadc522740 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bd2240 0x563346bcc4f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x563346bd0530 tx=0x7fcabc004660 comp rx=0 tx=0).stop 2024-09-19T10:02:56.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.326+0000 7fcadc522740 1 -- 172.21.15.18:0/546066298 shutdown_connections 2024-09-19T10:02:56.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.326+0000 7fcadc522740 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563346c51750 0x563346c53b40 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.326+0000 7fcadc522740 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563346bcca30 0x563346bdca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.326+0000 7fcab2ffd640 0 client.27296 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:56.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.326+0000 7fcadc522740 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563346bd2240 0x563346bcc4f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.326+0000 7fcadc522740 1 --2- 172.21.15.18:0/546066298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563346bc7060 0x563346bcbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.326+0000 7fcadc522740 1 -- 172.21.15.18:0/546066298 >> 172.21.15.18:0/546066298 conn(0x563346bc35f0 msgr2=0x563346bcf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:56.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.328+0000 7fcadc522740 1 -- 172.21.15.18:0/546066298 shutdown_connections 2024-09-19T10:02:56.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.328+0000 7fcadc522740 1 -- 172.21.15.18:0/546066298 wait complete. 2024-09-19T10:02:56.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.328+0000 7fcadc522740 20 client.27296 trim_cache size 0 max 16384 2024-09-19T10:02:56.332 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:02:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T10:02:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T10:02:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 36, 2024-09-19T10:02:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T10:02:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "8a2ec461": { 2024-09-19T10:02:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 36, 2024-09-19T10:02:56.332 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T10:02:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:02:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T10:02:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:02:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:02:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T10:02:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 150.0, 2024-09-19T10:02:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T10:02:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T10:02:56.333 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T10:02:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:02:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T10:02:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:02:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:56.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:02:56.334 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:02:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.331+0000 7fcada149640 1 -- 172.21.15.18:0/4280217531 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcac00a3240 msgr2=0x7fcac00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.331+0000 7fcada149640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcac00a3240 0x7fcac00a5700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00dfd0 tx=0x7fcacc0044b0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.331+0000 7fcada149640 1 -- 172.21.15.18:0/4280217531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad41082e0 msgr2=0x7fcad419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.331+0000 7fcada149640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad41082e0 0x7fcad419cf40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009fd0 tx=0x7fcacc00b260 comp rx=0 tx=0).stop 2024-09-19T10:02:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.331+0000 7fcada149640 1 -- 172.21.15.18:0/4280217531 shutdown_connections 2024-09-19T10:02:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.331+0000 7fcada149640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcac00a3240 0x7fcac00a5700 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.331+0000 7fcada149640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad41082e0 0x7fcad419cf40 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.331+0000 7fcada149640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcad4103760 0x7fcad4198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.331+0000 7fcada149640 1 --2- 172.21.15.18:0/4280217531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcad4102db0 0x7fcad4198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:56.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.331+0000 7fcada149640 1 -- 172.21.15.18:0/4280217531 >> 172.21.15.18:0/4280217531 conn(0x7fcad40fc7d0 msgr2=0x7fcad4105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:56.336 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:02:56.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.332+0000 7fcada149640 1 -- 172.21.15.18:0/4280217531 shutdown_connections 2024-09-19T10:02:56.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:56.332+0000 7fcada149640 1 -- 172.21.15.18:0/4280217531 wait complete. 2024-09-19T10:02:56.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:55 smithi049 ceph-mon[34858]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 68 MiB/s wr, 432 op/s 2024-09-19T10:02:56.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:55 smithi162 ceph-mon[35174]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 68 MiB/s wr, 432 op/s 2024-09-19T10:02:56.975 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:56 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:02:57.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:56 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:02:57.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:56 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:02:58.193 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8a2ec461', total seconds elapsed: 36.5 2024-09-19T10:02:58.193 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T10:02:58.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:02:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.244+0000 7f50850b1640 1 -- 172.21.15.18:0/2038934063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50780a4540 msgr2=0x7f50780a4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.244+0000 7f50850b1640 1 --2- 172.21.15.18:0/2038934063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50780a4540 0x7f50780a4940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5074009900 tx=0x7f507402a4d0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.246+0000 7f50850b1640 1 -- 172.21.15.18:0/2038934063 shutdown_connections 2024-09-19T10:02:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.246+0000 7f50850b1640 1 --2- 172.21.15.18:0/2038934063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50780a6030 0x7f50780aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.246+0000 7f50850b1640 1 --2- 172.21.15.18:0/2038934063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50780a5670 0x7f50780a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.246+0000 7f50850b1640 1 --2- 172.21.15.18:0/2038934063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50780a4540 0x7f50780a4940 secure :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5074009900 tx=0x7f507402a4d0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.246+0000 7f50850b1640 1 -- 172.21.15.18:0/2038934063 >> 172.21.15.18:0/2038934063 conn(0x7f507809fba0 msgr2=0x7f50780a2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.246+0000 7f50850b1640 1 -- 172.21.15.18:0/2038934063 shutdown_connections 2024-09-19T10:02:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.246+0000 7f50850b1640 1 -- 172.21.15.18:0/2038934063 wait complete. 2024-09-19T10:02:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.248+0000 7f50850b1640 1 Processor -- start 2024-09-19T10:02:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.248+0000 7f50850b1640 1 -- start start 2024-09-19T10:02:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.249+0000 7f50850b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50780a5670 0x7f5078142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.249+0000 7f50850b1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50780a6030 0x7f5078143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.249+0000 7f50850b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5078148460 0x7f507814a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.249+0000 7f50850b1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50780b89f0 con 0x7f50780a5670 2024-09-19T10:02:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.249+0000 7f50850b1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f50780b8870 con 0x7f5078148460 2024-09-19T10:02:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.249+0000 7f50850b1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50780b8b70 con 0x7f50780a6030 2024-09-19T10:02:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.255+0000 7f507f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50780a6030 0x7f5078143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.255+0000 7f50848b0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5078148460 0x7f507814a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.256+0000 7f507ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50780a5670 0x7f5078142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.256+0000 7f507ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50780a5670 0x7f5078142ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57954/0 (socket says 172.21.15.18:57954) 2024-09-19T10:02:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.256+0000 7f507ffff640 1 -- 172.21.15.18:0/2354356187 learned_addr learned my addr 172.21.15.18:0/2354356187 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.261+0000 7f507ffff640 1 -- 172.21.15.18:0/2354356187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50780a6030 msgr2=0x7f5078143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.261+0000 7f507ffff640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50780a6030 0x7f5078143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.262+0000 7f507ffff640 1 -- 172.21.15.18:0/2354356187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5078148460 msgr2=0x7f507814a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.262+0000 7f507ffff640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5078148460 0x7f507814a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.262+0000 7f507ffff640 1 -- 172.21.15.18:0/2354356187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50780ac290 con 0x7f50780a5670 2024-09-19T10:02:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.262+0000 7f50848b0640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5078148460 0x7f507814a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:02:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.264+0000 7f507ffff640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50780a5670 0x7f5078142ec0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f5074000c00 tx=0x7f5074005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.266+0000 7f507d7fa640 1 -- 172.21.15.18:0/2354356187 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074040030 con 0x7f50780a5670 2024-09-19T10:02:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.266+0000 7f50850b1640 1 -- 172.21.15.18:0/2354356187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50780ac520 con 0x7f50780a5670 2024-09-19T10:02:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.266+0000 7f50850b1640 1 -- 172.21.15.18:0/2354356187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50780aca60 con 0x7f50780a5670 2024-09-19T10:02:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.274+0000 7f50890a4740 1 Processor -- start 2024-09-19T10:02:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.274+0000 7f50890a4740 1 -- start start 2024-09-19T10:02:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.274+0000 7f50890a4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f93bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.274+0000 7f50890a4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93c4b0 0x55937f940f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.274+0000 7f50890a4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f941540 0x55937f943a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.274+0000 7f50890a4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55937f89f2f0 con 0x55937f93c4b0 2024-09-19T10:02:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.274+0000 7f50890a4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55937f847270 con 0x55937f941540 2024-09-19T10:02:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.274+0000 7f50890a4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55937f89b2b0 con 0x55937f93bb70 2024-09-19T10:02:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.276+0000 7f507d7fa640 1 -- 172.21.15.18:0/2354356187 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50740094f0 con 0x7f50780a5670 2024-09-19T10:02:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.276+0000 7f507d7fa640 1 -- 172.21.15.18:0/2354356187 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074040030 con 0x7f50780a5670 2024-09-19T10:02:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.277+0000 7f507f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f941540 0x55937f943a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.277+0000 7f50848b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f93bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.278+0000 7f50848b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f93bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45328/0 (socket says 172.21.15.18:45328) 2024-09-19T10:02:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.278+0000 7f50848b0640 1 -- 172.21.15.18:0/1710662491 learned_addr learned my addr 172.21.15.18:0/1710662491 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.282+0000 7f507ffff640 1 --2- 172.21.15.18:0/1710662491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93c4b0 0x55937f940f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.282+0000 7f50848b0640 1 -- 172.21.15.18:0/1710662491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f941540 msgr2=0x55937f943a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.282+0000 7f50848b0640 1 --2- 172.21.15.18:0/1710662491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f941540 0x55937f943a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.282+0000 7f50848b0640 1 -- 172.21.15.18:0/1710662491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93c4b0 msgr2=0x55937f940f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.282+0000 7f50848b0640 1 --2- 172.21.15.18:0/1710662491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93c4b0 0x55937f940f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.283+0000 7f50848b0640 1 -- 172.21.15.18:0/1710662491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55937f846340 con 0x55937f93bb70 2024-09-19T10:02:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.283+0000 7f507ffff640 1 --2- 172.21.15.18:0/1710662491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93c4b0 0x55937f940f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:02:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.289+0000 7f50848b0640 1 --2- 172.21.15.18:0/1710662491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f93bf70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5080065a40 tx=0x7f50800758e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a806abb3fbcd77a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.291+0000 7f507d7fa640 1 -- 172.21.15.18:0/2354356187 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5074043030 con 0x7f50780a5670 2024-09-19T10:02:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.293+0000 7f507d7fa640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f50700a3710 0x7f50700a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.293+0000 7f507d7fa640 1 -- 172.21.15.18:0/2354356187 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5074041070 con 0x7f50780a5670 2024-09-19T10:02:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.346+0000 7f9609150640 1 -- 172.21.15.18:0/989466147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9604108da0 msgr2=0x7f960410cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.346+0000 7f9609150640 1 --2- 172.21.15.18:0/989466147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9604108da0 0x7f960410cdf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009860 tx=0x7f95f402a340 comp rx=0 tx=0).stop 2024-09-19T10:02:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.347+0000 7f9609150640 1 -- 172.21.15.18:0/989466147 shutdown_connections 2024-09-19T10:02:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.347+0000 7f9609150640 1 --2- 172.21.15.18:0/989466147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f960410d520 0x7f96041150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.347+0000 7f9609150640 1 --2- 172.21.15.18:0/989466147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9604108da0 0x7f960410cdf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.347+0000 7f9609150640 1 --2- 172.21.15.18:0/989466147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96041083f0 0x7f96041087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.347+0000 7f9609150640 1 -- 172.21.15.18:0/989466147 >> 172.21.15.18:0/989466147 conn(0x7f9604077af0 msgr2=0x7f9604079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:58.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.348+0000 7f9609150640 1 -- 172.21.15.18:0/989466147 shutdown_connections 2024-09-19T10:02:58.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.348+0000 7f9609150640 1 -- 172.21.15.18:0/989466147 wait complete. 2024-09-19T10:02:58.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.349+0000 7f9609150640 1 Processor -- start 2024-09-19T10:02:58.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.350+0000 7f9609150640 1 -- start start 2024-09-19T10:02:58.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.350+0000 7f9609150640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96041083f0 0x7f9604073980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.351+0000 7f9609150640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9604108da0 0x7f9604073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.351+0000 7f9609150640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f960410d520 0x7f960406cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.351+0000 7f960259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9604108da0 0x7f9604073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.351+0000 7f960259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9604108da0 0x7f9604073ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45256/0 (socket says 172.21.15.18:45256) 2024-09-19T10:02:58.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.351+0000 7f960259c640 1 -- 172.21.15.18:0/486487947 learned_addr learned my addr 172.21.15.18:0/486487947 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:58.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.351+0000 7f9609150640 1 -- 172.21.15.18:0/486487947 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9604118570 con 0x7f96041083f0 2024-09-19T10:02:58.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.351+0000 7f9609150640 1 -- 172.21.15.18:0/486487947 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f96041183f0 con 0x7f960410d520 2024-09-19T10:02:58.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.351+0000 7f9609150640 1 -- 172.21.15.18:0/486487947 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96041186f0 con 0x7f9604108da0 2024-09-19T10:02:58.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.352+0000 7f9602d9d640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96041083f0 0x7f9604073980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.353+0000 7f960259c640 1 -- 172.21.15.18:0/486487947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f960410d520 msgr2=0x7f960406cbd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T10:02:58.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.353+0000 7f960259c640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f960410d520 0x7f960406cbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.353+0000 7f960259c640 1 -- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96041083f0 msgr2=0x7f9604073980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.353+0000 7f960259c640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96041083f0 0x7f9604073980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.353+0000 7f960259c640 1 -- 172.21.15.18:0/486487947 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960406d490 con 0x7f9604108da0 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.354+0000 7f960259c640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9604108da0 0x7f9604073ec0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f95f4035040 tx=0x7f95f4033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.354+0000 7f9602d9d640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96041083f0 0x7f9604073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.355+0000 7f95ebfff640 1 -- 172.21.15.18:0/486487947 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4037040 con 0x7f9604108da0 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.355+0000 7f95ebfff640 1 -- 172.21.15.18:0/486487947 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95f4040070 con 0x7f9604108da0 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.355+0000 7f95ebfff640 1 -- 172.21.15.18:0/486487947 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4003ae0 con 0x7f9604108da0 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.356+0000 7f9609150640 1 -- 172.21.15.18:0/486487947 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960406d720 con 0x7f9604108da0 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.357+0000 7f9609150640 1 -- 172.21.15.18:0/486487947 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9604071680 con 0x7f9604108da0 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.362+0000 7f960b529740 1 Processor -- start 2024-09-19T10:02:58.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.365+0000 7f95ebfff640 1 -- 172.21.15.18:0/486487947 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f95f4003c80 con 0x7f9604108da0 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.366+0000 7f95ebfff640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95ec0a3450 0x7f95ec0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.367+0000 7f95ebfff640 1 -- 172.21.15.18:0/486487947 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f95f40ef640 con 0x7f9604108da0 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.367+0000 7f960b529740 1 -- start start 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.368+0000 7f960b529740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cad2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.368+0000 7f960b529740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 0x55df3cad1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.368+0000 7f9602d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cad2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.368+0000 7f9602d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cad2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45266/0 (socket says 172.21.15.18:45266) 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.369+0000 7f9602d9d640 1 -- 172.21.15.18:0/1618203509 learned_addr learned my addr 172.21.15.18:0/1618203509 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.369+0000 7f960259c640 1 --2- 172.21.15.18:0/1618203509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 0x55df3cad1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.369+0000 7f960b529740 1 --2- 172.21.15.18:0/1618203509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 0x55df3cade640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.369+0000 7f960b529740 1 -- 172.21.15.18:0/1618203509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55df3ca372f0 con 0x55df3cad1e40 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.370+0000 7f960b529740 1 -- 172.21.15.18:0/1618203509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55df3c9decf0 con 0x55df3cad13e0 2024-09-19T10:02:58.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.369+0000 7f960359e640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95ec0a3450 0x7f95ec0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.370+0000 7f960b529740 1 -- 172.21.15.18:0/1618203509 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55df3ca332b0 con 0x55df3cad2b40 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.370+0000 7f960359e640 1 --2- 172.21.15.18:0/1618203509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 0x55df3cade640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.372+0000 7f960359e640 1 -- 172.21.15.18:0/1618203509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 msgr2=0x55df3cad2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.372+0000 7f960359e640 1 --2- 172.21.15.18:0/1618203509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cad2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.372+0000 7f960359e640 1 -- 172.21.15.18:0/1618203509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 msgr2=0x55df3cad1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.372+0000 7f960359e640 1 --2- 172.21.15.18:0/1618203509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 0x55df3cad1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.372+0000 7f960359e640 1 -- 172.21.15.18:0/1618203509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3c9c33a0 con 0x55df3cad1e40 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.373+0000 7f960359e640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95ec0a3450 0x7f95ec0a5910 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f95f8005940 tx=0x7f95f800e480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.373+0000 7f960359e640 1 --2- 172.21.15.18:0/1618203509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 0x55df3cade640 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f95f8011760 tx=0x7f95f8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26114c63db55fa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.374+0000 7f95e8ff9640 1 -- 172.21.15.18:0/1618203509 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f800eb40 con 0x55df3cad1e40 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.374+0000 7f95e8ff9640 1 -- 172.21.15.18:0/1618203509 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95f8011ce0 con 0x55df3cad1e40 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.376+0000 7f960b529740 1 -- 172.21.15.18:0/1618203509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 msgr2=0x55df3cade640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.376+0000 7f960b529740 1 --2- 172.21.15.18:0/1618203509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 0x55df3cade640 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f95f8011760 tx=0x7f95f8018000 comp rx=0 tx=0).stop 2024-09-19T10:02:58.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.376+0000 7f960b529740 1 -- 172.21.15.18:0/1618203509 shutdown_connections 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.376+0000 7f960b529740 1 --2- 172.21.15.18:0/1618203509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 0x55df3cade640 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.376+0000 7f960b529740 1 --2- 172.21.15.18:0/1618203509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 0x55df3cad1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.376+0000 7f960b529740 1 --2- 172.21.15.18:0/1618203509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cad2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.376+0000 7f960b529740 1 -- 172.21.15.18:0/1618203509 >> 172.21.15.18:0/1618203509 conn(0x55df3ca9a310 msgr2=0x55df3cacdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.378+0000 7f960b529740 1 -- 172.21.15.18:0/1618203509 shutdown_connections 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.380+0000 7f960b529740 1 -- 172.21.15.18:0/1618203509 wait complete. 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.380+0000 7f960b529740 1 -- start start 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.380+0000 7f960b529740 1 Processor -- start 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.381+0000 7f960b529740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 0x55df3cade400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.381+0000 7f960b529740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 0x55df3cadb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.382+0000 7f960b529740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cadbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.382+0000 7f9602d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 0x55df3cade400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.382+0000 7f9602d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 0x55df3cade400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50914/0 (socket says 172.21.15.18:50914) 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.382+0000 7f960259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 0x55df3cadb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.382+0000 7f9602d9d640 1 -- 172.21.15.18:0/2026688804 learned_addr learned my addr 172.21.15.18:0/2026688804 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:58.305 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:02:58.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.382+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55df3cadf000 con 0x55df3cad1e40 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.382+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55df3c9f2060 con 0x55df3cad13e0 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.382+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55df3cadf180 con 0x55df3cad2b40 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.382+0000 7f960b529740 10 client.0 _ll_register_callbacks cb 0x55df3c7458c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.383+0000 7f9602d9d640 1 -- 172.21.15.18:0/2026688804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 msgr2=0x55df3cadbbf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.383+0000 7f9602d9d640 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cadbbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.383+0000 7f9602d9d640 1 -- 172.21.15.18:0/2026688804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 msgr2=0x55df3cadb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.383+0000 7f9602d9d640 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 0x55df3cadb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.383+0000 7f9602d9d640 1 -- 172.21.15.18:0/2026688804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3c7a83c0 con 0x55df3cad13e0 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.384+0000 7f9602d9d640 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 0x55df3cade400 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00fb40 tx=0x7f95fc00d3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8638aab74bbf531e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.384+0000 7f95e6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.384+0000 7f95e6ff5640 1 -- 172.21.15.18:0/2026688804 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc01d060 con 0x55df3cad13e0 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.384+0000 7f95e6ff5640 1 -- 172.21.15.18:0/2026688804 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f95fc00ddc0 con 0x55df3cad13e0 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.384+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f8011ce0 con 0x55df3cad13e0 2024-09-19T10:02:58.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.385+0000 7f95e6ff5640 1 -- 172.21.15.18:0/2026688804 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f95fc003970 con 0x55df3cad13e0 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.385+0000 7f960b529740 10 client.27302 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.385+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55df3caea950 con 0x55df3cad13e0 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.385+0000 7f95e6ff5640 1 -- 172.21.15.18:0/2026688804 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95fc004030 con 0x55df3cad13e0 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.386+0000 7f95e6ff5640 1 -- 172.21.15.18:0/2026688804 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f95fc017070 con 0x55df3cad13e0 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.389+0000 7f960b529740 10 client.27302 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.389+0000 7f960b529740 10 client.27302 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.389+0000 7f960b529740 20 client.27302 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.389+0000 7f960b529740 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55df3caebd60 0x55df3caee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.389+0000 7f960b529740 4 client.27302 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.389+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f95f8011ce0 con 0x55df3caebd60 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.389+0000 7f960259c640 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55df3caebd60 0x55df3caee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.390+0000 7f960259c640 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55df3caebd60 0x55df3caee150 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5521ef66f95246b2 server_cookie=f312b55b563a0a6b in_seq=0 out_seq=0 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.390+0000 7f95e6ff5640 10 client.27302 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.391+0000 7f95e6ff5640 1 -- 172.21.15.18:0/2026688804 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f95f8011ce0 con 0x55df3caebd60 2024-09-19T10:02:58.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.391+0000 7f95e6ff5640 10 client.27302 handle_command_reply: tid=0 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.391+0000 7f960b529740 1 client.27302 shutdown 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.391+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 msgr2=0x55df3cade400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.391+0000 7f960b529740 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 0x55df3cade400 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00fb40 tx=0x7f95fc00d3e0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.394+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 shutdown_connections 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.394+0000 7f960b529740 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55df3caebd60 0x55df3caee150 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.394+0000 7f95e6ff5640 0 client.27302 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.394+0000 7f960b529740 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cadbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.394+0000 7f960b529740 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad1e40 0x55df3cadb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.394+0000 7f960b529740 1 --2- 172.21.15.18:0/2026688804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad13e0 0x55df3cade400 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.394+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 >> 172.21.15.18:0/2026688804 conn(0x55df3ca9a310 msgr2=0x55df3cacd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.398+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 shutdown_connections 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.401+0000 7f960b529740 1 -- 172.21.15.18:0/2026688804 wait complete. 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.401+0000 7f960b529740 20 client.27302 trim_cache size 0 max 16384 2024-09-19T10:02:58.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.444+0000 7f960b529740 1 Processor -- start 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.444+0000 7f960b529740 1 -- start start 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.445+0000 7f960b529740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad13e0 0x55df3cae82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.445+0000 7f960b529740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3caf39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.445+0000 7f960b529740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad2b40 0x55df3caf3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.446+0000 7f9602d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad13e0 0x55df3cae82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.446+0000 7f9602d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad13e0 0x55df3cae82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45288/0 (socket says 172.21.15.18:45288) 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.446+0000 7f960259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3caf39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.446+0000 7f960259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3caf39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50916/0 (socket says 172.21.15.18:50916) 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.446+0000 7f9602d9d640 1 -- 172.21.15.18:0/2532813786 learned_addr learned my addr 172.21.15.18:0/2532813786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.446+0000 7f960b529740 1 -- 172.21.15.18:0/2532813786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f96041bc390 con 0x55df3cad2b40 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.446+0000 7f960b529740 1 -- 172.21.15.18:0/2532813786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f96041bded0 con 0x55df3cad1e40 2024-09-19T10:02:58.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.446+0000 7f960b529740 1 -- 172.21.15.18:0/2532813786 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96041bca60 con 0x55df3cad13e0 2024-09-19T10:02:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.451+0000 7f960359e640 1 --2- 172.21.15.18:0/2532813786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad2b40 0x55df3caf3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.452+0000 7f960259c640 1 -- 172.21.15.18:0/2532813786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad13e0 msgr2=0x55df3cae82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.452+0000 7f960259c640 1 --2- 172.21.15.18:0/2532813786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad13e0 0x55df3cae82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.452+0000 7f960259c640 1 -- 172.21.15.18:0/2532813786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad2b40 msgr2=0x55df3caf3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.452+0000 7f960259c640 1 --2- 172.21.15.18:0/2532813786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad2b40 0x55df3caf3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.452+0000 7f960259c640 1 -- 172.21.15.18:0/2532813786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3caa7800 con 0x55df3cad1e40 2024-09-19T10:02:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.454+0000 7f960259c640 1 --2- 172.21.15.18:0/2532813786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3caf39f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f95f40ed110 tx=0x7f95f40045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=937c6f7c4f075251 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.460+0000 7f95e87f8640 1 -- 172.21.15.18:0/2532813786 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f40c9070 con 0x55df3cad1e40 2024-09-19T10:02:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.460+0000 7f95e87f8640 1 -- 172.21.15.18:0/2532813786 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95f40c48a0 con 0x55df3cad1e40 2024-09-19T10:02:58.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.460+0000 7f95e87f8640 1 -- 172.21.15.18:0/2532813786 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f40da070 con 0x55df3cad1e40 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.462+0000 7f960b529740 1 -- 172.21.15.18:0/2532813786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 msgr2=0x55df3caf39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.462+0000 7f960b529740 1 --2- 172.21.15.18:0/2532813786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3caf39f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f95f40ed110 tx=0x7f95f40045f0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.462+0000 7f960b529740 1 -- 172.21.15.18:0/2532813786 shutdown_connections 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.462+0000 7f960b529740 1 --2- 172.21.15.18:0/2532813786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad2b40 0x55df3caf3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.462+0000 7f960b529740 1 --2- 172.21.15.18:0/2532813786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3caf39f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.462+0000 7f960b529740 1 --2- 172.21.15.18:0/2532813786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad13e0 0x55df3cae82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.462+0000 7f960b529740 1 -- 172.21.15.18:0/2532813786 >> 172.21.15.18:0/2532813786 conn(0x55df3ca9a310 msgr2=0x55df3cad6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.464+0000 7f960b529740 1 -- 172.21.15.18:0/2532813786 shutdown_connections 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.464+0000 7f960b529740 1 -- 172.21.15.18:0/2532813786 wait complete. 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.465+0000 7f960b529740 1 -- start start 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.465+0000 7f960b529740 1 Processor -- start 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.466+0000 7f960b529740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad13e0 0x55df3cae04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.466+0000 7f960b529740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3cae0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.467+0000 7f960b529740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cae0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.467+0000 7f960b529740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f96041bd800 con 0x55df3cad13e0 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.467+0000 7f960b529740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f96041bd130 con 0x55df3cad1e40 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.467+0000 7f960b529740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96041ba370 con 0x55df3cad2b40 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.467+0000 7f960259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3cae0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.467+0000 7f960259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3cae0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50926/0 (socket says 172.21.15.18:50926) 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.467+0000 7f960259c640 1 -- 172.21.15.18:0/2736965154 learned_addr learned my addr 172.21.15.18:0/2736965154 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.467+0000 7f960359e640 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cae0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.468+0000 7f960b529740 10 client.0 _ll_register_callbacks cb 0x7f95fc009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.472+0000 7f960359e640 1 -- 172.21.15.18:0/2736965154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 msgr2=0x55df3cae0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.472+0000 7f960359e640 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3cae0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.472+0000 7f960359e640 1 -- 172.21.15.18:0/2736965154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad13e0 msgr2=0x55df3cae04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.472+0000 7f960359e640 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad13e0 0x55df3cae04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.472+0000 7f960359e640 1 -- 172.21.15.18:0/2736965154 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3cb55cb0 con 0x55df3cad2b40 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.473+0000 7f960359e640 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cae0f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f95f800e340 tx=0x7f95f8004260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9682ebb880ad3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.473+0000 7f95e67f4640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.474+0000 7f95e67f4640 1 -- 172.21.15.18:0/2736965154 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f802e070 con 0x55df3cad2b40 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.474+0000 7f95e67f4640 1 -- 172.21.15.18:0/2736965154 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f95f801b830 con 0x55df3cad2b40 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.474+0000 7f960b529740 1 -- 172.21.15.18:0/2736965154 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f40c48a0 con 0x55df3cad2b40 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.475+0000 7f95e67f4640 1 -- 172.21.15.18:0/2736965154 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f95f803a050 con 0x55df3cad2b40 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.475+0000 7f960b529740 10 client.27328 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.475+0000 7f960b529740 1 -- 172.21.15.18:0/2736965154 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55df3cb56f70 con 0x55df3cad2b40 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.478+0000 7f95e67f4640 1 -- 172.21.15.18:0/2736965154 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95f80035f0 con 0x55df3cad2b40 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.479+0000 7f95e67f4640 1 -- 172.21.15.18:0/2736965154 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f95f800f040 con 0x55df3cad2b40 2024-09-19T10:02:58.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.479+0000 7f960b529740 10 client.27328 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.479+0000 7f960b529740 10 client.27328 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.479+0000 7f960b529740 20 client.27328 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.479+0000 7f960b529740 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55df3caebd60 0x55df3cb59370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.479+0000 7f960b529740 4 client.27328 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.479+0000 7f960b529740 1 -- 172.21.15.18:0/2736965154 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f95f40c48a0 con 0x55df3caebd60 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.480+0000 7f9602d9d640 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55df3caebd60 0x55df3cb59370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.482+0000 7f9602d9d640 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55df3caebd60 0x55df3cb59370 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e16ac8184d45d84b server_cookie=9cbac03ade5c2e5d in_seq=0 out_seq=0 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.482+0000 7f95e67f4640 10 client.27328 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.482+0000 7f95e67f4640 1 -- 172.21.15.18:0/2736965154 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f95f40c48a0 con 0x55df3caebd60 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.483+0000 7f95e67f4640 10 client.27328 handle_command_reply: tid=0 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.483+0000 7f960b529740 1 client.27328 shutdown 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.483+0000 7f960b529740 1 -- 172.21.15.18:0/2736965154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 msgr2=0x55df3cae0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.483+0000 7f960b529740 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cae0f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f95f800e340 tx=0x7f95f8004260 comp rx=0 tx=0).stop 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.484+0000 7f960b529740 1 -- 172.21.15.18:0/2736965154 shutdown_connections 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.484+0000 7f960b529740 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55df3caebd60 0x55df3cb59370 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.484+0000 7f960b529740 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df3cad2b40 0x55df3cae0f90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.484+0000 7f95e67f4640 0 client.27328 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.484+0000 7f960b529740 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55df3cad1e40 0x55df3cae0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.484+0000 7f960b529740 1 --2- 172.21.15.18:0/2736965154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df3cad13e0 0x55df3cae04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.484+0000 7f960b529740 1 -- 172.21.15.18:0/2736965154 >> 172.21.15.18:0/2736965154 conn(0x55df3ca9a310 msgr2=0x55df3cacc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.484+0000 7f960b529740 1 -- 172.21.15.18:0/2736965154 shutdown_connections 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.484+0000 7f960b529740 1 -- 172.21.15.18:0/2736965154 wait complete. 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.485+0000 7f960b529740 20 client.27328 trim_cache size 0 max 16384 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.487+0000 7f95e9ffb640 1 -- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95ec0a3450 msgr2=0x7f95ec0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.487+0000 7f95e9ffb640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95ec0a3450 0x7f95ec0a5910 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f95f8005940 tx=0x7f95f800e480 comp rx=0 tx=0).stop 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.487+0000 7f95e9ffb640 1 -- 172.21.15.18:0/486487947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9604108da0 msgr2=0x7f9604073ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.487+0000 7f95e9ffb640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9604108da0 0x7f9604073ec0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f95f4035040 tx=0x7f95f4033d10 comp rx=0 tx=0).stop 2024-09-19T10:02:58.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.488+0000 7f95e9ffb640 1 -- 172.21.15.18:0/486487947 shutdown_connections 2024-09-19T10:02:58.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.488+0000 7f95e9ffb640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f95ec0a3450 0x7f95ec0a5910 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.488+0000 7f95e9ffb640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f960410d520 0x7f960406cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.488+0000 7f95e9ffb640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9604108da0 0x7f9604073ec0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.488+0000 7f95e9ffb640 1 --2- 172.21.15.18:0/486487947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96041083f0 0x7f9604073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.488+0000 7f95e9ffb640 1 -- 172.21.15.18:0/486487947 >> 172.21.15.18:0/486487947 conn(0x7f9604077af0 msgr2=0x7f9604078dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:58.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.489+0000 7f95e9ffb640 1 -- 172.21.15.18:0/486487947 shutdown_connections 2024-09-19T10:02:58.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:02:57.490+0000 7f95e9ffb640 1 -- 172.21.15.18:0/486487947 wait complete. 2024-09-19T10:02:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.295+0000 7f506a7fc640 1 -- 172.21.15.18:0/1710662491 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080076760 con 0x55937f93bb70 2024-09-19T10:02:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.295+0000 7f506a7fc640 1 -- 172.21.15.18:0/1710662491 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f508007a070 con 0x55937f93bb70 2024-09-19T10:02:58.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:57 smithi018 ceph-mon[30956]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 65 MiB/s wr, 391 op/s 2024-09-19T10:02:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.296+0000 7f507ffff640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f50700a3710 0x7f50700a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.296+0000 7f50890a4740 1 -- 172.21.15.18:0/1710662491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 msgr2=0x55937f93bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.296+0000 7f50890a4740 1 --2- 172.21.15.18:0/1710662491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f93bf70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5080065a40 tx=0x7f50800758e0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.298+0000 7f50890a4740 1 -- 172.21.15.18:0/1710662491 shutdown_connections 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.298+0000 7f50890a4740 1 --2- 172.21.15.18:0/1710662491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f941540 0x55937f943a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.298+0000 7f50890a4740 1 --2- 172.21.15.18:0/1710662491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93c4b0 0x55937f940f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.298+0000 7f50890a4740 1 --2- 172.21.15.18:0/1710662491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f93bf70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.298+0000 7f50890a4740 1 -- 172.21.15.18:0/1710662491 >> 172.21.15.18:0/1710662491 conn(0x55937f9371e0 msgr2=0x55937f9375e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.298+0000 7f50890a4740 1 -- 172.21.15.18:0/1710662491 shutdown_connections 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.298+0000 7f50890a4740 1 -- 172.21.15.18:0/1710662491 wait complete. 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.299+0000 7f50890a4740 1 -- start start 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.299+0000 7f50890a4740 1 Processor -- start 2024-09-19T10:02:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.300+0000 7f50890a4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93bb70 0x55937f967fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.300+0000 7f50890a4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 0x55937f968520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.300+0000 7f50890a4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f941540 0x55937f96f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.300+0000 7f50890a4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55937f966520 con 0x55937f93bb70 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.300+0000 7f50890a4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55937f828290 con 0x55937f93c4b0 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.300+0000 7f50890a4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55937f9666a0 con 0x55937f941540 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.300+0000 7f50890a4740 10 client.0 _ll_register_callbacks cb 0x55937f859140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.301+0000 7f50848b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93bb70 0x55937f967fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.301+0000 7f50848b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93bb70 0x55937f967fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57974/0 (socket says 172.21.15.18:57974) 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.301+0000 7f50848b0640 1 -- 172.21.15.18:0/2459687401 learned_addr learned my addr 172.21.15.18:0/2459687401 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.302+0000 7f50848b0640 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f941540 0x55937f96f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.303+0000 7f507f7fe640 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 0x55937f968520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.303+0000 7f507ffff640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f50700a3710 0x7f50700a5bd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f50740b8610 tx=0x7f5074005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.304+0000 7f50848b0640 1 -- 172.21.15.18:0/2459687401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f941540 msgr2=0x55937f96f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.304+0000 7f50848b0640 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f941540 0x55937f96f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.305+0000 7f50848b0640 1 -- 172.21.15.18:0/2459687401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 msgr2=0x55937f968520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.305+0000 7f50848b0640 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 0x55937f968520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.305+0000 7f50848b0640 1 -- 172.21.15.18:0/2459687401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55937f5b2210 con 0x55937f93bb70 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.306+0000 7f50848b0640 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93bb70 0x55937f967fe0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f5080000b60 tx=0x7f5080068340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e8b4c855c93eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.306+0000 7f50637fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.308+0000 7f50637fe640 1 -- 172.21.15.18:0/2459687401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080088050 con 0x55937f93bb70 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.308+0000 7f50890a4740 1 -- 172.21.15.18:0/2459687401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55937f8aca20 con 0x55937f93bb70 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.309+0000 7f50637fe640 1 -- 172.21.15.18:0/2459687401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5080076760 con 0x55937f93bb70 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.315+0000 7f50637fe640 1 -- 172.21.15.18:0/2459687401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5080076960 con 0x55937f93bb70 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.315+0000 7f50890a4740 10 client.17859 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.315+0000 7f50890a4740 1 -- 172.21.15.18:0/2459687401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55937f67e620 con 0x55937f93bb70 2024-09-19T10:02:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.323+0000 7f50637fe640 1 -- 172.21.15.18:0/2459687401 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55937f8aca20 con 0x55937f93bb70 2024-09-19T10:02:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.323+0000 7f50637fe640 1 -- 172.21.15.18:0/2459687401 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f508008c020 con 0x55937f93bb70 2024-09-19T10:02:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.325+0000 7f50890a4740 10 client.17859 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.325+0000 7f50890a4740 10 client.17859 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.325+0000 7f50890a4740 20 client.17859 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.325+0000 7f50890a4740 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55937f973fa0 0x55937f9763e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.325+0000 7f50890a4740 4 client.17859 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:02:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.325+0000 7f50890a4740 1 -- 172.21.15.18:0/2459687401 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55937f8a6d70 con 0x55937f973fa0 2024-09-19T10:02:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.328+0000 7f507f7fe640 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55937f973fa0 0x55937f9763e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.340+0000 7f507f7fe640 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55937f973fa0 0x55937f9763e0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e39fb7bb073388ad server_cookie=9099ce96812f1adf in_seq=0 out_seq=0 2024-09-19T10:02:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.340+0000 7f50637fe640 10 client.17859 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.354+0000 7f50637fe640 1 -- 172.21.15.18:0/2459687401 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55937f8a6d70 con 0x55937f973fa0 2024-09-19T10:02:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.354+0000 7f50637fe640 10 client.17859 handle_command_reply: tid=0 2024-09-19T10:02:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.354+0000 7f50890a4740 1 client.17859 shutdown 2024-09-19T10:02:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.355+0000 7f50890a4740 1 -- 172.21.15.18:0/2459687401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93bb70 msgr2=0x55937f967fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.355+0000 7f50890a4740 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93bb70 0x55937f967fe0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f5080000b60 tx=0x7f5080068340 comp rx=0 tx=0).stop 2024-09-19T10:02:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.355+0000 7f50890a4740 1 -- 172.21.15.18:0/2459687401 shutdown_connections 2024-09-19T10:02:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.355+0000 7f50890a4740 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55937f973fa0 0x55937f9763e0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.355+0000 7f50890a4740 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f941540 0x55937f96f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.355+0000 7f50890a4740 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 0x55937f968520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.355+0000 7f50890a4740 1 --2- 172.21.15.18:0/2459687401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93bb70 0x55937f967fe0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.355+0000 7f50890a4740 1 -- 172.21.15.18:0/2459687401 >> 172.21.15.18:0/2459687401 conn(0x55937f9371e0 msgr2=0x55937f938a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.355+0000 7f50637fe640 0 client.17859 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.356+0000 7f50890a4740 1 -- 172.21.15.18:0/2459687401 shutdown_connections 2024-09-19T10:02:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.358+0000 7f50890a4740 1 -- 172.21.15.18:0/2459687401 wait complete. 2024-09-19T10:02:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.358+0000 7f50890a4740 20 client.17859 trim_cache size 0 max 16384 2024-09-19T10:02:58.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:57 smithi049 ceph-mon[34858]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 65 MiB/s wr, 391 op/s 2024-09-19T10:02:58.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:58 smithi162 ceph-mon[35174]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 65 MiB/s wr, 391 op/s 2024-09-19T10:02:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.468+0000 7f50890a4740 1 Processor -- start 2024-09-19T10:02:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.469+0000 7f50890a4740 1 -- start start 2024-09-19T10:02:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.469+0000 7f50890a4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93bb70 0x55937f93cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.475+0000 7f50890a4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93c4b0 0x55937f96f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.475+0000 7f50890a4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f941540 0x55937f938090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.475+0000 7f50890a4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f506400e4f0 con 0x55937f93c4b0 2024-09-19T10:02:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.475+0000 7f50890a4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5064010030 con 0x55937f93bb70 2024-09-19T10:02:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.475+0000 7f50890a4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f506400ebc0 con 0x55937f941540 2024-09-19T10:02:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.476+0000 7f50848b0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93bb70 0x55937f93cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.477+0000 7f50848b0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93bb70 0x55937f93cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50970/0 (socket says 172.21.15.18:50970) 2024-09-19T10:02:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.477+0000 7f50848b0640 1 -- 172.21.15.18:0/3860293120 learned_addr learned my addr 172.21.15.18:0/3860293120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.477+0000 7f50848b0640 1 --2- 172.21.15.18:0/3860293120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f941540 0x55937f938090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.478+0000 7f50848b0640 1 -- 172.21.15.18:0/3860293120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f941540 msgr2=0x55937f938090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.478+0000 7f50848b0640 1 --2- 172.21.15.18:0/3860293120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f941540 0x55937f938090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.478+0000 7f50848b0640 1 -- 172.21.15.18:0/3860293120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93c4b0 msgr2=0x55937f96f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.478+0000 7f50848b0640 1 --2- 172.21.15.18:0/3860293120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93c4b0 0x55937f96f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.479+0000 7f50848b0640 1 -- 172.21.15.18:0/3860293120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55937f976a60 con 0x55937f93bb70 2024-09-19T10:02:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.480+0000 7f50848b0640 1 --2- 172.21.15.18:0/3860293120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93bb70 0x55937f93cd70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f508007fdd0 tx=0x7f5080078040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7936213e3caa5c25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.481+0000 7f5069ffb640 1 -- 172.21.15.18:0/3860293120 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080088040 con 0x55937f93bb70 2024-09-19T10:02:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.481+0000 7f5069ffb640 1 -- 172.21.15.18:0/3860293120 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5080083070 con 0x55937f93bb70 2024-09-19T10:02:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.481+0000 7f5069ffb640 1 -- 172.21.15.18:0/3860293120 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508007f9c0 con 0x55937f93bb70 2024-09-19T10:02:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.483+0000 7f50890a4740 1 -- 172.21.15.18:0/3860293120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93bb70 msgr2=0x55937f93cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:02:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.483+0000 7f50890a4740 1 --2- 172.21.15.18:0/3860293120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93bb70 0x55937f93cd70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f508007fdd0 tx=0x7f5080078040 comp rx=0 tx=0).stop 2024-09-19T10:02:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.483+0000 7f50890a4740 1 -- 172.21.15.18:0/3860293120 shutdown_connections 2024-09-19T10:02:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.483+0000 7f50890a4740 1 --2- 172.21.15.18:0/3860293120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f941540 0x55937f938090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.483+0000 7f50890a4740 1 --2- 172.21.15.18:0/3860293120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f93c4b0 0x55937f96f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.483+0000 7f50890a4740 1 --2- 172.21.15.18:0/3860293120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93bb70 0x55937f93cd70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.483+0000 7f50890a4740 1 -- 172.21.15.18:0/3860293120 >> 172.21.15.18:0/3860293120 conn(0x55937f9371e0 msgr2=0x55937f967fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:02:58.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.491+0000 7f50890a4740 1 -- 172.21.15.18:0/3860293120 shutdown_connections 2024-09-19T10:02:58.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.491+0000 7f50890a4740 1 -- 172.21.15.18:0/3860293120 wait complete. 2024-09-19T10:02:58.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.492+0000 7f50890a4740 1 -- start start 2024-09-19T10:02:58.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.492+0000 7f50890a4740 1 Processor -- start 2024-09-19T10:02:58.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.495+0000 7f50890a4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f96f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.498 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.496+0000 7f50890a4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 0x55937f96bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.496+0000 7f50890a4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f941540 0x55937f96c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.496+0000 7f50848b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f96f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.496+0000 7f50848b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f96f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45360/0 (socket says 172.21.15.18:45360) 2024-09-19T10:02:58.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.496+0000 7f50848b0640 1 -- 172.21.15.18:0/1417398246 learned_addr learned my addr 172.21.15.18:0/1417398246 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:02:58.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.496+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f506400f960 con 0x55937f941540 2024-09-19T10:02:58.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.496+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f506400f290 con 0x55937f93c4b0 2024-09-19T10:02:58.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.496+0000 7f507f7fe640 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 0x55937f96bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.499 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.497+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f506400c4d0 con 0x55937f93bb70 2024-09-19T10:02:58.501 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.499+0000 7f50848b0640 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f941540 0x55937f96c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.499+0000 7f507f7fe640 1 -- 172.21.15.18:0/1417398246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 msgr2=0x55937f96f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.499+0000 7f507f7fe640 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f96f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.499+0000 7f507f7fe640 1 -- 172.21.15.18:0/1417398246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f941540 msgr2=0x55937f96c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:02:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.499+0000 7f507f7fe640 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f941540 0x55937f96c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:02:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.499+0000 7f507f7fe640 1 -- 172.21.15.18:0/1417398246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55937f9dccb0 con 0x55937f93c4b0 2024-09-19T10:02:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.499+0000 7f50848b0640 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f96f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:02:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.500+0000 7f50890a4740 10 client.0 _ll_register_callbacks cb 0x7f506c0093b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:02:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.500+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5080083070 con 0x55937f93c4b0 2024-09-19T10:02:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.503+0000 7f507f7fe640 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 0x55937f96bef0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55937f976c60 tx=0x7f506c015710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aa7327843289d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:02:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.503+0000 7f50637fe640 10 client.27326 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:02:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.507+0000 7f50637fe640 1 -- 172.21.15.18:0/1417398246 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c025060 con 0x55937f93c4b0 2024-09-19T10:02:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.507+0000 7f50637fe640 1 -- 172.21.15.18:0/1417398246 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f506c005990 con 0x55937f93c4b0 2024-09-19T10:02:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.507+0000 7f50637fe640 1 -- 172.21.15.18:0/1417398246 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f506c005c30 con 0x55937f93c4b0 2024-09-19T10:02:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.508+0000 7f50890a4740 10 client.27326 fetch_fsmap learned FSMap version 28 2024-09-19T10:02:58.511 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.509+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55937f9ddeb0 con 0x55937f93c4b0 2024-09-19T10:02:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.511+0000 7f50637fe640 1 -- 172.21.15.18:0/1417398246 <== mon.2 v2:172.21.15.49:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f506c006030 con 0x55937f93c4b0 2024-09-19T10:02:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.511+0000 7f50890a4740 10 client.27326 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:02:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.511+0000 7f50890a4740 10 client.27326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:02:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.511+0000 7f50890a4740 20 client.27326 populate_metadata read hostname 'smithi018' 2024-09-19T10:02:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.511+0000 7f50890a4740 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55937f9de780 0x55937f9e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:02:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.511+0000 7f50890a4740 4 client.27326 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:02:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.511+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55937f823900 con 0x55937f9de780 2024-09-19T10:02:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.512+0000 7f50848b0640 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55937f9de780 0x55937f9e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:02:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.522+0000 7f50848b0640 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55937f9de780 0x55937f9e0ba0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88aba9c1597f2c85 server_cookie=868872a3361ce1a8 in_seq=0 out_seq=0 2024-09-19T10:02:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:02:58.523+0000 7f50637fe640 10 client.27326 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:02:59.924 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:02:59.924 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:02:59.924 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:59 smithi018 ceph-mon[30956]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 98 MiB/s wr, 510 op/s 2024-09-19T10:02:59.924 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:02:59.924 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:02:59 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:00.031 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T10:03:00.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:00.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:00.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:59 smithi049 ceph-mon[34858]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 98 MiB/s wr, 510 op/s 2024-09-19T10:03:00.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:00.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:02:59 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:59 smithi162 ceph-mon[35174]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 98 MiB/s wr, 510 op/s 2024-09-19T10:03:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:00.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:02:59 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:00.232 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.198+0000 7fbc5359e640 1 -- 172.21.15.18:0/2640514452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc5406e4f0 msgr2=0x7fbc5406e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.198+0000 7fbc5359e640 1 --2- 172.21.15.18:0/2640514452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc5406e4f0 0x7fbc5406e930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00afd0 tx=0x7fbc4c02a560 comp rx=0 tx=0).stop 2024-09-19T10:03:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.198+0000 7fbc5359e640 1 -- 172.21.15.18:0/2640514452 shutdown_connections 2024-09-19T10:03:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.198+0000 7fbc5359e640 1 --2- 172.21.15.18:0/2640514452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc5406ee70 0x7fbc5407a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.198+0000 7fbc5359e640 1 --2- 172.21.15.18:0/2640514452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc5406e4f0 0x7fbc5406e930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.198+0000 7fbc5359e640 1 --2- 172.21.15.18:0/2640514452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5410e090 0x7fbc5410e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.198+0000 7fbc5359e640 1 -- 172.21.15.18:0/2640514452 >> 172.21.15.18:0/2640514452 conn(0x7fbc54073180 msgr2=0x7fbc54073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.198+0000 7fbc5359e640 1 -- 172.21.15.18:0/2640514452 shutdown_connections 2024-09-19T10:03:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.199+0000 7fbc5359e640 1 -- 172.21.15.18:0/2640514452 wait complete. 2024-09-19T10:03:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.200+0000 7fbc5359e640 1 Processor -- start 2024-09-19T10:03:01.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.201+0000 7fbc5359e640 1 -- start start 2024-09-19T10:03:01.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.201+0000 7fbc5359e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc5406e4f0 0x7fbc54084540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:01.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.202+0000 7fbc5359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc5406ee70 0x7fbc54084a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:01.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.202+0000 7fbc5359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5410e090 0x7fbc5407d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:01.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.202+0000 7fbc5359e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbc54131c20 con 0x7fbc5406ee70 2024-09-19T10:03:01.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.202+0000 7fbc5359e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbc54131aa0 con 0x7fbc5410e090 2024-09-19T10:03:01.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.202+0000 7fbc5359e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc54131da0 con 0x7fbc5406e4f0 2024-09-19T10:03:01.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.202+0000 7fbc5259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc5406e4f0 0x7fbc54084540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:01.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.202+0000 7fbc5259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc5406e4f0 0x7fbc54084540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45386/0 (socket says 172.21.15.18:45386) 2024-09-19T10:03:01.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.202+0000 7fbc5259c640 1 -- 172.21.15.18:0/1997206537 learned_addr learned my addr 172.21.15.18:0/1997206537 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:01.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.202+0000 7fbc52d9d640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5410e090 0x7fbc5407d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:01.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.203+0000 7fbc5259c640 1 -- 172.21.15.18:0/1997206537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5410e090 msgr2=0x7fbc5407d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:01.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.203+0000 7fbc5259c640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5410e090 0x7fbc5407d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:01.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.203+0000 7fbc5259c640 1 -- 172.21.15.18:0/1997206537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc5406ee70 msgr2=0x7fbc54084a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:01.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.203+0000 7fbc5259c640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc5406ee70 0x7fbc54084a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:01.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.203+0000 7fbc5259c640 1 -- 172.21.15.18:0/1997206537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5407e050 con 0x7fbc5406e4f0 2024-09-19T10:03:01.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.203+0000 7fbc5259c640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc5406e4f0 0x7fbc54084540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400daf0 tx=0x7fbc4400af60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:01.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.204+0000 7fbc437fe640 1 -- 172.21.15.18:0/1997206537 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4401a070 con 0x7fbc5406e4f0 2024-09-19T10:03:01.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.204+0000 7fbc5359e640 1 -- 172.21.15.18:0/1997206537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5407e340 con 0x7fbc5406e4f0 2024-09-19T10:03:01.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.204+0000 7fbc5359e640 1 -- 172.21.15.18:0/1997206537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc54082380 con 0x7fbc5406e4f0 2024-09-19T10:03:01.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.206+0000 7fbc437fe640 1 -- 172.21.15.18:0/1997206537 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc4400cc70 con 0x7fbc5406e4f0 2024-09-19T10:03:01.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.211+0000 7fbc437fe640 1 -- 172.21.15.18:0/1997206537 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc440146f0 con 0x7fbc5406e4f0 2024-09-19T10:03:01.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.211+0000 7fbc5359e640 1 -- 172.21.15.18:0/1997206537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc541096d0 con 0x7fbc5406e4f0 2024-09-19T10:03:01.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.215+0000 7fbc437fe640 1 -- 172.21.15.18:0/1997206537 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbc4401d070 con 0x7fbc5406e4f0 2024-09-19T10:03:01.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.217+0000 7fbc437fe640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbc3c0a31f0 0x7fbc3c0a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:01.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.217+0000 7fbc437fe640 1 -- 172.21.15.18:0/1997206537 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbc440cf250 con 0x7fbc5406e4f0 2024-09-19T10:03:01.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.218+0000 7fbc51d9b640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbc3c0a31f0 0x7fbc3c0a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:01.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.218+0000 7fbc437fe640 1 -- 172.21.15.18:0/1997206537 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbc4400ce20 con 0x7fbc5406e4f0 2024-09-19T10:03:01.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.222+0000 7fbc51d9b640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbc3c0a31f0 0x7fbc3c0a56b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c02ab50 tx=0x7fbc4c005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:01.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.624+0000 7fbc5359e640 1 -- 172.21.15.18:0/1997206537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc5407eb00 con 0x7fbc5406e4f0 2024-09-19T10:03:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:03:01.630 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:03:01.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.627+0000 7fbc437fe640 1 -- 172.21.15.18:0/1997206537 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fbc4409bfa0 con 0x7fbc5406e4f0 2024-09-19T10:03:01.630 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:03:01.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 -- 172.21.15.18:0/1997206537 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbc3c0a31f0 msgr2=0x7fbc3c0a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:01.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbc3c0a31f0 0x7fbc3c0a56b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c02ab50 tx=0x7fbc4c005f80 comp rx=0 tx=0).stop 2024-09-19T10:03:01.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 -- 172.21.15.18:0/1997206537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc5406e4f0 msgr2=0x7fbc54084540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:01.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc5406e4f0 0x7fbc54084540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400daf0 tx=0x7fbc4400af60 comp rx=0 tx=0).stop 2024-09-19T10:03:01.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 -- 172.21.15.18:0/1997206537 shutdown_connections 2024-09-19T10:03:01.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fbc3c0a31f0 0x7fbc3c0a56b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:01.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5410e090 0x7fbc5407d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:01.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc5406ee70 0x7fbc54084a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:01.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 --2- 172.21.15.18:0/1997206537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc5406e4f0 0x7fbc54084540 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:01.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 -- 172.21.15.18:0/1997206537 >> 172.21.15.18:0/1997206537 conn(0x7fbc54073180 msgr2=0x7fbc5406d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:01.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 -- 172.21.15.18:0/1997206537 shutdown_connections 2024-09-19T10:03:01.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:01.631+0000 7fbc5359e640 1 -- 172.21.15.18:0/1997206537 wait complete. 2024-09-19T10:03:02.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:02 smithi018 ceph-mon[30956]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 138 MiB/s wr, 712 op/s 2024-09-19T10:03:02.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:02 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1997206537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:03:02.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:02 smithi049 ceph-mon[34858]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 138 MiB/s wr, 712 op/s 2024-09-19T10:03:02.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:02 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1997206537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:03:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:02 smithi162 ceph-mon[35174]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 138 MiB/s wr, 712 op/s 2024-09-19T10:03:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:02 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1997206537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:03:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:03.001 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T10:03:03.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T10:03:03.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.982+0000 7f4f1e134640 1 -- 172.21.15.18:0/4221972879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f18108e00 msgr2=0x7f4f1810ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.982+0000 7f4f1e134640 1 --2- 172.21.15.18:0/4221972879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f18108e00 0x7f4f1810ce00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009900 tx=0x7f4f0002a420 comp rx=0 tx=0).stop 2024-09-19T10:03:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.983+0000 7f4f1e134640 1 -- 172.21.15.18:0/4221972879 shutdown_connections 2024-09-19T10:03:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.983+0000 7f4f1e134640 1 --2- 172.21.15.18:0/4221972879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f1810d530 0x7f4f181150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.983+0000 7f4f1e134640 1 --2- 172.21.15.18:0/4221972879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f18108e00 0x7f4f1810ce00 secure :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009900 tx=0x7f4f0002a420 comp rx=0 tx=0).stop 2024-09-19T10:03:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.984+0000 7f4f1e134640 1 --2- 172.21.15.18:0/4221972879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f18108450 0x7f4f18108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.984+0000 7f4f1e134640 1 -- 172.21.15.18:0/4221972879 >> 172.21.15.18:0/4221972879 conn(0x7f4f18077ba0 msgr2=0x7f4f18079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.988+0000 7f4f1e134640 1 -- 172.21.15.18:0/4221972879 shutdown_connections 2024-09-19T10:03:03.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.988+0000 7f4f1e134640 1 -- 172.21.15.18:0/4221972879 wait complete. 2024-09-19T10:03:03.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.989+0000 7f4f1e134640 1 Processor -- start 2024-09-19T10:03:03.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.989+0000 7f4f1e134640 1 -- start start 2024-09-19T10:03:03.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.989+0000 7f4f1e134640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f18108450 0x7f4f18073c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:03.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.990+0000 7f4f1e134640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1810d530 0x7f4f1806cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:03.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.990+0000 7f4f1e134640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f1806d220 0x7f4f1806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.990+0000 7f4f1e134640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f18118580 con 0x7f4f1810d530 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.990+0000 7f4f1e134640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f18118400 con 0x7f4f1806d220 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.990+0000 7f4f177fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f18108450 0x7f4f18073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.991+0000 7f4f0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1810d530 0x7f4f1806cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.991+0000 7f4f0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1810d530 0x7f4f1806cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58026/0 (socket says 172.21.15.18:58026) 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.991+0000 7f4f0ffff640 1 -- 172.21.15.18:0/2724450376 learned_addr learned my addr 172.21.15.18:0/2724450376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.991+0000 7f4f1e134640 1 -- 172.21.15.18:0/2724450376 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f18118700 con 0x7f4f18108450 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.992+0000 7f4f0ffff640 1 -- 172.21.15.18:0/2724450376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f18108450 msgr2=0x7f4f18073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.992+0000 7f4f0ffff640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f18108450 0x7f4f18073c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.992+0000 7f4f0ffff640 1 -- 172.21.15.18:0/2724450376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f1806d220 msgr2=0x7f4f1806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.992+0000 7f4f0ffff640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f1806d220 0x7f4f1806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.992+0000 7f4f0ffff640 1 -- 172.21.15.18:0/2724450376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f180718e0 con 0x7f4f1810d530 2024-09-19T10:03:04.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.993+0000 7f4f0ffff640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1810d530 0x7f4f1806cce0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f4f000058c0 tx=0x7f4f00003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:04.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.995+0000 7f4f157fa640 1 -- 172.21.15.18:0/2724450376 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0003f070 con 0x7f4f1810d530 2024-09-19T10:03:04.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.995+0000 7f4f157fa640 1 -- 172.21.15.18:0/2724450376 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f00031c90 con 0x7f4f1810d530 2024-09-19T10:03:04.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.995+0000 7f4f157fa640 1 -- 172.21.15.18:0/2724450376 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f00035070 con 0x7f4f1810d530 2024-09-19T10:03:04.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.995+0000 7f4f1e134640 1 -- 172.21.15.18:0/2724450376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f18071b70 con 0x7f4f1810d530 2024-09-19T10:03:04.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:03.996+0000 7f4f1e134640 1 -- 172.21.15.18:0/2724450376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f18072000 con 0x7f4f1810d530 2024-09-19T10:03:04.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.003+0000 7f4f2050d740 1 Processor -- start 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.004+0000 7f4f2050d740 1 -- start start 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.005+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c34fdb40 0x55f6c34fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.006+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c34fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.006+0000 7f4f17fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c34fdb40 0x55f6c34fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.006+0000 7f4f17fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c34fdb40 0x55f6c34fc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45412/0 (socket says 172.21.15.18:45412) 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.006+0000 7f4f17fff640 1 -- 172.21.15.18:0/2067025928 learned_addr learned my addr 172.21.15.18:0/2067025928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.006+0000 7f4f2050d740 1 --2- 172.21.15.18:0/2067025928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 0x55f6c3509760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.007+0000 7f4f2050d740 1 -- 172.21.15.18:0/2067025928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6c34622f0 con 0x55f6c34fc5d0 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.007+0000 7f4f2050d740 1 -- 172.21.15.18:0/2067025928 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f6c3409cf0 con 0x55f6c3507370 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.007+0000 7f4f2050d740 1 -- 172.21.15.18:0/2067025928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f6c345e2b0 con 0x55f6c34fdb40 2024-09-19T10:03:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.008+0000 7f4f157fa640 1 -- 172.21.15.18:0/2724450376 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4f000317b0 con 0x7f4f1810d530 2024-09-19T10:03:04.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.008+0000 7f4f17fff640 1 -- 172.21.15.18:0/2067025928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 msgr2=0x55f6c3509760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:04.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.008+0000 7f4f17fff640 1 --2- 172.21.15.18:0/2067025928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 0x55f6c3509760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.008+0000 7f4f17fff640 1 -- 172.21.15.18:0/2067025928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 msgr2=0x55f6c34fca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:04.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.008+0000 7f4f17fff640 1 --2- 172.21.15.18:0/2067025928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c34fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.008+0000 7f4f17fff640 1 -- 172.21.15.18:0/2067025928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6c33ee3a0 con 0x55f6c34fdb40 2024-09-19T10:03:04.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.009+0000 7f4f17fff640 1 --2- 172.21.15.18:0/2067025928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c34fdb40 0x55f6c34fc090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000ba70 tx=0x7f4f1000bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f152fc73392f5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:04.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.009+0000 7f4f0dffb640 1 -- 172.21.15.18:0/2067025928 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000dc40 con 0x55f6c34fdb40 2024-09-19T10:03:04.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.009+0000 7f4f0dffb640 1 -- 172.21.15.18:0/2067025928 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f1000dde0 con 0x55f6c34fdb40 2024-09-19T10:03:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.011+0000 7f4f2050d740 1 -- 172.21.15.18:0/2067025928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c34fdb40 msgr2=0x55f6c34fc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.011+0000 7f4f2050d740 1 --2- 172.21.15.18:0/2067025928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c34fdb40 0x55f6c34fc090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000ba70 tx=0x7f4f1000bf30 comp rx=0 tx=0).stop 2024-09-19T10:03:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.011+0000 7f4f2050d740 1 -- 172.21.15.18:0/2067025928 shutdown_connections 2024-09-19T10:03:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.011+0000 7f4f2050d740 1 --2- 172.21.15.18:0/2067025928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 0x55f6c3509760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.011+0000 7f4f2050d740 1 --2- 172.21.15.18:0/2067025928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c34fca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.011+0000 7f4f2050d740 1 --2- 172.21.15.18:0/2067025928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c34fdb40 0x55f6c34fc090 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.011+0000 7f4f2050d740 1 -- 172.21.15.18:0/2067025928 >> 172.21.15.18:0/2067025928 conn(0x55f6c34c5310 msgr2=0x55f6c34f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.046+0000 7f4f2050d740 1 -- 172.21.15.18:0/2067025928 shutdown_connections 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.046+0000 7f4f2050d740 1 -- 172.21.15.18:0/2067025928 wait complete. 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.046+0000 7f4f157fa640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f040a3310 0x7f4f040a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.047+0000 7f4f177fe640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f040a3310 0x7f4f040a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.047+0000 7f4f157fa640 1 -- 172.21.15.18:0/2724450376 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4f000ef880 con 0x7f4f1810d530 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.047+0000 7f4f2050d740 1 -- start start 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.048+0000 7f4f177fe640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f040a3310 0x7f4f040a57d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x55f6c34f9ac0 tx=0x7f4f08004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.048+0000 7f4f2050d740 1 Processor -- start 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.049+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c3506ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.049+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 0x55f6c3503d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.049+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c3504750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.049+0000 7f4f2050d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6c350a0c0 con 0x55f6c34fc5d0 2024-09-19T10:03:04.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.050+0000 7f4f2050d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f6c341d060 con 0x55f6c3507370 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.050+0000 7f4f2050d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f6c350a240 con 0x55f6c35042d0 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.050+0000 7f4f2050d740 10 client.0 _ll_register_callbacks cb 0x55f6c31708c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.050+0000 7f4f17fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c3504750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.050+0000 7f4f17fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c3504750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45422/0 (socket says 172.21.15.18:45422) 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.050+0000 7f4f17fff640 1 -- 172.21.15.18:0/3722562076 learned_addr learned my addr 172.21.15.18:0/3722562076 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.053+0000 7f4f17fff640 1 -- 172.21.15.18:0/3722562076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 msgr2=0x55f6c3503d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.054+0000 7f4f17fff640 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 0x55f6c3503d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.054+0000 7f4f17fff640 1 -- 172.21.15.18:0/3722562076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 msgr2=0x55f6c3506ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.054+0000 7f4f17fff640 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c3506ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.054+0000 7f4f17fff640 1 -- 172.21.15.18:0/3722562076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6c31d33c0 con 0x55f6c35042d0 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.054+0000 7f4f17fff640 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c3504750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000dfe0 tx=0x7f4f100047a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4266249df64478bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.054+0000 7f4ef6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.055+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/3722562076 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10004040 con 0x55f6c35042d0 2024-09-19T10:03:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.055+0000 7f4f2050d740 1 -- 172.21.15.18:0/3722562076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f6c346f860 con 0x55f6c35042d0 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.055+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/3722562076 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4f100041e0 con 0x55f6c35042d0 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.055+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/3722562076 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f100043e0 con 0x55f6c35042d0 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.056+0000 7f4f2050d740 10 client.27364 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.056+0000 7f4f2050d740 1 -- 172.21.15.18:0/3722562076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f6c3515e00 con 0x55f6c35042d0 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.056+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/3722562076 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f10020030 con 0x55f6c35042d0 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.057+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/3722562076 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4f10010b90 con 0x55f6c35042d0 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.058+0000 7f4f2050d740 10 client.27364 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.058+0000 7f4f2050d740 10 client.27364 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.058+0000 7f4f2050d740 20 client.27364 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.059+0000 7f4f2050d740 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55f6c3517630 0x55f6c3519a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.059+0000 7f4f2050d740 4 client.27364 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.059+0000 7f4f2050d740 1 -- 172.21.15.18:0/3722562076 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6c346f860 con 0x55f6c3517630 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.060+0000 7f4f177fe640 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55f6c3517630 0x55f6c3519a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.062+0000 7f4f177fe640 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55f6c3517630 0x55f6c3519a80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=493119f148792456 server_cookie=5678b0f34171202f in_seq=0 out_seq=0 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.062+0000 7f4ef6ffd640 10 client.27364 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.064+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/3722562076 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6c346f860 con 0x55f6c3517630 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.064+0000 7f4ef6ffd640 10 client.27364 handle_command_reply: tid=0 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.065+0000 7f4f2050d740 1 client.27364 shutdown 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.065+0000 7f4f2050d740 1 -- 172.21.15.18:0/3722562076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 msgr2=0x55f6c3504750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.065+0000 7f4f2050d740 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c3504750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000dfe0 tx=0x7f4f100047a0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.065+0000 7f4f2050d740 1 -- 172.21.15.18:0/3722562076 shutdown_connections 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.065+0000 7f4f2050d740 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55f6c3517630 0x55f6c3519a80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.065+0000 7f4f2050d740 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c3504750 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.065+0000 7f4f2050d740 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 0x55f6c3503d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.065+0000 7f4f2050d740 1 --2- 172.21.15.18:0/3722562076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c3506ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.065+0000 7f4f2050d740 1 -- 172.21.15.18:0/3722562076 >> 172.21.15.18:0/3722562076 conn(0x55f6c34c5310 msgr2=0x55f6c34fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:04.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.066+0000 7f4ef6ffd640 0 client.27364 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:03:04.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.066+0000 7f4f2050d740 1 -- 172.21.15.18:0/3722562076 shutdown_connections 2024-09-19T10:03:04.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.066+0000 7f4f2050d740 1 -- 172.21.15.18:0/3722562076 wait complete. 2024-09-19T10:03:04.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.066+0000 7f4f2050d740 20 client.27364 trim_cache size 0 max 16384 2024-09-19T10:03:04.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.124+0000 7f4f2050d740 1 Processor -- start 2024-09-19T10:03:04.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.124+0000 7f4f2050d740 1 -- start start 2024-09-19T10:03:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.125+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c3502d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.125+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c35042d0 0x55f6c34ff120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.126+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c3507370 0x55f6c351f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.126+0000 7f4f2050d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f181c5140 con 0x55f6c34fc5d0 2024-09-19T10:03:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.126+0000 7f4f2050d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f181c6c80 con 0x55f6c35042d0 2024-09-19T10:03:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.126+0000 7f4f2050d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f181c5810 con 0x55f6c3507370 2024-09-19T10:03:04.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.129+0000 7f4f177fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c3502d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.129+0000 7f4f177fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c3502d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58048/0 (socket says 172.21.15.18:58048) 2024-09-19T10:03:04.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.129+0000 7f4f177fe640 1 -- 172.21.15.18:0/2681170393 learned_addr learned my addr 172.21.15.18:0/2681170393 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:04.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.131+0000 7f4f0ffff640 1 --2- 172.21.15.18:0/2681170393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c35042d0 0x55f6c34ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.131+0000 7f4f17fff640 1 --2- 172.21.15.18:0/2681170393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c3507370 0x55f6c351f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.132+0000 7f4f17fff640 1 -- 172.21.15.18:0/2681170393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c35042d0 msgr2=0x55f6c34ff120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:04.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.132+0000 7f4f17fff640 1 --2- 172.21.15.18:0/2681170393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c35042d0 0x55f6c34ff120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.132+0000 7f4f17fff640 1 -- 172.21.15.18:0/2681170393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 msgr2=0x55f6c3502d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:04.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.132+0000 7f4f17fff640 1 --2- 172.21.15.18:0/2681170393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c3502d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.132+0000 7f4f17fff640 1 -- 172.21.15.18:0/2681170393 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6c34f91a0 con 0x55f6c3507370 2024-09-19T10:03:04.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.134+0000 7f4f17fff640 1 --2- 172.21.15.18:0/2681170393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c3507370 0x55f6c351f390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4f10000c00 tx=0x7f4f1000b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd62e2435860c177 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:04.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.135+0000 7f4f0d7fa640 1 -- 172.21.15.18:0/2681170393 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10035070 con 0x55f6c3507370 2024-09-19T10:03:04.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.135+0000 7f4f0d7fa640 1 -- 172.21.15.18:0/2681170393 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f10020070 con 0x55f6c3507370 2024-09-19T10:03:04.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.137+0000 7f4f2050d740 1 -- 172.21.15.18:0/2681170393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c3507370 msgr2=0x55f6c351f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:04.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.137+0000 7f4f2050d740 1 --2- 172.21.15.18:0/2681170393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c3507370 0x55f6c351f390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4f10000c00 tx=0x7f4f1000b4a0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.137+0000 7f4f2050d740 1 -- 172.21.15.18:0/2681170393 shutdown_connections 2024-09-19T10:03:04.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.137+0000 7f4f2050d740 1 --2- 172.21.15.18:0/2681170393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c3507370 0x55f6c351f390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.138+0000 7f4f2050d740 1 --2- 172.21.15.18:0/2681170393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c35042d0 0x55f6c34ff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.138+0000 7f4f2050d740 1 --2- 172.21.15.18:0/2681170393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c3502d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.138+0000 7f4f2050d740 1 -- 172.21.15.18:0/2681170393 >> 172.21.15.18:0/2681170393 conn(0x55f6c34c5310 msgr2=0x55f6c3502660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:04.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.138+0000 7f4f2050d740 1 -- 172.21.15.18:0/2681170393 shutdown_connections 2024-09-19T10:03:04.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.138+0000 7f4f2050d740 1 -- 172.21.15.18:0/2681170393 wait complete. 2024-09-19T10:03:04.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.139+0000 7f4f2050d740 1 -- start start 2024-09-19T10:03:04.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.140+0000 7f4f2050d740 1 Processor -- start 2024-09-19T10:03:04.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.141+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c35019a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.141+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c350f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.141+0000 7f4f177fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c35019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.141+0000 7f4f177fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c35019a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58056/0 (socket says 172.21.15.18:58056) 2024-09-19T10:03:04.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.144+0000 7f4f0ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c350f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.142+0000 7f4f2050d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 0x55f6c350fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.144+0000 7f4f0ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c350f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45430/0 (socket says 172.21.15.18:45430) 2024-09-19T10:03:04.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.144+0000 7f4f177fe640 1 -- 172.21.15.18:0/324996354 learned_addr learned my addr 172.21.15.18:0/324996354 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:04.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.144+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f181c65b0 con 0x55f6c34fc5d0 2024-09-19T10:03:04.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.150+0000 7f4f17fff640 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 0x55f6c350fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.150+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f181c5ee0 con 0x55f6c3507370 2024-09-19T10:03:04.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.151+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f181c3140 con 0x55f6c35042d0 2024-09-19T10:03:04.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.151+0000 7f4f2050d740 10 client.0 _ll_register_callbacks cb 0x7f4f1000b8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:04.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.154+0000 7f4f0ffff640 1 -- 172.21.15.18:0/324996354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 msgr2=0x55f6c350fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:04.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.154+0000 7f4f0ffff640 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 0x55f6c350fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.154+0000 7f4f0ffff640 1 -- 172.21.15.18:0/324996354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 msgr2=0x55f6c35019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:04.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.154+0000 7f4f0ffff640 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c35019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.154+0000 7f4f0ffff640 1 -- 172.21.15.18:0/324996354 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6c3504d30 con 0x55f6c35042d0 2024-09-19T10:03:04.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.157+0000 7f4f0ffff640 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c350f520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55f6c34fd070 tx=0x7f4f000bbd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f3d638411ad0a81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:04.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.157+0000 7f4ef6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.158+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/324996354 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f000bbe70 con 0x55f6c35042d0 2024-09-19T10:03:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.159+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f10020070 con 0x55f6c35042d0 2024-09-19T10:03:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.159+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/324996354 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4f000ed460 con 0x55f6c35042d0 2024-09-19T10:03:04.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.199+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/324996354 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f000c0220 con 0x55f6c35042d0 2024-09-19T10:03:04.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.199+0000 7f4f2050d740 10 client.27370 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:04.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.199+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f6c3581420 con 0x55f6c35042d0 2024-09-19T10:03:04.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.200+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/324996354 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f10020070 con 0x55f6c35042d0 2024-09-19T10:03:04.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.201+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/324996354 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4f000bc0d0 con 0x55f6c35042d0 2024-09-19T10:03:04.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.201+0000 7f4f2050d740 10 client.27370 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:04.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.201+0000 7f4f2050d740 10 client.27370 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:03:04.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.201+0000 7f4f2050d740 20 client.27370 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:04.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.201+0000 7f4f2050d740 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55f6c3581a10 0x55f6c3583e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:04.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.201+0000 7f4f2050d740 4 client.27370 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:03:04.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.201+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f6c3469d70 con 0x55f6c3581a10 2024-09-19T10:03:04.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.202+0000 7f4f177fe640 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55f6c3581a10 0x55f6c3583e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:04.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.203+0000 7f4f177fe640 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55f6c3581a10 0x55f6c3583e30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec111d737f08622b server_cookie=74080c20a889e228 in_seq=0 out_seq=0 2024-09-19T10:03:04.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.204+0000 7f4ef6ffd640 10 client.27370 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:03:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.204+0000 7f4ef6ffd640 1 -- 172.21.15.18:0/324996354 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f6c3469d70 con 0x55f6c3581a10 2024-09-19T10:03:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.204+0000 7f4ef6ffd640 10 client.27370 handle_command_reply: tid=0 2024-09-19T10:03:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.204+0000 7f4f2050d740 1 client.27370 shutdown 2024-09-19T10:03:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.205+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 msgr2=0x55f6c350f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.205+0000 7f4f2050d740 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c350f520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55f6c34fd070 tx=0x7f4f000bbd00 comp rx=0 tx=0).stop 2024-09-19T10:03:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.206+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 shutdown_connections 2024-09-19T10:03:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.206+0000 7f4f2050d740 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x55f6c3581a10 0x55f6c3583e30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.206+0000 7f4f2050d740 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6c3507370 0x55f6c350fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.206+0000 7f4f2050d740 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6c35042d0 0x55f6c350f520 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.206+0000 7f4f2050d740 1 --2- 172.21.15.18:0/324996354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6c34fc5d0 0x55f6c35019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.206+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 >> 172.21.15.18:0/324996354 conn(0x55f6c34c5310 msgr2=0x55f6c3502e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.206+0000 7f4ef6ffd640 0 client.27370 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:03:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.206+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 shutdown_connections 2024-09-19T10:03:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.206+0000 7f4f2050d740 1 -- 172.21.15.18:0/324996354 wait complete. 2024-09-19T10:03:04.212 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:03:04.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.207+0000 7f4f2050d740 20 client.27370 trim_cache size 0 max 16384 2024-09-19T10:03:04.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.210+0000 7f4f1e134640 1 -- 172.21.15.18:0/2724450376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f040a3310 msgr2=0x7f4f040a57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:04.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.210+0000 7f4f1e134640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f040a3310 0x7f4f040a57d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x55f6c34f9ac0 tx=0x7f4f08004a40 comp rx=0 tx=0).stop 2024-09-19T10:03:04.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.210+0000 7f4f1e134640 1 -- 172.21.15.18:0/2724450376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1810d530 msgr2=0x7f4f1806cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:04.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.210+0000 7f4f1e134640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1810d530 0x7f4f1806cce0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f4f000058c0 tx=0x7f4f00003b90 comp rx=0 tx=0).stop 2024-09-19T10:03:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.212+0000 7f4f1e134640 1 -- 172.21.15.18:0/2724450376 shutdown_connections 2024-09-19T10:03:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.212+0000 7f4f1e134640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4f040a3310 0x7f4f040a57d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.212+0000 7f4f1e134640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f1806d220 0x7f4f1806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.212+0000 7f4f1e134640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1810d530 0x7f4f1806cce0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.212+0000 7f4f1e134640 1 --2- 172.21.15.18:0/2724450376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f18108450 0x7f4f18073c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.212+0000 7f4f1e134640 1 -- 172.21.15.18:0/2724450376 >> 172.21.15.18:0/2724450376 conn(0x7f4f18077ba0 msgr2=0x7f4f180784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.213+0000 7f4f1e134640 1 -- 172.21.15.18:0/2724450376 shutdown_connections 2024-09-19T10:03:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:04.213+0000 7f4f1e134640 1 -- 172.21.15.18:0/2724450376 wait complete. 2024-09-19T10:03:04.256 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:04 smithi018 ceph-mon[30956]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 256 MiB/s wr, 1.49k op/s 2024-09-19T10:03:04.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:04 smithi049 ceph-mon[34858]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 256 MiB/s wr, 1.49k op/s 2024-09-19T10:03:04.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:04 smithi162 ceph-mon[35174]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 256 MiB/s wr, 1.49k op/s 2024-09-19T10:03:05.202 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:05.324 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T10:03:05.399 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:05 smithi018 ceph-mon[30956]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 418 MiB/s wr, 2.53k op/s 2024-09-19T10:03:05.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:05 smithi049 ceph-mon[34858]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 418 MiB/s wr, 2.53k op/s 2024-09-19T10:03:05.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:05 smithi162 ceph-mon[35174]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 418 MiB/s wr, 2.53k op/s 2024-09-19T10:03:06.205 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.201+0000 7f50637fe640 1 -- 172.21.15.18:0/1417398246 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55937f823900 con 0x55937f9de780 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.201+0000 7f50637fe640 10 client.27326 handle_command_reply: tid=0 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.201+0000 7f50890a4740 1 client.27326 shutdown 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.201+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 msgr2=0x55937f96bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.201+0000 7f50890a4740 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 0x55937f96bef0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55937f976c60 tx=0x7f506c015710 comp rx=0 tx=0).stop 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.202+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 shutdown_connections 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.202+0000 7f50890a4740 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55937f9de780 0x55937f9e0ba0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.202+0000 7f50890a4740 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55937f941540 0x55937f96c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.202+0000 7f50890a4740 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55937f93c4b0 0x55937f96bef0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.202+0000 7f50890a4740 1 --2- 172.21.15.18:0/1417398246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55937f93bb70 0x55937f96f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.202+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 >> 172.21.15.18:0/1417398246 conn(0x55937f9371e0 msgr2=0x55937f938090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.202+0000 7f50637fe640 0 client.27326 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.203+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 shutdown_connections 2024-09-19T10:03:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.203+0000 7f50890a4740 1 -- 172.21.15.18:0/1417398246 wait complete. 2024-09-19T10:03:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.203+0000 7f50890a4740 20 client.27326 trim_cache size 0 max 16384 2024-09-19T10:03:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:03:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:03:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:03:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:03:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.211+0000 7f50850b1640 1 -- 172.21.15.18:0/2354356187 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f50700a3710 msgr2=0x7f50700a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.211+0000 7f50850b1640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f50700a3710 0x7f50700a5bd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f50740b8610 tx=0x7f5074005fd0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.212+0000 7f50850b1640 1 -- 172.21.15.18:0/2354356187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50780a5670 msgr2=0x7f5078142ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.212+0000 7f50850b1640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50780a5670 0x7f5078142ec0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f5074000c00 tx=0x7f5074005610 comp rx=0 tx=0).stop 2024-09-19T10:03:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.214+0000 7f50850b1640 1 -- 172.21.15.18:0/2354356187 shutdown_connections 2024-09-19T10:03:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.214+0000 7f50850b1640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f50700a3710 0x7f50700a5bd0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.214+0000 7f50850b1640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5078148460 0x7f507814a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.214+0000 7f50850b1640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50780a6030 0x7f5078143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.214+0000 7f50850b1640 1 --2- 172.21.15.18:0/2354356187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50780a5670 0x7f5078142ec0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.214+0000 7f50850b1640 1 -- 172.21.15.18:0/2354356187 >> 172.21.15.18:0/2354356187 conn(0x7f507809fba0 msgr2=0x7f50780a1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.215+0000 7f50850b1640 1 -- 172.21.15.18:0/2354356187 shutdown_connections 2024-09-19T10:03:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:06.215+0000 7f50850b1640 1 -- 172.21.15.18:0/2354356187 wait complete. 2024-09-19T10:03:06.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.363+0000 7f218b59e640 1 -- 172.21.15.18:0/2024044391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c108c30 msgr2=0x7f218c10cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:06.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.363+0000 7f218b59e640 1 --2- 172.21.15.18:0/2024044391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c108c30 0x7f218c10cc30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f2174009900 tx=0x7f217402a400 comp rx=0 tx=0).stop 2024-09-19T10:03:06.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.365+0000 7f218b59e640 1 -- 172.21.15.18:0/2024044391 shutdown_connections 2024-09-19T10:03:06.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.365+0000 7f218b59e640 1 --2- 172.21.15.18:0/2024044391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f218c10d360 0x7f218c114ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.365+0000 7f218b59e640 1 --2- 172.21.15.18:0/2024044391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c108c30 0x7f218c10cc30 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.365+0000 7f218b59e640 1 --2- 172.21.15.18:0/2024044391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f218c108280 0x7f218c108660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.365+0000 7f218b59e640 1 -- 172.21.15.18:0/2024044391 >> 172.21.15.18:0/2024044391 conn(0x7f218c0779f0 msgr2=0x7f218c079e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.365+0000 7f218b59e640 1 -- 172.21.15.18:0/2024044391 shutdown_connections 2024-09-19T10:03:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.365+0000 7f218b59e640 1 -- 172.21.15.18:0/2024044391 wait complete. 2024-09-19T10:03:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.367+0000 7f218b59e640 1 Processor -- start 2024-09-19T10:03:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.368+0000 7f218b59e640 1 -- start start 2024-09-19T10:03:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.368+0000 7f218b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f218c108280 0x7f218c082850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.368+0000 7f218b59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f218c108c30 0x7f218c07b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.369+0000 7f218b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c10d360 0x7f218c07be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.369+0000 7f218b59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1183b0 con 0x7f218c10d360 2024-09-19T10:03:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.369+0000 7f218b59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f218c118230 con 0x7f218c108280 2024-09-19T10:03:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.369+0000 7f218b59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f218c118530 con 0x7f218c108c30 2024-09-19T10:03:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.370+0000 7f218ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c10d360 0x7f218c07be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.370+0000 7f218ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c10d360 0x7f218c07be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58076/0 (socket says 172.21.15.18:58076) 2024-09-19T10:03:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.370+0000 7f218ad9d640 1 -- 172.21.15.18:0/4148484966 learned_addr learned my addr 172.21.15.18:0/4148484966 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.371+0000 7f2183fff640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f218c108c30 0x7f218c07b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.371+0000 7f218a59c640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f218c108280 0x7f218c082850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.375+0000 7f218ad9d640 1 -- 172.21.15.18:0/4148484966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f218c108c30 msgr2=0x7f218c07b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:06.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.375+0000 7f218ad9d640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f218c108c30 0x7f218c07b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.375+0000 7f218ad9d640 1 -- 172.21.15.18:0/4148484966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f218c108280 msgr2=0x7f218c082850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:06.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.375+0000 7f218ad9d640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f218c108280 0x7f218c082850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.375+0000 7f218ad9d640 1 -- 172.21.15.18:0/4148484966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218c07c410 con 0x7f218c10d360 2024-09-19T10:03:06.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.378+0000 7f218ad9d640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c10d360 0x7f218c07be20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f218400d750 tx=0x7f218400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:06.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.379+0000 7f21837fe640 1 -- 172.21.15.18:0/4148484966 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2184017070 con 0x7f218c10d360 2024-09-19T10:03:06.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.379+0000 7f21837fe640 1 -- 172.21.15.18:0/4148484966 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2184005020 con 0x7f218c10d360 2024-09-19T10:03:06.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.379+0000 7f21837fe640 1 -- 172.21.15.18:0/4148484966 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2184004d00 con 0x7f218c10d360 2024-09-19T10:03:06.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.379+0000 7f218b59e640 1 -- 172.21.15.18:0/4148484966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218c07c700 con 0x7f218c10d360 2024-09-19T10:03:06.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.379+0000 7f218b59e640 1 -- 172.21.15.18:0/4148484966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f218c0805b0 con 0x7f218c10d360 2024-09-19T10:03:06.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.388+0000 7f2193234740 1 Processor -- start 2024-09-19T10:03:06.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.389+0000 7f2193234740 1 -- start start 2024-09-19T10:03:06.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.389+0000 7f2193234740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f2fc00 0x562592f2ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.389+0000 7f2193234740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 0x562592f3a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.389+0000 7f2193234740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 0x562592f3d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.389+0000 7f2193234740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562592e952a0 con 0x562592f30520 2024-09-19T10:03:06.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.389+0000 7f2193234740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562592e3cb10 con 0x562592f2fc00 2024-09-19T10:03:06.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.389+0000 7f2193234740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562592e91260 con 0x562592f3ade0 2024-09-19T10:03:06.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.398+0000 7f2183fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f2fc00 0x562592f2ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.398+0000 7f2183fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 0x562592f3d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.400+0000 7f2183fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 0x562592f3d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45454/0 (socket says 172.21.15.18:45454) 2024-09-19T10:03:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.400+0000 7f2183fff640 1 -- 172.21.15.18:0/3154548319 learned_addr learned my addr 172.21.15.18:0/3154548319 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.401+0000 7f218a59c640 1 --2- 172.21.15.18:0/3154548319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 0x562592f3a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.403+0000 7f2183fff640 1 -- 172.21.15.18:0/3154548319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f2fc00 msgr2=0x562592f2ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:06.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.403+0000 7f2183fff640 1 --2- 172.21.15.18:0/3154548319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f2fc00 0x562592f2ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.403+0000 7f2183fff640 1 -- 172.21.15.18:0/3154548319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 msgr2=0x562592f3a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.403+0000 7f2183fff640 1 --2- 172.21.15.18:0/3154548319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 0x562592f3a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.403+0000 7f2183fff640 1 -- 172.21.15.18:0/3154548319 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562592c06b90 con 0x562592f3ade0 2024-09-19T10:03:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.410+0000 7f21837fe640 1 -- 172.21.15.18:0/4148484966 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f21840051d0 con 0x7f218c10d360 2024-09-19T10:03:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.414+0000 7f21837fe640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21780a33d0 0x7f21780a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.415+0000 7f21837fe640 1 -- 172.21.15.18:0/4148484966 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f21840cf1c0 con 0x7f218c10d360 2024-09-19T10:03:06.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.417+0000 7f2183fff640 1 --2- 172.21.15.18:0/3154548319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 0x562592f3d1d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f217402a970 tx=0x7f217402a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aecbd0b6d2be518 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:06.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.419+0000 7f2173fff640 1 -- 172.21.15.18:0/3154548319 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174035030 con 0x562592f3ade0 2024-09-19T10:03:06.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.419+0000 7f2173fff640 1 -- 172.21.15.18:0/3154548319 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2174003e60 con 0x562592f3ade0 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.419+0000 7f2173fff640 1 -- 172.21.15.18:0/3154548319 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217403d480 con 0x562592f3ade0 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.421+0000 7f2193234740 1 -- 172.21.15.18:0/3154548319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 msgr2=0x562592f3d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.421+0000 7f2193234740 1 --2- 172.21.15.18:0/3154548319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 0x562592f3d1d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f217402a970 tx=0x7f217402a400 comp rx=0 tx=0).stop 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.421+0000 7f218a59c640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21780a33d0 0x7f21780a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.422+0000 7f2193234740 1 -- 172.21.15.18:0/3154548319 shutdown_connections 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.422+0000 7f2193234740 1 --2- 172.21.15.18:0/3154548319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 0x562592f3d1d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.422+0000 7f2193234740 1 --2- 172.21.15.18:0/3154548319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 0x562592f3a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.422+0000 7f2193234740 1 --2- 172.21.15.18:0/3154548319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f2fc00 0x562592f2ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.422+0000 7f2193234740 1 -- 172.21.15.18:0/3154548319 >> 172.21.15.18:0/3154548319 conn(0x562592f2c190 msgr2=0x562592f2c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.423+0000 7f2193234740 1 -- 172.21.15.18:0/3154548319 shutdown_connections 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.423+0000 7f2193234740 1 -- 172.21.15.18:0/3154548319 wait complete. 2024-09-19T10:03:06.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.423+0000 7f2193234740 1 -- start start 2024-09-19T10:03:06.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.423+0000 7f2193234740 1 Processor -- start 2024-09-19T10:03:06.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.424+0000 7f2193234740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f2fc00 0x562592f3a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.424+0000 7f2193234740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 0x562592f37b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.425+0000 7f2193234740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 0x562592f382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.428+0000 7f2193234740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562592f3d8c0 con 0x562592f30520 2024-09-19T10:03:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.428+0000 7f2193234740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562592e1d6e0 con 0x562592f2fc00 2024-09-19T10:03:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.428+0000 7f2193234740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562592f3da40 con 0x562592f3ade0 2024-09-19T10:03:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.428+0000 7f2193234740 10 client.0 _ll_register_callbacks cb 0x562592e41a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.435+0000 7f2183fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 0x562592f37b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.435+0000 7f2183fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 0x562592f37b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42488/0 (socket says 172.21.15.18:42488) 2024-09-19T10:03:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.435+0000 7f2183fff640 1 -- 172.21.15.18:0/4108035037 learned_addr learned my addr 172.21.15.18:0/4108035037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.435+0000 7f218a59c640 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f2fc00 0x562592f3a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.436+0000 7f218ad9d640 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 0x562592f382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.438+0000 7f2183fff640 1 -- 172.21.15.18:0/4108035037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 msgr2=0x562592f382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.438+0000 7f2183fff640 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 0x562592f382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.438+0000 7f2183fff640 1 -- 172.21.15.18:0/4108035037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f2fc00 msgr2=0x562592f3a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:06.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.438+0000 7f2183fff640 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f2fc00 0x562592f3a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.438+0000 7f2183fff640 1 -- 172.21.15.18:0/4108035037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562592f46d30 con 0x562592f30520 2024-09-19T10:03:06.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.439+0000 7f218a59c640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21780a33d0 0x7f21780a5890 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x562592f2cff0 tx=0x7f217c00a490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:06.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.439+0000 7f2183fff640 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 0x562592f37b50 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f2174006010 tx=0x7f217402a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661d23d56dc44d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.442+0000 7f2171ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.442+0000 7f2171ffb640 1 -- 172.21.15.18:0/4108035037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174035070 con 0x562592f30520 2024-09-19T10:03:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.442+0000 7f2171ffb640 1 -- 172.21.15.18:0/4108035037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f21740317c0 con 0x562592f30520 2024-09-19T10:03:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.446+0000 7f2193234740 1 -- 172.21.15.18:0/4108035037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2174003e60 con 0x562592f30520 2024-09-19T10:03:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.448+0000 7f2171ffb640 1 -- 172.21.15.18:0/4108035037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2174003780 con 0x562592f30520 2024-09-19T10:03:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.449+0000 7f2193234740 10 client.17886 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.449+0000 7f2193234740 1 -- 172.21.15.18:0/4108035037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562592f495c0 con 0x562592f30520 2024-09-19T10:03:06.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.459+0000 7f2171ffb640 1 -- 172.21.15.18:0/4108035037 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217403d480 con 0x562592f30520 2024-09-19T10:03:06.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.459+0000 7f2171ffb640 1 -- 172.21.15.18:0/4108035037 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f217403a040 con 0x562592f30520 2024-09-19T10:03:06.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.459+0000 7f2193234740 10 client.17886 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:06.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.459+0000 7f2193234740 10 client.17886 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:03:06.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.459+0000 7f2193234740 20 client.17886 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:06.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.459+0000 7f2193234740 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562592f4a910 0x562592f4cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.459+0000 7f2193234740 4 client.17886 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:06.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.459+0000 7f2193234740 1 -- 172.21.15.18:0/4108035037 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2174003e60 con 0x562592f4a910 2024-09-19T10:03:06.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.464+0000 7f218a59c640 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562592f4a910 0x562592f4cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.469+0000 7f218a59c640 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562592f4a910 0x562592f4cd00 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=869970a76d052d1 server_cookie=815defdb76e6b68b in_seq=0 out_seq=0 2024-09-19T10:03:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.471+0000 7f2171ffb640 10 client.17886 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:06.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.474+0000 7f2171ffb640 1 -- 172.21.15.18:0/4108035037 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2174003e60 con 0x562592f4a910 2024-09-19T10:03:06.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.474+0000 7f2171ffb640 10 client.17886 handle_command_reply: tid=0 2024-09-19T10:03:06.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.474+0000 7f2193234740 1 client.17886 shutdown 2024-09-19T10:03:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.475+0000 7f2193234740 1 -- 172.21.15.18:0/4108035037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 msgr2=0x562592f37b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.475+0000 7f2193234740 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 0x562592f37b50 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f2174006010 tx=0x7f217402a900 comp rx=0 tx=0).stop 2024-09-19T10:03:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.475+0000 7f2193234740 1 -- 172.21.15.18:0/4108035037 shutdown_connections 2024-09-19T10:03:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.475+0000 7f2193234740 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562592f4a910 0x562592f4cd00 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.475+0000 7f2193234740 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f3ade0 0x562592f382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.475+0000 7f2193234740 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f30520 0x562592f37b50 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.475+0000 7f2193234740 1 --2- 172.21.15.18:0/4108035037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f2fc00 0x562592f3a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.475+0000 7f2193234740 1 -- 172.21.15.18:0/4108035037 >> 172.21.15.18:0/4108035037 conn(0x562592f2c190 msgr2=0x562592f2b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.475+0000 7f2171ffb640 0 client.17886 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.475+0000 7f2193234740 1 -- 172.21.15.18:0/4108035037 shutdown_connections 2024-09-19T10:03:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.476+0000 7f2193234740 1 -- 172.21.15.18:0/4108035037 wait complete. 2024-09-19T10:03:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.476+0000 7f2193234740 20 client.17886 trim_cache size 0 max 16384 2024-09-19T10:03:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.511+0000 7f2193234740 1 Processor -- start 2024-09-19T10:03:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.511+0000 7f2193234740 1 -- start start 2024-09-19T10:03:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.512+0000 7f2193234740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f2fc00 0x562592f34db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.512+0000 7f2193234740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 0x562592f352f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.512+0000 7f2193234740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 0x562592f2ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.512+0000 7f2193234740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1c4a30 con 0x562592f2fc00 2024-09-19T10:03:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.512+0000 7f2193234740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1c6570 con 0x562592f3ade0 2024-09-19T10:03:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.513+0000 7f2193234740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1c5100 con 0x562592f30520 2024-09-19T10:03:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.514+0000 7f218ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 0x562592f2ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.514+0000 7f218ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 0x562592f2ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59364/0 (socket says 172.21.15.18:59364) 2024-09-19T10:03:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.514+0000 7f218ad9d640 1 -- 172.21.15.18:0/3026259092 learned_addr learned my addr 172.21.15.18:0/3026259092 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.514+0000 7f2183fff640 1 --2- 172.21.15.18:0/3026259092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 0x562592f352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.515+0000 7f218ad9d640 1 -- 172.21.15.18:0/3026259092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 msgr2=0x562592f352f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.515+0000 7f218ad9d640 1 --2- 172.21.15.18:0/3026259092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 0x562592f352f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.515+0000 7f218ad9d640 1 -- 172.21.15.18:0/3026259092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f2fc00 msgr2=0x562592f34db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.515+0000 7f218ad9d640 1 --2- 172.21.15.18:0/3026259092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f2fc00 0x562592f34db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.515+0000 7f218ad9d640 1 -- 172.21.15.18:0/3026259092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562592f3ac10 con 0x562592f3ade0 2024-09-19T10:03:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.516+0000 7f218ad9d640 1 --2- 172.21.15.18:0/3026259092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 0x562592f2ac50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f218409b7a0 tx=0x7f218409b230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b19c9ab87a73e635 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.517+0000 7f21737fe640 1 -- 172.21.15.18:0/3026259092 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2184020040 con 0x562592f3ade0 2024-09-19T10:03:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.517+0000 7f21737fe640 1 -- 172.21.15.18:0/3026259092 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21840a4480 con 0x562592f3ade0 2024-09-19T10:03:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.517+0000 7f21737fe640 1 -- 172.21.15.18:0/3026259092 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218409cda0 con 0x562592f3ade0 2024-09-19T10:03:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.518+0000 7f2193234740 1 -- 172.21.15.18:0/3026259092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 msgr2=0x562592f2ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.518+0000 7f2193234740 1 --2- 172.21.15.18:0/3026259092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 0x562592f2ac50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f218409b7a0 tx=0x7f218409b230 comp rx=0 tx=0).stop 2024-09-19T10:03:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.518+0000 7f2193234740 1 -- 172.21.15.18:0/3026259092 shutdown_connections 2024-09-19T10:03:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.518+0000 7f2193234740 1 --2- 172.21.15.18:0/3026259092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 0x562592f2ac50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.518+0000 7f2193234740 1 --2- 172.21.15.18:0/3026259092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 0x562592f352f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.518+0000 7f2193234740 1 --2- 172.21.15.18:0/3026259092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f2fc00 0x562592f34db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.518+0000 7f2193234740 1 -- 172.21.15.18:0/3026259092 >> 172.21.15.18:0/3026259092 conn(0x562592f2c190 msgr2=0x562592f36c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.519+0000 7f2193234740 1 -- 172.21.15.18:0/3026259092 shutdown_connections 2024-09-19T10:03:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.519+0000 7f2193234740 1 -- 172.21.15.18:0/3026259092 wait complete. 2024-09-19T10:03:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.519+0000 7f2193234740 1 -- start start 2024-09-19T10:03:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.520+0000 7f2193234740 1 Processor -- start 2024-09-19T10:03:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.521+0000 7f2193234740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f2fc00 0x562592f4fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.521+0000 7f2193234740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 0x562592f50060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.521+0000 7f2193234740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 0x562592f4df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.523+0000 7f2183fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 0x562592f50060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.523+0000 7f218a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f2fc00 0x562592f4fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.524+0000 7f218ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 0x562592f4df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.524+0000 7f218a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f2fc00 0x562592f4fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42510/0 (socket says 172.21.15.18:42510) 2024-09-19T10:03:06.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.524+0000 7f2183fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 0x562592f50060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54570/0 (socket says 172.21.15.18:54570) 2024-09-19T10:03:06.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.524+0000 7f218a59c640 1 -- 172.21.15.18:0/3651270852 learned_addr learned my addr 172.21.15.18:0/3651270852 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:06.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.524+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1c5ea0 con 0x562592f2fc00 2024-09-19T10:03:06.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.524+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1c57d0 con 0x562592f3ade0 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.524+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1c2a30 con 0x562592f30520 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.525+0000 7f2193234740 10 client.0 _ll_register_callbacks cb 0x7f2174003680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.525+0000 7f2183fff640 1 -- 172.21.15.18:0/3651270852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 msgr2=0x562592f4df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.525+0000 7f2183fff640 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 0x562592f4df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.525+0000 7f2183fff640 1 -- 172.21.15.18:0/3651270852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f2fc00 msgr2=0x562592f4fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.525+0000 7f2183fff640 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f2fc00 0x562592f4fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.525+0000 7f2183fff640 1 -- 172.21.15.18:0/3651270852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562592e9a520 con 0x562592f30520 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.526+0000 7f2183fff640 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 0x562592f50060 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2174031af0 tx=0x7f2174009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcb6747aea5b6b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.526+0000 7f2171ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.526+0000 7f2171ffb640 1 -- 172.21.15.18:0/3651270852 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174061060 con 0x562592f30520 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.527+0000 7f2171ffb640 1 -- 172.21.15.18:0/3651270852 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2174003b20 con 0x562592f30520 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.527+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21840a4480 con 0x562592f30520 2024-09-19T10:03:06.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.527+0000 7f2171ffb640 1 -- 172.21.15.18:0/3651270852 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2174035070 con 0x562592f30520 2024-09-19T10:03:06.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.527+0000 7f2193234740 10 client.27385 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:06.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.528+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562592fb5b70 con 0x562592f30520 2024-09-19T10:03:06.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.528+0000 7f2171ffb640 1 -- 172.21.15.18:0/3651270852 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2174003d40 con 0x562592f30520 2024-09-19T10:03:06.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.528+0000 7f2171ffb640 1 -- 172.21.15.18:0/3651270852 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f217403d7c0 con 0x562592f30520 2024-09-19T10:03:06.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.529+0000 7f2193234740 10 client.27385 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:06.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.529+0000 7f2193234740 10 client.27385 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:03:06.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.529+0000 7f2193234740 20 client.27385 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:06.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.529+0000 7f2193234740 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562592fb62a0 0x562592fb86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:06.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.529+0000 7f2193234740 4 client.27385 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T10:03:06.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.529+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x7f21840a4480 con 0x562592fb62a0 2024-09-19T10:03:06.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.531+0000 7f218a59c640 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562592fb62a0 0x562592fb86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:06.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.541+0000 7f218a59c640 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562592fb62a0 0x562592fb86c0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd36eaf0cc1c0bf1 server_cookie=4f97687dfc3e06a9 in_seq=0 out_seq=0 2024-09-19T10:03:06.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:06.541+0000 7f2171ffb640 10 client.27385 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:07.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2171ffb640 1 -- 172.21.15.18:0/3651270852 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f21840a4480 con 0x562592fb62a0 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2171ffb640 10 client.27385 handle_command_reply: tid=0 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2193234740 1 client.27385 shutdown 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 msgr2=0x562592f50060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2193234740 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 0x562592f50060 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2174031af0 tx=0x7f2174009520 comp rx=0 tx=0).stop 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 shutdown_connections 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2193234740 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x562592fb62a0 0x562592fb86c0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2193234740 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562592f3ade0 0x562592f4df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2193234740 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562592f30520 0x562592f50060 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2193234740 1 --2- 172.21.15.18:0/3651270852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562592f2fc00 0x562592f4fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2171ffb640 0 client.27385 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.208+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 >> 172.21.15.18:0/3651270852 conn(0x562592f2c190 msgr2=0x562592f393b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.209+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 shutdown_connections 2024-09-19T10:03:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.209+0000 7f2193234740 1 -- 172.21.15.18:0/3651270852 wait complete. 2024-09-19T10:03:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.209+0000 7f2193234740 20 client.27385 trim_cache size 0 max 16384 2024-09-19T10:03:07.213 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:03:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T10:03:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T10:03:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 38, 2024-09-19T10:03:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T10:03:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: "187414c6": { 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 38, 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 150.0, 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "QUIESCED", 2024-09-19T10:03:07.214 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:03:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:07.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:07.215 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.209+0000 7f21817fa640 1 -- 172.21.15.18:0/4148484966 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21780a33d0 msgr2=0x7f21780a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.209+0000 7f21817fa640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21780a33d0 0x7f21780a5890 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x562592f2cff0 tx=0x7f217c00a490 comp rx=0 tx=0).stop 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.210+0000 7f21817fa640 1 -- 172.21.15.18:0/4148484966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c10d360 msgr2=0x7f218c07be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.210+0000 7f21817fa640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c10d360 0x7f218c07be20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f218400d750 tx=0x7f218400dc10 comp rx=0 tx=0).stop 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.210+0000 7f21817fa640 1 -- 172.21.15.18:0/4148484966 shutdown_connections 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.210+0000 7f21817fa640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f21780a33d0 0x7f21780a5890 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.210+0000 7f21817fa640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c10d360 0x7f218c07be20 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.210+0000 7f21817fa640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f218c108c30 0x7f218c07b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.210+0000 7f21817fa640 1 --2- 172.21.15.18:0/4148484966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f218c108280 0x7f218c082850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.210+0000 7f21817fa640 1 -- 172.21.15.18:0/4148484966 >> 172.21.15.18:0/4148484966 conn(0x7f218c0779f0 msgr2=0x7f218c078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.210+0000 7f21817fa640 1 -- 172.21.15.18:0/4148484966 shutdown_connections 2024-09-19T10:03:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.210+0000 7f21817fa640 1 -- 172.21.15.18:0/4148484966 wait complete. 2024-09-19T10:03:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.394+0000 7fe3af054640 1 -- 172.21.15.18:0/900599820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a81082a0 msgr2=0x7fe3a810ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.394+0000 7fe3af054640 1 --2- 172.21.15.18:0/900599820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a81082a0 0x7fe3a810ec10 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fe390009930 tx=0x7fe39002a420 comp rx=0 tx=0).stop 2024-09-19T10:03:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.394+0000 7fe3af054640 1 -- 172.21.15.18:0/900599820 shutdown_connections 2024-09-19T10:03:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.394+0000 7fe3af054640 1 --2- 172.21.15.18:0/900599820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a81082a0 0x7fe3a810ec10 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.394+0000 7fe3af054640 1 --2- 172.21.15.18:0/900599820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a8103720 0x7fe3a8107b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.394+0000 7fe3af054640 1 --2- 172.21.15.18:0/900599820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3a8102d70 0x7fe3a8103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.394+0000 7fe3af054640 1 -- 172.21.15.18:0/900599820 >> 172.21.15.18:0/900599820 conn(0x7fe3a80fc7d0 msgr2=0x7fe3a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.394+0000 7fe3af054640 1 -- 172.21.15.18:0/900599820 shutdown_connections 2024-09-19T10:03:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.394+0000 7fe3af054640 1 -- 172.21.15.18:0/900599820 wait complete. 2024-09-19T10:03:07.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3af054640 1 Processor -- start 2024-09-19T10:03:07.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3af054640 1 -- start start 2024-09-19T10:03:07.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3af054640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3a8102d70 0x7fe3a8198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3af054640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103720 0x7fe3a8198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3af054640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a81082a0 0x7fe3a819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3af054640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81120c0 con 0x7fe3a8103720 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3af054640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8111f40 con 0x7fe3a8102d70 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3af054640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8112240 con 0x7fe3a81082a0 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103720 0x7fe3a8198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3acdf0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3a8102d70 0x7fe3a8198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103720 0x7fe3a8198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42528/0 (socket says 172.21.15.18:42528) 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3a7fff640 1 -- 172.21.15.18:0/3920895180 learned_addr learned my addr 172.21.15.18:0/3920895180 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.395+0000 7fe3ad5f1640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a81082a0 0x7fe3a819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3a7fff640 1 -- 172.21.15.18:0/3920895180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a81082a0 msgr2=0x7fe3a819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a81082a0 0x7fe3a819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3a7fff640 1 -- 172.21.15.18:0/3920895180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3a8102d70 msgr2=0x7fe3a8198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3a8102d70 0x7fe3a8198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3a7fff640 1 -- 172.21.15.18:0/3920895180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a819d4e0 con 0x7fe3a8103720 2024-09-19T10:03:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3acdf0640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3a8102d70 0x7fe3a8198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:03:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3ad5f1640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a81082a0 0x7fe3a819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:03:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103720 0x7fe3a8198a70 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fe39800ebc0 tx=0x7fe39800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3a5ffb640 1 -- 172.21.15.18:0/3920895180 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398010630 con 0x7fe3a8103720 2024-09-19T10:03:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3a5ffb640 1 -- 172.21.15.18:0/3920895180 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe398010cb0 con 0x7fe3a8103720 2024-09-19T10:03:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3af054640 1 -- 172.21.15.18:0/3920895180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a819d7d0 con 0x7fe3a8103720 2024-09-19T10:03:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3a5ffb640 1 -- 172.21.15.18:0/3920895180 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398017c20 con 0x7fe3a8103720 2024-09-19T10:03:07.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.396+0000 7fe3af054640 1 -- 172.21.15.18:0/3920895180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a81a50b0 con 0x7fe3a8103720 2024-09-19T10:03:07.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.398+0000 7fe3a5ffb640 1 -- 172.21.15.18:0/3920895180 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe3980107d0 con 0x7fe3a8103720 2024-09-19T10:03:07.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3b142d740 1 Processor -- start 2024-09-19T10:03:07.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3b142d740 1 -- start start 2024-09-19T10:03:07.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 0x55a665348090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3a5ffb640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3940a32c0 0x7fe3940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a665348a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665355760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3b142d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a6652ae2f0 con 0x55a665353370 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3b142d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a665255cf0 con 0x55a6653485d0 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3b142d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a6652aa2b0 con 0x55a665349b40 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a665348a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3acdf0640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3940a32c0 0x7fe3940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3ad5f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665355760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3ad5f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665355760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42538/0 (socket says 172.21.15.18:42538) 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a665348a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:59396/0 (socket says 172.21.15.18:59396) 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3ad5f1640 1 -- 172.21.15.18:0/4220540253 learned_addr learned my addr 172.21.15.18:0/4220540253 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3ad5f1640 1 --2- 172.21.15.18:0/4220540253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 0x55a665348090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.399+0000 7fe3a5ffb640 1 -- 172.21.15.18:0/3920895180 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe3980d0250 con 0x7fe3a8103720 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe3a7fff640 1 -- 172.21.15.18:0/4220540253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 msgr2=0x55a665348090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/4220540253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 0x55a665348090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe3a7fff640 1 -- 172.21.15.18:0/4220540253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 msgr2=0x55a665355760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:07.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/4220540253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665355760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe3a7fff640 1 -- 172.21.15.18:0/4220540253 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a66523a3a0 con 0x55a6653485d0 2024-09-19T10:03:07.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe3ad5f1640 1 --2- 172.21.15.18:0/4220540253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 0x55a665348090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:03:07.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe3acdf0640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3940a32c0 0x7fe3940a5780 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000bfd0 tx=0x7fe3a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:07.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/4220540253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a665348a10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe398098ca0 tx=0x7fe398098ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d0b8f3d4fd682e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:07.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe39effd640 1 -- 172.21.15.18:0/4220540253 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398010e60 con 0x55a6653485d0 2024-09-19T10:03:07.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe39effd640 1 -- 172.21.15.18:0/4220540253 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe39809cf40 con 0x55a6653485d0 2024-09-19T10:03:07.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.400+0000 7fe39effd640 1 -- 172.21.15.18:0/4220540253 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39809dda0 con 0x55a6653485d0 2024-09-19T10:03:07.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.401+0000 7fe3b142d740 1 -- 172.21.15.18:0/4220540253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 msgr2=0x55a665348a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.401+0000 7fe3b142d740 1 --2- 172.21.15.18:0/4220540253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a665348a10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe398098ca0 tx=0x7fe398098ae0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.401+0000 7fe3b142d740 1 -- 172.21.15.18:0/4220540253 shutdown_connections 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.401+0000 7fe3b142d740 1 --2- 172.21.15.18:0/4220540253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665355760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.401+0000 7fe3b142d740 1 --2- 172.21.15.18:0/4220540253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a665348a10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.401+0000 7fe3b142d740 1 --2- 172.21.15.18:0/4220540253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 0x55a665348090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.401+0000 7fe3b142d740 1 -- 172.21.15.18:0/4220540253 >> 172.21.15.18:0/4220540253 conn(0x55a665311310 msgr2=0x55a665344c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.401+0000 7fe3b142d740 1 -- 172.21.15.18:0/4220540253 shutdown_connections 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.401+0000 7fe3b142d740 1 -- 172.21.15.18:0/4220540253 wait complete. 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.401+0000 7fe3b142d740 1 -- start start 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3b142d740 1 Processor -- start 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6653485d0 0x55a665352e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a665349b40 0x55a6653500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665350840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3b142d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a665356070 con 0x55a665353370 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3b142d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a665269060 con 0x55a665349b40 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3b142d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a6653561f0 con 0x55a6653485d0 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3b142d740 10 client.0 _ll_register_callbacks cb 0x55a664fbc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3ad5f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665350840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a665349b40 0x55a6653500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3ad5f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665350840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42554/0 (socket says 172.21.15.18:42554) 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3ad5f1640 1 -- 172.21.15.18:0/1369897404 learned_addr learned my addr 172.21.15.18:0/1369897404 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3acdf0640 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6653485d0 0x55a665352e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3a7fff640 1 -- 172.21.15.18:0/1369897404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6653485d0 msgr2=0x55a665352e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6653485d0 0x55a665352e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3a7fff640 1 -- 172.21.15.18:0/1369897404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 msgr2=0x55a665350840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:07.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665350840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.402+0000 7fe3a7fff640 1 -- 172.21.15.18:0/1369897404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a66501f3c0 con 0x55a665349b40 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a665349b40 0x55a6653500b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55a66534a170 tx=0x7fe39809c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6d728a2b40094fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe387fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe387fff640 1 -- 172.21.15.18:0/1369897404 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398010e60 con 0x55a665349b40 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe3b142d740 1 -- 172.21.15.18:0/1369897404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe39809cf40 con 0x55a665349b40 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe387fff640 1 -- 172.21.15.18:0/1369897404 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe39809ab40 con 0x55a665349b40 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe387fff640 1 -- 172.21.15.18:0/1369897404 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe3980ba050 con 0x55a665349b40 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe3b142d740 10 client.27368 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe3b142d740 1 -- 172.21.15.18:0/1369897404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a665361bc0 con 0x55a665349b40 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe387fff640 1 -- 172.21.15.18:0/1369897404 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe39809cf40 con 0x55a665349b40 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe387fff640 1 -- 172.21.15.18:0/1369897404 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe398085b90 con 0x55a665349b40 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe3b142d740 10 client.27368 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe3b142d740 10 client.27368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe3b142d740 20 client.27368 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:07.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe3b142d740 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a665362f10 0x55a665365300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe3b142d740 4 client.27368 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.403+0000 7fe3b142d740 1 -- 172.21.15.18:0/1369897404 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6652bb860 con 0x55a665362f10 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.404+0000 7fe3acdf0640 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a665362f10 0x55a665365300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.404+0000 7fe3acdf0640 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a665362f10 0x55a665365300 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71e819f2b261dea server_cookie=a13158cd58b744ca in_seq=0 out_seq=0 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.404+0000 7fe387fff640 10 client.27368 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe387fff640 1 -- 172.21.15.18:0/1369897404 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a6652bb860 con 0x55a665362f10 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe387fff640 10 client.27368 handle_command_reply: tid=0 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 client.27368 shutdown 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 -- 172.21.15.18:0/1369897404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a665349b40 msgr2=0x55a6653500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a665349b40 0x55a6653500b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55a66534a170 tx=0x7fe39809c410 comp rx=0 tx=0).stop 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 -- 172.21.15.18:0/1369897404 shutdown_connections 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a665362f10 0x55a665365300 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665350840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe387fff640 0 client.27368 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:07.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a665349b40 0x55a6653500b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 --2- 172.21.15.18:0/1369897404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a6653485d0 0x55a665352e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 -- 172.21.15.18:0/1369897404 >> 172.21.15.18:0/1369897404 conn(0x55a665311310 msgr2=0x55a66534a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:07.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 -- 172.21.15.18:0/1369897404 shutdown_connections 2024-09-19T10:03:07.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 1 -- 172.21.15.18:0/1369897404 wait complete. 2024-09-19T10:03:07.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.405+0000 7fe3b142d740 20 client.27368 trim_cache size 0 max 16384 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.418+0000 7fe3b142d740 1 Processor -- start 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.418+0000 7fe3b142d740 1 -- start start 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.418+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a66534f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.418+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665349b40 0x55a665368320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.418+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665353370 0x55a665368860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.418+0000 7fe3b142d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81ab2c0 con 0x55a665349b40 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.418+0000 7fe3b142d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81ace00 con 0x55a6653485d0 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.418+0000 7fe3b142d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81ab990 con 0x55a665353370 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665349b40 0x55a665368320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3ad5f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665353370 0x55a665368860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665349b40 0x55a665368320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42560/0 (socket says 172.21.15.18:42560) 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3a7fff640 1 -- 172.21.15.18:0/2221190334 learned_addr learned my addr 172.21.15.18:0/2221190334 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3acdf0640 1 --2- 172.21.15.18:0/2221190334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a66534f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3ad5f1640 1 -- 172.21.15.18:0/2221190334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 msgr2=0x55a66534f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3ad5f1640 1 --2- 172.21.15.18:0/2221190334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a66534f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3ad5f1640 1 -- 172.21.15.18:0/2221190334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665349b40 msgr2=0x55a665368320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3ad5f1640 1 --2- 172.21.15.18:0/2221190334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665349b40 0x55a665368320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3ad5f1640 1 -- 172.21.15.18:0/2221190334 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a665351040 con 0x55a665353370 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/2221190334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665349b40 0x55a665368320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe3ad5f1640 1 --2- 172.21.15.18:0/2221190334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665353370 0x55a665368860 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe390009230 tx=0x7fe3900095e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=192baf8d217682e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe39e7fc640 1 -- 172.21.15.18:0/2221190334 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390035040 con 0x55a665353370 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe39e7fc640 1 -- 172.21.15.18:0/2221190334 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe390031770 con 0x55a665353370 2024-09-19T10:03:07.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.419+0000 7fe39e7fc640 1 -- 172.21.15.18:0/2221190334 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39003bdd0 con 0x55a665353370 2024-09-19T10:03:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 -- 172.21.15.18:0/2221190334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665353370 msgr2=0x55a665368860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 --2- 172.21.15.18:0/2221190334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665353370 0x55a665368860 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe390009230 tx=0x7fe3900095e0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 -- 172.21.15.18:0/2221190334 shutdown_connections 2024-09-19T10:03:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 --2- 172.21.15.18:0/2221190334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665353370 0x55a665368860 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 --2- 172.21.15.18:0/2221190334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665349b40 0x55a665368320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 --2- 172.21.15.18:0/2221190334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a66534f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 -- 172.21.15.18:0/2221190334 >> 172.21.15.18:0/2221190334 conn(0x55a665311310 msgr2=0x55a66535eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 -- 172.21.15.18:0/2221190334 shutdown_connections 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 -- 172.21.15.18:0/2221190334 wait complete. 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 -- start start 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.420+0000 7fe3b142d740 1 Processor -- start 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a665366030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 0x55a665366570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3b142d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665366ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3b142d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81ac730 con 0x55a665353370 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3b142d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81ac060 con 0x55a6653485d0 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3b142d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a81a92c0 con 0x55a665349b40 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3b142d740 10 client.0 _ll_register_callbacks cb 0x7fe3980093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3ad5f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665366ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3ad5f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665366ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42566/0 (socket says 172.21.15.18:42566) 2024-09-19T10:03:07.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3acdf0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a665366030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3ad5f1640 1 -- 172.21.15.18:0/3006668141 learned_addr learned my addr 172.21.15.18:0/3006668141 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:07.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3a7fff640 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 0x55a665366570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3ad5f1640 1 -- 172.21.15.18:0/3006668141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 msgr2=0x55a665366570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:07.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3ad5f1640 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 0x55a665366570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3ad5f1640 1 -- 172.21.15.18:0/3006668141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 msgr2=0x55a665366030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3ad5f1640 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a665366030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.421+0000 7fe3ad5f1640 1 -- 172.21.15.18:0/3006668141 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6653cc850 con 0x55a665353370 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe3ad5f1640 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665366ab0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe3900092a0 tx=0x7fe39003b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1160e3bd1a8bdf1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe387fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe387fff640 1 -- 172.21.15.18:0/3006668141 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390057060 con 0x55a665353370 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe387fff640 1 -- 172.21.15.18:0/3006668141 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe390004460 con 0x55a665353370 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe3b142d740 1 -- 172.21.15.18:0/3006668141 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe390031770 con 0x55a665353370 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe387fff640 1 -- 172.21.15.18:0/3006668141 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe390035070 con 0x55a665353370 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe3b142d740 10 client.17907 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe3b142d740 1 -- 172.21.15.18:0/3006668141 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a6653cdab0 con 0x55a665353370 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe387fff640 1 -- 172.21.15.18:0/3006668141 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe390031770 con 0x55a665353370 2024-09-19T10:03:07.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe387fff640 1 -- 172.21.15.18:0/3006668141 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe39004a650 con 0x55a665353370 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe3b142d740 10 client.17907 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe3b142d740 10 client.17907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe3b142d740 20 client.17907 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe3b142d740 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a6653ce170 0x55a6653d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe3b142d740 4 client.17907 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.422+0000 7fe3b142d740 1 -- 172.21.15.18:0/3006668141 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a6652b5d70 con 0x55a6653ce170 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3acdf0640 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a6653ce170 0x55a6653d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3acdf0640 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a6653ce170 0x55a6653d0590 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db04bad9baff022a server_cookie=61b405fc5d1b5b4e in_seq=0 out_seq=0 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe387fff640 10 client.17907 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe387fff640 1 -- 172.21.15.18:0/3006668141 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a6652b5d70 con 0x55a6653ce170 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe387fff640 10 client.17907 handle_command_reply: tid=0 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 client.17907 shutdown 2024-09-19T10:03:07.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 -- 172.21.15.18:0/3006668141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 msgr2=0x55a665366ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665366ab0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe3900092a0 tx=0x7fe39003b910 comp rx=0 tx=0).stop 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 -- 172.21.15.18:0/3006668141 shutdown_connections 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a6653ce170 0x55a6653d0590 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a665353370 0x55a665366ab0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a665349b40 0x55a665366570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 --2- 172.21.15.18:0/3006668141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6653485d0 0x55a665366030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 -- 172.21.15.18:0/3006668141 >> 172.21.15.18:0/3006668141 conn(0x55a665311310 msgr2=0x55a66534a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe387fff640 0 client.17907 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 -- 172.21.15.18:0/3006668141 shutdown_connections 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.423+0000 7fe3b142d740 1 -- 172.21.15.18:0/3006668141 wait complete. 2024-09-19T10:03:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3b142d740 20 client.17907 trim_cache size 0 max 16384 2024-09-19T10:03:07.433 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:03:07.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 -- 172.21.15.18:0/3920895180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3940a32c0 msgr2=0x7fe3940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3940a32c0 0x7fe3940a5780 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000bfd0 tx=0x7fe3a000b390 comp rx=0 tx=0).stop 2024-09-19T10:03:07.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 -- 172.21.15.18:0/3920895180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103720 msgr2=0x7fe3a8198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:07.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103720 0x7fe3a8198a70 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fe39800ebc0 tx=0x7fe39800c6a0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 -- 172.21.15.18:0/3920895180 shutdown_connections 2024-09-19T10:03:07.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe3940a32c0 0x7fe3940a5780 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a81082a0 0x7fe3a819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103720 0x7fe3a8198a70 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 --2- 172.21.15.18:0/3920895180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3a8102d70 0x7fe3a8198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:07.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 -- 172.21.15.18:0/3920895180 >> 172.21.15.18:0/3920895180 conn(0x7fe3a80fc7d0 msgr2=0x7fe3a8105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:07.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 -- 172.21.15.18:0/3920895180 shutdown_connections 2024-09-19T10:03:07.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:07.424+0000 7fe3af054640 1 -- 172.21.15.18:0/3920895180 wait complete. 2024-09-19T10:03:08.085 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:08.085 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:07 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:08.085 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:07 smithi018 ceph-mon[30956]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 493 MiB/s wr, 2.94k op/s 2024-09-19T10:03:08.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:07 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:08.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:07 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:08.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:07 smithi049 ceph-mon[34858]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 493 MiB/s wr, 2.94k op/s 2024-09-19T10:03:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:07 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:07 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:08.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:07 smithi162 ceph-mon[35174]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 493 MiB/s wr, 2.94k op/s 2024-09-19T10:03:08.383 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '187414c6', quiesce took 10.2 seconds. Will release after: 19.8 2024-09-19T10:03:09.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:08 smithi018 ceph-mon[30956]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 586 MiB/s wr, 3.34k op/s 2024-09-19T10:03:09.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:08 smithi162 ceph-mon[35174]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 586 MiB/s wr, 3.34k op/s 2024-09-19T10:03:09.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:08 smithi049 ceph-mon[34858]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 586 MiB/s wr, 3.34k op/s 2024-09-19T10:03:09.852 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T10:03:09.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T10:03:10.128 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:10.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:03:10.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:03:10.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:10.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:03:10.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:03:10.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:10.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:03:10.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:03:10.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:03:10.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.609+0000 7f6eef547640 1 -- 172.21.15.18:0/3605334655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8101420 msgr2=0x7f6ee810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:10.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.609+0000 7f6eef547640 1 --2- 172.21.15.18:0/3605334655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8101420 0x7f6ee810d950 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009cd0 tx=0x7f6ee002a8e0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.609+0000 7f6eef547640 1 -- 172.21.15.18:0/3605334655 shutdown_connections 2024-09-19T10:03:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.609+0000 7f6eef547640 1 --2- 172.21.15.18:0/3605334655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8101420 0x7f6ee810d950 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.609+0000 7f6eef547640 1 --2- 172.21.15.18:0/3605334655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee8100a80 0x7f6ee8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.609+0000 7f6eef547640 1 --2- 172.21.15.18:0/3605334655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ee8106a80 0x7f6ee8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.609+0000 7f6eef547640 1 -- 172.21.15.18:0/3605334655 >> 172.21.15.18:0/3605334655 conn(0x7f6ee80fc7a0 msgr2=0x7f6ee80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.609+0000 7f6eef547640 1 -- 172.21.15.18:0/3605334655 shutdown_connections 2024-09-19T10:03:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.609+0000 7f6eef547640 1 -- 172.21.15.18:0/3605334655 wait complete. 2024-09-19T10:03:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eef547640 1 Processor -- start 2024-09-19T10:03:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eef547640 1 -- start start 2024-09-19T10:03:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eef547640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8100a80 0x7f6ee81991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eef547640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ee8101420 0x7f6ee8199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eef547640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eef547640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee8110e80 con 0x7f6ee8100a80 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eef547640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee8110d00 con 0x7f6ee8101420 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eef547640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee8111000 con 0x7f6ee8106a80 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eed2e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8100a80 0x7f6ee81991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eed2e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8100a80 0x7f6ee81991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42572/0 (socket says 172.21.15.18:42572) 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eed2e3640 1 -- 172.21.15.18:0/3414010831 learned_addr learned my addr 172.21.15.18:0/3414010831 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eecae2640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ee8101420 0x7f6ee8199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eedae4640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eed2e3640 1 -- 172.21.15.18:0/3414010831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee8106a80 msgr2=0x7f6ee81a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eed2e3640 1 -- 172.21.15.18:0/3414010831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ee8101420 msgr2=0x7f6ee8199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ee8101420 0x7f6ee8199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.610+0000 7f6eed2e3640 1 -- 172.21.15.18:0/3414010831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee81a47b0 con 0x7f6ee8100a80 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.611+0000 7f6eedae4640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.611+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8100a80 0x7f6ee81991f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c920 tx=0x7f6ee400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.611+0000 7f6ede7fc640 1 -- 172.21.15.18:0/3414010831 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4007c70 con 0x7f6ee8100a80 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.611+0000 7f6ede7fc640 1 -- 172.21.15.18:0/3414010831 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ee4007e10 con 0x7f6ee8100a80 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.611+0000 7f6eef547640 1 -- 172.21.15.18:0/3414010831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee81a4980 con 0x7f6ee8100a80 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.611+0000 7f6ede7fc640 1 -- 172.21.15.18:0/3414010831 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4018890 con 0x7f6ee8100a80 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.611+0000 7f6eef547640 1 -- 172.21.15.18:0/3414010831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee81a4e90 con 0x7f6ee8100a80 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.613+0000 7f6ede7fc640 1 -- 172.21.15.18:0/3414010831 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6ee4018a70 con 0x7f6ee8100a80 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6ef1920740 1 Processor -- start 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6ef1920740 1 -- start start 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddb4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 0x559acddc2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6ef1920740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559acdd1a280 con 0x559acddb4b60 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6ef1920740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559acdcc1b10 con 0x559acddb5480 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6ef1920740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559acdd16240 con 0x559acddbfd40 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eedae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddb4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eedae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddb4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42576/0 (socket says 172.21.15.18:42576) 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eedae4640 1 -- 172.21.15.18:0/443516736 learned_addr learned my addr 172.21.15.18:0/443516736 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eecae2640 1 --2- 172.21.15.18:0/443516736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 0x559acddc2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6ede7fc640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6ed40a3240 0x7f6ed40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/443516736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eecae2640 1 -- 172.21.15.18:0/443516736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 msgr2=0x559acddbf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eecae2640 1 --2- 172.21.15.18:0/443516736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eecae2640 1 -- 172.21.15.18:0/443516736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 msgr2=0x559acddb4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eecae2640 1 --2- 172.21.15.18:0/443516736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddb4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eecae2640 1 -- 172.21.15.18:0/443516736 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559acdcce1f0 con 0x559acddbfd40 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eedae4640 1 --2- 172.21.15.18:0/443516736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6ede7fc640 1 -- 172.21.15.18:0/3414010831 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6ee40cf9b0 con 0x7f6ee8100a80 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.614+0000 7f6eedae4640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6ed40a3240 0x7f6ed40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.615+0000 7f6eecae2640 1 --2- 172.21.15.18:0/443516736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 0x559acddc2130 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009bd0 tx=0x7f6ed8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d5863b956967887 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.615+0000 7f6ed37fe640 1 -- 172.21.15.18:0/443516736 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8004230 con 0x559acddbfd40 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.615+0000 7f6ed37fe640 1 -- 172.21.15.18:0/443516736 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ed8009e40 con 0x559acddbfd40 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.615+0000 7f6ed37fe640 1 -- 172.21.15.18:0/443516736 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8004d70 con 0x559acddbfd40 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6eedae4640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6ed40a3240 0x7f6ed40a5700 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009a60 tx=0x7f6ee003f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 -- 172.21.15.18:0/443516736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 msgr2=0x559acddc2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 --2- 172.21.15.18:0/443516736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 0x559acddc2130 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009bd0 tx=0x7f6ed8011810 comp rx=0 tx=0).stop 2024-09-19T10:03:10.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 -- 172.21.15.18:0/443516736 shutdown_connections 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 --2- 172.21.15.18:0/443516736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 0x559acddc2130 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 --2- 172.21.15.18:0/443516736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 --2- 172.21.15.18:0/443516736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 -- 172.21.15.18:0/443516736 >> 172.21.15.18:0/443516736 conn(0x559acddb10f0 msgr2=0x559acddb14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 -- 172.21.15.18:0/443516736 shutdown_connections 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 -- 172.21.15.18:0/443516736 wait complete. 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 -- start start 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 Processor -- start 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 0x559acddbf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddbd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559acddc2910 con 0x559acddbfd40 2024-09-19T10:03:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559acdcd4f10 con 0x559acddb5480 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.616+0000 7f6ef1920740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559acddc2a90 con 0x559acddb4b60 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6ef1920740 10 client.0 _ll_register_callbacks cb 0x559acdc9da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eedae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddbd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eedae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddbd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42578/0 (socket says 172.21.15.18:42578) 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eedae4640 1 -- 172.21.15.18:0/1439968446 learned_addr learned my addr 172.21.15.18:0/1439968446 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 0x559acddbf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eecae2640 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eed2e3640 1 -- 172.21.15.18:0/1439968446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 msgr2=0x559acddbcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eed2e3640 1 -- 172.21.15.18:0/1439968446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 msgr2=0x559acddbd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddbd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eed2e3640 1 -- 172.21.15.18:0/1439968446 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559acda8b6a0 con 0x559acddb4b60 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eedae4640 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddbd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 0x559acddbf7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x559acddb1f50 tx=0x7f6ee4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=131f53098e8c3283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6ed0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/1439968446 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee40cfe60 con 0x559acddb4b60 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6ef1920740 1 -- 172.21.15.18:0/1439968446 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559acdd277f0 con 0x559acddb4b60 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.617+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/1439968446 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6ee409a300 con 0x559acddb4b60 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/1439968446 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6ee409c000 con 0x559acddb4b60 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ef1920740 10 client.27415 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ef1920740 1 -- 172.21.15.18:0/1439968446 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559acddce520 con 0x559acddb4b60 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/1439968446 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559acdd277f0 con 0x559acddb4b60 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/1439968446 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6ee40a47e0 con 0x559acddb4b60 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ef1920740 10 client.27415 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ef1920740 10 client.27415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:10.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ef1920740 20 client.27415 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ef1920740 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559acddcf930 0x559acddd1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ef1920740 4 client.27415 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6ef1920740 1 -- 172.21.15.18:0/1439968446 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559acdd21d00 con 0x559acddcf930 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.618+0000 7f6eecae2640 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559acddcf930 0x559acddd1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.619+0000 7f6eecae2640 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559acddcf930 0x559acddd1d20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c29b9c3061eb0dfb server_cookie=1780ee95c55cd82 in_seq=0 out_seq=0 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.619+0000 7f6ed0ff9640 10 client.27415 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/1439968446 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559acdd21d00 con 0x559acddcf930 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ed0ff9640 10 client.27415 handle_command_reply: tid=0 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 client.27415 shutdown 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 -- 172.21.15.18:0/1439968446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 msgr2=0x559acddbf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 0x559acddbf7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x559acddb1f50 tx=0x7f6ee4000bc0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 -- 172.21.15.18:0/1439968446 shutdown_connections 2024-09-19T10:03:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559acddcf930 0x559acddd1d20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddbd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ed0ff9640 0 client.27415 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:10.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 --2- 172.21.15.18:0/1439968446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 0x559acddbf7f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 -- 172.21.15.18:0/1439968446 >> 172.21.15.18:0/1439968446 conn(0x559acddb10f0 msgr2=0x559acddb6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:10.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 -- 172.21.15.18:0/1439968446 shutdown_connections 2024-09-19T10:03:10.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 1 -- 172.21.15.18:0/1439968446 wait complete. 2024-09-19T10:03:10.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.620+0000 7f6ef1920740 20 client.27415 trim_cache size 0 max 16384 2024-09-19T10:03:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6ef1920740 1 Processor -- start 2024-09-19T10:03:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6ef1920740 1 -- start start 2024-09-19T10:03:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddbb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 0x559acddd7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6ef1920740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81ad3c0 con 0x559acddb4b60 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6ef1920740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81aef00 con 0x559acddb5480 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6ef1920740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81ada90 con 0x559acddbfd40 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eed2e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddbb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eed2e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddbb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42594/0 (socket says 172.21.15.18:42594) 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eed2e3640 1 -- 172.21.15.18:0/2872930829 learned_addr learned my addr 172.21.15.18:0/2872930829 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eedae4640 1 --2- 172.21.15.18:0/2872930829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 0x559acddd7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eecae2640 1 --2- 172.21.15.18:0/2872930829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eed2e3640 1 -- 172.21.15.18:0/2872930829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 msgr2=0x559acddd7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/2872930829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 0x559acddd7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eed2e3640 1 -- 172.21.15.18:0/2872930829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 msgr2=0x559acddbb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:10.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/2872930829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eed2e3640 1 -- 172.21.15.18:0/2872930829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559acddbd640 con 0x559acddb4b60 2024-09-19T10:03:10.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.638+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/2872930829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddbb410 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4098460 tx=0x7f6ee4096a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9b441a0ebec153 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:10.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ed2ffd640 1 -- 172.21.15.18:0/2872930829 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee40a03b0 con 0x559acddb4b60 2024-09-19T10:03:10.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ed2ffd640 1 -- 172.21.15.18:0/2872930829 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ee40a4c70 con 0x559acddb4b60 2024-09-19T10:03:10.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ed2ffd640 1 -- 172.21.15.18:0/2872930829 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4066ec0 con 0x559acddb4b60 2024-09-19T10:03:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ef1920740 1 -- 172.21.15.18:0/2872930829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 msgr2=0x559acddbb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ef1920740 1 --2- 172.21.15.18:0/2872930829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddbb410 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4098460 tx=0x7f6ee4096a40 comp rx=0 tx=0).stop 2024-09-19T10:03:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ef1920740 1 -- 172.21.15.18:0/2872930829 shutdown_connections 2024-09-19T10:03:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ef1920740 1 --2- 172.21.15.18:0/2872930829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddbfd40 0x559acddd7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ef1920740 1 --2- 172.21.15.18:0/2872930829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddbb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ef1920740 1 --2- 172.21.15.18:0/2872930829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddb4b60 0x559acddbb410 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ef1920740 1 -- 172.21.15.18:0/2872930829 >> 172.21.15.18:0/2872930829 conn(0x559acddb10f0 msgr2=0x559acddb7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ef1920740 1 -- 172.21.15.18:0/2872930829 shutdown_connections 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.639+0000 7f6ef1920740 1 -- 172.21.15.18:0/2872930829 wait complete. 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6ef1920740 1 -- start start 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6ef1920740 1 Processor -- start 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 0x559acddc80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddc8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6ef1920740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddc3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6ef1920740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81ae830 con 0x559acddbfd40 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6ef1920740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81ae160 con 0x559acddb5480 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6ef1920740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81ab3a0 con 0x559acddb4b60 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6ef1920740 10 client.0 _ll_register_callbacks cb 0x7f6ee400c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6eedae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddc3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6eedae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddc3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42596/0 (socket says 172.21.15.18:42596) 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.640+0000 7f6eedae4640 1 -- 172.21.15.18:0/765597412 learned_addr learned my addr 172.21.15.18:0/765597412 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6eecae2640 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddc8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 0x559acddc80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6eedae4640 1 -- 172.21.15.18:0/765597412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 msgr2=0x559acddc80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6eedae4640 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 0x559acddc80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6eedae4640 1 -- 172.21.15.18:0/765597412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 msgr2=0x559acddc8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6eedae4640 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddc8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6eedae4640 1 -- 172.21.15.18:0/765597412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559acddd2090 con 0x559acddbfd40 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6eedae4640 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddc3710 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0006010 tx=0x7f6ee0009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610b7c17edd39114 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6ed0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/765597412 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0057060 con 0x559acddbfd40 2024-09-19T10:03:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/765597412 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6ee00305a0 con 0x559acddbfd40 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6ef1920740 1 -- 172.21.15.18:0/765597412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ee40a4c70 con 0x559acddbfd40 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/765597412 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6ee00307a0 con 0x559acddbfd40 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6ef1920740 10 client.17925 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6ef1920740 1 -- 172.21.15.18:0/765597412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559acde3a060 con 0x559acddbfd40 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.641+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/765597412 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ee40a4c70 con 0x559acddbfd40 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.642+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/765597412 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6ee0051070 con 0x559acddbfd40 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.642+0000 7f6ef1920740 10 client.17925 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.642+0000 7f6ef1920740 10 client.17925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.642+0000 7f6ef1920740 20 client.17925 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.642+0000 7f6ef1920740 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559acde3a790 0x559acde3cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.642+0000 7f6ef1920740 4 client.17925 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T10:03:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.642+0000 7f6ef1920740 1 -- 172.21.15.18:0/765597412 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559acdc9e110 con 0x559acde3a790 2024-09-19T10:03:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.642+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559acde3a790 0x559acde3cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.643+0000 7f6ed0ff9640 10 client.17925 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.643+0000 7f6eed2e3640 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559acde3a790 0x559acde3cbb0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a3a07e706d698e server_cookie=a2d02cb897120b07 in_seq=0 out_seq=0 2024-09-19T10:03:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ed0ff9640 1 -- 172.21.15.18:0/765597412 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559acdc9e110 con 0x559acde3a790 2024-09-19T10:03:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ed0ff9640 10 client.17925 handle_command_reply: tid=0 2024-09-19T10:03:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 client.17925 shutdown 2024-09-19T10:03:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 -- 172.21.15.18:0/765597412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 msgr2=0x559acddc3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddc3710 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0006010 tx=0x7f6ee0009360 comp rx=0 tx=0).stop 2024-09-19T10:03:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 -- 172.21.15.18:0/765597412 shutdown_connections 2024-09-19T10:03:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559acde3a790 0x559acde3cbb0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559acddbfd40 0x559acddc3710 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559acddb5480 0x559acddc8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 --2- 172.21.15.18:0/765597412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559acddb4b60 0x559acddc80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 -- 172.21.15.18:0/765597412 >> 172.21.15.18:0/765597412 conn(0x559acddb10f0 msgr2=0x559acddbb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ed0ff9640 0 client.17925 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 -- 172.21.15.18:0/765597412 shutdown_connections 2024-09-19T10:03:10.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.644+0000 7f6ef1920740 1 -- 172.21.15.18:0/765597412 wait complete. 2024-09-19T10:03:10.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6ef1920740 20 client.17925 trim_cache size 0 max 16384 2024-09-19T10:03:10.652 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:03:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T10:03:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "f09008b2-e10c-46f7-9f3c-e8c2f2a42bba", 2024-09-19T10:03:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T10:03:10.652 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:03:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 -- 172.21.15.18:0/3414010831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6ed40a3240 msgr2=0x7f6ed40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6ed40a3240 0x7f6ed40a5700 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009a60 tx=0x7f6ee003f040 comp rx=0 tx=0).stop 2024-09-19T10:03:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 -- 172.21.15.18:0/3414010831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8100a80 msgr2=0x7f6ee81991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8100a80 0x7f6ee81991f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c920 tx=0x7f6ee400cde0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 -- 172.21.15.18:0/3414010831 shutdown_connections 2024-09-19T10:03:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6ed40a3240 0x7f6ed40a5700 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ee8101420 0x7f6ee8199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 --2- 172.21.15.18:0/3414010831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8100a80 0x7f6ee81991f0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 -- 172.21.15.18:0/3414010831 >> 172.21.15.18:0/3414010831 conn(0x7f6ee80fc7a0 msgr2=0x7f6ee80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:10.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 -- 172.21.15.18:0/3414010831 shutdown_connections 2024-09-19T10:03:10.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:10.645+0000 7f6eef547640 1 -- 172.21.15.18:0/3414010831 wait complete. 2024-09-19T10:03:11.266 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:10 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T10:03:11.267 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:10 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T10:03:11.267 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:10 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T10:03:11.267 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:10 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T10:03:11.267 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:10 smithi018 ceph-mon[30956]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 602 MiB/s wr, 3.41k op/s 2024-09-19T10:03:11.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:10 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T10:03:11.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:10 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T10:03:11.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:10 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T10:03:11.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:10 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T10:03:11.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:10 smithi049 ceph-mon[34858]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 602 MiB/s wr, 3.41k op/s 2024-09-19T10:03:11.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:10 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T10:03:11.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:10 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T10:03:11.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:10 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T10:03:11.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:10 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T10:03:11.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:10 smithi162 ceph-mon[35174]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 602 MiB/s wr, 3.41k op/s 2024-09-19T10:03:11.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T10:03:11.926 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:12.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.595+0000 7fb55c065640 1 -- 172.21.15.18:0/2781135733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb554105560 msgr2=0x7fb55410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:12.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.595+0000 7fb55c065640 1 --2- 172.21.15.18:0/2781135733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb554105560 0x7fb55410d0e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00adb0 tx=0x7fb54c02b7a0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.596+0000 7fb55c065640 1 -- 172.21.15.18:0/2781135733 shutdown_connections 2024-09-19T10:03:12.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.596+0000 7fb55c065640 1 --2- 172.21.15.18:0/2781135733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb554105560 0x7fb55410d0e0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.596+0000 7fb55c065640 1 --2- 172.21.15.18:0/2781135733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb554100de0 0x7fb554104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.596+0000 7fb55c065640 1 --2- 172.21.15.18:0/2781135733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554100430 0x7fb554100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.596+0000 7fb55c065640 1 -- 172.21.15.18:0/2781135733 >> 172.21.15.18:0/2781135733 conn(0x7fb554077230 msgr2=0x7fb5540fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:12.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.598+0000 7fb55c065640 1 -- 172.21.15.18:0/2781135733 shutdown_connections 2024-09-19T10:03:12.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.598+0000 7fb55c065640 1 -- 172.21.15.18:0/2781135733 wait complete. 2024-09-19T10:03:12.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.599+0000 7fb55c065640 1 Processor -- start 2024-09-19T10:03:12.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.599+0000 7fb55c065640 1 -- start start 2024-09-19T10:03:12.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.599+0000 7fb55c065640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb554100430 0x7fb5541a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.600+0000 7fb55c065640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb554100de0 0x7fb5541a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.600+0000 7fb55c065640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554105560 0x7fb55419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.600+0000 7fb55c065640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb55410fdb0 con 0x7fb554100430 2024-09-19T10:03:12.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.600+0000 7fb55c065640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb55410fc30 con 0x7fb554105560 2024-09-19T10:03:12.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.600+0000 7fb55c065640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb55410ff30 con 0x7fb554100de0 2024-09-19T10:03:12.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.600+0000 7fb559e01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb554100430 0x7fb5541a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.600+0000 7fb559e01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb554100430 0x7fb5541a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42614/0 (socket says 172.21.15.18:42614) 2024-09-19T10:03:12.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.600+0000 7fb559e01640 1 -- 172.21.15.18:0/574462765 learned_addr learned my addr 172.21.15.18:0/574462765 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.601+0000 7fb55a602640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554105560 0x7fb55419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.601+0000 7fb559e01640 1 -- 172.21.15.18:0/574462765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb554100de0 msgr2=0x7fb5541a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.601+0000 7fb559e01640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb554100de0 0x7fb5541a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.601+0000 7fb559e01640 1 -- 172.21.15.18:0/574462765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554105560 msgr2=0x7fb55419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.601+0000 7fb559e01640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554105560 0x7fb55419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.601+0000 7fb559e01640 1 -- 172.21.15.18:0/574462765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55419efc0 con 0x7fb554100430 2024-09-19T10:03:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.601+0000 7fb55a602640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554105560 0x7fb55419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:03:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.601+0000 7fb559e01640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb554100430 0x7fb5541a46d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb55000c890 tx=0x7fb55000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.601+0000 7fb54affd640 1 -- 172.21.15.18:0/574462765 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550004220 con 0x7fb554100430 2024-09-19T10:03:12.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.601+0000 7fb54affd640 1 -- 172.21.15.18:0/574462765 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5500043c0 con 0x7fb554100430 2024-09-19T10:03:12.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.602+0000 7fb54affd640 1 -- 172.21.15.18:0/574462765 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5500049e0 con 0x7fb554100430 2024-09-19T10:03:12.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.602+0000 7fb55c065640 1 -- 172.21.15.18:0/574462765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55419f2b0 con 0x7fb554100430 2024-09-19T10:03:12.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.602+0000 7fb55c065640 1 -- 172.21.15.18:0/574462765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5541ab5a0 con 0x7fb554100430 2024-09-19T10:03:12.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.606+0000 7fb55e43e740 1 Processor -- start 2024-09-19T10:03:12.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.607+0000 7fb55e43e740 1 -- start start 2024-09-19T10:03:12.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.607+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c714a0 0x55ad60c71880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.607+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c71dc0 0x55ad60c7c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.607+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c7c680 0x55ad60c7ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.607+0000 7fb55e43e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ad60bd72e0 con 0x55ad60c71dc0 2024-09-19T10:03:12.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.607+0000 7fb55e43e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ad60b7ece0 con 0x55ad60c7c680 2024-09-19T10:03:12.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.607+0000 7fb55e43e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ad60bd32a0 con 0x55ad60c714a0 2024-09-19T10:03:12.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.608+0000 7fb559e01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c71dc0 0x55ad60c7c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.608+0000 7fb559e01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c71dc0 0x55ad60c7c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42626/0 (socket says 172.21.15.18:42626) 2024-09-19T10:03:12.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.608+0000 7fb559e01640 1 -- 172.21.15.18:0/2108690730 learned_addr learned my addr 172.21.15.18:0/2108690730 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:12.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.608+0000 7fb54affd640 1 -- 172.21.15.18:0/574462765 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb5500079b0 con 0x7fb554100430 2024-09-19T10:03:12.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.609+0000 7fb559e01640 1 -- 172.21.15.18:0/2108690730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c714a0 msgr2=0x55ad60c71880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:12.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.609+0000 7fb559e01640 1 --2- 172.21.15.18:0/2108690730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c714a0 0x55ad60c71880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.609+0000 7fb559e01640 1 -- 172.21.15.18:0/2108690730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c7c680 msgr2=0x55ad60c7ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:12.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.609+0000 7fb559e01640 1 --2- 172.21.15.18:0/2108690730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c7c680 0x55ad60c7ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.609+0000 7fb559e01640 1 -- 172.21.15.18:0/2108690730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad60b63440 con 0x55ad60c71dc0 2024-09-19T10:03:12.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.609+0000 7fb559e01640 1 --2- 172.21.15.18:0/2108690730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c71dc0 0x55ad60c7c140 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb5500d5b90 tx=0x7fb5500d5c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8008e91f921bcba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:12.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.609+0000 7fb53ffff640 1 -- 172.21.15.18:0/2108690730 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5500d7d70 con 0x55ad60c71dc0 2024-09-19T10:03:12.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.609+0000 7fb53ffff640 1 -- 172.21.15.18:0/2108690730 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5500dc070 con 0x55ad60c71dc0 2024-09-19T10:03:12.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.610+0000 7fb53ffff640 1 -- 172.21.15.18:0/2108690730 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5500d87f0 con 0x55ad60c71dc0 2024-09-19T10:03:12.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.610+0000 7fb54affd640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5400a3400 0x7fb5400a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.611+0000 7fb55e43e740 1 -- 172.21.15.18:0/2108690730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c71dc0 msgr2=0x55ad60c7c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:12.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.611+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2108690730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c71dc0 0x55ad60c7c140 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb5500d5b90 tx=0x7fb5500d5c80 comp rx=0 tx=0).stop 2024-09-19T10:03:12.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.611+0000 7fb55e43e740 1 -- 172.21.15.18:0/2108690730 shutdown_connections 2024-09-19T10:03:12.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.611+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2108690730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c7c680 0x55ad60c7ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.611+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2108690730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c71dc0 0x55ad60c7c140 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.611+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2108690730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c714a0 0x55ad60c71880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.611+0000 7fb55e43e740 1 -- 172.21.15.18:0/2108690730 >> 172.21.15.18:0/2108690730 conn(0x55ad60c6da30 msgr2=0x55ad60c6de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.611+0000 7fb55a602640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5400a3400 0x7fb5400a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.611+0000 7fb54affd640 1 -- 172.21.15.18:0/574462765 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb5500cf9a0 con 0x7fb554100430 2024-09-19T10:03:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.612+0000 7fb55e43e740 1 -- 172.21.15.18:0/2108690730 shutdown_connections 2024-09-19T10:03:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.612+0000 7fb55e43e740 1 -- 172.21.15.18:0/2108690730 wait complete. 2024-09-19T10:03:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.612+0000 7fb55e43e740 1 -- start start 2024-09-19T10:03:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.612+0000 7fb55a602640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5400a3400 0x7fb5400a58c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb54c006010 tx=0x7fb54c005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.612+0000 7fb55e43e740 1 Processor -- start 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.613+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c7bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.613+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c71dc0 0x55ad60c79250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.613+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 0x55ad60c79790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.613+0000 7fb55e43e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ad60c7f2f0 con 0x55ad60c714a0 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.613+0000 7fb55e43e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ad60b92050 con 0x55ad60c71dc0 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.613+0000 7fb55e43e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ad60c7f470 con 0x55ad60c7c680 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.613+0000 7fb55e43e740 10 client.0 _ll_register_callbacks cb 0x55ad60bd2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.614+0000 7fb559e01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c7bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.614+0000 7fb559e01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c7bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42636/0 (socket says 172.21.15.18:42636) 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.614+0000 7fb559e01640 1 -- 172.21.15.18:0/2399276079 learned_addr learned my addr 172.21.15.18:0/2399276079 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.614+0000 7fb559e01640 1 -- 172.21.15.18:0/2399276079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 msgr2=0x55ad60c79790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.614+0000 7fb559e01640 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 0x55ad60c79790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.614+0000 7fb559e01640 1 -- 172.21.15.18:0/2399276079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c71dc0 msgr2=0x55ad60c79250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.614+0000 7fb559e01640 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c71dc0 0x55ad60c79250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.614+0000 7fb559e01640 1 -- 172.21.15.18:0/2399276079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad609483c0 con 0x55ad60c714a0 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.615+0000 7fb559e01640 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c7bfa0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb55009bf20 tx=0x7fb5500e1e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b6d073fb8606bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.615+0000 7fb53d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.615+0000 7fb53d7fa640 1 -- 172.21.15.18:0/2399276079 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55001d070 con 0x55ad60c714a0 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.615+0000 7fb55e43e740 1 -- 172.21.15.18:0/2399276079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5500dc070 con 0x55ad60c714a0 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.615+0000 7fb53d7fa640 1 -- 172.21.15.18:0/2399276079 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb5500cd580 con 0x55ad60c714a0 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.615+0000 7fb53d7fa640 1 -- 172.21.15.18:0/2399276079 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb550098230 con 0x55ad60c714a0 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.615+0000 7fb55e43e740 10 client.17937 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.615+0000 7fb55e43e740 1 -- 172.21.15.18:0/2399276079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad60c8acc0 con 0x55ad60c714a0 2024-09-19T10:03:12.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.616+0000 7fb53d7fa640 1 -- 172.21.15.18:0/2399276079 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5500a4e50 con 0x55ad60c714a0 2024-09-19T10:03:12.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.617+0000 7fb53d7fa640 1 -- 172.21.15.18:0/2399276079 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb550007ca0 con 0x55ad60c714a0 2024-09-19T10:03:12.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.617+0000 7fb55e43e740 10 client.17937 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:12.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.617+0000 7fb55e43e740 10 client.17937 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:12.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.617+0000 7fb55e43e740 20 client.17937 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:12.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.617+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ad60c8c010 0x55ad60c8e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.617+0000 7fb55e43e740 4 client.17937 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:12.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.617+0000 7fb55e43e740 1 -- 172.21.15.18:0/2399276079 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad60be4850 con 0x55ad60c8c010 2024-09-19T10:03:12.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.620+0000 7fb559600640 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ad60c8c010 0x55ad60c8e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.621+0000 7fb559600640 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ad60c8c010 0x55ad60c8e400 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8649cc3614d6fee6 server_cookie=c649d4cc193f42da in_seq=0 out_seq=0 2024-09-19T10:03:12.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.621+0000 7fb53d7fa640 10 client.17937 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:12.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.623+0000 7fb53d7fa640 1 -- 172.21.15.18:0/2399276079 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad60be4850 con 0x55ad60c8c010 2024-09-19T10:03:12.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.623+0000 7fb53d7fa640 10 client.17937 handle_command_reply: tid=0 2024-09-19T10:03:12.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.624+0000 7fb55e43e740 1 client.17937 shutdown 2024-09-19T10:03:12.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.624+0000 7fb55e43e740 1 -- 172.21.15.18:0/2399276079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 msgr2=0x55ad60c7bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:12.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.624+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c7bfa0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb55009bf20 tx=0x7fb5500e1e90 comp rx=0 tx=0).stop 2024-09-19T10:03:12.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.625+0000 7fb55e43e740 1 -- 172.21.15.18:0/2399276079 shutdown_connections 2024-09-19T10:03:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.625+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ad60c8c010 0x55ad60c8e400 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.625+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 0x55ad60c79790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.625+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c71dc0 0x55ad60c79250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.625+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2399276079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c7bfa0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.625+0000 7fb55e43e740 1 -- 172.21.15.18:0/2399276079 >> 172.21.15.18:0/2399276079 conn(0x55ad60c6da30 msgr2=0x55ad60c73710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.625+0000 7fb53d7fa640 0 client.17937 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.625+0000 7fb55e43e740 1 -- 172.21.15.18:0/2399276079 shutdown_connections 2024-09-19T10:03:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.625+0000 7fb55e43e740 1 -- 172.21.15.18:0/2399276079 wait complete. 2024-09-19T10:03:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.626+0000 7fb55e43e740 20 client.17937 trim_cache size 0 max 16384 2024-09-19T10:03:12.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.656+0000 7fb55e43e740 1 Processor -- start 2024-09-19T10:03:12.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.656+0000 7fb55e43e740 1 -- start start 2024-09-19T10:03:12.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.656+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c79670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.656+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c71dc0 0x55ad60c6ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c7c680 0x55ad60c91050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb55e43e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb5541b3bd0 con 0x55ad60c714a0 2024-09-19T10:03:12.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb55e43e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb5541b5710 con 0x55ad60c7c680 2024-09-19T10:03:12.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb55e43e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb5541b42a0 con 0x55ad60c71dc0 2024-09-19T10:03:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb559e01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c79670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb559e01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c79670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42652/0 (socket says 172.21.15.18:42652) 2024-09-19T10:03:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb559e01640 1 -- 172.21.15.18:0/2521143797 learned_addr learned my addr 172.21.15.18:0/2521143797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb559600640 1 --2- 172.21.15.18:0/2521143797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c71dc0 0x55ad60c6ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb559e01640 1 -- 172.21.15.18:0/2521143797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c71dc0 msgr2=0x55ad60c6ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb55a602640 1 --2- 172.21.15.18:0/2521143797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c7c680 0x55ad60c91050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb559e01640 1 --2- 172.21.15.18:0/2521143797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c71dc0 0x55ad60c6ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb559e01640 1 -- 172.21.15.18:0/2521143797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c7c680 msgr2=0x55ad60c91050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb559e01640 1 --2- 172.21.15.18:0/2521143797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c7c680 0x55ad60c91050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb559e01640 1 -- 172.21.15.18:0/2521143797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad60c71220 con 0x55ad60c714a0 2024-09-19T10:03:12.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.657+0000 7fb559600640 1 --2- 172.21.15.18:0/2521143797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c71dc0 0x55ad60c6ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:03:12.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.658+0000 7fb559e01640 1 --2- 172.21.15.18:0/2521143797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c79670 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fb55009a240 tx=0x7fb550000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f66b3190160e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:12.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.658+0000 7fb53f7fe640 1 -- 172.21.15.18:0/2521143797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5500a8070 con 0x55ad60c714a0 2024-09-19T10:03:12.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.658+0000 7fb53f7fe640 1 -- 172.21.15.18:0/2521143797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5500dc070 con 0x55ad60c714a0 2024-09-19T10:03:12.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.658+0000 7fb53f7fe640 1 -- 172.21.15.18:0/2521143797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55001d070 con 0x55ad60c714a0 2024-09-19T10:03:12.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.659+0000 7fb55e43e740 1 -- 172.21.15.18:0/2521143797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 msgr2=0x55ad60c79670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:12.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.659+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2521143797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c79670 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fb55009a240 tx=0x7fb550000bc0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.659+0000 7fb55e43e740 1 -- 172.21.15.18:0/2521143797 shutdown_connections 2024-09-19T10:03:12.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.659+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2521143797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c7c680 0x55ad60c91050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.659+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2521143797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c71dc0 0x55ad60c6ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.659+0000 7fb55e43e740 1 --2- 172.21.15.18:0/2521143797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c79670 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.659+0000 7fb55e43e740 1 -- 172.21.15.18:0/2521143797 >> 172.21.15.18:0/2521143797 conn(0x55ad60c6da30 msgr2=0x55ad60c6c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.659+0000 7fb55e43e740 1 -- 172.21.15.18:0/2521143797 shutdown_connections 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.659+0000 7fb55e43e740 1 -- 172.21.15.18:0/2521143797 wait complete. 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.660+0000 7fb55e43e740 1 -- start start 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.660+0000 7fb55e43e740 1 Processor -- start 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c907a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c71dc0 0x55ad60c90ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb55e43e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 0x55ad60ceea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb55e43e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb5541b5040 con 0x55ad60c714a0 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb55e43e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb5541b4970 con 0x55ad60c71dc0 2024-09-19T10:03:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb55e43e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb5541b1bb0 con 0x55ad60c7c680 2024-09-19T10:03:12.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb55e43e740 10 client.0 _ll_register_callbacks cb 0x7fb5500d59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:12.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb55a602640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 0x55ad60ceea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb55a602640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 0x55ad60ceea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:54736/0 (socket says 172.21.15.18:54736) 2024-09-19T10:03:12.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb55a602640 1 -- 172.21.15.18:0/4265068216 learned_addr learned my addr 172.21.15.18:0/4265068216 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:12.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.661+0000 7fb559e01640 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c907a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb55a602640 1 -- 172.21.15.18:0/4265068216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c71dc0 msgr2=0x55ad60c90ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:12.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb55a602640 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c71dc0 0x55ad60c90ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb55a602640 1 -- 172.21.15.18:0/4265068216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 msgr2=0x55ad60c907a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:12.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb55a602640 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c907a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb55a602640 1 -- 172.21.15.18:0/4265068216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad60cef0a0 con 0x55ad60c7c680 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb559e01640 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c907a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb53d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb55a602640 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 0x55ad60ceea00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb54c032630 tx=0x7fb54c032660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d33fee43476ad331 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb53d7fa640 1 -- 172.21.15.18:0/4265068216 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c004510 con 0x55ad60c7c680 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb53d7fa640 1 -- 172.21.15.18:0/4265068216 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb54c0046b0 con 0x55ad60c7c680 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.662+0000 7fb55e43e740 1 -- 172.21.15.18:0/4265068216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5500dc070 con 0x55ad60c7c680 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb53d7fa640 1 -- 172.21.15.18:0/4265068216 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb54c059070 con 0x55ad60c7c680 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb55e43e740 10 client.27424 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb55e43e740 1 -- 172.21.15.18:0/4265068216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad60cf6390 con 0x55ad60c7c680 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb53d7fa640 1 -- 172.21.15.18:0/4265068216 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb54c0309f0 con 0x55ad60c7c680 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb53d7fa640 1 -- 172.21.15.18:0/4265068216 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb54c04a790 con 0x55ad60c7c680 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb55e43e740 10 client.27424 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb55e43e740 10 client.27424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:12.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb55e43e740 20 client.27424 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:12.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb55e43e740 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ad60cf6ae0 0x55ad60cf8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:12.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb55e43e740 4 client.27424 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T10:03:12.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.663+0000 7fb55e43e740 1 -- 172.21.15.18:0/4265068216 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb5500dc070 con 0x55ad60cf6ae0 2024-09-19T10:03:12.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.664+0000 7fb559e01640 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ad60cf6ae0 0x55ad60cf8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:12.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.666+0000 7fb559e01640 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ad60cf6ae0 0x55ad60cf8f00 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c90afbcdbc0a509c server_cookie=e244b6b5115f298d in_seq=0 out_seq=0 2024-09-19T10:03:12.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.666+0000 7fb53d7fa640 10 client.27424 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:12.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.666+0000 7fb53d7fa640 1 -- 172.21.15.18:0/4265068216 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fb5500dc070 con 0x55ad60cf6ae0 2024-09-19T10:03:12.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.666+0000 7fb53d7fa640 10 client.27424 handle_command_reply: tid=0 2024-09-19T10:03:12.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.666+0000 7fb55e43e740 1 client.27424 shutdown 2024-09-19T10:03:12.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb55e43e740 1 -- 172.21.15.18:0/4265068216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 msgr2=0x55ad60ceea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:12.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb55e43e740 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 0x55ad60ceea00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb54c032630 tx=0x7fb54c032660 comp rx=0 tx=0).stop 2024-09-19T10:03:12.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb55e43e740 1 -- 172.21.15.18:0/4265068216 shutdown_connections 2024-09-19T10:03:12.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb55e43e740 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ad60cf6ae0 0x55ad60cf8f00 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb53d7fa640 0 client.27424 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb55e43e740 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ad60c7c680 0x55ad60ceea00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb55e43e740 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad60c71dc0 0x55ad60c90ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb55e43e740 1 --2- 172.21.15.18:0/4265068216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ad60c714a0 0x55ad60c907a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb55e43e740 1 -- 172.21.15.18:0/4265068216 >> 172.21.15.18:0/4265068216 conn(0x55ad60c6da30 msgr2=0x55ad60c6cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb55e43e740 1 -- 172.21.15.18:0/4265068216 shutdown_connections 2024-09-19T10:03:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.667+0000 7fb55e43e740 1 -- 172.21.15.18:0/4265068216 wait complete. 2024-09-19T10:03:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.668+0000 7fb55e43e740 20 client.27424 trim_cache size 0 max 16384 2024-09-19T10:03:12.671 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:03:12.671 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T10:03:12.672 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T10:03:12.672 INFO:teuthology.orchestra.run.smithi018.stdout: "f09008b2-e10c-46f7-9f3c-e8c2f2a42bba": { 2024-09-19T10:03:12.672 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T10:03:12.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "f09008b2-e10c-46f7-9f3c-e8c2f2a42bba", 2024-09-19T10:03:12.672 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T10:03:12.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:12.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:12.672 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:03:12.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 -- 172.21.15.18:0/574462765 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5400a3400 msgr2=0x7fb5400a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:12.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5400a3400 0x7fb5400a58c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb54c006010 tx=0x7fb54c005fa0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 -- 172.21.15.18:0/574462765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb554100430 msgr2=0x7fb5541a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:12.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb554100430 0x7fb5541a46d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb55000c890 tx=0x7fb55000cd50 comp rx=0 tx=0).stop 2024-09-19T10:03:12.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 -- 172.21.15.18:0/574462765 shutdown_connections 2024-09-19T10:03:12.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fb5400a3400 0x7fb5400a58c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb554105560 0x7fb55419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb554100de0 0x7fb5541a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 --2- 172.21.15.18:0/574462765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb554100430 0x7fb5541a46d0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:12.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 -- 172.21.15.18:0/574462765 >> 172.21.15.18:0/574462765 conn(0x7fb554077230 msgr2=0x7fb554103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:12.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 -- 172.21.15.18:0/574462765 shutdown_connections 2024-09-19T10:03:12.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:12.669+0000 7fb55c065640 1 -- 172.21.15.18:0/574462765 wait complete. 2024-09-19T10:03:13.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:12 smithi162 ceph-mon[35174]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 568 MiB/s wr, 3.13k op/s 2024-09-19T10:03:13.355 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:12 smithi018 ceph-mon[30956]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 568 MiB/s wr, 3.13k op/s 2024-09-19T10:03:13.388 INFO:tasks.cephfs.filesystem:scrub status for tag:f09008b2-e10c-46f7-9f3c-e8c2f2a42bba - {'path': '/', 'tag': 'f09008b2-e10c-46f7-9f3c-e8c2f2a42bba', 'options': 'recursive,force'} 2024-09-19T10:03:13.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:12 smithi049 ceph-mon[34858]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 568 MiB/s wr, 3.13k op/s 2024-09-19T10:03:15.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:14 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T10:03:15.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:14 smithi018 ceph-mon[30956]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 462 MiB/s wr, 2.33k op/s 2024-09-19T10:03:15.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:14 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T10:03:15.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:14 smithi049 ceph-mon[34858]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 462 MiB/s wr, 2.33k op/s 2024-09-19T10:03:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:14 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T10:03:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:14 smithi162 ceph-mon[35174]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 462 MiB/s wr, 2.33k op/s 2024-09-19T10:03:17.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:16 smithi018 ceph-mon[30956]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 293 MiB/s wr, 1.23k op/s 2024-09-19T10:03:17.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:16 smithi049 ceph-mon[34858]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 293 MiB/s wr, 1.23k op/s 2024-09-19T10:03:17.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:16 smithi162 ceph-mon[35174]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 293 MiB/s wr, 1.23k op/s 2024-09-19T10:03:19.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:18 smithi018 ceph-mon[30956]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 220 MiB/s wr, 754 op/s 2024-09-19T10:03:19.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:18 smithi049 ceph-mon[34858]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 220 MiB/s wr, 754 op/s 2024-09-19T10:03:19.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.401+0000 7fd7ec34b640 1 -- 172.21.15.18:0/3929355727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7e4102610 msgr2=0x7fd7e4108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:19.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.401+0000 7fd7ec34b640 1 --2- 172.21.15.18:0/3929355727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7e4102610 0x7fd7e4108ea0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009ca0 tx=0x7fd7dc02a8c0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.401+0000 7fd7ec34b640 1 -- 172.21.15.18:0/3929355727 shutdown_connections 2024-09-19T10:03:19.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.401+0000 7fd7ec34b640 1 --2- 172.21.15.18:0/3929355727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7e4102610 0x7fd7e4108ea0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.401+0000 7fd7ec34b640 1 --2- 172.21.15.18:0/3929355727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7e4101c50 0x7fd7e41020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.401+0000 7fd7ec34b640 1 --2- 172.21.15.18:0/3929355727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7e4100a60 0x7fd7e4100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.401+0000 7fd7ec34b640 1 -- 172.21.15.18:0/3929355727 >> 172.21.15.18:0/3929355727 conn(0x7fd7e40fc1e0 msgr2=0x7fd7e40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:19.406 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.401+0000 7fd7ec34b640 1 -- 172.21.15.18:0/3929355727 shutdown_connections 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.401+0000 7fd7ec34b640 1 -- 172.21.15.18:0/3929355727 wait complete. 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.401+0000 7fd7ec34b640 1 Processor -- start 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ec34b640 1 -- start start 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ec34b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7e4100a60 0x7fd7e4197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ec34b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7e4101c50 0x7fd7e41982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ec34b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7e4102610 0x7fd7e419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ec34b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e410d890 con 0x7fd7e4100a60 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ec34b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e410d710 con 0x7fd7e4102610 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ec34b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e410da10 con 0x7fd7e4101c50 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea0e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7e4100a60 0x7fd7e4197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea0e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7e4100a60 0x7fd7e4197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36744/0 (socket says 172.21.15.18:36744) 2024-09-19T10:03:19.407 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea0e7640 1 -- 172.21.15.18:0/158680683 learned_addr learned my addr 172.21.15.18:0/158680683 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7e4101c50 0x7fd7e41982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea8e8640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7e4102610 0x7fd7e419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea0e7640 1 -- 172.21.15.18:0/158680683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7e4101c50 msgr2=0x7fd7e41982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7e4101c50 0x7fd7e41982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea0e7640 1 -- 172.21.15.18:0/158680683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7e4102610 msgr2=0x7fd7e419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7e4102610 0x7fd7e419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea0e7640 1 -- 172.21.15.18:0/158680683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e419f9c0 con 0x7fd7e4100a60 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea8e8640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7e4102610 0x7fd7e419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.402+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7e4100a60 0x7fd7e4197db0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000e9c0 tx=0x7fd7e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.403+0000 7fd7db7fe640 1 -- 172.21.15.18:0/158680683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e000cd80 con 0x7fd7e4100a60 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.403+0000 7fd7db7fe640 1 -- 172.21.15.18:0/158680683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e00035f0 con 0x7fd7e4100a60 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.403+0000 7fd7ec34b640 1 -- 172.21.15.18:0/158680683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e419fcb0 con 0x7fd7e4100a60 2024-09-19T10:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.403+0000 7fd7db7fe640 1 -- 172.21.15.18:0/158680683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0010690 con 0x7fd7e4100a60 2024-09-19T10:03:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.403+0000 7fd7ec34b640 1 -- 172.21.15.18:0/158680683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e41a01b0 con 0x7fd7e4100a60 2024-09-19T10:03:19.413 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.405+0000 7fd7db7fe640 1 -- 172.21.15.18:0/158680683 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd7e00037a0 con 0x7fd7e4100a60 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ef1c7740 1 Processor -- start 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ef1c7740 1 -- start start 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483adc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5597483052f0 con 0x5597483a66f0 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5597482ad270 con 0x5597483a5db0 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5597483012b0 con 0x5597483ab780 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7db7fe640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd7d00a32f0 0x7fd7d00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ea0e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7e98e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ea8e8640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd7d00a32f0 0x7fd7d00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7e98e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:57100/0 (socket says 172.21.15.18:57100) 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ea0e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483ab1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36750/0 (socket says 172.21.15.18:36750) 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7e98e6640 1 -- 172.21.15.18:0/2364388417 learned_addr learned my addr 172.21.15.18:0/2364388417 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.406+0000 7fd7ea8e8640 1 --2- 172.21.15.18:0/2364388417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7db7fe640 1 -- 172.21.15.18:0/158680683 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd7e00cfdd0 con 0x7fd7e4100a60 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7e98e6640 1 -- 172.21.15.18:0/2364388417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 msgr2=0x5597483a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/2364388417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483a61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7e98e6640 1 -- 172.21.15.18:0/2364388417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 msgr2=0x5597483ab1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/2364388417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483ab1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7e98e6640 1 -- 172.21.15.18:0/2364388417 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597482ac340 con 0x5597483ab780 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/2364388417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483adc40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009cf0 tx=0x7fd7d4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3214f6ff34a5d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7ea8e8640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd7d00a32f0 0x7fd7d00a57b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc005fe0 tx=0x7fd7dc031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7d8bfe640 1 -- 172.21.15.18:0/2364388417 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4004230 con 0x5597483ab780 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7d8bfe640 1 -- 172.21.15.18:0/2364388417 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7d40043d0 con 0x5597483ab780 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.407+0000 7fd7d8bfe640 1 -- 172.21.15.18:0/2364388417 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40198f0 con 0x5597483ab780 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.408+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/2364388417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 msgr2=0x5597483adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.408+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/2364388417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483adc40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009cf0 tx=0x7fd7d4011810 comp rx=0 tx=0).stop 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.408+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/2364388417 shutdown_connections 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.408+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/2364388417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483adc40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.408+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/2364388417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483ab1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.408+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/2364388417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.408+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/2364388417 >> 172.21.15.18:0/2364388417 conn(0x55974839d010 msgr2=0x55974839d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.408+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/2364388417 shutdown_connections 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.408+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/2364388417 wait complete. 2024-09-19T10:03:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ef1c7740 1 -- start start 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ef1c7740 1 Processor -- start 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483afec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483b7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5597483ae750 con 0x5597483a66f0 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55974828e290 con 0x5597483a5db0 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5597483ae8d0 con 0x5597483ab780 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ef1c7740 10 client.0 _ll_register_callbacks cb 0x5597482bf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7e98e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7e98e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36752/0 (socket says 172.21.15.18:36752) 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7e98e6640 1 -- 172.21.15.18:0/62035407 learned_addr learned my addr 172.21.15.18:0/62035407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7ea8e8640 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7e98e6640 1 -- 172.21.15.18:0/62035407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 msgr2=0x5597483b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483b7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7e98e6640 1 -- 172.21.15.18:0/62035407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 msgr2=0x5597483afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.409+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.410+0000 7fd7e98e6640 1 -- 172.21.15.18:0/62035407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559748018210 con 0x5597483a66f0 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.410+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b0400 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4004630 tx=0x7fd7d40052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c185f8477ec9b22a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.410+0000 7fd7cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.410+0000 7fd7cdffb640 1 -- 172.21.15.18:0/62035407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4027070 con 0x5597483a66f0 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.410+0000 7fd7cdffb640 1 -- 172.21.15.18:0/62035407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd7d40037f0 con 0x5597483a66f0 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.410+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/62035407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7d40043d0 con 0x5597483a66f0 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.410+0000 7fd7cdffb640 1 -- 172.21.15.18:0/62035407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd7d4033050 con 0x5597483a66f0 2024-09-19T10:03:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.410+0000 7fd7ef1c7740 10 client.17955 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.410+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/62035407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5597480e4620 con 0x5597483a66f0 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.410+0000 7fd7cdffb640 1 -- 172.21.15.18:0/62035407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7d40043d0 con 0x5597483a66f0 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.411+0000 7fd7cdffb640 1 -- 172.21.15.18:0/62035407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd7d4004ba0 con 0x5597483a66f0 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.411+0000 7fd7ef1c7740 10 client.17955 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.411+0000 7fd7ef1c7740 10 client.17955 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.411+0000 7fd7ef1c7740 20 client.17955 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.411+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5597483bb920 0x5597483bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.411+0000 7fd7ef1c7740 4 client.17955 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.411+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/62035407 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559748312a20 con 0x5597483bb920 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.411+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5597483bb920 0x5597483bdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.411+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5597483bb920 0x5597483bdd10 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=273620a38859c548 server_cookie=b14deae79fbd207a in_seq=0 out_seq=0 2024-09-19T10:03:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.411+0000 7fd7cdffb640 10 client.17955 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:19.420 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:18 smithi162 ceph-mon[35174]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 220 MiB/s wr, 754 op/s 2024-09-19T10:03:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7cdffb640 1 -- 172.21.15.18:0/62035407 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559748312a20 con 0x5597483bb920 2024-09-19T10:03:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7cdffb640 10 client.17955 handle_command_reply: tid=0 2024-09-19T10:03:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 client.17955 shutdown 2024-09-19T10:03:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/62035407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 msgr2=0x5597483b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b0400 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4004630 tx=0x7fd7d40052f0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/62035407 shutdown_connections 2024-09-19T10:03:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5597483bb920 0x5597483bdd10 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b0400 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7cdffb640 0 client.17955 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/62035407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/62035407 >> 172.21.15.18:0/62035407 conn(0x55974839d010 msgr2=0x55974839e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/62035407 shutdown_connections 2024-09-19T10:03:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/62035407 wait complete. 2024-09-19T10:03:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.412+0000 7fd7ef1c7740 20 client.17955 trim_cache size 0 max 16384 2024-09-19T10:03:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ef1c7740 1 Processor -- start 2024-09-19T10:03:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ef1c7740 1 -- start start 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a5db0 0x55974839c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a66f0 0x5597483b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x55974839e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e41a6ce0 con 0x5597483a5db0 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e41a8820 con 0x5597483a66f0 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e41a73b0 con 0x5597483ab780 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ea0e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a5db0 0x55974839c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ea0e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a5db0 0x55974839c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36762/0 (socket says 172.21.15.18:36762) 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.427+0000 7fd7ea0e7640 1 -- 172.21.15.18:0/1966468839 learned_addr learned my addr 172.21.15.18:0/1966468839 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/1966468839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a66f0 0x5597483b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7ea0e7640 1 -- 172.21.15.18:0/1966468839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 msgr2=0x55974839e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7ea8e8640 1 --2- 172.21.15.18:0/1966468839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x55974839e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/1966468839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x55974839e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7ea0e7640 1 -- 172.21.15.18:0/1966468839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a66f0 msgr2=0x5597483b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/1966468839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a66f0 0x5597483b7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7ea0e7640 1 -- 172.21.15.18:0/1966468839 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55974839ce30 con 0x5597483a5db0 2024-09-19T10:03:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/1966468839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a5db0 0x55974839c0b0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd7e009c350 tx=0x7fd7e006e100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84868632a590f594 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7cffff640 1 -- 172.21.15.18:0/1966468839 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e009cac0 con 0x5597483a5db0 2024-09-19T10:03:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7cffff640 1 -- 172.21.15.18:0/1966468839 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e009c3c0 con 0x5597483a5db0 2024-09-19T10:03:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.428+0000 7fd7cffff640 1 -- 172.21.15.18:0/1966468839 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0003c30 con 0x5597483a5db0 2024-09-19T10:03:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/1966468839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a5db0 msgr2=0x55974839c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/1966468839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a5db0 0x55974839c0b0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd7e009c350 tx=0x7fd7e006e100 comp rx=0 tx=0).stop 2024-09-19T10:03:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/1966468839 shutdown_connections 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/1966468839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x55974839e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/1966468839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a66f0 0x5597483b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/1966468839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a5db0 0x55974839c0b0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/1966468839 >> 172.21.15.18:0/1966468839 conn(0x55974839d010 msgr2=0x55974839b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/1966468839 shutdown_connections 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/1966468839 wait complete. 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 -- start start 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 Processor -- start 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e41a8150 con 0x5597483a66f0 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e41a7a80 con 0x5597483a5db0 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e41a4cc0 con 0x5597483ab780 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7ef1c7740 10 client.0 _ll_register_callbacks cb 0x7fd7e0003e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.429+0000 7fd7e98e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7e98e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36770/0 (socket says 172.21.15.18:36770) 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7e98e6640 1 -- 172.21.15.18:0/312364367 learned_addr learned my addr 172.21.15.18:0/312364367 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7ea8e8640 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7e98e6640 1 -- 172.21.15.18:0/312364367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 msgr2=0x5597483b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7e98e6640 1 -- 172.21.15.18:0/312364367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 msgr2=0x5597483b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7e98e6640 1 -- 172.21.15.18:0/312364367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597483b6360 con 0x5597483a66f0 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7e98e6640 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b4d40 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40197a0 tx=0x7fd7d4005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75d8049d9b0c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7cdffb640 1 -- 172.21.15.18:0/312364367 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d403c060 con 0x5597483a66f0 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7cdffb640 1 -- 172.21.15.18:0/312364367 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd7d4004660 con 0x5597483a66f0 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/312364367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7e009c3c0 con 0x5597483a66f0 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7cdffb640 1 -- 172.21.15.18:0/312364367 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd7d4027070 con 0x5597483a66f0 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7ef1c7740 10 client.17961 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.430+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/312364367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5597483b7670 con 0x5597483a66f0 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.431+0000 7fd7cdffb640 1 -- 172.21.15.18:0/312364367 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e009c3c0 con 0x5597483a66f0 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.431+0000 7fd7cdffb640 1 -- 172.21.15.18:0/312364367 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd7d40035f0 con 0x5597483a66f0 2024-09-19T10:03:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.431+0000 7fd7ef1c7740 10 client.17961 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:19.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.431+0000 7fd7ef1c7740 10 client.17961 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:19.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.431+0000 7fd7ef1c7740 20 client.17961 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:19.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.431+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559748426c20 0x559748429040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:19.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.431+0000 7fd7ef1c7740 4 client.17961 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:03:19.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.431+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/312364367 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55974830cd70 con 0x559748426c20 2024-09-19T10:03:19.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.431+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559748426c20 0x559748429040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:19.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.432+0000 7fd7ea0e7640 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559748426c20 0x559748429040 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ab5c5e2bcd1089 server_cookie=2933b8a2e06f75ae in_seq=0 out_seq=0 2024-09-19T10:03:19.439 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.432+0000 7fd7cdffb640 10 client.17961 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.443+0000 7fd7cdffb640 1 -- 172.21.15.18:0/312364367 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55974830cd70 con 0x559748426c20 2024-09-19T10:03:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.443+0000 7fd7cdffb640 10 client.17961 handle_command_reply: tid=0 2024-09-19T10:03:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.443+0000 7fd7ef1c7740 1 client.17961 shutdown 2024-09-19T10:03:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.443+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/312364367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 msgr2=0x5597483b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.443+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b4d40 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40197a0 tx=0x7fd7d4005b90 comp rx=0 tx=0).stop 2024-09-19T10:03:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.445+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/312364367 shutdown_connections 2024-09-19T10:03:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.445+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559748426c20 0x559748429040 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.445+0000 7fd7cdffb640 0 client.17961 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.445+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5597483ab780 0x5597483b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.445+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5597483a66f0 0x5597483b4d40 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.445+0000 7fd7ef1c7740 1 --2- 172.21.15.18:0/312364367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5597483a5db0 0x5597483b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.445+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/312364367 >> 172.21.15.18:0/312364367 conn(0x55974839d010 msgr2=0x55974839c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.445+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/312364367 shutdown_connections 2024-09-19T10:03:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.445+0000 7fd7ef1c7740 1 -- 172.21.15.18:0/312364367 wait complete. 2024-09-19T10:03:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.445+0000 7fd7ef1c7740 20 client.17961 trim_cache size 0 max 16384 2024-09-19T10:03:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:03:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:03:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:03:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:03:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 -- 172.21.15.18:0/158680683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd7d00a32f0 msgr2=0x7fd7d00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd7d00a32f0 0x7fd7d00a57b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc005fe0 tx=0x7fd7dc031bb0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 -- 172.21.15.18:0/158680683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7e4100a60 msgr2=0x7fd7e4197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7e4100a60 0x7fd7e4197db0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000e9c0 tx=0x7fd7e000ee80 comp rx=0 tx=0).stop 2024-09-19T10:03:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 -- 172.21.15.18:0/158680683 shutdown_connections 2024-09-19T10:03:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd7d00a32f0 0x7fd7d00a57b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7e4102610 0x7fd7e419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7e4101c50 0x7fd7e41982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 --2- 172.21.15.18:0/158680683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7e4100a60 0x7fd7e4197db0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 -- 172.21.15.18:0/158680683 >> 172.21.15.18:0/158680683 conn(0x7fd7e40fc1e0 msgr2=0x7fd7e4104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 -- 172.21.15.18:0/158680683 shutdown_connections 2024-09-19T10:03:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:19.446+0000 7fd7ec34b640 1 -- 172.21.15.18:0/158680683 wait complete. 2024-09-19T10:03:21.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:20 smithi018 ceph-mon[30956]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 124 MiB/s wr, 316 op/s 2024-09-19T10:03:21.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:20 smithi049 ceph-mon[34858]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 124 MiB/s wr, 316 op/s 2024-09-19T10:03:21.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:20 smithi162 ceph-mon[35174]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 124 MiB/s wr, 316 op/s 2024-09-19T10:03:23.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:22 smithi018 ceph-mon[30956]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 77 MiB/s wr, 57 op/s 2024-09-19T10:03:23.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:22 smithi049 ceph-mon[34858]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 77 MiB/s wr, 57 op/s 2024-09-19T10:03:23.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:22 smithi162 ceph-mon[35174]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 77 MiB/s wr, 57 op/s 2024-09-19T10:03:25.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:24 smithi018 ceph-mon[30956]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 74 MiB/s wr, 44 op/s 2024-09-19T10:03:25.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:24 smithi049 ceph-mon[34858]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 74 MiB/s wr, 44 op/s 2024-09-19T10:03:25.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:24 smithi162 ceph-mon[35174]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 74 MiB/s wr, 44 op/s 2024-09-19T10:03:27.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:26 smithi018 ceph-mon[30956]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 64 MiB/s wr, 35 op/s 2024-09-19T10:03:27.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:26 smithi049 ceph-mon[34858]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 64 MiB/s wr, 35 op/s 2024-09-19T10:03:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:26 smithi162 ceph-mon[35174]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 64 MiB/s wr, 35 op/s 2024-09-19T10:03:28.184 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:03:28.442 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:29.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.021+0000 7fd4bb690640 1 -- 172.21.15.18:0/3156296488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4106f10 msgr2=0x7fd4b410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:29.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.021+0000 7fd4bb690640 1 --2- 172.21.15.18:0/3156296488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4106f10 0x7fd4b410ea90 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009ca0 tx=0x7fd4ac02a8c0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.021+0000 7fd4bb690640 1 -- 172.21.15.18:0/3156296488 shutdown_connections 2024-09-19T10:03:29.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.021+0000 7fd4bb690640 1 --2- 172.21.15.18:0/3156296488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4106f10 0x7fd4b410ea90 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.021+0000 7fd4bb690640 1 --2- 172.21.15.18:0/3156296488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b4102790 0x7fd4b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.021+0000 7fd4bb690640 1 --2- 172.21.15.18:0/3156296488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4b4101de0 0x7fd4b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.021+0000 7fd4bb690640 1 -- 172.21.15.18:0/3156296488 >> 172.21.15.18:0/3156296488 conn(0x7fd4b40fd8c0 msgr2=0x7fd4b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.021+0000 7fd4bb690640 1 -- 172.21.15.18:0/3156296488 shutdown_connections 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.021+0000 7fd4bb690640 1 -- 172.21.15.18:0/3156296488 wait complete. 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4bb690640 1 Processor -- start 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4bb690640 1 -- start start 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4bb690640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b4101de0 0x7fd4b4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4bb690640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4102790 0x7fd4b4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4bb690640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4b4106f10 0x7fd4b419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4bb690640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4111f90 con 0x7fd4b4102790 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4bb690640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4111e10 con 0x7fd4b4101de0 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4bb690640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4112110 con 0x7fd4b4106f10 2024-09-19T10:03:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4b8c2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4102790 0x7fd4b4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4b8c2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4102790 0x7fd4b4198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56096/0 (socket says 172.21.15.18:56096) 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4b8c2b640 1 -- 172.21.15.18:0/3856787366 learned_addr learned my addr 172.21.15.18:0/3856787366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4b942c640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b4101de0 0x7fd4b4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.022+0000 7fd4b9c2d640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4b4106f10 0x7fd4b419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4b8c2b640 1 -- 172.21.15.18:0/3856787366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4b4106f10 msgr2=0x7fd4b419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4b8c2b640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4b4106f10 0x7fd4b419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4b8c2b640 1 -- 172.21.15.18:0/3856787366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b4101de0 msgr2=0x7fd4b4198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4b8c2b640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b4101de0 0x7fd4b4198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4b8c2b640 1 -- 172.21.15.18:0/3856787366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b419d3c0 con 0x7fd4b4102790 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4b8c2b640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4102790 0x7fd4b4198950 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000b4a0 tx=0x7fd4b000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4a67fc640 1 -- 172.21.15.18:0/3856787366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0015020 con 0x7fd4b4102790 2024-09-19T10:03:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4a67fc640 1 -- 172.21.15.18:0/3856787366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4b0011d10 con 0x7fd4b4102790 2024-09-19T10:03:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4bb690640 1 -- 172.21.15.18:0/3856787366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b419d6b0 con 0x7fd4b4102790 2024-09-19T10:03:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4a67fc640 1 -- 172.21.15.18:0/3856787366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b000f2e0 con 0x7fd4b4102790 2024-09-19T10:03:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.023+0000 7fd4bb690640 1 -- 172.21.15.18:0/3856787366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b41a4f90 con 0x7fd4b4102790 2024-09-19T10:03:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.024+0000 7fd4bb690640 1 -- 172.21.15.18:0/3856787366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b41021c0 con 0x7fd4b4102790 2024-09-19T10:03:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.025+0000 7fd4a67fc640 1 -- 172.21.15.18:0/3856787366 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd4b0018020 con 0x7fd4b4102790 2024-09-19T10:03:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.026+0000 7fd4a67fc640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd4a00a32c0 0x7fd4a00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.026+0000 7fd4a67fc640 1 -- 172.21.15.18:0/3856787366 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd4b00cf5d0 con 0x7fd4b4102790 2024-09-19T10:03:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.026+0000 7fd4b942c640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd4a00a32c0 0x7fd4a00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.026+0000 7fd4b942c640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd4a00a32c0 0x7fd4a00a5780 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800abe0 tx=0x7fd4a800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.029+0000 7fd4a67fc640 1 -- 172.21.15.18:0/3856787366 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd4b001f020 con 0x7fd4b4102790 2024-09-19T10:03:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.243+0000 7fd4bb690640 1 -- 172.21.15.18:0/3856787366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4b4199770 con 0x7fd4b4102790 2024-09-19T10:03:29.246 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:28 smithi018 ceph-mon[30956]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 65 MiB/s wr, 38 op/s 2024-09-19T10:03:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.244+0000 7fd4a67fc640 1 -- 172.21.15.18:0/3856787366 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fd4b4199770 con 0x7fd4b4102790 2024-09-19T10:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:03:29.247 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:03:29.247 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:03:29.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.246+0000 7fd4bb690640 1 -- 172.21.15.18:0/3856787366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd4a00a32c0 msgr2=0x7fd4a00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:29.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.246+0000 7fd4bb690640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd4a00a32c0 0x7fd4a00a5780 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800abe0 tx=0x7fd4a800a2d0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.246+0000 7fd4bb690640 1 -- 172.21.15.18:0/3856787366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4102790 msgr2=0x7fd4b4198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:29.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.246+0000 7fd4bb690640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4102790 0x7fd4b4198950 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000b4a0 tx=0x7fd4b000b8a0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.246+0000 7fd4bb690640 1 -- 172.21.15.18:0/3856787366 shutdown_connections 2024-09-19T10:03:29.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.247+0000 7fd4bb690640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd4a00a32c0 0x7fd4a00a5780 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.247+0000 7fd4bb690640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4b4106f10 0x7fd4b419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.247+0000 7fd4bb690640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4102790 0x7fd4b4198950 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.247+0000 7fd4bb690640 1 --2- 172.21.15.18:0/3856787366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b4101de0 0x7fd4b4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:29.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.247+0000 7fd4bb690640 1 -- 172.21.15.18:0/3856787366 >> 172.21.15.18:0/3856787366 conn(0x7fd4b40fd8c0 msgr2=0x7fd4b40ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:29.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.247+0000 7fd4bb690640 1 -- 172.21.15.18:0/3856787366 shutdown_connections 2024-09-19T10:03:29.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:29.247+0000 7fd4bb690640 1 -- 172.21.15.18:0/3856787366 wait complete. 2024-09-19T10:03:29.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:28 smithi049 ceph-mon[34858]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 65 MiB/s wr, 38 op/s 2024-09-19T10:03:29.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:28 smithi162 ceph-mon[35174]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 65 MiB/s wr, 38 op/s 2024-09-19T10:03:29.843 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --set-id 187414c6 --release --await' 2024-09-19T10:03:29.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --set-id 187414c6 --release --await 2024-09-19T10:03:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:30.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:29 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3856787366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:03:30.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:29 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3856787366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:03:30.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:29 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3856787366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:03:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.611+0000 7fd929caf640 1 -- 172.21.15.18:0/4143883640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd924102d40 msgr2=0x7fd924103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.611+0000 7fd929caf640 1 --2- 172.21.15.18:0/4143883640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd924102d40 0x7fd924103120 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd914009900 tx=0x7fd91402a480 comp rx=0 tx=0).stop 2024-09-19T10:03:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.611+0000 7fd929caf640 1 -- 172.21.15.18:0/4143883640 shutdown_connections 2024-09-19T10:03:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.611+0000 7fd929caf640 1 --2- 172.21.15.18:0/4143883640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd92410c170 0x7fd92410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.611+0000 7fd929caf640 1 --2- 172.21.15.18:0/4143883640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd924103660 0x7fd92410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.611+0000 7fd929caf640 1 --2- 172.21.15.18:0/4143883640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd924102d40 0x7fd924103120 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.611+0000 7fd929caf640 1 -- 172.21.15.18:0/4143883640 >> 172.21.15.18:0/4143883640 conn(0x7fd9240fc7a0 msgr2=0x7fd9240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.611+0000 7fd929caf640 1 -- 172.21.15.18:0/4143883640 shutdown_connections 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.611+0000 7fd929caf640 1 -- 172.21.15.18:0/4143883640 wait complete. 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.612+0000 7fd929caf640 1 Processor -- start 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.612+0000 7fd929caf640 1 -- start start 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd929caf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd924102d40 0x7fd9241009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd929caf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd924103660 0x7fd924100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd929caf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd92410c170 0x7fd924101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd929caf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd924111fd0 con 0x7fd92410c170 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd929caf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd924111e50 con 0x7fd924103660 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd929caf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd924112150 con 0x7fd924102d40 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd923fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd92410c170 0x7fd924101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd923fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd92410c170 0x7fd924101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56120/0 (socket says 172.21.15.18:56120) 2024-09-19T10:03:30.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd923fff640 1 -- 172.21.15.18:0/1876177477 learned_addr learned my addr 172.21.15.18:0/1876177477 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd9237fe640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd924102d40 0x7fd9241009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd922ffd640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd924103660 0x7fd924100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd923fff640 1 -- 172.21.15.18:0/1876177477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd924102d40 msgr2=0x7fd9241009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd923fff640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd924102d40 0x7fd9241009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd923fff640 1 -- 172.21.15.18:0/1876177477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd924103660 msgr2=0x7fd924100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd923fff640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd924103660 0x7fd924100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd923fff640 1 -- 172.21.15.18:0/1876177477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9241a6970 con 0x7fd92410c170 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd922ffd640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd924103660 0x7fd924100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd923fff640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd92410c170 0x7fd924101420 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00b970 tx=0x7fd91c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.613+0000 7fd920ff9640 1 -- 172.21.15.18:0/1876177477 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c019070 con 0x7fd92410c170 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.614+0000 7fd920ff9640 1 -- 172.21.15.18:0/1876177477 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd91c00cb40 con 0x7fd92410c170 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.614+0000 7fd929caf640 1 -- 172.21.15.18:0/1876177477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9241a6c60 con 0x7fd92410c170 2024-09-19T10:03:30.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.614+0000 7fd920ff9640 1 -- 172.21.15.18:0/1876177477 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c007650 con 0x7fd92410c170 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.614+0000 7fd929caf640 1 -- 172.21.15.18:0/1876177477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9241a7150 con 0x7fd92410c170 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.616+0000 7fd920ff9640 1 -- 172.21.15.18:0/1876177477 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd91c01c070 con 0x7fd92410c170 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.616+0000 7fd92c088740 1 Processor -- start 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.616+0000 7fd92c088740 1 -- start start 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.616+0000 7fd92c088740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda725440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.616+0000 7fd92c088740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda72fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.616+0000 7fd92c088740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 0x55cbda732630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd92c088740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cbda68a620 con 0x55cbda725060 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd92c088740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cbda631e50 con 0x55cbda725980 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd92c088740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cbda6865e0 con 0x55cbda730240 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda725440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda725440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56128/0 (socket says 172.21.15.18:56128) 2024-09-19T10:03:30.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 -- 172.21.15.18:0/1031579661 learned_addr learned my addr 172.21.15.18:0/1031579661 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 --2- 172.21.15.18:0/1031579661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 0x55cbda732630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd9237fe640 1 --2- 172.21.15.18:0/1031579661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda72fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 -- 172.21.15.18:0/1031579661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 msgr2=0x55cbda732630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 --2- 172.21.15.18:0/1031579661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 0x55cbda732630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 -- 172.21.15.18:0/1031579661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 msgr2=0x55cbda72fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 --2- 172.21.15.18:0/1031579661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda72fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 -- 172.21.15.18:0/1031579661 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbda622d40 con 0x55cbda725060 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd920ff9640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd90c0a3240 0x7fd90c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 --2- 172.21.15.18:0/1031579661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda725440 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd918013540 tx=0x7fd91800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbbf5b747172d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd920ff9640 1 -- 172.21.15.18:0/1876177477 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd91c0cef20 con 0x7fd92410c170 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd922ffd640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd90c0a3240 0x7fd90c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd909ffb640 1 -- 172.21.15.18:0/1031579661 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918019070 con 0x55cbda725060 2024-09-19T10:03:30.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd909ffb640 1 -- 172.21.15.18:0/1031579661 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd918011e60 con 0x55cbda725060 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.617+0000 7fd909ffb640 1 -- 172.21.15.18:0/1031579661 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91800f5c0 con 0x55cbda725060 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.618+0000 7fd92c088740 1 -- 172.21.15.18:0/1031579661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 msgr2=0x55cbda725440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.618+0000 7fd922ffd640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd90c0a3240 0x7fd90c0a5700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd91801c000 tx=0x7fd91800fc90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.618+0000 7fd92c088740 1 --2- 172.21.15.18:0/1031579661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda725440 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd918013540 tx=0x7fd91800b6c0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.618+0000 7fd92c088740 1 -- 172.21.15.18:0/1031579661 shutdown_connections 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.618+0000 7fd92c088740 1 --2- 172.21.15.18:0/1031579661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 0x55cbda732630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.618+0000 7fd92c088740 1 --2- 172.21.15.18:0/1031579661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda72fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.618+0000 7fd92c088740 1 --2- 172.21.15.18:0/1031579661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda725440 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.618+0000 7fd92c088740 1 -- 172.21.15.18:0/1031579661 >> 172.21.15.18:0/1031579661 conn(0x55cbda7215f0 msgr2=0x55cbda7219d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.618+0000 7fd92c088740 1 -- 172.21.15.18:0/1031579661 shutdown_connections 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.618+0000 7fd92c088740 1 -- 172.21.15.18:0/1031579661 wait complete. 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd92c088740 1 -- start start 2024-09-19T10:03:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd92c088740 1 Processor -- start 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd92c088740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda72d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd92c088740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda72d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd92c088740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 0x55cbda72db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd92c088740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cbda732e10 con 0x55cbda725060 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd92c088740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cbda612f10 con 0x55cbda725980 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd92c088740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cbda732f90 con 0x55cbda730240 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd92c088740 10 client.0 _ll_register_callbacks cb 0x55cbda636db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd9237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda72d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd9237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda72d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56138/0 (socket says 172.21.15.18:56138) 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd9237fe640 1 -- 172.21.15.18:0/781990774 learned_addr learned my addr 172.21.15.18:0/781990774 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd922ffd640 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda72d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.619+0000 7fd923fff640 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 0x55cbda72db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd9237fe640 1 -- 172.21.15.18:0/781990774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 msgr2=0x55cbda72db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd9237fe640 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 0x55cbda72db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd9237fe640 1 -- 172.21.15.18:0/781990774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 msgr2=0x55cbda72d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd9237fe640 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda72d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd9237fe640 1 -- 172.21.15.18:0/781990774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbda399580 con 0x55cbda725060 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd922ffd640 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda72d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd923fff640 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 0x55cbda72db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd9237fe640 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda72d080 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd91402a9a0 tx=0x7fd9140319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc6834b8493a348 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd902ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd902ffd640 1 -- 172.21.15.18:0/781990774 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914035040 con 0x55cbda725060 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd92c088740 1 -- 172.21.15.18:0/781990774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd918011e60 con 0x55cbda725060 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd902ffd640 1 -- 172.21.15.18:0/781990774 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd914004300 con 0x55cbda725060 2024-09-19T10:03:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd902ffd640 1 -- 172.21.15.18:0/781990774 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd91404c070 con 0x55cbda725060 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd92c088740 10 client.17979 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd92c088740 1 -- 172.21.15.18:0/781990774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cbda463960 con 0x55cbda725060 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.620+0000 7fd902ffd640 1 -- 172.21.15.18:0/781990774 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd918011e60 con 0x55cbda725060 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.621+0000 7fd902ffd640 1 -- 172.21.15.18:0/781990774 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd914004c90 con 0x55cbda725060 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.621+0000 7fd92c088740 10 client.17979 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.621+0000 7fd92c088740 10 client.17979 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.621+0000 7fd92c088740 20 client.17979 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.621+0000 7fd92c088740 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cbda73fca0 0x55cbda742120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.621+0000 7fd92c088740 4 client.17979 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.621+0000 7fd92c088740 1 -- 172.21.15.18:0/781990774 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbda697b90 con 0x55cbda73fca0 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.621+0000 7fd922ffd640 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cbda73fca0 0x55cbda742120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.621+0000 7fd902ffd640 10 client.17979 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.621+0000 7fd922ffd640 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cbda73fca0 0x55cbda742120 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7913b760168ae630 server_cookie=89439d1046eceef7 in_seq=0 out_seq=0 2024-09-19T10:03:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd902ffd640 1 -- 172.21.15.18:0/781990774 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cbda697b90 con 0x55cbda73fca0 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd902ffd640 10 client.17979 handle_command_reply: tid=0 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd92c088740 1 client.17979 shutdown 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd92c088740 1 -- 172.21.15.18:0/781990774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 msgr2=0x55cbda72d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd92c088740 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda72d080 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd91402a9a0 tx=0x7fd9140319b0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd92c088740 1 -- 172.21.15.18:0/781990774 shutdown_connections 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd92c088740 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cbda73fca0 0x55cbda742120 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd92c088740 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda730240 0x55cbda72db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd92c088740 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda72d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd902ffd640 0 client.17979 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd92c088740 1 --2- 172.21.15.18:0/781990774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda72d080 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.622+0000 7fd92c088740 1 -- 172.21.15.18:0/781990774 >> 172.21.15.18:0/781990774 conn(0x55cbda7215f0 msgr2=0x55cbda727320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.623+0000 7fd92c088740 1 -- 172.21.15.18:0/781990774 shutdown_connections 2024-09-19T10:03:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.623+0000 7fd92c088740 1 -- 172.21.15.18:0/781990774 wait complete. 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.623+0000 7fd92c088740 20 client.17979 trim_cache size 0 max 16384 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd92c088740 1 Processor -- start 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd92c088740 1 -- start start 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd92c088740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda727b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd92c088740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725980 0x55cbda7479f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd92c088740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda730240 0x55cbda747f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd92c088740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd9241af750 con 0x55cbda725060 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd92c088740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd9241b1290 con 0x55cbda730240 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd92c088740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9241afe20 con 0x55cbda725980 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd9237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda727b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd9237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda727b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56144/0 (socket says 172.21.15.18:56144) 2024-09-19T10:03:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd9237fe640 1 -- 172.21.15.18:0/2117865749 learned_addr learned my addr 172.21.15.18:0/2117865749 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd922ffd640 1 --2- 172.21.15.18:0/2117865749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725980 0x55cbda7479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd9237fe640 1 -- 172.21.15.18:0/2117865749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725980 msgr2=0x55cbda7479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd9237fe640 1 --2- 172.21.15.18:0/2117865749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725980 0x55cbda7479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd9237fe640 1 -- 172.21.15.18:0/2117865749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda730240 msgr2=0x55cbda747f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd9237fe640 1 --2- 172.21.15.18:0/2117865749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda730240 0x55cbda747f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd9237fe640 1 -- 172.21.15.18:0/2117865749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbda7257b0 con 0x55cbda725060 2024-09-19T10:03:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.640+0000 7fd9237fe640 1 --2- 172.21.15.18:0/2117865749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda727b10 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd9140095a0 tx=0x7fd91402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b8b2c020dc9477 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd9097fa640 1 -- 172.21.15.18:0/2117865749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914035030 con 0x55cbda725060 2024-09-19T10:03:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd9097fa640 1 -- 172.21.15.18:0/2117865749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd914003c40 con 0x55cbda725060 2024-09-19T10:03:30.723 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:03:30.723 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T10:03:30.723 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T10:03:30.723 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 40, 2024-09-19T10:03:30.723 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": { 2024-09-19T10:03:30.723 INFO:teuthology.orchestra.run.smithi018.stdout: "187414c6": { 2024-09-19T10:03:30.723 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 40, 2024-09-19T10:03:30.723 INFO:teuthology.orchestra.run.smithi018.stdout: "age_ref": 0.0, 2024-09-19T10:03:30.723 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:03:30.723 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: "timeout": 90.0, 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: "expiration": 150.0, 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: "members": { 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: "file:/": { 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: "excluded": false, 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: "state": { 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RELEASED", 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:30.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:30.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:03:30.725 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:03:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd9097fa640 1 -- 172.21.15.18:0/2117865749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914005630 con 0x55cbda725060 2024-09-19T10:03:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd92c088740 1 -- 172.21.15.18:0/2117865749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 msgr2=0x55cbda727b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd92c088740 1 --2- 172.21.15.18:0/2117865749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda727b10 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd9140095a0 tx=0x7fd91402a480 comp rx=0 tx=0).stop 2024-09-19T10:03:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd92c088740 1 -- 172.21.15.18:0/2117865749 shutdown_connections 2024-09-19T10:03:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd92c088740 1 --2- 172.21.15.18:0/2117865749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda730240 0x55cbda747f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd92c088740 1 --2- 172.21.15.18:0/2117865749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725980 0x55cbda7479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd92c088740 1 --2- 172.21.15.18:0/2117865749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda725060 0x55cbda727b10 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd92c088740 1 -- 172.21.15.18:0/2117865749 >> 172.21.15.18:0/2117865749 conn(0x55cbda7215f0 msgr2=0x55cbda72b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd92c088740 1 -- 172.21.15.18:0/2117865749 shutdown_connections 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.641+0000 7fd92c088740 1 -- 172.21.15.18:0/2117865749 wait complete. 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd92c088740 1 -- start start 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd92c088740 1 Processor -- start 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd92c088740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725060 0x55cbda7342d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd92c088740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda734810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd92c088740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda730240 0x55cbda7a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd92c088740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd9241b0bc0 con 0x55cbda730240 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd92c088740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd9241b04f0 con 0x55cbda725980 2024-09-19T10:03:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd92c088740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9241ad730 con 0x55cbda725060 2024-09-19T10:03:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd92c088740 10 client.0 _ll_register_callbacks cb 0x7fd914031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd923fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda730240 0x55cbda7a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd923fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda730240 0x55cbda7a99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56146/0 (socket says 172.21.15.18:56146) 2024-09-19T10:03:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd923fff640 1 -- 172.21.15.18:0/799195505 learned_addr learned my addr 172.21.15.18:0/799195505 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd9237fe640 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725060 0x55cbda7342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd922ffd640 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda734810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd923fff640 1 -- 172.21.15.18:0/799195505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725060 msgr2=0x55cbda7342d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.642+0000 7fd923fff640 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725060 0x55cbda7342d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd923fff640 1 -- 172.21.15.18:0/799195505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 msgr2=0x55cbda734810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd923fff640 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda734810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd923fff640 1 -- 172.21.15.18:0/799195505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbda735110 con 0x55cbda730240 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd9237fe640 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725060 0x55cbda7342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd922ffd640 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda734810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd923fff640 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda730240 0x55cbda7a99c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd91c097a20 tx=0x7fd91c09b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2541204d1892cae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd902ffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd902ffd640 1 -- 172.21.15.18:0/799195505 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0a4180 con 0x55cbda730240 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd902ffd640 1 -- 172.21.15.18:0/799195505 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd91c0a3cf0 con 0x55cbda730240 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd92c088740 1 -- 172.21.15.18:0/799195505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd914003c40 con 0x55cbda730240 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd902ffd640 1 -- 172.21.15.18:0/799195505 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd91c0a3ef0 con 0x55cbda730240 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd92c088740 10 client.17985 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd92c088740 1 -- 172.21.15.18:0/799195505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cbda7ab070 con 0x55cbda730240 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd902ffd640 1 -- 172.21.15.18:0/799195505 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd914003c40 con 0x55cbda730240 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd902ffd640 1 -- 172.21.15.18:0/799195505 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd91c09a480 con 0x55cbda730240 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd92c088740 10 client.17985 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd92c088740 10 client.17985 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd92c088740 20 client.17985 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd92c088740 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cbda7ab740 0x55cbda7adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd92c088740 4 client.17985 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "187414c6", "release": true, "await": true}] 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.643+0000 7fd92c088740 1 -- 172.21.15.18:0/799195505 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "set_id": "187414c6", "release": true, "await": true}) -- 0x55cbda6920a0 con 0x55cbda7ab740 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.644+0000 7fd9237fe640 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cbda7ab740 0x55cbda7adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.644+0000 7fd902ffd640 10 client.17985 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.644+0000 7fd9237fe640 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cbda7ab740 0x55cbda7adb30 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc5f694846785d77 server_cookie=88816d58b0603ca5 in_seq=0 out_seq=0 2024-09-19T10:03:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.650+0000 7fd902ffd640 1 -- 172.21.15.18:0/799195505 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55cbda6920a0 con 0x55cbda7ab740 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.650+0000 7fd902ffd640 10 client.17985 handle_command_reply: tid=0 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.650+0000 7fd92c088740 1 client.17985 shutdown 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.650+0000 7fd92c088740 1 -- 172.21.15.18:0/799195505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda730240 msgr2=0x55cbda7a99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.650+0000 7fd92c088740 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda730240 0x55cbda7a99c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd91c097a20 tx=0x7fd91c09b680 comp rx=0 tx=0).stop 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.650+0000 7fd92c088740 1 -- 172.21.15.18:0/799195505 shutdown_connections 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.650+0000 7fd92c088740 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55cbda7ab740 0x55cbda7adb30 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.651+0000 7fd902ffd640 0 client.17985 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.651+0000 7fd92c088740 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cbda730240 0x55cbda7a99c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.651+0000 7fd92c088740 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cbda725980 0x55cbda734810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.651+0000 7fd92c088740 1 --2- 172.21.15.18:0/799195505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbda725060 0x55cbda7342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.651+0000 7fd92c088740 1 -- 172.21.15.18:0/799195505 >> 172.21.15.18:0/799195505 conn(0x55cbda7215f0 msgr2=0x55cbda71ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.651+0000 7fd92c088740 1 -- 172.21.15.18:0/799195505 shutdown_connections 2024-09-19T10:03:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.651+0000 7fd92c088740 1 -- 172.21.15.18:0/799195505 wait complete. 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.651+0000 7fd92c088740 20 client.17985 trim_cache size 0 max 16384 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 -- 172.21.15.18:0/1876177477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd90c0a3240 msgr2=0x7fd90c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd90c0a3240 0x7fd90c0a5700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd91801c000 tx=0x7fd91800fc90 comp rx=0 tx=0).stop 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 -- 172.21.15.18:0/1876177477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd92410c170 msgr2=0x7fd924101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd92410c170 0x7fd924101420 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00b970 tx=0x7fd91c00be30 comp rx=0 tx=0).stop 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 -- 172.21.15.18:0/1876177477 shutdown_connections 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fd90c0a3240 0x7fd90c0a5700 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd92410c170 0x7fd924101420 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd924103660 0x7fd924100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 --2- 172.21.15.18:0/1876177477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd924102d40 0x7fd9241009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 -- 172.21.15.18:0/1876177477 >> 172.21.15.18:0/1876177477 conn(0x7fd9240fc7a0 msgr2=0x7fd9240fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 -- 172.21.15.18:0/1876177477 shutdown_connections 2024-09-19T10:03:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:30.652+0000 7fd929caf640 1 -- 172.21.15.18:0/1876177477 wait complete. 2024-09-19T10:03:31.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:30 smithi018 ceph-mon[30956]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 63 MiB/s wr, 37 op/s 2024-09-19T10:03:31.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:30 smithi049 ceph-mon[34858]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 63 MiB/s wr, 37 op/s 2024-09-19T10:03:31.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:30 smithi162 ceph-mon[35174]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 63 MiB/s wr, 37 op/s 2024-09-19T10:03:31.755 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '187414c6', total seconds elapsed: 33.6 2024-09-19T10:03:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.659+0000 7f0d14c77640 1 -- 172.21.15.18:0/2211314085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d100737d0 msgr2=0x7f0d1007a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.659+0000 7f0d14c77640 1 --2- 172.21.15.18:0/2211314085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d100737d0 0x7f0d1007a3e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400b9f0 tx=0x7f0d0402c0c0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.660+0000 7f0d14c77640 1 -- 172.21.15.18:0/2211314085 shutdown_connections 2024-09-19T10:03:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.660+0000 7f0d14c77640 1 --2- 172.21.15.18:0/2211314085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d100737d0 0x7f0d1007a3e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.660+0000 7f0d14c77640 1 --2- 172.21.15.18:0/2211314085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d10072e30 0x7f0d10073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.660+0000 7f0d14c77640 1 --2- 172.21.15.18:0/2211314085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d10109590 0x7f0d10109990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.660+0000 7f0d14c77640 1 -- 172.21.15.18:0/2211314085 >> 172.21.15.18:0/2211314085 conn(0x7f0d1006eb50 msgr2=0x7f0d10070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.660+0000 7f0d14c77640 1 -- 172.21.15.18:0/2211314085 shutdown_connections 2024-09-19T10:03:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.660+0000 7f0d14c77640 1 -- 172.21.15.18:0/2211314085 wait complete. 2024-09-19T10:03:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.662+0000 7f0d14c77640 1 Processor -- start 2024-09-19T10:03:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.662+0000 7f0d14c77640 1 -- start start 2024-09-19T10:03:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.662+0000 7f0d14c77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d10072e30 0x7f0d10084db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.662+0000 7f0d14c77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d100737d0 0x7f0d100833f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.663+0000 7f0d14c77640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d10109590 0x7f0d10083930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.663+0000 7f0d14c77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1007de40 con 0x7f0d10072e30 2024-09-19T10:03:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.663+0000 7f0d14c77640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1007dcc0 con 0x7f0d10109590 2024-09-19T10:03:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.663+0000 7f0d14c77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1007dfc0 con 0x7f0d100737d0 2024-09-19T10:03:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.663+0000 7f0d0ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d10109590 0x7f0d10083930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.664+0000 7f0d0ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d10109590 0x7f0d10083930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:50952/0 (socket says 172.21.15.18:50952) 2024-09-19T10:03:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.664+0000 7f0d0ed9d640 1 -- 172.21.15.18:0/830427822 learned_addr learned my addr 172.21.15.18:0/830427822 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.664+0000 7f0d0dd9b640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d100737d0 0x7f0d100833f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.665+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d10072e30 0x7f0d10084db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.665+0000 7f0d0ed9d640 1 -- 172.21.15.18:0/830427822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d100737d0 msgr2=0x7f0d100833f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.665+0000 7f0d0ed9d640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d100737d0 0x7f0d100833f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.665+0000 7f0d0ed9d640 1 -- 172.21.15.18:0/830427822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d10072e30 msgr2=0x7f0d10084db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.665+0000 7f0d0ed9d640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d10072e30 0x7f0d10084db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.665+0000 7f0d0ed9d640 1 -- 172.21.15.18:0/830427822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d100841d0 con 0x7f0d10109590 2024-09-19T10:03:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.667+0000 7f0d0ed9d640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d10109590 0x7f0d10083930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0d0402c6b0 tx=0x7f0d040035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.667+0000 7f0cff7fe640 1 -- 172.21.15.18:0/830427822 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04039070 con 0x7f0d10109590 2024-09-19T10:03:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.668+0000 7f0d14c77640 1 -- 172.21.15.18:0/830427822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d101b71c0 con 0x7f0d10109590 2024-09-19T10:03:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.668+0000 7f0d14c77640 1 -- 172.21.15.18:0/830427822 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d101b7650 con 0x7f0d10109590 2024-09-19T10:03:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.673+0000 7f0d17a0b740 1 Processor -- start 2024-09-19T10:03:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.673+0000 7f0d17a0b740 1 -- start start 2024-09-19T10:03:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.674+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e6cb70 0x556971e6cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.674+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e71f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.674+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e74a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.674+0000 7f0d17a0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556971dd02f0 con 0x556971e72540 2024-09-19T10:03:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.674+0000 7f0d17a0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556971d78270 con 0x556971e6cb70 2024-09-19T10:03:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.674+0000 7f0d17a0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556971dcc2b0 con 0x556971e6d4b0 2024-09-19T10:03:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.674+0000 7f0cff7fe640 1 -- 172.21.15.18:0/830427822 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d04005460 con 0x7f0d10109590 2024-09-19T10:03:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.674+0000 7f0cff7fe640 1 -- 172.21.15.18:0/830427822 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04003be0 con 0x7f0d10109590 2024-09-19T10:03:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.675+0000 7f0d0e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e71f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.675+0000 7f0d0e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e71f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47472/0 (socket says 172.21.15.18:47472) 2024-09-19T10:03:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.675+0000 7f0d0e59c640 1 -- 172.21.15.18:0/3274046162 learned_addr learned my addr 172.21.15.18:0/3274046162 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.675+0000 7f0d0dd9b640 1 --2- 172.21.15.18:0/3274046162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e6cb70 0x556971e6cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.675+0000 7f0d0e59c640 1 -- 172.21.15.18:0/3274046162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e6cb70 msgr2=0x556971e6cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.675+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/3274046162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e6cb70 0x556971e6cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.675+0000 7f0d0e59c640 1 -- 172.21.15.18:0/3274046162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 msgr2=0x556971e74a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.675+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/3274046162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e74a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.677+0000 7f0d0e59c640 1 -- 172.21.15.18:0/3274046162 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556971d77340 con 0x556971e6d4b0 2024-09-19T10:03:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.678+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/3274046162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e71f70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000a420 tx=0x7f0d0000ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f89845bdc7b8340e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.679+0000 7f0cff7fe640 1 -- 172.21.15.18:0/830427822 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0d04034440 con 0x7f0d10109590 2024-09-19T10:03:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.680+0000 7f0cff7fe640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0cf80a3450 0x7f0cf80a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.681+0000 7f0cff7fe640 1 -- 172.21.15.18:0/830427822 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0d040ef4b0 con 0x7f0d10109590 2024-09-19T10:03:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.682+0000 7f0cfcff9640 1 -- 172.21.15.18:0/3274046162 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00019020 con 0x556971e6d4b0 2024-09-19T10:03:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.682+0000 7f0cfcff9640 1 -- 172.21.15.18:0/3274046162 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d00008df0 con 0x556971e6d4b0 2024-09-19T10:03:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.682+0000 7f0cfcff9640 1 -- 172.21.15.18:0/3274046162 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000148a0 con 0x556971e6d4b0 2024-09-19T10:03:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.683+0000 7f0d0dd9b640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0cf80a3450 0x7f0cf80a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.684+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3274046162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 msgr2=0x556971e71f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.684+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/3274046162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e71f70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000a420 tx=0x7f0d0000ac00 comp rx=0 tx=0).stop 2024-09-19T10:03:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.684+0000 7f0d0dd9b640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0cf80a3450 0x7f0cf80a5910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009440 tx=0x7f0d08009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.684+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3274046162 shutdown_connections 2024-09-19T10:03:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.684+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/3274046162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e74a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.684+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/3274046162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e71f70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.684+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/3274046162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e6cb70 0x556971e6cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.685+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3274046162 >> 172.21.15.18:0/3274046162 conn(0x556971e681e0 msgr2=0x556971e685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.685+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3274046162 shutdown_connections 2024-09-19T10:03:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.685+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3274046162 wait complete. 2024-09-19T10:03:32.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.686+0000 7f0d17a0b740 1 -- start start 2024-09-19T10:03:32.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.686+0000 7f0d17a0b740 1 Processor -- start 2024-09-19T10:03:32.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.687+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e6cb70 0x556971e76dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.687+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e77310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.687+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.690 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.687+0000 7f0d17a0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556971e75510 con 0x556971e72540 2024-09-19T10:03:32.691 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.687+0000 7f0d17a0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556971d59290 con 0x556971e6cb70 2024-09-19T10:03:32.691 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.687+0000 7f0d17a0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556971e75690 con 0x556971e6d4b0 2024-09-19T10:03:32.691 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.687+0000 7f0d17a0b740 10 client.0 _ll_register_callbacks cb 0x556971d8a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:32.691 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.688+0000 7f0d0ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.691 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.688+0000 7f0d0ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56190/0 (socket says 172.21.15.18:56190) 2024-09-19T10:03:32.691 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.688+0000 7f0d0ed9d640 1 -- 172.21.15.18:0/3978441070 learned_addr learned my addr 172.21.15.18:0/3978441070 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.688+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e6cb70 0x556971e76dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.688+0000 7f0d0dd9b640 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e77310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.689+0000 7f0d0ed9d640 1 -- 172.21.15.18:0/3978441070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 msgr2=0x556971e77310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.689+0000 7f0d0ed9d640 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e77310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.689+0000 7f0d0ed9d640 1 -- 172.21.15.18:0/3978441070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e6cb70 msgr2=0x556971e76dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.689+0000 7f0d0ed9d640 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e6cb70 0x556971e76dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.689+0000 7f0d0ed9d640 1 -- 172.21.15.18:0/3978441070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556971ae3210 con 0x556971e72540 2024-09-19T10:03:32.693 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.690+0000 7f0d0ed9d640 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7e350 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f0d040b8ef0 tx=0x7f0d040bac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76579ed50bc3e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.695+0000 7f0cf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.695+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/3978441070 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d040d4060 con 0x556971e72540 2024-09-19T10:03:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.695+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3978441070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d00008df0 con 0x556971e72540 2024-09-19T10:03:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.695+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/3978441070 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0d040ed090 con 0x556971e72540 2024-09-19T10:03:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.696+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/3978441070 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d040bd220 con 0x556971e72540 2024-09-19T10:03:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.696+0000 7f0d17a0b740 10 client.17994 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.696+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3978441070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556971baf620 con 0x556971e72540 2024-09-19T10:03:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.696+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/3978441070 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d00008df0 con 0x556971e72540 2024-09-19T10:03:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.698+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/3978441070 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0d040c4280 con 0x556971e72540 2024-09-19T10:03:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.698+0000 7f0d17a0b740 10 client.17994 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.698+0000 7f0d17a0b740 10 client.17994 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.698+0000 7f0d17a0b740 20 client.17994 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.698+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556971e82c40 0x556971e85080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.698+0000 7f0d17a0b740 4 client.17994 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.698+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3978441070 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556971ddda20 con 0x556971e82c40 2024-09-19T10:03:32.703 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.700+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556971e82c40 0x556971e85080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.701+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556971e82c40 0x556971e85080 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f289ea6a2ed5cb8f server_cookie=7f18765dc1a61bc9 in_seq=0 out_seq=0 2024-09-19T10:03:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.702+0000 7f0cf5ffb640 10 client.17994 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.703+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/3978441070 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556971ddda20 con 0x556971e82c40 2024-09-19T10:03:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.703+0000 7f0cf5ffb640 10 client.17994 handle_command_reply: tid=0 2024-09-19T10:03:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.704+0000 7f0d17a0b740 1 client.17994 shutdown 2024-09-19T10:03:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3978441070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 msgr2=0x556971e7e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7e350 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f0d040b8ef0 tx=0x7f0d040bac60 comp rx=0 tx=0).stop 2024-09-19T10:03:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3978441070 shutdown_connections 2024-09-19T10:03:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556971e82c40 0x556971e85080 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7e350 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e77310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/3978441070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e6cb70 0x556971e76dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3978441070 >> 172.21.15.18:0/3978441070 conn(0x556971e681e0 msgr2=0x556971e699f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0cf5ffb640 0 client.17994 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3978441070 shutdown_connections 2024-09-19T10:03:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.705+0000 7f0d17a0b740 1 -- 172.21.15.18:0/3978441070 wait complete. 2024-09-19T10:03:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.706+0000 7f0d17a0b740 20 client.17994 trim_cache size 0 max 16384 2024-09-19T10:03:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.762+0000 7f0d17a0b740 1 Processor -- start 2024-09-19T10:03:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.762+0000 7f0d17a0b740 1 -- start start 2024-09-19T10:03:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.762+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e6cb70 0x556971e62ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.763+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e7e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.763+0000 7f0d0e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e6cb70 0x556971e62ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.763+0000 7f0d0e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e6cb70 0x556971e62ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56206/0 (socket says 172.21.15.18:56206) 2024-09-19T10:03:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.763+0000 7f0d0e59c640 1 -- 172.21.15.18:0/4241816057 learned_addr learned my addr 172.21.15.18:0/4241816057 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.763+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/4241816057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e72540 0x556971e6e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.763+0000 7f0d17a0b740 1 -- 172.21.15.18:0/4241816057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf000e2b0 con 0x556971e6cb70 2024-09-19T10:03:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.763+0000 7f0d17a0b740 1 -- 172.21.15.18:0/4241816057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf000fdf0 con 0x556971e72540 2024-09-19T10:03:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.763+0000 7f0d17a0b740 1 -- 172.21.15.18:0/4241816057 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf000e980 con 0x556971e6d4b0 2024-09-19T10:03:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.763+0000 7f0d0dd9b640 1 --2- 172.21.15.18:0/4241816057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e7e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.764+0000 7f0d0ed9d640 1 --2- 172.21.15.18:0/4241816057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e72540 0x556971e6e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.764+0000 7f0d0e59c640 1 -- 172.21.15.18:0/4241816057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 msgr2=0x556971e7e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.764+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/4241816057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e7e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.764+0000 7f0d0e59c640 1 -- 172.21.15.18:0/4241816057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e72540 msgr2=0x556971e6e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.764+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/4241816057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e72540 0x556971e6e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.764+0000 7f0d0e59c640 1 -- 172.21.15.18:0/4241816057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556971e68000 con 0x556971e6cb70 2024-09-19T10:03:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.765+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/4241816057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e6cb70 0x556971e62ed0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000a340 tx=0x7f0d00015dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d78ad4d2592dbea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.802+0000 7f0cf7fff640 1 -- 172.21.15.18:0/4241816057 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00019040 con 0x556971e6cb70 2024-09-19T10:03:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.802+0000 7f0cf7fff640 1 -- 172.21.15.18:0/4241816057 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d00005520 con 0x556971e6cb70 2024-09-19T10:03:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.804+0000 7f0d17a0b740 1 -- 172.21.15.18:0/4241816057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e6cb70 msgr2=0x556971e62ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.804+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/4241816057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e6cb70 0x556971e62ed0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000a340 tx=0x7f0d00015dc0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.804+0000 7f0d17a0b740 1 -- 172.21.15.18:0/4241816057 shutdown_connections 2024-09-19T10:03:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.804+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/4241816057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971e72540 0x556971e6e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.804+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/4241816057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e7e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.804+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/4241816057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e6cb70 0x556971e62ed0 secure :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000a340 tx=0x7f0d00015dc0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.804+0000 7f0d17a0b740 1 -- 172.21.15.18:0/4241816057 >> 172.21.15.18:0/4241816057 conn(0x556971e681e0 msgr2=0x556971e76dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.806+0000 7f0d17a0b740 1 -- 172.21.15.18:0/4241816057 shutdown_connections 2024-09-19T10:03:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.806+0000 7f0d17a0b740 1 -- 172.21.15.18:0/4241816057 wait complete. 2024-09-19T10:03:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.807+0000 7f0d17a0b740 1 -- start start 2024-09-19T10:03:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.807+0000 7f0d17a0b740 1 Processor -- start 2024-09-19T10:03:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.808+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e7b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.808+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.808+0000 7f0d17a0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971ee9940 0x556971eebd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.808+0000 7f0d17a0b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf000f720 con 0x556971e72540 2024-09-19T10:03:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.808+0000 7f0d17a0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf000f050 con 0x556971ee9940 2024-09-19T10:03:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.808+0000 7f0d17a0b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf000c340 con 0x556971e6d4b0 2024-09-19T10:03:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.808+0000 7f0d17a0b740 10 client.0 _ll_register_callbacks cb 0x7f0d04009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.809+0000 7f0d0dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.809+0000 7f0d0dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56214/0 (socket says 172.21.15.18:56214) 2024-09-19T10:03:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.809+0000 7f0d0dd9b640 1 -- 172.21.15.18:0/755624926 learned_addr learned my addr 172.21.15.18:0/755624926 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.809+0000 7f0d0ed9d640 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971ee9940 0x556971eebd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.809+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e7b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.810+0000 7f0d0dd9b640 1 -- 172.21.15.18:0/755624926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 msgr2=0x556971e7b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.810+0000 7f0d0dd9b640 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e7b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.810+0000 7f0d0dd9b640 1 -- 172.21.15.18:0/755624926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971ee9940 msgr2=0x556971eebd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.810+0000 7f0d0dd9b640 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971ee9940 0x556971eebd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.810+0000 7f0d0dd9b640 1 -- 172.21.15.18:0/755624926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556971eec2f0 con 0x556971e72540 2024-09-19T10:03:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.812+0000 7f0d0dd9b640 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7b7c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f0d08017cb0 tx=0x7f0d08004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513853f74d4145f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.823+0000 7f0cf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.823+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/755624926 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d08028070 con 0x556971e72540 2024-09-19T10:03:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.823+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/755624926 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0d08024620 con 0x556971e72540 2024-09-19T10:03:32.827 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.824+0000 7f0d17a0b740 1 -- 172.21.15.18:0/755624926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556971dd7d70 con 0x556971e72540 2024-09-19T10:03:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.825+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/755624926 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d08024820 con 0x556971e72540 2024-09-19T10:03:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.825+0000 7f0d17a0b740 10 client.18000 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.825+0000 7f0d17a0b740 1 -- 172.21.15.18:0/755624926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556971eed760 con 0x556971e72540 2024-09-19T10:03:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.827+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/755624926 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x556971dd7d70 con 0x556971e72540 2024-09-19T10:03:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.828+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/755624926 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0d08035020 con 0x556971e72540 2024-09-19T10:03:32.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.829+0000 7f0d17a0b740 10 client.18000 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:32.832 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.829+0000 7f0d17a0b740 10 client.18000 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.829+0000 7f0d17a0b740 20 client.18000 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.829+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556971eee140 0x556971ef0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.829+0000 7f0d17a0b740 4 client.18000 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:03:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.829+0000 7f0d17a0b740 1 -- 172.21.15.18:0/755624926 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556971d54900 con 0x556971eee140 2024-09-19T10:03:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.831+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556971eee140 0x556971ef0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.838+0000 7f0d0e59c640 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556971eee140 0x556971ef0560 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fe083be7a52efb1 server_cookie=1539f4f74b1bcd78 in_seq=0 out_seq=0 2024-09-19T10:03:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:32.839+0000 7f0cf5ffb640 10 client.18000 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:33.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:33 smithi018 ceph-mon[30956]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 76 MiB/s wr, 107 op/s 2024-09-19T10:03:33.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:33 smithi049 ceph-mon[34858]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 76 MiB/s wr, 107 op/s 2024-09-19T10:03:33.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:33 smithi162 ceph-mon[35174]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 76 MiB/s wr, 107 op/s 2024-09-19T10:03:35.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:35 smithi018 ceph-mon[30956]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 200 MiB/s wr, 654 op/s 2024-09-19T10:03:35.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:35 smithi049 ceph-mon[34858]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 200 MiB/s wr, 654 op/s 2024-09-19T10:03:35.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:35 smithi162 ceph-mon[35174]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 200 MiB/s wr, 654 op/s 2024-09-19T10:03:37.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:36 smithi018 ceph-mon[30956]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 283 MiB/s wr, 971 op/s 2024-09-19T10:03:37.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:36 smithi049 ceph-mon[34858]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 283 MiB/s wr, 971 op/s 2024-09-19T10:03:37.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:36 smithi162 ceph-mon[35174]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 283 MiB/s wr, 971 op/s 2024-09-19T10:03:39.387 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:38 smithi018 ceph-mon[30956]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 376 MiB/s wr, 1.24k op/s 2024-09-19T10:03:39.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:39 smithi049 ceph-mon[34858]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 376 MiB/s wr, 1.24k op/s 2024-09-19T10:03:39.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:38 smithi162 ceph-mon[35174]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 376 MiB/s wr, 1.24k op/s 2024-09-19T10:03:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0cf5ffb640 1 -- 172.21.15.18:0/755624926 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556971d54900 con 0x556971eee140 2024-09-19T10:03:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0cf5ffb640 10 client.18000 handle_command_reply: tid=0 2024-09-19T10:03:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0d17a0b740 1 client.18000 shutdown 2024-09-19T10:03:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0d17a0b740 1 -- 172.21.15.18:0/755624926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 msgr2=0x556971e7b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7b7c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f0d08017cb0 tx=0x7f0d08004a60 comp rx=0 tx=0).stop 2024-09-19T10:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0d17a0b740 1 -- 172.21.15.18:0/755624926 shutdown_connections 2024-09-19T10:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x556971eee140 0x556971ef0560 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556971ee9940 0x556971eebd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556971e72540 0x556971e7b7c0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0d17a0b740 1 --2- 172.21.15.18:0/755624926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556971e6d4b0 0x556971e7b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0cf5ffb640 0 client.18000 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.791+0000 7f0d17a0b740 1 -- 172.21.15.18:0/755624926 >> 172.21.15.18:0/755624926 conn(0x556971e681e0 msgr2=0x556971e66a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.792+0000 7f0d17a0b740 1 -- 172.21.15.18:0/755624926 shutdown_connections 2024-09-19T10:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.792+0000 7f0d17a0b740 1 -- 172.21.15.18:0/755624926 wait complete. 2024-09-19T10:03:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.792+0000 7f0d17a0b740 20 client.18000 trim_cache size 0 max 16384 2024-09-19T10:03:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:03:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:03:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:03:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:03:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.800+0000 7f0d14c77640 1 -- 172.21.15.18:0/830427822 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0cf80a3450 msgr2=0x7f0cf80a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.800+0000 7f0d14c77640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0cf80a3450 0x7f0cf80a5910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009440 tx=0x7f0d08009720 comp rx=0 tx=0).stop 2024-09-19T10:03:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.800+0000 7f0d14c77640 1 -- 172.21.15.18:0/830427822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d10109590 msgr2=0x7f0d10083930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.800+0000 7f0d14c77640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d10109590 0x7f0d10083930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0d0402c6b0 tx=0x7f0d040035f0 comp rx=0 tx=0).stop 2024-09-19T10:03:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.800+0000 7f0d14c77640 1 -- 172.21.15.18:0/830427822 shutdown_connections 2024-09-19T10:03:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.801+0000 7f0d14c77640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f0cf80a3450 0x7f0cf80a5910 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.801+0000 7f0d14c77640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d10109590 0x7f0d10083930 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.801+0000 7f0d14c77640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d100737d0 0x7f0d100833f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.801+0000 7f0d14c77640 1 --2- 172.21.15.18:0/830427822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d10072e30 0x7f0d10084db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.801+0000 7f0d14c77640 1 -- 172.21.15.18:0/830427822 >> 172.21.15.18:0/830427822 conn(0x7f0d1006eb50 msgr2=0x7f0d100763c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.801+0000 7f0d14c77640 1 -- 172.21.15.18:0/830427822 shutdown_connections 2024-09-19T10:03:39.805 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:39.801+0000 7f0d14c77640 1 -- 172.21.15.18:0/830427822 wait complete. 2024-09-19T10:03:42.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:41 smithi018 ceph-mon[30956]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 554 MiB/s wr, 1.75k op/s 2024-09-19T10:03:42.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:41 smithi049 ceph-mon[34858]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 554 MiB/s wr, 1.75k op/s 2024-09-19T10:03:42.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:41 smithi162 ceph-mon[35174]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 554 MiB/s wr, 1.75k op/s 2024-09-19T10:03:43.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T10:03:44.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:44 smithi018 ceph-mon[30956]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 636 MiB/s wr, 2.04k op/s 2024-09-19T10:03:44.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:44 smithi049 ceph-mon[34858]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 636 MiB/s wr, 2.04k op/s 2024-09-19T10:03:44.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:44 smithi162 ceph-mon[35174]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 636 MiB/s wr, 2.04k op/s 2024-09-19T10:03:44.527 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:45.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.585+0000 7efd609dd640 1 -- 172.21.15.18:0/2188495133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd5c101270 msgr2=0x7efd5c10d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:45.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.585+0000 7efd609dd640 1 --2- 172.21.15.18:0/2188495133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd5c101270 0x7efd5c10d7a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7efd54009cd0 tx=0x7efd5402a8f0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.586+0000 7efd609dd640 1 -- 172.21.15.18:0/2188495133 shutdown_connections 2024-09-19T10:03:45.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.586+0000 7efd609dd640 1 --2- 172.21.15.18:0/2188495133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd5c101270 0x7efd5c10d7a0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.586+0000 7efd609dd640 1 --2- 172.21.15.18:0/2188495133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c1008d0 0x7efd5c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.586+0000 7efd609dd640 1 --2- 172.21.15.18:0/2188495133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd5c1068d0 0x7efd5c106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.586+0000 7efd609dd640 1 -- 172.21.15.18:0/2188495133 >> 172.21.15.18:0/2188495133 conn(0x7efd5c0fc610 msgr2=0x7efd5c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:45.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.586+0000 7efd609dd640 1 -- 172.21.15.18:0/2188495133 shutdown_connections 2024-09-19T10:03:45.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.586+0000 7efd609dd640 1 -- 172.21.15.18:0/2188495133 wait complete. 2024-09-19T10:03:45.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.589+0000 7efd609dd640 1 Processor -- start 2024-09-19T10:03:45.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.590+0000 7efd609dd640 1 -- start start 2024-09-19T10:03:45.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.591+0000 7efd609dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd5c1008d0 0x7efd5c109b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.591+0000 7efd609dd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c101270 0x7efd5c10a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.591+0000 7efd609dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd5c1068d0 0x7efd5c10a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.591+0000 7efd609dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c10fcb0 con 0x7efd5c1008d0 2024-09-19T10:03:45.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.591+0000 7efd609dd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c10fb30 con 0x7efd5c101270 2024-09-19T10:03:45.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.591+0000 7efd609dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c10fe30 con 0x7efd5c1068d0 2024-09-19T10:03:45.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.592+0000 7efd5b59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd5c1068d0 0x7efd5c10a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.592+0000 7efd5b59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd5c1068d0 0x7efd5c10a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45480/0 (socket says 172.21.15.18:45480) 2024-09-19T10:03:45.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.592+0000 7efd5b59e640 1 -- 172.21.15.18:0/3921114292 learned_addr learned my addr 172.21.15.18:0/3921114292 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:45.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.592+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd5c1008d0 0x7efd5c109b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.593+0000 7efd5a59c640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c101270 0x7efd5c10a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.593+0000 7efd5b59e640 1 -- 172.21.15.18:0/3921114292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c101270 msgr2=0x7efd5c10a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:45.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.593+0000 7efd5b59e640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c101270 0x7efd5c10a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.593+0000 7efd5b59e640 1 -- 172.21.15.18:0/3921114292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd5c1008d0 msgr2=0x7efd5c109b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:45.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.593+0000 7efd5b59e640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd5c1008d0 0x7efd5c109b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.593+0000 7efd5b59e640 1 -- 172.21.15.18:0/3921114292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c073f90 con 0x7efd5c1068d0 2024-09-19T10:03:45.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.594+0000 7efd5a59c640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c101270 0x7efd5c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:03:45.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.594+0000 7efd5b59e640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd5c1068d0 0x7efd5c10a590 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efd54003ba0 tx=0x7efd54003bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.596+0000 7efd43fff640 1 -- 172.21.15.18:0/3921114292 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54004240 con 0x7efd5c1068d0 2024-09-19T10:03:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.596+0000 7efd609dd640 1 -- 172.21.15.18:0/3921114292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c074220 con 0x7efd5c1068d0 2024-09-19T10:03:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.597+0000 7efd43fff640 1 -- 172.21.15.18:0/3921114292 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd54040070 con 0x7efd5c1068d0 2024-09-19T10:03:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.597+0000 7efd43fff640 1 -- 172.21.15.18:0/3921114292 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54045e00 con 0x7efd5c1068d0 2024-09-19T10:03:45.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.597+0000 7efd609dd640 1 -- 172.21.15.18:0/3921114292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c1b3c60 con 0x7efd5c1068d0 2024-09-19T10:03:45.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.602+0000 7efd635b7740 1 Processor -- start 2024-09-19T10:03:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.603+0000 7efd635b7740 1 -- start start 2024-09-19T10:03:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.603+0000 7efd635b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.603+0000 7efd635b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222cef90 0x5603222d9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.603+0000 7efd635b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.603+0000 7efd635b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5603222342e0 con 0x5603222ce670 2024-09-19T10:03:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.603+0000 7efd635b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5603221dbce0 con 0x5603222d9850 2024-09-19T10:03:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.603+0000 7efd635b7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5603222302a0 con 0x5603222cef90 2024-09-19T10:03:45.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.604+0000 7efd5a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.604+0000 7efd5a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52250/0 (socket says 172.21.15.18:52250) 2024-09-19T10:03:45.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.604+0000 7efd5a59c640 1 -- 172.21.15.18:0/1625021855 learned_addr learned my addr 172.21.15.18:0/1625021855 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:45.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.604+0000 7efd5a59c640 1 --2- 172.21.15.18:0/1625021855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.604+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/1625021855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222cef90 0x5603222d9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.606+0000 7efd5a59c640 1 -- 172.21.15.18:0/1625021855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222cef90 msgr2=0x5603222d9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:45.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.606+0000 7efd5a59c640 1 --2- 172.21.15.18:0/1625021855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222cef90 0x5603222d9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.606+0000 7efd5a59c640 1 -- 172.21.15.18:0/1625021855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 msgr2=0x5603222cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:45.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.606+0000 7efd5a59c640 1 --2- 172.21.15.18:0/1625021855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.606+0000 7efd5a59c640 1 -- 172.21.15.18:0/1625021855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603221c0440 con 0x5603222d9850 2024-09-19T10:03:45.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.607+0000 7efd5a59c640 1 --2- 172.21.15.18:0/1625021855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222dbc40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efd50009fd0 tx=0x7efd500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98f5f84e952c5aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:45.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.607+0000 7efd417fa640 1 -- 172.21.15.18:0/1625021855 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5001d070 con 0x5603222d9850 2024-09-19T10:03:45.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.607+0000 7efd417fa640 1 -- 172.21.15.18:0/1625021855 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd50010050 con 0x5603222d9850 2024-09-19T10:03:45.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.608+0000 7efd417fa640 1 -- 172.21.15.18:0/1625021855 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5000c030 con 0x5603222d9850 2024-09-19T10:03:45.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.610+0000 7efd635b7740 1 -- 172.21.15.18:0/1625021855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 msgr2=0x5603222dbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:45.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.610+0000 7efd635b7740 1 --2- 172.21.15.18:0/1625021855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222dbc40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efd50009fd0 tx=0x7efd500046c0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.611+0000 7efd43fff640 1 -- 172.21.15.18:0/3921114292 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efd540043e0 con 0x7efd5c1068d0 2024-09-19T10:03:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.613+0000 7efd635b7740 1 -- 172.21.15.18:0/1625021855 shutdown_connections 2024-09-19T10:03:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.613+0000 7efd635b7740 1 --2- 172.21.15.18:0/1625021855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222dbc40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.613+0000 7efd635b7740 1 --2- 172.21.15.18:0/1625021855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222cef90 0x5603222d9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.613+0000 7efd635b7740 1 --2- 172.21.15.18:0/1625021855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.613+0000 7efd635b7740 1 -- 172.21.15.18:0/1625021855 >> 172.21.15.18:0/1625021855 conn(0x5603222cac00 msgr2=0x5603222cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.613+0000 7efd43fff640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efd440a3400 0x7efd440a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.614+0000 7efd5a59c640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efd440a3400 0x7efd440a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.614+0000 7efd635b7740 1 -- 172.21.15.18:0/1625021855 shutdown_connections 2024-09-19T10:03:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.614+0000 7efd635b7740 1 -- 172.21.15.18:0/1625021855 wait complete. 2024-09-19T10:03:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.614+0000 7efd43fff640 1 -- 172.21.15.18:0/3921114292 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efd540f0b40 con 0x7efd5c1068d0 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.615+0000 7efd5a59c640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efd440a3400 0x7efd440a58c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efd50013610 tx=0x7efd50009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.615+0000 7efd635b7740 1 -- start start 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.615+0000 7efd635b7740 1 Processor -- start 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.616+0000 7efd635b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222ce670 0x5603222d9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.616+0000 7efd635b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222d6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.616+0000 7efd635b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222d6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.616+0000 7efd5a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.617+0000 7efd5a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222d6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52262/0 (socket says 172.21.15.18:52262) 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.617+0000 7efd5a59c640 1 -- 172.21.15.18:0/204174707 learned_addr learned my addr 172.21.15.18:0/204174707 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.617+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5603222dc4c0 con 0x5603222cef90 2024-09-19T10:03:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.617+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5603221ef050 con 0x5603222d9850 2024-09-19T10:03:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.617+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5603222dc640 con 0x5603222ce670 2024-09-19T10:03:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.617+0000 7efd635b7740 10 client.0 _ll_register_callbacks cb 0x56032222f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.617+0000 7efd5b59e640 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222d6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.618+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222ce670 0x5603222d9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.618+0000 7efd5b59e640 1 -- 172.21.15.18:0/204174707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222ce670 msgr2=0x5603222d9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.618+0000 7efd5b59e640 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222ce670 0x5603222d9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.618+0000 7efd5b59e640 1 -- 172.21.15.18:0/204174707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 msgr2=0x5603222d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.618+0000 7efd5b59e640 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222d6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.618+0000 7efd5b59e640 1 -- 172.21.15.18:0/204174707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560321fa53c0 con 0x5603222d9850 2024-09-19T10:03:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.619+0000 7efd5b59e640 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222d6980 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efd540ee610 tx=0x7efd540bd830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f3394deca1983e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.619+0000 7efd3eff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:03:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.620+0000 7efd3eff5640 1 -- 172.21.15.18:0/204174707 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540c5da0 con 0x5603222d9850 2024-09-19T10:03:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.620+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd50010050 con 0x5603222d9850 2024-09-19T10:03:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.620+0000 7efd3eff5640 1 -- 172.21.15.18:0/204174707 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efd540ee720 con 0x5603222d9850 2024-09-19T10:03:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.621+0000 7efd3eff5640 1 -- 172.21.15.18:0/204174707 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd540046d0 con 0x5603222d9850 2024-09-19T10:03:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.621+0000 7efd635b7740 10 client.27440 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.621+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5603222e7e70 con 0x5603222d9850 2024-09-19T10:03:45.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.624+0000 7efd3eff5640 1 -- 172.21.15.18:0/204174707 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd50010050 con 0x5603222d9850 2024-09-19T10:03:45.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.626+0000 7efd3eff5640 1 -- 172.21.15.18:0/204174707 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd5404d030 con 0x5603222d9850 2024-09-19T10:03:45.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.626+0000 7efd635b7740 10 client.27440 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:45.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.626+0000 7efd635b7740 10 client.27440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:45.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.626+0000 7efd635b7740 20 client.27440 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:45.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.626+0000 7efd635b7740 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5603222e9550 0x5603222eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.626+0000 7efd635b7740 4 client.27440 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:45.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.626+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560322241850 con 0x5603222e9550 2024-09-19T10:03:45.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.627+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5603222e9550 0x5603222eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.631+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5603222e9550 0x5603222eb9d0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee1c5265d25dc9dd server_cookie=dc0933714fff6580 in_seq=0 out_seq=0 2024-09-19T10:03:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.631+0000 7efd3eff5640 10 client.27440 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:45.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.633+0000 7efd3eff5640 1 -- 172.21.15.18:0/204174707 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560322241850 con 0x5603222e9550 2024-09-19T10:03:45.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.633+0000 7efd3eff5640 10 client.27440 handle_command_reply: tid=0 2024-09-19T10:03:45.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.633+0000 7efd635b7740 1 client.27440 shutdown 2024-09-19T10:03:45.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.634+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 msgr2=0x5603222d6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:45.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.634+0000 7efd635b7740 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222d6980 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efd540ee610 tx=0x7efd540bd830 comp rx=0 tx=0).stop 2024-09-19T10:03:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.636+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 shutdown_connections 2024-09-19T10:03:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.636+0000 7efd635b7740 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5603222e9550 0x5603222eb9d0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.636+0000 7efd635b7740 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222d6980 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.636+0000 7efd635b7740 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222d6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.636+0000 7efd635b7740 1 --2- 172.21.15.18:0/204174707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222ce670 0x5603222d9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.636+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 >> 172.21.15.18:0/204174707 conn(0x5603222cac00 msgr2=0x5603222d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.636+0000 7efd3eff5640 0 client.27440 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.636+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 shutdown_connections 2024-09-19T10:03:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.637+0000 7efd635b7740 1 -- 172.21.15.18:0/204174707 wait complete. 2024-09-19T10:03:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.637+0000 7efd635b7740 20 client.27440 trim_cache size 0 max 16384 2024-09-19T10:03:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.721+0000 7efd635b7740 1 Processor -- start 2024-09-19T10:03:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.726+0000 7efd635b7740 1 -- start start 2024-09-19T10:03:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.726+0000 7efd635b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222e5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.726+0000 7efd635b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222cef90 0x5603222d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.726+0000 7efd635b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.726+0000 7efd635b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1bc0e0 con 0x5603222ce670 2024-09-19T10:03:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.726+0000 7efd635b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1bdc20 con 0x5603222d9850 2024-09-19T10:03:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.726+0000 7efd635b7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1bc7b0 con 0x5603222cef90 2024-09-19T10:03:45.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.731+0000 7efd5b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.731+0000 7efd5a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222cef90 0x5603222d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.731+0000 7efd5ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.731+0000 7efd5ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222e5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52268/0 (socket says 172.21.15.18:52268) 2024-09-19T10:03:45.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.731+0000 7efd5ad9d640 1 -- 172.21.15.18:0/3673825442 learned_addr learned my addr 172.21.15.18:0/3673825442 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.734+0000 7efd5ad9d640 1 -- 172.21.15.18:0/3673825442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222cef90 msgr2=0x5603222d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.734+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/3673825442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222cef90 0x5603222d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.734+0000 7efd5ad9d640 1 -- 172.21.15.18:0/3673825442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 msgr2=0x5603222c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.734+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/3673825442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.734+0000 7efd5ad9d640 1 -- 172.21.15.18:0/3673825442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603222cb8f0 con 0x5603222ce670 2024-09-19T10:03:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.736+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/3673825442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222e5720 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00a940 tx=0x7efd4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ce26cb1f71d438 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:45.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.737+0000 7efd40ff9640 1 -- 172.21.15.18:0/3673825442 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c005a80 con 0x5603222ce670 2024-09-19T10:03:45.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.738+0000 7efd40ff9640 1 -- 172.21.15.18:0/3673825442 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd4c005c20 con 0x5603222ce670 2024-09-19T10:03:45.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.739+0000 7efd635b7740 1 -- 172.21.15.18:0/3673825442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 msgr2=0x5603222e5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:45.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.739+0000 7efd635b7740 1 --2- 172.21.15.18:0/3673825442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222e5720 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00a940 tx=0x7efd4c008040 comp rx=0 tx=0).stop 2024-09-19T10:03:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.740+0000 7efd635b7740 1 -- 172.21.15.18:0/3673825442 shutdown_connections 2024-09-19T10:03:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.740+0000 7efd635b7740 1 --2- 172.21.15.18:0/3673825442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222d9850 0x5603222c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.740+0000 7efd635b7740 1 --2- 172.21.15.18:0/3673825442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222cef90 0x5603222d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.740+0000 7efd635b7740 1 --2- 172.21.15.18:0/3673825442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222ce670 0x5603222e5720 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.740+0000 7efd635b7740 1 -- 172.21.15.18:0/3673825442 >> 172.21.15.18:0/3673825442 conn(0x5603222cac00 msgr2=0x5603222c9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.740+0000 7efd635b7740 1 -- 172.21.15.18:0/3673825442 shutdown_connections 2024-09-19T10:03:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.741+0000 7efd635b7740 1 -- 172.21.15.18:0/3673825442 wait complete. 2024-09-19T10:03:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.741+0000 7efd635b7740 1 -- start start 2024-09-19T10:03:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.742+0000 7efd635b7740 1 Processor -- start 2024-09-19T10:03:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.742+0000 7efd635b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222dd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.742+0000 7efd635b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222d9850 0x5603222ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.742+0000 7efd635b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222de2b0 0x5603223532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.742+0000 7efd635b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1bd550 con 0x5603222cef90 2024-09-19T10:03:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.742+0000 7efd635b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1bce80 con 0x5603222de2b0 2024-09-19T10:03:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.742+0000 7efd635b7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1ba170 con 0x5603222d9850 2024-09-19T10:03:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.742+0000 7efd635b7740 10 client.0 _ll_register_callbacks cb 0x7efd54003f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:45.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.753+0000 7efd5b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222de2b0 0x5603223532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.753+0000 7efd5a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222d9850 0x5603222ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.754+0000 7efd5ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222dd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.754+0000 7efd5ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222dd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52270/0 (socket says 172.21.15.18:52270) 2024-09-19T10:03:45.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.754+0000 7efd5ad9d640 1 -- 172.21.15.18:0/1869555922 learned_addr learned my addr 172.21.15.18:0/1869555922 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:45.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.757+0000 7efd5ad9d640 1 -- 172.21.15.18:0/1869555922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222d9850 msgr2=0x5603222ddd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:45.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.757+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222d9850 0x5603222ddd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.757+0000 7efd5ad9d640 1 -- 172.21.15.18:0/1869555922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222de2b0 msgr2=0x5603223532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:45.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.757+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222de2b0 0x5603223532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.757+0000 7efd5ad9d640 1 -- 172.21.15.18:0/1869555922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560322364960 con 0x5603222cef90 2024-09-19T10:03:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.760+0000 7efd5ad9d640 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222dd830 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0062b0 tx=0x7efd4c0062e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185727bfa289181f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.761+0000 7efd3eff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.762+0000 7efd3eff5640 1 -- 172.21.15.18:0/1869555922 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c005dd0 con 0x5603222cef90 2024-09-19T10:03:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.762+0000 7efd3eff5640 1 -- 172.21.15.18:0/1869555922 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7efd4c0169b0 con 0x5603222cef90 2024-09-19T10:03:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.762+0000 7efd635b7740 1 -- 172.21.15.18:0/1869555922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56032223bd60 con 0x5603222cef90 2024-09-19T10:03:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.763+0000 7efd3eff5640 1 -- 172.21.15.18:0/1869555922 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd4c016bb0 con 0x5603222cef90 2024-09-19T10:03:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.763+0000 7efd635b7740 10 client.18015 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.763+0000 7efd635b7740 1 -- 172.21.15.18:0/1869555922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560322365ca0 con 0x5603222cef90 2024-09-19T10:03:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.765+0000 7efd3eff5640 1 -- 172.21.15.18:0/1869555922 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56032223bd60 con 0x5603222cef90 2024-09-19T10:03:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.765+0000 7efd3eff5640 1 -- 172.21.15.18:0/1869555922 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd4c02d400 con 0x5603222cef90 2024-09-19T10:03:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.766+0000 7efd635b7740 10 client.18015 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.766+0000 7efd635b7740 10 client.18015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.766+0000 7efd635b7740 20 client.18015 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.766+0000 7efd635b7740 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x560322366210 0x560322368600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.766+0000 7efd635b7740 4 client.18015 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T10:03:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.766+0000 7efd635b7740 1 -- 172.21.15.18:0/1869555922 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5603221b8210 con 0x560322366210 2024-09-19T10:03:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.772+0000 7efd5a59c640 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x560322366210 0x560322368600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:45.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.786+0000 7efd5a59c640 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x560322366210 0x560322368600 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1314a5b514ec1d6 server_cookie=1258625507de400a in_seq=0 out_seq=0 2024-09-19T10:03:45.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.786+0000 7efd3eff5640 10 client.18015 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:45.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd3eff5640 1 -- 172.21.15.18:0/1869555922 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5603221b8210 con 0x560322366210 2024-09-19T10:03:45.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd3eff5640 10 client.18015 handle_command_reply: tid=0 2024-09-19T10:03:45.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd635b7740 1 client.18015 shutdown 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd635b7740 1 -- 172.21.15.18:0/1869555922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 msgr2=0x5603222dd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd635b7740 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222dd830 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0062b0 tx=0x7efd4c0062e0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd635b7740 1 -- 172.21.15.18:0/1869555922 shutdown_connections 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd635b7740 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x560322366210 0x560322368600 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd635b7740 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5603222de2b0 0x5603223532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd635b7740 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5603222d9850 0x5603222ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd635b7740 1 --2- 172.21.15.18:0/1869555922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603222cef90 0x5603222dd830 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.790+0000 7efd635b7740 1 -- 172.21.15.18:0/1869555922 >> 172.21.15.18:0/1869555922 conn(0x5603222cac00 msgr2=0x5603222d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.791+0000 7efd3eff5640 0 client.18015 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.791+0000 7efd635b7740 1 -- 172.21.15.18:0/1869555922 shutdown_connections 2024-09-19T10:03:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.791+0000 7efd635b7740 1 -- 172.21.15.18:0/1869555922 wait complete. 2024-09-19T10:03:45.801 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:03:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T10:03:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T10:03:45.801 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:03:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.795+0000 7efd635b7740 20 client.18015 trim_cache size 0 max 16384 2024-09-19T10:03:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.805+0000 7efd609dd640 1 -- 172.21.15.18:0/3921114292 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efd440a3400 msgr2=0x7efd440a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.805+0000 7efd609dd640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efd440a3400 0x7efd440a58c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efd50013610 tx=0x7efd50009110 comp rx=0 tx=0).stop 2024-09-19T10:03:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.805+0000 7efd609dd640 1 -- 172.21.15.18:0/3921114292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd5c1068d0 msgr2=0x7efd5c10a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.805+0000 7efd609dd640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd5c1068d0 0x7efd5c10a590 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efd54003ba0 tx=0x7efd54003bd0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.805+0000 7efd609dd640 1 -- 172.21.15.18:0/3921114292 shutdown_connections 2024-09-19T10:03:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.805+0000 7efd609dd640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7efd440a3400 0x7efd440a58c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.805+0000 7efd609dd640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd5c1068d0 0x7efd5c10a590 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.805+0000 7efd609dd640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c101270 0x7efd5c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.805+0000 7efd609dd640 1 --2- 172.21.15.18:0/3921114292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd5c1008d0 0x7efd5c109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.805+0000 7efd609dd640 1 -- 172.21.15.18:0/3921114292 >> 172.21.15.18:0/3921114292 conn(0x7efd5c0fc610 msgr2=0x7efd5c0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.806+0000 7efd609dd640 1 -- 172.21.15.18:0/3921114292 shutdown_connections 2024-09-19T10:03:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:45.806+0000 7efd609dd640 1 -- 172.21.15.18:0/3921114292 wait complete. 2024-09-19T10:03:46.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:46 smithi018 ceph-mon[30956]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 811 MiB/s wr, 2.50k op/s 2024-09-19T10:03:46.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:46 smithi049 ceph-mon[34858]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 811 MiB/s wr, 2.50k op/s 2024-09-19T10:03:46.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:46 smithi162 ceph-mon[35174]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 811 MiB/s wr, 2.50k op/s 2024-09-19T10:03:47.269 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T10:03:47.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:03:48.329 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:48.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:48 smithi018 ceph-mon[30956]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 820 MiB/s wr, 2.17k op/s 2024-09-19T10:03:48.652 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:48 smithi049 ceph-mon[34858]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 820 MiB/s wr, 2.17k op/s 2024-09-19T10:03:48.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:48 smithi162 ceph-mon[35174]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 820 MiB/s wr, 2.17k op/s 2024-09-19T10:03:49.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.157+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/995406063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfbc1091f0 msgr2=0x7fdfbc1095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:49.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.157+0000 7fdfc3bf2640 1 --2- 172.21.15.18:0/995406063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfbc1091f0 0x7fdfbc1095d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009ca0 tx=0x7fdfb402a980 comp rx=0 tx=0).stop 2024-09-19T10:03:49.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.158+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/995406063 shutdown_connections 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.158+0000 7fdfc3bf2640 1 --2- 172.21.15.18:0/995406063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfbc114ab0 0x7fdfbc116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.158+0000 7fdfc3bf2640 1 --2- 172.21.15.18:0/995406063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfbc109b10 0x7fdfbc114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.158+0000 7fdfc3bf2640 1 --2- 172.21.15.18:0/995406063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfbc1091f0 0x7fdfbc1095d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.158+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/995406063 >> 172.21.15.18:0/995406063 conn(0x7fdfbc06e140 msgr2=0x7fdfbc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.161+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/995406063 shutdown_connections 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.161+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/995406063 wait complete. 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.162+0000 7fdfc3bf2640 1 Processor -- start 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.162+0000 7fdfc3bf2640 1 -- start start 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.162+0000 7fdfc3bf2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfbc1091f0 0x7fdfbc111640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.162+0000 7fdfc3bf2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfbc109b10 0x7fdfbc111b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.162+0000 7fdfc3bf2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfbc114ab0 0x7fdfbc1120c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.162+0000 7fdfc3bf2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc10bf00 con 0x7fdfbc109b10 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc3bf2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc10bd80 con 0x7fdfbc1091f0 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc3bf2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc10c080 con 0x7fdfbc114ab0 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc198e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfbc1091f0 0x7fdfbc111640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc198e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfbc1091f0 0x7fdfbc111640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:51340/0 (socket says 172.21.15.18:51340) 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc118d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfbc109b10 0x7fdfbc111b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc198e640 1 -- 172.21.15.18:0/938007756 learned_addr learned my addr 172.21.15.18:0/938007756 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc198e640 1 -- 172.21.15.18:0/938007756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfbc114ab0 msgr2=0x7fdfbc1120c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc198e640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfbc114ab0 0x7fdfbc1120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc198e640 1 -- 172.21.15.18:0/938007756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfbc109b10 msgr2=0x7fdfbc111b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc198e640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfbc109b10 0x7fdfbc111b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.163+0000 7fdfc198e640 1 -- 172.21.15.18:0/938007756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc11d070 con 0x7fdfbc1091f0 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.164+0000 7fdfc198e640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfbc1091f0 0x7fdfbc111640 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4030c20 tx=0x7fdfb4030c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.164+0000 7fdfb2ffd640 1 -- 172.21.15.18:0/938007756 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4034050 con 0x7fdfbc1091f0 2024-09-19T10:03:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.164+0000 7fdfb2ffd640 1 -- 172.21.15.18:0/938007756 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfb402f7e0 con 0x7fdfbc1091f0 2024-09-19T10:03:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.164+0000 7fdfb2ffd640 1 -- 172.21.15.18:0/938007756 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb402e7f0 con 0x7fdfbc1091f0 2024-09-19T10:03:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.164+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/938007756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc11d300 con 0x7fdfbc1091f0 2024-09-19T10:03:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.164+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/938007756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc11d790 con 0x7fdfbc1091f0 2024-09-19T10:03:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.168+0000 7fdfb2ffd640 1 -- 172.21.15.18:0/938007756 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdfb4037020 con 0x7fdfbc1091f0 2024-09-19T10:03:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.169+0000 7fdfb2ffd640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdfa80a3300 0x7fdfa80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.169+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/938007756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfbc073a40 con 0x7fdfbc1091f0 2024-09-19T10:03:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.169+0000 7fdfb2ffd640 1 -- 172.21.15.18:0/938007756 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdfb40f0670 con 0x7fdfbc1091f0 2024-09-19T10:03:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.169+0000 7fdfc118d640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdfa80a3300 0x7fdfa80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.170+0000 7fdfc118d640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdfa80a3300 0x7fdfa80a57c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc112e00 tx=0x7fdfac009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:49.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.175+0000 7fdfb2ffd640 1 -- 172.21.15.18:0/938007756 <== mon.2 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdfb40bd3c0 con 0x7fdfbc1091f0 2024-09-19T10:03:49.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.789+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/938007756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfbc112b70 con 0x7fdfbc1091f0 2024-09-19T10:03:49.796 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:49 smithi018 ceph-mon[30956]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 816 MiB/s wr, 2.02k op/s 2024-09-19T10:03:49.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.792+0000 7fdfb2ffd640 1 -- 172.21.15.18:0/938007756 <== mon.2 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fdfb40bccc0 con 0x7fdfbc1091f0 2024-09-19T10:03:49.796 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:03:49.799 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:03:49.799 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:03:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.800+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/938007756 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdfa80a3300 msgr2=0x7fdfa80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.800+0000 7fdfc3bf2640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdfa80a3300 0x7fdfa80a57c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc112e00 tx=0x7fdfac009110 comp rx=0 tx=0).stop 2024-09-19T10:03:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.800+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/938007756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfbc1091f0 msgr2=0x7fdfbc111640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.800+0000 7fdfc3bf2640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfbc1091f0 0x7fdfbc111640 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4030c20 tx=0x7fdfb4030c50 comp rx=0 tx=0).stop 2024-09-19T10:03:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.800+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/938007756 shutdown_connections 2024-09-19T10:03:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.800+0000 7fdfc3bf2640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fdfa80a3300 0x7fdfa80a57c0 secure :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc112e00 tx=0x7fdfac009110 comp rx=0 tx=0).stop 2024-09-19T10:03:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.800+0000 7fdfc3bf2640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdfbc114ab0 0x7fdfbc1120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.800+0000 7fdfc3bf2640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfbc109b10 0x7fdfbc111b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.800+0000 7fdfc3bf2640 1 --2- 172.21.15.18:0/938007756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfbc1091f0 0x7fdfbc111640 secure :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4030c20 tx=0x7fdfb4030c50 comp rx=0 tx=0).stop 2024-09-19T10:03:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.800+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/938007756 >> 172.21.15.18:0/938007756 conn(0x7fdfbc06e140 msgr2=0x7fdfbc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:49.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.801+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/938007756 shutdown_connections 2024-09-19T10:03:49.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:49.803+0000 7fdfc3bf2640 1 -- 172.21.15.18:0/938007756 wait complete. 2024-09-19T10:03:49.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:49 smithi049 ceph-mon[34858]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 816 MiB/s wr, 2.02k op/s 2024-09-19T10:03:49.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:49 smithi162 ceph-mon[35174]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 816 MiB/s wr, 2.02k op/s 2024-09-19T10:03:50.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:50 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/938007756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:03:50.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:50 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/938007756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:03:50.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:50 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/938007756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:03:51.136 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:03:50 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0[44812]: 2024-09-19T10:03:50.715+0000 7f7e30926640 -1 bdev(0x5637adf90c00 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 6 2024-09-19T10:03:51.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T10:03:51.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:51 smithi018 ceph-mon[30956]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 902 MiB/s wr, 2.11k op/s 2024-09-19T10:03:51.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:51 smithi049 ceph-mon[34858]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 902 MiB/s wr, 2.11k op/s 2024-09-19T10:03:51.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:51 smithi162 ceph-mon[35174]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 902 MiB/s wr, 2.11k op/s 2024-09-19T10:03:52.357 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:53.093 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:52 smithi018 ceph-mon[30956]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 812 MiB/s wr, 1.81k op/s 2024-09-19T10:03:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.104+0000 7f9187042640 1 -- 172.21.15.18:0/3496672285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9180073980 msgr2=0x7f918007a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.104+0000 7f917f7fe640 1 -- 172.21.15.18:0/3496672285 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174039070 con 0x7f9180073980 2024-09-19T10:03:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.104+0000 7f9187042640 1 --2- 172.21.15.18:0/3496672285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9180073980 0x7f918007a450 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f917400b9f0 tx=0x7f917402c0a0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.105+0000 7f9187042640 1 -- 172.21.15.18:0/3496672285 shutdown_connections 2024-09-19T10:03:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.105+0000 7f9187042640 1 --2- 172.21.15.18:0/3496672285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9180073980 0x7f918007a450 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.105+0000 7f9187042640 1 --2- 172.21.15.18:0/3496672285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9180072fc0 0x7f9180073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.105+0000 7f9187042640 1 --2- 172.21.15.18:0/3496672285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91801096e0 0x7f9180109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.105+0000 7f9187042640 1 -- 172.21.15.18:0/3496672285 >> 172.21.15.18:0/3496672285 conn(0x7f918006ece0 msgr2=0x7f9180071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.105+0000 7f9187042640 1 -- 172.21.15.18:0/3496672285 shutdown_connections 2024-09-19T10:03:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.105+0000 7f9187042640 1 -- 172.21.15.18:0/3496672285 wait complete. 2024-09-19T10:03:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.106+0000 7f9187042640 1 Processor -- start 2024-09-19T10:03:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.106+0000 7f9187042640 1 -- start start 2024-09-19T10:03:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.106+0000 7f9187042640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9180072fc0 0x7f918007a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.106+0000 7f9187042640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9180073980 0x7f91800788c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.106+0000 7f9187042640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91801096e0 0x7f9180078e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.106+0000 7f9187042640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f918007cc90 con 0x7f9180072fc0 2024-09-19T10:03:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.106+0000 7f9187042640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f918007cb10 con 0x7f9180073980 2024-09-19T10:03:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.106+0000 7f9187042640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f918007ce10 con 0x7f91801096e0 2024-09-19T10:03:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.110+0000 7f91855df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91801096e0 0x7f9180078e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.110+0000 7f9184dde640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9180072fc0 0x7f918007a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.110+0000 7f9184dde640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9180072fc0 0x7f918007a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51398/0 (socket says 172.21.15.18:51398) 2024-09-19T10:03:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.110+0000 7f9184dde640 1 -- 172.21.15.18:0/1191225561 learned_addr learned my addr 172.21.15.18:0/1191225561 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.110+0000 7f917ffff640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9180073980 0x7f91800788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.113+0000 7f917ffff640 1 -- 172.21.15.18:0/1191225561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91801096e0 msgr2=0x7f9180078e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.113+0000 7f917ffff640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91801096e0 0x7f9180078e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.113+0000 7f917ffff640 1 -- 172.21.15.18:0/1191225561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9180072fc0 msgr2=0x7f918007a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.113+0000 7f917ffff640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9180072fc0 0x7f918007a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.113+0000 7f917ffff640 1 -- 172.21.15.18:0/1191225561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9180079620 con 0x7f9180073980 2024-09-19T10:03:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.119+0000 7f917ffff640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9180073980 0x7f91800788c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f917800bd70 tx=0x7f917800be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.124+0000 7f917dffb640 1 -- 172.21.15.18:0/1191225561 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178019070 con 0x7f9180073980 2024-09-19T10:03:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.124+0000 7f917dffb640 1 -- 172.21.15.18:0/1191225561 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9178014920 con 0x7f9180073980 2024-09-19T10:03:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.124+0000 7f917dffb640 1 -- 172.21.15.18:0/1191225561 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178012940 con 0x7f9180073980 2024-09-19T10:03:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.125+0000 7f9187042640 1 -- 172.21.15.18:0/1191225561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91801325b0 con 0x7f9180073980 2024-09-19T10:03:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.125+0000 7f9187042640 1 -- 172.21.15.18:0/1191225561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9180132b00 con 0x7f9180073980 2024-09-19T10:03:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.129+0000 7f9189dd1740 1 Processor -- start 2024-09-19T10:03:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.130+0000 7f9189dd1740 1 -- start start 2024-09-19T10:03:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.130+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590df9a0 0x55b6590dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.130+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.130+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590e7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.130+0000 7f9189dd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b6590432f0 con 0x55b6590df9a0 2024-09-19T10:03:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.130+0000 7f9189dd1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b658feb270 con 0x55b6590e02e0 2024-09-19T10:03:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.130+0000 7f9189dd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b65903f2b0 con 0x55b6590e5370 2024-09-19T10:03:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.133+0000 7f91855df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590df9a0 0x55b6590dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.133+0000 7f91855df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590df9a0 0x55b6590dfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51408/0 (socket says 172.21.15.18:51408) 2024-09-19T10:03:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.133+0000 7f91855df640 1 -- 172.21.15.18:0/1509415435 learned_addr learned my addr 172.21.15.18:0/1509415435 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.134+0000 7f9184dde640 1 --2- 172.21.15.18:0/1509415435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.134+0000 7f917ffff640 1 --2- 172.21.15.18:0/1509415435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590e7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.135+0000 7f91855df640 1 -- 172.21.15.18:0/1509415435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 msgr2=0x55b6590e7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.135+0000 7f91855df640 1 --2- 172.21.15.18:0/1509415435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590e7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.135+0000 7f91855df640 1 -- 172.21.15.18:0/1509415435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 msgr2=0x55b6590e4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.135+0000 7f91855df640 1 --2- 172.21.15.18:0/1509415435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.135+0000 7f91855df640 1 -- 172.21.15.18:0/1509415435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b658fea340 con 0x55b6590df9a0 2024-09-19T10:03:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.140+0000 7f917dffb640 1 -- 172.21.15.18:0/1191225561 <== mon.2 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9178014ad0 con 0x7f9180073980 2024-09-19T10:03:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.142+0000 7f917dffb640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91680a3520 0x7f91680a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.142+0000 7f917dffb640 1 -- 172.21.15.18:0/1191225561 <== mon.2 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f91780cf510 con 0x7f9180073980 2024-09-19T10:03:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.144+0000 7f9184dde640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91680a3520 0x7f91680a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.147 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.144+0000 7f91855df640 1 --2- 172.21.15.18:0/1509415435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590df9a0 0x55b6590dfda0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f917400b9f0 tx=0x7f9174009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35ccb5dd4e7aef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.148+0000 7f9166ffd640 1 -- 172.21.15.18:0/1509415435 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174039030 con 0x55b6590df9a0 2024-09-19T10:03:53.150 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.148+0000 7f9166ffd640 1 -- 172.21.15.18:0/1509415435 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f917403a040 con 0x55b6590df9a0 2024-09-19T10:03:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.149+0000 7f9189dd1740 1 -- 172.21.15.18:0/1509415435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590df9a0 msgr2=0x55b6590dfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.149+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1509415435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590df9a0 0x55b6590dfda0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f917400b9f0 tx=0x7f9174009680 comp rx=0 tx=0).stop 2024-09-19T10:03:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.150+0000 7f9189dd1740 1 -- 172.21.15.18:0/1509415435 shutdown_connections 2024-09-19T10:03:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.150+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1509415435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590e7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.150+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1509415435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.150+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1509415435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590df9a0 0x55b6590dfda0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.150+0000 7f9189dd1740 1 -- 172.21.15.18:0/1509415435 >> 172.21.15.18:0/1509415435 conn(0x55b6590db010 msgr2=0x55b6590db410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.150+0000 7f9189dd1740 1 -- 172.21.15.18:0/1509415435 shutdown_connections 2024-09-19T10:03:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.150+0000 7f9189dd1740 1 -- 172.21.15.18:0/1509415435 wait complete. 2024-09-19T10:03:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.151+0000 7f9189dd1740 1 -- start start 2024-09-19T10:03:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.151+0000 7f9189dd1740 1 Processor -- start 2024-09-19T10:03:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.152+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.152+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590ea080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.152+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 0x55b6590f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.152+0000 7f9189dd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b6590e8330 con 0x55b6590ef0b0 2024-09-19T10:03:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.152+0000 7f9189dd1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b658fcc290 con 0x55b6590e02e0 2024-09-19T10:03:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.152+0000 7f9189dd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b6590e84b0 con 0x55b6590e5370 2024-09-19T10:03:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.152+0000 7f9189dd1740 10 client.0 _ll_register_callbacks cb 0x55b658ffd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.154+0000 7f9184dde640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.154+0000 7f9184dde640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:51372/0 (socket says 172.21.15.18:51372) 2024-09-19T10:03:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.154+0000 7f9184dde640 1 -- 172.21.15.18:0/1621890035 learned_addr learned my addr 172.21.15.18:0/1621890035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.154+0000 7f91855df640 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 0x55b6590f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.158 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.155+0000 7f9184dde640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91680a3520 0x7f91680a59e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x55b6590e0d10 tx=0x7f917000a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.155+0000 7f9184dde640 1 -- 172.21.15.18:0/1621890035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 msgr2=0x55b6590ea080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.155+0000 7f9184dde640 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590ea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.155+0000 7f9184dde640 1 -- 172.21.15.18:0/1621890035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 msgr2=0x55b6590f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.155+0000 7f9184dde640 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 0x55b6590f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.155+0000 7f9184dde640 1 -- 172.21.15.18:0/1621890035 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b658d56210 con 0x55b6590e02e0 2024-09-19T10:03:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.156+0000 7f9184dde640 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e9b40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f91700169a0 tx=0x7f9170004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35c32973e8a111fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.157+0000 7f915ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:03:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.157+0000 7f915ffff640 1 -- 172.21.15.18:0/1621890035 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170016e60 con 0x55b6590e02e0 2024-09-19T10:03:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.157+0000 7f9189dd1740 1 -- 172.21.15.18:0/1621890035 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b659050a20 con 0x55b6590e02e0 2024-09-19T10:03:53.160 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.157+0000 7f915ffff640 1 -- 172.21.15.18:0/1621890035 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9170015d10 con 0x55b6590e02e0 2024-09-19T10:03:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.158+0000 7f915ffff640 1 -- 172.21.15.18:0/1621890035 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f917002e460 con 0x55b6590e02e0 2024-09-19T10:03:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.159+0000 7f9189dd1740 10 client.27464 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.159+0000 7f9189dd1740 1 -- 172.21.15.18:0/1621890035 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b658e22620 con 0x55b6590e02e0 2024-09-19T10:03:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.159+0000 7f915ffff640 1 -- 172.21.15.18:0/1621890035 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b659050a20 con 0x55b6590e02e0 2024-09-19T10:03:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.161+0000 7f915ffff640 1 -- 172.21.15.18:0/1621890035 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9170022820 con 0x55b6590e02e0 2024-09-19T10:03:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.161+0000 7f9189dd1740 10 client.27464 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.161+0000 7f9189dd1740 10 client.27464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.161+0000 7f9189dd1740 20 client.27464 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.161+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6590f6130 0x55b6590f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.161+0000 7f9189dd1740 4 client.27464 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.161+0000 7f9189dd1740 1 -- 172.21.15.18:0/1621890035 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b65904ad70 con 0x55b6590f6130 2024-09-19T10:03:53.165 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.163+0000 7f917ffff640 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6590f6130 0x55b6590f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.166+0000 7f917ffff640 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6590f6130 0x55b6590f85f0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd39361c993d9cbc server_cookie=57f7e9594a13a134 in_seq=0 out_seq=0 2024-09-19T10:03:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.166+0000 7f915ffff640 10 client.27464 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:53.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.175+0000 7f915ffff640 1 -- 172.21.15.18:0/1621890035 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b65904ad70 con 0x55b6590f6130 2024-09-19T10:03:53.178 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.175+0000 7f915ffff640 10 client.27464 handle_command_reply: tid=0 2024-09-19T10:03:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.176+0000 7f9189dd1740 1 client.27464 shutdown 2024-09-19T10:03:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.177+0000 7f9189dd1740 1 -- 172.21.15.18:0/1621890035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 msgr2=0x55b6590e9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.177+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e9b40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f91700169a0 tx=0x7f9170004730 comp rx=0 tx=0).stop 2024-09-19T10:03:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.177+0000 7f9189dd1740 1 -- 172.21.15.18:0/1621890035 shutdown_connections 2024-09-19T10:03:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.177+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b6590f6130 0x55b6590f85f0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.177+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 0x55b6590f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.177+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590ea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.177+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1621890035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e9b40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.177+0000 7f9189dd1740 1 -- 172.21.15.18:0/1621890035 >> 172.21.15.18:0/1621890035 conn(0x55b6590db010 msgr2=0x55b6590dc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.177+0000 7f915ffff640 0 client.27464 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.177+0000 7f9189dd1740 1 -- 172.21.15.18:0/1621890035 shutdown_connections 2024-09-19T10:03:53.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.178+0000 7f9189dd1740 1 -- 172.21.15.18:0/1621890035 wait complete. 2024-09-19T10:03:53.181 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.178+0000 7f9189dd1740 20 client.27464 trim_cache size 0 max 16384 2024-09-19T10:03:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.216+0000 7f9189dd1740 1 Processor -- start 2024-09-19T10:03:53.220 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.217+0000 7f9189dd1740 1 -- start start 2024-09-19T10:03:53.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.218+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.218+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590e9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.222 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.218+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 0x55b6590db3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.218+0000 7f9184dde640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.218+0000 7f9184dde640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:51374/0 (socket says 172.21.15.18:51374) 2024-09-19T10:03:53.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.218+0000 7f9184dde640 1 -- 172.21.15.18:0/2356950543 learned_addr learned my addr 172.21.15.18:0/2356950543 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:53.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.218+0000 7f9189dd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f91801d1290 con 0x55b6590ef0b0 2024-09-19T10:03:53.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.218+0000 7f917ffff640 1 --2- 172.21.15.18:0/2356950543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590e9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.223 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.219+0000 7f9189dd1740 1 -- 172.21.15.18:0/2356950543 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91801d2dd0 con 0x55b6590e02e0 2024-09-19T10:03:53.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.219+0000 7f9189dd1740 1 -- 172.21.15.18:0/2356950543 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91801d1960 con 0x55b6590e5370 2024-09-19T10:03:53.224 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.219+0000 7f91855df640 1 --2- 172.21.15.18:0/2356950543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 0x55b6590db3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.220+0000 7f91855df640 1 -- 172.21.15.18:0/2356950543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 msgr2=0x55b6590e9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.220+0000 7f91855df640 1 --2- 172.21.15.18:0/2356950543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590e9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.220+0000 7f91855df640 1 -- 172.21.15.18:0/2356950543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 msgr2=0x55b6590e98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.228 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.220+0000 7f91855df640 1 --2- 172.21.15.18:0/2356950543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.220+0000 7f91855df640 1 -- 172.21.15.18:0/2356950543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6590f8960 con 0x55b6590ef0b0 2024-09-19T10:03:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.221+0000 7f91855df640 1 --2- 172.21.15.18:0/2356950543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 0x55b6590db3f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f917402e010 tx=0x7f9174005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6f9bdccb08f8ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.221+0000 7f91667fc640 1 -- 172.21.15.18:0/2356950543 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917404a070 con 0x55b6590ef0b0 2024-09-19T10:03:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.222+0000 7f91667fc640 1 -- 172.21.15.18:0/2356950543 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9174005850 con 0x55b6590ef0b0 2024-09-19T10:03:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.222+0000 7f91667fc640 1 -- 172.21.15.18:0/2356950543 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174039040 con 0x55b6590ef0b0 2024-09-19T10:03:53.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.223+0000 7f9189dd1740 1 -- 172.21.15.18:0/2356950543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 msgr2=0x55b6590db3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.223+0000 7f9189dd1740 1 --2- 172.21.15.18:0/2356950543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 0x55b6590db3f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f917402e010 tx=0x7f9174005780 comp rx=0 tx=0).stop 2024-09-19T10:03:53.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.224+0000 7f9189dd1740 1 -- 172.21.15.18:0/2356950543 shutdown_connections 2024-09-19T10:03:53.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.224+0000 7f9189dd1740 1 --2- 172.21.15.18:0/2356950543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590ef0b0 0x55b6590db3f0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.230 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.224+0000 7f9189dd1740 1 --2- 172.21.15.18:0/2356950543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6590e9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.224+0000 7f9189dd1740 1 --2- 172.21.15.18:0/2356950543 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590e02e0 0x55b6590e98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.224+0000 7f9189dd1740 1 -- 172.21.15.18:0/2356950543 >> 172.21.15.18:0/2356950543 conn(0x55b6590db010 msgr2=0x55b6590e1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.224+0000 7f9189dd1740 1 -- 172.21.15.18:0/2356950543 shutdown_connections 2024-09-19T10:03:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.224+0000 7f9189dd1740 1 -- 172.21.15.18:0/2356950543 wait complete. 2024-09-19T10:03:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.225+0000 7f9189dd1740 1 -- start start 2024-09-19T10:03:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.225+0000 7f9189dd1740 1 Processor -- start 2024-09-19T10:03:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.226+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590e02e0 0x55b659105260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.226+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6591057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.227+0000 7f9189dd1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590ef0b0 0x55b65915ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.227+0000 7f9189dd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f91801d2700 con 0x55b6590e02e0 2024-09-19T10:03:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.227+0000 7f9189dd1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91801d2030 con 0x55b6590ef0b0 2024-09-19T10:03:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.227+0000 7f9189dd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91801cf320 con 0x55b6590e5370 2024-09-19T10:03:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.227+0000 7f9189dd1740 10 client.0 _ll_register_callbacks cb 0x7f917001b040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.227+0000 7f917ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6591057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.227+0000 7f917ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6591057a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42756/0 (socket says 172.21.15.18:42756) 2024-09-19T10:03:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.227+0000 7f917ffff640 1 -- 172.21.15.18:0/1949145468 learned_addr learned my addr 172.21.15.18:0/1949145468 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.227+0000 7f91855df640 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590ef0b0 0x55b65915ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.228+0000 7f9184dde640 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590e02e0 0x55b659105260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.229+0000 7f917ffff640 1 -- 172.21.15.18:0/1949145468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590ef0b0 msgr2=0x55b65915ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.229+0000 7f917ffff640 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590ef0b0 0x55b65915ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.229+0000 7f917ffff640 1 -- 172.21.15.18:0/1949145468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590e02e0 msgr2=0x55b659105260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.229+0000 7f917ffff640 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590e02e0 0x55b659105260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.229+0000 7f917ffff640 1 -- 172.21.15.18:0/1949145468 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b65910a680 con 0x55b6590e5370 2024-09-19T10:03:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.231+0000 7f917ffff640 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6591057a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f917809bd70 tx=0x7f9178004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a51e280229334d23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.231+0000 7f915ffff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.232+0000 7f915ffff640 1 -- 172.21.15.18:0/1949145468 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91780b9060 con 0x55b6590e5370 2024-09-19T10:03:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.233+0000 7f915ffff640 1 -- 172.21.15.18:0/1949145468 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f917809c010 con 0x55b6590e5370 2024-09-19T10:03:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.233+0000 7f9189dd1740 1 -- 172.21.15.18:0/1949145468 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9174005850 con 0x55b6590e5370 2024-09-19T10:03:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.234+0000 7f915ffff640 1 -- 172.21.15.18:0/1949145468 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91780cd1b0 con 0x55b6590e5370 2024-09-19T10:03:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.234+0000 7f9189dd1740 10 client.27508 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.234+0000 7f9189dd1740 1 -- 172.21.15.18:0/1949145468 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b659160240 con 0x55b6590e5370 2024-09-19T10:03:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.235+0000 7f915ffff640 1 -- 172.21.15.18:0/1949145468 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91780a42e0 con 0x55b6590e5370 2024-09-19T10:03:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.236+0000 7f915ffff640 1 -- 172.21.15.18:0/1949145468 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f917809b000 con 0x55b6590e5370 2024-09-19T10:03:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.236+0000 7f9189dd1740 10 client.27508 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.236+0000 7f9189dd1740 10 client.27508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:03:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.236+0000 7f9189dd1740 20 client.27508 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.236+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b659160af0 0x55b659162ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.236+0000 7f9189dd1740 4 client.27508 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:03:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.236+0000 7f9189dd1740 1 -- 172.21.15.18:0/1949145468 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f9174005850 con 0x55b659160af0 2024-09-19T10:03:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.238+0000 7f9184dde640 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b659160af0 0x55b659162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.240+0000 7f9184dde640 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b659160af0 0x55b659162ee0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962a48f50b90db65 server_cookie=44cef2cc4a11e025 in_seq=0 out_seq=0 2024-09-19T10:03:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:53.241+0000 7f915ffff640 10 client.27508 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:53.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:52 smithi049 ceph-mon[34858]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 812 MiB/s wr, 1.81k op/s 2024-09-19T10:03:53.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:52 smithi162 ceph-mon[35174]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 812 MiB/s wr, 1.81k op/s 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.663+0000 7f656fd1d640 1 -- 172.21.15.18:0/4075368081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f656811b140 msgr2=0x7f656811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.663+0000 7f656fd1d640 1 --2- 172.21.15.18:0/4075368081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f656811b140 0x7f656811d530 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6560009ca0 tx=0x7f656002a8e0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.664+0000 7f656fd1d640 1 -- 172.21.15.18:0/4075368081 shutdown_connections 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.664+0000 7f656fd1d640 1 --2- 172.21.15.18:0/4075368081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f656811b140 0x7f656811d530 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.664+0000 7f656fd1d640 1 --2- 172.21.15.18:0/4075368081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6568109830 0x7f6568109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.664+0000 7f656fd1d640 1 --2- 172.21.15.18:0/4075368081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6568109450 0x7f6568110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.664+0000 7f656fd1d640 1 -- 172.21.15.18:0/4075368081 >> 172.21.15.18:0/4075368081 conn(0x7f656806e140 msgr2=0x7f656806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.665+0000 7f656fd1d640 1 -- 172.21.15.18:0/4075368081 shutdown_connections 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.665+0000 7f656fd1d640 1 -- 172.21.15.18:0/4075368081 wait complete. 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.666+0000 7f656fd1d640 1 Processor -- start 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.666+0000 7f656fd1d640 1 -- start start 2024-09-19T10:03:53.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.667+0000 7f656fd1d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6568109450 0x7f65681a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.667+0000 7f656fd1d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6568109830 0x7f65681a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.667+0000 7f656fd1d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f656811b140 0x7f65681abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.668+0000 7f656fd1d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6568120d50 con 0x7f6568109830 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.668+0000 7f656fd1d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6568120bd0 con 0x7f6568109450 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.668+0000 7f656fd1d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6568120ed0 con 0x7f656811b140 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.668+0000 7f656d2b8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6568109830 0x7f65681a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.668+0000 7f656d2b8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6568109830 0x7f65681a7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51474/0 (socket says 172.21.15.18:51474) 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.668+0000 7f656d2b8640 1 -- 172.21.15.18:0/1852240504 learned_addr learned my addr 172.21.15.18:0/1852240504 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.669+0000 7f656dab9640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6568109450 0x7f65681a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.670+0000 7f656d2b8640 1 -- 172.21.15.18:0/1852240504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f656811b140 msgr2=0x7f65681abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.670+0000 7f656d2b8640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f656811b140 0x7f65681abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.670+0000 7f656d2b8640 1 -- 172.21.15.18:0/1852240504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6568109450 msgr2=0x7f65681a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.670+0000 7f656d2b8640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6568109450 0x7f65681a7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.670+0000 7f656d2b8640 1 -- 172.21.15.18:0/1852240504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65681ac1e0 con 0x7f6568109830 2024-09-19T10:03:53.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.671+0000 7f656d2b8640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6568109830 0x7f65681a7770 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f656400d950 tx=0x7f656400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.672+0000 7f655effd640 1 -- 172.21.15.18:0/1852240504 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564017070 con 0x7f6568109830 2024-09-19T10:03:53.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.672+0000 7f655effd640 1 -- 172.21.15.18:0/1852240504 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6564009bb0 con 0x7f6568109830 2024-09-19T10:03:53.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.672+0000 7f655effd640 1 -- 172.21.15.18:0/1852240504 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656400f600 con 0x7f6568109830 2024-09-19T10:03:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.674+0000 7f656fd1d640 1 -- 172.21.15.18:0/1852240504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65681ac4d0 con 0x7f6568109830 2024-09-19T10:03:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.674+0000 7f656fd1d640 1 -- 172.21.15.18:0/1852240504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65681b3db0 con 0x7f6568109830 2024-09-19T10:03:53.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.680+0000 7f65720f6740 1 Processor -- start 2024-09-19T10:03:53.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.681+0000 7f65720f6740 1 -- start start 2024-09-19T10:03:53.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.682+0000 7f65720f6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.682+0000 7f65720f6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.682+0000 7f65720f6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820d3370 0x5650820d5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.682+0000 7f65720f6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56508202e2f0 con 0x5650820c85d0 2024-09-19T10:03:53.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.682+0000 7f65720f6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x565081fd5cf0 con 0x5650820d3370 2024-09-19T10:03:53.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.682+0000 7f656e2ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.683+0000 7f656e2ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42786/0 (socket says 172.21.15.18:42786) 2024-09-19T10:03:53.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.683+0000 7f656e2ba640 1 -- 172.21.15.18:0/2963254538 learned_addr learned my addr 172.21.15.18:0/2963254538 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:53.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.683+0000 7f65720f6740 1 -- 172.21.15.18:0/2963254538 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56508202a2b0 con 0x5650820c9b40 2024-09-19T10:03:53.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.684+0000 7f656e2ba640 1 -- 172.21.15.18:0/2963254538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820d3370 msgr2=0x5650820d5760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T10:03:53.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.684+0000 7f656e2ba640 1 --2- 172.21.15.18:0/2963254538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820d3370 0x5650820d5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.684+0000 7f656e2ba640 1 -- 172.21.15.18:0/2963254538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 msgr2=0x5650820c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.684+0000 7f656e2ba640 1 --2- 172.21.15.18:0/2963254538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.684+0000 7f656e2ba640 1 -- 172.21.15.18:0/2963254538 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565081fba3a0 con 0x5650820c9b40 2024-09-19T10:03:53.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.695+0000 7f656e2ba640 1 --2- 172.21.15.18:0/2963254538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820c8090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6560030770 tx=0x7f6560009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb9b0fa133f2018 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.695+0000 7f655effd640 1 -- 172.21.15.18:0/1852240504 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6564005020 con 0x7f6568109830 2024-09-19T10:03:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.696+0000 7f6553fff640 1 -- 172.21.15.18:0/2963254538 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560031670 con 0x5650820c9b40 2024-09-19T10:03:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.696+0000 7f6553fff640 1 -- 172.21.15.18:0/2963254538 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6560036040 con 0x5650820c9b40 2024-09-19T10:03:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.696+0000 7f6553fff640 1 -- 172.21.15.18:0/2963254538 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560030ae0 con 0x5650820c9b40 2024-09-19T10:03:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.697+0000 7f655effd640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f65540a3450 0x7f65540a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.698+0000 7f65720f6740 1 -- 172.21.15.18:0/2963254538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 msgr2=0x5650820c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.698+0000 7f65720f6740 1 --2- 172.21.15.18:0/2963254538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820c8090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6560030770 tx=0x7f6560009780 comp rx=0 tx=0).stop 2024-09-19T10:03:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.698+0000 7f65720f6740 1 -- 172.21.15.18:0/2963254538 shutdown_connections 2024-09-19T10:03:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.698+0000 7f65720f6740 1 --2- 172.21.15.18:0/2963254538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820d3370 0x5650820d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.698+0000 7f65720f6740 1 --2- 172.21.15.18:0/2963254538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.698+0000 7f65720f6740 1 --2- 172.21.15.18:0/2963254538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820c8090 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.698+0000 7f65720f6740 1 -- 172.21.15.18:0/2963254538 >> 172.21.15.18:0/2963254538 conn(0x565082091310 msgr2=0x5650820c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:53.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.699+0000 7f655effd640 1 -- 172.21.15.18:0/1852240504 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f65640cf4a0 con 0x7f6568109830 2024-09-19T10:03:53.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.700+0000 7f65720f6740 1 -- 172.21.15.18:0/2963254538 shutdown_connections 2024-09-19T10:03:53.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.700+0000 7f65720f6740 1 -- 172.21.15.18:0/2963254538 wait complete. 2024-09-19T10:03:53.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.701+0000 7f65720f6740 1 -- start start 2024-09-19T10:03:53.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.702+0000 7f65720f6740 1 Processor -- start 2024-09-19T10:03:53.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.703+0000 7f65720f6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.704+0000 7f65720f6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820c9b40 0x5650820d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.704+0000 7f65720f6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.704+0000 7f656dab9640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f65540a3450 0x7f65540a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.704+0000 7f65720f6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5650820d6010 con 0x5650820c85d0 2024-09-19T10:03:53.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.704+0000 7f65720f6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x565081fe9060 con 0x5650820c9b40 2024-09-19T10:03:53.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.704+0000 7f65720f6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5650820d6190 con 0x5650820d3370 2024-09-19T10:03:53.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.705+0000 7f65720f6740 10 client.0 _ll_register_callbacks cb 0x565081d3c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:53.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.705+0000 7f656dab9640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f65540a3450 0x7f65540a5910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5650820c5ac0 tx=0x7f6558009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.705+0000 7f656e2ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.705+0000 7f656e2ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42796/0 (socket says 172.21.15.18:42796) 2024-09-19T10:03:53.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.705+0000 7f656e2ba640 1 -- 172.21.15.18:0/1427149698 learned_addr learned my addr 172.21.15.18:0/1427149698 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:53.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.707+0000 7f656e2ba640 1 -- 172.21.15.18:0/1427149698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820c9b40 msgr2=0x5650820d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.707+0000 7f656e2ba640 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820c9b40 0x5650820d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.707+0000 7f656e2ba640 1 -- 172.21.15.18:0/1427149698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 msgr2=0x5650820d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.707+0000 7f656e2ba640 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.707+0000 7f656e2ba640 1 -- 172.21.15.18:0/1427149698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565081d9f3c0 con 0x5650820d3370 2024-09-19T10:03:53.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.708+0000 7f656e2ba640 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820d0c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6560004af0 tx=0x7f6560031bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff07043b4f35836e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.709+0000 7f65517fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:53.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.709+0000 7f65517fa640 1 -- 172.21.15.18:0/1427149698 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560053060 con 0x5650820d3370 2024-09-19T10:03:53.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.710+0000 7f65517fa640 1 -- 172.21.15.18:0/1427149698 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6560031d60 con 0x5650820d3370 2024-09-19T10:03:53.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.710+0000 7f65720f6740 1 -- 172.21.15.18:0/1427149698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6560036040 con 0x5650820d3370 2024-09-19T10:03:53.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.712+0000 7f65517fa640 1 -- 172.21.15.18:0/1427149698 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6560031770 con 0x5650820d3370 2024-09-19T10:03:53.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.713+0000 7f65720f6740 10 client.27517 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:53.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.713+0000 7f65720f6740 1 -- 172.21.15.18:0/1427149698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5650820d6010 con 0x5650820d3370 2024-09-19T10:03:53.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.715+0000 7f65517fa640 1 -- 172.21.15.18:0/1427149698 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6560036040 con 0x5650820d3370 2024-09-19T10:03:53.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.716+0000 7f65517fa640 1 -- 172.21.15.18:0/1427149698 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6560043a10 con 0x5650820d3370 2024-09-19T10:03:53.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.717+0000 7f65720f6740 10 client.27517 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.717+0000 7f65720f6740 10 client.27517 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T10:03:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.717+0000 7f65720f6740 20 client.27517 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.717+0000 7f65720f6740 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5650820e2d50 0x5650820e5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.718+0000 7f65720f6740 4 client.27517 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:53.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.718+0000 7f65720f6740 1 -- 172.21.15.18:0/1427149698 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56508203b860 con 0x5650820e2d50 2024-09-19T10:03:53.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.721+0000 7f656dab9640 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5650820e2d50 0x5650820e5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.743+0000 7f65517fa640 10 client.27517 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T10:03:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.743+0000 7f656dab9640 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5650820e2d50 0x5650820e5140 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bda9c3ccb2474fff server_cookie=abc2bee64dfd9ddb in_seq=0 out_seq=0 2024-09-19T10:03:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.744+0000 7f65517fa640 1 -- 172.21.15.18:0/1427149698 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f6558013b30 con 0x5650820e2d50 2024-09-19T10:03:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.745+0000 7f65517fa640 10 client.27517 handle_command_reply: tid=0 2024-09-19T10:03:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.745+0000 7f65720f6740 1 client.27517 shutdown 2024-09-19T10:03:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.745+0000 7f65720f6740 1 -- 172.21.15.18:0/1427149698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 msgr2=0x5650820d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.745+0000 7f65720f6740 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820d0c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6560004af0 tx=0x7f6560031bc0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.746+0000 7f65720f6740 1 -- 172.21.15.18:0/1427149698 shutdown_connections 2024-09-19T10:03:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.746+0000 7f65720f6740 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5650820e2d50 0x5650820e5140 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.746+0000 7f65720f6740 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820d0c10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.746+0000 7f65720f6740 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820c9b40 0x5650820d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.746+0000 7f65720f6740 1 --2- 172.21.15.18:0/1427149698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.746+0000 7f65720f6740 1 -- 172.21.15.18:0/1427149698 >> 172.21.15.18:0/1427149698 conn(0x565082091310 msgr2=0x5650820ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.747+0000 7f65517fa640 0 client.27517 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T10:03:53.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.747+0000 7f65720f6740 1 -- 172.21.15.18:0/1427149698 shutdown_connections 2024-09-19T10:03:53.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.747+0000 7f65720f6740 1 -- 172.21.15.18:0/1427149698 wait complete. 2024-09-19T10:03:53.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.748+0000 7f65720f6740 20 client.27517 trim_cache size 0 max 16384 2024-09-19T10:03:53.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.815+0000 7f65720f6740 1 Processor -- start 2024-09-19T10:03:53.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.815+0000 7f65720f6740 1 -- start start 2024-09-19T10:03:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.816+0000 7f65720f6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.816+0000 7f65720f6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820c9b40 0x5650820d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.816+0000 7f65720f6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.817+0000 7f65720f6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65681bc120 con 0x5650820c85d0 2024-09-19T10:03:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.817+0000 7f65720f6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f65681bdc60 con 0x5650820c9b40 2024-09-19T10:03:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.817+0000 7f65720f6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65681bc7f0 con 0x5650820d3370 2024-09-19T10:03:53.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.819+0000 7f656e2ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.819+0000 7f656d2b8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820c9b40 0x5650820d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.819+0000 7f656e2ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:42800/0 (socket says 172.21.15.18:42800) 2024-09-19T10:03:53.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.819+0000 7f656e2ba640 1 -- 172.21.15.18:0/4008543928 learned_addr learned my addr 172.21.15.18:0/4008543928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:53.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.820+0000 7f656e2ba640 1 -- 172.21.15.18:0/4008543928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820c9b40 msgr2=0x5650820d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.820+0000 7f656e2ba640 1 --2- 172.21.15.18:0/4008543928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820c9b40 0x5650820d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.820+0000 7f656e2ba640 1 -- 172.21.15.18:0/4008543928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 msgr2=0x5650820cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.820+0000 7f656e2ba640 1 --2- 172.21.15.18:0/4008543928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.820+0000 7f656e2ba640 1 -- 172.21.15.18:0/4008543928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650820d1510 con 0x5650820d3370 2024-09-19T10:03:53.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.823+0000 7f656e2ba640 1 --2- 172.21.15.18:0/4008543928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820cb1d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6560031930 tx=0x7f6560000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a477ddec6138a01c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.824+0000 7f65537fe640 1 -- 172.21.15.18:0/4008543928 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656005e070 con 0x5650820d3370 2024-09-19T10:03:53.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.824+0000 7f65537fe640 1 -- 172.21.15.18:0/4008543928 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f656003bd20 con 0x5650820d3370 2024-09-19T10:03:53.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.824+0000 7f65537fe640 1 -- 172.21.15.18:0/4008543928 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6560053070 con 0x5650820d3370 2024-09-19T10:03:53.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.826+0000 7f65720f6740 1 -- 172.21.15.18:0/4008543928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 msgr2=0x5650820cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.827+0000 7f65720f6740 1 --2- 172.21.15.18:0/4008543928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820cb1d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6560031930 tx=0x7f6560000f40 comp rx=0 tx=0).stop 2024-09-19T10:03:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.829+0000 7f65720f6740 1 -- 172.21.15.18:0/4008543928 shutdown_connections 2024-09-19T10:03:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.829+0000 7f65720f6740 1 --2- 172.21.15.18:0/4008543928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820d3370 0x5650820cb1d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.829+0000 7f65720f6740 1 --2- 172.21.15.18:0/4008543928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820c9b40 0x5650820d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.829+0000 7f65720f6740 1 --2- 172.21.15.18:0/4008543928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.829+0000 7f65720f6740 1 -- 172.21.15.18:0/4008543928 >> 172.21.15.18:0/4008543928 conn(0x565082091310 msgr2=0x5650820d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.833+0000 7f65720f6740 1 -- 172.21.15.18:0/4008543928 shutdown_connections 2024-09-19T10:03:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.833+0000 7f65720f6740 1 -- 172.21.15.18:0/4008543928 wait complete. 2024-09-19T10:03:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.834+0000 7f65720f6740 1 -- start start 2024-09-19T10:03:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.835+0000 7f65720f6740 1 Processor -- start 2024-09-19T10:03:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.836+0000 7f65720f6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820d3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.837+0000 7f65720f6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820d4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.837+0000 7f65720f6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820da420 0x5650820da8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.837+0000 7f65720f6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65681bd590 con 0x5650820c85d0 2024-09-19T10:03:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.837+0000 7f65720f6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f65681bcec0 con 0x5650820da420 2024-09-19T10:03:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.837+0000 7f65720f6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65681ba1b0 con 0x5650820c9b40 2024-09-19T10:03:53.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.837+0000 7f65720f6740 10 client.0 _ll_register_callbacks cb 0x7f6558005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:53.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.839+0000 7f656e2ba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820da420 0x5650820da8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.839+0000 7f656e2ba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820da420 0x5650820da8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:51450/0 (socket says 172.21.15.18:51450) 2024-09-19T10:03:53.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.839+0000 7f656e2ba640 1 -- 172.21.15.18:0/439249521 learned_addr learned my addr 172.21.15.18:0/439249521 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:53.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.839+0000 7f656d2b8640 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820d4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.843+0000 7f656d2b8640 1 -- 172.21.15.18:0/439249521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820da420 msgr2=0x5650820da8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.843+0000 7f656d2b8640 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820da420 0x5650820da8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.843+0000 7f656d2b8640 1 -- 172.21.15.18:0/439249521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 msgr2=0x5650820d3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.842+0000 7f656dab9640 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820d3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.843+0000 7f656d2b8640 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820d3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.843+0000 7f656d2b8640 1 -- 172.21.15.18:0/439249521 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650820dade0 con 0x5650820c9b40 2024-09-19T10:03:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.844+0000 7f656dab9640 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820d3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:03:53.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.846+0000 7f656d2b8640 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820d4070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x5650820c9070 tx=0x7f656409c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16960a74ceb93da4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:53.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.846+0000 7f65517fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.847+0000 7f65517fa640 1 -- 172.21.15.18:0/439249521 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65640b9060 con 0x5650820c9b40 2024-09-19T10:03:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.847+0000 7f65517fa640 1 -- 172.21.15.18:0/439249521 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6564098180 con 0x5650820c9b40 2024-09-19T10:03:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.847+0000 7f65720f6740 1 -- 172.21.15.18:0/439249521 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f656003bd20 con 0x5650820c9b40 2024-09-19T10:03:53.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.850+0000 7f65517fa640 1 -- 172.21.15.18:0/439249521 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65640b3030 con 0x5650820c9b40 2024-09-19T10:03:53.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.850+0000 7f65720f6740 10 client.27523 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:53.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.850+0000 7f65720f6740 1 -- 172.21.15.18:0/439249521 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56508214d740 con 0x5650820c9b40 2024-09-19T10:03:53.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.851+0000 7f65517fa640 1 -- 172.21.15.18:0/439249521 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f656003bd20 con 0x5650820c9b40 2024-09-19T10:03:53.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.851+0000 7f65517fa640 1 -- 172.21.15.18:0/439249521 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6564023060 con 0x5650820c9b40 2024-09-19T10:03:53.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.852+0000 7f65720f6740 10 client.27523 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:53.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.852+0000 7f65720f6740 10 client.27523 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T10:03:53.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.852+0000 7f65720f6740 20 client.27523 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:53.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.852+0000 7f65720f6740 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56508214dc10 0x565082150030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:53.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.853+0000 7f65720f6740 4 client.27523 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:03:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.853+0000 7f65720f6740 1 -- 172.21.15.18:0/439249521 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565082035d70 con 0x56508214dc10 2024-09-19T10:03:53.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.855+0000 7f656dab9640 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56508214dc10 0x565082150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.863+0000 7f656dab9640 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56508214dc10 0x565082150030 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=be2de3d4f4dcaad6 server_cookie=ab6793e30ca0a5a0 in_seq=0 out_seq=0 2024-09-19T10:03:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.863+0000 7f65517fa640 10 client.27523 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T10:03:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.867+0000 7f65517fa640 1 -- 172.21.15.18:0/439249521 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56508203b860 con 0x56508214dc10 2024-09-19T10:03:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.867+0000 7f65517fa640 10 client.27523 handle_command_reply: tid=0 2024-09-19T10:03:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.867+0000 7f65720f6740 1 client.27523 shutdown 2024-09-19T10:03:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.867+0000 7f65720f6740 1 -- 172.21.15.18:0/439249521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 msgr2=0x5650820d4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.867+0000 7f65720f6740 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820d4070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x5650820c9070 tx=0x7f656409c350 comp rx=0 tx=0).stop 2024-09-19T10:03:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.868+0000 7f65720f6740 1 -- 172.21.15.18:0/439249521 shutdown_connections 2024-09-19T10:03:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.868+0000 7f65720f6740 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x56508214dc10 0x565082150030 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.868+0000 7f65720f6740 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650820da420 0x5650820da8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.868+0000 7f65517fa640 0 client.27523 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T10:03:53.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.868+0000 7f65720f6740 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650820c9b40 0x5650820d4070 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.868+0000 7f65720f6740 1 --2- 172.21.15.18:0/439249521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5650820c85d0 0x5650820d3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.868+0000 7f65720f6740 1 -- 172.21.15.18:0/439249521 >> 172.21.15.18:0/439249521 conn(0x565082091310 msgr2=0x5650820c34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.870+0000 7f65720f6740 1 -- 172.21.15.18:0/439249521 shutdown_connections 2024-09-19T10:03:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.870+0000 7f65720f6740 1 -- 172.21.15.18:0/439249521 wait complete. 2024-09-19T10:03:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.870+0000 7f65720f6740 20 client.27523 trim_cache size 0 max 16384 2024-09-19T10:03:53.873 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:03:53.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.871+0000 7f656fd1d640 1 -- 172.21.15.18:0/1852240504 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f65540a3450 msgr2=0x7f65540a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.871+0000 7f656fd1d640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f65540a3450 0x7f65540a5910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5650820c5ac0 tx=0x7f6558009720 comp rx=0 tx=0).stop 2024-09-19T10:03:53.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.871+0000 7f656fd1d640 1 -- 172.21.15.18:0/1852240504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6568109830 msgr2=0x7f65681a7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:53.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.871+0000 7f656fd1d640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6568109830 0x7f65681a7770 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f656400d950 tx=0x7f656400de10 comp rx=0 tx=0).stop 2024-09-19T10:03:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.876+0000 7f656fd1d640 1 -- 172.21.15.18:0/1852240504 shutdown_connections 2024-09-19T10:03:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.876+0000 7f656fd1d640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f65540a3450 0x7f65540a5910 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.876+0000 7f656fd1d640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f656811b140 0x7f65681abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.876+0000 7f656fd1d640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6568109830 0x7f65681a7770 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.876+0000 7f656fd1d640 1 --2- 172.21.15.18:0/1852240504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6568109450 0x7f65681a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.876+0000 7f656fd1d640 1 -- 172.21.15.18:0/1852240504 >> 172.21.15.18:0/1852240504 conn(0x7f656806e140 msgr2=0x7f656811bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.876+0000 7f656fd1d640 1 -- 172.21.15.18:0/1852240504 shutdown_connections 2024-09-19T10:03:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:53.876+0000 7f656fd1d640 1 -- 172.21.15.18:0/1852240504 wait complete. 2024-09-19T10:03:55.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T10:03:56.144 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:56.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:55 smithi018 ceph-mon[30956]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 894 MiB/s wr, 1.87k op/s 2024-09-19T10:03:56.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:55 smithi049 ceph-mon[34858]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 894 MiB/s wr, 1.87k op/s 2024-09-19T10:03:56.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:55 smithi162 ceph-mon[35174]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 894 MiB/s wr, 1.87k op/s 2024-09-19T10:03:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.052+0000 7f4e7f291640 1 -- 172.21.15.18:0/2347712902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e78074eb0 msgr2=0x7f4e781124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.052+0000 7f4e7f291640 1 --2- 172.21.15.18:0/2347712902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e78074eb0 0x7f4e781124a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009900 tx=0x7f4e6802a4b0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.054+0000 7f4e7f291640 1 -- 172.21.15.18:0/2347712902 shutdown_connections 2024-09-19T10:03:57.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.054+0000 7f4e7f291640 1 --2- 172.21.15.18:0/2347712902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e781129e0 0x7f4e78114dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.054+0000 7f4e7f291640 1 --2- 172.21.15.18:0/2347712902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e78074eb0 0x7f4e781124a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.054+0000 7f4e7f291640 1 --2- 172.21.15.18:0/2347712902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e78074590 0x7f4e78074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.054+0000 7f4e7f291640 1 -- 172.21.15.18:0/2347712902 >> 172.21.15.18:0/2347712902 conn(0x7f4e780fd710 msgr2=0x7f4e780ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:57.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.054+0000 7f4e7f291640 1 -- 172.21.15.18:0/2347712902 shutdown_connections 2024-09-19T10:03:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.054+0000 7f4e7f291640 1 -- 172.21.15.18:0/2347712902 wait complete. 2024-09-19T10:03:57.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.056+0000 7f4e7f291640 1 Processor -- start 2024-09-19T10:03:57.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.056+0000 7f4e7f291640 1 -- start start 2024-09-19T10:03:57.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.056+0000 7f4e7f291640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e78074590 0x7f4e78111ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.056+0000 7f4e7f291640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e78074eb0 0x7f4e78112430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.056+0000 7f4e7f291640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e781129e0 0x7f4e7810b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.057+0000 7f4e7f291640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e781184f0 con 0x7f4e78074eb0 2024-09-19T10:03:57.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.058+0000 7f4e7f291640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4e78118370 con 0x7f4e781129e0 2024-09-19T10:03:57.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.058+0000 7f4e7f291640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e78118670 con 0x7f4e78074590 2024-09-19T10:03:57.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.059+0000 7f4e7e28f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e78074590 0x7f4e78111ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.059+0000 7f4e7ea90640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e781129e0 0x7f4e7810b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.059+0000 7f4e7e28f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e78074590 0x7f4e78111ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:32848/0 (socket says 172.21.15.18:32848) 2024-09-19T10:03:57.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.059+0000 7f4e7e28f640 1 -- 172.21.15.18:0/657293450 learned_addr learned my addr 172.21.15.18:0/657293450 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:57.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.059+0000 7f4e7da8e640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e78074eb0 0x7f4e78112430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.060+0000 7f4e7e28f640 1 -- 172.21.15.18:0/657293450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e781129e0 msgr2=0x7f4e7810b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:57.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.060+0000 7f4e7e28f640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e781129e0 0x7f4e7810b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.060+0000 7f4e7e28f640 1 -- 172.21.15.18:0/657293450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e78074eb0 msgr2=0x7f4e78112430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:57.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.060+0000 7f4e7e28f640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e78074eb0 0x7f4e78112430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.060+0000 7f4e7e28f640 1 -- 172.21.15.18:0/657293450 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7810ba20 con 0x7f4e78074590 2024-09-19T10:03:57.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.060+0000 7f4e7e28f640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e78074590 0x7f4e78111ef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400b4a0 tx=0x7f4e7400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:57.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.061+0000 7f4e6f7fe640 1 -- 172.21.15.18:0/657293450 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74014070 con 0x7f4e78074590 2024-09-19T10:03:57.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.061+0000 7f4e6f7fe640 1 -- 172.21.15.18:0/657293450 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e74010af0 con 0x7f4e78074590 2024-09-19T10:03:57.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.062+0000 7f4e6f7fe640 1 -- 172.21.15.18:0/657293450 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74017d10 con 0x7f4e78074590 2024-09-19T10:03:57.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.062+0000 7f4e7f291640 1 -- 172.21.15.18:0/657293450 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7810bd10 con 0x7f4e78074590 2024-09-19T10:03:57.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.062+0000 7f4e7f291640 1 -- 172.21.15.18:0/657293450 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7810fc50 con 0x7f4e78074590 2024-09-19T10:03:57.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.067+0000 7f4e828cc740 1 Processor -- start 2024-09-19T10:03:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.075+0000 7f4e828cc740 1 -- start start 2024-09-19T10:03:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.075+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2d20 0x55b3c48c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.075+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 0x55b3c48c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.076+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 0x55b3c48ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.076+0000 7f4e828cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b3c48272f0 con 0x55b3c48c2020 2024-09-19T10:03:57.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.076+0000 7f4e828cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b3c47cecf0 con 0x55b3c48c2d20 2024-09-19T10:03:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.076+0000 7f4e828cc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b3c48232b0 con 0x55b3c48c15c0 2024-09-19T10:03:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.076+0000 7f4e7ea90640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2d20 0x55b3c48c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.076+0000 7f4e7ea90640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2d20 0x55b3c48c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:39208/0 (socket says 172.21.15.18:39208) 2024-09-19T10:03:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.076+0000 7f4e7ea90640 1 -- 172.21.15.18:0/1385104009 learned_addr learned my addr 172.21.15.18:0/1385104009 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.077+0000 7f4e6f7fe640 1 -- 172.21.15.18:0/657293450 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4e74017070 con 0x7f4e78074590 2024-09-19T10:03:57.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.078+0000 7f4e7e28f640 1 --2- 172.21.15.18:0/1385104009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 0x55b3c48c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.078+0000 7f4e7ea90640 1 -- 172.21.15.18:0/1385104009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 msgr2=0x55b3c48c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:57.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.078+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/1385104009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 0x55b3c48c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.078+0000 7f4e7ea90640 1 -- 172.21.15.18:0/1385104009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 msgr2=0x55b3c48ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:57.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.078+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/1385104009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 0x55b3c48ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.078+0000 7f4e7ea90640 1 -- 172.21.15.18:0/1385104009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c47b33a0 con 0x55b3c48c2d20 2024-09-19T10:03:57.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.078+0000 7f4e7e28f640 1 --2- 172.21.15.18:0/1385104009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 0x55b3c48c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:03:57.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.079+0000 7f4e6f7fe640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4e640a3380 0x7f4e640a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.080+0000 7f4e6f7fe640 1 -- 172.21.15.18:0/657293450 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4e740cf040 con 0x7f4e78074590 2024-09-19T10:03:57.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.086+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/1385104009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2d20 0x55b3c48c3100 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009ef0 tx=0x7f4e7000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bee3cfe1c144bc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:57.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.086+0000 7f4e7e28f640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4e640a3380 0x7f4e640a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.088+0000 7f4e63fff640 1 -- 172.21.15.18:0/1385104009 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7001a070 con 0x55b3c48c2d20 2024-09-19T10:03:57.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.089+0000 7f4e63fff640 1 -- 172.21.15.18:0/1385104009 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e700158f0 con 0x55b3c48c2d20 2024-09-19T10:03:57.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.092+0000 7f4e828cc740 1 -- 172.21.15.18:0/1385104009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2d20 msgr2=0x55b3c48c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:57.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.092+0000 7f4e828cc740 1 --2- 172.21.15.18:0/1385104009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2d20 0x55b3c48c3100 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009ef0 tx=0x7f4e7000c7f0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.093+0000 7f4e828cc740 1 -- 172.21.15.18:0/1385104009 shutdown_connections 2024-09-19T10:03:57.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.093+0000 7f4e828cc740 1 --2- 172.21.15.18:0/1385104009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 0x55b3c48ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.093+0000 7f4e828cc740 1 --2- 172.21.15.18:0/1385104009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 0x55b3c48c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.093+0000 7f4e828cc740 1 --2- 172.21.15.18:0/1385104009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2d20 0x55b3c48c3100 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.093+0000 7f4e828cc740 1 -- 172.21.15.18:0/1385104009 >> 172.21.15.18:0/1385104009 conn(0x55b3c488a310 msgr2=0x55b3c48be100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:57.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.095+0000 7f4e7e28f640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4e640a3380 0x7f4e640a5840 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400b470 tx=0x7f4e74017730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:57.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.096+0000 7f4e828cc740 1 -- 172.21.15.18:0/1385104009 shutdown_connections 2024-09-19T10:03:57.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.096+0000 7f4e828cc740 1 -- 172.21.15.18:0/1385104009 wait complete. 2024-09-19T10:03:57.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.097+0000 7f4e828cc740 1 -- start start 2024-09-19T10:03:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.097+0000 7f4e828cc740 1 Processor -- start 2024-09-19T10:03:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.097+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c15c0 0x55b3c48ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.097+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 0x55b3c48cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.097+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c2d20 0x55b3c48cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.097+0000 7f4e828cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b3c48cf2a0 con 0x55b3c48c15c0 2024-09-19T10:03:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.097+0000 7f4e828cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b3c47e2060 con 0x55b3c48c2020 2024-09-19T10:03:57.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.097+0000 7f4e828cc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b3c48cf420 con 0x55b3c48c2d20 2024-09-19T10:03:57.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.098+0000 7f4e828cc740 10 client.0 _ll_register_callbacks cb 0x55b3c45358c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:57.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.098+0000 7f4e7ea90640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c15c0 0x55b3c48ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.099+0000 7f4e7ea90640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c15c0 0x55b3c48ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39838/0 (socket says 172.21.15.18:39838) 2024-09-19T10:03:57.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.099+0000 7f4e7ea90640 1 -- 172.21.15.18:0/1036948053 learned_addr learned my addr 172.21.15.18:0/1036948053 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:57.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.099+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c2d20 0x55b3c48cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.099+0000 7f4e7da8e640 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 0x55b3c48cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.100+0000 7f4e7ea90640 1 -- 172.21.15.18:0/1036948053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c2d20 msgr2=0x55b3c48cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.100+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c2d20 0x55b3c48cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.100+0000 7f4e7ea90640 1 -- 172.21.15.18:0/1036948053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 msgr2=0x55b3c48cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.101+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 0x55b3c48cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.101+0000 7f4e7ea90640 1 -- 172.21.15.18:0/1036948053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c45983c0 con 0x55b3c48c15c0 2024-09-19T10:03:57.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.101+0000 7f4e7da8e640 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 0x55b3c48cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:03:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.101+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c15c0 0x55b3c48ce600 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000afd0 tx=0x7f4e7000a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da944cc9124e577 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.101+0000 7f4e61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:03:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.102+0000 7f4e61ffb640 1 -- 172.21.15.18:0/1036948053 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70028060 con 0x55b3c48c15c0 2024-09-19T10:03:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.102+0000 7f4e61ffb640 1 -- 172.21.15.18:0/1036948053 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4e70012040 con 0x55b3c48c15c0 2024-09-19T10:03:57.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.105+0000 7f4e828cc740 1 -- 172.21.15.18:0/1036948053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e700158f0 con 0x55b3c48c15c0 2024-09-19T10:03:57.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.110+0000 7f4e61ffb640 1 -- 172.21.15.18:0/1036948053 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e7001a030 con 0x55b3c48c15c0 2024-09-19T10:03:57.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.110+0000 7f4e828cc740 10 client.18045 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:57.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.110+0000 7f4e828cc740 1 -- 172.21.15.18:0/1036948053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3c48dabc0 con 0x55b3c48c15c0 2024-09-19T10:03:57.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.113+0000 7f4e61ffb640 1 -- 172.21.15.18:0/1036948053 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e700158f0 con 0x55b3c48c15c0 2024-09-19T10:03:57.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.115+0000 7f4e61ffb640 1 -- 172.21.15.18:0/1036948053 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4e70020070 con 0x55b3c48c15c0 2024-09-19T10:03:57.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.115+0000 7f4e828cc740 10 client.18045 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:57.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.115+0000 7f4e828cc740 10 client.18045 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:03:57.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.115+0000 7f4e828cc740 20 client.18045 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:57.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.115+0000 7f4e828cc740 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b3c48dc410 0x55b3c48de8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.115+0000 7f4e828cc740 4 client.18045 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:57.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.115+0000 7f4e828cc740 1 -- 172.21.15.18:0/1036948053 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3c4834860 con 0x55b3c48dc410 2024-09-19T10:03:57.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.118+0000 7f4e7da8e640 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b3c48dc410 0x55b3c48de8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.127+0000 7f4e7da8e640 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b3c48dc410 0x55b3c48de8a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=33f9dcd2e23a869b server_cookie=1a2ff99a1e9892ad in_seq=0 out_seq=0 2024-09-19T10:03:57.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.127+0000 7f4e61ffb640 10 client.18045 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:03:57.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.134+0000 7f4e61ffb640 1 -- 172.21.15.18:0/1036948053 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3c4834860 con 0x55b3c48dc410 2024-09-19T10:03:57.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.134+0000 7f4e61ffb640 10 client.18045 handle_command_reply: tid=0 2024-09-19T10:03:57.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.134+0000 7f4e828cc740 1 client.18045 shutdown 2024-09-19T10:03:57.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.135+0000 7f4e828cc740 1 -- 172.21.15.18:0/1036948053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c15c0 msgr2=0x55b3c48ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:57.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.135+0000 7f4e828cc740 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c15c0 0x55b3c48ce600 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000afd0 tx=0x7f4e7000a4a0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.135+0000 7f4e828cc740 1 -- 172.21.15.18:0/1036948053 shutdown_connections 2024-09-19T10:03:57.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.135+0000 7f4e828cc740 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b3c48dc410 0x55b3c48de8a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.135+0000 7f4e828cc740 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c2d20 0x55b3c48cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.135+0000 7f4e828cc740 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 0x55b3c48cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.135+0000 7f4e828cc740 1 --2- 172.21.15.18:0/1036948053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c15c0 0x55b3c48ce600 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.135+0000 7f4e828cc740 1 -- 172.21.15.18:0/1036948053 >> 172.21.15.18:0/1036948053 conn(0x55b3c488a310 msgr2=0x55b3c48bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:57.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.135+0000 7f4e61ffb640 0 client.18045 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:03:57.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.137+0000 7f4e828cc740 1 -- 172.21.15.18:0/1036948053 shutdown_connections 2024-09-19T10:03:57.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.137+0000 7f4e828cc740 1 -- 172.21.15.18:0/1036948053 wait complete. 2024-09-19T10:03:57.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.138+0000 7f4e828cc740 20 client.18045 trim_cache size 0 max 16384 2024-09-19T10:03:57.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.179+0000 7f4e828cc740 1 Processor -- start 2024-09-19T10:03:57.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.179+0000 7f4e828cc740 1 -- start start 2024-09-19T10:03:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.180+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c15c0 0x55b3c48d8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.180+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 0x55b3c48c4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.181+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c2d20 0x55b3c48e4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.181+0000 7f4e7da8e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 0x55b3c48c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.181+0000 7f4e7da8e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 0x55b3c48c4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39850/0 (socket says 172.21.15.18:39850) 2024-09-19T10:03:57.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.182+0000 7f4e7ea90640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c15c0 0x55b3c48d8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.182+0000 7f4e7da8e640 1 -- 172.21.15.18:0/756982749 learned_addr learned my addr 172.21.15.18:0/756982749 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:57.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.182+0000 7f4e828cc740 1 -- 172.21.15.18:0/756982749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e781bc1e0 con 0x55b3c48c2020 2024-09-19T10:03:57.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.182+0000 7f4e828cc740 1 -- 172.21.15.18:0/756982749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4e781bdd20 con 0x55b3c48c15c0 2024-09-19T10:03:57.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.182+0000 7f4e828cc740 1 -- 172.21.15.18:0/756982749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e781bc8b0 con 0x55b3c48c2d20 2024-09-19T10:03:57.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.183+0000 7f4e7da8e640 1 -- 172.21.15.18:0/756982749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c2d20 msgr2=0x55b3c48e4170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:03:57.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.183+0000 7f4e7da8e640 1 --2- 172.21.15.18:0/756982749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c2d20 0x55b3c48e4170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.183+0000 7f4e7da8e640 1 -- 172.21.15.18:0/756982749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c15c0 msgr2=0x55b3c48d8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:57.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.183+0000 7f4e7da8e640 1 --2- 172.21.15.18:0/756982749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c15c0 0x55b3c48d8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.183+0000 7f4e7da8e640 1 -- 172.21.15.18:0/756982749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c4897bf0 con 0x55b3c48c2020 2024-09-19T10:03:57.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.184+0000 7f4e7da8e640 1 --2- 172.21.15.18:0/756982749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 0x55b3c48c4110 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009900 tx=0x7f4e68000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99a7e755561cc1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:57.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.185+0000 7f4e637fe640 1 -- 172.21.15.18:0/756982749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68049020 con 0x55b3c48c2020 2024-09-19T10:03:57.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.185+0000 7f4e637fe640 1 -- 172.21.15.18:0/756982749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e68031da0 con 0x55b3c48c2020 2024-09-19T10:03:57.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.186+0000 7f4e828cc740 1 -- 172.21.15.18:0/756982749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 msgr2=0x55b3c48c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:57.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.186+0000 7f4e828cc740 1 --2- 172.21.15.18:0/756982749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 0x55b3c48c4110 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009900 tx=0x7f4e68000bc0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.187+0000 7f4e828cc740 1 -- 172.21.15.18:0/756982749 shutdown_connections 2024-09-19T10:03:57.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.187+0000 7f4e828cc740 1 --2- 172.21.15.18:0/756982749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c2d20 0x55b3c48e4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.187+0000 7f4e828cc740 1 --2- 172.21.15.18:0/756982749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2020 0x55b3c48c4110 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.187+0000 7f4e828cc740 1 --2- 172.21.15.18:0/756982749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c15c0 0x55b3c48d8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.187+0000 7f4e828cc740 1 -- 172.21.15.18:0/756982749 >> 172.21.15.18:0/756982749 conn(0x55b3c488a310 msgr2=0x55b3c48ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:57.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.188+0000 7f4e828cc740 1 -- 172.21.15.18:0/756982749 shutdown_connections 2024-09-19T10:03:57.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.188+0000 7f4e828cc740 1 -- 172.21.15.18:0/756982749 wait complete. 2024-09-19T10:03:57.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.189+0000 7f4e828cc740 1 -- start start 2024-09-19T10:03:57.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.189+0000 7f4e828cc740 1 Processor -- start 2024-09-19T10:03:57.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.190+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 0x55b3c48d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.190+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 0x55b3c48cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.190+0000 7f4e828cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2d20 0x55b3c48d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.190+0000 7f4e828cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e781bd650 con 0x55b3c48c2d20 2024-09-19T10:03:57.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.190+0000 7f4e828cc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4e781bcf80 con 0x55b3c48c2020 2024-09-19T10:03:57.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.190+0000 7f4e828cc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e781ba270 con 0x55b3c48c15c0 2024-09-19T10:03:57.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.190+0000 7f4e828cc740 10 client.0 _ll_register_callbacks cb 0x7f4e70018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:57.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.196+0000 7f4e7da8e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 0x55b3c48cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.196+0000 7f4e7da8e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 0x55b3c48cff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:39234/0 (socket says 172.21.15.18:39234) 2024-09-19T10:03:57.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.196+0000 7f4e7da8e640 1 -- 172.21.15.18:0/3575538180 learned_addr learned my addr 172.21.15.18:0/3575538180 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:57.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.196+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 0x55b3c48d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.200+0000 7f4e7ea90640 1 -- 172.21.15.18:0/3575538180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 msgr2=0x55b3c48cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.200+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 0x55b3c48cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.200+0000 7f4e7ea90640 1 -- 172.21.15.18:0/3575538180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2d20 msgr2=0x55b3c48d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.200+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2d20 0x55b3c48d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.200+0000 7f4e7ea90640 1 -- 172.21.15.18:0/3575538180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c48d0a90 con 0x55b3c48c15c0 2024-09-19T10:03:57.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.206+0000 7f4e7ea90640 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 0x55b3c48d4c30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4e70023ed0 tx=0x7f4e7000cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccbb7f9820810c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:57.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.206+0000 7f4e61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.209+0000 7f4e61ffb640 1 -- 172.21.15.18:0/3575538180 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70028070 con 0x55b3c48c15c0 2024-09-19T10:03:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.209+0000 7f4e828cc740 1 -- 172.21.15.18:0/3575538180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3c482ed70 con 0x55b3c48c15c0 2024-09-19T10:03:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.209+0000 7f4e61ffb640 1 -- 172.21.15.18:0/3575538180 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4e70012070 con 0x55b3c48c15c0 2024-09-19T10:03:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.212+0000 7f4e61ffb640 1 -- 172.21.15.18:0/3575538180 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e7003d070 con 0x55b3c48c15c0 2024-09-19T10:03:57.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.212+0000 7f4e828cc740 10 client.27535 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:57.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.212+0000 7f4e828cc740 1 -- 172.21.15.18:0/3575538180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3c4957fc0 con 0x55b3c48c15c0 2024-09-19T10:03:57.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.215+0000 7f4e61ffb640 1 -- 172.21.15.18:0/3575538180 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b3c482ed70 con 0x55b3c48c15c0 2024-09-19T10:03:57.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.215+0000 7f4e61ffb640 1 -- 172.21.15.18:0/3575538180 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4e70020040 con 0x55b3c48c15c0 2024-09-19T10:03:57.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.217+0000 7f4e828cc740 10 client.27535 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.217+0000 7f4e828cc740 10 client.27535 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:03:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.217+0000 7f4e828cc740 20 client.27535 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.217+0000 7f4e828cc740 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b3c4958660 0x55b3c495aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.217+0000 7f4e828cc740 4 client.27535 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:03:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.217+0000 7f4e828cc740 1 -- 172.21.15.18:0/3575538180 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b3c47ab170 con 0x55b3c4958660 2024-09-19T10:03:57.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.221+0000 7f4e7da8e640 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b3c4958660 0x55b3c495aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.232+0000 7f4e7da8e640 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b3c4958660 0x55b3c495aa80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3b816087e7cc3fa6 server_cookie=8ff54786a082df96 in_seq=0 out_seq=0 2024-09-19T10:03:57.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.232+0000 7f4e61ffb640 10 client.27535 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:03:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e61ffb640 1 -- 172.21.15.18:0/3575538180 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b3c47ab170 con 0x55b3c4958660 2024-09-19T10:03:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e61ffb640 10 client.27535 handle_command_reply: tid=0 2024-09-19T10:03:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e828cc740 1 client.27535 shutdown 2024-09-19T10:03:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e828cc740 1 -- 172.21.15.18:0/3575538180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 msgr2=0x55b3c48d4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e828cc740 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 0x55b3c48d4c30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4e70023ed0 tx=0x7f4e7000cf80 comp rx=0 tx=0).stop 2024-09-19T10:03:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e828cc740 1 -- 172.21.15.18:0/3575538180 shutdown_connections 2024-09-19T10:03:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e828cc740 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x55b3c4958660 0x55b3c495aa80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e828cc740 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3c48c2d20 0x55b3c48d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e828cc740 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3c48c2020 0x55b3c48cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e828cc740 1 --2- 172.21.15.18:0/3575538180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c48c15c0 0x55b3c48d4c30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.233+0000 7f4e828cc740 1 -- 172.21.15.18:0/3575538180 >> 172.21.15.18:0/3575538180 conn(0x55b3c488a310 msgr2=0x55b3c48bcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.234+0000 7f4e61ffb640 0 client.27535 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:03:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.234+0000 7f4e828cc740 1 -- 172.21.15.18:0/3575538180 shutdown_connections 2024-09-19T10:03:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.234+0000 7f4e828cc740 1 -- 172.21.15.18:0/3575538180 wait complete. 2024-09-19T10:03:57.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.234+0000 7f4e828cc740 20 client.27535 trim_cache size 0 max 16384 2024-09-19T10:03:57.238 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:03:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.237+0000 7f4e6d7fa640 1 -- 172.21.15.18:0/657293450 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4e640a3380 msgr2=0x7f4e640a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.237+0000 7f4e6d7fa640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4e640a3380 0x7f4e640a5840 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400b470 tx=0x7f4e74017730 comp rx=0 tx=0).stop 2024-09-19T10:03:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.237+0000 7f4e6d7fa640 1 -- 172.21.15.18:0/657293450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e78074590 msgr2=0x7f4e78111ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.237+0000 7f4e6d7fa640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e78074590 0x7f4e78111ef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400b4a0 tx=0x7f4e7400b960 comp rx=0 tx=0).stop 2024-09-19T10:03:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.237+0000 7f4e6d7fa640 1 -- 172.21.15.18:0/657293450 shutdown_connections 2024-09-19T10:03:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.237+0000 7f4e6d7fa640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f4e640a3380 0x7f4e640a5840 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.237+0000 7f4e6d7fa640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e781129e0 0x7f4e7810b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.237+0000 7f4e6d7fa640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e78074eb0 0x7f4e78112430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.237+0000 7f4e6d7fa640 1 --2- 172.21.15.18:0/657293450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e78074590 0x7f4e78111ef0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:57.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.237+0000 7f4e6d7fa640 1 -- 172.21.15.18:0/657293450 >> 172.21.15.18:0/657293450 conn(0x7f4e780fd710 msgr2=0x7f4e780fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:57.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.239+0000 7f4e6d7fa640 1 -- 172.21.15.18:0/657293450 shutdown_connections 2024-09-19T10:03:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:57.239+0000 7f4e6d7fa640 1 -- 172.21.15.18:0/657293450 wait complete. 2024-09-19T10:03:58.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T10:03:58.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:03:57 smithi018 ceph-mon[30956]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 837 MiB/s wr, 1.73k op/s 2024-09-19T10:03:58.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:03:58 smithi049 ceph-mon[34858]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 837 MiB/s wr, 1.73k op/s 2024-09-19T10:03:58.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:03:58 smithi162 ceph-mon[35174]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 1.5 MiB/s rd, 837 MiB/s wr, 1.73k op/s 2024-09-19T10:03:58.809 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:03:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.015+0000 7f915ffff640 1 -- 172.21.15.18:0/1949145468 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f9174005850 con 0x55b659160af0 2024-09-19T10:03:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.015+0000 7f915ffff640 10 client.27508 handle_command_reply: tid=0 2024-09-19T10:03:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.015+0000 7f9189dd1740 1 client.27508 shutdown 2024-09-19T10:03:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.020+0000 7f9189dd1740 1 -- 172.21.15.18:0/1949145468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 msgr2=0x55b6591057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.020+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6591057a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f917809bd70 tx=0x7f9178004b50 comp rx=0 tx=0).stop 2024-09-19T10:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.020+0000 7f9189dd1740 1 -- 172.21.15.18:0/1949145468 shutdown_connections 2024-09-19T10:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.020+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55b659160af0 0x55b659162ee0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.020+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b6590ef0b0 0x55b65915ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.020+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6590e5370 0x55b6591057a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.020+0000 7f9189dd1740 1 --2- 172.21.15.18:0/1949145468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6590e02e0 0x55b659105260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.020+0000 7f9189dd1740 1 -- 172.21.15.18:0/1949145468 >> 172.21.15.18:0/1949145468 conn(0x55b6590db010 msgr2=0x55b6590e98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.020+0000 7f915ffff640 0 client.27508 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.020+0000 7f9189dd1740 1 -- 172.21.15.18:0/1949145468 shutdown_connections 2024-09-19T10:03:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.021+0000 7f9189dd1740 1 -- 172.21.15.18:0/1949145468 wait complete. 2024-09-19T10:03:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.021+0000 7f9189dd1740 20 client.27508 trim_cache size 0 max 16384 2024-09-19T10:03:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:03:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:03:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:03:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:03:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.034+0000 7f9187042640 1 -- 172.21.15.18:0/1191225561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91680a3520 msgr2=0x7f91680a59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.034+0000 7f9187042640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91680a3520 0x7f91680a59e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x55b6590e0d10 tx=0x7f917000a040 comp rx=0 tx=0).stop 2024-09-19T10:03:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.034+0000 7f9187042640 1 -- 172.21.15.18:0/1191225561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9180073980 msgr2=0x7f91800788c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.034+0000 7f9187042640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9180073980 0x7f91800788c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f917800bd70 tx=0x7f917800be60 comp rx=0 tx=0).stop 2024-09-19T10:03:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.035+0000 7f9187042640 1 -- 172.21.15.18:0/1191225561 shutdown_connections 2024-09-19T10:03:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.035+0000 7f9187042640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f91680a3520 0x7f91680a59e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.035+0000 7f9187042640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91801096e0 0x7f9180078e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.035+0000 7f9187042640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9180073980 0x7f91800788c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.036+0000 7f9187042640 1 --2- 172.21.15.18:0/1191225561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9180072fc0 0x7f918007a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.036+0000 7f9187042640 1 -- 172.21.15.18:0/1191225561 >> 172.21.15.18:0/1191225561 conn(0x7f918006ece0 msgr2=0x7f9180070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.036+0000 7f9187042640 1 -- 172.21.15.18:0/1191225561 shutdown_connections 2024-09-19T10:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:03:59.037+0000 7f9187042640 1 -- 172.21.15.18:0/1191225561 wait complete. 2024-09-19T10:03:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.618+0000 7f340d59a640 1 -- 172.21.15.18:0/1078878971 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408031640 con 0x7f341011b140 2024-09-19T10:03:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.619+0000 7f340f59e640 1 -- 172.21.15.18:0/1078878971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f341011b140 msgr2=0x7f341011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.619+0000 7f340f59e640 1 --2- 172.21.15.18:0/1078878971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f341011b140 0x7f341011d530 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3408009ca0 tx=0x7f340802a8b0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.619+0000 7f340f59e640 1 -- 172.21.15.18:0/1078878971 shutdown_connections 2024-09-19T10:03:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.619+0000 7f340f59e640 1 --2- 172.21.15.18:0/1078878971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f341011b140 0x7f341011d530 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.619+0000 7f340f59e640 1 --2- 172.21.15.18:0/1078878971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341006ea30 0x7f341006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.619+0000 7f340f59e640 1 --2- 172.21.15.18:0/1078878971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3410110190 0x7f341006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.619+0000 7f340f59e640 1 -- 172.21.15.18:0/1078878971 >> 172.21.15.18:0/1078878971 conn(0x7f3410073180 msgr2=0x7f3410073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.623+0000 7f340f59e640 1 -- 172.21.15.18:0/1078878971 shutdown_connections 2024-09-19T10:03:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.623+0000 7f340f59e640 1 -- 172.21.15.18:0/1078878971 wait complete. 2024-09-19T10:03:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.625+0000 7f340f59e640 1 Processor -- start 2024-09-19T10:03:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.625+0000 7f340f59e640 1 -- start start 2024-09-19T10:03:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.625+0000 7f340f59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f341006ea30 0x7f34101186a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.625+0000 7f340f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3410110190 0x7f3410118be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.625+0000 7f340f59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341011b140 0x7f3410111910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.625+0000 7f340f59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3410120be0 con 0x7f3410110190 2024-09-19T10:03:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.625+0000 7f340f59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3410120a60 con 0x7f341011b140 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.625+0000 7f340f59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3410120d60 con 0x7f341006ea30 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.627+0000 7f340e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f341006ea30 0x7f34101186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.627+0000 7f340e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f341006ea30 0x7f34101186a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:32924/0 (socket says 172.21.15.18:32924) 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.627+0000 7f340e59c640 1 -- 172.21.15.18:0/4253499965 learned_addr learned my addr 172.21.15.18:0/4253499965 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.628+0000 7f340ed9d640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341011b140 0x7f3410111910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.629+0000 7f340dd9b640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3410110190 0x7f3410118be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.634+0000 7f340e59c640 1 -- 172.21.15.18:0/4253499965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341011b140 msgr2=0x7f3410111910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.634+0000 7f340e59c640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341011b140 0x7f3410111910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.634+0000 7f340e59c640 1 -- 172.21.15.18:0/4253499965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3410110190 msgr2=0x7f3410118be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.634+0000 7f340e59c640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3410110190 0x7f3410118be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.634+0000 7f340e59c640 1 -- 172.21.15.18:0/4253499965 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34101121d0 con 0x7f341006ea30 2024-09-19T10:03:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.642+0000 7f340e59c640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f341006ea30 0x7f34101186a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f340000d950 tx=0x7f340000dd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.643+0000 7f33ff7fe640 1 -- 172.21.15.18:0/4253499965 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400017070 con 0x7f341006ea30 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.643+0000 7f33ff7fe640 1 -- 172.21.15.18:0/4253499965 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f340000de80 con 0x7f341006ea30 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.643+0000 7f33ff7fe640 1 -- 172.21.15.18:0/4253499965 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340000f620 con 0x7f341006ea30 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.644+0000 7f340f59e640 1 -- 172.21.15.18:0/4253499965 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34101124c0 con 0x7f341006ea30 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.644+0000 7f340f59e640 1 -- 172.21.15.18:0/4253499965 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3410116460 con 0x7f341006ea30 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.649+0000 7f3417046740 1 Processor -- start 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.649+0000 7f3417046740 1 -- start start 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.649+0000 7f3417046740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 0x562122bf0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.655+0000 7f340ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 0x562122bf0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.657+0000 7f340ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 0x562122bf0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:39256/0 (socket says 172.21.15.18:39256) 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.657+0000 7f340ed9d640 1 -- 172.21.15.18:0/1260745958 learned_addr learned my addr 172.21.15.18:0/1260745958 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.657+0000 7f3417046740 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bf0780 0x562122bf0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.657+0000 7f3417046740 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bfb520 0x562122bfd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.657+0000 7f3417046740 1 -- 172.21.15.18:0/1260745958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562122b562f0 con 0x562122bf0780 2024-09-19T10:03:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.657+0000 7f3417046740 1 -- 172.21.15.18:0/1260745958 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562122afdcf0 con 0x562122bf1cf0 2024-09-19T10:03:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.657+0000 7f3417046740 1 -- 172.21.15.18:0/1260745958 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562122b522b0 con 0x562122bfb520 2024-09-19T10:03:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.657+0000 7f33ff7fe640 1 -- 172.21.15.18:0/4253499965 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3400009c30 con 0x7f341006ea30 2024-09-19T10:03:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.658+0000 7f340dd9b640 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bfb520 0x562122bfd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.663+0000 7f33ff7fe640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33f80a3410 0x7f33f80a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.664+0000 7f340e59c640 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bf0780 0x562122bf0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.665+0000 7f33ff7fe640 1 -- 172.21.15.18:0/4253499965 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f34000cf4c0 con 0x7f341006ea30 2024-09-19T10:03:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.668+0000 7f340ed9d640 1 -- 172.21.15.18:0/1260745958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bfb520 msgr2=0x562122bfd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.668+0000 7f340ed9d640 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bfb520 0x562122bfd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.668+0000 7f340ed9d640 1 -- 172.21.15.18:0/1260745958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bf0780 msgr2=0x562122bf0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.668+0000 7f340ed9d640 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bf0780 0x562122bf0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.668+0000 7f340ed9d640 1 -- 172.21.15.18:0/1260745958 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562122ae23a0 con 0x562122bf1cf0 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.669+0000 7f340ed9d640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33f80a3410 0x7f33f80a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.670+0000 7f340ed9d640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33f80a3410 0x7f33f80a58d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3408009430 tx=0x7f3408040000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.671+0000 7f340ed9d640 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 0x562122bf0240 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3408035000 tx=0x7f3408009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=532d013212a04a5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.673+0000 7f33fcff9640 1 -- 172.21.15.18:0/1260745958 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340804c070 con 0x562122bf1cf0 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.674+0000 7f33fcff9640 1 -- 172.21.15.18:0/1260745958 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3408036040 con 0x562122bf1cf0 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.675+0000 7f3417046740 1 -- 172.21.15.18:0/1260745958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 msgr2=0x562122bf0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.675+0000 7f3417046740 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 0x562122bf0240 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3408035000 tx=0x7f3408009950 comp rx=0 tx=0).stop 2024-09-19T10:03:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.676+0000 7f3417046740 1 -- 172.21.15.18:0/1260745958 shutdown_connections 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.676+0000 7f3417046740 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bfb520 0x562122bfd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.676+0000 7f3417046740 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bf0780 0x562122bf0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.676+0000 7f3417046740 1 --2- 172.21.15.18:0/1260745958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 0x562122bf0240 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.676+0000 7f3417046740 1 -- 172.21.15.18:0/1260745958 >> 172.21.15.18:0/1260745958 conn(0x562122bb9310 msgr2=0x562122bece10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.676+0000 7f3417046740 1 -- 172.21.15.18:0/1260745958 shutdown_connections 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.677+0000 7f3417046740 1 -- 172.21.15.18:0/1260745958 wait complete. 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.678+0000 7f3417046740 1 -- start start 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.678+0000 7f3417046740 1 Processor -- start 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.679+0000 7f3417046740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122bfafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.679+0000 7f3417046740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bf1cf0 0x562122bf8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.679+0000 7f3417046740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bfb520 0x562122bf89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.679+0000 7f3417046740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562122c20220 con 0x562122bf1cf0 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.679+0000 7f3417046740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562122b11060 con 0x562122bfb520 2024-09-19T10:03:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.679+0000 7f3417046740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562122c203a0 con 0x562122bf0780 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.679+0000 7f3417046740 10 client.0 _ll_register_callbacks cb 0x5621228648c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.679+0000 7f340e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122bfafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.680+0000 7f340e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122bfafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:32938/0 (socket says 172.21.15.18:32938) 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.680+0000 7f340e59c640 1 -- 172.21.15.18:0/2672806698 learned_addr learned my addr 172.21.15.18:0/2672806698 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.680+0000 7f340e59c640 1 -- 172.21.15.18:0/2672806698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bfb520 msgr2=0x562122bf89f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.680+0000 7f340e59c640 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bfb520 0x562122bf89f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.680+0000 7f340e59c640 1 -- 172.21.15.18:0/2672806698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bf1cf0 msgr2=0x562122bf8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.680+0000 7f340e59c640 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bf1cf0 0x562122bf8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.680+0000 7f340e59c640 1 -- 172.21.15.18:0/2672806698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621228c73c0 con 0x562122bf0780 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.682+0000 7f340e59c640 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122bfafb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3400097f90 tx=0x7f340009b580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a237c9497035312 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.682+0000 7f33f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.685+0000 7f33f5ffb640 1 -- 172.21.15.18:0/2672806698 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340009ce60 con 0x562122bf0780 2024-09-19T10:03:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.685+0000 7f3417046740 1 -- 172.21.15.18:0/2672806698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562122b63860 con 0x562122bf0780 2024-09-19T10:03:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.685+0000 7f33f5ffb640 1 -- 172.21.15.18:0/2672806698 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f34000cf0f0 con 0x562122bf0780 2024-09-19T10:03:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.686+0000 7f33f5ffb640 1 -- 172.21.15.18:0/2672806698 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34000a47a0 con 0x562122bf0780 2024-09-19T10:03:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.686+0000 7f3417046740 10 client.27547 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.686+0000 7f3417046740 1 -- 172.21.15.18:0/2672806698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562122c2bec0 con 0x562122bf0780 2024-09-19T10:03:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.689+0000 7f33f5ffb640 1 -- 172.21.15.18:0/2672806698 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562122b63860 con 0x562122bf0780 2024-09-19T10:03:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.691+0000 7f33f5ffb640 1 -- 172.21.15.18:0/2672806698 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3400023060 con 0x562122bf0780 2024-09-19T10:03:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.691+0000 7f3417046740 10 client.27547 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.691+0000 7f3417046740 10 client.27547 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:03:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.691+0000 7f3417046740 20 client.27547 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.691+0000 7f3417046740 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x562122c2d880 0x562122c2fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.691+0000 7f3417046740 4 client.27547 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:03:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.691+0000 7f3417046740 1 -- 172.21.15.18:0/2672806698 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562122b5dd70 con 0x562122c2d880 2024-09-19T10:03:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.695+0000 7f340dd9b640 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x562122c2d880 0x562122c2fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.704+0000 7f340dd9b640 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x562122c2d880 0x562122c2fd10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee790e876171506b server_cookie=269169cc8f2ce579 in_seq=0 out_seq=0 2024-09-19T10:03:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.704+0000 7f33f5ffb640 10 client.27547 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:03:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.709+0000 7f33f5ffb640 1 -- 172.21.15.18:0/2672806698 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562122b5dd70 con 0x562122c2d880 2024-09-19T10:03:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.710+0000 7f33f5ffb640 10 client.27547 handle_command_reply: tid=0 2024-09-19T10:03:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.710+0000 7f3417046740 1 client.27547 shutdown 2024-09-19T10:03:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.710+0000 7f3417046740 1 -- 172.21.15.18:0/2672806698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 msgr2=0x562122bfafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.710+0000 7f3417046740 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122bfafb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3400097f90 tx=0x7f340009b580 comp rx=0 tx=0).stop 2024-09-19T10:03:59.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.712+0000 7f3417046740 1 -- 172.21.15.18:0/2672806698 shutdown_connections 2024-09-19T10:03:59.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.712+0000 7f3417046740 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x562122c2d880 0x562122c2fd10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.712+0000 7f3417046740 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bfb520 0x562122bf89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.712+0000 7f3417046740 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bf1cf0 0x562122bf8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.712+0000 7f3417046740 1 --2- 172.21.15.18:0/2672806698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122bfafb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.712+0000 7f3417046740 1 -- 172.21.15.18:0/2672806698 >> 172.21.15.18:0/2672806698 conn(0x562122bb9310 msgr2=0x562122bf2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:59.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.712+0000 7f33f5ffb640 0 client.27547 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:03:59.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.712+0000 7f3417046740 1 -- 172.21.15.18:0/2672806698 shutdown_connections 2024-09-19T10:03:59.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.712+0000 7f3417046740 1 -- 172.21.15.18:0/2672806698 wait complete. 2024-09-19T10:03:59.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.713+0000 7f3417046740 20 client.27547 trim_cache size 0 max 16384 2024-09-19T10:03:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.759+0000 7f3417046740 1 Processor -- start 2024-09-19T10:03:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.759+0000 7f3417046740 1 -- start start 2024-09-19T10:03:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.760+0000 7f3417046740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf0780 0x562122becfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.760+0000 7f3417046740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf1cf0 0x562122bf7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.760+0000 7f3417046740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c355f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.760+0000 7f3417046740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f341007bcf0 con 0x562122bfb520 2024-09-19T10:03:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.760+0000 7f3417046740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f341007d830 con 0x562122bf0780 2024-09-19T10:03:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.760+0000 7f3417046740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f341007c3c0 con 0x562122bf1cf0 2024-09-19T10:03:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.761+0000 7f340ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.761+0000 7f340ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c355f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39884/0 (socket says 172.21.15.18:39884) 2024-09-19T10:03:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.761+0000 7f340ed9d640 1 -- 172.21.15.18:0/4167228333 learned_addr learned my addr 172.21.15.18:0/4167228333 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.761+0000 7f340e59c640 1 --2- 172.21.15.18:0/4167228333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf0780 0x562122becfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.761+0000 7f340dd9b640 1 --2- 172.21.15.18:0/4167228333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf1cf0 0x562122bf7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.762+0000 7f340ed9d640 1 -- 172.21.15.18:0/4167228333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf1cf0 msgr2=0x562122bf7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:59.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.762+0000 7f340ed9d640 1 --2- 172.21.15.18:0/4167228333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf1cf0 0x562122bf7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.762+0000 7f340ed9d640 1 -- 172.21.15.18:0/4167228333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf0780 msgr2=0x562122becfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:59.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.762+0000 7f340ed9d640 1 --2- 172.21.15.18:0/4167228333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf0780 0x562122becfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.762+0000 7f340ed9d640 1 -- 172.21.15.18:0/4167228333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562122bf8d60 con 0x562122bfb520 2024-09-19T10:03:59.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.763+0000 7f340ed9d640 1 --2- 172.21.15.18:0/4167228333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c355f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f3408006010 tx=0x7f3408030b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979d85256ead1467 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.764+0000 7f33f7fff640 1 -- 172.21.15.18:0/4167228333 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340804c070 con 0x562122bfb520 2024-09-19T10:03:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.764+0000 7f33f7fff640 1 -- 172.21.15.18:0/4167228333 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f340804d040 con 0x562122bfb520 2024-09-19T10:03:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.764+0000 7f33f7fff640 1 -- 172.21.15.18:0/4167228333 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408004340 con 0x562122bfb520 2024-09-19T10:03:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.766+0000 7f3417046740 1 -- 172.21.15.18:0/4167228333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 msgr2=0x562122c355f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.766+0000 7f3417046740 1 --2- 172.21.15.18:0/4167228333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c355f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f3408006010 tx=0x7f3408030b70 comp rx=0 tx=0).stop 2024-09-19T10:03:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.767+0000 7f3417046740 1 -- 172.21.15.18:0/4167228333 shutdown_connections 2024-09-19T10:03:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.767+0000 7f3417046740 1 --2- 172.21.15.18:0/4167228333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c355f0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.767+0000 7f3417046740 1 --2- 172.21.15.18:0/4167228333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf1cf0 0x562122bf7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.767+0000 7f3417046740 1 --2- 172.21.15.18:0/4167228333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf0780 0x562122becfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.767+0000 7f3417046740 1 -- 172.21.15.18:0/4167228333 >> 172.21.15.18:0/4167228333 conn(0x562122bb9310 msgr2=0x562122bec8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.768+0000 7f3417046740 1 -- 172.21.15.18:0/4167228333 shutdown_connections 2024-09-19T10:03:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.768+0000 7f3417046740 1 -- 172.21.15.18:0/4167228333 wait complete. 2024-09-19T10:03:59.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.768+0000 7f3417046740 1 -- start start 2024-09-19T10:03:59.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.769+0000 7f3417046740 1 Processor -- start 2024-09-19T10:03:59.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.770+0000 7f3417046740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122c25bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.771+0000 7f3417046740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 0x562122c20640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.771+0000 7f3417046740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c20b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.771+0000 7f3417046740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f341007d160 con 0x562122bfb520 2024-09-19T10:03:59.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.771+0000 7f3417046740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f341007ca90 con 0x562122bf1cf0 2024-09-19T10:03:59.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.771+0000 7f3417046740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3410079d80 con 0x562122bf0780 2024-09-19T10:03:59.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.771+0000 7f340ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c20b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.771+0000 7f340ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c20b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39888/0 (socket says 172.21.15.18:39888) 2024-09-19T10:03:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.771+0000 7f340ed9d640 1 -- 172.21.15.18:0/320989441 learned_addr learned my addr 172.21.15.18:0/320989441 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:03:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.772+0000 7f340dd9b640 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 0x562122c20640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.772+0000 7f340e59c640 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122c25bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.772+0000 7f3417046740 10 client.0 _ll_register_callbacks cb 0x7f340009b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:03:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.772+0000 7f340e59c640 1 -- 172.21.15.18:0/320989441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 msgr2=0x562122c20640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.772+0000 7f340e59c640 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 0x562122c20640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.772+0000 7f340e59c640 1 -- 172.21.15.18:0/320989441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 msgr2=0x562122c20b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:03:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.772+0000 7f340e59c640 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c20b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.772+0000 7f340e59c640 1 -- 172.21.15.18:0/320989441 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562122c21170 con 0x562122bf0780 2024-09-19T10:03:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.772+0000 7f340e59c640 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122c25bd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f340009bac0 tx=0x7f34000cf300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d4d107567ebee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:03:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.773+0000 7f33f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:03:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.773+0000 7f33f5ffb640 1 -- 172.21.15.18:0/320989441 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340009ce60 con 0x562122bf0780 2024-09-19T10:03:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.773+0000 7f33f5ffb640 1 -- 172.21.15.18:0/320989441 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f340009b190 con 0x562122bf0780 2024-09-19T10:03:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.773+0000 7f3417046740 1 -- 172.21.15.18:0/320989441 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f340804d040 con 0x562122bf0780 2024-09-19T10:03:59.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.773+0000 7f33f5ffb640 1 -- 172.21.15.18:0/320989441 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34000a1160 con 0x562122bf0780 2024-09-19T10:03:59.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.773+0000 7f3417046740 10 client.27553 fetch_fsmap learned FSMap version 28 2024-09-19T10:03:59.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.773+0000 7f3417046740 1 -- 172.21.15.18:0/320989441 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562122c21170 con 0x562122bf0780 2024-09-19T10:03:59.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.773+0000 7f33f5ffb640 1 -- 172.21.15.18:0/320989441 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34000aa030 con 0x562122bf0780 2024-09-19T10:03:59.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.775+0000 7f33f5ffb640 1 -- 172.21.15.18:0/320989441 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3400022380 con 0x562122bf0780 2024-09-19T10:03:59.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.775+0000 7f3417046740 10 client.27553 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:03:59.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.775+0000 7f3417046740 10 client.27553 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:03:59.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.775+0000 7f3417046740 20 client.27553 populate_metadata read hostname 'smithi018' 2024-09-19T10:03:59.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.775+0000 7f3417046740 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x562122c976d0 0x562122c99ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:03:59.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.775+0000 7f3417046740 4 client.27553 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:03:59.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.775+0000 7f3417046740 1 -- 172.21.15.18:0/320989441 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f340804d040 con 0x562122c976d0 2024-09-19T10:03:59.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.776+0000 7f340dd9b640 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x562122c976d0 0x562122c99ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:03:59.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.777+0000 7f340dd9b640 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x562122c976d0 0x562122c99ac0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c7cb09a0a6c4693 server_cookie=7363a8825a0b3bd4 in_seq=0 out_seq=0 2024-09-19T10:03:59.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.777+0000 7f33f5ffb640 10 client.27553 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:03:59.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.777+0000 7f33f5ffb640 1 -- 172.21.15.18:0/320989441 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f340804d040 con 0x562122c976d0 2024-09-19T10:03:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.777+0000 7f33f5ffb640 10 client.27553 handle_command_reply: tid=0 2024-09-19T10:03:59.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.777+0000 7f3417046740 1 client.27553 shutdown 2024-09-19T10:03:59.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.780+0000 7f3417046740 1 -- 172.21.15.18:0/320989441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 msgr2=0x562122c25bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.780+0000 7f3417046740 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122c25bd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f340009bac0 tx=0x7f34000cf300 comp rx=0 tx=0).stop 2024-09-19T10:03:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.780+0000 7f3417046740 1 -- 172.21.15.18:0/320989441 shutdown_connections 2024-09-19T10:03:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.780+0000 7f3417046740 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x562122c976d0 0x562122c99ac0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.780+0000 7f3417046740 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562122bfb520 0x562122c20b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.780+0000 7f3417046740 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562122bf1cf0 0x562122c20640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.780+0000 7f3417046740 1 --2- 172.21.15.18:0/320989441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562122bf0780 0x562122c25bd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.780+0000 7f3417046740 1 -- 172.21.15.18:0/320989441 >> 172.21.15.18:0/320989441 conn(0x562122bb9310 msgr2=0x562122bf6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.780+0000 7f33f5ffb640 0 client.27553 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:03:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.781+0000 7f3417046740 1 -- 172.21.15.18:0/320989441 shutdown_connections 2024-09-19T10:03:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.781+0000 7f3417046740 1 -- 172.21.15.18:0/320989441 wait complete. 2024-09-19T10:03:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.781+0000 7f3417046740 20 client.27553 trim_cache size 0 max 16384 2024-09-19T10:03:59.784 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.783+0000 7f340f59e640 1 -- 172.21.15.18:0/4253499965 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33f80a3410 msgr2=0x7f33f80a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.783+0000 7f340f59e640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33f80a3410 0x7f33f80a58d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3408009430 tx=0x7f3408040000 comp rx=0 tx=0).stop 2024-09-19T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.783+0000 7f340f59e640 1 -- 172.21.15.18:0/4253499965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f341006ea30 msgr2=0x7f34101186a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.783+0000 7f340f59e640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f341006ea30 0x7f34101186a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f340000d950 tx=0x7f340000dd50 comp rx=0 tx=0).stop 2024-09-19T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.783+0000 7f340f59e640 1 -- 172.21.15.18:0/4253499965 shutdown_connections 2024-09-19T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.783+0000 7f340f59e640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33f80a3410 0x7f33f80a58d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.783+0000 7f340f59e640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f341011b140 0x7f3410111910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.783+0000 7f340f59e640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3410110190 0x7f3410118be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.783+0000 7f340f59e640 1 --2- 172.21.15.18:0/4253499965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f341006ea30 0x7f34101186a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:03:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.783+0000 7f340f59e640 1 -- 172.21.15.18:0/4253499965 >> 172.21.15.18:0/4253499965 conn(0x7f3410073180 msgr2=0x7f341011a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:03:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.785+0000 7f340f59e640 1 -- 172.21.15.18:0/4253499965 shutdown_connections 2024-09-19T10:03:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:03:59.785+0000 7f340f59e640 1 -- 172.21.15.18:0/4253499965 wait complete. 2024-09-19T10:04:00.393 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:00 smithi018 ceph-mon[30956]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 763 MiB/s wr, 1.74k op/s 2024-09-19T10:04:00.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:00 smithi049 ceph-mon[34858]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 763 MiB/s wr, 1.74k op/s 2024-09-19T10:04:00.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:00 smithi162 ceph-mon[35174]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 763 MiB/s wr, 1.74k op/s 2024-09-19T10:04:01.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T10:04:01.856 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:02.308 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:02 smithi018 ceph-mon[30956]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 843 MiB/s wr, 2.09k op/s 2024-09-19T10:04:02.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:02 smithi049 ceph-mon[34858]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 843 MiB/s wr, 2.09k op/s 2024-09-19T10:04:02.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:02 smithi162 ceph-mon[35174]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 2.0 MiB/s rd, 843 MiB/s wr, 2.09k op/s 2024-09-19T10:04:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.712+0000 7f76839d6640 1 -- 172.21.15.18:0/1031371341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76740a9730 msgr2=0x7f767400b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.712+0000 7f76839d6640 1 --2- 172.21.15.18:0/1031371341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76740a9730 0x7f767400b830 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f767c067960 tx=0x7f767c08e320 comp rx=0 tx=0).stop 2024-09-19T10:04:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.712+0000 7f76839d6640 1 -- 172.21.15.18:0/1031371341 shutdown_connections 2024-09-19T10:04:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.712+0000 7f76839d6640 1 --2- 172.21.15.18:0/1031371341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76740a9730 0x7f767400b830 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.712+0000 7f76839d6640 1 --2- 172.21.15.18:0/1031371341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76740a5460 0x7f76740a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.712+0000 7f76839d6640 1 --2- 172.21.15.18:0/1031371341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76740a4ab0 0x7f76740a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.712+0000 7f76839d6640 1 -- 172.21.15.18:0/1031371341 >> 172.21.15.18:0/1031371341 conn(0x7f767401a110 msgr2=0x7f767401a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.713+0000 7f76839d6640 1 -- 172.21.15.18:0/1031371341 shutdown_connections 2024-09-19T10:04:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.713+0000 7f76839d6640 1 -- 172.21.15.18:0/1031371341 wait complete. 2024-09-19T10:04:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.714+0000 7f76839d6640 1 Processor -- start 2024-09-19T10:04:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.714+0000 7f76839d6640 1 -- start start 2024-09-19T10:04:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.714+0000 7f76839d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76740a4ab0 0x7f767400b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.714+0000 7f76839d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76740a5460 0x7f76740055f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.714+0000 7f76839d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7674005b30 0x7f7674005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.714+0000 7f76839d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f767400ecb0 con 0x7f76740a4ab0 2024-09-19T10:04:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.714+0000 7f76839d6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f767400eb30 con 0x7f7674005b30 2024-09-19T10:04:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.714+0000 7f76839d6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f767400ee30 con 0x7f76740a5460 2024-09-19T10:04:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.715+0000 7f7680f71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76740a5460 0x7f76740055f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.715+0000 7f7680f71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76740a5460 0x7f76740055f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:32964/0 (socket says 172.21.15.18:32964) 2024-09-19T10:04:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.715+0000 7f7680f71640 1 -- 172.21.15.18:0/775850790 learned_addr learned my addr 172.21.15.18:0/775850790 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:02.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.718+0000 7f7680f71640 1 -- 172.21.15.18:0/775850790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7674005b30 msgr2=0x7f7674005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:02.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.718+0000 7f7680f71640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7674005b30 0x7f7674005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.718+0000 7f7680f71640 1 -- 172.21.15.18:0/775850790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76740a4ab0 msgr2=0x7f767400b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:02.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.718+0000 7f7680f71640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76740a4ab0 0x7f767400b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.718+0000 7f7680f71640 1 -- 172.21.15.18:0/775850790 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76741581a0 con 0x7f76740a5460 2024-09-19T10:04:02.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.722+0000 7f7680f71640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76740a5460 0x7f76740055f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f767800b4a0 tx=0x7f767800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:02.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.723+0000 7f76727fc640 1 -- 172.21.15.18:0/775850790 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678014070 con 0x7f76740a5460 2024-09-19T10:04:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.723+0000 7f76839d6640 1 -- 172.21.15.18:0/775850790 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7674158490 con 0x7f76740a5460 2024-09-19T10:04:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.723+0000 7f76839d6640 1 -- 172.21.15.18:0/775850790 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76741589d0 con 0x7f76740a5460 2024-09-19T10:04:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.728+0000 7f76727fc640 1 -- 172.21.15.18:0/775850790 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7678010af0 con 0x7f76740a5460 2024-09-19T10:04:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.728+0000 7f76727fc640 1 -- 172.21.15.18:0/775850790 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678017d10 con 0x7f76740a5460 2024-09-19T10:04:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.735+0000 7f7685daf740 1 Processor -- start 2024-09-19T10:04:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.738+0000 7f7685daf740 1 -- start start 2024-09-19T10:04:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.739+0000 7f7685daf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a71410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.739+0000 7f7685daf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a71950 0x5575b9a71db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.739+0000 7f7685daf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a7eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.739+0000 7f7685daf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575b99d72f0 con 0x5575b9a71950 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.739+0000 7f7685daf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5575b997ecf0 con 0x5575b9a72d50 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.739+0000 7f7685daf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5575b99d32b0 con 0x5575b9a7c6f0 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.743+0000 7f7680f71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a7eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.743+0000 7f7680f71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a7eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:32974/0 (socket says 172.21.15.18:32974) 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.743+0000 7f7680f71640 1 -- 172.21.15.18:0/2702894109 learned_addr learned my addr 172.21.15.18:0/2702894109 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.743+0000 7f7681f73640 1 --2- 172.21.15.18:0/2702894109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a71410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.744+0000 7f7680f71640 1 -- 172.21.15.18:0/2702894109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 msgr2=0x5575b9a71410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.744+0000 7f7680f71640 1 --2- 172.21.15.18:0/2702894109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a71410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.744+0000 7f7680f71640 1 -- 172.21.15.18:0/2702894109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a71950 msgr2=0x5575b9a71db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.744+0000 7f7680f71640 1 --2- 172.21.15.18:0/2702894109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a71950 0x5575b9a71db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.744+0000 7f7680f71640 1 -- 172.21.15.18:0/2702894109 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b99633a0 con 0x5575b9a7c6f0 2024-09-19T10:04:02.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.745+0000 7f7680f71640 1 --2- 172.21.15.18:0/2702894109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a7eae0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f767800be60 tx=0x7f76780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c229878f6062b3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:02.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.751+0000 7f76727fc640 1 -- 172.21.15.18:0/775850790 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7678017070 con 0x7f76740a5460 2024-09-19T10:04:02.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.757+0000 7f76727fc640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76680a3390 0x7f76680a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.759+0000 7f76839d6640 1 -- 172.21.15.18:0/2702894109 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76780da8f0 con 0x5575b9a7c6f0 2024-09-19T10:04:02.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.759+0000 7f76839d6640 1 -- 172.21.15.18:0/2702894109 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76780df070 con 0x5575b9a7c6f0 2024-09-19T10:04:02.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.760+0000 7f76727fc640 1 -- 172.21.15.18:0/775850790 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f76780cfd90 con 0x7f76740a5460 2024-09-19T10:04:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.761+0000 7f7685daf740 1 -- 172.21.15.18:0/2702894109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 msgr2=0x5575b9a7eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.761+0000 7f7685daf740 1 --2- 172.21.15.18:0/2702894109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a7eae0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f767800be60 tx=0x7f76780046c0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.764+0000 7f7685daf740 1 -- 172.21.15.18:0/2702894109 shutdown_connections 2024-09-19T10:04:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.764+0000 7f7685daf740 1 --2- 172.21.15.18:0/2702894109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a7eae0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.764+0000 7f7685daf740 1 --2- 172.21.15.18:0/2702894109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a71950 0x5575b9a71db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.764+0000 7f7685daf740 1 --2- 172.21.15.18:0/2702894109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a71410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.764+0000 7f7685daf740 1 -- 172.21.15.18:0/2702894109 >> 172.21.15.18:0/2702894109 conn(0x5575b9a3a310 msgr2=0x5575b9a6dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.765+0000 7f7685daf740 1 -- 172.21.15.18:0/2702894109 shutdown_connections 2024-09-19T10:04:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.765+0000 7f7685daf740 1 -- 172.21.15.18:0/2702894109 wait complete. 2024-09-19T10:04:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.766+0000 7f7685daf740 1 -- start start 2024-09-19T10:04:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.766+0000 7f7685daf740 1 Processor -- start 2024-09-19T10:04:02.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.767+0000 7f7685daf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a71950 0x5575b9a7bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.767+0000 7f7685daf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a72d50 0x5575b9a791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.767+0000 7f7685daf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 0x5575b9a79730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.767+0000 7f7685daf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575b9a7f200 con 0x5575b9a7c6f0 2024-09-19T10:04:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.767+0000 7f7685daf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5575b9992060 con 0x5575b9a71950 2024-09-19T10:04:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.767+0000 7f7685daf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5575b9a7f380 con 0x5575b9a72d50 2024-09-19T10:04:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.767+0000 7f7685daf740 10 client.0 _ll_register_callbacks cb 0x5575b96e58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.781+0000 7f7681772640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a71950 0x5575b9a7bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.781+0000 7f7681772640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a71950 0x5575b9a7bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:39308/0 (socket says 172.21.15.18:39308) 2024-09-19T10:04:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.781+0000 7f7681772640 1 -- 172.21.15.18:0/1734497222 learned_addr learned my addr 172.21.15.18:0/1734497222 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:02.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.787+0000 7f7681772640 1 -- 172.21.15.18:0/1734497222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a72d50 msgr2=0x5575b9a791f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T10:04:02.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.787+0000 7f7681772640 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a72d50 0x5575b9a791f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.787+0000 7f7681772640 1 -- 172.21.15.18:0/1734497222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 msgr2=0x5575b9a79730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:02.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.787+0000 7f7681772640 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 0x5575b9a79730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.787+0000 7f7681772640 1 -- 172.21.15.18:0/1734497222 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b97483c0 con 0x5575b9a71950 2024-09-19T10:04:02.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.788+0000 7f7681f73640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76680a3390 0x7f76680a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.788+0000 7f7681772640 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a71950 0x5575b9a7bf40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f766c009460 tx=0x7f766c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76d37d5c924a545e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:02.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.788+0000 7f7664ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:04:02.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.789+0000 7f7664ff9640 1 -- 172.21.15.18:0/1734497222 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c018070 con 0x5575b9a71950 2024-09-19T10:04:02.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.790+0000 7f7685daf740 1 -- 172.21.15.18:0/1734497222 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76780df070 con 0x5575b9a71950 2024-09-19T10:04:02.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.790+0000 7f7664ff9640 1 -- 172.21.15.18:0/1734497222 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f766c005220 con 0x5575b9a71950 2024-09-19T10:04:02.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.790+0000 7f7664ff9640 1 -- 172.21.15.18:0/1734497222 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f766c005420 con 0x5575b9a71950 2024-09-19T10:04:02.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.790+0000 7f7685daf740 10 client.27512 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:02.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.791+0000 7f7685daf740 1 -- 172.21.15.18:0/1734497222 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5575b9a8acd0 con 0x5575b9a71950 2024-09-19T10:04:02.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.791+0000 7f7664ff9640 1 -- 172.21.15.18:0/1734497222 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76780df070 con 0x5575b9a71950 2024-09-19T10:04:02.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.791+0000 7f7664ff9640 1 -- 172.21.15.18:0/1734497222 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f766c01b020 con 0x5575b9a71950 2024-09-19T10:04:02.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.792+0000 7f7685daf740 10 client.27512 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:02.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.792+0000 7f7685daf740 10 client.27512 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:04:02.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.792+0000 7f7685daf740 20 client.27512 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:02.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.792+0000 7f7685daf740 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5575b9a8c5e0 0x5575b9a8ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.792+0000 7f7685daf740 4 client.27512 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:02.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.792+0000 7f7685daf740 1 -- 172.21.15.18:0/1734497222 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575b99e4860 con 0x5575b9a8c5e0 2024-09-19T10:04:02.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.793+0000 7f7680f71640 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5575b9a8c5e0 0x5575b9a8ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.798+0000 7f7680f71640 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5575b9a8c5e0 0x5575b9a8ea80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9cd1faf2c84c302 server_cookie=e7ab56efa5076f80 in_seq=0 out_seq=0 2024-09-19T10:04:02.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.798+0000 7f7664ff9640 10 client.27512 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:04:02.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.801+0000 7f7664ff9640 1 -- 172.21.15.18:0/1734497222 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575b99e4860 con 0x5575b9a8c5e0 2024-09-19T10:04:02.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.801+0000 7f7664ff9640 10 client.27512 handle_command_reply: tid=0 2024-09-19T10:04:02.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.801+0000 7f7685daf740 1 client.27512 shutdown 2024-09-19T10:04:02.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.801+0000 7f7685daf740 1 -- 172.21.15.18:0/1734497222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a71950 msgr2=0x5575b9a7bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:02.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.801+0000 7f7685daf740 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a71950 0x5575b9a7bf40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f766c009460 tx=0x7f766c009920 comp rx=0 tx=0).stop 2024-09-19T10:04:02.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.802+0000 7f7681f73640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76680a3390 0x7f76680a5850 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f767c051790 tx=0x7f767c067a30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:02.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.802+0000 7f7685daf740 1 -- 172.21.15.18:0/1734497222 shutdown_connections 2024-09-19T10:04:02.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.802+0000 7f7685daf740 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5575b9a8c5e0 0x5575b9a8ea80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.802+0000 7f7685daf740 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 0x5575b9a79730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.802+0000 7f7685daf740 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a72d50 0x5575b9a791f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.802+0000 7f7685daf740 1 --2- 172.21.15.18:0/1734497222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a71950 0x5575b9a7bf40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.802+0000 7f7685daf740 1 -- 172.21.15.18:0/1734497222 >> 172.21.15.18:0/1734497222 conn(0x5575b9a3a310 msgr2=0x5575b9a6d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:02.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.802+0000 7f7664ff9640 0 client.27512 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:04:02.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.802+0000 7f7685daf740 1 -- 172.21.15.18:0/1734497222 shutdown_connections 2024-09-19T10:04:02.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.802+0000 7f7685daf740 1 -- 172.21.15.18:0/1734497222 wait complete. 2024-09-19T10:04:02.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.804+0000 7f7685daf740 20 client.27512 trim_cache size 0 max 16384 2024-09-19T10:04:02.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.847+0000 7f7685daf740 1 Processor -- start 2024-09-19T10:04:02.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.847+0000 7f7685daf740 1 -- start start 2024-09-19T10:04:02.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.848+0000 7f7685daf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a71950 0x5575b9a791b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.848+0000 7f7685daf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a796f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.849+0000 7f7685daf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 0x5575b9a744d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.849+0000 7f7685daf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f766000e4f0 con 0x5575b9a7c6f0 2024-09-19T10:04:02.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.849+0000 7f7685daf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7660010030 con 0x5575b9a72d50 2024-09-19T10:04:02.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.849+0000 7f7685daf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f766000ebc0 con 0x5575b9a71950 2024-09-19T10:04:02.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.849+0000 7f7681f73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 0x5575b9a744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.849+0000 7f7681f73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 0x5575b9a744d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39926/0 (socket says 172.21.15.18:39926) 2024-09-19T10:04:02.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.849+0000 7f7681f73640 1 -- 172.21.15.18:0/2118412775 learned_addr learned my addr 172.21.15.18:0/2118412775 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:02.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.850+0000 7f7681772640 1 --2- 172.21.15.18:0/2118412775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a71950 0x5575b9a791b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.851+0000 7f7681f73640 1 -- 172.21.15.18:0/2118412775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a71950 msgr2=0x5575b9a791b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:02.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.851+0000 7f7681f73640 1 --2- 172.21.15.18:0/2118412775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a71950 0x5575b9a791b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.851+0000 7f7681f73640 1 -- 172.21.15.18:0/2118412775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 msgr2=0x5575b9a796f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:02.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.851+0000 7f7681f73640 1 --2- 172.21.15.18:0/2118412775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a796f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.851+0000 7f7681f73640 1 -- 172.21.15.18:0/2118412775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b9a7c2b0 con 0x5575b9a7c6f0 2024-09-19T10:04:02.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.851+0000 7f7681f73640 1 --2- 172.21.15.18:0/2118412775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 0x5575b9a744d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f767c067ce0 tx=0x7f767c09c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71955873417068a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:02.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.856+0000 7f7666ffd640 1 -- 172.21.15.18:0/2118412775 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c06e5b0 con 0x5575b9a7c6f0 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.856+0000 7f7666ffd640 1 -- 172.21.15.18:0/2118412775 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f767c0a7070 con 0x5575b9a7c6f0 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.856+0000 7f7666ffd640 1 -- 172.21.15.18:0/2118412775 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c0a2a00 con 0x5575b9a7c6f0 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.858+0000 7f7685daf740 1 -- 172.21.15.18:0/2118412775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 msgr2=0x5575b9a744d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.858+0000 7f7685daf740 1 --2- 172.21.15.18:0/2118412775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 0x5575b9a744d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f767c067ce0 tx=0x7f767c09c000 comp rx=0 tx=0).stop 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.859+0000 7f7685daf740 1 -- 172.21.15.18:0/2118412775 shutdown_connections 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.859+0000 7f7685daf740 1 --2- 172.21.15.18:0/2118412775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a7c6f0 0x5575b9a744d0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.859+0000 7f7685daf740 1 --2- 172.21.15.18:0/2118412775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a796f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.859+0000 7f7685daf740 1 --2- 172.21.15.18:0/2118412775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a71950 0x5575b9a791b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.859+0000 7f7685daf740 1 -- 172.21.15.18:0/2118412775 >> 172.21.15.18:0/2118412775 conn(0x5575b9a3a310 msgr2=0x5575b9a70f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.859+0000 7f7685daf740 1 -- 172.21.15.18:0/2118412775 shutdown_connections 2024-09-19T10:04:02.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.859+0000 7f7685daf740 1 -- 172.21.15.18:0/2118412775 wait complete. 2024-09-19T10:04:02.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.859+0000 7f7685daf740 1 -- start start 2024-09-19T10:04:02.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.860+0000 7f7685daf740 1 Processor -- start 2024-09-19T10:04:02.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.866+0000 7f7685daf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a71950 0x5575b9a7f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.866+0000 7f7685daf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a7fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.866+0000 7f7685daf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a80180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.866+0000 7f7685daf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f766000f960 con 0x5575b9a71950 2024-09-19T10:04:02.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.866+0000 7f7685daf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f766000f290 con 0x5575b9a72d50 2024-09-19T10:04:02.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.867+0000 7f7685daf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f766000c4d0 con 0x5575b9a7c6f0 2024-09-19T10:04:02.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.867+0000 7f7685daf740 10 client.0 _ll_register_callbacks cb 0x7f766c00b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:02.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.867+0000 7f7681f73640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a80180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.870+0000 7f7681f73640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a80180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33008/0 (socket says 172.21.15.18:33008) 2024-09-19T10:04:02.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.870+0000 7f7681f73640 1 -- 172.21.15.18:0/4047445733 learned_addr learned my addr 172.21.15.18:0/4047445733 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:02.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.872+0000 7f7680f71640 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a7fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.873+0000 7f7681f73640 1 -- 172.21.15.18:0/4047445733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 msgr2=0x5575b9a7fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:02.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.873+0000 7f7681f73640 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a7fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.873+0000 7f7681f73640 1 -- 172.21.15.18:0/4047445733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a71950 msgr2=0x5575b9a7f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:02.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.873+0000 7f7681f73640 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a71950 0x5575b9a7f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.873+0000 7f7681f73640 1 -- 172.21.15.18:0/4047445733 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b9af55a0 con 0x5575b9a7c6f0 2024-09-19T10:04:02.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.877+0000 7f7681f73640 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a80180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f767c050d60 tx=0x7f767c068300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fda458a66ae2a9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:02.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.878+0000 7f7664ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:04:02.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.879+0000 7f7664ff9640 1 -- 172.21.15.18:0/4047445733 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c0ba060 con 0x5575b9a7c6f0 2024-09-19T10:04:02.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.879+0000 7f7664ff9640 1 -- 172.21.15.18:0/4047445733 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f767c0a2b60 con 0x5575b9a7c6f0 2024-09-19T10:04:02.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.880+0000 7f7685daf740 1 -- 172.21.15.18:0/4047445733 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f767c0a7070 con 0x5575b9a7c6f0 2024-09-19T10:04:02.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.881+0000 7f7664ff9640 1 -- 172.21.15.18:0/4047445733 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f767c0a2430 con 0x5575b9a7c6f0 2024-09-19T10:04:02.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.881+0000 7f7685daf740 10 client.27568 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:02.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.881+0000 7f7685daf740 1 -- 172.21.15.18:0/4047445733 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5575b9af6860 con 0x5575b9a7c6f0 2024-09-19T10:04:02.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.881+0000 7f7664ff9640 1 -- 172.21.15.18:0/4047445733 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f767c092040 con 0x5575b9a7c6f0 2024-09-19T10:04:02.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.883+0000 7f7664ff9640 1 -- 172.21.15.18:0/4047445733 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f767c0ac470 con 0x5575b9a7c6f0 2024-09-19T10:04:02.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.883+0000 7f7685daf740 10 client.27568 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:02.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.883+0000 7f7685daf740 10 client.27568 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:04:02.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.883+0000 7f7685daf740 20 client.27568 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:02.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.883+0000 7f7685daf740 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5575b9af6de0 0x5575b9af91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:02.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.884+0000 7f7685daf740 4 client.27568 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:04:02.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.884+0000 7f7685daf740 1 -- 172.21.15.18:0/4047445733 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f767c0a7070 con 0x5575b9af6de0 2024-09-19T10:04:02.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.884+0000 7f7681772640 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5575b9af6de0 0x5575b9af91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.886+0000 7f7681772640 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5575b9af6de0 0x5575b9af91d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c3b78a797ef372d server_cookie=36d942b207ef1903 in_seq=0 out_seq=0 2024-09-19T10:04:02.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.886+0000 7f7664ff9640 10 client.27568 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:04:02.895 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.887+0000 7f7664ff9640 1 -- 172.21.15.18:0/4047445733 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f767c0a7070 con 0x5575b9af6de0 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.887+0000 7f7664ff9640 10 client.27568 handle_command_reply: tid=0 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.887+0000 7f7685daf740 1 client.27568 shutdown 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.887+0000 7f7685daf740 1 -- 172.21.15.18:0/4047445733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 msgr2=0x5575b9a80180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.887+0000 7f7685daf740 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a80180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f767c050d60 tx=0x7f767c068300 comp rx=0 tx=0).stop 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.888+0000 7f7685daf740 1 -- 172.21.15.18:0/4047445733 shutdown_connections 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.888+0000 7f7685daf740 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5575b9af6de0 0x5575b9af91d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.888+0000 7f7685daf740 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575b9a7c6f0 0x5575b9a80180 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.888+0000 7f7664ff9640 0 client.27568 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.888+0000 7f7685daf740 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575b9a72d50 0x5575b9a7fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.888+0000 7f7685daf740 1 --2- 172.21.15.18:0/4047445733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575b9a71950 0x5575b9a7f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.888+0000 7f7685daf740 1 -- 172.21.15.18:0/4047445733 >> 172.21.15.18:0/4047445733 conn(0x5575b9a3a310 msgr2=0x5575b9a776c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.888+0000 7f7685daf740 1 -- 172.21.15.18:0/4047445733 shutdown_connections 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.888+0000 7f7685daf740 1 -- 172.21.15.18:0/4047445733 wait complete. 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.889+0000 7f7685daf740 20 client.27568 trim_cache size 0 max 16384 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.890+0000 7f7667fff640 1 -- 172.21.15.18:0/775850790 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76680a3390 msgr2=0x7f76680a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.890+0000 7f7667fff640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76680a3390 0x7f76680a5850 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f767c051790 tx=0x7f767c067a30 comp rx=0 tx=0).stop 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.890+0000 7f7667fff640 1 -- 172.21.15.18:0/775850790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76740a5460 msgr2=0x7f76740055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.890+0000 7f7667fff640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76740a5460 0x7f76740055f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f767800b4a0 tx=0x7f767800b960 comp rx=0 tx=0).stop 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.890+0000 7f7667fff640 1 -- 172.21.15.18:0/775850790 shutdown_connections 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.890+0000 7f7667fff640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f76680a3390 0x7f76680a5850 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.890+0000 7f7667fff640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7674005b30 0x7f7674005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.890+0000 7f7667fff640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76740a5460 0x7f76740055f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.890+0000 7f7667fff640 1 --2- 172.21.15.18:0/775850790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76740a4ab0 0x7f767400b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.891+0000 7f7667fff640 1 -- 172.21.15.18:0/775850790 >> 172.21.15.18:0/775850790 conn(0x7f767401a110 msgr2=0x7f76740a84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.891+0000 7f7667fff640 1 -- 172.21.15.18:0/775850790 shutdown_connections 2024-09-19T10:04:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:02.891+0000 7f7667fff640 1 -- 172.21.15.18:0/775850790 wait complete. 2024-09-19T10:04:03.986 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T10:04:04.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:04 smithi018 ceph-mon[30956]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 750 MiB/s wr, 1.83k op/s 2024-09-19T10:04:04.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:04 smithi049 ceph-mon[34858]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 750 MiB/s wr, 1.83k op/s 2024-09-19T10:04:04.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:04 smithi162 ceph-mon[35174]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 1.4 MiB/s rd, 750 MiB/s wr, 1.83k op/s 2024-09-19T10:04:05.035 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:05.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.972+0000 7fa33b024640 1 -- 172.21.15.18:0/3710958157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa334106da0 msgr2=0x7fa33410e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:05.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.972+0000 7fa33b024640 1 --2- 172.21.15.18:0/3710958157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa334106da0 0x7fa33410e940 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009cd0 tx=0x7fa32c02a930 comp rx=0 tx=0).stop 2024-09-19T10:04:05.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.973+0000 7fa33b024640 1 -- 172.21.15.18:0/3710958157 shutdown_connections 2024-09-19T10:04:05.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.973+0000 7fa33b024640 1 --2- 172.21.15.18:0/3710958157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa334106da0 0x7fa33410e940 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:05.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.973+0000 7fa33b024640 1 --2- 172.21.15.18:0/3710958157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa334100b50 0x7fa334106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:05.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.973+0000 7fa33b024640 1 --2- 172.21.15.18:0/3710958157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3341001a0 0x7fa334100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:05.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.973+0000 7fa33b024640 1 -- 172.21.15.18:0/3710958157 >> 172.21.15.18:0/3710958157 conn(0x7fa334077090 msgr2=0x7fa3340fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:05.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.974+0000 7fa33b024640 1 -- 172.21.15.18:0/3710958157 shutdown_connections 2024-09-19T10:04:05.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.974+0000 7fa33b024640 1 -- 172.21.15.18:0/3710958157 wait complete. 2024-09-19T10:04:05.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.976+0000 7fa33b024640 1 Processor -- start 2024-09-19T10:04:05.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.976+0000 7fa33b024640 1 -- start start 2024-09-19T10:04:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.978+0000 7fa33b024640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3341001a0 0x7fa334198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:05.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.979+0000 7fa33b024640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa334100b50 0x7fa3341987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:05.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.979+0000 7fa33b024640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa334106da0 0x7fa33419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:05.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.980+0000 7fa33b024640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa334111ef0 con 0x7fa334100b50 2024-09-19T10:04:05.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.980+0000 7fa33b024640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa334111d70 con 0x7fa3341001a0 2024-09-19T10:04:05.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.980+0000 7fa33b024640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa334112070 con 0x7fa334106da0 2024-09-19T10:04:05.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.983+0000 7fa3395c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa334106da0 0x7fa33419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:05.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.984+0000 7fa3395c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa334106da0 0x7fa33419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33028/0 (socket says 172.21.15.18:33028) 2024-09-19T10:04:05.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.984+0000 7fa3395c1640 1 -- 172.21.15.18:0/1252056948 learned_addr learned my addr 172.21.15.18:0/1252056948 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:05.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.985+0000 7fa3395c1640 1 -- 172.21.15.18:0/1252056948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3341001a0 msgr2=0x7fa334198290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T10:04:05.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.985+0000 7fa3395c1640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3341001a0 0x7fa334198290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:05.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.985+0000 7fa3395c1640 1 -- 172.21.15.18:0/1252056948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa334100b50 msgr2=0x7fa3341987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:05.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.985+0000 7fa3395c1640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa334100b50 0x7fa3341987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:05.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.985+0000 7fa3395c1640 1 -- 172.21.15.18:0/1252056948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33419d240 con 0x7fa334106da0 2024-09-19T10:04:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.987+0000 7fa3395c1640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa334106da0 0x7fa33419cb60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009620 tx=0x7fa32c031690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.988+0000 7fa331ffb640 1 -- 172.21.15.18:0/1252056948 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c004040 con 0x7fa334106da0 2024-09-19T10:04:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.989+0000 7fa331ffb640 1 -- 172.21.15.18:0/1252056948 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa32c02d070 con 0x7fa334106da0 2024-09-19T10:04:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.989+0000 7fa33b024640 1 -- 172.21.15.18:0/1252056948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33419d4d0 con 0x7fa334106da0 2024-09-19T10:04:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.989+0000 7fa33b024640 1 -- 172.21.15.18:0/1252056948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33419d9a0 con 0x7fa334106da0 2024-09-19T10:04:05.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.995+0000 7fa33d3fd740 1 Processor -- start 2024-09-19T10:04:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.995+0000 7fa33d3fd740 1 -- start start 2024-09-19T10:04:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.995+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x56399504ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.995+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 0x563995053910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.995+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995054390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.995+0000 7fa33d3fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563994faa2f0 con 0x56399504f290 2024-09-19T10:04:06.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.995+0000 7fa33d3fd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563994f51cf0 con 0x56399504e8e0 2024-09-19T10:04:06.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:05.995+0000 7fa33d3fd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563994fa62b0 con 0x563995053ee0 2024-09-19T10:04:06.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.002+0000 7fa331ffb640 1 -- 172.21.15.18:0/1252056948 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c02fd70 con 0x7fa334106da0 2024-09-19T10:04:06.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.002+0000 7fa331ffb640 1 -- 172.21.15.18:0/1252056948 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa32c0305f0 con 0x7fa334106da0 2024-09-19T10:04:06.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.004+0000 7fa333fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995054390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.004+0000 7fa333fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x56399504ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.004+0000 7fa333fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x56399504ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:39348/0 (socket says 172.21.15.18:39348) 2024-09-19T10:04:06.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.004+0000 7fa333fff640 1 -- 172.21.15.18:0/3015654575 learned_addr learned my addr 172.21.15.18:0/3015654575 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:06.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.004+0000 7fa331ffb640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3240a33b0 0x7fa3240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.005+0000 7fa331ffb640 1 -- 172.21.15.18:0/1252056948 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa32c0f2710 con 0x7fa334106da0 2024-09-19T10:04:06.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.006+0000 7fa333fff640 1 -- 172.21.15.18:0/3015654575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 msgr2=0x56399504ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:06.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.006+0000 7fa333fff640 1 --2- 172.21.15.18:0/3015654575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x56399504ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.006+0000 7fa333fff640 1 -- 172.21.15.18:0/3015654575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 msgr2=0x563995053910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T10:04:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.006+0000 7fa333fff640 1 --2- 172.21.15.18:0/3015654575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 0x563995053910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.006+0000 7fa333fff640 1 -- 172.21.15.18:0/3015654575 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563994f363a0 con 0x563995053ee0 2024-09-19T10:04:06.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.007+0000 7fa333fff640 1 --2- 172.21.15.18:0/3015654575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995054390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa3280153d0 tx=0x7fa3280099b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e04e721cfb2eeed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.007+0000 7fa31e7fc640 1 -- 172.21.15.18:0/3015654575 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328012040 con 0x563995053ee0 2024-09-19T10:04:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.008+0000 7fa31e7fc640 1 -- 172.21.15.18:0/3015654575 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa328001b70 con 0x563995053ee0 2024-09-19T10:04:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.008+0000 7fa31e7fc640 1 -- 172.21.15.18:0/3015654575 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328018640 con 0x563995053ee0 2024-09-19T10:04:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.009+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3015654575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 msgr2=0x563995054390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.009+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/3015654575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995054390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa3280153d0 tx=0x7fa3280099b0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.010+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3015654575 shutdown_connections 2024-09-19T10:04:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.010+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/3015654575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995054390 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.010+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/3015654575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 0x563995053910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.010+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/3015654575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x56399504ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.010+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3015654575 >> 172.21.15.18:0/3015654575 conn(0x56399500d310 msgr2=0x563995040b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:06.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.012+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3015654575 shutdown_connections 2024-09-19T10:04:06.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.012+0000 7fa3395c1640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3240a33b0 0x7fa3240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.012+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3015654575 wait complete. 2024-09-19T10:04:06.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.013+0000 7fa33d3fd740 1 -- start start 2024-09-19T10:04:06.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.014+0000 7fa33d3fd740 1 Processor -- start 2024-09-19T10:04:06.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.015+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504e8e0 0x56399505a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.016+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56399504f290 0x5639950573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.016+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563995053ee0 0x5639950578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.016+0000 7fa33d3fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56399506bc30 con 0x56399504e8e0 2024-09-19T10:04:06.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.016+0000 7fa33d3fd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563994f65060 con 0x563995053ee0 2024-09-19T10:04:06.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.016+0000 7fa33d3fd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56399506bdb0 con 0x56399504f290 2024-09-19T10:04:06.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.016+0000 7fa33d3fd740 10 client.0 _ll_register_callbacks cb 0x563994cb88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:06.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.022+0000 7fa333fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563995053ee0 0x5639950578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.022+0000 7fa333fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504e8e0 0x56399505a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.023+0000 7fa333fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504e8e0 0x56399505a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39960/0 (socket says 172.21.15.18:39960) 2024-09-19T10:04:06.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.023+0000 7fa333fff640 1 -- 172.21.15.18:0/3231930743 learned_addr learned my addr 172.21.15.18:0/3231930743 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:06.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.023+0000 7fa338dc0640 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56399504f290 0x5639950573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.028+0000 7fa333fff640 1 -- 172.21.15.18:0/3231930743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56399504f290 msgr2=0x5639950573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:06.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.028+0000 7fa333fff640 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56399504f290 0x5639950573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.028+0000 7fa333fff640 1 -- 172.21.15.18:0/3231930743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563995053ee0 msgr2=0x5639950578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:06.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.028+0000 7fa333fff640 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563995053ee0 0x5639950578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.028+0000 7fa333fff640 1 -- 172.21.15.18:0/3231930743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563994d1b3c0 con 0x56399504e8e0 2024-09-19T10:04:06.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.028+0000 7fa3395c1640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3240a33b0 0x7fa3240a5870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0c74c0 tx=0x7fa32c0f2910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:06.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.029+0000 7fa313fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:06.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.030+0000 7fa333fff640 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504e8e0 0x56399505a0f0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa328001670 tx=0x7fa328004bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffb36228b54613c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:06.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.030+0000 7fa313fff640 1 -- 172.21.15.18:0/3231930743 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32801f030 con 0x56399504e8e0 2024-09-19T10:04:06.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.031+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3231930743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa328001b70 con 0x56399504e8e0 2024-09-19T10:04:06.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.031+0000 7fa313fff640 1 -- 172.21.15.18:0/3231930743 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa328015da0 con 0x56399504e8e0 2024-09-19T10:04:06.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.032+0000 7fa313fff640 1 -- 172.21.15.18:0/3231930743 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa32801f030 con 0x56399504e8e0 2024-09-19T10:04:06.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.032+0000 7fa33d3fd740 10 client.18069 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:06.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.032+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3231930743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5639950774a0 con 0x56399504e8e0 2024-09-19T10:04:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.034+0000 7fa313fff640 1 -- 172.21.15.18:0/3231930743 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa328001b70 con 0x56399504e8e0 2024-09-19T10:04:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.034+0000 7fa313fff640 1 -- 172.21.15.18:0/3231930743 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa328008900 con 0x56399504e8e0 2024-09-19T10:04:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.034+0000 7fa33d3fd740 10 client.18069 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.034+0000 7fa33d3fd740 10 client.18069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.034+0000 7fa33d3fd740 20 client.18069 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.035+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563995078cc0 0x56399507b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.035+0000 7fa33d3fd740 4 client.18069 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.035+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3231930743 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563994fb7860 con 0x563995078cc0 2024-09-19T10:04:06.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.039+0000 7fa338dc0640 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563995078cc0 0x56399507b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.041+0000 7fa313fff640 10 client.18069 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:06.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.042+0000 7fa338dc0640 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563995078cc0 0x56399507b140 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efc1e5ad8697f4b8 server_cookie=23ce2b81d9dc7ff5 in_seq=0 out_seq=0 2024-09-19T10:04:06.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.049+0000 7fa313fff640 1 -- 172.21.15.18:0/3231930743 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563994fb7860 con 0x563995078cc0 2024-09-19T10:04:06.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.049+0000 7fa313fff640 10 client.18069 handle_command_reply: tid=0 2024-09-19T10:04:06.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.049+0000 7fa33d3fd740 1 client.18069 shutdown 2024-09-19T10:04:06.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.049+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3231930743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504e8e0 msgr2=0x56399505a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:06.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.050+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504e8e0 0x56399505a0f0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa328001670 tx=0x7fa328004bd0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.050+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3231930743 shutdown_connections 2024-09-19T10:04:06.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.050+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x563995078cc0 0x56399507b140 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.050+0000 7fa313fff640 0 client.18069 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:06.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.050+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563995053ee0 0x5639950578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.050+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56399504f290 0x5639950573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.050+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/3231930743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504e8e0 0x56399505a0f0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.050+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3231930743 >> 172.21.15.18:0/3231930743 conn(0x56399500d310 msgr2=0x56399504df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:06.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.051+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3231930743 shutdown_connections 2024-09-19T10:04:06.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.051+0000 7fa33d3fd740 1 -- 172.21.15.18:0/3231930743 wait complete. 2024-09-19T10:04:06.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.051+0000 7fa33d3fd740 20 client.18069 trim_cache size 0 max 16384 2024-09-19T10:04:06.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.101+0000 7fa33d3fd740 1 Processor -- start 2024-09-19T10:04:06.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.104+0000 7fa33d3fd740 1 -- start start 2024-09-19T10:04:06.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.105+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x563995052690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.106+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 0x563995080a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.106+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995080f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.106+0000 7fa333fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x563995052690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.106+0000 7fa333fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x563995052690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:39364/0 (socket says 172.21.15.18:39364) 2024-09-19T10:04:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.107+0000 7fa333fff640 1 -- 172.21.15.18:0/2859815901 learned_addr learned my addr 172.21.15.18:0/2859815901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.107+0000 7fa33d3fd740 1 -- 172.21.15.18:0/2859815901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa31800e680 con 0x56399504f290 2024-09-19T10:04:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.107+0000 7fa33d3fd740 1 -- 172.21.15.18:0/2859815901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa3180101c0 con 0x56399504e8e0 2024-09-19T10:04:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.108+0000 7fa33d3fd740 1 -- 172.21.15.18:0/2859815901 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa31800ed50 con 0x563995053ee0 2024-09-19T10:04:06.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.109+0000 7fa333fff640 1 --2- 172.21.15.18:0/2859815901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995080f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.111+0000 7fa333fff640 1 -- 172.21.15.18:0/2859815901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 msgr2=0x563995080f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:06.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.111+0000 7fa333fff640 1 --2- 172.21.15.18:0/2859815901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995080f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.111+0000 7fa333fff640 1 -- 172.21.15.18:0/2859815901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 msgr2=0x563995080a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:06.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.111+0000 7fa333fff640 1 --2- 172.21.15.18:0/2859815901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 0x563995080a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.111+0000 7fa333fff640 1 -- 172.21.15.18:0/2859815901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56399501a800 con 0x56399504e8e0 2024-09-19T10:04:06.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.117+0000 7fa333fff640 1 --2- 172.21.15.18:0/2859815901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x563995052690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa328000c00 tx=0x7fa328027e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0d5725fd73cf254 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.119+0000 7fa31dffb640 1 -- 172.21.15.18:0/2859815901 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328030040 con 0x56399504e8e0 2024-09-19T10:04:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.120+0000 7fa31dffb640 1 -- 172.21.15.18:0/2859815901 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa328004a20 con 0x56399504e8e0 2024-09-19T10:04:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.121+0000 7fa33d3fd740 1 -- 172.21.15.18:0/2859815901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 msgr2=0x563995052690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.121+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/2859815901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x563995052690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa328000c00 tx=0x7fa328027e30 comp rx=0 tx=0).stop 2024-09-19T10:04:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.122+0000 7fa33d3fd740 1 -- 172.21.15.18:0/2859815901 shutdown_connections 2024-09-19T10:04:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.122+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/2859815901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995080f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.122+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/2859815901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 0x563995080a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.122+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/2859815901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56399504e8e0 0x563995052690 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.122+0000 7fa33d3fd740 1 -- 172.21.15.18:0/2859815901 >> 172.21.15.18:0/2859815901 conn(0x56399500d310 msgr2=0x56399504df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:06.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.122+0000 7fa33d3fd740 1 -- 172.21.15.18:0/2859815901 shutdown_connections 2024-09-19T10:04:06.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.122+0000 7fa33d3fd740 1 -- 172.21.15.18:0/2859815901 wait complete. 2024-09-19T10:04:06.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.123+0000 7fa33d3fd740 1 -- start start 2024-09-19T10:04:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.123+0000 7fa33d3fd740 1 Processor -- start 2024-09-19T10:04:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.124+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 0x5639950710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.124+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.124+0000 7fa33d3fd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563995071b50 0x56399506e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.124+0000 7fa33d3fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa31800faf0 con 0x56399504f290 2024-09-19T10:04:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.125+0000 7fa33d3fd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa31800f420 con 0x563995071b50 2024-09-19T10:04:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.125+0000 7fa33d3fd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa31800c600 con 0x563995053ee0 2024-09-19T10:04:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.125+0000 7fa33d3fd740 10 client.0 _ll_register_callbacks cb 0x7fa328001540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.127+0000 7fa338dc0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.127+0000 7fa338dc0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:33056/0 (socket says 172.21.15.18:33056) 2024-09-19T10:04:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.127+0000 7fa338dc0640 1 -- 172.21.15.18:0/9335106 learned_addr learned my addr 172.21.15.18:0/9335106 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.127+0000 7fa333fff640 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563995071b50 0x56399506e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.127+0000 7fa333fff640 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 0x5639950710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.130+0000 7fa338dc0640 1 -- 172.21.15.18:0/9335106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563995071b50 msgr2=0x56399506e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.130+0000 7fa338dc0640 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563995071b50 0x56399506e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.130+0000 7fa338dc0640 1 -- 172.21.15.18:0/9335106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 msgr2=0x5639950710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.130+0000 7fa338dc0640 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 0x5639950710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.130+0000 7fa338dc0640 1 -- 172.21.15.18:0/9335106 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56399506e8f0 con 0x563995053ee0 2024-09-19T10:04:06.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.132+0000 7fa338dc0640 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995071610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa32000b6d0 tx=0x7fa320014780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71577c8888059576 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:06.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.132+0000 7fa3137fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:04:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.133+0000 7fa3137fe640 1 -- 172.21.15.18:0/9335106 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320022060 con 0x563995053ee0 2024-09-19T10:04:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.134+0000 7fa33d3fd740 1 -- 172.21.15.18:0/9335106 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563994fb1d70 con 0x563995053ee0 2024-09-19T10:04:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.134+0000 7fa3137fe640 1 -- 172.21.15.18:0/9335106 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa32000f040 con 0x563995053ee0 2024-09-19T10:04:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.135+0000 7fa3137fe640 1 -- 172.21.15.18:0/9335106 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa32001d440 con 0x563995053ee0 2024-09-19T10:04:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.135+0000 7fa33d3fd740 10 client.27583 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.135+0000 7fa33d3fd740 1 -- 172.21.15.18:0/9335106 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5639950e45e0 con 0x563995053ee0 2024-09-19T10:04:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.136+0000 7fa3137fe640 1 -- 172.21.15.18:0/9335106 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563994fb1d70 con 0x563995053ee0 2024-09-19T10:04:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.138+0000 7fa3137fe640 1 -- 172.21.15.18:0/9335106 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa32001c4e0 con 0x563995053ee0 2024-09-19T10:04:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.138+0000 7fa33d3fd740 10 client.27583 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.138+0000 7fa33d3fd740 10 client.27583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.138+0000 7fa33d3fd740 20 client.27583 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.138+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5639950e4ce0 0x5639950e7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.138+0000 7fa33d3fd740 4 client.27583 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:04:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.138+0000 7fa33d3fd740 1 -- 172.21.15.18:0/9335106 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563994f2e170 con 0x5639950e4ce0 2024-09-19T10:04:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.140+0000 7fa333fff640 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5639950e4ce0 0x5639950e7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.143+0000 7fa333fff640 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5639950e4ce0 0x5639950e7100 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18e2fc8358d4a3b1 server_cookie=e0da511d36a10229 in_seq=0 out_seq=0 2024-09-19T10:04:06.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.143+0000 7fa3137fe640 10 client.27583 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.149+0000 7fa3137fe640 1 -- 172.21.15.18:0/9335106 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563994f2e170 con 0x5639950e4ce0 2024-09-19T10:04:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.149+0000 7fa3137fe640 10 client.27583 handle_command_reply: tid=0 2024-09-19T10:04:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 client.27583 shutdown 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 -- 172.21.15.18:0/9335106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 msgr2=0x563995071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995071610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa32000b6d0 tx=0x7fa320014780 comp rx=0 tx=0).stop 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 -- 172.21.15.18:0/9335106 shutdown_connections 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x5639950e4ce0 0x5639950e7100 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563995071b50 0x56399506e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563995053ee0 0x563995071610 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 --2- 172.21.15.18:0/9335106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56399504f290 0x5639950710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 -- 172.21.15.18:0/9335106 >> 172.21.15.18:0/9335106 conn(0x56399500d310 msgr2=0x56399503fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa3137fe640 0 client.27583 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 -- 172.21.15.18:0/9335106 shutdown_connections 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 1 -- 172.21.15.18:0/9335106 wait complete. 2024-09-19T10:04:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.150+0000 7fa33d3fd740 20 client.27583 trim_cache size 0 max 16384 2024-09-19T10:04:06.157 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:04:06.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.158+0000 7fa31f7fe640 1 -- 172.21.15.18:0/1252056948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3240a33b0 msgr2=0x7fa3240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:06.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.158+0000 7fa31f7fe640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3240a33b0 0x7fa3240a5870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0c74c0 tx=0x7fa32c0f2910 comp rx=0 tx=0).stop 2024-09-19T10:04:06.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.158+0000 7fa31f7fe640 1 -- 172.21.15.18:0/1252056948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa334106da0 msgr2=0x7fa33419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:06.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.158+0000 7fa31f7fe640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa334106da0 0x7fa33419cb60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009620 tx=0x7fa32c031690 comp rx=0 tx=0).stop 2024-09-19T10:04:06.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.159+0000 7fa31f7fe640 1 -- 172.21.15.18:0/1252056948 shutdown_connections 2024-09-19T10:04:06.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.159+0000 7fa31f7fe640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fa3240a33b0 0x7fa3240a5870 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.159+0000 7fa31f7fe640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa334106da0 0x7fa33419cb60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.159+0000 7fa31f7fe640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa334100b50 0x7fa3341987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.159+0000 7fa31f7fe640 1 --2- 172.21.15.18:0/1252056948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3341001a0 0x7fa334198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:06.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.159+0000 7fa31f7fe640 1 -- 172.21.15.18:0/1252056948 >> 172.21.15.18:0/1252056948 conn(0x7fa334077090 msgr2=0x7fa334105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:06.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.159+0000 7fa31f7fe640 1 -- 172.21.15.18:0/1252056948 shutdown_connections 2024-09-19T10:04:06.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:06.159+0000 7fa31f7fe640 1 -- 172.21.15.18:0/1252056948 wait complete. 2024-09-19T10:04:06.638 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:06 smithi018 ceph-mon[30956]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 832 MiB/s wr, 1.87k op/s 2024-09-19T10:04:06.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:06 smithi049 ceph-mon[34858]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 832 MiB/s wr, 1.87k op/s 2024-09-19T10:04:06.664 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:06 smithi162 ceph-mon[35174]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 832 MiB/s wr, 1.87k op/s 2024-09-19T10:04:08.239 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T10:04:08.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T10:04:08.637 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:08 smithi018 ceph-mon[30956]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 805 MiB/s wr, 1.83k op/s 2024-09-19T10:04:08.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:08 smithi049 ceph-mon[34858]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 805 MiB/s wr, 1.83k op/s 2024-09-19T10:04:08.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:08 smithi162 ceph-mon[35174]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 805 MiB/s wr, 1.83k op/s 2024-09-19T10:04:09.305 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:09.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:09 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:04:09.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:09 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:04:09.774 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:09 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:04:09.986 INFO:tasks.workunit.client.0.smithi018.stdout:stopping iogen 2024-09-19T10:04:09.986 INFO:tasks.workunit.client.0.smithi018.stderr:+ echo 'stopping iogen' 2024-09-19T10:04:09.986 INFO:tasks.workunit.client.0.smithi018.stderr:+ ./iogen -k 2024-09-19T10:04:10.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.321+0000 7fafbc014640 1 -- 172.21.15.18:0/69610668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb410ae80 msgr2=0x7fafb41091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:10.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.321+0000 7fafbc014640 1 --2- 172.21.15.18:0/69610668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb410ae80 0x7fafb41091f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009930 tx=0x7fafa402a460 comp rx=0 tx=0).stop 2024-09-19T10:04:10.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.323+0000 7fafbc014640 1 -- 172.21.15.18:0/69610668 shutdown_connections 2024-09-19T10:04:10.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.323+0000 7fafbc014640 1 --2- 172.21.15.18:0/69610668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafb4109810 0x7fafb4109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.323+0000 7fafbc014640 1 --2- 172.21.15.18:0/69610668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb410ae80 0x7fafb41091f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.323+0000 7fafbc014640 1 --2- 172.21.15.18:0/69610668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb410a560 0x7fafb410a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.323+0000 7fafbc014640 1 -- 172.21.15.18:0/69610668 >> 172.21.15.18:0/69610668 conn(0x7fafb406e140 msgr2=0x7fafb406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.325+0000 7fafbc014640 1 -- 172.21.15.18:0/69610668 shutdown_connections 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.325+0000 7fafbc014640 1 -- 172.21.15.18:0/69610668 wait complete. 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.326+0000 7fafbc014640 1 Processor -- start 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.326+0000 7fafbc014640 1 -- start start 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.327+0000 7fafbc014640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb4109810 0x7fafb4117870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.327+0000 7fafbc014640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafb410a560 0x7fafb4117db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.327+0000 7fafbc014640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb410ae80 0x7fafb41182f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.328+0000 7fafb9db0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb4109810 0x7fafb4117870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.328+0000 7fafb9db0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb4109810 0x7fafb4117870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60852/0 (socket says 172.21.15.18:60852) 2024-09-19T10:04:10.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.328+0000 7fafbc014640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fafb411ca10 con 0x7fafb410a560 2024-09-19T10:04:10.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.328+0000 7fafbc014640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fafb411c890 con 0x7fafb4109810 2024-09-19T10:04:10.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.328+0000 7fafbc014640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fafb411cb90 con 0x7fafb410ae80 2024-09-19T10:04:10.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.328+0000 7fafb9db0640 1 -- 172.21.15.18:0/3005365366 learned_addr learned my addr 172.21.15.18:0/3005365366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:10.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.329+0000 7fafb95af640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafb410a560 0x7fafb4117db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.329+0000 7fafba5b1640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb410ae80 0x7fafb41182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.331+0000 7fafba5b1640 1 -- 172.21.15.18:0/3005365366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb4109810 msgr2=0x7fafb4117870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:10.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.331+0000 7fafba5b1640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb4109810 0x7fafb4117870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.331+0000 7fafba5b1640 1 -- 172.21.15.18:0/3005365366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafb410a560 msgr2=0x7fafb4117db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:10.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.331+0000 7fafba5b1640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafb410a560 0x7fafb4117db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.331+0000 7fafba5b1640 1 -- 172.21.15.18:0/3005365366 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb41b3540 con 0x7fafb410ae80 2024-09-19T10:04:10.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.335+0000 7fafba5b1640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb410ae80 0x7fafb41182f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fafac00e940 tx=0x7fafac00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:10.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.335+0000 7fafaaffd640 1 -- 172.21.15.18:0/3005365366 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac004d20 con 0x7fafb410ae80 2024-09-19T10:04:10.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.335+0000 7fafaaffd640 1 -- 172.21.15.18:0/3005365366 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafac005020 con 0x7fafb410ae80 2024-09-19T10:04:10.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.335+0000 7fafaaffd640 1 -- 172.21.15.18:0/3005365366 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac0116b0 con 0x7fafb410ae80 2024-09-19T10:04:10.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.338+0000 7fafbc014640 1 -- 172.21.15.18:0/3005365366 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb41b3830 con 0x7fafb410ae80 2024-09-19T10:04:10.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.338+0000 7fafbc014640 1 -- 172.21.15.18:0/3005365366 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb41b3c90 con 0x7fafb410ae80 2024-09-19T10:04:10.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.353+0000 7fafbe3ed740 1 Processor -- start 2024-09-19T10:04:10.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.355+0000 7fafbe3ed740 1 -- start start 2024-09-19T10:04:10.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.355+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73eb60 0x56495f73ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.355+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73f480 0x56495f749800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.355+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f749d40 0x56495f74c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.355+0000 7fafbe3ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56495f6a4280 con 0x56495f73f480 2024-09-19T10:04:10.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.355+0000 7fafbe3ed740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56495f64bb10 con 0x56495f749d40 2024-09-19T10:04:10.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.355+0000 7fafbe3ed740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56495f6a0240 con 0x56495f73eb60 2024-09-19T10:04:10.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.356+0000 7fafaaffd640 1 -- 172.21.15.18:0/3005365366 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fafac011850 con 0x7fafb410ae80 2024-09-19T10:04:10.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.357+0000 7fafb95af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f749d40 0x56495f74c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.357+0000 7fafb95af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73eb60 0x56495f73ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.357+0000 7fafb95af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f749d40 0x56495f74c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60868/0 (socket says 172.21.15.18:60868) 2024-09-19T10:04:10.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.357+0000 7fafb95af640 1 -- 172.21.15.18:0/2051945754 learned_addr learned my addr 172.21.15.18:0/2051945754 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:10.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.358+0000 7fafb9db0640 1 --2- 172.21.15.18:0/2051945754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73f480 0x56495f749800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.359+0000 7fafb95af640 1 -- 172.21.15.18:0/2051945754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73eb60 msgr2=0x56495f73ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:10.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.359+0000 7fafb95af640 1 --2- 172.21.15.18:0/2051945754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73eb60 0x56495f73ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.359+0000 7fafb95af640 1 -- 172.21.15.18:0/2051945754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73f480 msgr2=0x56495f749800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:10.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.359+0000 7fafb95af640 1 --2- 172.21.15.18:0/2051945754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73f480 0x56495f749800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.359+0000 7fafb95af640 1 -- 172.21.15.18:0/2051945754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56495f6581f0 con 0x56495f749d40 2024-09-19T10:04:10.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.359+0000 7fafb9db0640 1 --2- 172.21.15.18:0/2051945754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73f480 0x56495f749800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:04:10.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.359+0000 7fafaaffd640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fafa00a3380 0x7fafa00a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.360+0000 7fafaaffd640 1 -- 172.21.15.18:0/3005365366 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fafac0cf940 con 0x7fafb410ae80 2024-09-19T10:04:10.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.361+0000 7fafb9db0640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fafa00a3380 0x7fafa00a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.362+0000 7fafb95af640 1 --2- 172.21.15.18:0/2051945754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f749d40 0x56495f74c130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fafa402aa50 tx=0x7fafa4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba6c68225ca28de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.363+0000 7faf9ffff640 1 -- 172.21.15.18:0/2051945754 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4035050 con 0x56495f749d40 2024-09-19T10:04:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.363+0000 7faf9ffff640 1 -- 172.21.15.18:0/2051945754 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafa4044070 con 0x56495f749d40 2024-09-19T10:04:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.363+0000 7faf9ffff640 1 -- 172.21.15.18:0/2051945754 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa40035f0 con 0x56495f749d40 2024-09-19T10:04:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.364+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2051945754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f749d40 msgr2=0x56495f74c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.364+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/2051945754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f749d40 0x56495f74c130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fafa402aa50 tx=0x7fafa4000bc0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.364+0000 7fafb9db0640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fafa00a3380 0x7fafa00a5840 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x56495f73bf50 tx=0x7fafb000c480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:10.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.364+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2051945754 shutdown_connections 2024-09-19T10:04:10.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.364+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/2051945754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f749d40 0x56495f74c130 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fafa402aa50 tx=0x7fafa4000bc0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.364+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/2051945754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73f480 0x56495f749800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.364+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/2051945754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73eb60 0x56495f73ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.364+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2051945754 >> 172.21.15.18:0/2051945754 conn(0x56495f73b0f0 msgr2=0x56495f73b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:10.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.365+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2051945754 shutdown_connections 2024-09-19T10:04:10.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.365+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2051945754 wait complete. 2024-09-19T10:04:10.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.368+0000 7fafbe3ed740 1 -- start start 2024-09-19T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.370+0000 7fafbe3ed740 1 Processor -- start 2024-09-19T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.371+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 0x56495f746db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.372+0000 7fafb9db0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 0x56495f746db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.373+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f7472f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.373+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f747830 0x56495f755e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.373+0000 7fafba5b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f747830 0x56495f755e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.373+0000 7fafb95af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f7472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.373+0000 7fafba5b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f747830 0x56495f755e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60880/0 (socket says 172.21.15.18:60880) 2024-09-19T10:04:10.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.374+0000 7fafb9db0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 0x56495f746db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45322/0 (socket says 172.21.15.18:45322) 2024-09-19T10:04:10.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.374+0000 7fafb95af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f7472f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52830/0 (socket says 172.21.15.18:52830) 2024-09-19T10:04:10.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.374+0000 7fafba5b1640 1 -- 172.21.15.18:0/2815532371 learned_addr learned my addr 172.21.15.18:0/2815532371 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:10.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.375+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56495f74c910 con 0x56495f73eb60 2024-09-19T10:04:10.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.375+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56495f65ef10 con 0x56495f747830 2024-09-19T10:04:10.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.375+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56495f74ca90 con 0x56495f73f480 2024-09-19T10:04:10.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.375+0000 7fafbe3ed740 10 client.0 _ll_register_callbacks cb 0x56495f627a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:10.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.377+0000 7fafba5b1640 1 -- 172.21.15.18:0/2815532371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 msgr2=0x56495f7472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:10.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.377+0000 7fafba5b1640 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f7472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.377+0000 7fafba5b1640 1 -- 172.21.15.18:0/2815532371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 msgr2=0x56495f746db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.377+0000 7fafba5b1640 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 0x56495f746db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.377+0000 7fafba5b1640 1 -- 172.21.15.18:0/2815532371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56495f4156a0 con 0x56495f747830 2024-09-19T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.377+0000 7fafba5b1640 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f747830 0x56495f755e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fafac098390 tx=0x7fafac09bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81c0a12814285e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.377+0000 7faf9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.377+0000 7faf9d7fa640 1 -- 172.21.15.18:0/2815532371 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac01f030 con 0x56495f747830 2024-09-19T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.377+0000 7faf9d7fa640 1 -- 172.21.15.18:0/2815532371 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fafac0bad70 con 0x56495f747830 2024-09-19T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.378+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafa4044070 con 0x56495f747830 2024-09-19T10:04:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.388+0000 7faf9d7fa640 1 -- 172.21.15.18:0/2815532371 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fafac0a4ba0 con 0x56495f747830 2024-09-19T10:04:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.389+0000 7fafbe3ed740 10 client.27539 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.389+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56495f758c00 con 0x56495f747830 2024-09-19T10:04:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.414+0000 7faf9d7fa640 1 -- 172.21.15.18:0/2815532371 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafac07ab60 con 0x56495f747830 2024-09-19T10:04:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.414+0000 7faf9d7fa640 1 -- 172.21.15.18:0/2815532371 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fafac00f040 con 0x56495f747830 2024-09-19T10:04:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.414+0000 7fafbe3ed740 10 client.27539 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.414+0000 7fafbe3ed740 10 client.27539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.414+0000 7fafbe3ed740 20 client.27539 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.414+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56495f75a010 0x56495f75c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.415+0000 7fafbe3ed740 4 client.27539 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.415+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fafa4044070 con 0x56495f75a010 2024-09-19T10:04:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.418+0000 7fafb9db0640 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56495f75a010 0x56495f75c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.434+0000 7fafb9db0640 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56495f75a010 0x56495f75c400 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be7ca3a2d7c686b3 server_cookie=c076175810181d58 in_seq=0 out_seq=0 2024-09-19T10:04:10.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.434+0000 7faf9d7fa640 10 client.27539 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:10.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.439+0000 7faf9d7fa640 1 -- 172.21.15.18:0/2815532371 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fafa4044070 con 0x56495f75a010 2024-09-19T10:04:10.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.439+0000 7faf9d7fa640 10 client.27539 handle_command_reply: tid=0 2024-09-19T10:04:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.439+0000 7fafbe3ed740 1 client.27539 shutdown 2024-09-19T10:04:10.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.441+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f747830 msgr2=0x56495f755e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.441+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f747830 0x56495f755e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fafac098390 tx=0x7fafac09bf30 comp rx=0 tx=0).stop 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.442+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 shutdown_connections 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.442+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56495f75a010 0x56495f75c400 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.442+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f747830 0x56495f755e10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.442+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f7472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.442+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/2815532371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 0x56495f746db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.442+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 >> 172.21.15.18:0/2815532371 conn(0x56495f73b0f0 msgr2=0x56495f740e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.442+0000 7faf9d7fa640 0 client.27539 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.442+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 shutdown_connections 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.442+0000 7fafbe3ed740 1 -- 172.21.15.18:0/2815532371 wait complete. 2024-09-19T10:04:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.443+0000 7fafbe3ed740 20 client.27539 trim_cache size 0 max 16384 2024-09-19T10:04:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.484+0000 7fafbe3ed740 1 Processor -- start 2024-09-19T10:04:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.484+0000 7fafbe3ed740 1 -- start start 2024-09-19T10:04:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.485+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f73eb60 0x56495f755c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.485+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f761c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.485+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f747830 0x56495f7621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.485+0000 7fafbe3ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faf9800e3f0 con 0x56495f747830 2024-09-19T10:04:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.485+0000 7fafbe3ed740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faf9800ff30 con 0x56495f73eb60 2024-09-19T10:04:10.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.485+0000 7fafbe3ed740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf9800eac0 con 0x56495f73f480 2024-09-19T10:04:10.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.485+0000 7fafba5b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f747830 0x56495f7621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.485+0000 7fafba5b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f747830 0x56495f7621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45338/0 (socket says 172.21.15.18:45338) 2024-09-19T10:04:10.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.485+0000 7fafba5b1640 1 -- 172.21.15.18:0/60864602 learned_addr learned my addr 172.21.15.18:0/60864602 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:10.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.488+0000 7fafb95af640 1 --2- 172.21.15.18:0/60864602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f761c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.489+0000 7fafb9db0640 1 --2- 172.21.15.18:0/60864602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f73eb60 0x56495f755c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.490+0000 7fafba5b1640 1 -- 172.21.15.18:0/60864602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 msgr2=0x56495f761c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.490+0000 7fafba5b1640 1 --2- 172.21.15.18:0/60864602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f761c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.490+0000 7fafba5b1640 1 -- 172.21.15.18:0/60864602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f73eb60 msgr2=0x56495f755c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.490+0000 7fafba5b1640 1 --2- 172.21.15.18:0/60864602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f73eb60 0x56495f755c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.490+0000 7fafba5b1640 1 -- 172.21.15.18:0/60864602 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56495f74c4a0 con 0x56495f747830 2024-09-19T10:04:10.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.491+0000 7fafba5b1640 1 --2- 172.21.15.18:0/60864602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f747830 0x56495f7621c0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fafac09c7e0 tx=0x7fafac00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b0b0b551862fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:10.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.521+0000 7faf9f7fe640 1 -- 172.21.15.18:0/60864602 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac01f040 con 0x56495f747830 2024-09-19T10:04:10.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.527+0000 7faf9f7fe640 1 -- 172.21.15.18:0/60864602 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafac097fd0 con 0x56495f747830 2024-09-19T10:04:10.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.528+0000 7fafbe3ed740 1 -- 172.21.15.18:0/60864602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f747830 msgr2=0x56495f7621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:10.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.528+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/60864602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f747830 0x56495f7621c0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fafac09c7e0 tx=0x7fafac00ef90 comp rx=0 tx=0).stop 2024-09-19T10:04:10.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.528+0000 7fafbe3ed740 1 -- 172.21.15.18:0/60864602 shutdown_connections 2024-09-19T10:04:10.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.528+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/60864602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f747830 0x56495f7621c0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.528+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/60864602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f761c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.528+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/60864602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f73eb60 0x56495f755c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.528+0000 7fafbe3ed740 1 -- 172.21.15.18:0/60864602 >> 172.21.15.18:0/60864602 conn(0x56495f73b0f0 msgr2=0x56495f740e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:10.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.529+0000 7fafbe3ed740 1 -- 172.21.15.18:0/60864602 shutdown_connections 2024-09-19T10:04:10.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.529+0000 7fafbe3ed740 1 -- 172.21.15.18:0/60864602 wait complete. 2024-09-19T10:04:10.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.529+0000 7fafbe3ed740 1 -- start start 2024-09-19T10:04:10.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.529+0000 7fafbe3ed740 1 Processor -- start 2024-09-19T10:04:10.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.530+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 0x56495f74e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.530+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f74e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.530+0000 7fafbe3ed740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f7c1c40 0x56495f7c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.530+0000 7fafbe3ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faf9800f860 con 0x56495f73eb60 2024-09-19T10:04:10.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.530+0000 7fafbe3ed740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faf9800f190 con 0x56495f7c1c40 2024-09-19T10:04:10.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.530+0000 7fafbe3ed740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf9800c3d0 con 0x56495f73f480 2024-09-19T10:04:10.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.531+0000 7fafbe3ed740 10 client.0 _ll_register_callbacks cb 0x7fafac004f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:10.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.532+0000 7fafb95af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f74e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.532+0000 7fafba5b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f7c1c40 0x56495f7c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.533+0000 7fafb95af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f74e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52858/0 (socket says 172.21.15.18:52858) 2024-09-19T10:04:10.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.533+0000 7fafb95af640 1 -- 172.21.15.18:0/3491825492 learned_addr learned my addr 172.21.15.18:0/3491825492 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:10.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.536+0000 7fafb9db0640 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 0x56495f74e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.538+0000 7fafba5b1640 1 -- 172.21.15.18:0/3491825492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 msgr2=0x56495f74e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:10.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.538+0000 7fafba5b1640 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f74e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.538+0000 7fafba5b1640 1 -- 172.21.15.18:0/3491825492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 msgr2=0x56495f74e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:10.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.538+0000 7fafba5b1640 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 0x56495f74e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:10.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.539+0000 7fafba5b1640 1 -- 172.21.15.18:0/3491825492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56495f7d5580 con 0x56495f7c1c40 2024-09-19T10:04:10.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.539+0000 7fafba5b1640 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f7c1c40 0x56495f7c4030 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fafac005c40 tx=0x7fafac07ae10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=632f850dfcd40c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:10.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.539+0000 7faf9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:04:10.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.542+0000 7faf9d7fa640 1 -- 172.21.15.18:0/3491825492 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac01f040 con 0x56495f7c1c40 2024-09-19T10:04:10.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.542+0000 7fafbe3ed740 1 -- 172.21.15.18:0/3491825492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56495f6b17f0 con 0x56495f7c1c40 2024-09-19T10:04:10.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.542+0000 7faf9d7fa640 1 -- 172.21.15.18:0/3491825492 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fafac09adf0 con 0x56495f7c1c40 2024-09-19T10:04:10.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.558+0000 7faf9d7fa640 1 -- 172.21.15.18:0/3491825492 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fafac097fd0 con 0x56495f7c1c40 2024-09-19T10:04:10.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.558+0000 7fafbe3ed740 10 client.27545 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:10.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.558+0000 7fafbe3ed740 1 -- 172.21.15.18:0/3491825492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56495f7d68d0 con 0x56495f7c1c40 2024-09-19T10:04:10.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.562+0000 7faf9d7fa640 1 -- 172.21.15.18:0/3491825492 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56495f6b17f0 con 0x56495f7c1c40 2024-09-19T10:04:10.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.563+0000 7faf9d7fa640 1 -- 172.21.15.18:0/3491825492 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fafac0a1470 con 0x56495f7c1c40 2024-09-19T10:04:10.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.564+0000 7fafbe3ed740 10 client.27545 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:10.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.564+0000 7fafbe3ed740 10 client.27545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:10.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.564+0000 7fafbe3ed740 20 client.27545 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:10.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.564+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56495f7d6d00 0x56495f7d90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:10.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.564+0000 7fafbe3ed740 4 client.27545 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T10:04:10.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.564+0000 7fafbe3ed740 1 -- 172.21.15.18:0/3491825492 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56495f6abd00 con 0x56495f7d6d00 2024-09-19T10:04:10.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.565+0000 7fafb9db0640 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56495f7d6d00 0x56495f7d90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:10.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.567+0000 7fafb9db0640 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56495f7d6d00 0x56495f7d90f0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1eabeb2ed7430f7 server_cookie=a0b40811142db9f2 in_seq=0 out_seq=0 2024-09-19T10:04:10.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:10.567+0000 7faf9d7fa640 10 client.27545 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:10.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:10 smithi018 ceph-mon[30956]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 747 MiB/s wr, 1.64k op/s 2024-09-19T10:04:10.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:10 smithi049 ceph-mon[34858]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 747 MiB/s wr, 1.64k op/s 2024-09-19T10:04:10.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:10 smithi162 ceph-mon[35174]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 2.2 MiB/s rd, 747 MiB/s wr, 1.64k op/s 2024-09-19T10:04:11.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:04:11.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:11 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:04:11.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:11 smithi018 ceph-mon[30956]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 829 MiB/s wr, 1.73k op/s 2024-09-19T10:04:11.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:11 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:04:11.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:11 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:04:11.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:11 smithi049 ceph-mon[34858]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 829 MiB/s wr, 1.73k op/s 2024-09-19T10:04:11.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.905+0000 7faf9d7fa640 1 -- 172.21.15.18:0/3491825492 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56495f6abd00 con 0x56495f7d6d00 2024-09-19T10:04:11.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.905+0000 7faf9d7fa640 10 client.27545 handle_command_reply: tid=0 2024-09-19T10:04:11.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.906+0000 7fafbe3ed740 1 client.27545 shutdown 2024-09-19T10:04:11.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.906+0000 7fafbe3ed740 1 -- 172.21.15.18:0/3491825492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f7c1c40 msgr2=0x56495f7c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:11.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.906+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f7c1c40 0x56495f7c4030 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fafac005c40 tx=0x7fafac07ae10 comp rx=0 tx=0).stop 2024-09-19T10:04:11.913 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:04:11.913 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-09-19T10:04:11.913 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "a2b9058a-ac2b-497a-970e-5a5924231c6c", 2024-09-19T10:04:11.913 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-09-19T10:04:11.913 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:04:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.906+0000 7fafbe3ed740 1 -- 172.21.15.18:0/3491825492 shutdown_connections 2024-09-19T10:04:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.906+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x56495f7d6d00 0x56495f7d90f0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.906+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56495f7c1c40 0x56495f7c4030 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.906+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56495f73f480 0x56495f74e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.906+0000 7fafbe3ed740 1 --2- 172.21.15.18:0/3491825492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56495f73eb60 0x56495f74e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.906+0000 7fafbe3ed740 1 -- 172.21.15.18:0/3491825492 >> 172.21.15.18:0/3491825492 conn(0x56495f73b0f0 msgr2=0x56495f740e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.907+0000 7faf9d7fa640 0 client.27545 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.907+0000 7fafbe3ed740 1 -- 172.21.15.18:0/3491825492 shutdown_connections 2024-09-19T10:04:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.907+0000 7fafbe3ed740 1 -- 172.21.15.18:0/3491825492 wait complete. 2024-09-19T10:04:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.908+0000 7fafbe3ed740 20 client.27545 trim_cache size 0 max 16384 2024-09-19T10:04:11.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:11 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:04:11.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:11 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:04:11.915 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:11 smithi162 ceph-mon[35174]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 2.1 MiB/s rd, 829 MiB/s wr, 1.73k op/s 2024-09-19T10:04:11.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.910+0000 7fafbc014640 1 -- 172.21.15.18:0/3005365366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fafa00a3380 msgr2=0x7fafa00a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.910+0000 7fafbc014640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fafa00a3380 0x7fafa00a5840 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x56495f73bf50 tx=0x7fafb000c480 comp rx=0 tx=0).stop 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.910+0000 7fafbc014640 1 -- 172.21.15.18:0/3005365366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb410ae80 msgr2=0x7fafb41182f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.910+0000 7fafbc014640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb410ae80 0x7fafb41182f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fafac00e940 tx=0x7fafac00ee00 comp rx=0 tx=0).stop 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.911+0000 7fafbc014640 1 -- 172.21.15.18:0/3005365366 shutdown_connections 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.911+0000 7fafbc014640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fafa00a3380 0x7fafa00a5840 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.911+0000 7fafbc014640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb410ae80 0x7fafb41182f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.911+0000 7fafbc014640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafb410a560 0x7fafb4117db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.911+0000 7fafbc014640 1 --2- 172.21.15.18:0/3005365366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb4109810 0x7fafb4117870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.911+0000 7fafbc014640 1 -- 172.21.15.18:0/3005365366 >> 172.21.15.18:0/3005365366 conn(0x7fafb406e140 msgr2=0x7fafb4071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.911+0000 7fafbc014640 1 -- 172.21.15.18:0/3005365366 shutdown_connections 2024-09-19T10:04:11.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:11.912+0000 7fafbc014640 1 -- 172.21.15.18:0/3005365366 wait complete. 2024-09-19T10:04:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.392+0000 7f3ae5474640 1 -- 172.21.15.18:0/2588280380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010adc0 msgr2=0x7f3ae0111650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.392+0000 7f3ae5474640 1 --2- 172.21.15.18:0/2588280380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010adc0 0x7f3ae0111650 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009860 tx=0x7f3acc02a360 comp rx=0 tx=0).stop 2024-09-19T10:04:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.394+0000 7f3ae5474640 1 -- 172.21.15.18:0/2588280380 shutdown_connections 2024-09-19T10:04:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.394+0000 7f3ae5474640 1 --2- 172.21.15.18:0/2588280380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010adc0 0x7f3ae0111650 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.394+0000 7f3ae5474640 1 --2- 172.21.15.18:0/2588280380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae010a400 0x7f3ae010a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.394+0000 7f3ae5474640 1 --2- 172.21.15.18:0/2588280380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ae00733b0 0x7f3ae00737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.394+0000 7f3ae5474640 1 -- 172.21.15.18:0/2588280380 >> 172.21.15.18:0/2588280380 conn(0x7f3ae006ece0 msgr2=0x7f3ae0071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.394+0000 7f3ae5474640 1 -- 172.21.15.18:0/2588280380 shutdown_connections 2024-09-19T10:04:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.396+0000 7f3ae5474640 1 -- 172.21.15.18:0/2588280380 wait complete. 2024-09-19T10:04:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.398+0000 7f3ae5474640 1 Processor -- start 2024-09-19T10:04:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.398+0000 7f3ae5474640 1 -- start start 2024-09-19T10:04:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.398+0000 7f3ae5474640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ae00733b0 0x7f3ae019e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.398+0000 7f3ae5474640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010a400 0x7f3ae019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.398+0000 7f3ae5474640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae010adc0 0x7f3ae01a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.398+0000 7f3ae5474640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0114f50 con 0x7f3ae010a400 2024-09-19T10:04:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.398+0000 7f3ae5474640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0114dd0 con 0x7f3ae00733b0 2024-09-19T10:04:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.398+0000 7f3ae5474640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae01150d0 con 0x7f3ae010adc0 2024-09-19T10:04:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.399+0000 7f3ade7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010a400 0x7f3ae019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.399+0000 7f3ade7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010a400 0x7f3ae019e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45374/0 (socket says 172.21.15.18:45374) 2024-09-19T10:04:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.399+0000 7f3ade7fc640 1 -- 172.21.15.18:0/320671912 learned_addr learned my addr 172.21.15.18:0/320671912 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.400+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae010adc0 0x7f3ae01a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.400+0000 7f3adeffd640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ae00733b0 0x7f3ae019e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.400+0000 7f3ade7fc640 1 -- 172.21.15.18:0/320671912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae010adc0 msgr2=0x7f3ae01a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.400+0000 7f3ade7fc640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae010adc0 0x7f3ae01a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.400+0000 7f3ade7fc640 1 -- 172.21.15.18:0/320671912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ae00733b0 msgr2=0x7f3ae019e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.400+0000 7f3ade7fc640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ae00733b0 0x7f3ae019e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.400+0000 7f3ade7fc640 1 -- 172.21.15.18:0/320671912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae01a5f80 con 0x7f3ae010a400 2024-09-19T10:04:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.400+0000 7f3ade7fc640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010a400 0x7f3ae019e8a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c890 tx=0x7f3ad000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.401+0000 7f3ad7fff640 1 -- 172.21.15.18:0/320671912 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0004220 con 0x7f3ae010a400 2024-09-19T10:04:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.401+0000 7f3ae5474640 1 -- 172.21.15.18:0/320671912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae01a6270 con 0x7f3ae010a400 2024-09-19T10:04:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.401+0000 7f3ae5474640 1 -- 172.21.15.18:0/320671912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae01a67c0 con 0x7f3ae010a400 2024-09-19T10:04:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.405+0000 7f3ae8217740 1 Processor -- start 2024-09-19T10:04:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.405+0000 7f3ae8217740 1 -- start start 2024-09-19T10:04:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.405+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab7dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.406+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab82da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.406+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab85830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.406+0000 7f3ae8217740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c85aae12f0 con 0x55c85ab7d9a0 2024-09-19T10:04:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.406+0000 7f3ae8217740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c85aa89270 con 0x55c85ab83370 2024-09-19T10:04:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.406+0000 7f3ae8217740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c85aadd2b0 con 0x55c85ab7e2e0 2024-09-19T10:04:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.406+0000 7f3ad7fff640 1 -- 172.21.15.18:0/320671912 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad00043c0 con 0x7f3ae010a400 2024-09-19T10:04:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.407+0000 7f3ade7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab85830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.407+0000 7f3ad7fff640 1 -- 172.21.15.18:0/320671912 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad00049c0 con 0x7f3ae010a400 2024-09-19T10:04:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.408+0000 7f3adeffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab82da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.408+0000 7f3ade7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab85830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60946/0 (socket says 172.21.15.18:60946) 2024-09-19T10:04:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.408+0000 7f3ade7fc640 1 -- 172.21.15.18:0/358906954 learned_addr learned my addr 172.21.15.18:0/358906954 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.412+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/358906954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab7dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.412+0000 7f3ad7fff640 1 -- 172.21.15.18:0/320671912 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3ad00079b0 con 0x7f3ae010a400 2024-09-19T10:04:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.412+0000 7f3ade7fc640 1 -- 172.21.15.18:0/358906954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 msgr2=0x55c85ab82da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.412+0000 7f3ade7fc640 1 --2- 172.21.15.18:0/358906954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab82da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.412+0000 7f3ade7fc640 1 -- 172.21.15.18:0/358906954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 msgr2=0x55c85ab7dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.412+0000 7f3ade7fc640 1 --2- 172.21.15.18:0/358906954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab7dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.412+0000 7f3ade7fc640 1 -- 172.21.15.18:0/358906954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c85aa88340 con 0x55c85ab83370 2024-09-19T10:04:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.412+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/358906954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab7dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.414+0000 7f3ad7fff640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ac40a3400 0x7f3ac40a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.414+0000 7f3ade7fc640 1 --2- 172.21.15.18:0/358906954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab85830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00d2710 tx=0x7f3ad00d7c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae444f01d42f9c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.415+0000 7f3ad57fa640 1 -- 172.21.15.18:0/358906954 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad009d4a0 con 0x55c85ab83370 2024-09-19T10:04:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.415+0000 7f3ad57fa640 1 -- 172.21.15.18:0/358906954 <== mon.2 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad00a1990 con 0x55c85ab83370 2024-09-19T10:04:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.415+0000 7f3ad57fa640 1 -- 172.21.15.18:0/358906954 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad009f3d0 con 0x55c85ab83370 2024-09-19T10:04:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.417+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ac40a3400 0x7f3ac40a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.418+0000 7f3ae8217740 1 -- 172.21.15.18:0/358906954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 msgr2=0x55c85ab85830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.418+0000 7f3ae8217740 1 --2- 172.21.15.18:0/358906954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab85830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00d2710 tx=0x7f3ad00d7c20 comp rx=0 tx=0).stop 2024-09-19T10:04:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.418+0000 7f3ad7fff640 1 -- 172.21.15.18:0/320671912 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3ad00d4ca0 con 0x7f3ae010a400 2024-09-19T10:04:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.423+0000 7f3ae8217740 1 -- 172.21.15.18:0/358906954 shutdown_connections 2024-09-19T10:04:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.423+0000 7f3ae8217740 1 --2- 172.21.15.18:0/358906954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab85830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.423+0000 7f3ae8217740 1 --2- 172.21.15.18:0/358906954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab82da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.423+0000 7f3ae8217740 1 --2- 172.21.15.18:0/358906954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab7dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.423+0000 7f3ae8217740 1 -- 172.21.15.18:0/358906954 >> 172.21.15.18:0/358906954 conn(0x55c85ab79010 msgr2=0x55c85ab79410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.430+0000 7f3ae8217740 1 -- 172.21.15.18:0/358906954 shutdown_connections 2024-09-19T10:04:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.431+0000 7f3ae8217740 1 -- 172.21.15.18:0/358906954 wait complete. 2024-09-19T10:04:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.432+0000 7f3ae8217740 1 -- start start 2024-09-19T10:04:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.432+0000 7f3ae8217740 1 Processor -- start 2024-09-19T10:04:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.433+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab87b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.433+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.437+0000 7f3ade7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.434+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab8f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.437+0000 7f3ae8217740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c85ab86340 con 0x55c85ab7d9a0 2024-09-19T10:04:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.437+0000 7f3ade7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab880d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52914/0 (socket says 172.21.15.18:52914) 2024-09-19T10:04:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.437+0000 7f3ade7fc640 1 -- 172.21.15.18:0/1797833287 learned_addr learned my addr 172.21.15.18:0/1797833287 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.438+0000 7f3ae8217740 1 -- 172.21.15.18:0/1797833287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c85aa6a290 con 0x55c85ab83370 2024-09-19T10:04:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.438+0000 7f3ae8217740 1 -- 172.21.15.18:0/1797833287 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c85ab864c0 con 0x55c85ab7e2e0 2024-09-19T10:04:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.438+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab8f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.439+0000 7f3ae8217740 10 client.0 _ll_register_callbacks cb 0x55c85aa9b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.439+0000 7f3adeffd640 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab87b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.440+0000 7f3adf7fe640 1 -- 172.21.15.18:0/1797833287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 msgr2=0x55c85ab880d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.440+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab880d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.440+0000 7f3adf7fe640 1 -- 172.21.15.18:0/1797833287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 msgr2=0x55c85ab87b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.440+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab87b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.440+0000 7f3adf7fe640 1 -- 172.21.15.18:0/1797833287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c85a7f4210 con 0x55c85ab83370 2024-09-19T10:04:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.441+0000 7f3ade7fc640 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab880d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:04:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.441+0000 7f3adeffd640 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab87b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.444+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab8f110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009780 tx=0x7f3acc02a360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=978b1851fba964b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.444+0000 7f3ac27fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-19T10:04:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.448+0000 7f3ac27fc640 1 -- 172.21.15.18:0/1797833287 <== mon.2 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc04c020 con 0x55c85ab83370 2024-09-19T10:04:12.451 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.448+0000 7f3ae8217740 1 -- 172.21.15.18:0/1797833287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ad00a1990 con 0x55c85ab83370 2024-09-19T10:04:12.452 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.448+0000 7f3ac27fc640 1 -- 172.21.15.18:0/1797833287 <== mon.2 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3acc005240 con 0x55c85ab83370 2024-09-19T10:04:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.459+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ac40a3400 0x7f3ac40a58c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009830 tx=0x7f3acc030340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.460+0000 7f3ac27fc640 1 -- 172.21.15.18:0/1797833287 <== mon.2 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3acc037040 con 0x55c85ab83370 2024-09-19T10:04:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.460+0000 7f3ae8217740 10 client.27557 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.460+0000 7f3ae8217740 1 -- 172.21.15.18:0/1797833287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c85a8c0620 con 0x55c85ab83370 2024-09-19T10:04:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.465+0000 7f3ac27fc640 1 -- 172.21.15.18:0/1797833287 <== mon.2 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad00a1990 con 0x55c85ab83370 2024-09-19T10:04:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.465+0000 7f3ac27fc640 1 -- 172.21.15.18:0/1797833287 <== mon.2 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3acc0035f0 con 0x55c85ab83370 2024-09-19T10:04:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.466+0000 7f3ae8217740 10 client.27557 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.466+0000 7f3ae8217740 10 client.27557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.466+0000 7f3ae8217740 20 client.27557 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.466+0000 7f3ae8217740 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c85ab93c70 0x55c85ab96130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.466+0000 7f3ae8217740 4 client.27557 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:12.471 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.466+0000 7f3ae8217740 1 -- 172.21.15.18:0/1797833287 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c85aaeea20 con 0x55c85ab93c70 2024-09-19T10:04:12.481 INFO:tasks.workunit.client.0.smithi018.stdout:OK 2024-09-19T10:04:12.482 INFO:tasks.workunit.client.0.smithi018.stderr:+ echo OK 2024-09-19T10:04:12.482 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.478+0000 7f3adeffd640 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c85ab93c70 0x55c85ab96130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.482+0000 7f3adeffd640 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c85ab93c70 0x55c85ab96130 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c11511f6984bab4c server_cookie=42d62d436b13a985 in_seq=0 out_seq=0 2024-09-19T10:04:12.485 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.482+0000 7f3ac27fc640 10 client.27557 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.487+0000 7f3ac27fc640 1 -- 172.21.15.18:0/1797833287 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c85aaeea20 con 0x55c85ab93c70 2024-09-19T10:04:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.487+0000 7f3ac27fc640 10 client.27557 handle_command_reply: tid=0 2024-09-19T10:04:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.487+0000 7f3ae8217740 1 client.27557 shutdown 2024-09-19T10:04:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.492+0000 7f3ae8217740 1 -- 172.21.15.18:0/1797833287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 msgr2=0x55c85ab8f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.492+0000 7f3ae8217740 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab8f110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009780 tx=0x7f3acc02a360 comp rx=0 tx=0).stop 2024-09-19T10:04:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.492+0000 7f3ae8217740 1 -- 172.21.15.18:0/1797833287 shutdown_connections 2024-09-19T10:04:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.492+0000 7f3ae8217740 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c85ab93c70 0x55c85ab96130 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.492+0000 7f3ae8217740 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab83370 0x55c85ab8f110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.492+0000 7f3ae8217740 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab880d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.492+0000 7f3ae8217740 1 --2- 172.21.15.18:0/1797833287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab87b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.492+0000 7f3ae8217740 1 -- 172.21.15.18:0/1797833287 >> 172.21.15.18:0/1797833287 conn(0x55c85ab79010 msgr2=0x55c85ab7a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.492+0000 7f3ac27fc640 0 client.27557 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.493+0000 7f3ae8217740 1 -- 172.21.15.18:0/1797833287 shutdown_connections 2024-09-19T10:04:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.493+0000 7f3ae8217740 1 -- 172.21.15.18:0/1797833287 wait complete. 2024-09-19T10:04:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.493+0000 7f3ae8217740 20 client.27557 trim_cache size 0 max 16384 2024-09-19T10:04:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.524+0000 7f3ae8217740 1 Processor -- start 2024-09-19T10:04:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.524+0000 7f3ae8217740 1 -- start start 2024-09-19T10:04:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.525+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab87000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.525+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7e2e0 0x55c85ab8f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.525+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab83370 0x55c85ab79ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.526+0000 7f3adeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab87000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.526+0000 7f3adeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab87000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45406/0 (socket says 172.21.15.18:45406) 2024-09-19T10:04:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.526+0000 7f3adeffd640 1 -- 172.21.15.18:0/3265329250 learned_addr learned my addr 172.21.15.18:0/3265329250 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.526+0000 7f3ae8217740 1 -- 172.21.15.18:0/3265329250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac800e490 con 0x55c85ab7d9a0 2024-09-19T10:04:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.526+0000 7f3ae8217740 1 -- 172.21.15.18:0/3265329250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac800ffd0 con 0x55c85ab7e2e0 2024-09-19T10:04:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.526+0000 7f3ae8217740 1 -- 172.21.15.18:0/3265329250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac800eb60 con 0x55c85ab83370 2024-09-19T10:04:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.526+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/3265329250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab83370 0x55c85ab79ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.527+0000 7f3ade7fc640 1 --2- 172.21.15.18:0/3265329250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7e2e0 0x55c85ab8f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.527+0000 7f3adf7fe640 1 -- 172.21.15.18:0/3265329250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7e2e0 msgr2=0x55c85ab8f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.527+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/3265329250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7e2e0 0x55c85ab8f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.527+0000 7f3adf7fe640 1 -- 172.21.15.18:0/3265329250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 msgr2=0x55c85ab87000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.527+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/3265329250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab87000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.527+0000 7f3adf7fe640 1 -- 172.21.15.18:0/3265329250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c85ab967b0 con 0x55c85ab83370 2024-09-19T10:04:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.528+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/3265329250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab83370 0x55c85ab79ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009860 tx=0x7f3acc0096f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64935ca67b03ab0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.528+0000 7f3ad4ff9640 1 -- 172.21.15.18:0/3265329250 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc061070 con 0x55c85ab83370 2024-09-19T10:04:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.528+0000 7f3ad4ff9640 1 -- 172.21.15.18:0/3265329250 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3acc041030 con 0x55c85ab83370 2024-09-19T10:04:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.529+0000 7f3ad4ff9640 1 -- 172.21.15.18:0/3265329250 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc04c040 con 0x55c85ab83370 2024-09-19T10:04:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.530+0000 7f3ae8217740 1 -- 172.21.15.18:0/3265329250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab83370 msgr2=0x55c85ab79ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.530+0000 7f3ae8217740 1 --2- 172.21.15.18:0/3265329250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab83370 0x55c85ab79ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009860 tx=0x7f3acc0096f0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.544+0000 7f3ae8217740 1 -- 172.21.15.18:0/3265329250 shutdown_connections 2024-09-19T10:04:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.544+0000 7f3ae8217740 1 --2- 172.21.15.18:0/3265329250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab83370 0x55c85ab79ec0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.544+0000 7f3ae8217740 1 --2- 172.21.15.18:0/3265329250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7e2e0 0x55c85ab8f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.544+0000 7f3ae8217740 1 --2- 172.21.15.18:0/3265329250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab7d9a0 0x55c85ab87000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.544+0000 7f3ae8217740 1 -- 172.21.15.18:0/3265329250 >> 172.21.15.18:0/3265329250 conn(0x55c85ab79010 msgr2=0x55c85ab868f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.546+0000 7f3ae8217740 1 -- 172.21.15.18:0/3265329250 shutdown_connections 2024-09-19T10:04:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.546+0000 7f3ae8217740 1 -- 172.21.15.18:0/3265329250 wait complete. 2024-09-19T10:04:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.546+0000 7f3ae8217740 1 -- start start 2024-09-19T10:04:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.547+0000 7f3ae8217740 1 Processor -- start 2024-09-19T10:04:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.547+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7d9a0 0x55c85ab8cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.547+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab8d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.548+0000 7f3ae8217740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab83370 0x55c85ab8e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.548+0000 7f3ae8217740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac800f900 con 0x55c85ab83370 2024-09-19T10:04:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.548+0000 7f3ade7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab8d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.548+0000 7f3adeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7d9a0 0x55c85ab8cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.548+0000 7f3adeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7d9a0 0x55c85ab8cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:60972/0 (socket says 172.21.15.18:60972) 2024-09-19T10:04:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.548+0000 7f3adeffd640 1 -- 172.21.15.18:0/3190053182 learned_addr learned my addr 172.21.15.18:0/3190053182 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.548+0000 7f3ae8217740 1 -- 172.21.15.18:0/3190053182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac800f230 con 0x55c85ab7d9a0 2024-09-19T10:04:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.548+0000 7f3ae8217740 1 -- 172.21.15.18:0/3190053182 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac800c470 con 0x55c85ab7e2e0 2024-09-19T10:04:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.548+0000 7f3ae8217740 10 client.0 _ll_register_callbacks cb 0x7f3acc035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.548+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab83370 0x55c85ab8e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.549+0000 7f3adf7fe640 1 -- 172.21.15.18:0/3190053182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 msgr2=0x55c85ab8d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.549+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab8d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.549+0000 7f3adf7fe640 1 -- 172.21.15.18:0/3190053182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7d9a0 msgr2=0x55c85ab8cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.549+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7d9a0 0x55c85ab8cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.549+0000 7f3adf7fe640 1 -- 172.21.15.18:0/3190053182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c85ab8e6d0 con 0x55c85ab83370 2024-09-19T10:04:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.549+0000 7f3adf7fe640 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab83370 0x55c85ab8e0c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f3acc003b50 tx=0x7f3acc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03ed1d0f78b169 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.550+0000 7f3ac27fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.550+0000 7f3ac27fc640 1 -- 172.21.15.18:0/3190053182 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc061020 con 0x55c85ab83370 2024-09-19T10:04:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.550+0000 7f3ac27fc640 1 -- 172.21.15.18:0/3190053182 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3acc0048c0 con 0x55c85ab83370 2024-09-19T10:04:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.550+0000 7f3ae8217740 1 -- 172.21.15.18:0/3190053182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3acc041030 con 0x55c85ab83370 2024-09-19T10:04:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.550+0000 7f3ac27fc640 1 -- 172.21.15.18:0/3190053182 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3acc04c040 con 0x55c85ab83370 2024-09-19T10:04:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.551+0000 7f3ae8217740 10 client.18108 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.551+0000 7f3ae8217740 1 -- 172.21.15.18:0/3190053182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c85abfecb0 con 0x55c85ab83370 2024-09-19T10:04:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.551+0000 7f3ac27fc640 1 -- 172.21.15.18:0/3190053182 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3acc041030 con 0x55c85ab83370 2024-09-19T10:04:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.552+0000 7f3ac27fc640 1 -- 172.21.15.18:0/3190053182 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3acc05c8c0 con 0x55c85ab83370 2024-09-19T10:04:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.552+0000 7f3ae8217740 10 client.18108 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.552+0000 7f3ae8217740 10 client.18108 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.552+0000 7f3ae8217740 20 client.18108 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.552+0000 7f3ae8217740 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c85abff370 0x55c85ac01790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.552+0000 7f3ae8217740 4 client.18108 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T10:04:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.552+0000 7f3ae8217740 1 -- 172.21.15.18:0/3190053182 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c85aae8d70 con 0x55c85abff370 2024-09-19T10:04:12.558 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.553+0000 7f3adeffd640 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c85abff370 0x55c85ac01790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.557+0000 7f3adeffd640 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c85abff370 0x55c85ac01790 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8b45eabb09932f7 server_cookie=bcca45e1143d6687 in_seq=0 out_seq=0 2024-09-19T10:04:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:12.558+0000 7f3ac27fc640 10 client.18108 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:12.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:12 smithi018 ceph-mon[30956]: scrub queued for path: / 2024-09-19T10:04:12.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:12 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T10:04:12.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:12 smithi018 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T10:04:12.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:04:12.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:04:12.731 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:04:13.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:12 smithi049 ceph-mon[34858]: scrub queued for path: / 2024-09-19T10:04:13.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:12 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T10:04:13.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:12 smithi049 ceph-mon[34858]: scrub summary: active paths [/] 2024-09-19T10:04:13.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:04:13.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:04:13.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:04:13.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:12 smithi162 ceph-mon[35174]: scrub queued for path: / 2024-09-19T10:04:13.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:12 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T10:04:13.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:12 smithi162 ceph-mon[35174]: scrub summary: active paths [/] 2024-09-19T10:04:13.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:04:13.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:04:13.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:04:13.497 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T10:04:13.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:13 smithi018 ceph-mon[30956]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 793 MiB/s wr, 1.47k op/s 2024-09-19T10:04:14.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:13 smithi049 ceph-mon[34858]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 793 MiB/s wr, 1.47k op/s 2024-09-19T10:04:14.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:13 smithi162 ceph-mon[35174]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.8 MiB/s rd, 793 MiB/s wr, 1.47k op/s 2024-09-19T10:04:14.383 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:14.661 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T10:04:14.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T10:04:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.126+0000 7f2e4f935640 1 -- 172.21.15.18:0/3725800332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e4810e4d0 msgr2=0x7f2e481108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.126+0000 7f2e4f935640 1 --2- 172.21.15.18:0/3725800332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e4810e4d0 0x7f2e481108e0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009ca0 tx=0x7f2e4002a8c0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.126+0000 7f2e4f935640 1 -- 172.21.15.18:0/3725800332 shutdown_connections 2024-09-19T10:04:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.126+0000 7f2e4f935640 1 --2- 172.21.15.18:0/3725800332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e4810e4d0 0x7f2e481108e0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.126+0000 7f2e4f935640 1 --2- 172.21.15.18:0/3725800332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e48101360 0x7f2e4810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.126+0000 7f2e4f935640 1 --2- 172.21.15.18:0/3725800332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e481009b0 0x7f2e48100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.126+0000 7f2e4f935640 1 -- 172.21.15.18:0/3725800332 >> 172.21.15.18:0/3725800332 conn(0x7f2e480fc7d0 msgr2=0x7f2e480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:15.131 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:14 smithi018 ceph-mon[30956]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 876 MiB/s wr, 1.70k op/s 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.126+0000 7f2e4f935640 1 -- 172.21.15.18:0/3725800332 shutdown_connections 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.126+0000 7f2e4f935640 1 -- 172.21.15.18:0/3725800332 wait complete. 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4f935640 1 Processor -- start 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4f935640 1 -- start start 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4f935640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e481009b0 0x7f2e4819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4f935640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e48101360 0x7f2e4819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4f935640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4810e4d0 0x7f2e4819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4f935640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e48114220 con 0x7f2e48101360 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4f935640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2e481140a0 con 0x7f2e4810e4d0 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4f935640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e481143a0 con 0x7f2e481009b0 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4d6d1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e481009b0 0x7f2e4819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4d6d1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e481009b0 0x7f2e4819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52940/0 (socket says 172.21.15.18:52940) 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4d6d1640 1 -- 172.21.15.18:0/2208484645 learned_addr learned my addr 172.21.15.18:0/2208484645 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.127+0000 7f2e4ced0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e48101360 0x7f2e4819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4810e4d0 0x7f2e4819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e4d6d1640 1 -- 172.21.15.18:0/2208484645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4810e4d0 msgr2=0x7f2e4819efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e4d6d1640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4810e4d0 0x7f2e4819efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e4d6d1640 1 -- 172.21.15.18:0/2208484645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e48101360 msgr2=0x7f2e4819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e4d6d1640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e48101360 0x7f2e4819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e4d6d1640 1 -- 172.21.15.18:0/2208484645 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4819f6b0 con 0x7f2e481009b0 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e4d6d1640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e481009b0 0x7f2e4819a700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400e9f0 tx=0x7f2e4400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e3e7fc640 1 -- 172.21.15.18:0/2208484645 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400cd80 con 0x7f2e481009b0 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e4f935640 1 -- 172.21.15.18:0/2208484645 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e4819f9a0 con 0x7f2e481009b0 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e4f935640 1 -- 172.21.15.18:0/2208484645 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e481a7280 con 0x7f2e481009b0 2024-09-19T10:04:15.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e3e7fc640 1 -- 172.21.15.18:0/2208484645 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e44005500 con 0x7f2e481009b0 2024-09-19T10:04:15.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.128+0000 7f2e3e7fc640 1 -- 172.21.15.18:0/2208484645 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44010690 con 0x7f2e481009b0 2024-09-19T10:04:15.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.131+0000 7f2e3e7fc640 1 -- 172.21.15.18:0/2208484645 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2e440046c0 con 0x7f2e481009b0 2024-09-19T10:04:15.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.131+0000 7f2e51d0e740 1 Processor -- start 2024-09-19T10:04:15.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.131+0000 7f2e51d0e740 1 -- start start 2024-09-19T10:04:15.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed4424a0 0x55d2ed442880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e3e7fc640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2e340a3240 0x7f2e340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed44d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed44fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d2ed3a82e0 con 0x55d2ed442dc0 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d2ed34fce0 con 0x55d2ed4424a0 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d2ed3a42a0 con 0x55d2ed44d680 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ced0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed44d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ced0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed44d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45454/0 (socket says 172.21.15.18:45454) 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ced0640 1 -- 172.21.15.18:0/2717119699 learned_addr learned my addr 172.21.15.18:0/2717119699 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4d6d1640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2e340a3240 0x7f2e340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/2717119699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed4424a0 0x55d2ed442880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e3e7fc640 1 -- 172.21.15.18:0/2208484645 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2e440cfb70 con 0x7f2e481009b0 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/2717119699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed44fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ced0640 1 -- 172.21.15.18:0/2717119699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 msgr2=0x55d2ed44fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:15.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/2717119699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed44fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ced0640 1 -- 172.21.15.18:0/2717119699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed4424a0 msgr2=0x55d2ed442880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:15.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/2717119699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed4424a0 0x55d2ed442880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ced0640 1 -- 172.21.15.18:0/2717119699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2ed334440 con 0x55d2ed442dc0 2024-09-19T10:04:15.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/2717119699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed44fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:04:15.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/2717119699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed44d140 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800bc10 tx=0x7f2e380107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c214b22231263b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:15.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.132+0000 7f2e4d6d1640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2e340a3240 0x7f2e340a5700 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2e44098620 tx=0x7f2e4401cb90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:15.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e337fe640 1 -- 172.21.15.18:0/2717119699 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38005020 con 0x55d2ed442dc0 2024-09-19T10:04:15.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e337fe640 1 -- 172.21.15.18:0/2717119699 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e380047a0 con 0x55d2ed442dc0 2024-09-19T10:04:15.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e337fe640 1 -- 172.21.15.18:0/2717119699 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38011710 con 0x55d2ed442dc0 2024-09-19T10:04:15.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2717119699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 msgr2=0x55d2ed44d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/2717119699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed44d140 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800bc10 tx=0x7f2e380107a0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2717119699 shutdown_connections 2024-09-19T10:04:15.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/2717119699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed44fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/2717119699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed44d140 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/2717119699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed4424a0 0x55d2ed442880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2717119699 >> 172.21.15.18:0/2717119699 conn(0x55d2ed43ea30 msgr2=0x55d2ed43ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2717119699 shutdown_connections 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.133+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2717119699 wait complete. 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e51d0e740 1 -- start start 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e51d0e740 1 Processor -- start 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed44cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 0x55d2ed44a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed44a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d2ed450250 con 0x55d2ed4424a0 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d2ed363050 con 0x55d2ed442dc0 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d2ed4503d0 con 0x55d2ed44d680 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e51d0e740 10 client.0 _ll_register_callbacks cb 0x55d2ed3a3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e4ded2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed44cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e4ced0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 0x55d2ed44a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e4ded2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed44cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45456/0 (socket says 172.21.15.18:45456) 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e4ced0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 0x55d2ed44a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:32772/0 (socket says 172.21.15.18:32772) 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.134+0000 7f2e4ded2640 1 -- 172.21.15.18:0/678882821 learned_addr learned my addr 172.21.15.18:0/678882821 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed44a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e4ded2640 1 -- 172.21.15.18:0/678882821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 msgr2=0x55d2ed44a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed44a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e4ded2640 1 -- 172.21.15.18:0/678882821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 msgr2=0x55d2ed44a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 0x55d2ed44a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e4ded2640 1 -- 172.21.15.18:0/678882821 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2ed1193c0 con 0x55d2ed4424a0 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 0x55d2ed44a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed44cf30 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f2e4002f540 tx=0x7f2e4002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec5c991db53c47c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:15.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e30ff9640 1 -- 172.21.15.18:0/678882821 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40003c30 con 0x55d2ed4424a0 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e30ff9640 1 -- 172.21.15.18:0/678882821 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2e40003dd0 con 0x55d2ed4424a0 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e51d0e740 1 -- 172.21.15.18:0/678882821 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e380047a0 con 0x55d2ed4424a0 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e30ff9640 1 -- 172.21.15.18:0/678882821 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2e40003fd0 con 0x55d2ed4424a0 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e51d0e740 10 client.18120 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.135+0000 7f2e51d0e740 1 -- 172.21.15.18:0/678882821 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2ed45bb40 con 0x55d2ed4424a0 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.136+0000 7f2e30ff9640 1 -- 172.21.15.18:0/678882821 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e380047a0 con 0x55d2ed4424a0 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.136+0000 7f2e30ff9640 1 -- 172.21.15.18:0/678882821 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2e4002fbd0 con 0x55d2ed4424a0 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.136+0000 7f2e51d0e740 10 client.18120 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.136+0000 7f2e51d0e740 10 client.18120 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.136+0000 7f2e51d0e740 20 client.18120 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.136+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d2ed45d000 0x55d2ed45f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.136+0000 7f2e51d0e740 4 client.18120 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:15.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.136+0000 7f2e51d0e740 1 -- 172.21.15.18:0/678882821 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2ed3b5850 con 0x55d2ed45d000 2024-09-19T10:04:15.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.136+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d2ed45d000 0x55d2ed45f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.137+0000 7f2e30ff9640 10 client.18120 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:15.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.136+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d2ed45d000 0x55d2ed45f410 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c570518c0c35917b server_cookie=386852edb0987ff5 in_seq=0 out_seq=0 2024-09-19T10:04:15.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.138+0000 7f2e30ff9640 1 -- 172.21.15.18:0/678882821 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2ed3b5850 con 0x55d2ed45d000 2024-09-19T10:04:15.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.138+0000 7f2e30ff9640 10 client.18120 handle_command_reply: tid=0 2024-09-19T10:04:15.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.138+0000 7f2e51d0e740 1 client.18120 shutdown 2024-09-19T10:04:15.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.138+0000 7f2e51d0e740 1 -- 172.21.15.18:0/678882821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 msgr2=0x55d2ed44cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.138+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed44cf30 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f2e4002f540 tx=0x7f2e4002a8c0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.139+0000 7f2e51d0e740 1 -- 172.21.15.18:0/678882821 shutdown_connections 2024-09-19T10:04:15.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.139+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d2ed45d000 0x55d2ed45f410 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.139+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed44a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.139+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 0x55d2ed44a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.139+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/678882821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed44cf30 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.139+0000 7f2e51d0e740 1 -- 172.21.15.18:0/678882821 >> 172.21.15.18:0/678882821 conn(0x55d2ed43ea30 msgr2=0x55d2ed43db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:15.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.139+0000 7f2e30ff9640 0 client.18120 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:15.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.139+0000 7f2e51d0e740 1 -- 172.21.15.18:0/678882821 shutdown_connections 2024-09-19T10:04:15.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.139+0000 7f2e51d0e740 1 -- 172.21.15.18:0/678882821 wait complete. 2024-09-19T10:04:15.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.139+0000 7f2e51d0e740 20 client.18120 trim_cache size 0 max 16384 2024-09-19T10:04:15.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e51d0e740 1 Processor -- start 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e51d0e740 1 -- start start 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed4424a0 0x55d2ed45f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed43da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed44d680 0x55d2ed464ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00e380 con 0x55d2ed442dc0 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00fec0 con 0x55d2ed44d680 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00ea50 con 0x55d2ed4424a0 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e4ced0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed43da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e4ced0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed43da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45468/0 (socket says 172.21.15.18:45468) 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e4ced0640 1 -- 172.21.15.18:0/4115333430 learned_addr learned my addr 172.21.15.18:0/4115333430 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/4115333430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed4424a0 0x55d2ed45f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/4115333430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed44d680 0x55d2ed464ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e4ced0640 1 -- 172.21.15.18:0/4115333430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed4424a0 msgr2=0x55d2ed45f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/4115333430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed4424a0 0x55d2ed45f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e4ced0640 1 -- 172.21.15.18:0/4115333430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed44d680 msgr2=0x55d2ed464ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/4115333430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed44d680 0x55d2ed464ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.157+0000 7f2e4ced0640 1 -- 172.21.15.18:0/4115333430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2ed449190 con 0x55d2ed442dc0 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/4115333430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed44d680 0x55d2ed464ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/4115333430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed43da80 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800bc10 tx=0x7f2e38005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d657d8feeace5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e32ffd640 1 -- 172.21.15.18:0/4115333430 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38005240 con 0x55d2ed442dc0 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e32ffd640 1 -- 172.21.15.18:0/4115333430 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3802d070 con 0x55d2ed442dc0 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e32ffd640 1 -- 172.21.15.18:0/4115333430 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e380277a0 con 0x55d2ed442dc0 2024-09-19T10:04:15.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e51d0e740 1 -- 172.21.15.18:0/4115333430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 msgr2=0x55d2ed43da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/4115333430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed43da80 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800bc10 tx=0x7f2e38005780 comp rx=0 tx=0).stop 2024-09-19T10:04:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e51d0e740 1 -- 172.21.15.18:0/4115333430 shutdown_connections 2024-09-19T10:04:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/4115333430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed44d680 0x55d2ed464ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/4115333430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed442dc0 0x55d2ed43da80 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.158+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/4115333430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed4424a0 0x55d2ed45f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.159+0000 7f2e51d0e740 1 -- 172.21.15.18:0/4115333430 >> 172.21.15.18:0/4115333430 conn(0x55d2ed43ea30 msgr2=0x55d2ed43d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.159+0000 7f2e51d0e740 1 -- 172.21.15.18:0/4115333430 shutdown_connections 2024-09-19T10:04:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.159+0000 7f2e51d0e740 1 -- 172.21.15.18:0/4115333430 wait complete. 2024-09-19T10:04:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.159+0000 7f2e51d0e740 1 -- start start 2024-09-19T10:04:15.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.159+0000 7f2e51d0e740 1 Processor -- start 2024-09-19T10:04:15.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.159+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed455850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 0x55d2ed455d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e51d0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed450c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00f7f0 con 0x55d2ed4424a0 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00f120 con 0x55d2ed442dc0 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e51d0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00c360 con 0x55d2ed44d680 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e51d0e740 10 client.0 _ll_register_callbacks cb 0x7f2e40009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ded2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed455850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ded2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed455850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45470/0 (socket says 172.21.15.18:45470) 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ded2640 1 -- 172.21.15.18:0/2154962647 learned_addr learned my addr 172.21.15.18:0/2154962647 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 0x55d2ed455d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed450c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ded2640 1 -- 172.21.15.18:0/2154962647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 msgr2=0x55d2ed450c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed450c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ded2640 1 -- 172.21.15.18:0/2154962647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 msgr2=0x55d2ed455d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 0x55d2ed455d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ded2640 1 -- 172.21.15.18:0/2154962647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2ed451440 con 0x55d2ed4424a0 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e4ded2640 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed455850 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f2e4002ade0 tx=0x7f2e4002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed94318f823811c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e30ff9640 1 -- 172.21.15.18:0/2154962647 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40030900 con 0x55d2ed4424a0 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e30ff9640 1 -- 172.21.15.18:0/2154962647 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2e40003c60 con 0x55d2ed4424a0 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.160+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2154962647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e3802d070 con 0x55d2ed4424a0 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e30ff9640 1 -- 172.21.15.18:0/2154962647 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2e40004b40 con 0x55d2ed4424a0 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e51d0e740 10 client.18126 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2154962647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2ed4c77d0 con 0x55d2ed4424a0 2024-09-19T10:04:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e30ff9640 1 -- 172.21.15.18:0/2154962647 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3802d070 con 0x55d2ed4424a0 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e30ff9640 1 -- 172.21.15.18:0/2154962647 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2e4002f7d0 con 0x55d2ed4424a0 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e51d0e740 10 client.18126 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e51d0e740 10 client.18126 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e51d0e740 20 client.18126 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d2ed4c7f20 0x55d2ed4ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e51d0e740 4 client.18126 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2154962647 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d2ed44b330 con 0x55d2ed4c7f20 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.161+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d2ed4c7f20 0x55d2ed4ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.162+0000 7f2e4ced0640 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d2ed4c7f20 0x55d2ed4ca340 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6ee7977291ab000 server_cookie=3b9f101b21397ae8 in_seq=0 out_seq=0 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.162+0000 7f2e30ff9640 10 client.18126 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e30ff9640 1 -- 172.21.15.18:0/2154962647 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55d2ed44b330 con 0x55d2ed4c7f20 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e30ff9640 10 client.18126 handle_command_reply: tid=0 2024-09-19T10:04:15.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e51d0e740 1 client.18126 shutdown 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2154962647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 msgr2=0x55d2ed455850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed455850 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f2e4002ade0 tx=0x7f2e4002a8c0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2154962647 shutdown_connections 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55d2ed4c7f20 0x55d2ed4ca340 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d2ed44d680 0x55d2ed450c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2ed442dc0 0x55d2ed455d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e51d0e740 1 --2- 172.21.15.18:0/2154962647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2ed4424a0 0x55d2ed455850 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e30ff9640 0 client.18126 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2154962647 >> 172.21.15.18:0/2154962647 conn(0x55d2ed43ea30 msgr2=0x55d2ed43db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.163+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2154962647 shutdown_connections 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e51d0e740 1 -- 172.21.15.18:0/2154962647 wait complete. 2024-09-19T10:04:15.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e51d0e740 20 client.18126 trim_cache size 0 max 16384 2024-09-19T10:04:15.173 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:04:15.173 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "scrub active (1 inodes in the stack)", 2024-09-19T10:04:15.173 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-09-19T10:04:15.173 INFO:teuthology.orchestra.run.smithi018.stdout: "a2b9058a-ac2b-497a-970e-5a5924231c6c": { 2024-09-19T10:04:15.173 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-09-19T10:04:15.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "a2b9058a-ac2b-497a-970e-5a5924231c6c", 2024-09-19T10:04:15.173 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-09-19T10:04:15.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:15.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:15.173 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:04:15.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e4f935640 1 -- 172.21.15.18:0/2208484645 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2e340a3240 msgr2=0x7f2e340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e4f935640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2e340a3240 0x7f2e340a5700 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2e44098620 tx=0x7f2e4401cb90 comp rx=0 tx=0).stop 2024-09-19T10:04:15.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e4f935640 1 -- 172.21.15.18:0/2208484645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e481009b0 msgr2=0x7f2e4819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e4f935640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e481009b0 0x7f2e4819a700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400e9f0 tx=0x7f2e4400edf0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e4f935640 1 -- 172.21.15.18:0/2208484645 shutdown_connections 2024-09-19T10:04:15.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e4f935640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2e340a3240 0x7f2e340a5700 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e4f935640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4810e4d0 0x7f2e4819efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e4f935640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e48101360 0x7f2e4819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e4f935640 1 --2- 172.21.15.18:0/2208484645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e481009b0 0x7f2e4819a700 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.164+0000 7f2e4f935640 1 -- 172.21.15.18:0/2208484645 >> 172.21.15.18:0/2208484645 conn(0x7f2e480fc7d0 msgr2=0x7f2e480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:15.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.165+0000 7f2e4f935640 1 -- 172.21.15.18:0/2208484645 shutdown_connections 2024-09-19T10:04:15.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:15.165+0000 7f2e4f935640 1 -- 172.21.15.18:0/2208484645 wait complete. 2024-09-19T10:04:15.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:14 smithi049 ceph-mon[34858]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 876 MiB/s wr, 1.70k op/s 2024-09-19T10:04:15.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:14 smithi162 ceph-mon[35174]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 2.3 MiB/s rd, 876 MiB/s wr, 1.70k op/s 2024-09-19T10:04:15.943 INFO:tasks.cephfs.filesystem:scrub status for tag:a2b9058a-ac2b-497a-970e-5a5924231c6c - {'path': '/', 'tag': 'a2b9058a-ac2b-497a-970e-5a5924231c6c', 'options': 'recursive,force'} 2024-09-19T10:04:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.953+0000 7f3ac27fc640 1 -- 172.21.15.18:0/3190053182 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c85aae8d70 con 0x55c85abff370 2024-09-19T10:04:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ac27fc640 10 client.18108 handle_command_reply: tid=0 2024-09-19T10:04:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 client.18108 shutdown 2024-09-19T10:04:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 -- 172.21.15.18:0/3190053182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab83370 msgr2=0x55c85ab8e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab83370 0x55c85ab8e0c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f3acc003b50 tx=0x7f3acc005270 comp rx=0 tx=0).stop 2024-09-19T10:04:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 -- 172.21.15.18:0/3190053182 shutdown_connections 2024-09-19T10:04:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55c85abff370 0x55c85ac01790 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c85ab83370 0x55c85ab8e0c0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c85ab7e2e0 0x55c85ab8d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 --2- 172.21.15.18:0/3190053182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c85ab7d9a0 0x55c85ab8cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 -- 172.21.15.18:0/3190053182 >> 172.21.15.18:0/3190053182 conn(0x55c85ab79010 msgr2=0x55c85ab779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ac27fc640 0 client.18108 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 -- 172.21.15.18:0/3190053182 shutdown_connections 2024-09-19T10:04:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 1 -- 172.21.15.18:0/3190053182 wait complete. 2024-09-19T10:04:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:{ 2024-09-19T10:04:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "message": "", 2024-09-19T10:04:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout: "return_code": 0 2024-09-19T10:04:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stdout:} 2024-09-19T10:04:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.954+0000 7f3ae8217740 20 client.18108 trim_cache size 0 max 16384 2024-09-19T10:04:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.956+0000 7f3ae5474640 1 -- 172.21.15.18:0/320671912 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ac40a3400 msgr2=0x7f3ac40a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.956+0000 7f3ae5474640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ac40a3400 0x7f3ac40a58c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009830 tx=0x7f3acc030340 comp rx=0 tx=0).stop 2024-09-19T10:04:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.956+0000 7f3ae5474640 1 -- 172.21.15.18:0/320671912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010a400 msgr2=0x7f3ae019e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.956+0000 7f3ae5474640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010a400 0x7f3ae019e8a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c890 tx=0x7f3ad000cd50 comp rx=0 tx=0).stop 2024-09-19T10:04:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.956+0000 7f3ae5474640 1 -- 172.21.15.18:0/320671912 shutdown_connections 2024-09-19T10:04:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.956+0000 7f3ae5474640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f3ac40a3400 0x7f3ac40a58c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.956+0000 7f3ae5474640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae010adc0 0x7f3ae01a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.956+0000 7f3ae5474640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010a400 0x7f3ae019e8a0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.956+0000 7f3ae5474640 1 --2- 172.21.15.18:0/320671912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ae00733b0 0x7f3ae019e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.956+0000 7f3ae5474640 1 -- 172.21.15.18:0/320671912 >> 172.21.15.18:0/320671912 conn(0x7f3ae006ece0 msgr2=0x7f3ae00716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.957+0000 7f3ae5474640 1 -- 172.21.15.18:0/320671912 shutdown_connections 2024-09-19T10:04:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi018.front.sepia.ceph.com.smithi018.stderr:2024-09-19T10:04:15.957+0000 7f3ae5474640 1 -- 172.21.15.18:0/320671912 wait complete. 2024-09-19T10:04:16.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:15 smithi018 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T10:04:16.251 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-09-19T10:04:16.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T10:04:16.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:15 smithi049 ceph-mon[34858]: scrub summary: idle+waiting paths [/] 2024-09-19T10:04:16.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:15 smithi162 ceph-mon[35174]: scrub summary: idle+waiting paths [/] 2024-09-19T10:04:16.604 DEBUG:teuthology.parallel:result is None 2024-09-19T10:04:16.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T10:04:16.637 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T10:04:16.637 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T10:04:16.648 INFO:tasks.quiescer:joining Quiescers 2024-09-19T10:04:16.648 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T10:04:16.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:04:16.934 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:17.297 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:16 smithi018 ceph-mon[30956]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 810 MiB/s wr, 1.69k op/s 2024-09-19T10:04:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 -- 172.21.15.18:0/3822131635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49001082a0 msgr2=0x7f490010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 --2- 172.21.15.18:0/3822131635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49001082a0 0x7f490010ec40 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009930 tx=0x7f48f802a420 comp rx=0 tx=0).stop 2024-09-19T10:04:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 -- 172.21.15.18:0/3822131635 shutdown_connections 2024-09-19T10:04:17.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 --2- 172.21.15.18:0/3822131635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49001082a0 0x7f490010ec40 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:17.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 --2- 172.21.15.18:0/3822131635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49001036e0 0x7f4900107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:17.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 --2- 172.21.15.18:0/3822131635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4900102d30 0x7f4900103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:17.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 -- 172.21.15.18:0/3822131635 >> 172.21.15.18:0/3822131635 conn(0x7f49000fc7d0 msgr2=0x7f49000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:17.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 -- 172.21.15.18:0/3822131635 shutdown_connections 2024-09-19T10:04:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 -- 172.21.15.18:0/3822131635 wait complete. 2024-09-19T10:04:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 Processor -- start 2024-09-19T10:04:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.376+0000 7f49084c1640 1 -- start start 2024-09-19T10:04:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f49084c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4900102d30 0x7f4900100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f49084c1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49001036e0 0x7f4900100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:17.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f49084c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49001082a0 0x7f4900101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:17.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f49084c1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f49001120a0 con 0x7f49001036e0 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f49084c1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4900111f20 con 0x7f49001082a0 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f49084c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4900112220 con 0x7f4900102d30 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4905a5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49001036e0 0x7f4900100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4905a5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49001036e0 0x7f4900100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47932/0 (socket says 172.21.15.18:47932) 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4905a5c640 1 -- 172.21.15.18:0/1461001236 learned_addr learned my addr 172.21.15.18:0/1461001236 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f490625d640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4900102d30 0x7f4900100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4906a5e640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49001082a0 0x7f4900101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4905a5c640 1 -- 172.21.15.18:0/1461001236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4900102d30 msgr2=0x7f4900100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4905a5c640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4900102d30 0x7f4900100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4905a5c640 1 -- 172.21.15.18:0/1461001236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49001082a0 msgr2=0x7f4900101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4905a5c640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49001082a0 0x7f4900101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:17.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4905a5c640 1 -- 172.21.15.18:0/1461001236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49001a6a00 con 0x7f49001036e0 2024-09-19T10:04:17.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4906a5e640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49001082a0 0x7f4900101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:04:17.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.377+0000 7f4905a5c640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49001036e0 0x7f4900100ed0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f48f400d950 tx=0x7f48f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:17.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.378+0000 7f48ff7fe640 1 -- 172.21.15.18:0/1461001236 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4017070 con 0x7f49001036e0 2024-09-19T10:04:17.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.378+0000 7f49084c1640 1 -- 172.21.15.18:0/1461001236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49001a6cf0 con 0x7f49001036e0 2024-09-19T10:04:17.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.378+0000 7f48ff7fe640 1 -- 172.21.15.18:0/1461001236 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f4009c30 con 0x7f49001036e0 2024-09-19T10:04:17.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.378+0000 7f48ff7fe640 1 -- 172.21.15.18:0/1461001236 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f40047a0 con 0x7f49001036e0 2024-09-19T10:04:17.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.378+0000 7f49084c1640 1 -- 172.21.15.18:0/1461001236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49001a7220 con 0x7f49001036e0 2024-09-19T10:04:17.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.379+0000 7f49084c1640 1 -- 172.21.15.18:0/1461001236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4900103110 con 0x7f49001036e0 2024-09-19T10:04:17.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.380+0000 7f48ff7fe640 1 -- 172.21.15.18:0/1461001236 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f48f4004020 con 0x7f49001036e0 2024-09-19T10:04:17.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.381+0000 7f48ff7fe640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48e80a3240 0x7f48e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:17.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.381+0000 7f490625d640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48e80a3240 0x7f48e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:17.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.381+0000 7f48ff7fe640 1 -- 172.21.15.18:0/1461001236 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f48f40cf9a0 con 0x7f49001036e0 2024-09-19T10:04:17.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.381+0000 7f490625d640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48e80a3240 0x7f48e80a5700 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f48f0005c40 tx=0x7f48f000a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:17.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.384+0000 7f48ff7fe640 1 -- 172.21.15.18:0/1461001236 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48f4020020 con 0x7f49001036e0 2024-09-19T10:04:17.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:16 smithi049 ceph-mon[34858]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 810 MiB/s wr, 1.69k op/s 2024-09-19T10:04:17.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:16 smithi162 ceph-mon[35174]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 810 MiB/s wr, 1.69k op/s 2024-09-19T10:04:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.598+0000 7f49084c1640 1 -- 172.21.15.18:0/1461001236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49001a7510 con 0x7f49001036e0 2024-09-19T10:04:17.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.598+0000 7f48ff7fe640 1 -- 172.21.15.18:0/1461001236 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f48f409c690 con 0x7f49001036e0 2024-09-19T10:04:17.602 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:04:17.602 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:04:17.603 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:04:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.601+0000 7f49084c1640 1 -- 172.21.15.18:0/1461001236 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48e80a3240 msgr2=0x7f48e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.601+0000 7f49084c1640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48e80a3240 0x7f48e80a5700 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f48f0005c40 tx=0x7f48f000a590 comp rx=0 tx=0).stop 2024-09-19T10:04:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.602+0000 7f49084c1640 1 -- 172.21.15.18:0/1461001236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49001036e0 msgr2=0x7f4900100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.602+0000 7f49084c1640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49001036e0 0x7f4900100ed0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f48f400d950 tx=0x7f48f400de10 comp rx=0 tx=0).stop 2024-09-19T10:04:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.602+0000 7f49084c1640 1 -- 172.21.15.18:0/1461001236 shutdown_connections 2024-09-19T10:04:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.602+0000 7f49084c1640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f48e80a3240 0x7f48e80a5700 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.602+0000 7f49084c1640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49001082a0 0x7f4900101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.602+0000 7f49084c1640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49001036e0 0x7f4900100ed0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.602+0000 7f49084c1640 1 --2- 172.21.15.18:0/1461001236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4900102d30 0x7f4900100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.602+0000 7f49084c1640 1 -- 172.21.15.18:0/1461001236 >> 172.21.15.18:0/1461001236 conn(0x7f49000fc7d0 msgr2=0x7f4900105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.602+0000 7f49084c1640 1 -- 172.21.15.18:0/1461001236 shutdown_connections 2024-09-19T10:04:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:17.602+0000 7f49084c1640 1 -- 172.21.15.18:0/1461001236 wait complete. 2024-09-19T10:04:18.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:17 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1461001236' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:04:18.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:17 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1461001236' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:04:18.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:17 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1461001236' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:04:18.630 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24524 quiesce db --cancel --all' 2024-09-19T10:04:18.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24524 quiesce db --cancel --all 2024-09-19T10:04:18.895 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:19.263 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:18 smithi018 ceph-mon[30956]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 687 MiB/s wr, 1.44k op/s 2024-09-19T10:04:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 -- 172.21.15.18:0/1696038647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02001009d0 msgr2=0x7f0200100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 --2- 172.21.15.18:0/1696038647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02001009d0 0x7f0200100db0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009900 tx=0x7f01f002a410 comp rx=0 tx=0).stop 2024-09-19T10:04:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 -- 172.21.15.18:0/1696038647 shutdown_connections 2024-09-19T10:04:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 --2- 172.21.15.18:0/1696038647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020010e4f0 0x7f0200110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 --2- 172.21.15.18:0/1696038647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0200101380 0x7f020010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 --2- 172.21.15.18:0/1696038647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02001009d0 0x7f0200100db0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 -- 172.21.15.18:0/1696038647 >> 172.21.15.18:0/1696038647 conn(0x7f02000fc7d0 msgr2=0x7f02000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 -- 172.21.15.18:0/1696038647 shutdown_connections 2024-09-19T10:04:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 -- 172.21.15.18:0/1696038647 wait complete. 2024-09-19T10:04:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 Processor -- start 2024-09-19T10:04:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.348+0000 7f0206b61640 1 -- start start 2024-09-19T10:04:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f0206b61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02001009d0 0x7f02001a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f0206b61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0200101380 0x7f02001a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f0206b61640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020010e4f0 0x7f020019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f0206b61640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0200114250 con 0x7f0200101380 2024-09-19T10:04:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f0206b61640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f02001140d0 con 0x7f02001009d0 2024-09-19T10:04:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f0206b61640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02001143d0 con 0x7f020010e4f0 2024-09-19T10:04:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0200101380 0x7f02001a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0200101380 0x7f02001a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47954/0 (socket says 172.21.15.18:47954) 2024-09-19T10:04:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fffff640 1 -- 172.21.15.18:0/1950262092 learned_addr learned my addr 172.21.15.18:0/1950262092 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f02048fd640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02001009d0 0x7f02001a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f02050fe640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020010e4f0 0x7f020019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fffff640 1 -- 172.21.15.18:0/1950262092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020010e4f0 msgr2=0x7f020019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fffff640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020010e4f0 0x7f020019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fffff640 1 -- 172.21.15.18:0/1950262092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02001009d0 msgr2=0x7f02001a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fffff640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02001009d0 0x7f02001a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fffff640 1 -- 172.21.15.18:0/1950262092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020019aed0 con 0x7f0200101380 2024-09-19T10:04:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f02050fe640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020010e4f0 0x7f020019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fffff640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0200101380 0x7f02001a0a80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f01f400d950 tx=0x7f01f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fdffb640 1 -- 172.21.15.18:0/1950262092 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4017070 con 0x7f0200101380 2024-09-19T10:04:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f0206b61640 1 -- 172.21.15.18:0/1950262092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020019b1c0 con 0x7f0200101380 2024-09-19T10:04:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.349+0000 7f01fdffb640 1 -- 172.21.15.18:0/1950262092 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01f4009c30 con 0x7f0200101380 2024-09-19T10:04:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.350+0000 7f01fdffb640 1 -- 172.21.15.18:0/1950262092 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f400f6b0 con 0x7f0200101380 2024-09-19T10:04:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.350+0000 7f0206b61640 1 -- 172.21.15.18:0/1950262092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02001a7530 con 0x7f0200101380 2024-09-19T10:04:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.352+0000 7f01fdffb640 1 -- 172.21.15.18:0/1950262092 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f01f40109d0 con 0x7f0200101380 2024-09-19T10:04:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f0208f3a740 1 Processor -- start 2024-09-19T10:04:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f0208f3a740 1 -- start start 2024-09-19T10:04:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdc7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdd26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f01fdffb640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01e80a3240 0x7f01e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdd2be0 0x55ef6bdd4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f0208f3a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ef6bd2c200 con 0x55ef6bdc8320 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f0208f3a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ef6bcd2dc0 con 0x55ef6bdd2be0 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f0208f3a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ef6bd281c0 con 0x55ef6bdc7a00 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f01fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdd26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f02048fd640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01e80a3240 0x7f01e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f01fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdd26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47966/0 (socket says 172.21.15.18:47966) 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f01fffff640 1 -- 172.21.15.18:0/2058385833 learned_addr learned my addr 172.21.15.18:0/2058385833 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f02050fe640 1 --2- 172.21.15.18:0/2058385833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdc7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f01fdffb640 1 -- 172.21.15.18:0/1950262092 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f01f40cf5d0 con 0x7f0200101380 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.353+0000 7f02050fe640 1 --2- 172.21.15.18:0/2058385833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdd2be0 0x55ef6bdd4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.354+0000 7f01fffff640 1 -- 172.21.15.18:0/2058385833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 msgr2=0x55ef6bdc7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.354+0000 7f01fffff640 1 --2- 172.21.15.18:0/2058385833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdc7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.354+0000 7f01fffff640 1 -- 172.21.15.18:0/2058385833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdd2be0 msgr2=0x55ef6bdd4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.354+0000 7f01fffff640 1 --2- 172.21.15.18:0/2058385833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdd2be0 0x55ef6bdd4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.354+0000 7f01fffff640 1 -- 172.21.15.18:0/2058385833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef6ba9d620 con 0x55ef6bdc8320 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.354+0000 7f01fffff640 1 --2- 172.21.15.18:0/2058385833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdd26a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f01f401d000 tx=0x7f01f400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c1b0d0b17b7c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.354+0000 7f02048fd640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01e80a3240 0x7f01e80a5700 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009230 tx=0x7f01f00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.354+0000 7f01e6ffd640 1 -- 172.21.15.18:0/2058385833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4020020 con 0x55ef6bdc8320 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.354+0000 7f01e6ffd640 1 -- 172.21.15.18:0/2058385833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01f40bd110 con 0x55ef6bdc8320 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.354+0000 7f01e6ffd640 1 -- 172.21.15.18:0/2058385833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4098230 con 0x55ef6bdc8320 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 -- 172.21.15.18:0/2058385833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 msgr2=0x55ef6bdd26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 --2- 172.21.15.18:0/2058385833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdd26a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f01f401d000 tx=0x7f01f400bf60 comp rx=0 tx=0).stop 2024-09-19T10:04:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 -- 172.21.15.18:0/2058385833 shutdown_connections 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 --2- 172.21.15.18:0/2058385833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdd2be0 0x55ef6bdd4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 --2- 172.21.15.18:0/2058385833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdd26a0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 --2- 172.21.15.18:0/2058385833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdc7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 -- 172.21.15.18:0/2058385833 >> 172.21.15.18:0/2058385833 conn(0x55ef6bdc3f90 msgr2=0x55ef6bdc4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 -- 172.21.15.18:0/2058385833 shutdown_connections 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 -- 172.21.15.18:0/2058385833 wait complete. 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 -- start start 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.355+0000 7f0208f3a740 1 Processor -- start 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdcf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdd2be0 0x55ef6bdcfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f0208f3a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ef6bdd5750 con 0x55ef6bdc8320 2024-09-19T10:04:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f0208f3a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ef6bcc6c50 con 0x55ef6bdc7a00 2024-09-19T10:04:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f0208f3a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ef6bdd58d0 con 0x55ef6bdd2be0 2024-09-19T10:04:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f0208f3a740 10 client.0 _ll_register_callbacks cb 0x55ef6bcd8ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f01fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdcf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f01fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdcf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47982/0 (socket says 172.21.15.18:47982) 2024-09-19T10:04:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f01fffff640 1 -- 172.21.15.18:0/4224491925 learned_addr learned my addr 172.21.15.18:0/4224491925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f02048fd640 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f02050fe640 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdd2be0 0x55ef6bdcfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f01fffff640 1 -- 172.21.15.18:0/4224491925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdd2be0 msgr2=0x55ef6bdcfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f01fffff640 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdd2be0 0x55ef6bdcfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f01fffff640 1 -- 172.21.15.18:0/4224491925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc7a00 msgr2=0x55ef6bdd2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f01fffff640 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f01fffff640 1 -- 172.21.15.18:0/4224491925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef6bdd0480 con 0x55ef6bdc8320 2024-09-19T10:04:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f02048fd640 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:04:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f01fffff640 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdcf740 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f01f4012040 tx=0x7f01f4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f241fd7bcf9824 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.356+0000 7f01dffff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f01dffff640 1 -- 172.21.15.18:0/4224491925 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4020070 con 0x55ef6bdc8320 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f01dffff640 1 -- 172.21.15.18:0/4224491925 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f01f40cf2d0 con 0x55ef6bdc8320 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f0208f3a740 1 -- 172.21.15.18:0/4224491925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01f40bd110 con 0x55ef6bdc8320 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f01dffff640 1 -- 172.21.15.18:0/4224491925 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f01f409ff70 con 0x55ef6bdc8320 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f0208f3a740 10 client.18144 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f0208f3a740 1 -- 172.21.15.18:0/4224491925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ef6bde1270 con 0x55ef6bdc8320 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f01dffff640 1 -- 172.21.15.18:0/4224491925 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01f40bd110 con 0x55ef6bdc8320 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f01dffff640 1 -- 172.21.15.18:0/4224491925 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f01f409b010 con 0x55ef6bdc8320 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f0208f3a740 10 client.18144 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f0208f3a740 10 client.18144 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:04:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f0208f3a740 20 client.18144 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f0208f3a740 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ef6bde25c0 0x55ef6bde49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f0208f3a740 4 client.18144 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.357+0000 7f0208f3a740 1 -- 172.21.15.18:0/4224491925 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef6bd39770 con 0x55ef6bde25c0 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.358+0000 7f02048fd640 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ef6bde25c0 0x55ef6bde49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.358+0000 7f01dffff640 10 client.18144 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.358+0000 7f02048fd640 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ef6bde25c0 0x55ef6bde49b0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59766c6975b9044 server_cookie=c4208e105a1e9a4a in_seq=0 out_seq=0 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f01dffff640 1 -- 172.21.15.18:0/4224491925 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef6bd39770 con 0x55ef6bde25c0 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f01dffff640 10 client.18144 handle_command_reply: tid=0 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 client.18144 shutdown 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 -- 172.21.15.18:0/4224491925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 msgr2=0x55ef6bdcf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdcf740 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f01f4012040 tx=0x7f01f4000bc0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 -- 172.21.15.18:0/4224491925 shutdown_connections 2024-09-19T10:04:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ef6bde25c0 0x55ef6bde49b0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdd2be0 0x55ef6bdcfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc8320 0x55ef6bdcf740 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 --2- 172.21.15.18:0/4224491925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f01dffff640 0 client.18144 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 -- 172.21.15.18:0/4224491925 >> 172.21.15.18:0/4224491925 conn(0x55ef6bdc3f90 msgr2=0x55ef6bdc31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 -- 172.21.15.18:0/4224491925 shutdown_connections 2024-09-19T10:04:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 1 -- 172.21.15.18:0/4224491925 wait complete. 2024-09-19T10:04:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.359+0000 7f0208f3a740 20 client.18144 trim_cache size 0 max 16384 2024-09-19T10:04:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.376+0000 7f0208f3a740 1 Processor -- start 2024-09-19T10:04:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.376+0000 7f0208f3a740 1 -- start start 2024-09-19T10:04:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.376+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc3f90 0x55ef6bdde9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.376+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdea040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.376+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc8320 0x55ef6bdea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.376+0000 7f0208f3a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f02001af790 con 0x55ef6bdc3f90 2024-09-19T10:04:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.376+0000 7f0208f3a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f02001b12d0 con 0x55ef6bdc8320 2024-09-19T10:04:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.376+0000 7f0208f3a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02001afe60 con 0x55ef6bdc7a00 2024-09-19T10:04:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f02048fd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc3f90 0x55ef6bdde9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f02048fd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc3f90 0x55ef6bdde9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47988/0 (socket says 172.21.15.18:47988) 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f01fffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f02048fd640 1 -- 172.21.15.18:0/166472622 learned_addr learned my addr 172.21.15.18:0/166472622 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f02050fe640 1 --2- 172.21.15.18:0/166472622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc8320 0x55ef6bdea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f01fffff640 1 -- 172.21.15.18:0/166472622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc8320 msgr2=0x55ef6bdea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f01fffff640 1 --2- 172.21.15.18:0/166472622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc8320 0x55ef6bdea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f01fffff640 1 -- 172.21.15.18:0/166472622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc3f90 msgr2=0x55ef6bdde9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f01fffff640 1 --2- 172.21.15.18:0/166472622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc3f90 0x55ef6bdde9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f01fffff640 1 -- 172.21.15.18:0/166472622 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef6bdc3dc0 con 0x55ef6bdc7a00 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f02048fd640 1 --2- 172.21.15.18:0/166472622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc3f90 0x55ef6bdde9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f01fffff640 1 --2- 172.21.15.18:0/166472622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdea040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009610 tx=0x7f01f4097d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82f9e0c63a429d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f01e67fc640 1 -- 172.21.15.18:0/166472622 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4020030 con 0x55ef6bdc7a00 2024-09-19T10:04:19.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f01e67fc640 1 -- 172.21.15.18:0/166472622 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01f40b2020 con 0x55ef6bdc7a00 2024-09-19T10:04:19.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.377+0000 7f01e67fc640 1 -- 172.21.15.18:0/166472622 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f40860e0 con 0x55ef6bdc7a00 2024-09-19T10:04:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 -- 172.21.15.18:0/166472622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 msgr2=0x55ef6bdea040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 --2- 172.21.15.18:0/166472622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdea040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009610 tx=0x7f01f4097d90 comp rx=0 tx=0).stop 2024-09-19T10:04:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 -- 172.21.15.18:0/166472622 shutdown_connections 2024-09-19T10:04:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 --2- 172.21.15.18:0/166472622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc8320 0x55ef6bdea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 --2- 172.21.15.18:0/166472622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdea040 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 --2- 172.21.15.18:0/166472622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc3f90 0x55ef6bdde9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 -- 172.21.15.18:0/166472622 >> 172.21.15.18:0/166472622 conn(0x55ef6bdcfde0 msgr2=0x55ef6bdce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 -- 172.21.15.18:0/166472622 shutdown_connections 2024-09-19T10:04:19.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 -- 172.21.15.18:0/166472622 wait complete. 2024-09-19T10:04:19.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 -- start start 2024-09-19T10:04:19.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.378+0000 7f0208f3a740 1 Processor -- start 2024-09-19T10:04:19.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc3f90 0x55ef6bdd69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f0208f3a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc8320 0x55ef6bdd7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f0208f3a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f02001b0c00 con 0x55ef6bdc7a00 2024-09-19T10:04:19.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f0208f3a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f02001b0530 con 0x55ef6bdc8320 2024-09-19T10:04:19.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f0208f3a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02001ad790 con 0x55ef6bdc3f90 2024-09-19T10:04:19.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f0208f3a740 10 client.0 _ll_register_callbacks cb 0x7f01f409b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:19.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f01fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f01fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47990/0 (socket says 172.21.15.18:47990) 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f01fffff640 1 -- 172.21.15.18:0/1442575010 learned_addr learned my addr 172.21.15.18:0/1442575010 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f02048fd640 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc3f90 0x55ef6bdd69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f02050fe640 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc8320 0x55ef6bdd7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f01fffff640 1 -- 172.21.15.18:0/1442575010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc3f90 msgr2=0x55ef6bdd69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f01fffff640 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc3f90 0x55ef6bdd69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f01fffff640 1 -- 172.21.15.18:0/1442575010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc8320 msgr2=0x55ef6bdd7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f01fffff640 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc8320 0x55ef6bdd7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.379+0000 7f01fffff640 1 -- 172.21.15.18:0/1442575010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef6bde4e10 con 0x55ef6bdc7a00 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f01fffff640 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd6ef0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f01f4097e00 tx=0x7f01f4009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afdddb9b5d8a31b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f01dffff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f01dffff640 1 -- 172.21.15.18:0/1442575010 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4020070 con 0x55ef6bdc7a00 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f01dffff640 1 -- 172.21.15.18:0/1442575010 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f01f40cf2e0 con 0x55ef6bdc7a00 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f0208f3a740 1 -- 172.21.15.18:0/1442575010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01f40b2020 con 0x55ef6bdc7a00 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f01dffff640 1 -- 172.21.15.18:0/1442575010 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f01f40a4830 con 0x55ef6bdc7a00 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f0208f3a740 10 client.18150 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f0208f3a740 1 -- 172.21.15.18:0/1442575010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ef6bde4e10 con 0x55ef6bdc7a00 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f01dffff640 1 -- 172.21.15.18:0/1442575010 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01f40b2020 con 0x55ef6bdc7a00 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f01dffff640 1 -- 172.21.15.18:0/1442575010 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f01f4081030 con 0x55ef6bdc7a00 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f0208f3a740 10 client.18150 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f0208f3a740 10 client.18150 resolve_mds: validated gid 24524 aka daemon mds.b 2024-09-19T10:04:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f0208f3a740 20 client.18150 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:19.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f0208f3a740 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ef6bdd2be0 0x55ef6be4f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:19.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f0208f3a740 4 client.18150 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T10:04:19.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.380+0000 7f0208f3a740 1 -- 172.21.15.18:0/1442575010 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55ef6bd33c80 con 0x55ef6bdd2be0 2024-09-19T10:04:19.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.381+0000 7f02048fd640 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ef6bdd2be0 0x55ef6be4f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:19.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.381+0000 7f02048fd640 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ef6bdd2be0 0x55ef6be4f4f0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef2fc79916f6c4b5 server_cookie=e44365b9f88d520b in_seq=0 out_seq=0 2024-09-19T10:04:19.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.381+0000 7f01dffff640 10 client.18150 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:19.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.381+0000 7f01dffff640 1 -- 172.21.15.18:0/1442575010 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55ef6bd33c80 con 0x55ef6bdd2be0 2024-09-19T10:04:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.381+0000 7f01dffff640 10 client.18150 handle_command_reply: tid=0 2024-09-19T10:04:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 client.18150 shutdown 2024-09-19T10:04:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 -- 172.21.15.18:0/1442575010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc7a00 msgr2=0x55ef6bdd6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd6ef0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f01f4097e00 tx=0x7f01f4009f20 comp rx=0 tx=0).stop 2024-09-19T10:04:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 -- 172.21.15.18:0/1442575010 shutdown_connections 2024-09-19T10:04:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55ef6bdd2be0 0x55ef6be4f4f0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef6bdc8320 0x55ef6bdd7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ef6bdc7a00 0x55ef6bdd6ef0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 --2- 172.21.15.18:0/1442575010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef6bdc3f90 0x55ef6bdd69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f01dffff640 0 client.18150 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 -- 172.21.15.18:0/1442575010 >> 172.21.15.18:0/1442575010 conn(0x55ef6bdcfde0 msgr2=0x55ef6bdd0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 -- 172.21.15.18:0/1442575010 shutdown_connections 2024-09-19T10:04:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 1 -- 172.21.15.18:0/1442575010 wait complete. 2024-09-19T10:04:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.382+0000 7f0208f3a740 20 client.18150 trim_cache size 0 max 16384 2024-09-19T10:04:19.393 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:04:19.393 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-19T10:04:19.393 INFO:teuthology.orchestra.run.smithi018.stdout: "leader": 24524, 2024-09-19T10:04:19.394 INFO:teuthology.orchestra.run.smithi018.stdout: "set_version": 40, 2024-09-19T10:04:19.394 INFO:teuthology.orchestra.run.smithi018.stdout: "sets": {} 2024-09-19T10:04:19.394 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:04:19.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 -- 172.21.15.18:0/1950262092 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01e80a3240 msgr2=0x7f01e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:19.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01e80a3240 0x7f01e80a5700 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009230 tx=0x7f01f00058d0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 -- 172.21.15.18:0/1950262092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0200101380 msgr2=0x7f02001a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:19.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0200101380 0x7f02001a0a80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f01f400d950 tx=0x7f01f400de10 comp rx=0 tx=0).stop 2024-09-19T10:04:19.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 -- 172.21.15.18:0/1950262092 shutdown_connections 2024-09-19T10:04:19.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f01e80a3240 0x7f01e80a5700 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020010e4f0 0x7f020019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0200101380 0x7f02001a0a80 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 --2- 172.21.15.18:0/1950262092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02001009d0 0x7f02001a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:19.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 -- 172.21.15.18:0/1950262092 >> 172.21.15.18:0/1950262092 conn(0x7f02000fc7d0 msgr2=0x7f02000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:19.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 -- 172.21.15.18:0/1950262092 shutdown_connections 2024-09-19T10:04:19.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:19.383+0000 7f0206b61640 1 -- 172.21.15.18:0/1950262092 wait complete. 2024-09-19T10:04:19.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:18 smithi049 ceph-mon[34858]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 687 MiB/s wr, 1.44k op/s 2024-09-19T10:04:19.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:18 smithi162 ceph-mon[35174]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 687 MiB/s wr, 1.44k op/s 2024-09-19T10:04:20.164 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T10:04:20.164 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T10:04:20.174 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T10:04:20.185 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T10:04:20.196 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T10:04:20.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:20 smithi018 ceph-mon[30956]: scrub summary: idle 2024-09-19T10:04:20.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:20 smithi049 ceph-mon[34858]: scrub summary: idle 2024-09-19T10:04:20.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:20 smithi162 ceph-mon[35174]: scrub summary: idle 2024-09-19T10:04:21.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:21 smithi018 ceph-mon[30956]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 626 MiB/s wr, 1.27k op/s 2024-09-19T10:04:21.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:21 smithi049 ceph-mon[34858]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 626 MiB/s wr, 1.27k op/s 2024-09-19T10:04:21.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:21 smithi162 ceph-mon[35174]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 1.9 MiB/s rd, 626 MiB/s wr, 1.27k op/s 2024-09-19T10:04:23.215 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:22 smithi162 ceph-mon[35174]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 489 MiB/s wr, 983 op/s 2024-09-19T10:04:23.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:22 smithi018 ceph-mon[30956]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 489 MiB/s wr, 983 op/s 2024-09-19T10:04:23.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:22 smithi049 ceph-mon[34858]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 489 MiB/s wr, 983 op/s 2024-09-19T10:04:25.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:24 smithi018 ceph-mon[30956]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 366 MiB/s wr, 771 op/s 2024-09-19T10:04:25.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:24 smithi049 ceph-mon[34858]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 366 MiB/s wr, 771 op/s 2024-09-19T10:04:25.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:24 smithi162 ceph-mon[35174]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 58 GiB used, 1014 GiB / 1.0 TiB avail; 1.3 MiB/s rd, 366 MiB/s wr, 771 op/s 2024-09-19T10:04:27.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:26 smithi018 ceph-mon[30956]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 777 KiB/s rd, 205 MiB/s wr, 462 op/s 2024-09-19T10:04:27.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:26 smithi049 ceph-mon[34858]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 777 KiB/s rd, 205 MiB/s wr, 462 op/s 2024-09-19T10:04:27.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:26 smithi162 ceph-mon[35174]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 777 KiB/s rd, 205 MiB/s wr, 462 op/s 2024-09-19T10:04:29.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:28 smithi018 ceph-mon[30956]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 101 MiB/s wr, 242 op/s 2024-09-19T10:04:29.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:28 smithi049 ceph-mon[34858]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 101 MiB/s wr, 242 op/s 2024-09-19T10:04:29.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:28 smithi162 ceph-mon[35174]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 101 MiB/s wr, 242 op/s 2024-09-19T10:04:31.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:30 smithi018 ceph-mon[30956]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 87 MiB/s wr, 214 op/s 2024-09-19T10:04:31.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:30 smithi049 ceph-mon[34858]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 87 MiB/s wr, 214 op/s 2024-09-19T10:04:31.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:30 smithi162 ceph-mon[35174]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 87 MiB/s wr, 214 op/s 2024-09-19T10:04:33.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:32 smithi018 ceph-mon[30956]: pgmap v705: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 83 MiB/s wr, 202 op/s 2024-09-19T10:04:33.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:32 smithi049 ceph-mon[34858]: pgmap v705: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 83 MiB/s wr, 202 op/s 2024-09-19T10:04:33.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:32 smithi162 ceph-mon[35174]: pgmap v705: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 83 MiB/s wr, 202 op/s 2024-09-19T10:04:35.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:34 smithi018 ceph-mon[30956]: pgmap v706: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 86 MiB/s wr, 210 op/s 2024-09-19T10:04:35.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:34 smithi049 ceph-mon[34858]: pgmap v706: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 86 MiB/s wr, 210 op/s 2024-09-19T10:04:35.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:34 smithi162 ceph-mon[35174]: pgmap v706: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 86 MiB/s wr, 210 op/s 2024-09-19T10:04:37.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:36 smithi018 ceph-mon[30956]: pgmap v707: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 87 MiB/s wr, 223 op/s 2024-09-19T10:04:37.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:36 smithi049 ceph-mon[34858]: pgmap v707: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 87 MiB/s wr, 223 op/s 2024-09-19T10:04:37.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:36 smithi162 ceph-mon[35174]: pgmap v707: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 87 MiB/s wr, 223 op/s 2024-09-19T10:04:39.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:38 smithi018 ceph-mon[30956]: pgmap v708: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 84 MiB/s wr, 224 op/s 2024-09-19T10:04:39.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:38 smithi049 ceph-mon[34858]: pgmap v708: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 84 MiB/s wr, 224 op/s 2024-09-19T10:04:39.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:38 smithi162 ceph-mon[35174]: pgmap v708: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 84 MiB/s wr, 224 op/s 2024-09-19T10:04:41.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:40 smithi018 ceph-mon[30956]: pgmap v709: 97 pgs: 97 active+clean; 9.9 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 90 MiB/s wr, 250 op/s 2024-09-19T10:04:41.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:40 smithi049 ceph-mon[34858]: pgmap v709: 97 pgs: 97 active+clean; 9.9 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 90 MiB/s wr, 250 op/s 2024-09-19T10:04:41.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:40 smithi162 ceph-mon[35174]: pgmap v709: 97 pgs: 97 active+clean; 9.9 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 90 MiB/s wr, 250 op/s 2024-09-19T10:04:43.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:42 smithi018 ceph-mon[30956]: pgmap v710: 97 pgs: 97 active+clean; 9.1 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 88 MiB/s wr, 269 op/s 2024-09-19T10:04:43.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:42 smithi049 ceph-mon[34858]: pgmap v710: 97 pgs: 97 active+clean; 9.1 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 88 MiB/s wr, 269 op/s 2024-09-19T10:04:43.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:42 smithi162 ceph-mon[35174]: pgmap v710: 97 pgs: 97 active+clean; 9.1 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 88 MiB/s wr, 269 op/s 2024-09-19T10:04:45.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:44 smithi018 ceph-mon[30956]: pgmap v711: 97 pgs: 97 active+clean; 8.1 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 89 MiB/s wr, 309 op/s 2024-09-19T10:04:45.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:44 smithi049 ceph-mon[34858]: pgmap v711: 97 pgs: 97 active+clean; 8.1 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 89 MiB/s wr, 309 op/s 2024-09-19T10:04:45.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:44 smithi162 ceph-mon[35174]: pgmap v711: 97 pgs: 97 active+clean; 8.1 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 89 MiB/s wr, 309 op/s 2024-09-19T10:04:45.944 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T10:04:46.468 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.081+0000 7f5751e2d640 1 -- 172.21.15.18:0/34804561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f574c108290 msgr2=0x7f574c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.081+0000 7f5751e2d640 1 --2- 172.21.15.18:0/34804561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f574c108290 0x7f574c10ec30 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f5744009cd0 tx=0x7f574402a8e0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.081+0000 7f5751e2d640 1 -- 172.21.15.18:0/34804561 shutdown_connections 2024-09-19T10:04:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.081+0000 7f5751e2d640 1 --2- 172.21.15.18:0/34804561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f574c108290 0x7f574c10ec30 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.081+0000 7f5751e2d640 1 --2- 172.21.15.18:0/34804561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f574c103740 0x7f574c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.081+0000 7f5751e2d640 1 --2- 172.21.15.18:0/34804561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574c102d90 0x7f574c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.081+0000 7f5751e2d640 1 -- 172.21.15.18:0/34804561 >> 172.21.15.18:0/34804561 conn(0x7f574c0fc7d0 msgr2=0x7f574c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:47.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.081+0000 7f5751e2d640 1 -- 172.21.15.18:0/34804561 shutdown_connections 2024-09-19T10:04:47.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.081+0000 7f5751e2d640 1 -- 172.21.15.18:0/34804561 wait complete. 2024-09-19T10:04:47.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f5751e2d640 1 Processor -- start 2024-09-19T10:04:47.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f5751e2d640 1 -- start start 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f5751e2d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f574c102d90 0x7f574c1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f5751e2d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574c103740 0x7f574c100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f5751e2d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f574c108290 0x7f574c101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f5751e2d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1120f0 con 0x7f574c102d90 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f5751e2d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f574c111f70 con 0x7f574c103740 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f5751e2d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f574c112270 con 0x7f574c108290 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f574b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f574c102d90 0x7f574c1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f574bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f574c108290 0x7f574c101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f574bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f574c108290 0x7f574c101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:44330/0 (socket says 172.21.15.18:44330) 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.082+0000 7f574bfff640 1 -- 172.21.15.18:0/3806750561 learned_addr learned my addr 172.21.15.18:0/3806750561 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:47.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f574affd640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574c103740 0x7f574c100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f574b7fe640 1 -- 172.21.15.18:0/3806750561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f574c108290 msgr2=0x7f574c101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f574b7fe640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f574c108290 0x7f574c101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f574b7fe640 1 -- 172.21.15.18:0/3806750561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574c103740 msgr2=0x7f574c100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f574b7fe640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574c103740 0x7f574c100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f574b7fe640 1 -- 172.21.15.18:0/3806750561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c1a6a90 con 0x7f574c102d90 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f574affd640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574c103740 0x7f574c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f574b7fe640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f574c102d90 0x7f574c1009f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f573c00b3f0 tx=0x7f573c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f5748ff9640 1 -- 172.21.15.18:0/3806750561 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c015020 con 0x7f574c102d90 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f5748ff9640 1 -- 172.21.15.18:0/3806750561 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f573c011d10 con 0x7f574c102d90 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f5751e2d640 1 -- 172.21.15.18:0/3806750561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574c1a6d80 con 0x7f574c102d90 2024-09-19T10:04:47.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f5748ff9640 1 -- 172.21.15.18:0/3806750561 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c00f2e0 con 0x7f574c102d90 2024-09-19T10:04:47.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.083+0000 7f5751e2d640 1 -- 172.21.15.18:0/3806750561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574c1a7260 con 0x7f574c102d90 2024-09-19T10:04:47.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f5748ff9640 1 -- 172.21.15.18:0/3806750561 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f573c018020 con 0x7f574c102d90 2024-09-19T10:04:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f5754206740 1 Processor -- start 2024-09-19T10:04:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f5754206740 1 -- start start 2024-09-19T10:04:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f5754206740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f5754206740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b3dc0 0x55a8154be140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f5754206740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154be680 0x55a8154c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f5754206740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a8154192e0 con 0x55a8154be680 2024-09-19T10:04:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f5754206740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a8153c0ce0 con 0x55a8154b3dc0 2024-09-19T10:04:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f5754206740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a8154152a0 con 0x55a8154b34a0 2024-09-19T10:04:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f574bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f574affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154be680 0x55a8154c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f574bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:44346/0 (socket says 172.21.15.18:44346) 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f574bfff640 1 -- 172.21.15.18:0/1420393672 learned_addr learned my addr 172.21.15.18:0/1420393672 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f574affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154be680 0x55a8154c0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38688/0 (socket says 172.21.15.18:38688) 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.086+0000 7f574b7fe640 1 --2- 172.21.15.18:0/1420393672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b3dc0 0x55a8154be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f5748ff9640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57340a3240 0x7f57340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f574bfff640 1 -- 172.21.15.18:0/1420393672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b3dc0 msgr2=0x55a8154be140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f574bfff640 1 --2- 172.21.15.18:0/1420393672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b3dc0 0x55a8154be140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f574bfff640 1 -- 172.21.15.18:0/1420393672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154be680 msgr2=0x55a8154c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f574bfff640 1 --2- 172.21.15.18:0/1420393672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154be680 0x55a8154c0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f574bfff640 1 -- 172.21.15.18:0/1420393672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8153a5440 con 0x55a8154b34a0 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f574affd640 1 --2- 172.21.15.18:0/1420393672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154be680 0x55a8154c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f5748ff9640 1 -- 172.21.15.18:0/3806750561 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f573c0cf100 con 0x7f574c102d90 2024-09-19T10:04:47.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f574bfff640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57340a3240 0x7f57340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f574bfff640 1 --2- 172.21.15.18:0/1420393672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154b3880 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5744009df0 tx=0x7f57440315f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bba2efee9de375bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f5731ffb640 1 -- 172.21.15.18:0/1420393672 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744031b20 con 0x55a8154b34a0 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f5731ffb640 1 -- 172.21.15.18:0/1420393672 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5744036070 con 0x55a8154b34a0 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.087+0000 7f5731ffb640 1 -- 172.21.15.18:0/1420393672 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744030e10 con 0x55a8154b34a0 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f5754206740 1 -- 172.21.15.18:0/1420393672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 msgr2=0x55a8154b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f574bfff640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57340a3240 0x7f57340a5700 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5744049000 tx=0x7f574404a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f5754206740 1 --2- 172.21.15.18:0/1420393672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154b3880 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5744009df0 tx=0x7f57440315f0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f5754206740 1 -- 172.21.15.18:0/1420393672 shutdown_connections 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f5754206740 1 --2- 172.21.15.18:0/1420393672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154be680 0x55a8154c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f5754206740 1 --2- 172.21.15.18:0/1420393672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b3dc0 0x55a8154be140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f5754206740 1 --2- 172.21.15.18:0/1420393672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154b3880 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f5754206740 1 -- 172.21.15.18:0/1420393672 >> 172.21.15.18:0/1420393672 conn(0x55a8154afa30 msgr2=0x55a8154afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f5754206740 1 -- 172.21.15.18:0/1420393672 shutdown_connections 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f5754206740 1 -- 172.21.15.18:0/1420393672 wait complete. 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.088+0000 7f5754206740 1 -- start start 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f5754206740 1 Processor -- start 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f5754206740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f5754206740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154bb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f5754206740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154be680 0x55a8154bb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f5754206740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a8154c1250 con 0x55a8154b3dc0 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f5754206740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a8153d4050 con 0x55a8154be680 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f5754206740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a8154c13d0 con 0x55a8154b34a0 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f5754206740 10 client.0 _ll_register_callbacks cb 0x55a815414160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f574affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154bb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f574affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154bb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38700/0 (socket says 172.21.15.18:38700) 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f574affd640 1 -- 172.21.15.18:0/2880837389 learned_addr learned my addr 172.21.15.18:0/2880837389 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f574b7fe640 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f574bfff640 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154be680 0x55a8154bb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f574affd640 1 -- 172.21.15.18:0/2880837389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 msgr2=0x55a8154bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f574affd640 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f574affd640 1 -- 172.21.15.18:0/2880837389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154be680 msgr2=0x55a8154bb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.089+0000 7f574affd640 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154be680 0x55a8154bb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f574affd640 1 -- 172.21.15.18:0/2880837389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a81518a3c0 con 0x55a8154b3dc0 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f574b7fe640 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f574affd640 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154bb1f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f57400117e0 tx=0x7f5740011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d52ab7227a23add server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f572affd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f572affd640 1 -- 172.21.15.18:0/2880837389 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574000fe70 con 0x55a8154b3dc0 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f572affd640 1 -- 172.21.15.18:0/2880837389 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5740005020 con 0x55a8154b3dc0 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f5754206740 1 -- 172.21.15.18:0/2880837389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5744036070 con 0x55a8154b3dc0 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f572affd640 1 -- 172.21.15.18:0/2880837389 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f574001f020 con 0x55a8154b3dc0 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f5754206740 10 client.18162 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f5754206740 1 -- 172.21.15.18:0/2880837389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a8154ccc30 con 0x55a8154b3dc0 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f572affd640 1 -- 172.21.15.18:0/2880837389 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5744036070 con 0x55a8154b3dc0 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.090+0000 7f572affd640 1 -- 172.21.15.18:0/2880837389 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5740018030 con 0x55a8154b3dc0 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.091+0000 7f5754206740 10 client.18162 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.091+0000 7f5754206740 10 client.18162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.091+0000 7f5754206740 20 client.18162 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.091+0000 7f5754206740 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a8154ce090 0x55a8154d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.091+0000 7f5754206740 4 client.18162 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.091+0000 7f5754206740 1 -- 172.21.15.18:0/2880837389 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a815426850 con 0x55a8154ce090 2024-09-19T10:04:47.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.091+0000 7f574b7fe640 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a8154ce090 0x55a8154d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.091+0000 7f574b7fe640 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a8154ce090 0x55a8154d0530 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c7aa6a8febd06b7 server_cookie=3ddc823bb8631c19 in_seq=0 out_seq=0 2024-09-19T10:04:47.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.091+0000 7f572affd640 10 client.18162 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f572affd640 1 -- 172.21.15.18:0/2880837389 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a815426850 con 0x55a8154ce090 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f572affd640 10 client.18162 handle_command_reply: tid=0 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 client.18162 shutdown 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 -- 172.21.15.18:0/2880837389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 msgr2=0x55a8154bb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154bb1f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f57400117e0 tx=0x7f5740011be0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 -- 172.21.15.18:0/2880837389 shutdown_connections 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a8154ce090 0x55a8154d0530 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f572affd640 0 client.18162 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154be680 0x55a8154bb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154bb1f0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 --2- 172.21.15.18:0/2880837389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154b34a0 0x55a8154bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 -- 172.21.15.18:0/2880837389 >> 172.21.15.18:0/2880837389 conn(0x55a8154afa30 msgr2=0x55a8154b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:47.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 -- 172.21.15.18:0/2880837389 shutdown_connections 2024-09-19T10:04:47.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 1 -- 172.21.15.18:0/2880837389 wait complete. 2024-09-19T10:04:47.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.092+0000 7f5754206740 20 client.18162 trim_cache size 0 max 16384 2024-09-19T10:04:47.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.110+0000 7f5754206740 1 Processor -- start 2024-09-19T10:04:47.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.110+0000 7f5754206740 1 -- start start 2024-09-19T10:04:47.113 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:46 smithi018 ceph-mon[30956]: pgmap v712: 97 pgs: 97 active+clean; 8.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 86 MiB/s wr, 381 op/s 2024-09-19T10:04:47.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.110+0000 7f5754206740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b34a0 0x55a8154ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.110+0000 7f5754206740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154b6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.110+0000 7f5754206740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 0x55a8154ba1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.110+0000 7f5754206740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1af800 con 0x55a8154b3dc0 2024-09-19T10:04:47.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.110+0000 7f5754206740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1b1340 con 0x55a8154b34a0 2024-09-19T10:04:47.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.110+0000 7f5754206740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1afed0 con 0x55a8154be680 2024-09-19T10:04:47.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154b6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38702/0 (socket says 172.21.15.18:38702) 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574affd640 1 -- 172.21.15.18:0/2566639660 learned_addr learned my addr 172.21.15.18:0/2566639660 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574bfff640 1 --2- 172.21.15.18:0/2566639660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 0x55a8154ba1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574b7fe640 1 --2- 172.21.15.18:0/2566639660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b34a0 0x55a8154ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574affd640 1 -- 172.21.15.18:0/2566639660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 msgr2=0x55a8154ba1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574affd640 1 --2- 172.21.15.18:0/2566639660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 0x55a8154ba1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574affd640 1 -- 172.21.15.18:0/2566639660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b34a0 msgr2=0x55a8154ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574affd640 1 --2- 172.21.15.18:0/2566639660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b34a0 0x55a8154ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574affd640 1 -- 172.21.15.18:0/2566639660 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8154b9740 con 0x55a8154b3dc0 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574b7fe640 1 --2- 172.21.15.18:0/2566639660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b34a0 0x55a8154ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f574affd640 1 --2- 172.21.15.18:0/2566639660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154b6900 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f5740024430 tx=0x7f574000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43cf4248a90aa3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f57317fa640 1 -- 172.21.15.18:0/2566639660 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574002a070 con 0x55a8154b3dc0 2024-09-19T10:04:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f57317fa640 1 -- 172.21.15.18:0/2566639660 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57400248a0 con 0x55a8154b3dc0 2024-09-19T10:04:47.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.111+0000 7f57317fa640 1 -- 172.21.15.18:0/2566639660 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740004280 con 0x55a8154b3dc0 2024-09-19T10:04:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.112+0000 7f5754206740 1 -- 172.21.15.18:0/2566639660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 msgr2=0x55a8154b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.112+0000 7f5754206740 1 --2- 172.21.15.18:0/2566639660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154b6900 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f5740024430 tx=0x7f574000c790 comp rx=0 tx=0).stop 2024-09-19T10:04:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.112+0000 7f5754206740 1 -- 172.21.15.18:0/2566639660 shutdown_connections 2024-09-19T10:04:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.112+0000 7f5754206740 1 --2- 172.21.15.18:0/2566639660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 0x55a8154ba1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.112+0000 7f5754206740 1 --2- 172.21.15.18:0/2566639660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b3dc0 0x55a8154b6900 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.112+0000 7f5754206740 1 --2- 172.21.15.18:0/2566639660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b34a0 0x55a8154ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.112+0000 7f5754206740 1 -- 172.21.15.18:0/2566639660 >> 172.21.15.18:0/2566639660 conn(0x55a8154afa30 msgr2=0x55a8154b9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.112+0000 7f5754206740 1 -- 172.21.15.18:0/2566639660 shutdown_connections 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.112+0000 7f5754206740 1 -- 172.21.15.18:0/2566639660 wait complete. 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.112+0000 7f5754206740 1 -- start start 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f5754206740 1 Processor -- start 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f5754206740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b34a0 0x55a8154c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f5754206740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b3dc0 0x55a8154c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f5754206740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 0x55a8154c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f5754206740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1b0c70 con 0x55a8154b34a0 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f5754206740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1b05a0 con 0x55a8154b3dc0 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f5754206740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1ad7e0 con 0x55a8154be680 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f5754206740 10 client.0 _ll_register_callbacks cb 0x7f574000c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f574b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b34a0 0x55a8154c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f574bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 0x55a8154c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f574bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 0x55a8154c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:44366/0 (socket says 172.21.15.18:44366) 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f574bfff640 1 -- 172.21.15.18:0/494843050 learned_addr learned my addr 172.21.15.18:0/494843050 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f574b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b34a0 0x55a8154c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38708/0 (socket says 172.21.15.18:38708) 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.113+0000 7f574affd640 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b3dc0 0x55a8154c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f574bfff640 1 -- 172.21.15.18:0/494843050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b3dc0 msgr2=0x55a8154c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f574bfff640 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b3dc0 0x55a8154c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f574bfff640 1 -- 172.21.15.18:0/494843050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b34a0 msgr2=0x55a8154c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f574bfff640 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b34a0 0x55a8154c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f574bfff640 1 -- 172.21.15.18:0/494843050 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8154c24e0 con 0x55a8154be680 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f574b7fe640 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b34a0 0x55a8154c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f574bfff640 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 0x55a8154c1cb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5744009df0 tx=0x7f5744050000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ead15f65845a46d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f572affd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T10:04:47.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f572affd640 1 -- 172.21.15.18:0/494843050 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744009540 con 0x55a8154be680 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f572affd640 1 -- 172.21.15.18:0/494843050 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5744009890 con 0x55a8154be680 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f5754206740 1 -- 172.21.15.18:0/494843050 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57400248a0 con 0x55a8154be680 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f572affd640 1 -- 172.21.15.18:0/494843050 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5744004b40 con 0x55a8154be680 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f5754206740 10 client.27667 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f5754206740 1 -- 172.21.15.18:0/494843050 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a8155410e0 con 0x55a8154be680 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.114+0000 7f572affd640 1 -- 172.21.15.18:0/494843050 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57400248a0 con 0x55a8154be680 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f572affd640 1 -- 172.21.15.18:0/494843050 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5744042040 con 0x55a8154be680 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f5754206740 10 client.27667 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f5754206740 10 client.27667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f5754206740 20 client.27667 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f5754206740 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a8154ce090 0x55a815543430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f5754206740 4 client.27667 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f5754206740 1 -- 172.21.15.18:0/494843050 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a815420d60 con 0x55a8154ce090 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f574b7fe640 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a8154ce090 0x55a815543430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f574b7fe640 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a8154ce090 0x55a815543430 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9f3e648ef5aa79f server_cookie=ffc48827007f28c3 in_seq=0 out_seq=0 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f572affd640 10 client.27667 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f572affd640 1 -- 172.21.15.18:0/494843050 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a815420d60 con 0x55a8154ce090 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f572affd640 10 client.27667 handle_command_reply: tid=0 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.115+0000 7f5754206740 1 client.27667 shutdown 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 1 -- 172.21.15.18:0/494843050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 msgr2=0x55a8154c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 0x55a8154c1cb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5744009df0 tx=0x7f5744050000 comp rx=0 tx=0).stop 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 1 -- 172.21.15.18:0/494843050 shutdown_connections 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x55a8154ce090 0x55a815543430 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8154be680 0x55a8154c1cb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8154b3dc0 0x55a8154c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f572affd640 0 client.27667 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:47.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 1 --2- 172.21.15.18:0/494843050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8154b34a0 0x55a8154c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 1 -- 172.21.15.18:0/494843050 >> 172.21.15.18:0/494843050 conn(0x55a8154afa30 msgr2=0x55a8154bca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:47.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 1 -- 172.21.15.18:0/494843050 shutdown_connections 2024-09-19T10:04:47.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 1 -- 172.21.15.18:0/494843050 wait complete. 2024-09-19T10:04:47.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5754206740 20 client.27667 trim_cache size 0 max 16384 2024-09-19T10:04:47.124 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:04:47.125 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-09-19T10:04:47.125 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-09-19T10:04:47.125 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:04:47.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5751e2d640 1 -- 172.21.15.18:0/3806750561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57340a3240 msgr2=0x7f57340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5751e2d640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57340a3240 0x7f57340a5700 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5744049000 tx=0x7f574404a000 comp rx=0 tx=0).stop 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5751e2d640 1 -- 172.21.15.18:0/3806750561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f574c102d90 msgr2=0x7f574c1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.116+0000 7f5751e2d640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f574c102d90 0x7f574c1009f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f573c00b3f0 tx=0x7f573c00b8b0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.117+0000 7f5751e2d640 1 -- 172.21.15.18:0/3806750561 shutdown_connections 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.117+0000 7f5751e2d640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f57340a3240 0x7f57340a5700 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.117+0000 7f5751e2d640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f574c108290 0x7f574c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.117+0000 7f5751e2d640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f574c103740 0x7f574c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.117+0000 7f5751e2d640 1 --2- 172.21.15.18:0/3806750561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f574c102d90 0x7f574c1009f0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.117+0000 7f5751e2d640 1 -- 172.21.15.18:0/3806750561 >> 172.21.15.18:0/3806750561 conn(0x7f574c0fc7d0 msgr2=0x7f574c106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.117+0000 7f5751e2d640 1 -- 172.21.15.18:0/3806750561 shutdown_connections 2024-09-19T10:04:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:47.117+0000 7f5751e2d640 1 -- 172.21.15.18:0/3806750561 wait complete. 2024-09-19T10:04:47.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:46 smithi049 ceph-mon[34858]: pgmap v712: 97 pgs: 97 active+clean; 8.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 86 MiB/s wr, 381 op/s 2024-09-19T10:04:47.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:46 smithi162 ceph-mon[35174]: pgmap v712: 97 pgs: 97 active+clean; 8.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 86 MiB/s wr, 381 op/s 2024-09-19T10:04:47.815 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T10:04:47.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:04:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:48.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.526+0000 7f13d8906640 1 -- 172.21.15.18:0/4198597130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4106f10 msgr2=0x7f13d410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:48.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.526+0000 7f13d8906640 1 --2- 172.21.15.18:0/4198597130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4106f10 0x7f13d410ea90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009ca0 tx=0x7f13cc02a8c0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.526+0000 7f13d8906640 1 -- 172.21.15.18:0/4198597130 shutdown_connections 2024-09-19T10:04:48.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.526+0000 7f13d8906640 1 --2- 172.21.15.18:0/4198597130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4106f10 0x7f13d410ea90 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.526+0000 7f13d8906640 1 --2- 172.21.15.18:0/4198597130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4102790 0x7f13d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.526+0000 7f13d8906640 1 --2- 172.21.15.18:0/4198597130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4101de0 0x7f13d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.526+0000 7f13d8906640 1 -- 172.21.15.18:0/4198597130 >> 172.21.15.18:0/4198597130 conn(0x7f13d40fd8c0 msgr2=0x7f13d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:48.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.526+0000 7f13d8906640 1 -- 172.21.15.18:0/4198597130 shutdown_connections 2024-09-19T10:04:48.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.526+0000 7f13d8906640 1 -- 172.21.15.18:0/4198597130 wait complete. 2024-09-19T10:04:48.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.527+0000 7f13d8906640 1 Processor -- start 2024-09-19T10:04:48.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.527+0000 7f13d8906640 1 -- start start 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.527+0000 7f13d8906640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4101de0 0x7f13d4198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.527+0000 7f13d8906640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4102790 0x7f13d4198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.527+0000 7f13d8906640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4106f10 0x7f13d419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.527+0000 7f13d8906640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f13d4111fc0 con 0x7f13d4106f10 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.527+0000 7f13d8906640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f13d4111e40 con 0x7f13d4102790 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.527+0000 7f13d8906640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13d4112140 con 0x7f13d4101de0 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.527+0000 7f13d2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4106f10 0x7f13d419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.527+0000 7f13d2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4106f10 0x7f13d419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38738/0 (socket says 172.21.15.18:38738) 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d2d9d640 1 -- 172.21.15.18:0/243799407 learned_addr learned my addr 172.21.15.18:0/243799407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d1d9b640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4102790 0x7f13d4198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d259c640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4101de0 0x7f13d4198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d2d9d640 1 -- 172.21.15.18:0/243799407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4101de0 msgr2=0x7f13d4198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:48.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d2d9d640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4101de0 0x7f13d4198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d2d9d640 1 -- 172.21.15.18:0/243799407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4102790 msgr2=0x7f13d4198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:48.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d2d9d640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4102790 0x7f13d4198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d2d9d640 1 -- 172.21.15.18:0/243799407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d419d3b0 con 0x7f13d4106f10 2024-09-19T10:04:48.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d2d9d640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4106f10 0x7f13d419ccd0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f13cc003f10 tx=0x7f13cc003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:48.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13cb7fe640 1 -- 172.21.15.18:0/243799407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc031710 con 0x7f13d4106f10 2024-09-19T10:04:48.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13cb7fe640 1 -- 172.21.15.18:0/243799407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13cc0318b0 con 0x7f13d4106f10 2024-09-19T10:04:48.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d8906640 1 -- 172.21.15.18:0/243799407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d419d640 con 0x7f13d4106f10 2024-09-19T10:04:48.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13cb7fe640 1 -- 172.21.15.18:0/243799407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc02fb50 con 0x7f13d4106f10 2024-09-19T10:04:48.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.528+0000 7f13d8906640 1 -- 172.21.15.18:0/243799407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d41a4f80 con 0x7f13d4106f10 2024-09-19T10:04:48.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.530+0000 7f13d8906640 1 -- 172.21.15.18:0/243799407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d41021c0 con 0x7f13d4106f10 2024-09-19T10:04:48.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.531+0000 7f13cb7fe640 1 -- 172.21.15.18:0/243799407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f13cc02fd30 con 0x7f13d4106f10 2024-09-19T10:04:48.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.531+0000 7f13cb7fe640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13b80a3240 0x7f13b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:48.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.531+0000 7f13d259c640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13b80a3240 0x7f13b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:48.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.531+0000 7f13cb7fe640 1 -- 172.21.15.18:0/243799407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f13cc0f0de0 con 0x7f13d4106f10 2024-09-19T10:04:48.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.532+0000 7f13d259c640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13b80a3240 0x7f13b80a5700 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f13c40058c0 tx=0x7f13c400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:48.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.536+0000 7f13cb7fe640 1 -- 172.21.15.18:0/243799407 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13cc0bdb30 con 0x7f13d4106f10 2024-09-19T10:04:48.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.748+0000 7f13d8906640 1 -- 172.21.15.18:0/243799407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13d410a150 con 0x7f13d4106f10 2024-09-19T10:04:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.749+0000 7f13cb7fe640 1 -- 172.21.15.18:0/243799407 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7f13cc0bd430 con 0x7f13d4106f10 2024-09-19T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:04:48.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 -- 172.21.15.18:0/243799407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13b80a3240 msgr2=0x7f13b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:48.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13b80a3240 0x7f13b80a5700 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f13c40058c0 tx=0x7f13c400a2d0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 -- 172.21.15.18:0/243799407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4106f10 msgr2=0x7f13d419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:48.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4106f10 0x7f13d419ccd0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f13cc003f10 tx=0x7f13cc003f40 comp rx=0 tx=0).stop 2024-09-19T10:04:48.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 -- 172.21.15.18:0/243799407 shutdown_connections 2024-09-19T10:04:48.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f13b80a3240 0x7f13b80a5700 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d4106f10 0x7f13d419ccd0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13d4102790 0x7f13d4198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 --2- 172.21.15.18:0/243799407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13d4101de0 0x7f13d4198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:48.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 -- 172.21.15.18:0/243799407 >> 172.21.15.18:0/243799407 conn(0x7f13d40fd8c0 msgr2=0x7f13d40feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:48.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 -- 172.21.15.18:0/243799407 shutdown_connections 2024-09-19T10:04:48.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:48.751+0000 7f13d8906640 1 -- 172.21.15.18:0/243799407 wait complete. 2024-09-19T10:04:49.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:48 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/243799407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:04:49.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:48 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/243799407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:04:49.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:48 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/243799407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:04:49.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T10:04:49.624 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:50.062 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:49 smithi018 ceph-mon[30956]: pgmap v713: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 75 MiB/s wr, 424 op/s 2024-09-19T10:04:50.121 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:04:50.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.060+0000 7f20c11aa640 1 -- 172.21.15.18:0/2288231421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20bc106f10 msgr2=0x7f20bc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.060+0000 7f20c11aa640 1 --2- 172.21.15.18:0/2288231421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20bc106f10 0x7f20bc10ea90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009ca0 tx=0x7f20b402a8c0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.060+0000 7f20c11aa640 1 -- 172.21.15.18:0/2288231421 shutdown_connections 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.060+0000 7f20c11aa640 1 --2- 172.21.15.18:0/2288231421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20bc106f10 0x7f20bc10ea90 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.060+0000 7f20c11aa640 1 --2- 172.21.15.18:0/2288231421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20bc102790 0x7f20bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.060+0000 7f20c11aa640 1 --2- 172.21.15.18:0/2288231421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20bc101de0 0x7f20bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.060+0000 7f20c11aa640 1 -- 172.21.15.18:0/2288231421 >> 172.21.15.18:0/2288231421 conn(0x7f20bc0fd8c0 msgr2=0x7f20bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.060+0000 7f20c11aa640 1 -- 172.21.15.18:0/2288231421 shutdown_connections 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.060+0000 7f20c11aa640 1 -- 172.21.15.18:0/2288231421 wait complete. 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.061+0000 7f20c11aa640 1 Processor -- start 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.061+0000 7f20c11aa640 1 -- start start 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.061+0000 7f20c11aa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20bc101de0 0x7f20bc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.061+0000 7f20c11aa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20bc102790 0x7f20bc198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.061+0000 7f20c11aa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20bc106f10 0x7f20bc19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20c11aa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc111f70 con 0x7f20bc101de0 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20c11aa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc111df0 con 0x7f20bc106f10 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20c11aa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc1120f0 con 0x7f20bc102790 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20bad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20bc101de0 0x7f20bc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20bad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20bc101de0 0x7f20bc198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38748/0 (socket says 172.21.15.18:38748) 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20bad9d640 1 -- 172.21.15.18:0/1166146362 learned_addr learned my addr 172.21.15.18:0/1166146362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20bb59e640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20bc106f10 0x7f20bc19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20b259c640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20bc102790 0x7f20bc198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20bad9d640 1 -- 172.21.15.18:0/1166146362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20bc102790 msgr2=0x7f20bc198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20bad9d640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20bc102790 0x7f20bc198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20bad9d640 1 -- 172.21.15.18:0/1166146362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20bc106f10 msgr2=0x7f20bc19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20bad9d640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20bc106f10 0x7f20bc19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20bad9d640 1 -- 172.21.15.18:0/1166146362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc19d2f0 con 0x7f20bc101de0 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20bad9d640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20bc101de0 0x7f20bc198340 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00c970 tx=0x7f20ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20b8d99640 1 -- 172.21.15.18:0/1166146362 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac007bb0 con 0x7f20bc101de0 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20c11aa640 1 -- 172.21.15.18:0/1166146362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20bc19d5e0 con 0x7f20bc101de0 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20b8d99640 1 -- 172.21.15.18:0/1166146362 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20ac007d50 con 0x7f20bc101de0 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.062+0000 7f20b8d99640 1 -- 172.21.15.18:0/1166146362 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac00f450 con 0x7f20bc101de0 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.063+0000 7f20c11aa640 1 -- 172.21.15.18:0/1166146362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20bc1a4ec0 con 0x7f20bc101de0 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.065+0000 7f20b8d99640 1 -- 172.21.15.18:0/1166146362 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f20ac005020 con 0x7f20bc101de0 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.065+0000 7f20c3583740 1 Processor -- start 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.065+0000 7f20c3583740 1 -- start start 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20c3583740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20c3583740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fcba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20c3583740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 0x5616a4fd8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20b8d99640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f20a80a3240 0x7f20a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20c3583740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5616a4f312f0 con 0x5616a4fccb40 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20c3583740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5616a4ed8cf0 con 0x5616a4fcb5d0 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20c3583740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5616a4f2d2b0 con 0x5616a4fd6370 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20bb59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20bb59e640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f20a80a3240 0x7f20a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20b259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 0x5616a4fd8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20b259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 0x5616a4fd8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:44394/0 (socket says 172.21.15.18:44394) 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20bb59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38756/0 (socket says 172.21.15.18:38756) 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20b259c640 1 -- 172.21.15.18:0/1825729212 learned_addr learned my addr 172.21.15.18:0/1825729212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20b8d99640 1 -- 172.21.15.18:0/1166146362 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f20ac0cf730 con 0x7f20bc101de0 2024-09-19T10:04:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20bad9d640 1 --2- 172.21.15.18:0/1825729212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fcba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20b259c640 1 -- 172.21.15.18:0/1825729212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 msgr2=0x5616a4fcba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20b259c640 1 --2- 172.21.15.18:0/1825729212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fcba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20b259c640 1 -- 172.21.15.18:0/1825729212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 msgr2=0x5616a4fcb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20b259c640 1 --2- 172.21.15.18:0/1825729212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20b259c640 1 -- 172.21.15.18:0/1825729212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a4ebd3a0 con 0x5616a4fd6370 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.066+0000 7f20bb59e640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f20a80a3240 0x7f20a80a5700 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f20b4005fe0 tx=0x7f20b4005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.067+0000 7f20b259c640 1 --2- 172.21.15.18:0/1825729212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 0x5616a4fd8760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20a400cbb0 tx=0x7f20a400e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b518b94c0000628 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.067+0000 7f20b159a640 1 -- 172.21.15.18:0/1825729212 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4005220 con 0x5616a4fd6370 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.067+0000 7f20b159a640 1 -- 172.21.15.18:0/1825729212 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20a4004c80 con 0x5616a4fd6370 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.067+0000 7f20b159a640 1 -- 172.21.15.18:0/1825729212 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4010760 con 0x5616a4fd6370 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.067+0000 7f20c3583740 1 -- 172.21.15.18:0/1825729212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 msgr2=0x5616a4fd8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.067+0000 7f20c3583740 1 --2- 172.21.15.18:0/1825729212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 0x5616a4fd8760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20a400cbb0 tx=0x7f20a400e720 comp rx=0 tx=0).stop 2024-09-19T10:04:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 -- 172.21.15.18:0/1825729212 shutdown_connections 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 --2- 172.21.15.18:0/1825729212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 0x5616a4fd8760 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 --2- 172.21.15.18:0/1825729212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fcba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 --2- 172.21.15.18:0/1825729212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 -- 172.21.15.18:0/1825729212 >> 172.21.15.18:0/1825729212 conn(0x5616a4f94310 msgr2=0x5616a4fc7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 -- 172.21.15.18:0/1825729212 shutdown_connections 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 -- 172.21.15.18:0/1825729212 wait complete. 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 -- start start 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 Processor -- start 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fd2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 0x5616a4fd3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5616a4fd9070 con 0x5616a4fccb40 2024-09-19T10:04:50.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5616a4eec060 con 0x5616a4fcb5d0 2024-09-19T10:04:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5616a4fd91f0 con 0x5616a4fd6370 2024-09-19T10:04:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20c3583740 10 client.0 _ll_register_callbacks cb 0x5616a4c3f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20b259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fd2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.068+0000 7f20b259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fd2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38768/0 (socket says 172.21.15.18:38768) 2024-09-19T10:04:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20b259c640 1 -- 172.21.15.18:0/4169629242 learned_addr learned my addr 172.21.15.18:0/4169629242 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20bad9d640 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20bb59e640 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 0x5616a4fd3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20b259c640 1 -- 172.21.15.18:0/4169629242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 msgr2=0x5616a4fd3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20b259c640 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 0x5616a4fd3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20b259c640 1 -- 172.21.15.18:0/4169629242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 msgr2=0x5616a4fd5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20b259c640 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20b259c640 1 -- 172.21.15.18:0/4169629242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a4ca23c0 con 0x5616a4fccb40 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20b259c640 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fd2f50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f20a400f010 tx=0x7f20a400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718f842e4421bdac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20a27fc640 1 -- 172.21.15.18:0/4169629242 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a40048d0 con 0x5616a4fccb40 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20a27fc640 1 -- 172.21.15.18:0/4169629242 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f20a4004a70 con 0x5616a4fccb40 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20c3583740 1 -- 172.21.15.18:0/4169629242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20a4004c80 con 0x5616a4fccb40 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20a27fc640 1 -- 172.21.15.18:0/4169629242 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f20a4004040 con 0x5616a4fccb40 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20c3583740 10 client.18186 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.069+0000 7f20c3583740 1 -- 172.21.15.18:0/4169629242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616a4fe4a60 con 0x5616a4fccb40 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20a27fc640 1 -- 172.21.15.18:0/4169629242 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20a4004c80 con 0x5616a4fccb40 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20a27fc640 1 -- 172.21.15.18:0/4169629242 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f20a40104a0 con 0x5616a4fccb40 2024-09-19T10:04:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20c3583740 10 client.18186 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20c3583740 10 client.18186 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20c3583740 20 client.18186 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20c3583740 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5616a4fe5e60 0x5616a4fe8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20c3583740 4 client.18186 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20c3583740 1 -- 172.21.15.18:0/4169629242 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616a4f3e860 con 0x5616a4fe5e60 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20bad9d640 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5616a4fe5e60 0x5616a4fe8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20a27fc640 10 client.18186 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.070+0000 7f20bad9d640 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5616a4fe5e60 0x5616a4fe8250 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d5f824dd549b6c7f server_cookie=dbdbd63d8c30d849 in_seq=0 out_seq=0 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20a27fc640 1 -- 172.21.15.18:0/4169629242 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616a4f3e860 con 0x5616a4fe5e60 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20a27fc640 10 client.18186 handle_command_reply: tid=0 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 client.18186 shutdown 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 -- 172.21.15.18:0/4169629242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 msgr2=0x5616a4fd2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fd2f50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f20a400f010 tx=0x7f20a400c920 comp rx=0 tx=0).stop 2024-09-19T10:04:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 -- 172.21.15.18:0/4169629242 shutdown_connections 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5616a4fe5e60 0x5616a4fe8250 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fd6370 0x5616a4fd3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fd2f50 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20a27fc640 0 client.18186 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 --2- 172.21.15.18:0/4169629242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 -- 172.21.15.18:0/4169629242 >> 172.21.15.18:0/4169629242 conn(0x5616a4f94310 msgr2=0x5616a4fcd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 -- 172.21.15.18:0/4169629242 shutdown_connections 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 1 -- 172.21.15.18:0/4169629242 wait complete. 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.071+0000 7f20c3583740 20 client.18186 trim_cache size 0 max 16384 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.084+0000 7f20c3583740 1 Processor -- start 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.084+0000 7f20c3583740 1 -- start start 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20c3583740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4f94310 0x5616a4fe2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20c3583740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20c3583740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fccb40 0x5616a4fde860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20c3583740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc1ad470 con 0x5616a4fcb5d0 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20c3583740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc1aefb0 con 0x5616a4f94310 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20c3583740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc1adb40 con 0x5616a4fccb40 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20b259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20b259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38782/0 (socket says 172.21.15.18:38782) 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20b259c640 1 -- 172.21.15.18:0/3358592555 learned_addr learned my addr 172.21.15.18:0/3358592555 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20bb59e640 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fccb40 0x5616a4fde860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20bad9d640 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4f94310 0x5616a4fe2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20b259c640 1 -- 172.21.15.18:0/3358592555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fccb40 msgr2=0x5616a4fde860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20b259c640 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fccb40 0x5616a4fde860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20b259c640 1 -- 172.21.15.18:0/3358592555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4f94310 msgr2=0x5616a4fe2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20b259c640 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4f94310 0x5616a4fe2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20b259c640 1 -- 172.21.15.18:0/3358592555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a4fe8810 con 0x5616a4fcb5d0 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20bb59e640 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fccb40 0x5616a4fde860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.085+0000 7f20bad9d640 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4f94310 0x5616a4fe2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20b259c640 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd8330 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f20a4010910 tx=0x7f20a4005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb47a03669cd7ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20b0d99640 1 -- 172.21.15.18:0/3358592555 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4003df0 con 0x5616a4fcb5d0 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20b0d99640 1 -- 172.21.15.18:0/3358592555 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20a4034070 con 0x5616a4fcb5d0 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20b0d99640 1 -- 172.21.15.18:0/3358592555 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4010430 con 0x5616a4fcb5d0 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20c3583740 1 -- 172.21.15.18:0/3358592555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fcb5d0 msgr2=0x5616a4fd8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20c3583740 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd8330 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f20a4010910 tx=0x7f20a4005890 comp rx=0 tx=0).stop 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20c3583740 1 -- 172.21.15.18:0/3358592555 shutdown_connections 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20c3583740 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4fccb40 0x5616a4fde860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20c3583740 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd8330 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20c3583740 1 --2- 172.21.15.18:0/3358592555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4f94310 0x5616a4fe2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.086+0000 7f20c3583740 1 -- 172.21.15.18:0/3358592555 >> 172.21.15.18:0/3358592555 conn(0x5616a4fd35f0 msgr2=0x5616a4fd2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 1 -- 172.21.15.18:0/3358592555 shutdown_connections 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 1 -- 172.21.15.18:0/3358592555 wait complete. 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 1 -- start start 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 1 Processor -- start 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4f94310 0x5616a4fd0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc1ae8e0 con 0x5616a4fccb40 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc1ae210 con 0x5616a4fcb5d0 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc1ab450 con 0x5616a4f94310 2024-09-19T10:04:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20c3583740 10 client.0 _ll_register_callbacks cb 0x7f20a4014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20bb59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20bb59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38784/0 (socket says 172.21.15.18:38784) 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20bb59e640 1 -- 172.21.15.18:0/2285223998 learned_addr learned my addr 172.21.15.18:0/2285223998 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20bad9d640 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4f94310 0x5616a4fd0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.087+0000 7f20b259c640 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20bb59e640 1 -- 172.21.15.18:0/2285223998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4f94310 msgr2=0x5616a4fd0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20bb59e640 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4f94310 0x5616a4fd0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20bb59e640 1 -- 172.21.15.18:0/2285223998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 msgr2=0x5616a4fd09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20bb59e640 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20bb59e640 1 -- 172.21.15.18:0/2285223998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a4fc8960 con 0x5616a4fccb40 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20b259c640 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20bb59e640 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcf1c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009ca0 tx=0x7f20b40093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00e2bdaa48d4508 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20a27fc640 1 -- 172.21.15.18:0/2285223998 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4041070 con 0x5616a4fccb40 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20a27fc640 1 -- 172.21.15.18:0/2285223998 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f20b4003970 con 0x5616a4fccb40 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20c3583740 1 -- 172.21.15.18:0/2285223998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20a4034070 con 0x5616a4fccb40 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20a27fc640 1 -- 172.21.15.18:0/2285223998 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f20b4044040 con 0x5616a4fccb40 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20c3583740 10 client.18192 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.088+0000 7f20c3583740 1 -- 172.21.15.18:0/2285223998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616a50551e0 con 0x5616a4fccb40 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.089+0000 7f20a27fc640 1 -- 172.21.15.18:0/2285223998 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20a4034070 con 0x5616a4fccb40 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.089+0000 7f20a27fc640 1 -- 172.21.15.18:0/2285223998 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f20b40305c0 con 0x5616a4fccb40 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.089+0000 7f20c3583740 10 client.18192 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.089+0000 7f20c3583740 10 client.18192 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.089+0000 7f20c3583740 20 client.18192 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.089+0000 7f20c3583740 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5616a4fd6370 0x5616a50579f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:50.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.089+0000 7f20c3583740 4 client.18192 mds_command: new command op to 14592 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.089+0000 7f20c3583740 1 -- 172.21.15.18:0/2285223998 --> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5616a4f38d70 con 0x5616a4fd6370 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.089+0000 7f20bad9d640 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5616a4fd6370 0x5616a50579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20bad9d640 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5616a4fd6370 0x5616a50579f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4d920d8929265ac4 server_cookie=d0f72a3b62120e89 in_seq=0 out_seq=0 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20a27fc640 10 client.18192 ms_handle_connect on v2:172.21.15.18:6840/1971133018 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20a27fc640 1 -- 172.21.15.18:0/2285223998 <== mds.4 v2:172.21.15.18:6840/1971133018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5616a4f38d70 con 0x5616a4fd6370 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20a27fc640 10 client.18192 handle_command_reply: tid=0 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 client.18192 shutdown 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 -- 172.21.15.18:0/2285223998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 msgr2=0x5616a4fcf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcf1c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009ca0 tx=0x7f20b40093f0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 -- 172.21.15.18:0/2285223998 shutdown_connections 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.18:6840/1971133018,v1:172.21.15.18:6841/1971133018] conn(0x5616a4fd6370 0x5616a50579f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616a4fccb40 0x5616a4fcf1c0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5616a4fcb5d0 0x5616a4fd09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20a27fc640 0 client.18192 ms_handle_reset on v2:172.21.15.18:6840/1971133018 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 --2- 172.21.15.18:0/2285223998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a4f94310 0x5616a4fd0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 -- 172.21.15.18:0/2285223998 >> 172.21.15.18:0/2285223998 conn(0x5616a4fd35f0 msgr2=0x5616a4fd47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 -- 172.21.15.18:0/2285223998 shutdown_connections 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 1 -- 172.21.15.18:0/2285223998 wait complete. 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.090+0000 7f20c3583740 20 client.18192 trim_cache size 0 max 16384 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 -- 172.21.15.18:0/1166146362 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f20a80a3240 msgr2=0x7f20a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f20a80a3240 0x7f20a80a5700 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f20b4005fe0 tx=0x7f20b4005ef0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 -- 172.21.15.18:0/1166146362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20bc101de0 msgr2=0x7f20bc198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20bc101de0 0x7f20bc198340 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00c970 tx=0x7f20ac00ce30 comp rx=0 tx=0).stop 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 -- 172.21.15.18:0/1166146362 shutdown_connections 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f20a80a3240 0x7f20a80a5700 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20bc106f10 0x7f20bc19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20bc102790 0x7f20bc198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 --2- 172.21.15.18:0/1166146362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20bc101de0 0x7f20bc198340 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:50.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 -- 172.21.15.18:0/1166146362 >> 172.21.15.18:0/1166146362 conn(0x7f20bc0fd8c0 msgr2=0x7f20bc0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:50.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 -- 172.21.15.18:0/1166146362 shutdown_connections 2024-09-19T10:04:50.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:50.091+0000 7f20c11aa640 1 -- 172.21.15.18:0/1166146362 wait complete. 2024-09-19T10:04:50.153 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:49 smithi049 ceph-mon[34858]: pgmap v713: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 75 MiB/s wr, 424 op/s 2024-09-19T10:04:50.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:49 smithi162 ceph-mon[35174]: pgmap v713: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 75 MiB/s wr, 424 op/s 2024-09-19T10:04:50.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T10:04:51.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:50 smithi018 ceph-mon[30956]: pgmap v714: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 78 MiB/s wr, 570 op/s 2024-09-19T10:04:51.174 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:51.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:50 smithi049 ceph-mon[34858]: pgmap v714: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 78 MiB/s wr, 570 op/s 2024-09-19T10:04:51.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:50 smithi162 ceph-mon[35174]: pgmap v714: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 78 MiB/s wr, 570 op/s 2024-09-19T10:04:51.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 -- 172.21.15.18:0/4017683446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344102ef0 msgr2=0x7f334410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:51.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 --2- 172.21.15.18:0/4017683446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344102ef0 0x7f334410da40 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f333c009ca0 tx=0x7f333c02a950 comp rx=0 tx=0).stop 2024-09-19T10:04:51.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 -- 172.21.15.18:0/4017683446 shutdown_connections 2024-09-19T10:04:51.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 --2- 172.21.15.18:0/4017683446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344102ef0 0x7f334410da40 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 --2- 172.21.15.18:0/4017683446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3344102570 0x7f33441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 --2- 172.21.15.18:0/4017683446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3344100e20 0x7f3344101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 -- 172.21.15.18:0/4017683446 >> 172.21.15.18:0/4017683446 conn(0x7f33440fc7d0 msgr2=0x7f33440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 -- 172.21.15.18:0/4017683446 shutdown_connections 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 -- 172.21.15.18:0/4017683446 wait complete. 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 Processor -- start 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.620+0000 7f334ad76640 1 -- start start 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f334ad76640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344100e20 0x7f3344198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f334ad76640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3344102570 0x7f33441989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f334ad76640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3344102ef0 0x7f334419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f334ad76640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3344110fa0 con 0x7f3344100e20 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f334ad76640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3344110e20 con 0x7f3344102570 2024-09-19T10:04:51.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f334ad76640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3344111120 con 0x7f3344102ef0 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f3348b12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344100e20 0x7f3344198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f3348b12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344100e20 0x7f3344198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38788/0 (socket says 172.21.15.18:38788) 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f3348b12640 1 -- 172.21.15.18:0/2917145116 learned_addr learned my addr 172.21.15.18:0/2917145116 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f3349313640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3344102ef0 0x7f334419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f3343fff640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3344102570 0x7f33441989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f3348b12640 1 -- 172.21.15.18:0/2917145116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3344102ef0 msgr2=0x7f334419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f3348b12640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3344102ef0 0x7f334419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f3348b12640 1 -- 172.21.15.18:0/2917145116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3344102570 msgr2=0x7f33441989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f3348b12640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3344102570 0x7f33441989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.621+0000 7f3348b12640 1 -- 172.21.15.18:0/2917145116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334419d440 con 0x7f3344100e20 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.622+0000 7f3348b12640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344100e20 0x7f3344198490 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f333800b4a0 tx=0x7f333800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.622+0000 7f3341ffb640 1 -- 172.21.15.18:0/2917145116 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338014070 con 0x7f3344100e20 2024-09-19T10:04:51.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.622+0000 7f3341ffb640 1 -- 172.21.15.18:0/2917145116 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3338010af0 con 0x7f3344100e20 2024-09-19T10:04:51.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.622+0000 7f334ad76640 1 -- 172.21.15.18:0/2917145116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334419d730 con 0x7f3344100e20 2024-09-19T10:04:51.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.622+0000 7f3341ffb640 1 -- 172.21.15.18:0/2917145116 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338017d10 con 0x7f3344100e20 2024-09-19T10:04:51.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.622+0000 7f334ad76640 1 -- 172.21.15.18:0/2917145116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33441a5010 con 0x7f3344100e20 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.624+0000 7f3341ffb640 1 -- 172.21.15.18:0/2917145116 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3338017070 con 0x7f3344100e20 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f334d14f740 1 Processor -- start 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f334d14f740 1 -- start start 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f334d14f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46bb40 0x56459d46a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f334d14f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 0x56459d46aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f334d14f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d479780 0x56459d47bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f334d14f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56459d3d02f0 con 0x56459d46bb40 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f334d14f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56459d377cf0 con 0x56459d46a5d0 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f334d14f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56459d3cc2b0 con 0x56459d479780 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f3349313640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46bb40 0x56459d46a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f3349313640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46bb40 0x56459d46a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38802/0 (socket says 172.21.15.18:38802) 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f3349313640 1 -- 172.21.15.18:0/1943150548 learned_addr learned my addr 172.21.15.18:0/1943150548 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f3341ffb640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33340a32c0 0x7f33340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f3343fff640 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d479780 0x56459d47bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f3349313640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33340a32c0 0x7f33340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f3341ffb640 1 -- 172.21.15.18:0/2917145116 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f33380cebd0 con 0x7f3344100e20 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.625+0000 7f3348b12640 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 0x56459d46aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f3349313640 1 -- 172.21.15.18:0/1943150548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d479780 msgr2=0x56459d47bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f3349313640 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d479780 0x56459d47bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f3349313640 1 -- 172.21.15.18:0/1943150548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 msgr2=0x56459d46aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f3349313640 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 0x56459d46aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f3349313640 1 -- 172.21.15.18:0/1943150548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56459d35c3a0 con 0x56459d46bb40 2024-09-19T10:04:51.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f3348b12640 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 0x56459d46aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:51.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f3343fff640 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d479780 0x56459d47bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:04:51.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f3349313640 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46bb40 0x56459d46a090 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f333c035000 tx=0x7f333c02f550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d760f7dee143a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:51.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f332effd640 1 -- 172.21.15.18:0/1943150548 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c043050 con 0x56459d46bb40 2024-09-19T10:04:51.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f332effd640 1 -- 172.21.15.18:0/1943150548 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c044040 con 0x56459d46bb40 2024-09-19T10:04:51.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.626+0000 7f332effd640 1 -- 172.21.15.18:0/1943150548 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c04d020 con 0x56459d46bb40 2024-09-19T10:04:51.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 -- 172.21.15.18:0/1943150548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46bb40 msgr2=0x56459d46a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:51.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f3349313640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33340a32c0 0x7f33340a5780 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f333c04e000 tx=0x7f333c04c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:51.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46bb40 0x56459d46a090 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f333c035000 tx=0x7f333c02f550 comp rx=0 tx=0).stop 2024-09-19T10:04:51.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 -- 172.21.15.18:0/1943150548 shutdown_connections 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d479780 0x56459d47bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 0x56459d46aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 --2- 172.21.15.18:0/1943150548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46bb40 0x56459d46a090 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 -- 172.21.15.18:0/1943150548 >> 172.21.15.18:0/1943150548 conn(0x56459d433310 msgr2=0x56459d466c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 -- 172.21.15.18:0/1943150548 shutdown_connections 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 -- 172.21.15.18:0/1943150548 wait complete. 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 -- start start 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.627+0000 7f334d14f740 1 Processor -- start 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f334d14f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46a5d0 0x56459d479170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f334d14f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46bb40 0x56459d476420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f334d14f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d479780 0x56459d476a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f334d14f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56459d47c480 con 0x56459d46a5d0 2024-09-19T10:04:51.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f334d14f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56459d38b060 con 0x56459d479780 2024-09-19T10:04:51.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f334d14f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56459d47c600 con 0x56459d46bb40 2024-09-19T10:04:51.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f334d14f740 10 client.0 _ll_register_callbacks cb 0x56459d0de8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:51.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3348b12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46a5d0 0x56459d479170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3348b12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46a5d0 0x56459d479170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38812/0 (socket says 172.21.15.18:38812) 2024-09-19T10:04:51.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3348b12640 1 -- 172.21.15.18:0/1300855677 learned_addr learned my addr 172.21.15.18:0/1300855677 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:51.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3349313640 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d479780 0x56459d476a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3343fff640 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46bb40 0x56459d476420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3348b12640 1 -- 172.21.15.18:0/1300855677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46bb40 msgr2=0x56459d476420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3348b12640 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46bb40 0x56459d476420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3348b12640 1 -- 172.21.15.18:0/1300855677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d479780 msgr2=0x56459d476a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3348b12640 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d479780 0x56459d476a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3348b12640 1 -- 172.21.15.18:0/1300855677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56459d1413c0 con 0x56459d46a5d0 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3349313640 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d479780 0x56459d476a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3348b12640 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46a5d0 0x56459d479170 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f333809af20 tx=0x7f33380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b50e3af6a21d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.628+0000 7f3323fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f3323fff640 1 -- 172.21.15.18:0/1300855677 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333801e070 con 0x56459d46a5d0 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f3323fff640 1 -- 172.21.15.18:0/1300855677 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f33380b4160 con 0x56459d46a5d0 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f334d14f740 1 -- 172.21.15.18:0/1300855677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f333c044040 con 0x56459d46a5d0 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f3323fff640 1 -- 172.21.15.18:0/1300855677 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f33380b9e60 con 0x56459d46a5d0 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f334d14f740 10 client.18204 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f334d14f740 1 -- 172.21.15.18:0/1300855677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56459d487f80 con 0x56459d46a5d0 2024-09-19T10:04:51.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f3323fff640 1 -- 172.21.15.18:0/1300855677 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c044040 con 0x56459d46a5d0 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f3323fff640 1 -- 172.21.15.18:0/1300855677 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f33380a3a00 con 0x56459d46a5d0 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f334d14f740 10 client.18204 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f334d14f740 10 client.18204 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f334d14f740 20 client.18204 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f334d14f740 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56459d489440 0x56459d48b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f334d14f740 4 client.18204 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.629+0000 7f334d14f740 1 -- 172.21.15.18:0/1300855677 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56459d3dd860 con 0x56459d489440 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.630+0000 7f3343fff640 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56459d489440 0x56459d48b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.630+0000 7f3323fff640 10 client.18204 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.630+0000 7f3343fff640 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56459d489440 0x56459d48b850 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9509da3b1f87aa79 server_cookie=6366e4b162c65c5e in_seq=0 out_seq=0 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f3323fff640 1 -- 172.21.15.18:0/1300855677 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56459d3dd860 con 0x56459d489440 2024-09-19T10:04:51.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f3323fff640 10 client.18204 handle_command_reply: tid=0 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 client.18204 shutdown 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 -- 172.21.15.18:0/1300855677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46a5d0 msgr2=0x56459d479170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46a5d0 0x56459d479170 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f333809af20 tx=0x7f33380046c0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 -- 172.21.15.18:0/1300855677 shutdown_connections 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56459d489440 0x56459d48b850 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f3323fff640 0 client.18204 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d479780 0x56459d476a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46bb40 0x56459d476420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 --2- 172.21.15.18:0/1300855677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d46a5d0 0x56459d479170 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 -- 172.21.15.18:0/1300855677 >> 172.21.15.18:0/1300855677 conn(0x56459d433310 msgr2=0x56459d46c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 -- 172.21.15.18:0/1300855677 shutdown_connections 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 1 -- 172.21.15.18:0/1300855677 wait complete. 2024-09-19T10:04:51.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.631+0000 7f334d14f740 20 client.18204 trim_cache size 0 max 16384 2024-09-19T10:04:51.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.644+0000 7f334d14f740 1 Processor -- start 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.644+0000 7f334d14f740 1 -- start start 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.644+0000 7f334d14f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 0x56459d466e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.644+0000 7f334d14f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46bb40 0x56459d485720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.644+0000 7f334d14f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d491120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.644+0000 7f334d14f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33441ab2d0 con 0x56459d479780 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.644+0000 7f334d14f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f33441ace10 con 0x56459d46a5d0 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.644+0000 7f334d14f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33441ab9a0 con 0x56459d46bb40 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.644+0000 7f3349313640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d491120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f3349313640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d491120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38824/0 (socket says 172.21.15.18:38824) 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f3349313640 1 -- 172.21.15.18:0/795317495 learned_addr learned my addr 172.21.15.18:0/795317495 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f3348b12640 1 --2- 172.21.15.18:0/795317495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 0x56459d466e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f3343fff640 1 --2- 172.21.15.18:0/795317495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46bb40 0x56459d485720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f3349313640 1 -- 172.21.15.18:0/795317495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46bb40 msgr2=0x56459d485720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:51.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f3349313640 1 --2- 172.21.15.18:0/795317495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46bb40 0x56459d485720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f3349313640 1 -- 172.21.15.18:0/795317495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 msgr2=0x56459d466e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:51.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f3349313640 1 --2- 172.21.15.18:0/795317495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 0x56459d466e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f3349313640 1 -- 172.21.15.18:0/795317495 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56459d4794e0 con 0x56459d479780 2024-09-19T10:04:51.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f3349313640 1 --2- 172.21.15.18:0/795317495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d491120 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f333c0098b0 tx=0x7f333c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909270ed3a204b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:51.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f332e7fc640 1 -- 172.21.15.18:0/795317495 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c05a070 con 0x56459d479780 2024-09-19T10:04:51.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f332e7fc640 1 -- 172.21.15.18:0/795317495 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c005bd0 con 0x56459d479780 2024-09-19T10:04:51.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.645+0000 7f332e7fc640 1 -- 172.21.15.18:0/795317495 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c04d070 con 0x56459d479780 2024-09-19T10:04:51.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 -- 172.21.15.18:0/795317495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 msgr2=0x56459d491120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:51.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 --2- 172.21.15.18:0/795317495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d491120 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f333c0098b0 tx=0x7f333c0098e0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 -- 172.21.15.18:0/795317495 shutdown_connections 2024-09-19T10:04:51.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 --2- 172.21.15.18:0/795317495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d491120 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 --2- 172.21.15.18:0/795317495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46bb40 0x56459d485720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 --2- 172.21.15.18:0/795317495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46a5d0 0x56459d466e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 -- 172.21.15.18:0/795317495 >> 172.21.15.18:0/795317495 conn(0x56459d433310 msgr2=0x56459d466700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:51.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 -- 172.21.15.18:0/795317495 shutdown_connections 2024-09-19T10:04:51.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 -- 172.21.15.18:0/795317495 wait complete. 2024-09-19T10:04:51.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 -- start start 2024-09-19T10:04:51.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.646+0000 7f334d14f740 1 Processor -- start 2024-09-19T10:04:51.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f334d14f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46a5d0 0x56459d473650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f334d14f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46bb40 0x56459d473b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f334d14f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d4740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f334d14f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33441ac740 con 0x56459d479780 2024-09-19T10:04:51.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f334d14f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f33441ac070 con 0x56459d46bb40 2024-09-19T10:04:51.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f334d14f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33441a92b0 con 0x56459d46a5d0 2024-09-19T10:04:51.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f334d14f740 10 client.0 _ll_register_callbacks cb 0x7f33380092b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:51.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3349313640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d4740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3349313640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d4740d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38830/0 (socket says 172.21.15.18:38830) 2024-09-19T10:04:51.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3349313640 1 -- 172.21.15.18:0/1075392180 learned_addr learned my addr 172.21.15.18:0/1075392180 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:51.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3348b12640 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46a5d0 0x56459d473650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3343fff640 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46bb40 0x56459d473b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3349313640 1 -- 172.21.15.18:0/1075392180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46a5d0 msgr2=0x56459d473650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:51.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3349313640 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46a5d0 0x56459d473650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3349313640 1 -- 172.21.15.18:0/1075392180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46bb40 msgr2=0x56459d473b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:51.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3349313640 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46bb40 0x56459d473b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3349313640 1 -- 172.21.15.18:0/1075392180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56459d4f32f0 con 0x56459d479780 2024-09-19T10:04:51.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3349313640 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d4740d0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f333c005e30 tx=0x7f333c049dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dfcf8bc1e96e52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:51.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.647+0000 7f3323fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:51.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f3323fff640 1 -- 172.21.15.18:0/1075392180 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c063060 con 0x56459d479780 2024-09-19T10:04:51.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f3323fff640 1 -- 172.21.15.18:0/1075392180 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f333c049680 con 0x56459d479780 2024-09-19T10:04:51.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f334d14f740 1 -- 172.21.15.18:0/1075392180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f333c005bd0 con 0x56459d479780 2024-09-19T10:04:51.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f3323fff640 1 -- 172.21.15.18:0/1075392180 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f333c05a030 con 0x56459d479780 2024-09-19T10:04:51.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f334d14f740 10 client.18210 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:51.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f334d14f740 1 -- 172.21.15.18:0/1075392180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56459d4f4590 con 0x56459d479780 2024-09-19T10:04:51.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f3323fff640 1 -- 172.21.15.18:0/1075392180 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c005bd0 con 0x56459d479780 2024-09-19T10:04:51.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f3323fff640 1 -- 172.21.15.18:0/1075392180 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f333c0306b0 con 0x56459d479780 2024-09-19T10:04:51.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f334d14f740 10 client.18210 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:51.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f334d14f740 10 client.18210 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-09-19T10:04:51.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f334d14f740 20 client.18210 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:51.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f334d14f740 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56459d489440 0x56459d4f6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:51.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f334d14f740 4 client.18210 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:04:51.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f334d14f740 1 -- 172.21.15.18:0/1075392180 --> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56459d3d7d70 con 0x56459d489440 2024-09-19T10:04:51.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.648+0000 7f3348b12640 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56459d489440 0x56459d4f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:51.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f3348b12640 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56459d489440 0x56459d4f6820 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2c9e9efa9134d4fa server_cookie=7b4cc500ed023c02 in_seq=0 out_seq=0 2024-09-19T10:04:51.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f3323fff640 10 client.18210 ms_handle_connect on v2:172.21.15.49:6834/4145133674 2024-09-19T10:04:51.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f3323fff640 1 -- 172.21.15.18:0/1075392180 <== mds.3 v2:172.21.15.49:6834/4145133674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56459d3d7d70 con 0x56459d489440 2024-09-19T10:04:51.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f3323fff640 10 client.18210 handle_command_reply: tid=0 2024-09-19T10:04:51.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 client.18210 shutdown 2024-09-19T10:04:51.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 -- 172.21.15.18:0/1075392180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 msgr2=0x56459d4740d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:51.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d4740d0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f333c005e30 tx=0x7f333c049dc0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 -- 172.21.15.18:0/1075392180 shutdown_connections 2024-09-19T10:04:51.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.49:6834/4145133674,v1:172.21.15.49:6835/4145133674] conn(0x56459d489440 0x56459d4f6820 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56459d479780 0x56459d4740d0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f3323fff640 0 client.18210 ms_handle_reset on v2:172.21.15.49:6834/4145133674 2024-09-19T10:04:51.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56459d46bb40 0x56459d473b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 --2- 172.21.15.18:0/1075392180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56459d46a5d0 0x56459d473650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 -- 172.21.15.18:0/1075392180 >> 172.21.15.18:0/1075392180 conn(0x56459d433310 msgr2=0x56459d4654e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:51.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 -- 172.21.15.18:0/1075392180 shutdown_connections 2024-09-19T10:04:51.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 1 -- 172.21.15.18:0/1075392180 wait complete. 2024-09-19T10:04:51.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.649+0000 7f334d14f740 20 client.18210 trim_cache size 0 max 16384 2024-09-19T10:04:51.662 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:04:51.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 -- 172.21.15.18:0/2917145116 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33340a32c0 msgr2=0x7f33340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:51.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33340a32c0 0x7f33340a5780 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f333c04e000 tx=0x7f333c04c000 comp rx=0 tx=0).stop 2024-09-19T10:04:51.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 -- 172.21.15.18:0/2917145116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344100e20 msgr2=0x7f3344198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:51.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344100e20 0x7f3344198490 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f333800b4a0 tx=0x7f333800b960 comp rx=0 tx=0).stop 2024-09-19T10:04:51.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 -- 172.21.15.18:0/2917145116 shutdown_connections 2024-09-19T10:04:51.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f33340a32c0 0x7f33340a5780 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3344102ef0 0x7f334419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3344102570 0x7f33441989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 --2- 172.21.15.18:0/2917145116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344100e20 0x7f3344198490 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:51.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 -- 172.21.15.18:0/2917145116 >> 172.21.15.18:0/2917145116 conn(0x7f33440fc7d0 msgr2=0x7f334406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:51.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 -- 172.21.15.18:0/2917145116 shutdown_connections 2024-09-19T10:04:51.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:51.650+0000 7f334ad76640 1 -- 172.21.15.18:0/2917145116 wait complete. 2024-09-19T10:04:52.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T10:04:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:53.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:52 smithi018 ceph-mon[30956]: pgmap v715: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 67 MiB/s wr, 575 op/s 2024-09-19T10:04:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.127+0000 7f9e01c9f640 1 -- 172.21.15.18:0/258674711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dfc102570 msgr2=0x7f9dfc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.127+0000 7f9e01c9f640 1 --2- 172.21.15.18:0/258674711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dfc102570 0x7f9dfc1029b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009900 tx=0x7f9de402a480 comp rx=0 tx=0).stop 2024-09-19T10:04:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.127+0000 7f9e01c9f640 1 -- 172.21.15.18:0/258674711 shutdown_connections 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.127+0000 7f9e01c9f640 1 --2- 172.21.15.18:0/258674711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.127+0000 7f9e01c9f640 1 --2- 172.21.15.18:0/258674711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dfc102570 0x7f9dfc1029b0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.127+0000 7f9e01c9f640 1 --2- 172.21.15.18:0/258674711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc100e20 0x7f9dfc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.127+0000 7f9e01c9f640 1 -- 172.21.15.18:0/258674711 >> 172.21.15.18:0/258674711 conn(0x7f9dfc0fc7d0 msgr2=0x7f9dfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.127+0000 7f9e01c9f640 1 -- 172.21.15.18:0/258674711 shutdown_connections 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.127+0000 7f9e01c9f640 1 -- 172.21.15.18:0/258674711 wait complete. 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9e01c9f640 1 Processor -- start 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9e01c9f640 1 -- start start 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9e01c9f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dfc100e20 0x7f9dfc19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9e01c9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc102570 0x7f9dfc19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9e01c9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9e01c9f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc110f80 con 0x7f9dfc102ef0 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9e01c9f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc110e00 con 0x7f9dfc102570 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9e01c9f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc111100 con 0x7f9dfc100e20 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9dfbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9dfbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38852/0 (socket says 172.21.15.18:38852) 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.128+0000 7f9dfbfff640 1 -- 172.21.15.18:0/1750693470 learned_addr learned my addr 172.21.15.18:0/1750693470 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dfc100e20 0x7f9dfc19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc102570 0x7f9dfc19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9dfbfff640 1 -- 172.21.15.18:0/1750693470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dfc100e20 msgr2=0x7f9dfc19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9dfbfff640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dfc100e20 0x7f9dfc19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9dfbfff640 1 -- 172.21.15.18:0/1750693470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc102570 msgr2=0x7f9dfc19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9dfbfff640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc102570 0x7f9dfc19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9dfbfff640 1 -- 172.21.15.18:0/1750693470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc19f680 con 0x7f9dfc102ef0 2024-09-19T10:04:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dfc100e20 0x7f9dfc19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc102570 0x7f9dfc19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9dfbfff640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc19efa0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9df400cad0 tx=0x7f9df400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9df8ff9640 1 -- 172.21.15.18:0/1750693470 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df400ae20 con 0x7f9dfc102ef0 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9df8ff9640 1 -- 172.21.15.18:0/1750693470 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9df4005020 con 0x7f9dfc102ef0 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9df8ff9640 1 -- 172.21.15.18:0/1750693470 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df400f6f0 con 0x7f9dfc102ef0 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9e01c9f640 1 -- 172.21.15.18:0/1750693470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc19f970 con 0x7f9dfc102ef0 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.129+0000 7f9e01c9f640 1 -- 172.21.15.18:0/1750693470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc1a7250 con 0x7f9dfc102ef0 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.132+0000 7f9df8ff9640 1 -- 172.21.15.18:0/1750693470 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9df40051d0 con 0x7f9dfc102ef0 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.132+0000 7f9e04078740 1 Processor -- start 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.132+0000 7f9e04078740 1 -- start start 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.132+0000 7f9e04078740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618afb40 0x55e7618ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.132+0000 7f9e04078740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618ae5d0 0x55e7618aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.132+0000 7f9e04078740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618b9370 0x55e7618bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9e04078740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e7618142f0 con 0x55e7618afb40 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9e04078740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e7617bbcf0 con 0x55e7618b9370 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9e04078740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e7618102b0 con 0x55e7618ae5d0 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618afb40 0x55e7618ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618afb40 0x55e7618ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38868/0 (socket says 172.21.15.18:38868) 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618ae5d0 0x55e7618aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfaffd640 1 -- 172.21.15.18:0/1000680844 learned_addr learned my addr 172.21.15.18:0/1000680844 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/1000680844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618b9370 0x55e7618bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/1000680844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618b9370 msgr2=0x55e7618bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/1000680844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618b9370 0x55e7618bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/1000680844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618afb40 msgr2=0x55e7618ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/1000680844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618afb40 0x55e7618ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/1000680844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7617a03a0 con 0x55e7618ae5d0 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/1000680844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618afb40 0x55e7618ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9df8ff9640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9de80a32c0 0x7f9de80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9de80a32c0 0x7f9de80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9df8ff9640 1 -- 172.21.15.18:0/1750693470 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9df40cfc90 con 0x7f9dfc102ef0 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.133+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/1000680844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618ae5d0 0x55e7618aea10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00bca0 tx=0x7f9dec00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dacc1235ac54e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9df1ffb640 1 -- 172.21.15.18:0/1000680844 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec005020 con 0x55e7618ae5d0 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9df1ffb640 1 -- 172.21.15.18:0/1000680844 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dec0047a0 con 0x55e7618ae5d0 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9df1ffb640 1 -- 172.21.15.18:0/1000680844 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec0116d0 con 0x55e7618ae5d0 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9e04078740 1 -- 172.21.15.18:0/1000680844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618ae5d0 msgr2=0x55e7618aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9de80a32c0 0x7f9de80a5780 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55e7618af070 tx=0x7f9de4005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9e04078740 1 --2- 172.21.15.18:0/1000680844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618ae5d0 0x55e7618aea10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00bca0 tx=0x7f9dec00f730 comp rx=0 tx=0).stop 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9e04078740 1 -- 172.21.15.18:0/1000680844 shutdown_connections 2024-09-19T10:04:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9e04078740 1 --2- 172.21.15.18:0/1000680844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618b9370 0x55e7618bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9e04078740 1 --2- 172.21.15.18:0/1000680844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618ae5d0 0x55e7618aea10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9e04078740 1 --2- 172.21.15.18:0/1000680844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618afb40 0x55e7618ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9e04078740 1 -- 172.21.15.18:0/1000680844 >> 172.21.15.18:0/1000680844 conn(0x55e761877310 msgr2=0x55e7618aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9e04078740 1 -- 172.21.15.18:0/1000680844 shutdown_connections 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.134+0000 7f9e04078740 1 -- 172.21.15.18:0/1000680844 wait complete. 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9e04078740 1 -- start start 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9e04078740 1 Processor -- start 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9e04078740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9e04078740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618afb40 0x55e7618b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9e04078740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618b9370 0x55e7618b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9e04078740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e7618bc070 con 0x55e7618ae5d0 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9e04078740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e7617cf060 con 0x55e7618b9370 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9e04078740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e7618bc1f0 con 0x55e7618afb40 2024-09-19T10:04:53.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9e04078740 10 client.0 _ll_register_callbacks cb 0x55e7615228c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9dfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9dfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618b8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38884/0 (socket says 172.21.15.18:38884) 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/549284500 learned_addr learned my addr 172.21.15.18:0/549284500 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9dfbfff640 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618b9370 0x55e7618b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.135+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618afb40 0x55e7618b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/549284500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618afb40 msgr2=0x55e7618b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618afb40 0x55e7618b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/549284500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618b9370 msgr2=0x55e7618b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618b9370 0x55e7618b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/549284500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7615853c0 con 0x55e7618ae5d0 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618b8ce0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9dec006010 tx=0x7f9dec00bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d2c93017e20ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9ddaffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9ddaffd640 1 -- 172.21.15.18:0/549284500 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec004c60 con 0x55e7618ae5d0 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9ddaffd640 1 -- 172.21.15.18:0/549284500 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9dec004020 con 0x55e7618ae5d0 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9e04078740 1 -- 172.21.15.18:0/549284500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dec0047a0 con 0x55e7618ae5d0 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9ddaffd640 1 -- 172.21.15.18:0/549284500 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9dec004220 con 0x55e7618ae5d0 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9e04078740 10 client.18222 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9e04078740 1 -- 172.21.15.18:0/549284500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e7618c7a80 con 0x55e7618ae5d0 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.136+0000 7f9ddaffd640 1 -- 172.21.15.18:0/549284500 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dec0047a0 con 0x55e7618ae5d0 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.137+0000 7f9ddaffd640 1 -- 172.21.15.18:0/549284500 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9dec003850 con 0x55e7618ae5d0 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.137+0000 7f9e04078740 10 client.18222 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.137+0000 7f9e04078740 10 client.18222 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.137+0000 7f9e04078740 20 client.18222 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.137+0000 7f9e04078740 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e7618c8e30 0x55e7618cb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.137+0000 7f9e04078740 4 client.18222 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.137+0000 7f9e04078740 1 -- 172.21.15.18:0/549284500 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e761821860 con 0x55e7618c8e30 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.137+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e7618c8e30 0x55e7618cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e7618c8e30 0x55e7618cb220 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8f7cf1f169eee309 server_cookie=690169a2137822c8 in_seq=0 out_seq=0 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9ddaffd640 10 client.18222 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9ddaffd640 1 -- 172.21.15.18:0/549284500 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e761821860 con 0x55e7618c8e30 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9ddaffd640 10 client.18222 handle_command_reply: tid=0 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9e04078740 1 client.18222 shutdown 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9e04078740 1 -- 172.21.15.18:0/549284500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 msgr2=0x55e7618b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9e04078740 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618b8ce0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9dec006010 tx=0x7f9dec00bfc0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9e04078740 1 -- 172.21.15.18:0/549284500 shutdown_connections 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9e04078740 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e7618c8e30 0x55e7618cb220 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9e04078740 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618b9370 0x55e7618b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9e04078740 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618afb40 0x55e7618b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.138+0000 7f9e04078740 1 --2- 172.21.15.18:0/549284500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618b8ce0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.139+0000 7f9e04078740 1 -- 172.21.15.18:0/549284500 >> 172.21.15.18:0/549284500 conn(0x55e761877310 msgr2=0x55e7618b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:53.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.139+0000 7f9ddaffd640 0 client.18222 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:04:53.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.139+0000 7f9e04078740 1 -- 172.21.15.18:0/549284500 shutdown_connections 2024-09-19T10:04:53.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.139+0000 7f9e04078740 1 -- 172.21.15.18:0/549284500 wait complete. 2024-09-19T10:04:53.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.139+0000 7f9e04078740 20 client.18222 trim_cache size 0 max 16384 2024-09-19T10:04:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9e04078740 1 Processor -- start 2024-09-19T10:04:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9e04078740 1 -- start start 2024-09-19T10:04:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9e04078740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9e04078740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 0x55e7618b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9e04078740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 0x55e7618b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9e04078740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc1af6a0 con 0x55e7618ae5d0 2024-09-19T10:04:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9e04078740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc1b11e0 con 0x55e7618afb40 2024-09-19T10:04:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9e04078740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc1afd70 con 0x55e7618b9370 2024-09-19T10:04:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9dfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9dfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38890/0 (socket says 172.21.15.18:38890) 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/1811686807 learned_addr learned my addr 172.21.15.18:0/1811686807 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9dfbfff640 1 --2- 172.21.15.18:0/1811686807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 0x55e7618b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.152+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/1811686807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 0x55e7618b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.153+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/1811686807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 msgr2=0x55e7618b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.153+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/1811686807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 0x55e7618b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.153+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/1811686807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 msgr2=0x55e7618b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.153+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/1811686807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 0x55e7618b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.153+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/1811686807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7618b7450 con 0x55e7618ae5d0 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.153+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/1811686807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 0x55e7618b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.153+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/1811686807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c5310 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00fc30 tx=0x7f9dec00b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57aa6a3d8bd30d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.153+0000 7f9df17fa640 1 -- 172.21.15.18:0/1811686807 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec037030 con 0x55e7618ae5d0 2024-09-19T10:04:53.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.153+0000 7f9df17fa640 1 -- 172.21.15.18:0/1811686807 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dec011440 con 0x55e7618ae5d0 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.153+0000 7f9df17fa640 1 -- 172.21.15.18:0/1811686807 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec0117d0 con 0x55e7618ae5d0 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 -- 172.21.15.18:0/1811686807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 msgr2=0x55e7618c5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 --2- 172.21.15.18:0/1811686807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c5310 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00fc30 tx=0x7f9dec00b980 comp rx=0 tx=0).stop 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 -- 172.21.15.18:0/1811686807 shutdown_connections 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 --2- 172.21.15.18:0/1811686807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 0x55e7618b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 --2- 172.21.15.18:0/1811686807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 0x55e7618b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 --2- 172.21.15.18:0/1811686807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c5310 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 -- 172.21.15.18:0/1811686807 >> 172.21.15.18:0/1811686807 conn(0x55e761877310 msgr2=0x55e7618b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 -- 172.21.15.18:0/1811686807 shutdown_connections 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 -- 172.21.15.18:0/1811686807 wait complete. 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 -- start start 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.154+0000 7f9e04078740 1 Processor -- start 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9e04078740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9e04078740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 0x55e7618c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9e04078740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 0x55e7618b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9e04078740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc1b0b10 con 0x55e7618ae5d0 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9e04078740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc1b0440 con 0x55e7618afb40 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9e04078740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc1ad680 con 0x55e7618b9370 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9e04078740 10 client.0 _ll_register_callbacks cb 0x7f9dec015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38902/0 (socket says 172.21.15.18:38902) 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/2069471496 learned_addr learned my addr 172.21.15.18:0/2069471496 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfbfff640 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 0x55e7618b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 0x55e7618c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/2069471496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 msgr2=0x55e7618b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 0x55e7618b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/2069471496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 msgr2=0x55e7618c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 0x55e7618c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfb7fe640 1 -- 172.21.15.18:0/2069471496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7618b2b00 con 0x55e7618ae5d0 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfbfff640 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 0x55e7618b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 0x55e7618c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9dfb7fe640 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c1480 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9dec006010 tx=0x7f9dec005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aee1860df4d6ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9ddaffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9ddaffd640 1 -- 172.21.15.18:0/2069471496 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec040060 con 0x55e7618ae5d0 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9e04078740 1 -- 172.21.15.18:0/2069471496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dec011440 con 0x55e7618ae5d0 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.155+0000 7f9ddaffd640 1 -- 172.21.15.18:0/2069471496 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9dec0119c0 con 0x55e7618ae5d0 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9ddaffd640 1 -- 172.21.15.18:0/2069471496 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9dec037070 con 0x55e7618ae5d0 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9e04078740 10 client.18228 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9e04078740 1 -- 172.21.15.18:0/2069471496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e761933000 con 0x55e7618ae5d0 2024-09-19T10:04:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9ddaffd640 1 -- 172.21.15.18:0/2069471496 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dec011440 con 0x55e7618ae5d0 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9ddaffd640 1 -- 172.21.15.18:0/2069471496 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9dec032960 con 0x55e7618ae5d0 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9e04078740 10 client.18228 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9e04078740 10 client.18228 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9e04078740 20 client.18228 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9e04078740 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e761933660 0x55e761935a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9e04078740 4 client.18228 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9e04078740 1 -- 172.21.15.18:0/2069471496 --> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e76181bd70 con 0x55e761933660 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.156+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e761933660 0x55e761935a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9dfaffd640 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e761933660 0x55e761935a80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1608508a1f9e3e24 server_cookie=791c4f79fedc2bbd in_seq=0 out_seq=0 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9ddaffd640 10 client.18228 ms_handle_connect on v2:172.21.15.162:6838/2783930861 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9ddaffd640 1 -- 172.21.15.18:0/2069471496 <== mds.2 v2:172.21.15.162:6838/2783930861 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e76181bd70 con 0x55e761933660 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9ddaffd640 10 client.18228 handle_command_reply: tid=0 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 client.18228 shutdown 2024-09-19T10:04:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 -- 172.21.15.18:0/2069471496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 msgr2=0x55e7618c1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c1480 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9dec006010 tx=0x7f9dec005970 comp rx=0 tx=0).stop 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 -- 172.21.15.18:0/2069471496 shutdown_connections 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.162:6838/2783930861,v1:172.21.15.162:6839/2783930861] conn(0x55e761933660 0x55e761935a80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7618b9370 0x55e7618b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7618afb40 0x55e7618c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 --2- 172.21.15.18:0/2069471496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e7618ae5d0 0x55e7618c1480 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9ddaffd640 0 client.18228 ms_handle_reset on v2:172.21.15.162:6838/2783930861 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 -- 172.21.15.18:0/2069471496 >> 172.21.15.18:0/2069471496 conn(0x55e761877310 msgr2=0x55e7618b4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 -- 172.21.15.18:0/2069471496 shutdown_connections 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 1 -- 172.21.15.18:0/2069471496 wait complete. 2024-09-19T10:04:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.157+0000 7f9e04078740 20 client.18228 trim_cache size 0 max 16384 2024-09-19T10:04:53.167 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:04:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 -- 172.21.15.18:0/1750693470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9de80a32c0 msgr2=0x7f9de80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9de80a32c0 0x7f9de80a5780 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55e7618af070 tx=0x7f9de4005bd0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 -- 172.21.15.18:0/1750693470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dfc102ef0 msgr2=0x7f9dfc19efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc19efa0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9df400cad0 tx=0x7f9df400cf90 comp rx=0 tx=0).stop 2024-09-19T10:04:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 -- 172.21.15.18:0/1750693470 shutdown_connections 2024-09-19T10:04:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f9de80a32c0 0x7f9de80a5780 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc19efa0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dfc102570 0x7f9dfc19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 --2- 172.21.15.18:0/1750693470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dfc100e20 0x7f9dfc19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 -- 172.21.15.18:0/1750693470 >> 172.21.15.18:0/1750693470 conn(0x7f9dfc0fc7d0 msgr2=0x7f9dfc06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 -- 172.21.15.18:0/1750693470 shutdown_connections 2024-09-19T10:04:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:53.158+0000 7f9e01c9f640 1 -- 172.21.15.18:0/1750693470 wait complete. 2024-09-19T10:04:53.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:52 smithi049 ceph-mon[34858]: pgmap v715: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 67 MiB/s wr, 575 op/s 2024-09-19T10:04:53.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:52 smithi162 ceph-mon[35174]: pgmap v715: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 67 MiB/s wr, 575 op/s 2024-09-19T10:04:53.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T10:04:54.087 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.576+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/270837524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d88100e30 msgr2=0x7f2d88104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.576+0000 7f2d8c9a1640 1 --2- 172.21.15.18:0/270837524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d88100e30 0x7f2d88104e80 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009900 tx=0x7f2d7002a410 comp rx=0 tx=0).stop 2024-09-19T10:04:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.576+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/270837524 shutdown_connections 2024-09-19T10:04:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.576+0000 7f2d8c9a1640 1 --2- 172.21.15.18:0/270837524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d881055b0 0x7f2d8810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.576+0000 7f2d8c9a1640 1 --2- 172.21.15.18:0/270837524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d88100e30 0x7f2d88104e80 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.576+0000 7f2d8c9a1640 1 --2- 172.21.15.18:0/270837524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d88100480 0x7f2d88100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.576+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/270837524 >> 172.21.15.18:0/270837524 conn(0x7f2d88077210 msgr2=0x7f2d880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.576+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/270837524 shutdown_connections 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.576+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/270837524 wait complete. 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.577+0000 7f2d8c9a1640 1 Processor -- start 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.577+0000 7f2d8c9a1640 1 -- start start 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d8c9a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d88100480 0x7f2d88197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d8c9a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d88100e30 0x7f2d881978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d8c9a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d881055b0 0x7f2d8819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d8c9a1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88110e90 con 0x7f2d88100e30 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d8c9a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88110d10 con 0x7f2d88100480 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d8c9a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88111010 con 0x7f2d881055b0 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d85d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d88100e30 0x7f2d881978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d85d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d88100e30 0x7f2d881978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38924/0 (socket says 172.21.15.18:38924) 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d85d9b640 1 -- 172.21.15.18:0/2160477080 learned_addr learned my addr 172.21.15.18:0/2160477080 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d86d9d640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d881055b0 0x7f2d8819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d8659c640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d88100480 0x7f2d88197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d85d9b640 1 -- 172.21.15.18:0/2160477080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d881055b0 msgr2=0x7f2d8819bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d881055b0 0x7f2d8819bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d85d9b640 1 -- 172.21.15.18:0/2160477080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d88100480 msgr2=0x7f2d88197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d88100480 0x7f2d88197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d85d9b640 1 -- 172.21.15.18:0/2160477080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8819c340 con 0x7f2d88100e30 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d88100e30 0x7f2d881978d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2d70006010 tx=0x7f2d700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.578+0000 7f2d7f7fe640 1 -- 172.21.15.18:0/2160477080 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7003f030 con 0x7f2d88100e30 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.579+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/2160477080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8819c5d0 con 0x7f2d88100e30 2024-09-19T10:04:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.579+0000 7f2d7f7fe640 1 -- 172.21.15.18:0/2160477080 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d70003ce0 con 0x7f2d88100e30 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.579+0000 7f2d7f7fe640 1 -- 172.21.15.18:0/2160477080 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70035070 con 0x7f2d88100e30 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.579+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/2160477080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d881a3f10 con 0x7f2d88100e30 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.581+0000 7f2d7f7fe640 1 -- 172.21.15.18:0/2160477080 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2d70042030 con 0x7f2d88100e30 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.581+0000 7f2d8ed7a740 1 Processor -- start 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8ed7a740 1 -- start start 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1314c30 0x5620d13132a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d13137e0 0x5620d1313c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d1320970 0x5620d1322d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5620d12772f0 con 0x5620d13137e0 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5620d121ecf0 con 0x5620d1314c30 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5620d12732b0 con 0x5620d1320970 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d13137e0 0x5620d1313c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d13137e0 0x5620d1313c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38938/0 (socket says 172.21.15.18:38938) 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8659c640 1 -- 172.21.15.18:0/2280855279 learned_addr learned my addr 172.21.15.18:0/2280855279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d86d9d640 1 --2- 172.21.15.18:0/2280855279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1314c30 0x5620d13132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/2280855279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d1320970 0x5620d1322d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d7f7fe640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2d740a3240 0x7f2d740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8659c640 1 -- 172.21.15.18:0/2280855279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d1320970 msgr2=0x5620d1322d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8659c640 1 --2- 172.21.15.18:0/2280855279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d1320970 0x5620d1322d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8659c640 1 -- 172.21.15.18:0/2280855279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1314c30 msgr2=0x5620d13132a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8659c640 1 --2- 172.21.15.18:0/2280855279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1314c30 0x5620d13132a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d8659c640 1 -- 172.21.15.18:0/2280855279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d12033a0 con 0x5620d13137e0 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.582+0000 7f2d86d9d640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2d740a3240 0x7f2d740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.583+0000 7f2d7f7fe640 1 -- 172.21.15.18:0/2160477080 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2d700eff50 con 0x7f2d88100e30 2024-09-19T10:04:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.583+0000 7f2d8659c640 1 --2- 172.21.15.18:0/2280855279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d13137e0 0x5620d1313c20 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800ac20 tx=0x7f2d7800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154a3e6125620287 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.583+0000 7f2d7cff9640 1 -- 172.21.15.18:0/2280855279 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7801d070 con 0x5620d13137e0 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.583+0000 7f2d86d9d640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2d740a3240 0x7f2d740a5700 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2d80005fd0 tx=0x7f2d80004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.583+0000 7f2d7cff9640 1 -- 172.21.15.18:0/2280855279 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d78018b20 con 0x5620d13137e0 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.583+0000 7f2d7cff9640 1 -- 172.21.15.18:0/2280855279 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d78010c00 con 0x5620d13137e0 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2280855279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d13137e0 msgr2=0x5620d1313c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/2280855279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d13137e0 0x5620d1313c20 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800ac20 tx=0x7f2d7800f790 comp rx=0 tx=0).stop 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2280855279 shutdown_connections 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/2280855279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d1320970 0x5620d1322d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/2280855279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d13137e0 0x5620d1313c20 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/2280855279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1314c30 0x5620d13132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2280855279 >> 172.21.15.18:0/2280855279 conn(0x5620d12da310 msgr2=0x5620d130fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2280855279 shutdown_connections 2024-09-19T10:04:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2280855279 wait complete. 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 -- start start 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 Processor -- start 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.584+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d13137e0 0x5620d1320300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d131d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 0x5620d131db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5620d1323540 con 0x5620d1314c30 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5620d1232060 con 0x5620d1320970 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5620d13236c0 con 0x5620d13137e0 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d8ed7a740 10 client.0 _ll_register_callbacks cb 0x5620d0f858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d85d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d131d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d85d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d131d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38950/0 (socket says 172.21.15.18:38950) 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d85d9b640 1 -- 172.21.15.18:0/1363561005 learned_addr learned my addr 172.21.15.18:0/1363561005 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d8659c640 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d13137e0 0x5620d1320300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d86d9d640 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 0x5620d131db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d85d9b640 1 -- 172.21.15.18:0/1363561005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d13137e0 msgr2=0x5620d1320300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d13137e0 0x5620d1320300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d85d9b640 1 -- 172.21.15.18:0/1363561005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 msgr2=0x5620d131db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 0x5620d131db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d85d9b640 1 -- 172.21.15.18:0/1363561005 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d0fe83c0 con 0x5620d1314c30 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d86d9d640 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 0x5620d131db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d131d5b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2d700bc640 tx=0x7f2d70032ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1d697617799647 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d6dffb640 1 -- 172.21.15.18:0/1363561005 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70049040 con 0x5620d1314c30 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d6dffb640 1 -- 172.21.15.18:0/1363561005 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2d700b8d20 con 0x5620d1314c30 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.585+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/1363561005 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d78018b20 con 0x5620d1314c30 2024-09-19T10:04:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d6dffb640 1 -- 172.21.15.18:0/1363561005 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2d700bc480 con 0x5620d1314c30 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d8ed7a740 10 client.18240 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/1363561005 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620d132ef70 con 0x5620d1314c30 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d6dffb640 1 -- 172.21.15.18:0/1363561005 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d78018b20 con 0x5620d1314c30 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d6dffb640 1 -- 172.21.15.18:0/1363561005 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2d700c4de0 con 0x5620d1314c30 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d8ed7a740 10 client.18240 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d8ed7a740 10 client.18240 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d8ed7a740 20 client.18240 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5620d1330380 0x5620d1332770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d8ed7a740 4 client.18240 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/1363561005 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620d1284860 con 0x5620d1330380 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.586+0000 7f2d8659c640 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5620d1330380 0x5620d1332770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.587+0000 7f2d6dffb640 10 client.18240 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.587+0000 7f2d8659c640 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5620d1330380 0x5620d1332770 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1224afce04aaf4 server_cookie=6e60746cc376e653 in_seq=0 out_seq=0 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.587+0000 7f2d6dffb640 1 -- 172.21.15.18:0/1363561005 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620d1284860 con 0x5620d1330380 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.587+0000 7f2d6dffb640 10 client.18240 handle_command_reply: tid=0 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.587+0000 7f2d8ed7a740 1 client.18240 shutdown 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/1363561005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 msgr2=0x5620d131d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d131d5b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2d700bc640 tx=0x7f2d70032ae0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/1363561005 shutdown_connections 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5620d1330380 0x5620d1332770 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 0x5620d131db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d131d5b0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d6dffb640 0 client.18240 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/1363561005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d13137e0 0x5620d1320300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/1363561005 >> 172.21.15.18:0/1363561005 conn(0x5620d12da310 msgr2=0x5620d1315bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/1363561005 shutdown_connections 2024-09-19T10:04:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/1363561005 wait complete. 2024-09-19T10:04:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.588+0000 7f2d8ed7a740 20 client.18240 trim_cache size 0 max 16384 2024-09-19T10:04:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.601+0000 7f2d8ed7a740 1 Processor -- start 2024-09-19T10:04:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.601+0000 7f2d8ed7a740 1 -- start start 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d13137e0 0x5620d132c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d130f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 0x5620d130fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881ab2b0 con 0x5620d1314c30 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881acdf0 con 0x5620d1320970 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881ab980 con 0x5620d13137e0 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d85d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d130f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d85d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d130f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38954/0 (socket says 172.21.15.18:38954) 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d85d9b640 1 -- 172.21.15.18:0/3731428306 learned_addr learned my addr 172.21.15.18:0/3731428306 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d8659c640 1 --2- 172.21.15.18:0/3731428306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d13137e0 0x5620d132c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d86d9d640 1 --2- 172.21.15.18:0/3731428306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 0x5620d130fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d85d9b640 1 -- 172.21.15.18:0/3731428306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d13137e0 msgr2=0x5620d132c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/3731428306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d13137e0 0x5620d132c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d85d9b640 1 -- 172.21.15.18:0/3731428306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 msgr2=0x5620d130fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/3731428306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 0x5620d130fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d85d9b640 1 -- 172.21.15.18:0/3731428306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d1310390 con 0x5620d1314c30 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/3731428306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d130f910 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2d7003d040 tx=0x7f2d7002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89824a136b93bcbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.602+0000 7f2d6ffff640 1 -- 172.21.15.18:0/3731428306 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70049070 con 0x5620d1314c30 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d6ffff640 1 -- 172.21.15.18:0/3731428306 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d700dc070 con 0x5620d1314c30 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d6ffff640 1 -- 172.21.15.18:0/3731428306 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d700044e0 con 0x5620d1314c30 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/3731428306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 msgr2=0x5620d130f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/3731428306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d130f910 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2d7003d040 tx=0x7f2d7002a410 comp rx=0 tx=0).stop 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/3731428306 shutdown_connections 2024-09-19T10:04:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/3731428306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d1320970 0x5620d130fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/3731428306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d130f910 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/3731428306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d13137e0 0x5620d132c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/3731428306 >> 172.21.15.18:0/3731428306 conn(0x5620d12da310 msgr2=0x5620d131d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/3731428306 shutdown_connections 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.603+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/3731428306 wait complete. 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d8ed7a740 1 -- start start 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d8ed7a740 1 Processor -- start 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d13137e0 0x5620d1328f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d1337930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d8ed7a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d1320970 0x5620d1337e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881ac720 con 0x5620d1314c30 2024-09-19T10:04:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881ac050 con 0x5620d13137e0 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d8ed7a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881a92b0 con 0x5620d1320970 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d8ed7a740 10 client.0 _ll_register_callbacks cb 0x7f2d70005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d85d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d1337930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d85d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d1337930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38962/0 (socket says 172.21.15.18:38962) 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d85d9b640 1 -- 172.21.15.18:0/2295052728 learned_addr learned my addr 172.21.15.18:0/2295052728 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d8659c640 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d13137e0 0x5620d1328f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d86d9d640 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d1320970 0x5620d1337e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d85d9b640 1 -- 172.21.15.18:0/2295052728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d1320970 msgr2=0x5620d1337e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d1320970 0x5620d1337e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d85d9b640 1 -- 172.21.15.18:0/2295052728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d13137e0 msgr2=0x5620d1328f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d13137e0 0x5620d1328f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.604+0000 7f2d85d9b640 1 -- 172.21.15.18:0/2295052728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d1338600 con 0x5620d1314c30 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d85d9b640 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d1337930 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2d700c0b70 tx=0x7f2d700c5270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f87554f9dc75d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d6dffb640 1 -- 172.21.15.18:0/2295052728 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70049030 con 0x5620d1314c30 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d6dffb640 1 -- 172.21.15.18:0/2295052728 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2d70003800 con 0x5620d1314c30 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2295052728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d700dc070 con 0x5620d1314c30 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d6dffb640 1 -- 172.21.15.18:0/2295052728 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2d7003bcb0 con 0x5620d1314c30 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d8ed7a740 10 client.18246 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2295052728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620d1338600 con 0x5620d1314c30 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d6dffb640 1 -- 172.21.15.18:0/2295052728 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d700dc070 con 0x5620d1314c30 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d6dffb640 1 -- 172.21.15.18:0/2295052728 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2d700ab080 con 0x5620d1314c30 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d8ed7a740 10 client.18246 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d8ed7a740 10 client.18246 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d8ed7a740 20 client.18246 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5620d139b200 0x5620d139d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d8ed7a740 4 client.18246 mds_command: new command op to 24488 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.605+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2295052728 --> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5620d127ed70 con 0x5620d139b200 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.606+0000 7f2d8659c640 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5620d139b200 0x5620d139d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.606+0000 7f2d8659c640 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5620d139b200 0x5620d139d5f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc983d280b5087ea server_cookie=4cbd005b65d24243 in_seq=0 out_seq=0 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.606+0000 7f2d6dffb640 10 client.18246 ms_handle_connect on v2:172.21.15.49:6836/1773266295 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.606+0000 7f2d6dffb640 1 -- 172.21.15.18:0/2295052728 <== mds.1 v2:172.21.15.49:6836/1773266295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5620d127ed70 con 0x5620d139b200 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.606+0000 7f2d6dffb640 10 client.18246 handle_command_reply: tid=0 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.606+0000 7f2d8ed7a740 1 client.18246 shutdown 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2295052728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 msgr2=0x5620d1337930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d1337930 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2d700c0b70 tx=0x7f2d700c5270 comp rx=0 tx=0).stop 2024-09-19T10:04:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2295052728 shutdown_connections 2024-09-19T10:04:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.49:6836/1773266295,v1:172.21.15.49:6837/1773266295] conn(0x5620d139b200 0x5620d139d5f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d6dffb640 0 client.18246 ms_handle_reset on v2:172.21.15.49:6836/1773266295 2024-09-19T10:04:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620d1320970 0x5620d1337e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5620d1314c30 0x5620d1337930 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 1 --2- 172.21.15.18:0/2295052728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620d13137e0 0x5620d1328f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2295052728 >> 172.21.15.18:0/2295052728 conn(0x5620d12da310 msgr2=0x5620d131d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2295052728 shutdown_connections 2024-09-19T10:04:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 1 -- 172.21.15.18:0/2295052728 wait complete. 2024-09-19T10:04:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8ed7a740 20 client.18246 trim_cache size 0 max 16384 2024-09-19T10:04:54.617 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:04:54.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/2160477080 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2d740a3240 msgr2=0x7f2d740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8c9a1640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2d740a3240 0x7f2d740a5700 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2d80005fd0 tx=0x7f2d80004a40 comp rx=0 tx=0).stop 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/2160477080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d88100e30 msgr2=0x7f2d881978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8c9a1640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d88100e30 0x7f2d881978d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2d70006010 tx=0x7f2d700042f0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/2160477080 shutdown_connections 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.607+0000 7f2d8c9a1640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f2d740a3240 0x7f2d740a5700 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.608+0000 7f2d8c9a1640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d881055b0 0x7f2d8819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.608+0000 7f2d8c9a1640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d88100e30 0x7f2d881978d0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.608+0000 7f2d8c9a1640 1 --2- 172.21.15.18:0/2160477080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d88100480 0x7f2d88197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.608+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/2160477080 >> 172.21.15.18:0/2160477080 conn(0x7f2d88077210 msgr2=0x7f2d88103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.608+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/2160477080 shutdown_connections 2024-09-19T10:04:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:54.608+0000 7f2d8c9a1640 1 -- 172.21.15.18:0/2160477080 wait complete. 2024-09-19T10:04:55.308 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:54 smithi018 ceph-mon[30956]: pgmap v716: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 54 MiB/s wr, 522 op/s 2024-09-19T10:04:55.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T10:04:55.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:54 smithi049 ceph-mon[34858]: pgmap v716: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 54 MiB/s wr, 522 op/s 2024-09-19T10:04:55.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:54 smithi162 ceph-mon[35174]: pgmap v716: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 54 MiB/s wr, 522 op/s 2024-09-19T10:04:55.596 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:04:56.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.101+0000 7f28303d9640 1 -- 172.21.15.18:0/1410964656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2828102ef0 msgr2=0x7f282810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:56.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.101+0000 7f28303d9640 1 --2- 172.21.15.18:0/1410964656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2828102ef0 0x7f282810da40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2820009ca0 tx=0x7f282002a950 comp rx=0 tx=0).stop 2024-09-19T10:04:56.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.101+0000 7f28303d9640 1 -- 172.21.15.18:0/1410964656 shutdown_connections 2024-09-19T10:04:56.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.101+0000 7f28303d9640 1 --2- 172.21.15.18:0/1410964656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2828102ef0 0x7f282810da40 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.101+0000 7f28303d9640 1 --2- 172.21.15.18:0/1410964656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2828102570 0x7f28281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.101+0000 7f28303d9640 1 --2- 172.21.15.18:0/1410964656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2828100e20 0x7f2828101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.101+0000 7f28303d9640 1 -- 172.21.15.18:0/1410964656 >> 172.21.15.18:0/1410964656 conn(0x7f28280fc7d0 msgr2=0x7f28280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.101+0000 7f28303d9640 1 -- 172.21.15.18:0/1410964656 shutdown_connections 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.101+0000 7f28303d9640 1 -- 172.21.15.18:0/1410964656 wait complete. 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.101+0000 7f28303d9640 1 Processor -- start 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f28303d9640 1 -- start start 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f28303d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2828100e20 0x7f28281a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f28303d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2828102570 0x7f28281a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f28303d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2828102ef0 0x7f282819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f28303d9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2828111020 con 0x7f2828102570 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f28303d9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2828110ea0 con 0x7f2828100e20 2024-09-19T10:04:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f28303d9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28281111a0 con 0x7f2828102ef0 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282d974640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2828102570 0x7f28281a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282d974640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2828102570 0x7f28281a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38978/0 (socket says 172.21.15.18:38978) 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282d974640 1 -- 172.21.15.18:0/3860740098 learned_addr learned my addr 172.21.15.18:0/3860740098 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282e175640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2828100e20 0x7f28281a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282e976640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2828102ef0 0x7f282819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282d974640 1 -- 172.21.15.18:0/3860740098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2828102ef0 msgr2=0x7f282819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282d974640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2828102ef0 0x7f282819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282d974640 1 -- 172.21.15.18:0/3860740098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2828100e20 msgr2=0x7f28281a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282d974640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2828100e20 0x7f28281a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282d974640 1 -- 172.21.15.18:0/3860740098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282819af00 con 0x7f2828102570 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.102+0000 7f282d974640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2828102570 0x7f28281a0ab0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f281800b4a0 tx=0x7f281800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.103+0000 7f281f7fe640 1 -- 172.21.15.18:0/3860740098 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818015020 con 0x7f2828102570 2024-09-19T10:04:56.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.103+0000 7f281f7fe640 1 -- 172.21.15.18:0/3860740098 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2818011d10 con 0x7f2828102570 2024-09-19T10:04:56.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.103+0000 7f28303d9640 1 -- 172.21.15.18:0/3860740098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282819b1f0 con 0x7f2828102570 2024-09-19T10:04:56.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.103+0000 7f281f7fe640 1 -- 172.21.15.18:0/3860740098 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281800f2e0 con 0x7f2828102570 2024-09-19T10:04:56.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.103+0000 7f28303d9640 1 -- 172.21.15.18:0/3860740098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28281a7390 con 0x7f2828102570 2024-09-19T10:04:56.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.105+0000 7f281f7fe640 1 -- 172.21.15.18:0/3860740098 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2818018020 con 0x7f2828102570 2024-09-19T10:04:56.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.105+0000 7f28327b2740 1 Processor -- start 2024-09-19T10:04:56.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.105+0000 7f28327b2740 1 -- start start 2024-09-19T10:04:56.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f28327b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd05b40 0x559cddd04090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f28327b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd04a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f28327b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd0f370 0x559cddd11760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f28327b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559cddc6a2f0 con 0x559cddd045d0 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f28327b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559cddc11cf0 con 0x559cddd0f370 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f28327b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559cddc662b0 con 0x559cddd05b40 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f281f7fe640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f28140a3240 0x7f28140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282e175640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd04a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282e175640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd04a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38992/0 (socket says 172.21.15.18:38992) 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282e175640 1 -- 172.21.15.18:0/2728065542 learned_addr learned my addr 172.21.15.18:0/2728065542 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282e976640 1 --2- 172.21.15.18:0/2728065542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd05b40 0x559cddd04090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282d974640 1 --2- 172.21.15.18:0/2728065542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd0f370 0x559cddd11760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282e976640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f28140a3240 0x7f28140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282e175640 1 -- 172.21.15.18:0/2728065542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd05b40 msgr2=0x559cddd04090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f281f7fe640 1 -- 172.21.15.18:0/3860740098 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f28180cf1e0 con 0x7f2828102570 2024-09-19T10:04:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282e175640 1 --2- 172.21.15.18:0/2728065542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd05b40 0x559cddd04090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282e175640 1 -- 172.21.15.18:0/2728065542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd0f370 msgr2=0x559cddd11760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282e175640 1 --2- 172.21.15.18:0/2728065542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd0f370 0x559cddd11760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282e175640 1 -- 172.21.15.18:0/2728065542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cddbf63a0 con 0x559cddd045d0 2024-09-19T10:04:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.106+0000 7f282d974640 1 --2- 172.21.15.18:0/2728065542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd0f370 0x559cddd11760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.107+0000 7f282e175640 1 --2- 172.21.15.18:0/2728065542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd04a10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f2824009a70 tx=0x7f2824009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ec23f0d6a7c45d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.107+0000 7f282e976640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f28140a3240 0x7f28140a5700 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2820005fe0 tx=0x7f2820005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.107+0000 7f281cdea640 1 -- 172.21.15.18:0/2728065542 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824017070 con 0x559cddd045d0 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.107+0000 7f281cdea640 1 -- 172.21.15.18:0/2728065542 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2824013470 con 0x559cddd045d0 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.107+0000 7f281cdea640 1 -- 172.21.15.18:0/2728065542 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28240125f0 con 0x559cddd045d0 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 -- 172.21.15.18:0/2728065542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 msgr2=0x559cddd04a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 --2- 172.21.15.18:0/2728065542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd04a10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f2824009a70 tx=0x7f2824009f30 comp rx=0 tx=0).stop 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 -- 172.21.15.18:0/2728065542 shutdown_connections 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 --2- 172.21.15.18:0/2728065542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd0f370 0x559cddd11760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 --2- 172.21.15.18:0/2728065542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd04a10 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 --2- 172.21.15.18:0/2728065542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd05b40 0x559cddd04090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 -- 172.21.15.18:0/2728065542 >> 172.21.15.18:0/2728065542 conn(0x559cddccd310 msgr2=0x559cddd00c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 -- 172.21.15.18:0/2728065542 shutdown_connections 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 -- 172.21.15.18:0/2728065542 wait complete. 2024-09-19T10:04:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 -- start start 2024-09-19T10:04:56.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 Processor -- start 2024-09-19T10:04:56.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd0ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd05b40 0x559cddd0bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd0f370 0x559cddd0c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559cddd12070 con 0x559cddd045d0 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559cddc25060 con 0x559cddd05b40 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559cddd121f0 con 0x559cddd0f370 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.108+0000 7f28327b2740 10 client.0 _ll_register_callbacks cb 0x559cdd9788c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e175640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd0ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e175640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd0ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39006/0 (socket says 172.21.15.18:39006) 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e175640 1 -- 172.21.15.18:0/3361374526 learned_addr learned my addr 172.21.15.18:0/3361374526 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282d974640 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd05b40 0x559cddd0bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e976640 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd0f370 0x559cddd0c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e175640 1 -- 172.21.15.18:0/3361374526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd0f370 msgr2=0x559cddd0c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e175640 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd0f370 0x559cddd0c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e175640 1 -- 172.21.15.18:0/3361374526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd05b40 msgr2=0x559cddd0bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:56.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e175640 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd05b40 0x559cddd0bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e175640 1 -- 172.21.15.18:0/3361374526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cdd9db3c0 con 0x559cddd045d0 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e976640 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd0f370 0x559cddd0c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f282e175640 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd0ecb0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f2824013f40 tx=0x7f28240138d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4f0a9ac146d0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f2811ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f2811ffb640 1 -- 172.21.15.18:0/3361374526 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824017050 con 0x559cddd045d0 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f2811ffb640 1 -- 172.21.15.18:0/3361374526 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f282401c450 con 0x559cddd045d0 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.109+0000 7f28327b2740 1 -- 172.21.15.18:0/3361374526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2824013470 con 0x559cddd045d0 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f2811ffb640 1 -- 172.21.15.18:0/3361374526 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f282402d070 con 0x559cddd045d0 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f28327b2740 10 client.18258 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f28327b2740 1 -- 172.21.15.18:0/3361374526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559cddd1dac0 con 0x559cddd045d0 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f2811ffb640 1 -- 172.21.15.18:0/3361374526 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2824013470 con 0x559cddd045d0 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f2811ffb640 1 -- 172.21.15.18:0/3361374526 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2824026730 con 0x559cddd045d0 2024-09-19T10:04:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f28327b2740 10 client.18258 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f28327b2740 10 client.18258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f28327b2740 20 client.18258 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f28327b2740 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559cddd1eec0 0x559cddd212b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f28327b2740 4 client.18258 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f28327b2740 1 -- 172.21.15.18:0/3361374526 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cddc77860 con 0x559cddd1eec0 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.110+0000 7f282d974640 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559cddd1eec0 0x559cddd212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.111+0000 7f2811ffb640 10 client.18258 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.111+0000 7f282d974640 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559cddd1eec0 0x559cddd212b0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b74c40e201413089 server_cookie=62273e34f42e8599 in_seq=0 out_seq=0 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f2811ffb640 1 -- 172.21.15.18:0/3361374526 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559cddc77860 con 0x559cddd1eec0 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f2811ffb640 10 client.18258 handle_command_reply: tid=0 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 client.18258 shutdown 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 -- 172.21.15.18:0/3361374526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 msgr2=0x559cddd0ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd0ecb0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f2824013f40 tx=0x7f28240138d0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 -- 172.21.15.18:0/3361374526 shutdown_connections 2024-09-19T10:04:56.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559cddd1eec0 0x559cddd212b0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd0f370 0x559cddd0c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd05b40 0x559cddd0bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 --2- 172.21.15.18:0/3361374526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd0ecb0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 -- 172.21.15.18:0/3361374526 >> 172.21.15.18:0/3361374526 conn(0x559cddccd310 msgr2=0x559cddd06930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:56.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f2811ffb640 0 client.18258 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:56.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 -- 172.21.15.18:0/3361374526 shutdown_connections 2024-09-19T10:04:56.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 1 -- 172.21.15.18:0/3361374526 wait complete. 2024-09-19T10:04:56.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.112+0000 7f28327b2740 20 client.18258 trim_cache size 0 max 16384 2024-09-19T10:04:56.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f28327b2740 1 Processor -- start 2024-09-19T10:04:56.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f28327b2740 1 -- start start 2024-09-19T10:04:56.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f28327b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddccd310 0x559cddd1b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f28327b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd03bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f28327b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd05b40 0x559cddd10760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f28327b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28281af810 con 0x559cddd045d0 2024-09-19T10:04:56.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f28327b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f28281b1350 con 0x559cddd05b40 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f28327b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28281afee0 con 0x559cddccd310 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f282d974640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd03bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f282d974640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd03bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39016/0 (socket says 172.21.15.18:39016) 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.125+0000 7f282d974640 1 -- 172.21.15.18:0/4218269536 learned_addr learned my addr 172.21.15.18:0/4218269536 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f282e175640 1 --2- 172.21.15.18:0/4218269536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddccd310 0x559cddd1b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f282e976640 1 --2- 172.21.15.18:0/4218269536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd05b40 0x559cddd10760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f282d974640 1 -- 172.21.15.18:0/4218269536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddccd310 msgr2=0x559cddd1b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f282d974640 1 --2- 172.21.15.18:0/4218269536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddccd310 0x559cddd1b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f282d974640 1 -- 172.21.15.18:0/4218269536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd05b40 msgr2=0x559cddd10760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f282d974640 1 --2- 172.21.15.18:0/4218269536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd05b40 0x559cddd10760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f282d974640 1 -- 172.21.15.18:0/4218269536 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cddd00320 con 0x559cddd045d0 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f282e175640 1 --2- 172.21.15.18:0/4218269536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddccd310 0x559cddd1b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f282d974640 1 --2- 172.21.15.18:0/4218269536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd03bd0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f281800bfd0 tx=0x7f281806e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1db285bef2965d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:56.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f2813fff640 1 -- 172.21.15.18:0/4218269536 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28180ce040 con 0x559cddd045d0 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f2813fff640 1 -- 172.21.15.18:0/4218269536 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2818066670 con 0x559cddd045d0 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.126+0000 7f2813fff640 1 -- 172.21.15.18:0/4218269536 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818010510 con 0x559cddd045d0 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 -- 172.21.15.18:0/4218269536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 msgr2=0x559cddd03bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 --2- 172.21.15.18:0/4218269536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd03bd0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f281800bfd0 tx=0x7f281806e650 comp rx=0 tx=0).stop 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 -- 172.21.15.18:0/4218269536 shutdown_connections 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 --2- 172.21.15.18:0/4218269536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddd05b40 0x559cddd10760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 --2- 172.21.15.18:0/4218269536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd03bd0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 --2- 172.21.15.18:0/4218269536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddccd310 0x559cddd1b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 -- 172.21.15.18:0/4218269536 >> 172.21.15.18:0/4218269536 conn(0x559cddd0c600 msgr2=0x559cddd0b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 -- 172.21.15.18:0/4218269536 shutdown_connections 2024-09-19T10:04:56.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 -- 172.21.15.18:0/4218269536 wait complete. 2024-09-19T10:04:56.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 -- start start 2024-09-19T10:04:56.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 Processor -- start 2024-09-19T10:04:56.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.127+0000 7f28327b2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddccd310 0x559cddd26520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f28327b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd26a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f28327b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd05b40 0x559cddd26fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f28327b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28281b0c80 con 0x559cddd045d0 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f28327b2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f28281b05b0 con 0x559cddccd310 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f28327b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28281ad7f0 con 0x559cddd05b40 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f28327b2740 10 client.0 _ll_register_callbacks cb 0x7f282002ff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282d974640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd26a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282d974640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd26a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39020/0 (socket says 172.21.15.18:39020) 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282d974640 1 -- 172.21.15.18:0/3934946018 learned_addr learned my addr 172.21.15.18:0/3934946018 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282e175640 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddccd310 0x559cddd26520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282e976640 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd05b40 0x559cddd26fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282d974640 1 -- 172.21.15.18:0/3934946018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd05b40 msgr2=0x559cddd26fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282d974640 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd05b40 0x559cddd26fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282d974640 1 -- 172.21.15.18:0/3934946018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddccd310 msgr2=0x559cddd26520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282d974640 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddccd310 0x559cddd26520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282d974640 1 -- 172.21.15.18:0/3934946018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cddd15b30 con 0x559cddd045d0 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f282d974640 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd26a60 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f281800bda0 tx=0x7f28180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5bf08d5eaeaf64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f2811ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f2811ffb640 1 -- 172.21.15.18:0/3934946018 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281806a020 con 0x559cddd045d0 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f2811ffb640 1 -- 172.21.15.18:0/3934946018 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2818097e40 con 0x559cddd045d0 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f28327b2740 1 -- 172.21.15.18:0/3934946018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2818066670 con 0x559cddd045d0 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.128+0000 7f2811ffb640 1 -- 172.21.15.18:0/3934946018 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f28180ce070 con 0x559cddd045d0 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f28327b2740 10 client.18264 fetch_fsmap learned FSMap version 28 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f28327b2740 1 -- 172.21.15.18:0/3934946018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559cddd89bd0 con 0x559cddd045d0 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f2811ffb640 1 -- 172.21.15.18:0/3934946018 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2818066670 con 0x559cddd045d0 2024-09-19T10:04:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f2811ffb640 1 -- 172.21.15.18:0/3934946018 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2818011830 con 0x559cddd045d0 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f28327b2740 10 client.18264 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f28327b2740 10 client.18264 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f28327b2740 20 client.18264 populate_metadata read hostname 'smithi018' 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f28327b2740 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559cddd0f370 0x559cddd8c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f28327b2740 4 client.18264 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f28327b2740 1 -- 172.21.15.18:0/3934946018 --> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559cddc71d70 con 0x559cddd0f370 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.129+0000 7f282e175640 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559cddd0f370 0x559cddd8c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f282e175640 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559cddd0f370 0x559cddd8c390 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55f9e1c538c4b261 server_cookie=348bf7ed5054ec5a in_seq=0 out_seq=0 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f2811ffb640 10 client.18264 ms_handle_connect on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f2811ffb640 1 -- 172.21.15.18:0/3934946018 <== mds.0 v2:172.21.15.49:6838/189898808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559cddc71d70 con 0x559cddd0f370 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f2811ffb640 10 client.18264 handle_command_reply: tid=0 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 client.18264 shutdown 2024-09-19T10:04:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 -- 172.21.15.18:0/3934946018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 msgr2=0x559cddd26a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd26a60 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f281800bda0 tx=0x7f28180046c0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 -- 172.21.15.18:0/3934946018 shutdown_connections 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.49:6838/189898808,v1:172.21.15.49:6839/189898808] conn(0x559cddd0f370 0x559cddd8c390 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559cddd05b40 0x559cddd26fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559cddd045d0 0x559cddd26a60 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 --2- 172.21.15.18:0/3934946018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cddccd310 0x559cddd26520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 -- 172.21.15.18:0/3934946018 >> 172.21.15.18:0/3934946018 conn(0x559cddd0c600 msgr2=0x559cddcff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f2811ffb640 0 client.18264 ms_handle_reset on v2:172.21.15.49:6838/189898808 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 -- 172.21.15.18:0/3934946018 shutdown_connections 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 1 -- 172.21.15.18:0/3934946018 wait complete. 2024-09-19T10:04:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.130+0000 7f28327b2740 20 client.18264 trim_cache size 0 max 16384 2024-09-19T10:04:56.139 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-09-19T10:04:56.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 -- 172.21.15.18:0/3860740098 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f28140a3240 msgr2=0x7f28140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:56.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f28140a3240 0x7f28140a5700 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2820005fe0 tx=0x7f2820005c50 comp rx=0 tx=0).stop 2024-09-19T10:04:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 -- 172.21.15.18:0/3860740098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2828102570 msgr2=0x7f28281a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2828102570 0x7f28281a0ab0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f281800b4a0 tx=0x7f281800b8a0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 -- 172.21.15.18:0/3860740098 shutdown_connections 2024-09-19T10:04:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f28140a3240 0x7f28140a5700 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2828102ef0 0x7f282819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2828102570 0x7f28281a0ab0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 --2- 172.21.15.18:0/3860740098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2828100e20 0x7f28281a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 -- 172.21.15.18:0/3860740098 >> 172.21.15.18:0/3860740098 conn(0x7f28280fc7d0 msgr2=0x7f282806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 -- 172.21.15.18:0/3860740098 shutdown_connections 2024-09-19T10:04:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:56.131+0000 7f28303d9640 1 -- 172.21.15.18:0/3860740098 wait complete. 2024-09-19T10:04:56.949 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T10:04:56.950 INFO:tasks.fwd_scrub:done joining 2024-09-19T10:04:56.951 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T10:04:56.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T10:04:57.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.070+0000 7f4774ffd640 1 -- 172.21.15.18:0/578489587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47701025e0 msgr2=0x7f4770108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.070+0000 7f4774ffd640 1 --2- 172.21.15.18:0/578489587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47701025e0 0x7f4770108e70 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f4768009ca0 tx=0x7f476802a8c0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.070+0000 7f4774ffd640 1 -- 172.21.15.18:0/578489587 shutdown_connections 2024-09-19T10:04:57.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.070+0000 7f4774ffd640 1 --2- 172.21.15.18:0/578489587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47701025e0 0x7f4770108e70 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.070+0000 7f4774ffd640 1 --2- 172.21.15.18:0/578489587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4770101c20 0x7f47701020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.070+0000 7f4774ffd640 1 --2- 172.21.15.18:0/578489587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4770100a30 0x7f4770100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.070+0000 7f4774ffd640 1 -- 172.21.15.18:0/578489587 >> 172.21.15.18:0/578489587 conn(0x7f47700fc1b0 msgr2=0x7f47700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:57.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.070+0000 7f4774ffd640 1 -- 172.21.15.18:0/578489587 shutdown_connections 2024-09-19T10:04:57.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.070+0000 7f4774ffd640 1 -- 172.21.15.18:0/578489587 wait complete. 2024-09-19T10:04:57.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f4774ffd640 1 Processor -- start 2024-09-19T10:04:57.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f4774ffd640 1 -- start start 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f4774ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4770100a30 0x7f4770197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f4774ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4770101c20 0x7f4770198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f4774ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47701025e0 0x7f477019f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f4774ffd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f477010c6b0 con 0x7f47701025e0 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f4774ffd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f477010c530 con 0x7f4770101c20 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f4774ffd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f477010c830 con 0x7f4770100a30 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f476ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47701025e0 0x7f477019f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f476ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47701025e0 0x7f477019f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36838/0 (socket says 172.21.15.18:36838) 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f476ed9d640 1 -- 172.21.15.18:0/511046942 learned_addr learned my addr 172.21.15.18:0/511046942 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f476dd9b640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4770101c20 0x7f4770198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.071+0000 7f476e59c640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4770100a30 0x7f4770197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f476ed9d640 1 -- 172.21.15.18:0/511046942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4770100a30 msgr2=0x7f4770197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f476ed9d640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4770100a30 0x7f4770197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f476ed9d640 1 -- 172.21.15.18:0/511046942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4770101c20 msgr2=0x7f4770198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f476ed9d640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4770101c20 0x7f4770198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f476ed9d640 1 -- 172.21.15.18:0/511046942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477019f9f0 con 0x7f47701025e0 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f476e59c640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4770100a30 0x7f4770197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f476ed9d640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47701025e0 0x7f477019f380 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f4768031ae0 tx=0x7f4768031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f475f7fe640 1 -- 172.21.15.18:0/511046942 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768003c30 con 0x7f47701025e0 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f4774ffd640 1 -- 172.21.15.18:0/511046942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477019fc80 con 0x7f47701025e0 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f475f7fe640 1 -- 172.21.15.18:0/511046942 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4768003dd0 con 0x7f47701025e0 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f475f7fe640 1 -- 172.21.15.18:0/511046942 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476802fcb0 con 0x7f47701025e0 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.072+0000 7f4774ffd640 1 -- 172.21.15.18:0/511046942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47701a01d0 con 0x7f47701025e0 2024-09-19T10:04:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.073+0000 7f4774ffd640 1 -- 172.21.15.18:0/511046942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47701a03a0 con 0x7f47701025e0 2024-09-19T10:04:57.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.074+0000 7f475f7fe640 1 -- 172.21.15.18:0/511046942 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4768004050 con 0x7f47701025e0 2024-09-19T10:04:57.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.075+0000 7f475f7fe640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47580a3250 0x7f47580a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.075+0000 7f476e59c640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47580a3250 0x7f47580a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.075+0000 7f475f7fe640 1 -- 172.21.15.18:0/511046942 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f47680f0c30 con 0x7f47701025e0 2024-09-19T10:04:57.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.075+0000 7f476e59c640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47580a3250 0x7f47580a5710 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4770101a80 tx=0x7f4760005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.079+0000 7f475f7fe640 1 -- 172.21.15.18:0/511046942 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f47680bd980 con 0x7f47701025e0 2024-09-19T10:04:57.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.258+0000 7f4774ffd640 1 -- 172.21.15.18:0/511046942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47701a0730 con 0x7f47701025e0 2024-09-19T10:04:57.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.260+0000 7f475f7fe640 1 -- 172.21.15.18:0/511046942 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22571 (secure 0 0 0) 0x7f47680bd280 con 0x7f47701025e0 2024-09-19T10:04:57.262 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:04:57.262 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:51:31.811334+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T10:04:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 -- 172.21.15.18:0/511046942 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47580a3250 msgr2=0x7f47580a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47580a3250 0x7f47580a5710 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4770101a80 tx=0x7f4760005f90 comp rx=0 tx=0).stop 2024-09-19T10:04:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 -- 172.21.15.18:0/511046942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47701025e0 msgr2=0x7f477019f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47701025e0 0x7f477019f380 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f4768031ae0 tx=0x7f4768031ee0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 -- 172.21.15.18:0/511046942 shutdown_connections 2024-09-19T10:04:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f47580a3250 0x7f47580a5710 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47701025e0 0x7f477019f380 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4770101c20 0x7f4770198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 --2- 172.21.15.18:0/511046942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4770100a30 0x7f4770197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 -- 172.21.15.18:0/511046942 >> 172.21.15.18:0/511046942 conn(0x7f47700fc1b0 msgr2=0x7f477006a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 -- 172.21.15.18:0/511046942 shutdown_connections 2024-09-19T10:04:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.262+0000 7f4774ffd640 1 -- 172.21.15.18:0/511046942 wait complete. 2024-09-19T10:04:57.275 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:56 smithi018 ceph-mon[30956]: pgmap v717: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 38 MiB/s wr, 448 op/s 2024-09-19T10:04:57.276 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:45:52.767383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:50:25.894248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:50:28.299795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T10:04:57.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T10:04:57.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 -- 172.21.15.18:0/1438992741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0808101bf0 msgr2=0x7f0808102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 --2- 172.21.15.18:0/1438992741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0808101bf0 0x7f0808102070 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009900 tx=0x7f07f802a410 comp rx=0 tx=0).stop 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 -- 172.21.15.18:0/1438992741 shutdown_connections 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 --2- 172.21.15.18:0/1438992741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08081025b0 0x7f0808108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 --2- 172.21.15.18:0/1438992741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0808101bf0 0x7f0808102070 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 --2- 172.21.15.18:0/1438992741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0808100a00 0x7f0808100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 -- 172.21.15.18:0/1438992741 >> 172.21.15.18:0/1438992741 conn(0x7f08080fc140 msgr2=0x7f08080fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 -- 172.21.15.18:0/1438992741 shutdown_connections 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 -- 172.21.15.18:0/1438992741 wait complete. 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 Processor -- start 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.381+0000 7f080f7e8640 1 -- start start 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080f7e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0808100a00 0x7f0808197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080f7e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0808101bf0 0x7f08081983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080f7e8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08081025b0 0x7f080819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080f7e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f080810d7d0 con 0x7f0808101bf0 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080f7e8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f080810d650 con 0x7f08081025b0 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080f7e8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f080810d950 con 0x7f0808100a00 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080cd83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0808101bf0 0x7f08081983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080cd83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0808101bf0 0x7f08081983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36852/0 (socket says 172.21.15.18:36852) 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080cd83640 1 -- 172.21.15.18:0/2042391725 learned_addr learned my addr 172.21.15.18:0/2042391725 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080d584640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0808100a00 0x7f0808197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080cd83640 1 -- 172.21.15.18:0/2042391725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0808100a00 msgr2=0x7f0808197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080cd83640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0808100a00 0x7f0808197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080cd83640 1 -- 172.21.15.18:0/2042391725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08081025b0 msgr2=0x7f080819f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080dd85640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08081025b0 0x7f080819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080cd83640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08081025b0 0x7f080819f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080cd83640 1 -- 172.21.15.18:0/2042391725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080819fa90 con 0x7f0808101bf0 2024-09-19T10:04:57.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080d584640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0808100a00 0x7f0808197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:04:57.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080cd83640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0808101bf0 0x7f08081983b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009230 tx=0x7f07f8031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:57.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f07fe7fc640 1 -- 172.21.15.18:0/2042391725 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f803f030 con 0x7f0808101bf0 2024-09-19T10:04:57.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f080f7e8640 1 -- 172.21.15.18:0/2042391725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080819fd20 con 0x7f0808101bf0 2024-09-19T10:04:57.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f07fe7fc640 1 -- 172.21.15.18:0/2042391725 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07f8003ad0 con 0x7f0808101bf0 2024-09-19T10:04:57.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.382+0000 7f07fe7fc640 1 -- 172.21.15.18:0/2042391725 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8035070 con 0x7f0808101bf0 2024-09-19T10:04:57.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.383+0000 7f080f7e8640 1 -- 172.21.15.18:0/2042391725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08081a01b0 con 0x7f0808101bf0 2024-09-19T10:04:57.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.383+0000 7f080f7e8640 1 -- 172.21.15.18:0/2042391725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0808107e40 con 0x7f0808101bf0 2024-09-19T10:04:57.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.385+0000 7f07fe7fc640 1 -- 172.21.15.18:0/2042391725 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f07f8042030 con 0x7f0808101bf0 2024-09-19T10:04:57.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.386+0000 7f07fe7fc640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f07f40a3250 0x7f07f40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.386+0000 7f080d584640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f07f40a3250 0x7f07f40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.386+0000 7f07fe7fc640 1 -- 172.21.15.18:0/2042391725 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f07f80f0380 con 0x7f0808101bf0 2024-09-19T10:04:57.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.386+0000 7f080d584640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f07f40a3250 0x7f07f40a5710 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0808101a50 tx=0x7f0804005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:57.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.389+0000 7f07fe7fc640 1 -- 172.21.15.18:0/2042391725 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07f80bd070 con 0x7f0808101bf0 2024-09-19T10:04:57.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:56 smithi049 ceph-mon[34858]: pgmap v717: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 38 MiB/s wr, 448 op/s 2024-09-19T10:04:57.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:56 smithi162 ceph-mon[35174]: pgmap v717: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 38 MiB/s wr, 448 op/s 2024-09-19T10:04:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.566+0000 7f080f7e8640 1 -- 172.21.15.18:0/2042391725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f080802da50 con 0x7f0808101bf0 2024-09-19T10:04:57.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.566+0000 7f07fe7fc640 1 -- 172.21.15.18:0/2042391725 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f07f80bc970 con 0x7f0808101bf0 2024-09-19T10:04:57.569 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T10:04:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.568+0000 7f080f7e8640 1 -- 172.21.15.18:0/2042391725 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f07f40a3250 msgr2=0x7f07f40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.568+0000 7f080f7e8640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f07f40a3250 0x7f07f40a5710 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0808101a50 tx=0x7f0804005f90 comp rx=0 tx=0).stop 2024-09-19T10:04:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.568+0000 7f080f7e8640 1 -- 172.21.15.18:0/2042391725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0808101bf0 msgr2=0x7f08081983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.568+0000 7f080f7e8640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0808101bf0 0x7f08081983b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009230 tx=0x7f07f8031b60 comp rx=0 tx=0).stop 2024-09-19T10:04:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.568+0000 7f080f7e8640 1 -- 172.21.15.18:0/2042391725 shutdown_connections 2024-09-19T10:04:57.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.568+0000 7f080f7e8640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f07f40a3250 0x7f07f40a5710 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.568+0000 7f080f7e8640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08081025b0 0x7f080819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.568+0000 7f080f7e8640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0808101bf0 0x7f08081983b0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.568+0000 7f080f7e8640 1 --2- 172.21.15.18:0/2042391725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0808100a00 0x7f0808197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.568+0000 7f080f7e8640 1 -- 172.21.15.18:0/2042391725 >> 172.21.15.18:0/2042391725 conn(0x7f08080fc140 msgr2=0x7f0808105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.569+0000 7f080f7e8640 1 -- 172.21.15.18:0/2042391725 shutdown_connections 2024-09-19T10:04:57.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.569+0000 7f080f7e8640 1 -- 172.21.15.18:0/2042391725 wait complete. 2024-09-19T10:04:57.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T10:04:57.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.687+0000 7f29893d8640 1 -- 172.21.15.18:0/4019304087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29841078b0 msgr2=0x7f2984109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.687+0000 7f29893d8640 1 --2- 172.21.15.18:0/4019304087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29841078b0 0x7f2984109ca0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f297c009ca0 tx=0x7f297c02a8c0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.687+0000 7f29893d8640 1 -- 172.21.15.18:0/4019304087 shutdown_connections 2024-09-19T10:04:57.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.687+0000 7f29893d8640 1 --2- 172.21.15.18:0/4019304087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29841078b0 0x7f2984109ca0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.687+0000 7f29893d8640 1 --2- 172.21.15.18:0/4019304087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2984104f80 0x7f2984107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.687+0000 7f29893d8640 1 --2- 172.21.15.18:0/4019304087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2984102650 0x7f2984104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.687+0000 7f29893d8640 1 -- 172.21.15.18:0/4019304087 >> 172.21.15.18:0/4019304087 conn(0x7f29840fc1b0 msgr2=0x7f29840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:57.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.687+0000 7f29893d8640 1 -- 172.21.15.18:0/4019304087 shutdown_connections 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.687+0000 7f29893d8640 1 -- 172.21.15.18:0/4019304087 wait complete. 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.687+0000 7f29893d8640 1 Processor -- start 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29893d8640 1 -- start start 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29893d8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2984102650 0x7f298419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29893d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2984104f80 0x7f298419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29893d8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29841078b0 0x7f29841a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29893d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f298410d840 con 0x7f2984104f80 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29893d8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f298410d6c0 con 0x7f29841078b0 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29893d8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f298410d9c0 con 0x7f2984102650 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29827fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2984104f80 0x7f298419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29827fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2984104f80 0x7f298419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36868/0 (socket says 172.21.15.18:36868) 2024-09-19T10:04:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29827fc640 1 -- 172.21.15.18:0/3511194989 learned_addr learned my addr 172.21.15.18:0/3511194989 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f2982ffd640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2984102650 0x7f298419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29827fc640 1 -- 172.21.15.18:0/3511194989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2984102650 msgr2=0x7f298419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29827fc640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2984102650 0x7f298419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29827fc640 1 -- 172.21.15.18:0/3511194989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29841078b0 msgr2=0x7f29841a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29827fc640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29841078b0 0x7f29841a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29827fc640 1 -- 172.21.15.18:0/3511194989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29841a1d40 con 0x7f2984104f80 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f2982ffd640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2984102650 0x7f298419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.688+0000 7f29827fc640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2984104f80 0x7f298419a660 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f297800e9f0 tx=0x7f297800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.689+0000 7f296bfff640 1 -- 172.21.15.18:0/3511194989 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297800ccc0 con 0x7f2984104f80 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.689+0000 7f296bfff640 1 -- 172.21.15.18:0/3511194989 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2978005500 con 0x7f2984104f80 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.689+0000 7f29893d8640 1 -- 172.21.15.18:0/3511194989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29841a1fd0 con 0x7f2984104f80 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.689+0000 7f296bfff640 1 -- 172.21.15.18:0/3511194989 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978010690 con 0x7f2984104f80 2024-09-19T10:04:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.689+0000 7f29893d8640 1 -- 172.21.15.18:0/3511194989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29841a24f0 con 0x7f2984104f80 2024-09-19T10:04:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.690+0000 7f29893d8640 1 -- 172.21.15.18:0/3511194989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29841093a0 con 0x7f2984104f80 2024-09-19T10:04:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.691+0000 7f296bfff640 1 -- 172.21.15.18:0/3511194989 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f29780046c0 con 0x7f2984104f80 2024-09-19T10:04:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.691+0000 7f296bfff640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f296c0a32d0 0x7f296c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.692+0000 7f2982ffd640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f296c0a32d0 0x7f296c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.692+0000 7f296bfff640 1 -- 172.21.15.18:0/3511194989 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f29780cfd20 con 0x7f2984104f80 2024-09-19T10:04:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.692+0000 7f2982ffd640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f296c0a32d0 0x7f296c0a5790 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2974009b40 tx=0x7f2974005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:57.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.696+0000 7f296bfff640 1 -- 172.21.15.18:0/3511194989 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f297809ca70 con 0x7f2984104f80 2024-09-19T10:04:57.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.869+0000 7f29893d8640 1 -- 172.21.15.18:0/3511194989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2984062e90 con 0x7f2984104f80 2024-09-19T10:04:57.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.870+0000 7f296bfff640 1 -- 172.21.15.18:0/3511194989 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f297809c370 con 0x7f2984104f80 2024-09-19T10:04:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 -- 172.21.15.18:0/3511194989 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f296c0a32d0 msgr2=0x7f296c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f296c0a32d0 0x7f296c0a5790 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2974009b40 tx=0x7f2974005e50 comp rx=0 tx=0).stop 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 -- 172.21.15.18:0/3511194989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2984104f80 msgr2=0x7f298419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2984104f80 0x7f298419a660 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f297800e9f0 tx=0x7f297800eeb0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 -- 172.21.15.18:0/3511194989 shutdown_connections 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f296c0a32d0 0x7f296c0a5790 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29841078b0 0x7f29841a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2984104f80 0x7f298419a660 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 --2- 172.21.15.18:0/3511194989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2984102650 0x7f298419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 -- 172.21.15.18:0/3511194989 >> 172.21.15.18:0/3511194989 conn(0x7f29840fc1b0 msgr2=0x7f2984101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 -- 172.21.15.18:0/3511194989 shutdown_connections 2024-09-19T10:04:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.872+0000 7f29893d8640 1 -- 172.21.15.18:0/3511194989 wait complete. 2024-09-19T10:04:57.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T10:04:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.990+0000 7f806b4ae640 1 -- 172.21.15.18:0/2172522580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80641025b0 msgr2=0x7f80641049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.990+0000 7f806b4ae640 1 --2- 172.21.15.18:0/2172522580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80641025b0 0x7f80641049a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f8060009900 tx=0x7f806002a410 comp rx=0 tx=0).stop 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.990+0000 7f806b4ae640 1 -- 172.21.15.18:0/2172522580 shutdown_connections 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.990+0000 7f806b4ae640 1 --2- 172.21.15.18:0/2172522580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8064107810 0x7f8064109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.990+0000 7f806b4ae640 1 --2- 172.21.15.18:0/2172522580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8064104ee0 0x7f80641072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.990+0000 7f806b4ae640 1 --2- 172.21.15.18:0/2172522580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80641025b0 0x7f80641049a0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.990+0000 7f806b4ae640 1 -- 172.21.15.18:0/2172522580 >> 172.21.15.18:0/2172522580 conn(0x7f80640fc1b0 msgr2=0x7f80640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.990+0000 7f806b4ae640 1 -- 172.21.15.18:0/2172522580 shutdown_connections 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.990+0000 7f806b4ae640 1 -- 172.21.15.18:0/2172522580 wait complete. 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806b4ae640 1 Processor -- start 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806b4ae640 1 -- start start 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806b4ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80641025b0 0x7f8064197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806b4ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8064104ee0 0x7f80641983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806b4ae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8064107810 0x7f806419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806b4ae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f806410d7f0 con 0x7f80641025b0 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806b4ae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f806410d670 con 0x7f8064104ee0 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806b4ae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f806410d970 con 0x7f8064107810 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806924a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80641025b0 0x7f8064197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806924a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80641025b0 0x7f8064197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36890/0 (socket says 172.21.15.18:36890) 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806924a640 1 -- 172.21.15.18:0/3131912364 learned_addr learned my addr 172.21.15.18:0/3131912364 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806924a640 1 -- 172.21.15.18:0/3131912364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8064107810 msgr2=0x7f806419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f8069a4b640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8064107810 0x7f806419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806924a640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8064107810 0x7f806419f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806924a640 1 -- 172.21.15.18:0/3131912364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8064104ee0 msgr2=0x7f80641983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f8068a49640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8064104ee0 0x7f80641983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806924a640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8064104ee0 0x7f80641983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f806924a640 1 -- 172.21.15.18:0/3131912364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806419fad0 con 0x7f80641025b0 2024-09-19T10:04:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.991+0000 7f8069a4b640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8064107810 0x7f806419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:04:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.992+0000 7f806924a640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80641025b0 0x7f8064197eb0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f8060005940 tx=0x7f8060004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.992+0000 7f805a7fc640 1 -- 172.21.15.18:0/3131912364 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806003f030 con 0x7f80641025b0 2024-09-19T10:04:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.992+0000 7f805a7fc640 1 -- 172.21.15.18:0/3131912364 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8060003ce0 con 0x7f80641025b0 2024-09-19T10:04:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.992+0000 7f806b4ae640 1 -- 172.21.15.18:0/3131912364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806419fd60 con 0x7f80641025b0 2024-09-19T10:04:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.992+0000 7f805a7fc640 1 -- 172.21.15.18:0/3131912364 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060035070 con 0x7f80641025b0 2024-09-19T10:04:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.992+0000 7f806b4ae640 1 -- 172.21.15.18:0/3131912364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80641a01d0 con 0x7f80641025b0 2024-09-19T10:04:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.993+0000 7f806b4ae640 1 -- 172.21.15.18:0/3131912364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80640fdca0 con 0x7f80641025b0 2024-09-19T10:04:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.994+0000 7f805a7fc640 1 -- 172.21.15.18:0/3131912364 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8060042030 con 0x7f80641025b0 2024-09-19T10:04:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.995+0000 7f805a7fc640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80500a3250 0x7f80500a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.995+0000 7f8068a49640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80500a3250 0x7f80500a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.995+0000 7f805a7fc640 1 -- 172.21.15.18:0/3131912364 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f80600f0340 con 0x7f80641025b0 2024-09-19T10:04:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.995+0000 7f8068a49640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80500a3250 0x7f80500a5710 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8054005fd0 tx=0x7f8054005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:57.999+0000 7f805a7fc640 1 -- 172.21.15.18:0/3131912364 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80600bd090 con 0x7f80641025b0 2024-09-19T10:04:58.135 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:57 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/511046942' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T10:04:58.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:57 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2042391725' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T10:04:58.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:57 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3511194989' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T10:04:58.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.173+0000 7f806b4ae640 1 -- 172.21.15.18:0/3131912364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8064062e90 con 0x7f80641025b0 2024-09-19T10:04:58.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.174+0000 7f805a7fc640 1 -- 172.21.15.18:0/3131912364 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f80600bc990 con 0x7f80641025b0 2024-09-19T10:04:58.176 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-19T10:04:58.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 -- 172.21.15.18:0/3131912364 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80500a3250 msgr2=0x7f80500a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:58.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80500a3250 0x7f80500a5710 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8054005fd0 tx=0x7f8054005850 comp rx=0 tx=0).stop 2024-09-19T10:04:58.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 -- 172.21.15.18:0/3131912364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80641025b0 msgr2=0x7f8064197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:58.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80641025b0 0x7f8064197eb0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f8060005940 tx=0x7f8060004360 comp rx=0 tx=0).stop 2024-09-19T10:04:58.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 -- 172.21.15.18:0/3131912364 shutdown_connections 2024-09-19T10:04:58.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f80500a3250 0x7f80500a5710 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:58.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8064107810 0x7f806419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:58.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8064104ee0 0x7f80641983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:58.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 --2- 172.21.15.18:0/3131912364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80641025b0 0x7f8064197eb0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:58.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 -- 172.21.15.18:0/3131912364 >> 172.21.15.18:0/3131912364 conn(0x7f80640fc1b0 msgr2=0x7f8064102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:58.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 -- 172.21.15.18:0/3131912364 shutdown_connections 2024-09-19T10:04:58.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.176+0000 7f806b4ae640 1 -- 172.21.15.18:0/3131912364 wait complete. 2024-09-19T10:04:58.189 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.289+0000 7f7211a04640 1 -- 172.21.15.18:0/581610914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f720c107720 msgr2=0x7f720c109b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.289+0000 7f7211a04640 1 --2- 172.21.15.18:0/581610914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f720c107720 0x7f720c109b10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f7204009ca0 tx=0x7f720402a8c0 comp rx=0 tx=0).stop 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.289+0000 7f7211a04640 1 -- 172.21.15.18:0/581610914 shutdown_connections 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.289+0000 7f7211a04640 1 --2- 172.21.15.18:0/581610914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f720c107720 0x7f720c109b10 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.289+0000 7f7211a04640 1 --2- 172.21.15.18:0/581610914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f720c104df0 0x7f720c1071e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.289+0000 7f7211a04640 1 --2- 172.21.15.18:0/581610914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f720c1024c0 0x7f720c1048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.289+0000 7f7211a04640 1 -- 172.21.15.18:0/581610914 >> 172.21.15.18:0/581610914 conn(0x7f720c0fc000 msgr2=0x7f720c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.289+0000 7f7211a04640 1 -- 172.21.15.18:0/581610914 shutdown_connections 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.289+0000 7f7211a04640 1 -- 172.21.15.18:0/581610914 wait complete. 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.290+0000 7f7211a04640 1 Processor -- start 2024-09-19T10:04:58.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.290+0000 7f7211a04640 1 -- start start 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.290+0000 7f7211a04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f720c1024c0 0x7f720c101e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.290+0000 7f7211a04640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f720c104df0 0x7f720c100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.290+0000 7f7211a04640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f720c107720 0x7f720c1009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.290+0000 7f7211a04640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f720c10d610 con 0x7f720c107720 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.290+0000 7f7211a04640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f720c10d490 con 0x7f720c1024c0 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.290+0000 7f7211a04640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f720c10d790 con 0x7f720c104df0 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f720b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f720c107720 0x7f720c1009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f720b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f720c107720 0x7f720c1009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36916/0 (socket says 172.21.15.18:36916) 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f720b7fe640 1 -- 172.21.15.18:0/3765524999 learned_addr learned my addr 172.21.15.18:0/3765524999 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f720affd640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f720c1024c0 0x7f720c101e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f72027fc640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f720c104df0 0x7f720c100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f720b7fe640 1 -- 172.21.15.18:0/3765524999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f720c104df0 msgr2=0x7f720c100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:58.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f720b7fe640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f720c104df0 0x7f720c100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:58.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f720b7fe640 1 -- 172.21.15.18:0/3765524999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f720c1024c0 msgr2=0x7f720c101e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:58.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f720b7fe640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f720c1024c0 0x7f720c101e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:58.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f720b7fe640 1 -- 172.21.15.18:0/3765524999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720c101240 con 0x7f720c107720 2024-09-19T10:04:58.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f720b7fe640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f720c107720 0x7f720c1009b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7204005e30 tx=0x7f7204031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:58.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f7210a02640 1 -- 172.21.15.18:0/3765524999 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204003c30 con 0x7f720c107720 2024-09-19T10:04:58.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f7210a02640 1 -- 172.21.15.18:0/3765524999 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7204003dd0 con 0x7f720c107720 2024-09-19T10:04:58.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f7211a04640 1 -- 172.21.15.18:0/3765524999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720c1a1db0 con 0x7f720c107720 2024-09-19T10:04:58.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f7210a02640 1 -- 172.21.15.18:0/3765524999 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720402fde0 con 0x7f720c107720 2024-09-19T10:04:58.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.291+0000 7f7211a04640 1 -- 172.21.15.18:0/3765524999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f720c1a2270 con 0x7f720c107720 2024-09-19T10:04:58.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.292+0000 7f7211a04640 1 -- 172.21.15.18:0/3765524999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f720c0fdaf0 con 0x7f720c107720 2024-09-19T10:04:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.294+0000 7f7210a02640 1 -- 172.21.15.18:0/3765524999 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7204004050 con 0x7f720c107720 2024-09-19T10:04:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.294+0000 7f7210a02640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f71f80a32d0 0x7f71f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:04:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.295+0000 7f720affd640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f71f80a32d0 0x7f71f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:04:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.295+0000 7f7210a02640 1 -- 172.21.15.18:0/3765524999 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f72040f0e20 con 0x7f720c107720 2024-09-19T10:04:58.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.295+0000 7f720affd640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f71f80a32d0 0x7f71f80a5790 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00bbe0 tx=0x7f71fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:04:58.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.298+0000 7f7210a02640 1 -- 172.21.15.18:0/3765524999 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72040bdb70 con 0x7f720c107720 2024-09-19T10:04:58.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:57 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/511046942' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T10:04:58.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:57 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2042391725' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T10:04:58.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:57 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3511194989' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T10:04:58.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:57 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/511046942' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T10:04:58.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:57 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2042391725' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T10:04:58.414 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:57 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3511194989' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T10:04:58.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.522+0000 7f7211a04640 1 -- 172.21.15.18:0/3765524999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f720c062df0 con 0x7f720c107720 2024-09-19T10:04:58.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.530+0000 7f7210a02640 1 -- 172.21.15.18:0/3765524999 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742337 (secure 0 0 0) 0x7f72040bd470 con 0x7f720c107720 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 18, 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout: "active_gid": 14150, 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout: "active_name": "x", 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addrs": { 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T10:04:58.543 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 817115447 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 817115447 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addr": "172.21.15.18:6801/817115447", 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: "active_change": "2024-09-19T09:43:30.259718+0000", 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: "available": true, 2024-09-19T10:04:58.544 INFO:teuthology.orchestra.run.smithi018.stdout: "standbys": [ 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 24112, 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "z", 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540701547738038271, 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.545 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.546 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.547 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.548 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.549 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.550 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-19T10:04:58.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-19T10:04:58.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-19T10:04:58.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-19T10:04:58.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-19T10:04:58.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-19T10:04:58.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.557 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.560 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.561 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:58.562 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:58.563 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-19T10:04:58.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-19T10:04:58.565 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-19T10:04:58.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-19T10:04:58.567 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.569 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.569 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.569 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.569 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.569 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.569 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.569 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.572 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-19T10:04:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T10:04:58.579 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T10:04:58.580 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-19T10:04:58.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-19T10:04:58.582 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-19T10:04:58.583 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.584 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.585 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.586 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.587 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-19T10:04:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.589 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.590 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.591 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.592 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.593 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.594 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.594 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-19T10:04:58.594 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.594 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.594 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-19T10:04:58.594 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-19T10:04:58.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.594 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.595 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-19T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.597 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.599 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.602 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.603 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.604 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.605 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.606 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.607 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.608 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.609 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.610 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.611 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.612 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.613 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.614 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:58.615 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T10:04:58.616 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:58.617 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.618 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.619 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.620 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.622 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.623 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.624 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.625 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.626 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.627 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.628 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.629 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.630 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.631 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.634 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-19T10:04:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T10:04:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T10:04:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-19T10:04:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T10:04:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T10:04:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T10:04:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T10:04:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T10:04:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-19T10:04:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-19T10:04:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-19T10:04:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-19T10:04:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.752 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-19T10:04:58.753 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.754 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-19T10:04:58.755 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.756 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.757 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-19T10:04:58.757 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.757 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.757 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.757 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-19T10:04:58.757 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-19T10:04:58.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.757 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.765 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-19T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.769 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.769 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.769 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.769 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.769 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.769 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.769 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.769 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.769 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.770 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-19T10:04:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T10:04:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-19T10:04:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-19T10:04:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-19T10:04:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-19T10:04:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-19T10:04:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-19T10:04:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T10:04:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T10:04:58.857 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.858 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.860 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T10:04:58.861 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.862 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.865 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.867 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.870 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.871 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.872 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.874 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.875 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.876 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.877 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.878 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.879 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.881 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.882 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.886 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.887 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.888 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.889 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.890 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.891 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-19T10:04:58.892 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.894 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.896 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.897 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.898 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.903 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.904 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.905 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.907 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-19T10:04:58.908 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.909 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.910 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-19T10:04:58.912 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.913 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-19T10:04:58.914 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.915 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.916 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.917 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.919 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.920 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.921 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.922 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.923 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.924 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.925 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.927 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.928 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.929 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.932 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.934 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.935 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.936 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.937 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.938 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.939 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.940 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.940 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.940 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.940 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.940 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T10:04:58.940 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.940 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.940 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.940 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-19T10:04:58.941 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-19T10:04:58.942 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-19T10:04:58.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.944 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.945 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.946 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.948 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.949 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-19T10:04:58.950 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.951 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.952 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.955 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.956 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.957 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-19T10:04:58.958 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.959 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.962 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.963 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.964 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.965 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.965 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.965 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.965 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.968 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.968 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.968 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.968 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.968 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.968 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.968 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.968 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.969 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-19T10:04:58.970 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.971 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.972 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.973 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.975 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.976 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.978 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.979 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.983 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.984 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.986 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.987 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.988 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.989 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-19T10:04:58.990 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:58.991 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.992 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 24113, 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "y", 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540701547738038271, 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.993 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.994 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.996 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.997 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:58.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-19T10:04:58.999 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.000 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.001 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-19T10:04:59.002 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-19T10:04:59.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.004 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-19T10:04:59.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.006 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.008 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.009 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T10:04:59.010 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-19T10:04:59.011 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.012 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-19T10:04:59.013 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.014 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.015 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.016 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.017 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.019 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T10:04:59.021 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.022 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.023 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-19T10:04:59.025 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-19T10:04:59.026 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.028 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.029 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.030 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.031 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T10:04:59.032 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T10:04:59.033 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-19T10:04:59.034 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.035 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.036 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.037 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.041 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T10:04:59.042 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.049 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-19T10:04:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-19T10:04:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-19T10:04:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-19T10:04:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-19T10:04:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T10:04:59.060 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-19T10:04:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T10:04:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-19T10:04:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.065 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.066 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.069 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.070 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.071 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.072 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T10:04:59.073 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-19T10:04:59.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-19T10:04:59.075 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-19T10:04:59.076 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T10:04:59.077 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T10:04:59.080 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.081 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.083 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.085 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-19T10:04:59.086 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.087 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.088 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.090 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.091 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.092 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-19T10:04:59.093 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.094 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.095 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.098 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.099 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.101 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.102 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.103 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.104 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.105 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.106 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.107 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.108 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T10:04:59.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T10:04:59.110 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.111 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.113 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.114 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.116 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.117 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.119 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.120 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.121 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.122 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.123 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.124 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.125 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.126 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.128 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.129 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.130 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.131 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.132 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.133 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.134 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.135 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.136 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.137 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.138 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-19T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-19T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T10:04:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-19T10:04:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T10:04:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-19T10:04:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T10:04:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T10:04:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-19T10:04:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-19T10:04:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-19T10:04:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T10:04:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-19T10:04:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T10:04:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-19T10:04:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-19T10:04:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-19T10:04:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.245 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.246 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.247 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.248 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.249 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.250 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.252 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-19T10:04:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-19T10:04:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-19T10:04:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-19T10:04:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-19T10:04:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T10:04:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-19T10:04:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-19T10:04:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-19T10:04:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-19T10:04:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-19T10:04:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-19T10:04:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.383 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.384 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.386 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.388 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.389 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-19T10:04:59.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-19T10:04:59.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-19T10:04:59.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-19T10:04:59.393 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-19T10:04:59.394 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.395 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T10:04:59.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.397 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.401 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.402 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.403 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.404 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.405 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.406 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.407 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.408 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.409 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.410 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.411 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.412 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.413 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.415 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.416 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.419 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.420 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.421 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.422 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:59.423 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.424 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.425 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.426 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.427 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.428 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.429 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.430 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.432 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.433 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.434 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.436 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: "modules": [ 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: "dashboard", 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: "iostat", 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: "nfs", 2024-09-19T10:04:59.437 INFO:teuthology.orchestra.run.smithi018.stdout: "restful" 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.438 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.439 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.442 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.443 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.444 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-19T10:04:59.445 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.446 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.447 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.448 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.449 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.450 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.451 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.452 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.453 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T10:04:59.454 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.455 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.456 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T10:04:59.457 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T10:04:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T10:04:59.459 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T10:04:59.460 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.461 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.462 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.463 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.464 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.465 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.466 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.467 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-19T10:04:59.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.469 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.471 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.472 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.473 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.474 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.475 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.476 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.477 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.478 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.479 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.480 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.481 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.482 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.483 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.484 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.485 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.486 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.487 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.488 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-19T10:04:59.489 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.490 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.491 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.492 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.493 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.495 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.496 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-19T10:04:59.498 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-19T10:04:59.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-19T10:04:59.500 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.501 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-19T10:04:59.502 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.503 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.506 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-19T10:04:59.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-19T10:04:59.508 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.510 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.512 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.513 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.514 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.515 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.516 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T10:04:59.517 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T10:04:59.518 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-19T10:04:59.519 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-19T10:04:59.520 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.521 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.522 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T10:04:59.524 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.525 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.526 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.528 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.529 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.530 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.532 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.533 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.535 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.536 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.537 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.538 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.539 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.540 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.541 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.543 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.544 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.545 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T10:04:59.546 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T10:04:59.547 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.548 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.549 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.551 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.553 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.554 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.555 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.556 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.557 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.558 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T10:04:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T10:04:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T10:04:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T10:04:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T10:04:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T10:04:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T10:04:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-19T10:04:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T10:04:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-19T10:04:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T10:04:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T10:04:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-19T10:04:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-19T10:04:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-19T10:04:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-19T10:04:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T10:04:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.668 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.669 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.670 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.672 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.675 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.676 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.677 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.678 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.679 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-19T10:04:59.681 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.682 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.683 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.685 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.686 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.688 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.689 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.690 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.691 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.693 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.694 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.695 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.696 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.697 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.698 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.699 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.700 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.701 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.702 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.703 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-19T10:04:59.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.706 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.708 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.709 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.710 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.711 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.712 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.713 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.714 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.715 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.716 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.717 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.718 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.719 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.720 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.721 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.722 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.723 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.725 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.726 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.727 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.729 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.730 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.731 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.732 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.734 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.735 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.736 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.739 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.740 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-19T10:04:59.741 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T10:04:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-19T10:04:59.743 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T10:04:59.744 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T10:04:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-19T10:04:59.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-19T10:04:59.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.749 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.751 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.752 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.753 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.754 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T10:04:59.756 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-19T10:04:59.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.758 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.759 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.760 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.761 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.764 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.765 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.766 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.767 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.769 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.770 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.771 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.772 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.773 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.774 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.775 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.776 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.777 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.778 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.781 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.782 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.785 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.786 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.787 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.788 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.789 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-19T10:04:59.789 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.789 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.789 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.792 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.792 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.792 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.792 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.792 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-19T10:04:59.792 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-19T10:04:59.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.792 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.793 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-19T10:04:59.794 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.797 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.799 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-19T10:04:59.802 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.803 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.806 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.807 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.808 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.809 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.810 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.811 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.812 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.813 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.816 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.819 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.820 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-19T10:04:59.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:59.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.823 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.826 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.827 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.829 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.830 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.831 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.832 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.833 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.834 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T10:04:59.836 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.837 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.838 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.839 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-19T10:04:59.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-19T10:04:59.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.842 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.843 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.844 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.846 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-19T10:04:59.847 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.848 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.849 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.851 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-19T10:04:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-19T10:04:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-19T10:04:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-19T10:04:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "services": { 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "dashboard": "https://172.21.15.18:8443/" 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "always_on_modules": { 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "octopus": [ 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-19T10:04:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "pacific": [ 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-19T10:04:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "quincy": [ 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-19T10:04:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "reef": [ 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-19T10:04:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "squid": [ 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T10:04:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "last_failure_osd_epoch": 3, 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "active_clients": [ 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3119153448 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "libcephsqlite", 2024-09-19T10:04:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 155217648 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T10:04:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3777931333 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2724140338 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T10:04:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:04:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T10:04:59.886 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:04:59.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:58 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3131912364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T10:04:59.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:58 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3765524999' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T10:04:59.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:04:58 smithi162 ceph-mon[35174]: pgmap v718: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 26 MiB/s wr, 336 op/s 2024-09-19T10:04:59.888 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:58 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3131912364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T10:04:59.888 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:58 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3765524999' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T10:04:59.888 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:04:58 smithi049 ceph-mon[34858]: pgmap v718: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 26 MiB/s wr, 336 op/s 2024-09-19T10:04:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.535+0000 7f7211a04640 1 -- 172.21.15.18:0/3765524999 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f71f80a32d0 msgr2=0x7f71f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.535+0000 7f7211a04640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f71f80a32d0 0x7f71f80a5790 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00bbe0 tx=0x7f71fc00b390 comp rx=0 tx=0).stop 2024-09-19T10:04:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.535+0000 7f7211a04640 1 -- 172.21.15.18:0/3765524999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f720c107720 msgr2=0x7f720c1009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:04:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.535+0000 7f7211a04640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f720c107720 0x7f720c1009b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7204005e30 tx=0x7f7204031ee0 comp rx=0 tx=0).stop 2024-09-19T10:04:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.536+0000 7f7211a04640 1 -- 172.21.15.18:0/3765524999 shutdown_connections 2024-09-19T10:04:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.536+0000 7f7211a04640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f71f80a32d0 0x7f71f80a5790 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.536+0000 7f7211a04640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f720c107720 0x7f720c1009b0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.536+0000 7f7211a04640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f720c104df0 0x7f720c100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.536+0000 7f7211a04640 1 --2- 172.21.15.18:0/3765524999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f720c1024c0 0x7f720c101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:04:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.536+0000 7f7211a04640 1 -- 172.21.15.18:0/3765524999 >> 172.21.15.18:0/3765524999 conn(0x7f720c0fc000 msgr2=0x7f720c102d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:04:59.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.536+0000 7f7211a04640 1 -- 172.21.15.18:0/3765524999 shutdown_connections 2024-09-19T10:04:59.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:04:58.536+0000 7f7211a04640 1 -- 172.21.15.18:0/3765524999 wait complete. 2024-09-19T10:04:59.897 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T10:04:59.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T10:04:59.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:58 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3131912364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T10:04:59.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:58 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3765524999' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T10:04:59.897 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:04:58 smithi018 ceph-mon[30956]: pgmap v718: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 26 MiB/s wr, 336 op/s 2024-09-19T10:05:00.166 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:00.633 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 152, 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 154, 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 57564, 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 82661, 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 14, 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.022384001, 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.004238983, 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.015638530, 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000358260, 2024-09-19T10:05:00.634 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 151, 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.069843540, 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000462540 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 259, 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000116059, 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000448 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 3920, 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 1184 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.635 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 801, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 961, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 644537, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 676694, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 39, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 6, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.235805554, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.078278511, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.176402561, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.006416650, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 962, 2024-09-19T10:05:00.636 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.265009027, 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000275477 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1134, 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000473627, 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000417 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 525776, 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 151968 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 82, 2024-09-19T10:05:00.637 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 261, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 29358, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 454281, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 10, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.029984614, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.016860250, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.010761731, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000248094, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 259, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.183342075, 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000707884 2024-09-19T10:05:00.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 126, 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000070685, 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000560 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 397392 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-09-19T10:05:00.639 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 52, 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.001230957, 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000023672 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2, 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000009049, 2024-09-19T10:05:00.640 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000004524 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 0, 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 0, 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 0, 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 0, 2024-09-19T10:05:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 11, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 0, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 0, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 10, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 0, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 10, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 0, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 10, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 0, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 0, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 0, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 1, 2024-09-19T10:05:00.642 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 20, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 20, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 1000, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 1, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 0, 2024-09-19T10:05:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 4, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 234, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T10:05:00.644 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 0, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 0, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 0, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 0, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 0 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 0, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 0, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 0, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 1, 2024-09-19T10:05:00.645 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_path": 10, 2024-09-19T10:05:00.646 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_inode": 10, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 0, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 0, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "evlrg": 0, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 4, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 0, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 0, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 4, 2024-09-19T10:05:00.647 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 0, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 2, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 0, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 0, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 2, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "segmjr": 2, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 0, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 4194304, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 4195426, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 0, 2024-09-19T10:05:00.648 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3, 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.005474745, 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001824915 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 0 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 13, 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 13, 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 0, 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 11, 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 12, 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 1, 2024-09-19T10:05:00.649 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 10, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 10, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 0, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 0, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 0, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 0, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 50168, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 223520 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 0, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 0, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 0, 2024-09-19T10:05:00.650 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 4, 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 0, 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-09-19T10:05:00.651 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.652 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.653 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-09-19T10:05:00.654 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.655 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.655 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.655 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-09-19T10:05:00.655 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.655 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.656 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.658 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-09-19T10:05:00.659 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.660 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.661 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 0, 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 1, 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 1, 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 0, 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 0, 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 0, 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 73, 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-09-19T10:05:00.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:00.664 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:00.665 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 254375, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 86, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:00.666 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 7400, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 152, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 50872, 2024-09-19T10:05:00.667 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 198, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 38, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 11334, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 33, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 38, 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-09-19T10:05:00.668 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 38, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.252996711, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.006657808 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 38, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 60 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 38, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 0, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 38, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-09-19T10:05:00.669 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 0, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 10, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 0, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 3, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 6, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 0, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 6, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 0, 2024-09-19T10:05:00.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 20, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-09-19T10:05:00.671 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-09-19T10:05:00.672 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 84, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 2, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 9, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 9, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 14, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 0, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 1 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 1, 2024-09-19T10:05:00.673 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "osd-slow-ops": { 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 18 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 0, 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 0, 2024-09-19T10:05:00.674 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 0, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 1031, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 621253, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 1031, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 1031, 2024-09-19T10:05:00.675 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 621253, 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:00.676 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 38, 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 11334, 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 38, 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 11334, 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-09-19T10:05:00.677 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 38, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 38, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 38, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 38, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:00.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-09-19T10:05:00.679 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x559ae7064960": { 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 4, 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1122, 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 4, 2024-09-19T10:05:00.680 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T10:05:00.681 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T10:05:00.681 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3, 2024-09-19T10:05:00.681 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1122, 2024-09-19T10:05:00.681 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:00.681 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:00.681 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:00.681 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:00.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:00.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:00.681 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:05:01.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:00 smithi018 ceph-mon[30956]: pgmap v719: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 18 MiB/s wr, 238 op/s 2024-09-19T10:05:01.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:00 smithi049 ceph-mon[34858]: pgmap v719: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 18 MiB/s wr, 238 op/s 2024-09-19T10:05:01.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:00 smithi162 ceph-mon[35174]: pgmap v719: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 18 MiB/s wr, 238 op/s 2024-09-19T10:05:01.595 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-19T10:05:01.595 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-19T10:05:01.595 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T10:05:01.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T10:05:01.862 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:02.341 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:05:02.341 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:02.341 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-09-19T10:05:02.341 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-09-19T10:05:02.341 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.001413531, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000256191, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.342 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 250, 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 245, 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 490784, 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 149968, 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-19T10:05:02.343 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.084736093, 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.030264379, 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.059359451, 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 245, 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.064243178, 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000262217 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:02.344 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 490784, 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 149968 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 2, 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 185, 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 320, 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 189872, 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-19T10:05:02.345 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.025382564, 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.013858363, 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.001311754, 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 183, 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.027262136, 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000148973 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:02.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 189872 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:02.347 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:02.348 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:02.349 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148962, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:02.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T10:05:02.351 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:02.352 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T10:05:02.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:02.352 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:02.352 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:02.352 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T10:05:02.352 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:02.352 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 248, 2024-09-19T10:05:02.353 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 453028, 2024-09-19T10:05:02.353 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:02.353 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 248, 2024-09-19T10:05:02.353 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T10:05:02.353 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T10:05:02.353 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 248, 2024-09-19T10:05:02.353 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 453028, 2024-09-19T10:05:02.353 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:02.354 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:02.354 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:02.354 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:02.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:02.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:02.354 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:05:02.997 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T10:05:02.997 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T10:05:02.997 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T10:05:02.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T10:05:03.256 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:03.378 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:02 smithi018 ceph-mon[30956]: pgmap v720: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 MiB/s wr, 59 op/s 2024-09-19T10:05:03.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:02 smithi049 ceph-mon[34858]: pgmap v720: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 MiB/s wr, 59 op/s 2024-09-19T10:05:03.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:02 smithi162 ceph-mon[35174]: pgmap v720: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 MiB/s wr, 59 op/s 2024-09-19T10:05:03.728 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:05:03.728 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:03.728 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 851, 2024-09-19T10:05:03.728 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 851, 2024-09-19T10:05:03.728 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 287529, 2024-09-19T10:05:03.728 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 269795, 2024-09-19T10:05:03.728 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 6, 2024-09-19T10:05:03.728 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-19T10:05:03.728 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.153093827, 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.046384259, 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.044662261, 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.048351592, 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 850, 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.243938322, 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000286986 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1866, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 1862, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 921464, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 662071, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 3, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.254723846, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.058120317, 2024-09-19T10:05:03.730 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.093926772, 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.099098709, 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1861, 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.264930485, 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000142359 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.731 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 508960, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 147808 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 4, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 184, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1508, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 398533, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.028902057, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.024689676, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.002195215, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000067501, 2024-09-19T10:05:03.732 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 182, 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.069341153, 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000380995 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 397568 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.733 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 4025, 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.147877088, 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000036739 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.734 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 0, 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 0, 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.735 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 0, 2024-09-19T10:05:03.736 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 1, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 0, 2024-09-19T10:05:03.737 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-09-19T10:05:03.738 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 0, 2024-09-19T10:05:03.739 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 0, 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 0, 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 0 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 0, 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 0, 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 0, 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 0, 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 0, 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 0, 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-09-19T10:05:03.740 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_path": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_inode": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T10:05:03.741 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 0, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 0, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "evlrg": 0, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 0, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 0, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 0, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 4, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 0, 2024-09-19T10:05:03.742 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 0, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 0, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 0, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 2, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "segmjr": 2, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 0, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 4194304, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 4195426, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 4195285, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.743 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 4 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 3, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 3, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 0, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 1, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 1, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 0, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 0, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 0, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 0, 2024-09-19T10:05:03.744 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 0, 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 0, 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 0, 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 50624, 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 215328 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 0, 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 0, 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 0, 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 0, 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 0, 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-09-19T10:05:03.745 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.747 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.749 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-09-19T10:05:03.750 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.751 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-09-19T10:05:03.752 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.753 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.754 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-09-19T10:05:03.755 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 0, 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 1, 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 1, 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 1, 2024-09-19T10:05:03.757 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 0, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 0, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 1014, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:03.758 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 197463, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 54, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 7400, 2024-09-19T10:05:03.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 152, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 8512, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 13, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-09-19T10:05:03.762 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 2467, 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 21, 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 3, 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 2467, 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2467, 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 17.198790779, 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.006971540 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-09-19T10:05:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2467, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 2468 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 2467, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 2467, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 0, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 1613, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 0, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 852, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 0, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 0, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-09-19T10:05:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 1, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-09-19T10:05:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-09-19T10:05:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 84, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 2, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 6, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 6, 2024-09-19T10:05:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 0, 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 2, 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 0 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 0, 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "osd-slow-ops": { 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 0 2024-09-19T10:05:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 0, 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 0, 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 0, 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T10:05:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 2717, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 950137, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 2717, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 2717, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 950137, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 2467, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 1127, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 2467, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1127, 2024-09-19T10:05:03.771 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:03.772 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.772 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.772 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.772 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:03.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.772 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-09-19T10:05:03.772 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:03.772 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 2467, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 2467, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 2467, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 2467, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.773 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T10:05:03.774 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x55df95598b40": { 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:03.775 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:03.776 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:05:04.696 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-19T10:05:04.696 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-19T10:05:04.696 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T10:05:04.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T10:05:04.968 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:05.235 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:04 smithi018 ceph-mon[30956]: pgmap v721: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T10:05:05.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:04 smithi049 ceph-mon[34858]: pgmap v721: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T10:05:05.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:04 smithi162 ceph-mon[35174]: pgmap v721: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.001844061, 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T10:05:05.469 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000258237, 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T10:05:05.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 2, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 187, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 320, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 190224, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.018881290, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.014022641, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.001915068, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 185, 2024-09-19T10:05:05.471 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.022804800, 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000123269 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 190224 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 251, 2024-09-19T10:05:05.472 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 246, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 491056, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 150608, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.058369221, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.023695260, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.039550247, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 246, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.061410216, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000249635 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.473 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 491056, 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 150608 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T10:05:05.474 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:05.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 149735, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T10:05:05.477 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:05.478 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 249, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 453158, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 249, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T10:05:05.479 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T10:05:05.480 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 249, 2024-09-19T10:05:05.480 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 453158, 2024-09-19T10:05:05.480 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T10:05:05.480 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T10:05:05.480 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T10:05:05.480 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T10:05:05.480 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:05.480 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T10:05:05.480 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T10:05:06.265 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T10:05:06.265 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T10:05:06.265 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T10:05:06.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T10:05:06.631 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T10:05:07.091 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:07 smithi049 ceph-mon[34858]: pgmap v722: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-19T10:05:07.200 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T10:05:07.200 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:07.200 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 464453, 2024-09-19T10:05:07.200 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 467023, 2024-09-19T10:05:07.200 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 162274164, 2024-09-19T10:05:07.200 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 439112844, 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 44, 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 29.924000843, 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 12.539434854, 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 37.538735903, 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.525537631, 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 467022, 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 83.549401471, 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000178898 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:07.201 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 765748, 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.267529711, 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000349 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 55120, 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 30192 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 3900, 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3713, 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1462524, 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 331028641, 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 11, 2024-09-19T10:05:07.202 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 6, 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.008201806, 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 1.449364828, 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.138105733, 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.411425563, 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3712, 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.489388632, 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000401236 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1100, 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000302399, 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000274 2024-09-19T10:05:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 555360, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 170976 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 3236, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3075, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 715846, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 260402140, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 218, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 9, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.734976814, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 1.179255603, 2024-09-19T10:05:07.204 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.226967796, 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.325904132, 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3073, 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.156555108, 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000376360 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2385, 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000606568, 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000254 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.205 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 406240 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 1, 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MDSRank": { 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2160, 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 416.507078964, 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.192827351 2024-09-19T10:05:07.206 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-PurgeQueue": { 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 527, 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.019386851, 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000036787 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: "request": 275, 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": 275, 2024-09-19T10:05:07.207 INFO:teuthology.orchestra.run.smithi049.stdout: "reply_latency": { 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 275, 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 81.361368915, 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.295859523 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_reply": 0, 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "forward": 0, 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_complete": 0, 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_keys": 0, 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_commit": 174, 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_split": 0, 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_merge": 0, 2024-09-19T10:05:07.208 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes": 28, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_top": 5, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_bottom": 23, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pin_tail": 0, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pinned": 20, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_expired": 0, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_with_caps": 6, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": 6, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "subtrees": 2, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse": 519, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_hit": 507, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_forward": 0, 2024-09-19T10:05:07.209 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_discover": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_dir_fetch": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_remote_ino": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_lock": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "load_cent": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "q": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "exported": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "exported_inodes": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "imported": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "imported_inodes": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_dir_fetch": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_backtrace_fetch": 410, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_peer_discover": 0, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rfiles": 4, 2024-09-19T10:05:07.210 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rbytes": 234, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rsnaps": 0, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_fetch": 410, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_set_tag": 0, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_inotable_repaired": 0, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_inodes": 152, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_base_inodes": 15, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dirfrag_rstats": 137, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_file_inodes": 258, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_inode_file_caps": 4, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_revoke": 184, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_grant": 3302, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T10:05:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps": 458977, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps_dirty": 458806, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_cap_release": 5, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "process_request_cap_release": 49 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache": { 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update": 0, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update_receipt": 0, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_try_discover": 0, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_send_discover": 0, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_handle_discover": 6, 2024-09-19T10:05:07.212 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays": 4, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_delayed": 0, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_enqueuing": 0, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_created": 22, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_enqueued": 18, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_reintegrated": 0, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_migrated": 0, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_processing": 0, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_enqueued": 0, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_prioritized": 0, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_started": 0, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_completed": 0, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_path": 10, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_inode": 288, 2024-09-19T10:05:07.213 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_enqueue_scrub": 15, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_exportdir": 0, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_flush": 0, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragmentdir": 0, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragstats": 0, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_inodestats": 0 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log": { 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "evlrg": 0, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "evadd": 459676, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "evex": 456230, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "evtrm": 455206, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "ev": 4470, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "evexg": 0, 2024-09-19T10:05:07.214 INFO:teuthology.orchestra.run.smithi049.stdout: "evexd": 19742, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "segadd": 523, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "segex": 519, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "segtrm": 518, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "seg": 5, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "segmjr": 1, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "segexg": 0, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "segexd": 22, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "expos": 960570108, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "wrpos": 969973733, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "rdpos": 0, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "jlat": { 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5427, 2024-09-19T10:05:07.215 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2311.007377142, 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.425835153 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "replayed": 0 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mem": { 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 27, 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "ino+": 60, 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "ino-": 33, 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "dir": 18, 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "dir+": 22, 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "dir-": 4, 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "dn": 28, 2024-09-19T10:05:07.216 INFO:teuthology.orchestra.run.smithi049.stdout: "dn+": 67, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "dn-": 39, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "cap": 6, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "cap+": 48, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "cap-": 42, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "rss": 78932, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "heap": 231712 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_server": { 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_client_request": 385, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_server_request": 0, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_request": 275, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_session": 16, 2024-09-19T10:05:07.217 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_peer_request": 0, 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: "req_create_latency": { 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 22, 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.026940527, 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001224569 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getattr_latency": { 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 55, 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 15.999455042, 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.290899182 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getfilelock_latency": { 2024-09-19T10:05:07.218 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: "req_link_latency": { 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookup_latency": { 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 149, 2024-09-19T10:05:07.219 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 45.683936827, 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.306603602 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookuphash_latency": { 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupino_latency": { 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000337613, 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000337613 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.220 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupname_latency": { 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupparent_latency": { 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupsnap_latency": { 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.221 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.222 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.222 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.222 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lssnap_latency": { 2024-09-19T10:05:07.222 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.222 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.222 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.223 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.223 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mkdir_latency": { 2024-09-19T10:05:07.223 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 10, 2024-09-19T10:05:07.223 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 18.087384411, 2024-09-19T10:05:07.223 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 1.808738441 2024-09-19T10:05:07.223 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.223 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mknod_latency": { 2024-09-19T10:05:07.223 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mksnap_latency": { 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: "req_open_latency": { 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-09-19T10:05:07.224 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000185844, 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000185844 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: "req_readdir_latency": { 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5, 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.328360303, 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.265672060 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rename_latency": { 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2, 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.001972719, 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000986359 2024-09-19T10:05:07.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "req_renamesnap_latency": { 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "req_snapdiff_latency": { 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmdir_latency": { 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4, 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.024681196, 2024-09-19T10:05:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.006170299 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmsnap_latency": { 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmxattr_latency": { 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setattr_latency": { 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-09-19T10:05:07.227 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.001098686, 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001098686 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setdirlayout_latency": { 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setfilelock_latency": { 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.228 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setlayout_latency": { 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setxattr_latency": { 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7, 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.019132099, 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002733157 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "req_symlink_latency": { 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.230 INFO:teuthology.orchestra.run.smithi049.stdout: "req_unlink_latency": { 2024-09-19T10:05:07.230 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 18, 2024-09-19T10:05:07.230 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.187883648, 2024-09-19T10:05:07.230 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010437980 2024-09-19T10:05:07.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.230 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_revoke_eviction": 0, 2024-09-19T10:05:07.230 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_acquisition_throttle": 0, 2024-09-19T10:05:07.230 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getvxattr_latency": { 2024-09-19T10:05:07.230 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.230 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessions": { 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "session_count": 1, 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "session_add": 2, 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "session_remove": 1, 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_open": 1, 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_stale": 0, 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "total_load": 48, 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "average_load": 48, 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_session_uptime": 760, 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: "mdthresh_evicted": 0 2024-09-19T10:05:07.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.232 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-09-19T10:05:07.232 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:07.232 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:07.232 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:07.232 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:07.232 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:07.232 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:07.232 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:07.232 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:07.233 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:07.235 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:07.235 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:07.235 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-09-19T10:05:07.235 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:07.235 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:07.235 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:07.235 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:07.235 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 319179, 2024-09-19T10:05:07.235 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 118, 2024-09-19T10:05:07.235 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 7400, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 152, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:07.236 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 108926, 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 1166, 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-19T10:05:07.237 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 8110, 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 966452385, 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 37, 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 8110, 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8110, 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 500.349226862, 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.061695342 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8110, 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 8538 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.238 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 8110, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 442, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 7668, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 152, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 44, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 17, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 5429, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 156, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-19T10:05:07.239 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 1500, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 425, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 88, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-19T10:05:07.240 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-19T10:05:07.241 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 84, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 2, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 12, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 12, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 711, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 16 2024-09-19T10:05:07.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "oft": { 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_objs": 1, 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_kv_pairs": 0, 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_updates": 0, 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_removes": 0 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "osd-slow-ops": { 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_ops_count": 264 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "purge_queue": { 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops": 0, 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops_high_water": 513, 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing": 0, 2024-09-19T10:05:07.243 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_high_water": 6, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed_ops": 530, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed": 18, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_item_in_journal": 0 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 471585, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 121984738, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 471585, 2024-09-19T10:05:07.244 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 471585, 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 121984738, 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-19T10:05:07.245 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 8110, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 966454203, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 8110, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 966454203, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.246 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:07.247 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 8110, 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 8110, 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 8110, 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 8110, 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle": { 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-09-19T10:05:07.248 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 18, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1818, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 18, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 2, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1818, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.249 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle-0x5635bb446960": { 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 459676, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 965779429, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 459676, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 5427, 2024-09-19T10:05:07.250 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 965779429, 2024-09-19T10:05:07.251 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:07.251 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:07.251 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:07.251 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:07.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:07.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:07.251 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T10:05:07.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:06 smithi018 ceph-mon[30956]: pgmap v722: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-19T10:05:07.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:06 smithi162 ceph-mon[35174]: pgmap v722: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-19T10:05:08.203 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-19T10:05:08.203 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-19T10:05:08.203 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T10:05:08.204 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T10:05:08.462 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 533, 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 705, 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 120912, 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 516650, 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 41, 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.098801909, 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.033896184, 2024-09-19T10:05:08.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.055735642, 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.004845239, 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 705, 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.059198100, 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000083968 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1146, 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000340106, 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000296 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T10:05:08.994 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 369, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 359, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 568282, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 187222, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 7, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.049161022, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.019600509, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.036177550, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000341970, 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:08.995 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 359, 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.050979426, 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000142003 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 127, 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000032272, 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000254 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 539872, 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 156432 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:08.996 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 142, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 328, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 52738, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 597969, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 14, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 6, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.027062960, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.013489323, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.012819807, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000170001, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 324, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.038257421, 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000118078 2024-09-19T10:05:08.997 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 241, 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000057654, 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000239 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 489792 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 1, 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MDSRank": { 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-19T10:05:08.998 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-19T10:05:08.999 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 42, 2024-09-19T10:05:08.999 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.001558896, 2024-09-19T10:05:08.999 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000037116 2024-09-19T10:05:08.999 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:08.999 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:08.999 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-PurgeQueue": { 2024-09-19T10:05:08.999 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-19T10:05:08.999 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-19T10:05:08.999 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2, 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000019120, 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000009560 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: "request": 0, 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": 0, 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: "reply_latency": { 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.000 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_reply": 0, 2024-09-19T10:05:09.001 INFO:teuthology.orchestra.run.smithi049.stdout: "forward": 0, 2024-09-19T10:05:09.001 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_complete": 0, 2024-09-19T10:05:09.001 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_keys": 0, 2024-09-19T10:05:09.001 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_commit": 11, 2024-09-19T10:05:09.001 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_split": 0, 2024-09-19T10:05:09.001 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_merge": 0, 2024-09-19T10:05:09.001 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes": 10, 2024-09-19T10:05:09.001 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_top": 0, 2024-09-19T10:05:09.001 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_bottom": 10, 2024-09-19T10:05:09.001 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pin_tail": 0, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pinned": 10, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_expired": 0, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_with_caps": 0, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": 0, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "subtrees": 1, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse": 20, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_hit": 20, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_forward": 0, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_discover": 0, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_dir_fetch": 0, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_remote_ino": 0, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_lock": 0, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "load_cent": 0, 2024-09-19T10:05:09.002 INFO:teuthology.orchestra.run.smithi049.stdout: "q": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "exported": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "exported_inodes": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "imported": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "imported_inodes": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_dir_fetch": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_backtrace_fetch": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_peer_discover": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rfiles": 4, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rbytes": 234, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rsnaps": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_set_tag": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T10:05:09.003 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_inotable_repaired": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_inodes": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_file_inodes": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_inode_file_caps": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_grant": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps": 0, 2024-09-19T10:05:09.004 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps_dirty": 0, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_cap_release": 0, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "process_request_cap_release": 0 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache": { 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update": 0, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update_receipt": 0, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_try_discover": 0, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_send_discover": 1, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_handle_discover": 0, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays": 0, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_delayed": 0, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_enqueuing": 0, 2024-09-19T10:05:09.005 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_created": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_enqueued": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_reintegrated": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_migrated": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_processing": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_enqueued": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_prioritized": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_started": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_completed": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_path": 10, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_inode": 10, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_exportdir": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_flush": 0, 2024-09-19T10:05:09.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragmentdir": 0, 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragstats": 0, 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_inodestats": 0 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log": { 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "evlrg": 0, 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "evadd": 2, 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "evex": 0, 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "evtrm": 0, 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "ev": 2, 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "evexg": 0, 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "evexd": 0, 2024-09-19T10:05:09.007 INFO:teuthology.orchestra.run.smithi049.stdout: "segadd": 2, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "segex": 0, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "segtrm": 0, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "seg": 2, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "segmjr": 2, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "segexg": 0, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "segexd": 0, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "expos": 4194304, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "wrpos": 4194892, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "rdpos": 0, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "jlat": { 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.001592466, 2024-09-19T10:05:09.008 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001592466 2024-09-19T10:05:09.009 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.009 INFO:teuthology.orchestra.run.smithi049.stdout: "replayed": 0 2024-09-19T10:05:09.009 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.009 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mem": { 2024-09-19T10:05:09.009 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 13, 2024-09-19T10:05:09.009 INFO:teuthology.orchestra.run.smithi049.stdout: "ino+": 13, 2024-09-19T10:05:09.009 INFO:teuthology.orchestra.run.smithi049.stdout: "ino-": 0, 2024-09-19T10:05:09.009 INFO:teuthology.orchestra.run.smithi049.stdout: "dir": 11, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "dir+": 12, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "dir-": 1, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "dn": 10, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "dn+": 10, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "dn-": 0, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "cap": 0, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "cap+": 0, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "cap-": 0, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "rss": 50244, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "heap": 223520 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_server": { 2024-09-19T10:05:09.010 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_client_request": 0, 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_server_request": 0, 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_request": 0, 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_session": 0, 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_peer_request": 0, 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "req_create_latency": { 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getattr_latency": { 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.011 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getfilelock_latency": { 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: "req_link_latency": { 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.012 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.013 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookup_latency": { 2024-09-19T10:05:09.013 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.013 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.013 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.013 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.013 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookuphash_latency": { 2024-09-19T10:05:09.013 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.013 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.013 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.016 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.016 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupino_latency": { 2024-09-19T10:05:09.016 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.016 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.016 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.016 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupname_latency": { 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupparent_latency": { 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupsnap_latency": { 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.017 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.018 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.018 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lssnap_latency": { 2024-09-19T10:05:09.018 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.018 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.018 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.018 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.018 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mkdir_latency": { 2024-09-19T10:05:09.018 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.019 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.019 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.019 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mknod_latency": { 2024-09-19T10:05:09.019 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.019 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.019 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.019 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mksnap_latency": { 2024-09-19T10:05:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "req_open_latency": { 2024-09-19T10:05:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "req_readdir_latency": { 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rename_latency": { 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "req_renamesnap_latency": { 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: "req_snapdiff_latency": { 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmdir_latency": { 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.023 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmsnap_latency": { 2024-09-19T10:05:09.023 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.023 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.023 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.023 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.023 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmxattr_latency": { 2024-09-19T10:05:09.023 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.023 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.023 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.023 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setattr_latency": { 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setdirlayout_latency": { 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setfilelock_latency": { 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.024 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setlayout_latency": { 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setxattr_latency": { 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.026 INFO:teuthology.orchestra.run.smithi049.stdout: "req_symlink_latency": { 2024-09-19T10:05:09.026 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.026 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.026 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.026 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.026 INFO:teuthology.orchestra.run.smithi049.stdout: "req_unlink_latency": { 2024-09-19T10:05:09.026 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.026 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.026 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.026 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.027 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_revoke_eviction": 0, 2024-09-19T10:05:09.027 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_acquisition_throttle": 0, 2024-09-19T10:05:09.027 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getvxattr_latency": { 2024-09-19T10:05:09.027 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.027 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.027 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.027 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:09.027 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.027 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessions": { 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "session_count": 0, 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "session_add": 0, 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "session_remove": 0, 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_open": 0, 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_stale": 0, 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "total_load": 0, 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "average_load": 0, 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_session_uptime": 0, 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "mdthresh_evicted": 0 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-09-19T10:05:09.028 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:09.029 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:09.029 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:09.029 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:09.029 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:09.029 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:09.029 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:09.029 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:09.029 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:09.029 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:09.029 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:09.030 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:09.030 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:09.030 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:09.030 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:09.030 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:09.030 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:09.031 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 238103, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 77, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:09.032 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 7400, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 152, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 50872, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 198, 2024-09-19T10:05:09.033 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 35, 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 10710, 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 32, 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 35, 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-19T10:05:09.034 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 35, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.196994587, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.005628416 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 35, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 57 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 35, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 35, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-09-19T10:05:09.035 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 10, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 1, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 5, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 6, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-09-19T10:05:09.036 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 20, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-19T10:05:09.037 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-19T10:05:09.038 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 84, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 2, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 8, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 8, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 14, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 1 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "oft": { 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_objs": 1, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_kv_pairs": 0, 2024-09-19T10:05:09.039 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_updates": 0, 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_removes": 0 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: "osd-slow-ops": { 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_ops_count": 18 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: "purge_queue": { 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops": 0, 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing": 0, 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_high_water": 0, 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed_ops": 0, 2024-09-19T10:05:09.040 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed": 0, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_item_in_journal": 0 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 1040, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 630656, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 1040, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1040, 2024-09-19T10:05:09.041 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 630656, 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 35, 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 10710, 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 35, 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 10710, 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-09-19T10:05:09.043 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 35, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 35, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 35, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 35, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.044 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle": { 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:09.045 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle-0x55cd6ea24960": { 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 2, 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 588, 2024-09-19T10:05:09.046 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 2, 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1, 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 588, 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:09.047 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T10:05:09.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:08 smithi049 ceph-mon[34858]: pgmap v723: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8.5 MiB/s wr, 77 op/s 2024-09-19T10:05:09.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:08 smithi018 ceph-mon[30956]: pgmap v723: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8.5 MiB/s wr, 77 op/s 2024-09-19T10:05:09.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:08 smithi162 ceph-mon[35174]: pgmap v723: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8.5 MiB/s wr, 77 op/s 2024-09-19T10:05:09.683 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T10:05:09.683 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T10:05:09.683 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T10:05:09.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T10:05:09.939 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T10:05:10.576 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T10:05:10.576 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:10.576 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 155, 2024-09-19T10:05:10.576 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 155, 2024-09-19T10:05:10.576 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 58327, 2024-09-19T10:05:10.576 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 108682, 2024-09-19T10:05:10.576 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 14, 2024-09-19T10:05:10.576 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-09-19T10:05:10.576 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.022522254, 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004262774, 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.014290532, 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000708442, 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 154, 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.026713498, 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000173464 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 238, 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000114445, 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000480 2024-09-19T10:05:10.577 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 854, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 1013, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 682363, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 297001, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.117548695, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.052750064, 2024-09-19T10:05:10.578 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.066940889, 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.005354194, 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1014, 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.071126726, 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000070144 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1241, 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000430119, 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000346 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 545936, 2024-09-19T10:05:10.579 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 155504 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 42, 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 227, 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 7168, 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 890535, 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 41, 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 6, 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.031327987, 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.009459423, 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.017583695, 2024-09-19T10:05:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.001253229, 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 223, 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.022306405, 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000100028 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 32, 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000003637, 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000113 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 491232 2024-09-19T10:05:10.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 1, 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MDSRank": { 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 44, 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.001333750, 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000030312 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.582 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-PurgeQueue": { 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2, 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000011550, 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000005775 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "request": 0, 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": 0, 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "reply_latency": { 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.583 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_reply": 0, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "forward": 0, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_complete": 0, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_keys": 0, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_commit": 11, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_split": 0, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_merge": 0, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes": 10, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_top": 0, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_bottom": 10, 2024-09-19T10:05:10.584 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pin_tail": 0, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pinned": 10, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_expired": 0, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_with_caps": 0, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": 0, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "subtrees": 1, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse": 20, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_hit": 20, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_forward": 0, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_discover": 0, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_dir_fetch": 0, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_remote_ino": 0, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_lock": 0, 2024-09-19T10:05:10.585 INFO:teuthology.orchestra.run.smithi049.stdout: "load_cent": 0, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "q": 0, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "exported": 0, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "exported_inodes": 0, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "imported": 0, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "imported_inodes": 0, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_dir_fetch": 0, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_backtrace_fetch": 0, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_peer_discover": 0, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rfiles": 4, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rbytes": 234, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rsnaps": 0, 2024-09-19T10:05:10.586 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_set_tag": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_inotable_repaired": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_inodes": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_file_inodes": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_inode_file_caps": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_grant": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T10:05:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps": 0, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps_dirty": 0, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_cap_release": 0, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "process_request_cap_release": 0 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache": { 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update": 0, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update_receipt": 0, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_try_discover": 0, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_send_discover": 1, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_handle_discover": 0, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays": 0, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_delayed": 0, 2024-09-19T10:05:10.588 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_enqueuing": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_created": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_enqueued": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_reintegrated": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_migrated": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_processing": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_enqueued": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_prioritized": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_started": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_completed": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_path": 10, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_inode": 10, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T10:05:10.589 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_exportdir": 0, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_flush": 0, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragmentdir": 0, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragstats": 0, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_inodestats": 0 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log": { 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "evlrg": 0, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "evadd": 2, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "evex": 0, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "evtrm": 0, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "ev": 2, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "evexg": 0, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "evexd": 0, 2024-09-19T10:05:10.590 INFO:teuthology.orchestra.run.smithi049.stdout: "segadd": 2, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "segex": 0, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "segtrm": 0, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "seg": 2, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "segmjr": 2, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "segexg": 0, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "segexd": 0, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "expos": 4194304, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "wrpos": 4194892, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "rdpos": 0, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "jlat": { 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.001527656, 2024-09-19T10:05:10.591 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001527656 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "replayed": 0 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mem": { 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 13, 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "ino+": 13, 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "ino-": 0, 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "dir": 11, 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "dir+": 12, 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "dir-": 1, 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "dn": 10, 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "dn+": 10, 2024-09-19T10:05:10.592 INFO:teuthology.orchestra.run.smithi049.stdout: "dn-": 0, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "cap": 0, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "cap+": 0, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "cap-": 0, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "rss": 51208, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "heap": 223520 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_server": { 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_client_request": 0, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_server_request": 0, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_request": 0, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_session": 0, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_peer_request": 0, 2024-09-19T10:05:10.593 INFO:teuthology.orchestra.run.smithi049.stdout: "req_create_latency": { 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getattr_latency": { 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getfilelock_latency": { 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.594 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: "req_link_latency": { 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookup_latency": { 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookuphash_latency": { 2024-09-19T10:05:10.595 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupino_latency": { 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupname_latency": { 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupparent_latency": { 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupsnap_latency": { 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lssnap_latency": { 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.597 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mkdir_latency": { 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mknod_latency": { 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mksnap_latency": { 2024-09-19T10:05:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: "req_open_latency": { 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: "req_readdir_latency": { 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rename_latency": { 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "req_renamesnap_latency": { 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "req_snapdiff_latency": { 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.600 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmdir_latency": { 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmsnap_latency": { 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.601 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmxattr_latency": { 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setattr_latency": { 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setdirlayout_latency": { 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.602 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setfilelock_latency": { 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setlayout_latency": { 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setxattr_latency": { 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.603 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: "req_symlink_latency": { 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: "req_unlink_latency": { 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.604 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_revoke_eviction": 0, 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_acquisition_throttle": 0, 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getvxattr_latency": { 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessions": { 2024-09-19T10:05:10.605 INFO:teuthology.orchestra.run.smithi049.stdout: "session_count": 0, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "session_add": 0, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "session_remove": 0, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_open": 0, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_stale": 0, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "total_load": 0, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "average_load": 0, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_session_uptime": 0, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "mdthresh_evicted": 0 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:10.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 238135, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 78, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-09-19T10:05:10.609 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 7400, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 152, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 50872, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 198, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 35, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 10710, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 33, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 35, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 35, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.208994247, 2024-09-19T10:05:10.611 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.005971264 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 35, 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 57 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 35, 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 35, 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-09-19T10:05:10.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 10, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 1, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 5, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 6, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-09-19T10:05:10.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 20, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-19T10:05:10.614 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-19T10:05:10.615 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 84, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 2, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 9, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 9, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 14, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 1 2024-09-19T10:05:10.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "oft": { 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_objs": 1, 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_kv_pairs": 0, 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_updates": 0, 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_removes": 0 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "osd-slow-ops": { 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_ops_count": 18 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "purge_queue": { 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops": 0, 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T10:05:10.617 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing": 0, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_high_water": 0, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed_ops": 0, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed": 0, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_item_in_journal": 0 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 1047, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 635772, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 1047, 2024-09-19T10:05:10.618 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1047, 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 635772, 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-19T10:05:10.619 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 35, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 10710, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 35, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 10710, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.620 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:10.621 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.621 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-09-19T10:05:10.621 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:10.624 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-19T10:05:10.624 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:10.624 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:10.624 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:10.624 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:10.624 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 35, 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 35, 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 35, 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 35, 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle": { 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.626 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle-0x559c138ae960": { 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 2, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 588, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 2, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 588, 2024-09-19T10:05:10.627 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:10.628 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:10.628 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:10.628 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:10.628 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:10.628 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:10.628 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T10:05:11.331 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:10 smithi049 ceph-mon[34858]: pgmap v724: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 22 MiB/s wr, 189 op/s 2024-09-19T10:05:11.362 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T10:05:11.362 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T10:05:11.362 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T10:05:11.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T10:05:11.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:10 smithi018 ceph-mon[30956]: pgmap v724: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 22 MiB/s wr, 189 op/s 2024-09-19T10:05:11.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:10 smithi162 ceph-mon[35174]: pgmap v724: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 22 MiB/s wr, 189 op/s 2024-09-19T10:05:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 846, 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 846, 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 225601, 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 268268, 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 6, 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.091263710, 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.031863624, 2024-09-19T10:05:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.024027648, 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.025446410, 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 845, 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.052410484, 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000062024 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 1018, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 1011, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 716100, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 393995, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.125822577, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.035921448, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.052137778, 2024-09-19T10:05:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.037206366, 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1010, 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.070341591, 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000069645 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 529856, 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 153264 2024-09-19T10:05:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 836, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 1023, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 280720, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 669178, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.115887674, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.037631959, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.029666602, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.037305429, 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1021, 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.070294417, 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000068848 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 403648 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 1, 2024-09-19T10:05:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MDSRank": { 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4055, 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.142372792, 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000035110 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-PurgeQueue": { 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-19T10:05:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: "request": 0, 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": 0, 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: "reply_latency": { 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.400 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_reply": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "forward": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_complete": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_keys": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_commit": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_split": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_merge": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_top": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_bottom": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pin_tail": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pinned": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_expired": 0, 2024-09-19T10:05:12.401 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_with_caps": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "subtrees": 1, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_hit": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_forward": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_discover": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_dir_fetch": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_remote_ino": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_lock": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "load_cent": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "q": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "exported": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "exported_inodes": 0, 2024-09-19T10:05:12.402 INFO:teuthology.orchestra.run.smithi049.stdout: "imported": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "imported_inodes": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_dir_fetch": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_backtrace_fetch": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_peer_discover": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rfiles": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rbytes": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rsnaps": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_set_tag": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_inotable_repaired": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_inodes": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T10:05:12.403 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_file_inodes": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_inode_file_caps": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_grant": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps_dirty": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_cap_release": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "process_request_cap_release": 0 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache": { 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update": 0, 2024-09-19T10:05:12.404 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update_receipt": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_try_discover": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_send_discover": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_handle_discover": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_delayed": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_enqueuing": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_created": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_enqueued": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_reintegrated": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_migrated": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_processing": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_enqueued": 0, 2024-09-19T10:05:12.405 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_prioritized": 0, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_started": 0, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_completed": 0, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_path": 0, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_inode": 0, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_exportdir": 0, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_flush": 0, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragmentdir": 0, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragstats": 0, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_inodestats": 0 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log": { 2024-09-19T10:05:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: "evlrg": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "evadd": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "evex": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "evtrm": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "ev": 5, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "evexg": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "evexd": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "segadd": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "segex": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "segtrm": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "seg": 2, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "segmjr": 2, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "segexg": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "segexd": 0, 2024-09-19T10:05:12.407 INFO:teuthology.orchestra.run.smithi049.stdout: "expos": 4194304, 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "wrpos": 4195734, 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "rdpos": 4195426, 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "jlat": { 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "replayed": 5 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mem": { 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 3, 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "ino+": 3, 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "ino-": 0, 2024-09-19T10:05:12.408 INFO:teuthology.orchestra.run.smithi049.stdout: "dir": 1, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "dir+": 1, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "dir-": 0, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "dn": 0, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "dn+": 0, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "dn-": 0, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "cap": 0, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "cap+": 0, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "cap-": 0, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "rss": 48636, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "heap": 215328 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_server": { 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_client_request": 0, 2024-09-19T10:05:12.409 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_server_request": 0, 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_request": 0, 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_session": 0, 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_peer_request": 0, 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "req_create_latency": { 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getattr_latency": { 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.410 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getfilelock_latency": { 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "req_link_latency": { 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookup_latency": { 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookuphash_latency": { 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupino_latency": { 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupname_latency": { 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.412 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupparent_latency": { 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupsnap_latency": { 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.413 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lssnap_latency": { 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mkdir_latency": { 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mknod_latency": { 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.414 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mksnap_latency": { 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "req_open_latency": { 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "req_readdir_latency": { 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.415 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rename_latency": { 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: "req_renamesnap_latency": { 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: "req_snapdiff_latency": { 2024-09-19T10:05:12.416 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmdir_latency": { 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmsnap_latency": { 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.417 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmxattr_latency": { 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setattr_latency": { 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setdirlayout_latency": { 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.418 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setfilelock_latency": { 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setlayout_latency": { 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.419 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setxattr_latency": { 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "req_symlink_latency": { 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "req_unlink_latency": { 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.420 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_revoke_eviction": 0, 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_acquisition_throttle": 0, 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getvxattr_latency": { 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessions": { 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "session_count": 1, 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "session_add": 2, 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "session_remove": 1, 2024-09-19T10:05:12.421 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_open": 1, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_stale": 0, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "total_load": 0, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "average_load": 0, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_session_uptime": 2029, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "mdthresh_evicted": 0 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:12.422 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:12.423 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-09-19T10:05:12.424 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 189440, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 52, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:12.425 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 7400, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 152, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 8512, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 13, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-09-19T10:05:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 2434, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 21, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 3, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 2434, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2434, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 37.292972523, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.015321681 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2434, 2024-09-19T10:05:12.427 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2435 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 2434, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 2434, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 1590, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 842, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-19T10:05:12.428 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 1, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-19T10:05:12.429 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-19T10:05:12.430 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 84, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 2, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 5, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 5, 2024-09-19T10:05:12.431 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 2, 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "oft": { 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_objs": 0, 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_kv_pairs": 0, 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_updates": 0, 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_removes": 0 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "osd-slow-ops": { 2024-09-19T10:05:12.432 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_ops_count": 0 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "purge_queue": { 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops": 0, 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing": 0, 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_high_water": 0, 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed_ops": 0, 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed": 0, 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_item_in_journal": 0 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-19T10:05:12.433 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 2696, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 963365, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 2696, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 2696, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 963365, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:12.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 2434, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 1435, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 2434, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1435, 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:12.435 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 2434, 2024-09-19T10:05:12.436 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 2434, 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 2434, 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 2434, 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle": { 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:12.437 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle-0x562aad148b40": { 2024-09-19T10:05:12.438 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-19T10:05:12.439 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-19T10:05:12.440 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:12.440 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T10:05:12.440 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T10:05:12.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:12 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:05:12.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:12 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:05:12.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:12 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T10:05:13.268 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-19T10:05:13.268 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-19T10:05:13.268 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T10:05:13.268 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T10:05:13.517 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T10:05:13.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:13.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:13.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:13 smithi162 ceph-mon[35174]: pgmap v725: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 34 MiB/s wr, 283 op/s 2024-09-19T10:05:13.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:13.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:13.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:05:13.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:05:13.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:13 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.045 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T10:05:14.045 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:14.045 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1985, 2024-09-19T10:05:14.045 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1987, 2024-09-19T10:05:14.045 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 323581456, 2024-09-19T10:05:14.045 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 631240, 2024-09-19T10:05:14.045 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 8, 2024-09-19T10:05:14.045 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-09-19T10:05:14.045 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.417737931, 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.054602515, 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.275022841, 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.069358329, 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1985, 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.071793397, 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000036167 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.046 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 995, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1177, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 331658729, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 806424, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 8, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 6, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.311072106, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.032542297, 2024-09-19T10:05:14.047 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.233671054, 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.033399414, 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1176, 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.067140060, 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000057091 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.048 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 491856 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1425, 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1418, 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 312332208, 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 522293, 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.364217828, 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.048073761, 2024-09-19T10:05:14.049 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.268606588, 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.040323686, 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1417, 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.062508496, 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000044113 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.050 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 529200, 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 151504 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 6127, 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.180933878, 2024-09-19T10:05:14.051 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000029530 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-19T10:05:14.052 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-19T10:05:14.053 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 36, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 4, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 32, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 29, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 2, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-19T10:05:14.054 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-19T10:05:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 4, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 234, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-19T10:05:14.056 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-19T10:05:14.057 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-19T10:05:14.058 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-19T10:05:14.059 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 459676, 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-19T10:05:14.060 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 5, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 65, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 960570108, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 969973733, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 969973134, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.061 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 459676 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 18, 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 36, 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 18, 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 9, 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 13, 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 4, 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 36, 2024-09-19T10:05:14.062 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 57, 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 21, 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 52464, 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 215328 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-19T10:05:14.063 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-19T10:05:14.064 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.065 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-19T10:05:14.066 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.067 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.067 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.067 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.067 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-19T10:05:14.067 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.067 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.067 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.068 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-19T10:05:14.069 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.069 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.069 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.069 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.069 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.070 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.071 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-19T10:05:14.072 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.073 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.074 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.075 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-19T10:05:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-19T10:05:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-19T10:05:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.077 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 2, 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 2105, 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-19T10:05:14.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T10:05:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:14.079 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:14.081 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 239563, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 81, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:14.082 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7400, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 77950, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 805, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T10:05:14.083 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 4140, 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 26, 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 4, 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 4140, 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4140, 2024-09-19T10:05:14.084 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 26.300460956, 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.006352768 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4140, 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 4141 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 4140, 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 4140, 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-19T10:05:14.085 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 2676, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 1461, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-19T10:05:14.086 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 2, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-19T10:05:14.087 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-19T10:05:14.088 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 2, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 11, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 11, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-19T10:05:14.089 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-19T10:05:14.090 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 4401, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 967159954, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 4401, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 4401, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 967159954, 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:14.091 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:14.092 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 4140, 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 965912303, 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 4140, 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 965912303, 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-19T10:05:14.093 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 4140, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 4140, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 4140, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 4140, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.094 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:14.095 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55cd720cab40": { 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:14.096 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T10:05:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T10:05:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:14.097 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:14.097 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T10:05:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:13 smithi018 ceph-mon[30956]: pgmap v725: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 34 MiB/s wr, 283 op/s 2024-09-19T10:05:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:05:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:05:14.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:13 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.150 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:13 smithi049 ceph-mon[34858]: pgmap v725: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 34 MiB/s wr, 283 op/s 2024-09-19T10:05:14.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T10:05:14.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T10:05:14.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:13 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' 2024-09-19T10:05:14.922 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-19T10:05:14.922 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-19T10:05:14.922 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T10:05:14.922 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T10:05:15.172 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T10:05:15.293 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:14 smithi162 ceph-mon[35174]: pgmap v726: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 50 MiB/s wr, 409 op/s 2024-09-19T10:05:15.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:14 smithi018 ceph-mon[30956]: pgmap v726: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 50 MiB/s wr, 409 op/s 2024-09-19T10:05:15.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:14 smithi049 ceph-mon[34858]: pgmap v726: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 50 MiB/s wr, 409 op/s 2024-09-19T10:05:15.685 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1133, 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1126, 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 822976, 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 429916, 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.137998801, 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.046266993, 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.053616988, 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.034485795, 2024-09-19T10:05:15.686 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1125, 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.051427951, 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000045713 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 529312, 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 151984 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:15.687 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 4, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 189, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 876, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 492282, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.012155796, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.008515416, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.001702117, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000093601, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 187, 2024-09-19T10:05:15.688 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.012278540, 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000065660 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 491584 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 882, 2024-09-19T10:05:15.689 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 882, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 234197, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 279659, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.080700395, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.029114220, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.021859391, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.022805699, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 881, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.034495216, 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000039154 2024-09-19T10:05:15.690 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-19T10:05:15.691 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3501, 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.106074671, 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000030298 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-19T10:05:15.693 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-19T10:05:15.694 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 1, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-19T10:05:15.695 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-19T10:05:15.696 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-19T10:05:15.697 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-19T10:05:15.698 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-19T10:05:15.699 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 2, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 2, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 4194892, 2024-09-19T10:05:15.700 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 4194352, 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 2 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 3, 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 3, 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 0, 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 1, 2024-09-19T10:05:15.701 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 1, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 0, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 0, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 0, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 0, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 48352, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 215328 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-19T10:05:15.702 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.703 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.704 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.705 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-19T10:05:15.706 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.707 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.707 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.707 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.707 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-19T10:05:15.707 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.708 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.710 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.712 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-19T10:05:15.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.713 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.713 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-19T10:05:15.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.713 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.713 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-19T10:05:15.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-19T10:05:15.715 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 0, 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 0, 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 0, 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 0, 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-19T10:05:15.716 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 0, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:15.717 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:15.718 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 181287, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 45, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7400, 2024-09-19T10:05:15.720 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 8512, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 13, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-19T10:05:15.721 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 1754, 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 21, 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 3, 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 1754, 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1754, 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.608967035, 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000917313 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-19T10:05:15.722 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1754, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1755 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 1754, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 1754, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 874, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 878, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-19T10:05:15.723 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 1, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-19T10:05:15.724 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-19T10:05:15.725 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-09-19T10:05:15.726 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 2, 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 4, 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 4, 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-19T10:05:15.727 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-19T10:05:15.728 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2015, 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 860344, 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2015, 2024-09-19T10:05:15.729 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2015, 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 860344, 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:15.730 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 1754, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 593, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1754, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 593, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 1754, 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 1754, 2024-09-19T10:05:15.732 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1754, 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1754, 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T10:05:15.733 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:15.734 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55a1735ceb40": { 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T10:05:15.735 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T10:05:15.736 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:15.736 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:15.736 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:15.736 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:15.736 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:15.736 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:15.736 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T10:05:16.341 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T10:05:16.341 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T10:05:16.341 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T10:05:16.341 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T10:05:16.593 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T10:05:17.074 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T10:05:17.074 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 945, 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 901, 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 239462, 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 320468, 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 10, 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.098033461, 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.032811572, 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.062559567, 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.006047333, 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:17.075 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 902, 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.056509547, 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000062649 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1751, 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000494317, 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000282 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 119, 2024-09-19T10:05:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 303, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 35300, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 947024, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 43, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 8, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.036259593, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.011716515, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.021917421, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000400734, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 301, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.033569147, 2024-09-19T10:05:17.077 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000111525 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 154, 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000031261, 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000202 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 493024 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 395, 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 396, 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 577160, 2024-09-19T10:05:17.078 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 219420, 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 11, 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 6, 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.054920666, 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.022001945, 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.039712380, 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000136526, 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 393, 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.021559944, 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000054859 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.079 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 190, 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000043880, 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000230 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 543552, 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 156944 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-19T10:05:17.080 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 49, 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.002015769, 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000041138 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000015318, 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000007659 2024-09-19T10:05:17.081 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 5, 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 3, 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3, 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001628696, 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000542898 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 2, 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-19T10:05:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 11, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 14, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 14, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 14, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 2, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 2, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 2, 2024-09-19T10:05:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 27, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 23, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 2, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-19T10:05:17.084 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 4, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 234, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 11, 2024-09-19T10:05:17.085 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 10, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 12, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 2 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 3, 2024-09-19T10:05:17.086 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 10, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 50, 2024-09-19T10:05:17.087 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 5, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 5, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-19T10:05:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 2, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 2, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 4195734, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 0, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.007716666, 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001929166 2024-09-19T10:05:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 0 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 17, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 17, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 0, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 15, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 16, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 1, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 14, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 14, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 0, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 2, 2024-09-19T10:05:17.090 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 3, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 1, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 50608, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 223520 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 7, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 5, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 15, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.091 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001446078, 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000723039 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.092 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1, 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000182618, 2024-09-19T10:05:17.093 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000182618 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.094 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.095 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-19T10:05:17.095 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.095 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.095 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.095 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-19T10:05:17.095 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.096 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.098 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.099 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.100 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.101 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 2, 2024-09-19T10:05:17.102 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 2, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 2, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 771, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:17.103 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:17.104 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:17.105 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 239095, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 80, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:17.106 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7400, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 68429, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 293, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-19T10:05:17.107 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 43, 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 12198, 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 33, 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 43, 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 43, 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.220995440, 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.005139428 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 43, 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 68 2024-09-19T10:05:17.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 43, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 0, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 43, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 0, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 10, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 0, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 4, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 7, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-19T10:05:17.109 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 6, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 20, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-19T10:05:17.110 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-19T10:05:17.111 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 2, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 8, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 8, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 19, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 0, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 2 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.112 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 1, 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 54 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-19T10:05:17.113 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 1455, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 702947, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 1455, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1455, 2024-09-19T10:05:17.114 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 702947, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:17.115 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 43, 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 12198, 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 43, 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 12198, 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-19T10:05:17.116 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 43, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 43, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 43, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 43, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:17.117 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.118 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x563f1068e960": { 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 5, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1430, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 5, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:17.119 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 4, 2024-09-19T10:05:17.120 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1430, 2024-09-19T10:05:17.120 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:17.120 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:17.120 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:17.120 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:17.120 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:17.120 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:17.120 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T10:05:17.120 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:16 smithi162 ceph-mon[35174]: pgmap v727: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 64 MiB/s wr, 521 op/s 2024-09-19T10:05:17.385 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:16 smithi018 ceph-mon[30956]: pgmap v727: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 64 MiB/s wr, 521 op/s 2024-09-19T10:05:17.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:16 smithi049 ceph-mon[34858]: pgmap v727: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 64 MiB/s wr, 521 op/s 2024-09-19T10:05:17.873 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-19T10:05:17.873 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-19T10:05:17.874 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T10:05:17.874 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T10:05:18.124 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T10:05:18.666 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T10:05:18.666 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T10:05:18.666 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1756, 2024-09-19T10:05:18.666 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1758, 2024-09-19T10:05:18.666 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 525561, 2024-09-19T10:05:18.666 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 558409, 2024-09-19T10:05:18.666 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-09-19T10:05:18.666 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.178123358, 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.057547268, 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.047789686, 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.057353792, 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1756, 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.062210561, 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000035427 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.667 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 9, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 195, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 4702, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 493582, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.014326585, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.008031940, 2024-09-19T10:05:18.668 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.004445180, 2024-09-19T10:05:18.669 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000116005, 2024-09-19T10:05:18.669 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:18.669 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 194, 2024-09-19T10:05:18.669 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.021617953, 2024-09-19T10:05:18.669 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000111432 2024-09-19T10:05:18.669 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.669 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:18.669 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 492560 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 264, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 257, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 530668, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 154862, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-19T10:05:18.670 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.037875349, 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.017526519, 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.026517915, 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000025099, 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 256, 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.014981142, 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000058520 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.671 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 530400, 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 154544 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3513, 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.107176412, 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000030508 2024-09-19T10:05:18.672 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-19T10:05:18.673 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 0, 2024-09-19T10:05:18.674 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 1, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-19T10:05:18.675 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 0, 2024-09-19T10:05:18.676 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T10:05:18.677 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-19T10:05:18.678 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T10:05:18.679 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 2, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-19T10:05:18.680 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 2, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 4194892, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 4194352, 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-19T10:05:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 2 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 3, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 3, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 0, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 1, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 1, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 0, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 0, 2024-09-19T10:05:18.682 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 0, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 0, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 47948, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 215328 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-19T10:05:18.683 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.684 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-19T10:05:18.685 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.686 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.687 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.688 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-19T10:05:18.688 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.688 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.688 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.688 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.688 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.689 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.691 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.692 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.693 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.694 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.695 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.695 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.695 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-19T10:05:18.695 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.695 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.695 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.695 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.695 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-19T10:05:18.695 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 0, 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 0, 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 0, 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 0, 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-19T10:05:18.696 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 0, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T10:05:18.697 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T10:05:18.698 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T10:05:18.699 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 190185, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 53, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7400, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T10:05:18.700 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 8512, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 13, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 1760, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 21, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 3, 2024-09-19T10:05:18.701 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 1760, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1760, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.509969035, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000857936 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1760, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1761 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 1760, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 1760, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-19T10:05:18.702 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 877, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 881, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 1, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-19T10:05:18.703 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-19T10:05:18.704 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 2, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 5, 2024-09-19T10:05:18.705 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 5, 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-19T10:05:18.706 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T10:05:18.707 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2025, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 862118, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2025, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2025, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 862118, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:18.708 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 1760, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 593, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1760, 2024-09-19T10:05:18.709 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 593, 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 1760, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 1760, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1760, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1760, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T10:05:18.711 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T10:05:18.712 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55e911860b40": { 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T10:05:18.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T10:05:18.714 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:18.714 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T10:05:18.714 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T10:05:19.293 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:18 smithi162 ceph-mon[35174]: pgmap v728: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 64 MiB/s wr, 523 op/s 2024-09-19T10:05:19.386 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:18 smithi018 ceph-mon[30956]: pgmap v728: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 64 MiB/s wr, 523 op/s 2024-09-19T10:05:19.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:18 smithi049 ceph-mon[34858]: pgmap v728: 97 pgs: 97 active+clean; 8.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 64 MiB/s wr, 523 op/s 2024-09-19T10:05:19.490 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-19T10:05:19.491 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-19T10:05:19.491 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T10:05:19.502 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T10:05:19.502 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T10:05:19.502 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T10:05:19.525 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T10:05:19.525 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T10:05:19.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T10:05:19.898 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.319+0000 7fe45a7f0640 1 -- 172.21.15.18:0/178053291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45410c170 msgr2=0x7fe45410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.319+0000 7fe45a7f0640 1 --2- 172.21.15.18:0/178053291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45410c170 0x7fe45410e610 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009ca0 tx=0x7fe44c02a950 comp rx=0 tx=0).stop 2024-09-19T10:05:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.319+0000 7fe45a7f0640 1 -- 172.21.15.18:0/178053291 shutdown_connections 2024-09-19T10:05:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.319+0000 7fe45a7f0640 1 --2- 172.21.15.18:0/178053291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45410c170 0x7fe45410e610 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.319+0000 7fe45a7f0640 1 --2- 172.21.15.18:0/178053291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe454103660 0x7fe45410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.319+0000 7fe45a7f0640 1 --2- 172.21.15.18:0/178053291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe454102d40 0x7fe454103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.319+0000 7fe45a7f0640 1 -- 172.21.15.18:0/178053291 >> 172.21.15.18:0/178053291 conn(0x7fe4540fc7a0 msgr2=0x7fe4540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.319+0000 7fe45a7f0640 1 -- 172.21.15.18:0/178053291 shutdown_connections 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.319+0000 7fe45a7f0640 1 -- 172.21.15.18:0/178053291 wait complete. 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe45a7f0640 1 Processor -- start 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe45a7f0640 1 -- start start 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe45a7f0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe454102d40 0x7fe454198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe45a7f0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe454103660 0x7fe454198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe45a7f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45410c170 0x7fe45419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe45a7f0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe454111f30 con 0x7fe45410c170 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe45a7f0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe454111db0 con 0x7fe454103660 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe45a7f0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4541120b0 con 0x7fe454102d40 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe458d8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45410c170 0x7fe45419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe453fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe454102d40 0x7fe454198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:20.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe453fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe454102d40 0x7fe454198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58688/0 (socket says 172.21.15.18:58688) 2024-09-19T10:05:20.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe458d8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45410c170 0x7fe45419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33782/0 (socket says 172.21.15.18:33782) 2024-09-19T10:05:20.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe453fff640 1 -- 172.21.15.18:0/1675700997 learned_addr learned my addr 172.21.15.18:0/1675700997 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:05:20.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.320+0000 7fe44bfff640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe454103660 0x7fe454198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:20.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe458d8d640 1 -- 172.21.15.18:0/1675700997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe454102d40 msgr2=0x7fe454198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:20.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe458d8d640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe454102d40 0x7fe454198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:20.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe458d8d640 1 -- 172.21.15.18:0/1675700997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe454103660 msgr2=0x7fe454198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:20.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe458d8d640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe454103660 0x7fe454198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe458d8d640 1 -- 172.21.15.18:0/1675700997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45419d2e0 con 0x7fe45410c170 2024-09-19T10:05:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe458d8d640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45410c170 0x7fe45419cc00 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe44c005cc0 tx=0x7fe44c02f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe451ffb640 1 -- 172.21.15.18:0/1675700997 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c034040 con 0x7fe45410c170 2024-09-19T10:05:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe451ffb640 1 -- 172.21.15.18:0/1675700997 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe44c030920 con 0x7fe45410c170 2024-09-19T10:05:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe45a7f0640 1 -- 172.21.15.18:0/1675700997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45419d570 con 0x7fe45410c170 2024-09-19T10:05:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe451ffb640 1 -- 172.21.15.18:0/1675700997 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c039430 con 0x7fe45410c170 2024-09-19T10:05:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.321+0000 7fe45a7f0640 1 -- 172.21.15.18:0/1675700997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4541a4eb0 con 0x7fe45410c170 2024-09-19T10:05:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.322+0000 7fe45a7f0640 1 -- 172.21.15.18:0/1675700997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe454103120 con 0x7fe45410c170 2024-09-19T10:05:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.323+0000 7fe451ffb640 1 -- 172.21.15.18:0/1675700997 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe44c037020 con 0x7fe45410c170 2024-09-19T10:05:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.324+0000 7fe451ffb640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4400a32c0 0x7fe4400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.324+0000 7fe451ffb640 1 -- 172.21.15.18:0/1675700997 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe44c0f0980 con 0x7fe45410c170 2024-09-19T10:05:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.324+0000 7fe453fff640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4400a32c0 0x7fe4400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:20.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.325+0000 7fe453fff640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4400a32c0 0x7fe4400a5780 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe44400ac90 tx=0x7fe44400a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.328+0000 7fe451ffb640 1 -- 172.21.15.18:0/1675700997 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe44c0bd670 con 0x7fe45410c170 2024-09-19T10:05:20.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.522+0000 7fe45a7f0640 1 -- 172.21.15.18:0/1675700997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe4541a5080 con 0x7fe45410c170 2024-09-19T10:05:20.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.527+0000 7fe451ffb640 1 -- 172.21.15.18:0/1675700997 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+587 (secure 0 0 0) 0x7fe44c0bcf70 con 0x7fe45410c170 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3655731262 2024-09-20T09:43:30.259608+0000 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3886965559 2024-09-20T09:43:30.259608+0000 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/809218832 2024-09-20T09:43:30.259608+0000 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1191027709 2024-09-20T09:43:06.466314+0000 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/288316346 2024-09-20T09:43:06.466314+0000 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/2865418420 2024-09-20T09:43:06.466314+0000 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/446921657 2024-09-20T09:43:30.259608+0000 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/809218832 2024-09-20T09:43:30.259608+0000 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/2865418420 2024-09-20T09:43:06.466314+0000 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/633086506 2024-09-20T09:43:06.466314+0000 2024-09-19T10:05:20.530 INFO:teuthology.orchestra.run.smithi018.stderr:listed 10 entries 2024-09-19T10:05:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 -- 172.21.15.18:0/1675700997 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4400a32c0 msgr2=0x7fe4400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4400a32c0 0x7fe4400a5780 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe44400ac90 tx=0x7fe44400a380 comp rx=0 tx=0).stop 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 -- 172.21.15.18:0/1675700997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45410c170 msgr2=0x7fe45419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45410c170 0x7fe45419cc00 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe44c005cc0 tx=0x7fe44c02f6a0 comp rx=0 tx=0).stop 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 -- 172.21.15.18:0/1675700997 shutdown_connections 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fe4400a32c0 0x7fe4400a5780 secure :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe44400ac90 tx=0x7fe44400a380 comp rx=0 tx=0).stop 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45410c170 0x7fe45419cc00 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe454103660 0x7fe454198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 --2- 172.21.15.18:0/1675700997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe454102d40 0x7fe454198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 -- 172.21.15.18:0/1675700997 >> 172.21.15.18:0/1675700997 conn(0x7fe4540fc7a0 msgr2=0x7fe4540fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 -- 172.21.15.18:0/1675700997 shutdown_connections 2024-09-19T10:05:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:20.531+0000 7fe45a7f0640 1 -- 172.21.15.18:0/1675700997 wait complete. 2024-09-19T10:05:20.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:20 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1675700997' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T10:05:20.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:20 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1675700997' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T10:05:20.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:20 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1675700997' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T10:05:21.356 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T10:05:21.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T10:05:21.356 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T10:05:21.887 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:21 smithi018 ceph-mon[30956]: pgmap v729: 97 pgs: 97 active+clean; 7.9 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 58 MiB/s wr, 495 op/s 2024-09-19T10:05:21.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:21 smithi049 ceph-mon[34858]: pgmap v729: 97 pgs: 97 active+clean; 7.9 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 58 MiB/s wr, 495 op/s 2024-09-19T10:05:21.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:21 smithi162 ceph-mon[35174]: pgmap v729: 97 pgs: 97 active+clean; 7.9 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 58 MiB/s wr, 495 op/s 2024-09-19T10:05:23.004 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T10:05:23.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T10:05:23.005 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T10:05:23.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T10:05:23.057 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T10:05:23.083 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T10:05:23.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T10:05:23.084 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T10:05:23.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T10:05:23.152 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-19T10:05:23.261 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:22 smithi018 ceph-mon[30956]: pgmap v730: 97 pgs: 97 active+clean; 6.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 48 MiB/s wr, 438 op/s 2024-09-19T10:05:23.262 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T10:05:23.273 INFO:tasks.cephadm:Teardown begin 2024-09-19T10:05:23.273 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T10:05:23.273 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:05:23.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:22 smithi049 ceph-mon[34858]: pgmap v730: 97 pgs: 97 active+clean; 6.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 48 MiB/s wr, 438 op/s 2024-09-19T10:05:23.413 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:22 smithi162 ceph-mon[35174]: pgmap v730: 97 pgs: 97 active+clean; 6.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 48 MiB/s wr, 438 op/s 2024-09-19T10:05:23.552 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.147+0000 7fcbb61d7640 1 -- 172.21.15.18:0/646160183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcba8094930 msgr2=0x7fcba8094d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.147+0000 7fcbb61d7640 1 --2- 172.21.15.18:0/646160183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcba8094930 0x7fcba8094d90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009900 tx=0x7fcba002a410 comp rx=0 tx=0).stop 2024-09-19T10:05:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.148+0000 7fcbb61d7640 1 -- 172.21.15.18:0/646160183 shutdown_connections 2024-09-19T10:05:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.148+0000 7fcbb61d7640 1 --2- 172.21.15.18:0/646160183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcba80952d0 0x7fcba80a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.148+0000 7fcbb61d7640 1 --2- 172.21.15.18:0/646160183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcba8094930 0x7fcba8094d90 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.148+0000 7fcbb61d7640 1 --2- 172.21.15.18:0/646160183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcba809a550 0x7fcba809a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.148+0000 7fcbb61d7640 1 -- 172.21.15.18:0/646160183 >> 172.21.15.18:0/646160183 conn(0x7fcba800a1f0 msgr2=0x7fcba800a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.148+0000 7fcbb61d7640 1 -- 172.21.15.18:0/646160183 shutdown_connections 2024-09-19T10:05:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.148+0000 7fcbb61d7640 1 -- 172.21.15.18:0/646160183 wait complete. 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb61d7640 1 Processor -- start 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb61d7640 1 -- start start 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb61d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcba8094930 0x7fcba812f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb61d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcba80952d0 0x7fcba812fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb61d7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcba809a550 0x7fcba8129880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb61d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcba80a3800 con 0x7fcba8094930 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb51d5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcba8094930 0x7fcba812f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb51d5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcba8094930 0x7fcba812f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33810/0 (socket says 172.21.15.18:33810) 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb51d5640 1 -- 172.21.15.18:0/3145781649 learned_addr learned my addr 172.21.15.18:0/3145781649 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcba80a3680 con 0x7fcba809a550 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.149+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcba80a3980 con 0x7fcba80952d0 2024-09-19T10:05:24.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.150+0000 7fcbb59d6640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcba809a550 0x7fcba8129880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.150+0000 7fcbb51d5640 1 -- 172.21.15.18:0/3145781649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcba80952d0 msgr2=0x7fcba812fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.150+0000 7fcbb51d5640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcba80952d0 0x7fcba812fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.150+0000 7fcbb51d5640 1 -- 172.21.15.18:0/3145781649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcba809a550 msgr2=0x7fcba8129880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.150+0000 7fcbb51d5640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcba809a550 0x7fcba8129880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.150+0000 7fcbb51d5640 1 -- 172.21.15.18:0/3145781649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba8129fb0 con 0x7fcba8094930 2024-09-19T10:05:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.150+0000 7fcbb51d5640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcba8094930 0x7fcba812f6c0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0097d0 tx=0x7fcbac009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.150+0000 7fcba67fc640 1 -- 172.21.15.18:0/3145781649 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac005020 con 0x7fcba8094930 2024-09-19T10:05:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.150+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba812a2a0 con 0x7fcba8094930 2024-09-19T10:05:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.151+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba8136590 con 0x7fcba8094930 2024-09-19T10:05:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.152+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba812adb0 con 0x7fcba8094930 2024-09-19T10:05:24.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.153+0000 7fcba67fc640 1 -- 172.21.15.18:0/3145781649 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbac0056a0 con 0x7fcba8094930 2024-09-19T10:05:24.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.153+0000 7fcba67fc640 1 -- 172.21.15.18:0/3145781649 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac004a40 con 0x7fcba8094930 2024-09-19T10:05:24.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.157+0000 7fcba67fc640 1 -- 172.21.15.18:0/3145781649 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcbac01b020 con 0x7fcba8094930 2024-09-19T10:05:24.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.158+0000 7fcba67fc640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb9c0a76e0 0x7fcb9c0a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:24.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.158+0000 7fcba67fc640 1 -- 172.21.15.18:0/3145781649 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcbac0cfce0 con 0x7fcba8094930 2024-09-19T10:05:24.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.159+0000 7fcbb49d4640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb9c0a76e0 0x7fcb9c0a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.159+0000 7fcbb49d4640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb9c0a76e0 0x7fcb9c0a9ba0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcba0005c40 tx=0x7fcba0009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:24.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.163+0000 7fcba67fc640 1 -- 172.21.15.18:0/3145781649 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcbac09c9d0 con 0x7fcba8094930 2024-09-19T10:05:24.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.545+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcba8136c00 con 0x7fcba8094930 2024-09-19T10:05:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.546+0000 7fcba67fc640 1 -- 172.21.15.18:0/3145781649 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7fcbac09c2d0 con 0x7fcba8094930 2024-09-19T10:05:24.549 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:05:24.549 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:05:24.549 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:05:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb9c0a76e0 msgr2=0x7fcb9c0a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb9c0a76e0 0x7fcb9c0a9ba0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcba0005c40 tx=0x7fcba0009560 comp rx=0 tx=0).stop 2024-09-19T10:05:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcba8094930 msgr2=0x7fcba812f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcba8094930 0x7fcba812f6c0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0097d0 tx=0x7fcbac009c90 comp rx=0 tx=0).stop 2024-09-19T10:05:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 shutdown_connections 2024-09-19T10:05:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7fcb9c0a76e0 0x7fcb9c0a9ba0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcba809a550 0x7fcba8129880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcba80952d0 0x7fcba812fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:24.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 --2- 172.21.15.18:0/3145781649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcba8094930 0x7fcba812f6c0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:24.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 >> 172.21.15.18:0/3145781649 conn(0x7fcba800a1f0 msgr2=0x7fcba8093140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:24.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 shutdown_connections 2024-09-19T10:05:24.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:24.549+0000 7fcbb61d7640 1 -- 172.21.15.18:0/3145781649 wait complete. 2024-09-19T10:05:24.875 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:24 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/3145781649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:05:24.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:24 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/3145781649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:05:24.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:24 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/3145781649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:05:25.306 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T10:05:25.564 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:25.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:25 smithi018 ceph-mon[30956]: pgmap v731: 97 pgs: 97 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 88 MiB/s wr, 641 op/s 2024-09-19T10:05:25.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:25 smithi049 ceph-mon[34858]: pgmap v731: 97 pgs: 97 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 88 MiB/s wr, 641 op/s 2024-09-19T10:05:25.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:25 smithi162 ceph-mon[35174]: pgmap v731: 97 pgs: 97 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 88 MiB/s wr, 641 op/s 2024-09-19T10:05:26.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 -- 172.21.15.18:0/1999814010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52c102570 msgr2=0x7ff52c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:26.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 --2- 172.21.15.18:0/1999814010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52c102570 0x7ff52c1029b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7ff520009900 tx=0x7ff52002a480 comp rx=0 tx=0).stop 2024-09-19T10:05:26.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 -- 172.21.15.18:0/1999814010 shutdown_connections 2024-09-19T10:05:26.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 --2- 172.21.15.18:0/1999814010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff52c102ef0 0x7ff52c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:26.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 --2- 172.21.15.18:0/1999814010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52c102570 0x7ff52c1029b0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:26.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 --2- 172.21.15.18:0/1999814010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52c100e20 0x7ff52c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:26.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 -- 172.21.15.18:0/1999814010 >> 172.21.15.18:0/1999814010 conn(0x7ff52c0fc7d0 msgr2=0x7ff52c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:26.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 -- 172.21.15.18:0/1999814010 shutdown_connections 2024-09-19T10:05:26.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 -- 172.21.15.18:0/1999814010 wait complete. 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 Processor -- start 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.068+0000 7ff5316d4640 1 -- start start 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff5316d4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52c100e20 0x7ff52c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff5316d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff52c102570 0x7ff52c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff5316d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52c102ef0 0x7ff52c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff5316d4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c110f50 con 0x7ff52c102ef0 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff5316d4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c110dd0 con 0x7ff52c102570 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff5316d4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c1110d0 con 0x7ff52c100e20 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52c102ef0 0x7ff52c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52c102ef0 0x7ff52c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33836/0 (socket says 172.21.15.18:33836) 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52b7fe640 1 -- 172.21.15.18:0/1670134312 learned_addr learned my addr 172.21.15.18:0/1670134312 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:05:26.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52affd640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52c100e20 0x7ff52c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52a7fc640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff52c102570 0x7ff52c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52b7fe640 1 -- 172.21.15.18:0/1670134312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52c100e20 msgr2=0x7ff52c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52b7fe640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52c100e20 0x7ff52c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52b7fe640 1 -- 172.21.15.18:0/1670134312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff52c102570 msgr2=0x7ff52c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52b7fe640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff52c102570 0x7ff52c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52b7fe640 1 -- 172.21.15.18:0/1670134312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c19d4f0 con 0x7ff52c102ef0 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.069+0000 7ff52a7fc640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff52c102570 0x7ff52c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.070+0000 7ff52b7fe640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52c102ef0 0x7ff52c19ce10 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7ff524009fd0 tx=0x7ff52400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.070+0000 7ff513fff640 1 -- 172.21.15.18:0/1670134312 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524017070 con 0x7ff52c102ef0 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.070+0000 7ff513fff640 1 -- 172.21.15.18:0/1670134312 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff524003e50 con 0x7ff52c102ef0 2024-09-19T10:05:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.070+0000 7ff5316d4640 1 -- 172.21.15.18:0/1670134312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52c19d7e0 con 0x7ff52c102ef0 2024-09-19T10:05:26.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.070+0000 7ff513fff640 1 -- 172.21.15.18:0/1670134312 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5240106c0 con 0x7ff52c102ef0 2024-09-19T10:05:26.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.070+0000 7ff5316d4640 1 -- 172.21.15.18:0/1670134312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff52c0fcbb0 con 0x7ff52c102ef0 2024-09-19T10:05:26.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.071+0000 7ff5316d4640 1 -- 172.21.15.18:0/1670134312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff52c1021b0 con 0x7ff52c102ef0 2024-09-19T10:05:26.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.072+0000 7ff513fff640 1 -- 172.21.15.18:0/1670134312 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff524003970 con 0x7ff52c102ef0 2024-09-19T10:05:26.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.073+0000 7ff513fff640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5140a3240 0x7ff5140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:26.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.073+0000 7ff52affd640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5140a3240 0x7ff5140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:26.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.073+0000 7ff513fff640 1 -- 172.21.15.18:0/1670134312 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff5240cf6a0 con 0x7ff52c102ef0 2024-09-19T10:05:26.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.073+0000 7ff52affd640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5140a3240 0x7ff5140a5700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0095f0 tx=0x7ff51c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:26.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.077+0000 7ff513fff640 1 -- 172.21.15.18:0/1670134312 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff52409c3f0 con 0x7ff52c102ef0 2024-09-19T10:05:26.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.295+0000 7ff5316d4640 1 -- 172.21.15.18:0/1670134312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff52c0fce10 con 0x7ff52c102ef0 2024-09-19T10:05:26.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.296+0000 7ff513fff640 1 -- 172.21.15.18:0/1670134312 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11954 (secure 0 0 0) 0x7ff52409bcf0 con 0x7ff52c102ef0 2024-09-19T10:05:26.298 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:05:26.298 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:52:25:944101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/643561171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":643561171},{"type":"v1","addr":"172.21.15.18:6835","nonce":643561171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/70672754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":70672754},{"type":"v1","addr":"172.21.15.18:6837","nonce":70672754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:50:29.937674+0000","modified":"2024-09-19T09:52:25.114893+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24488,"mds_2":24484,"mds_3":24470,"mds_4":14592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14580":{"gid":14580,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/2438161705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":2438161705},{"type":"v1","addr":"172.21.15.18:6839","nonce":2438161705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14592":{"gid":14592,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.18:6841/1971133018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":1971133018},{"type":"v1","addr":"172.21.15.18:6841","nonce":1971133018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/212444721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":212444721},{"type":"v1","addr":"172.21.15.162:6833","nonce":212444721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6833/94526458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":94526458},{"type":"v1","addr":"172.21.15.49:6833","nonce":94526458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2083709123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2083709123},{"type":"v1","addr":"172.21.15.162:6835","nonce":2083709123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3104050334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3104050334},{"type":"v1","addr":"172.21.15.162:6837","nonce":3104050334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6835/4145133674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4145133674},{"type":"v1","addr":"172.21.15.49:6835","nonce":4145133674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2783930861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2783930861},{"type":"v1","addr":"172.21.15.162:6839","nonce":2783930861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6837/1773266295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":1773266295},{"type":"v1","addr":"172.21.15.49:6837","nonce":1773266295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6839/189898808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":189898808},{"type":"v1","addr":"172.21.15.49:6839","nonce":189898808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[14592,24524,24470,24484,24488]},"id":1}]} 2024-09-19T10:05:26.299 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 -- 172.21.15.18:0/1670134312 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5140a3240 msgr2=0x7ff5140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5140a3240 0x7ff5140a5700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0095f0 tx=0x7ff51c005f90 comp rx=0 tx=0).stop 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 -- 172.21.15.18:0/1670134312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52c102ef0 msgr2=0x7ff52c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52c102ef0 0x7ff52c19ce10 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7ff524009fd0 tx=0x7ff52400b260 comp rx=0 tx=0).stop 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 -- 172.21.15.18:0/1670134312 shutdown_connections 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff5140a3240 0x7ff5140a5700 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52c102ef0 0x7ff52c19ce10 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff52c102570 0x7ff52c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 --2- 172.21.15.18:0/1670134312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52c100e20 0x7ff52c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 -- 172.21.15.18:0/1670134312 >> 172.21.15.18:0/1670134312 conn(0x7ff52c0fc7d0 msgr2=0x7ff52c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 -- 172.21.15.18:0/1670134312 shutdown_connections 2024-09-19T10:05:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:26.298+0000 7ff5316d4640 1 -- 172.21.15.18:0/1670134312 wait complete. 2024-09-19T10:05:26.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:26 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/1670134312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:05:26.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:26 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/1670134312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:05:26.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:26 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/1670134312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T10:05:27.221 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T10:05:27.487 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:27.879 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:27 smithi018 ceph-mon[30956]: pgmap v732: 97 pgs: 97 active+clean; 918 MiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 112 MiB/s wr, 729 op/s 2024-09-19T10:05:27.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:27 smithi049 ceph-mon[34858]: pgmap v732: 97 pgs: 97 active+clean; 918 MiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 112 MiB/s wr, 729 op/s 2024-09-19T10:05:27.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:27 smithi162 ceph-mon[35174]: pgmap v732: 97 pgs: 97 active+clean; 918 MiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 112 MiB/s wr, 729 op/s 2024-09-19T10:05:27.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.958+0000 7feb547af640 1 -- 172.21.15.18:0/2509202866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb4c106a80 msgr2=0x7feb4c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:27.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.958+0000 7feb547af640 1 --2- 172.21.15.18:0/2509202866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb4c106a80 0x7feb4c106e60 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7feb48009930 tx=0x7feb4802a420 comp rx=0 tx=0).stop 2024-09-19T10:05:27.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 -- 172.21.15.18:0/2509202866 shutdown_connections 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 --2- 172.21.15.18:0/2509202866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb4c101420 0x7feb4c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 --2- 172.21.15.18:0/2509202866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb4c100a80 0x7feb4c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 --2- 172.21.15.18:0/2509202866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb4c106a80 0x7feb4c106e60 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 -- 172.21.15.18:0/2509202866 >> 172.21.15.18:0/2509202866 conn(0x7feb4c0fc7a0 msgr2=0x7feb4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 -- 172.21.15.18:0/2509202866 shutdown_connections 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 -- 172.21.15.18:0/2509202866 wait complete. 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 Processor -- start 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 -- start start 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb4c100a80 0x7feb4c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb4c101420 0x7feb4c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb4c106a80 0x7feb4c1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c110ea0 con 0x7feb4c106a80 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c110d20 con 0x7feb4c100a80 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.959+0000 7feb547af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c111020 con 0x7feb4c101420 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb52d4c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb4c106a80 0x7feb4c1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb52d4c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb4c106a80 0x7feb4c1a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45738/0 (socket says 172.21.15.18:45738) 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb52d4c640 1 -- 172.21.15.18:0/2061547715 learned_addr learned my addr 172.21.15.18:0/2061547715 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb5254b640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb4c100a80 0x7feb4c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb51d4a640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb4c101420 0x7feb4c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb52d4c640 1 -- 172.21.15.18:0/2061547715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb4c101420 msgr2=0x7feb4c199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb52d4c640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb4c101420 0x7feb4c199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb52d4c640 1 -- 172.21.15.18:0/2061547715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb4c100a80 msgr2=0x7feb4c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb52d4c640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb4c100a80 0x7feb4c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb52d4c640 1 -- 172.21.15.18:0/2061547715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c1a4910 con 0x7feb4c106a80 2024-09-19T10:05:27.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb51d4a640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb4c101420 0x7feb4c199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T10:05:27.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.960+0000 7feb52d4c640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb4c106a80 0x7feb4c1a43d0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7feb4400eaa0 tx=0x7feb4400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:27.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.961+0000 7feb437fe640 1 -- 172.21.15.18:0/2061547715 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4400cdb0 con 0x7feb4c106a80 2024-09-19T10:05:27.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.961+0000 7feb547af640 1 -- 172.21.15.18:0/2061547715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c1a4ae0 con 0x7feb4c106a80 2024-09-19T10:05:27.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.961+0000 7feb437fe640 1 -- 172.21.15.18:0/2061547715 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb44005020 con 0x7feb4c106a80 2024-09-19T10:05:27.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.961+0000 7feb437fe640 1 -- 172.21.15.18:0/2061547715 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb440116b0 con 0x7feb4c106a80 2024-09-19T10:05:27.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.961+0000 7feb547af640 1 -- 172.21.15.18:0/2061547715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c1a4ff0 con 0x7feb4c106a80 2024-09-19T10:05:27.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.962+0000 7feb547af640 1 -- 172.21.15.18:0/2061547715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4c100ee0 con 0x7feb4c106a80 2024-09-19T10:05:27.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.963+0000 7feb437fe640 1 -- 172.21.15.18:0/2061547715 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7feb44005560 con 0x7feb4c106a80 2024-09-19T10:05:27.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.964+0000 7feb437fe640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feb380a32c0 0x7feb380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:27.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.964+0000 7feb5254b640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feb380a32c0 0x7feb380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:27.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.964+0000 7feb437fe640 1 -- 172.21.15.18:0/2061547715 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7feb440cfad0 con 0x7feb4c106a80 2024-09-19T10:05:27.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.964+0000 7feb5254b640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feb380a32c0 0x7feb380a5780 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feb48009900 tx=0x7feb480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:27.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:27.968+0000 7feb437fe640 1 -- 172.21.15.18:0/2061547715 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feb44016030 con 0x7feb4c106a80 2024-09-19T10:05:28.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.144+0000 7feb547af640 1 -- 172.21.15.18:0/2061547715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb4c108ff0 con 0x7feb4c106a80 2024-09-19T10:05:28.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.145+0000 7feb437fe640 1 -- 172.21.15.18:0/2061547715 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22571 (secure 0 0 0) 0x7feb4409c820 con 0x7feb4c106a80 2024-09-19T10:05:28.148 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T10:05:28.148 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"fsid":"5b174660-766b-11ef-bceb-c7b262605968","created":"2024-09-19T09:42:35.497952+0000","modified":"2024-09-19T09:51:31.811334+0000","last_up_change":"2024-09-19T09:49:40.316078+0000","last_in_change":"2024-09-19T09:49:16.196037+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:45:52.767383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:50:25.894248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:50:28.299795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"703e518f-f9d8-41f1-84cb-2d8dfe53c98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6803","nonce":92239132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6805","nonce":92239132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6809","nonce":92239132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":92239132},{"type":"v1","addr":"172.21.15.18:6807","nonce":92239132}]},"public_addr":"172.21.15.18:6803/92239132","cluster_addr":"172.21.15.18:6805/92239132","heartbeat_back_addr":"172.21.15.18:6809/92239132","heartbeat_front_addr":"172.21.15.18:6807/92239132","state":["exists","up"]},{"osd":1,"uuid":"5783af38-5921-4147-964c-d4a3f4f81ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6801","nonce":368229306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6803","nonce":368229306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6807","nonce":368229306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":368229306},{"type":"v1","addr":"172.21.15.49:6805","nonce":368229306}]},"public_addr":"172.21.15.49:6801/368229306","cluster_addr":"172.21.15.49:6803/368229306","heartbeat_back_addr":"172.21.15.49:6807/368229306","heartbeat_front_addr":"172.21.15.49:6805/368229306","state":["exists","up"]},{"osd":2,"uuid":"ffb5b828-2bfa-4e8b-bab9-a8fe6cd607c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6801","nonce":1401721539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6803","nonce":1401721539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6807","nonce":1401721539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1401721539},{"type":"v1","addr":"172.21.15.162:6805","nonce":1401721539}]},"public_addr":"172.21.15.162:6801/1401721539","cluster_addr":"172.21.15.162:6803/1401721539","heartbeat_back_addr":"172.21.15.162:6807/1401721539","heartbeat_front_addr":"172.21.15.162:6805/1401721539","state":["exists","up"]},{"osd":3,"uuid":"3ff4c7e3-f81b-42f5-827f-fbe5f7c3edfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6811","nonce":2371576209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6813","nonce":2371576209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6817","nonce":2371576209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2371576209},{"type":"v1","addr":"172.21.15.18:6815","nonce":2371576209}]},"public_addr":"172.21.15.18:6811/2371576209","cluster_addr":"172.21.15.18:6813/2371576209","heartbeat_back_addr":"172.21.15.18:6817/2371576209","heartbeat_front_addr":"172.21.15.18:6815/2371576209","state":["exists","up"]},{"osd":4,"uuid":"eb894107-ee7c-4c7c-8d84-173445174dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6809","nonce":3971547728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6811","nonce":3971547728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6815","nonce":3971547728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3971547728},{"type":"v1","addr":"172.21.15.49:6813","nonce":3971547728}]},"public_addr":"172.21.15.49:6809/3971547728","cluster_addr":"172.21.15.49:6811/3971547728","heartbeat_back_addr":"172.21.15.49:6815/3971547728","heartbeat_front_addr":"172.21.15.49:6813/3971547728","state":["exists","up"]},{"osd":5,"uuid":"2654f083-56fe-4de5-bc96-e47e8ef9dca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6809","nonce":2223869485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6811","nonce":2223869485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6815","nonce":2223869485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2223869485},{"type":"v1","addr":"172.21.15.162:6813","nonce":2223869485}]},"public_addr":"172.21.15.162:6809/2223869485","cluster_addr":"172.21.15.162:6811/2223869485","heartbeat_back_addr":"172.21.15.162:6815/2223869485","heartbeat_front_addr":"172.21.15.162:6813/2223869485","state":["exists","up"]},{"osd":6,"uuid":"9d62113a-1d28-4c49-a893-1ade15236dc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6819","nonce":1979863681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6821","nonce":1979863681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6825","nonce":1979863681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1979863681},{"type":"v1","addr":"172.21.15.18:6823","nonce":1979863681}]},"public_addr":"172.21.15.18:6819/1979863681","cluster_addr":"172.21.15.18:6821/1979863681","heartbeat_back_addr":"172.21.15.18:6825/1979863681","heartbeat_front_addr":"172.21.15.18:6823/1979863681","state":["exists","up"]},{"osd":7,"uuid":"8ec6cadf-ad0b-4ae7-bafc-40c901da2173","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6817","nonce":3068141986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6819","nonce":3068141986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6823","nonce":3068141986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3068141986},{"type":"v1","addr":"172.21.15.49:6821","nonce":3068141986}]},"public_addr":"172.21.15.49:6817/3068141986","cluster_addr":"172.21.15.49:6819/3068141986","heartbeat_back_addr":"172.21.15.49:6823/3068141986","heartbeat_front_addr":"172.21.15.49:6821/3068141986","state":["exists","up"]},{"osd":8,"uuid":"c9eed0ed-9719-4772-be83-f6849ab08bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6817","nonce":2887612683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6819","nonce":2887612683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6823","nonce":2887612683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2887612683},{"type":"v1","addr":"172.21.15.162:6821","nonce":2887612683}]},"public_addr":"172.21.15.162:6817/2887612683","cluster_addr":"172.21.15.162:6819/2887612683","heartbeat_back_addr":"172.21.15.162:6823/2887612683","heartbeat_front_addr":"172.21.15.162:6821/2887612683","state":["exists","up"]},{"osd":9,"uuid":"1ba61d77-2981-4ff0-8253-e8a4aacf19b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6827","nonce":3527304690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6829","nonce":3527304690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6833","nonce":3527304690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3527304690},{"type":"v1","addr":"172.21.15.18:6831","nonce":3527304690}]},"public_addr":"172.21.15.18:6827/3527304690","cluster_addr":"172.21.15.18:6829/3527304690","heartbeat_back_addr":"172.21.15.18:6833/3527304690","heartbeat_front_addr":"172.21.15.18:6831/3527304690","state":["exists","up"]},{"osd":10,"uuid":"da1f71af-43ea-4fa2-b5bb-f502936f4e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6825","nonce":2226510047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6827","nonce":2226510047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6831","nonce":2226510047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2226510047},{"type":"v1","addr":"172.21.15.49:6829","nonce":2226510047}]},"public_addr":"172.21.15.49:6825/2226510047","cluster_addr":"172.21.15.49:6827/2226510047","heartbeat_back_addr":"172.21.15.49:6831/2226510047","heartbeat_front_addr":"172.21.15.49:6829/2226510047","state":["exists","up"]},{"osd":11,"uuid":"1202ee7d-aee9-4ee8-97cc-5ca3eaa99367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6825","nonce":3607280204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6827","nonce":3607280204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6831","nonce":3607280204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3607280204},{"type":"v1","addr":"172.21.15.162:6829","nonce":3607280204}]},"public_addr":"172.21.15.162:6825/3607280204","cluster_addr":"172.21.15.162:6827/3607280204","heartbeat_back_addr":"172.21.15.162:6831/3607280204","heartbeat_front_addr":"172.21.15.162:6829/3607280204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:44:58.316121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:23.825313+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:45:49.899192+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:15.505458+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:46:41.759476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:06.683339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:31.916525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:47:57.761199+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:22.839091+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:48:48.048802+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:12.791722+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:49:38.488302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3655731262":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/3886965559":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:0/1191027709":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/288316346":"2024-09-20T09:43:06.466314+0000","172.21.15.18:6801/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/446921657":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6801/809218832":"2024-09-20T09:43:30.259608+0000","172.21.15.18:6800/2865418420":"2024-09-20T09:43:06.466314+0000","172.21.15.18:0/633086506":"2024-09-20T09:43:06.466314+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T10:05:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 -- 172.21.15.18:0/2061547715 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feb380a32c0 msgr2=0x7feb380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feb380a32c0 0x7feb380a5780 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feb48009900 tx=0x7feb480058d0 comp rx=0 tx=0).stop 2024-09-19T10:05:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 -- 172.21.15.18:0/2061547715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb4c106a80 msgr2=0x7feb4c1a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb4c106a80 0x7feb4c1a43d0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7feb4400eaa0 tx=0x7feb4400ef60 comp rx=0 tx=0).stop 2024-09-19T10:05:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 -- 172.21.15.18:0/2061547715 shutdown_connections 2024-09-19T10:05:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7feb380a32c0 0x7feb380a5780 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb4c106a80 0x7feb4c1a43d0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb4c101420 0x7feb4c199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 --2- 172.21.15.18:0/2061547715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb4c100a80 0x7feb4c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:28.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 -- 172.21.15.18:0/2061547715 >> 172.21.15.18:0/2061547715 conn(0x7feb4c0fc7a0 msgr2=0x7feb4c0fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:28.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.147+0000 7feb547af640 1 -- 172.21.15.18:0/2061547715 shutdown_connections 2024-09-19T10:05:28.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:28.148+0000 7feb547af640 1 -- 172.21.15.18:0/2061547715 wait complete. 2024-09-19T10:05:28.733 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:28 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2061547715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T10:05:28.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T10:05:28.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:28 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2061547715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T10:05:28.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:28 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2061547715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T10:05:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:29.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.493+0000 7f6b68719640 1 -- 172.21.15.18:0/4060338082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b60102d90 msgr2=0x7f6b60103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.493+0000 7f6b68719640 1 --2- 172.21.15.18:0/4060338082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b60102d90 0x7f6b60103170 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009930 tx=0x7f6b5c02a420 comp rx=0 tx=0).stop 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.493+0000 7f6b68719640 1 -- 172.21.15.18:0/4060338082 shutdown_connections 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.493+0000 7f6b68719640 1 --2- 172.21.15.18:0/4060338082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b60108290 0x7f6b6010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.493+0000 7f6b68719640 1 --2- 172.21.15.18:0/4060338082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b60103740 0x7f6b60107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.493+0000 7f6b68719640 1 --2- 172.21.15.18:0/4060338082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b60102d90 0x7f6b60103170 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.493+0000 7f6b68719640 1 -- 172.21.15.18:0/4060338082 >> 172.21.15.18:0/4060338082 conn(0x7f6b600fc7d0 msgr2=0x7f6b600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.493+0000 7f6b68719640 1 -- 172.21.15.18:0/4060338082 shutdown_connections 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.493+0000 7f6b68719640 1 -- 172.21.15.18:0/4060338082 wait complete. 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b68719640 1 Processor -- start 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b68719640 1 -- start start 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b68719640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b60102d90 0x7f6b60198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b68719640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b60103740 0x7f6b60198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b68719640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b60108290 0x7f6b6019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b68719640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6b60112090 con 0x7f6b60108290 2024-09-19T10:05:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b68719640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6b60111f10 con 0x7f6b60102d90 2024-09-19T10:05:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b68719640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6b60112210 con 0x7f6b60103740 2024-09-19T10:05:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b66cb6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b60108290 0x7f6b6019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b66cb6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b60108290 0x7f6b6019cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45768/0 (socket says 172.21.15.18:45768) 2024-09-19T10:05:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b66cb6640 1 -- 172.21.15.18:0/866632667 learned_addr learned my addr 172.21.15.18:0/866632667 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:05:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b664b5640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b60102d90 0x7f6b60198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b65cb4640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b60103740 0x7f6b60198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.494+0000 7f6b66cb6640 1 -- 172.21.15.18:0/866632667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b60103740 msgr2=0x7f6b60198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b66cb6640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b60103740 0x7f6b60198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b66cb6640 1 -- 172.21.15.18:0/866632667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b60102d90 msgr2=0x7f6b60198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b66cb6640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b60102d90 0x7f6b60198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b66cb6640 1 -- 172.21.15.18:0/866632667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6019d600 con 0x7f6b60108290 2024-09-19T10:05:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b65cb4640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b60103740 0x7f6b60198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T10:05:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b66cb6640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b60108290 0x7f6b6019cf20 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800eaa0 tx=0x7f6b5800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b577fe640 1 -- 172.21.15.18:0/866632667 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5800cdb0 con 0x7f6b60108290 2024-09-19T10:05:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b68719640 1 -- 172.21.15.18:0/866632667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6019d8f0 con 0x7f6b60108290 2024-09-19T10:05:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b577fe640 1 -- 172.21.15.18:0/866632667 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b58005020 con 0x7f6b60108290 2024-09-19T10:05:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b577fe640 1 -- 172.21.15.18:0/866632667 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b580116b0 con 0x7f6b60108290 2024-09-19T10:05:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.495+0000 7f6b68719640 1 -- 172.21.15.18:0/866632667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b601a51d0 con 0x7f6b60108290 2024-09-19T10:05:29.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.496+0000 7f6b68719640 1 -- 172.21.15.18:0/866632667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6006a7f0 con 0x7f6b60108290 2024-09-19T10:05:29.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.497+0000 7f6b577fe640 1 -- 172.21.15.18:0/866632667 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6b58005560 con 0x7f6b60108290 2024-09-19T10:05:29.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.498+0000 7f6b577fe640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6b4c0a3240 0x7f6b4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:29.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.498+0000 7f6b664b5640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6b4c0a3240 0x7f6b4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.498+0000 7f6b577fe640 1 -- 172.21.15.18:0/866632667 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6b580cfad0 con 0x7f6b60108290 2024-09-19T10:05:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.498+0000 7f6b664b5640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6b4c0a3240 0x7f6b4c0a5700 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009900 tx=0x7f6b5c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.502+0000 7f6b577fe640 1 -- 172.21.15.18:0/866632667 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b58016030 con 0x7f6b60108290 2024-09-19T10:05:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.714+0000 7f6b68719640 1 -- 172.21.15.18:0/866632667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6b6010a2a0 con 0x7f6b60108290 2024-09-19T10:05:29.716 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:29 smithi018 ceph-mon[30956]: pgmap v733: 97 pgs: 97 active+clean; 62 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 99 MiB/s wr, 637 op/s 2024-09-19T10:05:29.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.716+0000 7f6b577fe640 1 -- 172.21.15.18:0/866632667 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f6b5809c820 con 0x7f6b60108290 2024-09-19T10:05:29.718 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T10:05:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.720+0000 7f6b68719640 1 -- 172.21.15.18:0/866632667 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6b4c0a3240 msgr2=0x7f6b4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.720+0000 7f6b68719640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6b4c0a3240 0x7f6b4c0a5700 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009900 tx=0x7f6b5c0058d0 comp rx=0 tx=0).stop 2024-09-19T10:05:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.720+0000 7f6b68719640 1 -- 172.21.15.18:0/866632667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b60108290 msgr2=0x7f6b6019cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.720+0000 7f6b68719640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b60108290 0x7f6b6019cf20 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800eaa0 tx=0x7f6b5800ef60 comp rx=0 tx=0).stop 2024-09-19T10:05:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.721+0000 7f6b68719640 1 -- 172.21.15.18:0/866632667 shutdown_connections 2024-09-19T10:05:29.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.721+0000 7f6b68719640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f6b4c0a3240 0x7f6b4c0a5700 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:29.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.721+0000 7f6b68719640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b60108290 0x7f6b6019cf20 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:29.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.721+0000 7f6b68719640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b60103740 0x7f6b60198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:29.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.721+0000 7f6b68719640 1 --2- 172.21.15.18:0/866632667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b60102d90 0x7f6b60198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:29.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.721+0000 7f6b68719640 1 -- 172.21.15.18:0/866632667 >> 172.21.15.18:0/866632667 conn(0x7f6b600fc7d0 msgr2=0x7f6b60105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:29.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.721+0000 7f6b68719640 1 -- 172.21.15.18:0/866632667 shutdown_connections 2024-09-19T10:05:29.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:29.721+0000 7f6b68719640 1 -- 172.21.15.18:0/866632667 wait complete. 2024-09-19T10:05:29.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-mon[34858]: pgmap v733: 97 pgs: 97 active+clean; 62 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 99 MiB/s wr, 637 op/s 2024-09-19T10:05:29.901 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e[64849]: ignoring --setuser ceph since I am not root 2024-09-19T10:05:29.901 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e[64849]: ignoring --setgroup ceph since I am not root 2024-09-19T10:05:29.901 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-mds[64853]: -- 172.21.15.49:0/2714442177 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5574f5761860 con 0x5574f573f400 2024-09-19T10:05:29.902 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e[64849]: starting mds.e at 2024-09-19T10:05:29.902 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k[64538]: ignoring --setuser ceph since I am not root 2024-09-19T10:05:29.902 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k[64538]: ignoring --setgroup ceph since I am not root 2024-09-19T10:05:29.902 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-mds[64542]: -- 172.21.15.49:0/658333214 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557926f41860 con 0x557926f1e800 2024-09-19T10:05:29.902 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k[64538]: starting mds.k at 2024-09-19T10:05:29.902 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h[65151]: ignoring --setuser ceph since I am not root 2024-09-19T10:05:29.902 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h[65151]: ignoring --setgroup ceph since I am not root 2024-09-19T10:05:29.903 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-mds[65155]: -- 172.21.15.49:0/2281403742 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649b8217860 con 0x5649b81f5400 2024-09-19T10:05:29.903 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h[65151]: starting mds.h at 2024-09-19T10:05:29.903 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b[65464]: ignoring --setuser ceph since I am not root 2024-09-19T10:05:29.903 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b[65464]: ignoring --setgroup ceph since I am not root 2024-09-19T10:05:29.903 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-mds[65468]: -- 172.21.15.49:0/3664573923 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558756059c20 con 0x558756036800 2024-09-19T10:05:29.903 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 10:05:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b[65464]: starting mds.b at 2024-09-19T10:05:29.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-mon[35174]: pgmap v733: 97 pgs: 97 active+clean; 62 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 99 MiB/s wr, 637 op/s 2024-09-19T10:05:29.913 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i[65501]: ignoring --setuser ceph since I am not root 2024-09-19T10:05:29.913 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i[65501]: ignoring --setgroup ceph since I am not root 2024-09-19T10:05:29.914 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-mds[65505]: -- 172.21.15.162:0/281512512 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5573ff2b5c20 con 0x5573ff293000 2024-09-19T10:05:29.914 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i[65501]: starting mds.i at 2024-09-19T10:05:29.914 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c[65198]: ignoring --setuser ceph since I am not root 2024-09-19T10:05:29.914 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c[65198]: ignoring --setgroup ceph since I am not root 2024-09-19T10:05:29.914 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-mds[65202]: -- 172.21.15.162:0/3103921010 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55601074b860 con 0x556010728800 2024-09-19T10:05:29.914 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c[65198]: starting mds.c at 2024-09-19T10:05:29.915 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f[64898]: ignoring --setuser ceph since I am not root 2024-09-19T10:05:29.915 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f[64898]: ignoring --setgroup ceph since I am not root 2024-09-19T10:05:29.915 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-mds[64902]: -- 172.21.15.162:0/2143071267 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4a5711860 con 0x55a4a56ee800 2024-09-19T10:05:29.915 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f[64898]: starting mds.f at 2024-09-19T10:05:29.915 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l[64599]: ignoring --setuser ceph since I am not root 2024-09-19T10:05:29.915 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l[64599]: ignoring --setgroup ceph since I am not root 2024-09-19T10:05:29.915 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-mds[64603]: -- 172.21.15.162:0/2547395995 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ecc0cc5860 con 0x55ecc0ca3000 2024-09-19T10:05:29.915 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 10:05:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l[64599]: starting mds.l at 2024-09-19T10:05:30.023 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T10:05:29.714+0000 7f15e23b6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T10:05:30.024 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:05:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a[71815]: ignoring --setuser ceph since I am not root 2024-09-19T10:05:30.024 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:05:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a[71815]: ignoring --setgroup ceph since I am not root 2024-09-19T10:05:30.024 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:05:29 smithi018 ceph-mds[71819]: -- 172.21.15.18:0/253396507 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635d8451860 con 0x5635d842f400 2024-09-19T10:05:30.024 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:05:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a[71815]: starting mds.a at 2024-09-19T10:05:30.024 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:05:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g[71433]: ignoring --setuser ceph since I am not root 2024-09-19T10:05:30.024 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:05:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g[71433]: ignoring --setgroup ceph since I am not root 2024-09-19T10:05:30.024 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:05:29 smithi018 ceph-mds[71442]: -- 172.21.15.18:0/2476331477 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a56d57b860 con 0x55a56d558800 2024-09-19T10:05:30.024 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:05:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g[71433]: starting mds.g at 2024-09-19T10:05:30.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T10:05:30.607 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:30.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:30 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/866632667' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T10:05:30.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:30 smithi018 ceph-mon[30956]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T10:05:30.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:30 smithi018 ceph-mon[30956]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T10:05:30.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:30 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/866632667' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T10:05:30.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:30 smithi018 ceph-mon[30956]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T10:05:30.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:30 smithi018 ceph-mon[30956]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T10:05:30.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:30 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/866632667' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T10:05:30.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:30 smithi049 ceph-mon[34858]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T10:05:30.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:30 smithi049 ceph-mon[34858]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T10:05:30.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:30 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/866632667' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T10:05:30.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:30 smithi049 ceph-mon[34858]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T10:05:30.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:30 smithi049 ceph-mon[34858]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T10:05:30.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:30 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/866632667' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T10:05:30.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:30 smithi162 ceph-mon[35174]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T10:05:30.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:30 smithi162 ceph-mon[35174]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T10:05:30.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:30 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/866632667' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T10:05:30.913 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:30 smithi162 ceph-mon[35174]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T10:05:30.914 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:30 smithi162 ceph-mon[35174]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T10:05:31.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.040+0000 7faadb488640 1 -- 172.21.15.18:0/962227852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad4101df0 msgr2=0x7faad41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:31.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.040+0000 7faadb488640 1 --2- 172.21.15.18:0/962227852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad4101df0 0x7faad41021d0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7faacc009900 tx=0x7faacc02a3f0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.041+0000 7faadb488640 1 -- 172.21.15.18:0/962227852 shutdown_connections 2024-09-19T10:05:31.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.041+0000 7faadb488640 1 --2- 172.21.15.18:0/962227852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad4106f20 0x7faad410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.041+0000 7faadb488640 1 --2- 172.21.15.18:0/962227852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad41027a0 0x7faad41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.041+0000 7faadb488640 1 --2- 172.21.15.18:0/962227852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad4101df0 0x7faad41021d0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.041+0000 7faadb488640 1 -- 172.21.15.18:0/962227852 >> 172.21.15.18:0/962227852 conn(0x7faad40fd8f0 msgr2=0x7faad40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:31.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.041+0000 7faadb488640 1 -- 172.21.15.18:0/962227852 shutdown_connections 2024-09-19T10:05:31.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.041+0000 7faadb488640 1 -- 172.21.15.18:0/962227852 wait complete. 2024-09-19T10:05:31.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.041+0000 7faadb488640 1 Processor -- start 2024-09-19T10:05:31.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.041+0000 7faadb488640 1 -- start start 2024-09-19T10:05:31.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faadb488640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad4101df0 0x7faad40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:31.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faadb488640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad41027a0 0x7faad4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:31.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faadb488640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad4106f20 0x7faad4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:31.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faadb488640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faad4111fa0 con 0x7faad4106f20 2024-09-19T10:05:31.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faadb488640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faad4111e20 con 0x7faad4101df0 2024-09-19T10:05:31.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faadb488640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faad4112120 con 0x7faad41027a0 2024-09-19T10:05:31.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad9a25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad4106f20 0x7faad4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:31.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad9a25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad4106f20 0x7faad4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45808/0 (socket says 172.21.15.18:45808) 2024-09-19T10:05:31.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad9a25640 1 -- 172.21.15.18:0/2015023406 learned_addr learned my addr 172.21.15.18:0/2015023406 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad9224640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad4101df0 0x7faad40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad8a23640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad41027a0 0x7faad4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad9a25640 1 -- 172.21.15.18:0/2015023406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad41027a0 msgr2=0x7faad4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad9a25640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad41027a0 0x7faad4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad9a25640 1 -- 172.21.15.18:0/2015023406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad4101df0 msgr2=0x7faad40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad9a25640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad4101df0 0x7faad40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad9a25640 1 -- 172.21.15.18:0/2015023406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad41a6900 con 0x7faad4106f20 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad9a25640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad4106f20 0x7faad4074f70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7faac400b970 tx=0x7faac400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad27fc640 1 -- 172.21.15.18:0/2015023406 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4019070 con 0x7faad4106f20 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad27fc640 1 -- 172.21.15.18:0/2015023406 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faac400cb40 con 0x7faad4106f20 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faad27fc640 1 -- 172.21.15.18:0/2015023406 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4007650 con 0x7faad4106f20 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.042+0000 7faadb488640 1 -- 172.21.15.18:0/2015023406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad41a6bf0 con 0x7faad4106f20 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.043+0000 7faadb488640 1 -- 172.21.15.18:0/2015023406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad41a70e0 con 0x7faad4106f20 2024-09-19T10:05:31.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.043+0000 7faadb488640 1 -- 172.21.15.18:0/2015023406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad41021d0 con 0x7faad4106f20 2024-09-19T10:05:31.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.045+0000 7faad27fc640 1 -- 172.21.15.18:0/2015023406 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faac401c070 con 0x7faad4106f20 2024-09-19T10:05:31.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.045+0000 7faad27fc640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faabc0a3240 0x7faabc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:31.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.045+0000 7faad9224640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faabc0a3240 0x7faabc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:31.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.046+0000 7faad27fc640 1 -- 172.21.15.18:0/2015023406 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8612+0+0 (secure 0 0 0) 0x7faac40cf4f0 con 0x7faad4106f20 2024-09-19T10:05:31.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.046+0000 7faad9224640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faabc0a3240 0x7faabc0a5700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faacc000c00 tx=0x7faacc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:31.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.049+0000 7faad27fc640 1 -- 172.21.15.18:0/2015023406 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faac409ba40 con 0x7faad4106f20 2024-09-19T10:05:31.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.264+0000 7faadb488640 1 -- 172.21.15.18:0/2015023406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7faad402d7c0 con 0x7faad4106f20 2024-09-19T10:05:31.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.723+0000 7faad27fc640 1 -- 172.21.15.18:0/2015023406 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7faac409fd40 con 0x7faad4106f20 2024-09-19T10:05:31.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 -- 172.21.15.18:0/2015023406 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faabc0a3240 msgr2=0x7faabc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:31.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faabc0a3240 0x7faabc0a5700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faacc000c00 tx=0x7faacc0058d0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 -- 172.21.15.18:0/2015023406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad4106f20 msgr2=0x7faad4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:31.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad4106f20 0x7faad4074f70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7faac400b970 tx=0x7faac400be30 comp rx=0 tx=0).stop 2024-09-19T10:05:31.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 -- 172.21.15.18:0/2015023406 shutdown_connections 2024-09-19T10:05:31.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7faabc0a3240 0x7faabc0a5700 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad4106f20 0x7faad4074f70 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad41027a0 0x7faad4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 --2- 172.21.15.18:0/2015023406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad4101df0 0x7faad40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:31.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 -- 172.21.15.18:0/2015023406 >> 172.21.15.18:0/2015023406 conn(0x7faad40fd8f0 msgr2=0x7faad40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:31.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 -- 172.21.15.18:0/2015023406 shutdown_connections 2024-09-19T10:05:31.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:31.726+0000 7faadb488640 1 -- 172.21.15.18:0/2015023406 wait complete. 2024-09-19T10:05:32.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6834/1140840505,v1:172.21.15.162:6838/1140840505] up:boot 2024-09-19T10:05:32.167 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6832/1931051287,v1:172.21.15.162:6835/1931051287] up:boot 2024-09-19T10:05:32.167 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6833/485830425,v1:172.21.15.162:6836/485830425] up:boot 2024-09-19T10:05:32.167 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6832/3001736720,v1:172.21.15.49:6835/3001736720] up:boot 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.162:6837/1110945718,v1:172.21.15.162:6839/1110945718] up:boot 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6834/2152286205,v1:172.21.15.49:6837/2152286205] up:boot 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6833/3693904971,v1:172.21.15.49:6836/3693904971] up:boot 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6838/3825095860,v1:172.21.15.18:6840/3825095860] up:boot 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.18:6839/2638460622,v1:172.21.15.18:6841/2638460622] up:boot 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: mds.? [v2:172.21.15.49:6838/991819730,v1:172.21.15.49:6839/991819730] up:boot 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T10:05:32.168 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T10:05:32.169 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T10:05:32.169 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T10:05:32.169 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T10:05:32.169 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T10:05:32.169 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T10:05:32.169 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: pgmap v735: 97 pgs: 97 active+clean; 9.6 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 116 MiB/s wr, 717 op/s 2024-09-19T10:05:32.169 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:31 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2015023406' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T10:05:32.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.162:6834/1140840505,v1:172.21.15.162:6838/1140840505] up:boot 2024-09-19T10:05:32.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.162:6832/1931051287,v1:172.21.15.162:6835/1931051287] up:boot 2024-09-19T10:05:32.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.162:6833/485830425,v1:172.21.15.162:6836/485830425] up:boot 2024-09-19T10:05:32.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6832/3001736720,v1:172.21.15.49:6835/3001736720] up:boot 2024-09-19T10:05:32.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.162:6837/1110945718,v1:172.21.15.162:6839/1110945718] up:boot 2024-09-19T10:05:32.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6834/2152286205,v1:172.21.15.49:6837/2152286205] up:boot 2024-09-19T10:05:32.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6833/3693904971,v1:172.21.15.49:6836/3693904971] up:boot 2024-09-19T10:05:32.170 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.18:6838/3825095860,v1:172.21.15.18:6840/3825095860] up:boot 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.18:6839/2638460622,v1:172.21.15.18:6841/2638460622] up:boot 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: mds.? [v2:172.21.15.49:6838/991819730,v1:172.21.15.49:6839/991819730] up:boot 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T10:05:32.171 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: pgmap v735: 97 pgs: 97 active+clean; 9.6 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 116 MiB/s wr, 717 op/s 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:31 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2015023406' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.162:6834/1140840505,v1:172.21.15.162:6838/1140840505] up:boot 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.162:6832/1931051287,v1:172.21.15.162:6835/1931051287] up:boot 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.162:6833/485830425,v1:172.21.15.162:6836/485830425] up:boot 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6832/3001736720,v1:172.21.15.49:6835/3001736720] up:boot 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.162:6837/1110945718,v1:172.21.15.162:6839/1110945718] up:boot 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6834/2152286205,v1:172.21.15.49:6837/2152286205] up:boot 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6833/3693904971,v1:172.21.15.49:6836/3693904971] up:boot 2024-09-19T10:05:32.172 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.18:6838/3825095860,v1:172.21.15.18:6840/3825095860] up:boot 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.18:6839/2638460622,v1:172.21.15.18:6841/2638460622] up:boot 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: mds.? [v2:172.21.15.49:6838/991819730,v1:172.21.15.49:6839/991819730] up:boot 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T10:05:32.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T10:05:32.174 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T10:05:32.174 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='mgr.14150 172.21.15.18:0/3844876752' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T10:05:32.174 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: pgmap v735: 97 pgs: 97 active+clean; 9.6 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 116 MiB/s wr, 717 op/s 2024-09-19T10:05:32.174 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:31 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2015023406' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T10:05:32.584 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T10:05:32.849 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:32.885 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:32 smithi018 ceph-mon[30956]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T10:05:32.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:32 smithi018 ceph-mon[30956]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T10:05:32.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:32 smithi018 ceph-mon[30956]: Cluster is now healthy 2024-09-19T10:05:32.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:32 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/2015023406' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T10:05:32.886 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:32 smithi018 ceph-mon[30956]: fsmap 12 up:standby 2024-09-19T10:05:33.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:32 smithi049 ceph-mon[34858]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T10:05:33.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:32 smithi049 ceph-mon[34858]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T10:05:33.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:32 smithi049 ceph-mon[34858]: Cluster is now healthy 2024-09-19T10:05:33.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:32 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/2015023406' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T10:05:33.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:32 smithi049 ceph-mon[34858]: fsmap 12 up:standby 2024-09-19T10:05:33.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:32 smithi162 ceph-mon[35174]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T10:05:33.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:32 smithi162 ceph-mon[35174]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T10:05:33.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:32 smithi162 ceph-mon[35174]: Cluster is now healthy 2024-09-19T10:05:33.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:32 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/2015023406' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T10:05:33.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:32 smithi162 ceph-mon[35174]: fsmap 12 up:standby 2024-09-19T10:05:33.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.294+0000 7ff6aab1f640 1 -- 172.21.15.18:0/3170360846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a4102790 msgr2=0x7ff6a41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:33.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.294+0000 7ff6aab1f640 1 --2- 172.21.15.18:0/3170360846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a4102790 0x7ff6a41067e0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7ff698009900 tx=0x7ff69802a410 comp rx=0 tx=0).stop 2024-09-19T10:05:33.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 -- 172.21.15.18:0/3170360846 shutdown_connections 2024-09-19T10:05:33.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 --2- 172.21.15.18:0/3170360846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6a4106f10 0x7ff6a410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 --2- 172.21.15.18:0/3170360846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a4102790 0x7ff6a41067e0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 --2- 172.21.15.18:0/3170360846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a4101de0 0x7ff6a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 -- 172.21.15.18:0/3170360846 >> 172.21.15.18:0/3170360846 conn(0x7ff6a40fd8c0 msgr2=0x7ff6a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:33.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 -- 172.21.15.18:0/3170360846 shutdown_connections 2024-09-19T10:05:33.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 -- 172.21.15.18:0/3170360846 wait complete. 2024-09-19T10:05:33.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 Processor -- start 2024-09-19T10:05:33.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 -- start start 2024-09-19T10:05:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6a4101de0 0x7ff6a40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a4102790 0x7ff6a4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a4106f10 0x7ff6a4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a4111f90 con 0x7ff6a4102790 2024-09-19T10:05:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a4111e10 con 0x7ff6a4106f10 2024-09-19T10:05:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.295+0000 7ff6aab1f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a4112110 con 0x7ff6a4101de0 2024-09-19T10:05:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a4102790 0x7ff6a4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:33.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a4102790 0x7ff6a4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45828/0 (socket says 172.21.15.18:45828) 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a3fff640 1 -- 172.21.15.18:0/4209701243 learned_addr learned my addr 172.21.15.18:0/4209701243 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a90bc640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a4106f10 0x7ff6a4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a88bb640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6a4101de0 0x7ff6a40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a3fff640 1 -- 172.21.15.18:0/4209701243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6a4101de0 msgr2=0x7ff6a40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a3fff640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6a4101de0 0x7ff6a40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a3fff640 1 -- 172.21.15.18:0/4209701243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a4106f10 msgr2=0x7ff6a4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a3fff640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a4106f10 0x7ff6a4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a3fff640 1 -- 172.21.15.18:0/4209701243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a41a6930 con 0x7ff6a4102790 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a90bc640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a4106f10 0x7ff6a4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.296+0000 7ff6a3fff640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a4102790 0x7ff6a4074a30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7ff698005ab0 tx=0x7ff6980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:33.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.297+0000 7ff6a1ffb640 1 -- 172.21.15.18:0/4209701243 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69803f030 con 0x7ff6a4102790 2024-09-19T10:05:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.297+0000 7ff6a1ffb640 1 -- 172.21.15.18:0/4209701243 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff698003ce0 con 0x7ff6a4102790 2024-09-19T10:05:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.297+0000 7ff6aab1f640 1 -- 172.21.15.18:0/4209701243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a41a6bc0 con 0x7ff6a4102790 2024-09-19T10:05:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.297+0000 7ff6a1ffb640 1 -- 172.21.15.18:0/4209701243 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698035070 con 0x7ff6a4102790 2024-09-19T10:05:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.297+0000 7ff6aab1f640 1 -- 172.21.15.18:0/4209701243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a41a70a0 con 0x7ff6a4102790 2024-09-19T10:05:33.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.298+0000 7ff6aab1f640 1 -- 172.21.15.18:0/4209701243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a41021c0 con 0x7ff6a4102790 2024-09-19T10:05:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.299+0000 7ff6a1ffb640 1 -- 172.21.15.18:0/4209701243 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff698042030 con 0x7ff6a4102790 2024-09-19T10:05:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.300+0000 7ff6a1ffb640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff68c0a3240 0x7ff68c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.300+0000 7ff6a88bb640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff68c0a3240 0x7ff68c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.300+0000 7ff6a1ffb640 1 -- 172.21.15.18:0/4209701243 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8612+0+0 (secure 0 0 0) 0x7ff6980f0350 con 0x7ff6a4102790 2024-09-19T10:05:33.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.301+0000 7ff6a88bb640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff68c0a3240 0x7ff68c0a5700 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff6940058c0 tx=0x7ff69400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:33.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.304+0000 7ff6a1ffb640 1 -- 172.21.15.18:0/4209701243 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff6980bc840 con 0x7ff6a4102790 2024-09-19T10:05:33.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.482+0000 7ff6aab1f640 1 -- 172.21.15.18:0/4209701243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff6a410a0f0 con 0x7ff6a4102790 2024-09-19T10:05:33.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.729+0000 7ff6a1ffb640 1 -- 172.21.15.18:0/4209701243 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) ==== 181+0+0 (secure 0 0 0) 0x7ff6980c0b40 con 0x7ff6a4102790 2024-09-19T10:05:33.733 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T10:05:33.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.732+0000 7ff6aab1f640 1 -- 172.21.15.18:0/4209701243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff68c0a3240 msgr2=0x7ff68c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.732+0000 7ff6aab1f640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff68c0a3240 0x7ff68c0a5700 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff6940058c0 tx=0x7ff69400a2d0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.732+0000 7ff6aab1f640 1 -- 172.21.15.18:0/4209701243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a4102790 msgr2=0x7ff6a4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.732+0000 7ff6aab1f640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a4102790 0x7ff6a4074a30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7ff698005ab0 tx=0x7ff6980042f0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.733+0000 7ff6aab1f640 1 -- 172.21.15.18:0/4209701243 shutdown_connections 2024-09-19T10:05:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.733+0000 7ff6aab1f640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7ff68c0a3240 0x7ff68c0a5700 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.733+0000 7ff6aab1f640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6a4106f10 0x7ff6a4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.733+0000 7ff6aab1f640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a4102790 0x7ff6a4074a30 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.733+0000 7ff6aab1f640 1 --2- 172.21.15.18:0/4209701243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6a4101de0 0x7ff6a40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.733+0000 7ff6aab1f640 1 -- 172.21.15.18:0/4209701243 >> 172.21.15.18:0/4209701243 conn(0x7ff6a40fd8c0 msgr2=0x7ff6a40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.733+0000 7ff6aab1f640 1 -- 172.21.15.18:0/4209701243 shutdown_connections 2024-09-19T10:05:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:33.733+0000 7ff6aab1f640 1 -- 172.21.15.18:0/4209701243 wait complete. 2024-09-19T10:05:34.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:33 smithi018 ceph-mon[30956]: pgmap v736: 97 pgs: 97 active+clean; 9.6 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 112 MiB/s wr, 649 op/s 2024-09-19T10:05:34.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:33 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4209701243' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T10:05:34.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:33 smithi049 ceph-mon[34858]: pgmap v736: 97 pgs: 97 active+clean; 9.6 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 112 MiB/s wr, 649 op/s 2024-09-19T10:05:34.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:33 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/4209701243' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T10:05:34.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:33 smithi162 ceph-mon[35174]: pgmap v736: 97 pgs: 97 active+clean; 9.6 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 112 MiB/s wr, 649 op/s 2024-09-19T10:05:34.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:33 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/4209701243' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T10:05:34.420 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 5b174660-766b-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T10:05:34.680 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T10:05:34.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:34 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/4209701243' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T10:05:34.901 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:34 smithi049 ceph-mon[34858]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T10:05:35.002 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:34 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/4209701243' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T10:05:35.002 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:34 smithi162 ceph-mon[35174]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T10:05:35.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:34 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/4209701243' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T10:05:35.075 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:34 smithi018 ceph-mon[30956]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T10:05:35.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.158+0000 7f1d2b59e640 1 -- 172.21.15.18:0/3808574721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d2c1068d0 msgr2=0x7f1d2c106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:35.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.158+0000 7f1d2b59e640 1 --2- 172.21.15.18:0/3808574721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d2c1068d0 0x7f1d2c106cb0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009930 tx=0x7f1d1c02a420 comp rx=0 tx=0).stop 2024-09-19T10:05:35.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.158+0000 7f1d2b59e640 1 -- 172.21.15.18:0/3808574721 shutdown_connections 2024-09-19T10:05:35.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.158+0000 7f1d2b59e640 1 --2- 172.21.15.18:0/3808574721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d2c101270 0x7f1d2c10d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:35.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.158+0000 7f1d2b59e640 1 --2- 172.21.15.18:0/3808574721 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c1008d0 0x7f1d2c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:35.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.158+0000 7f1d2b59e640 1 --2- 172.21.15.18:0/3808574721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d2c1068d0 0x7f1d2c106cb0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:35.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.158+0000 7f1d2b59e640 1 -- 172.21.15.18:0/3808574721 >> 172.21.15.18:0/3808574721 conn(0x7f1d2c0fc610 msgr2=0x7f1d2c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.158+0000 7f1d2b59e640 1 -- 172.21.15.18:0/3808574721 shutdown_connections 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.158+0000 7f1d2b59e640 1 -- 172.21.15.18:0/3808574721 wait complete. 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2b59e640 1 Processor -- start 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2b59e640 1 -- start start 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2b59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d2c1008d0 0x7f1d2c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101270 0x7f1d2c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d2c1068d0 0x7f1d2c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2b59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c110c90 con 0x7f1d2c1068d0 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2b59e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c110b10 con 0x7f1d2c101270 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2b59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c110e10 con 0x7f1d2c1008d0 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d2c1068d0 0x7f1d2c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d2c1068d0 0x7f1d2c19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45844/0 (socket says 172.21.15.18:45844) 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d2ad9d640 1 -- 172.21.15.18:0/693326379 learned_addr learned my addr 172.21.15.18:0/693326379 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.159+0000 7f1d23fff640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101270 0x7f1d2c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d2a59c640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d2c1008d0 0x7f1d2c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d2ad9d640 1 -- 172.21.15.18:0/693326379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d2c1008d0 msgr2=0x7f1d2c1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d2ad9d640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d2c1008d0 0x7f1d2c1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d2ad9d640 1 -- 172.21.15.18:0/693326379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101270 msgr2=0x7f1d2c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d2ad9d640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101270 0x7f1d2c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d2ad9d640 1 -- 172.21.15.18:0/693326379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c19d250 con 0x7f1d2c1068d0 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d2ad9d640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d2c1068d0 0x7f1d2c19cb70 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400eaa0 tx=0x7f1d2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d237fe640 1 -- 172.21.15.18:0/693326379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2400cdb0 con 0x7f1d2c1068d0 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d237fe640 1 -- 172.21.15.18:0/693326379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d24005020 con 0x7f1d2c1068d0 2024-09-19T10:05:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d2b59e640 1 -- 172.21.15.18:0/693326379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c19d540 con 0x7f1d2c1068d0 2024-09-19T10:05:35.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d237fe640 1 -- 172.21.15.18:0/693326379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d240116b0 con 0x7f1d2c1068d0 2024-09-19T10:05:35.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.160+0000 7f1d2b59e640 1 -- 172.21.15.18:0/693326379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c1a4e20 con 0x7f1d2c1068d0 2024-09-19T10:05:35.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.161+0000 7f1d2b59e640 1 -- 172.21.15.18:0/693326379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c100d30 con 0x7f1d2c1068d0 2024-09-19T10:05:35.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.163+0000 7f1d237fe640 1 -- 172.21.15.18:0/693326379 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1d24005560 con 0x7f1d2c1068d0 2024-09-19T10:05:35.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.163+0000 7f1d237fe640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d180a3240 0x7f1d180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T10:05:35.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.163+0000 7f1d2a59c640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d180a3240 0x7f1d180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T10:05:35.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.163+0000 7f1d237fe640 1 -- 172.21.15.18:0/693326379 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8116+0+0 (secure 0 0 0) 0x7f1d240cfd60 con 0x7f1d2c1068d0 2024-09-19T10:05:35.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.164+0000 7f1d2a59c640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d180a3240 0x7f1d180a5700 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009900 tx=0x7f1d1c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T10:05:35.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.167+0000 7f1d237fe640 1 -- 172.21.15.18:0/693326379 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d24016030 con 0x7f1d2c1068d0 2024-09-19T10:05:35.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.342+0000 7f1d2b59e640 1 -- 172.21.15.18:0/693326379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1d2c199600 con 0x7f1d2c1068d0 2024-09-19T10:05:35.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.732+0000 7f1d237fe640 1 -- 172.21.15.18:0/693326379 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) ==== 169+0+0 (secure 0 0 0) 0x7f1d2409c4f0 con 0x7f1d2c1068d0 2024-09-19T10:05:35.736 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.736+0000 7f1d2b59e640 1 -- 172.21.15.18:0/693326379 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d180a3240 msgr2=0x7f1d180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.736+0000 7f1d2b59e640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d180a3240 0x7f1d180a5700 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009900 tx=0x7f1d1c0058d0 comp rx=0 tx=0).stop 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.736+0000 7f1d2b59e640 1 -- 172.21.15.18:0/693326379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d2c1068d0 msgr2=0x7f1d2c19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.736+0000 7f1d2b59e640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d2c1068d0 0x7f1d2c19cb70 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400eaa0 tx=0x7f1d2400ef60 comp rx=0 tx=0).stop 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.737+0000 7f1d2b59e640 1 -- 172.21.15.18:0/693326379 shutdown_connections 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.737+0000 7f1d2b59e640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.18:6800/817115447,v1:172.21.15.18:6801/817115447] conn(0x7f1d180a3240 0x7f1d180a5700 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.737+0000 7f1d2b59e640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d2c1068d0 0x7f1d2c19cb70 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.737+0000 7f1d2b59e640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101270 0x7f1d2c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.737+0000 7f1d2b59e640 1 --2- 172.21.15.18:0/693326379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d2c1008d0 0x7f1d2c1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.737+0000 7f1d2b59e640 1 -- 172.21.15.18:0/693326379 >> 172.21.15.18:0/693326379 conn(0x7f1d2c0fc610 msgr2=0x7f1d2c06a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T10:05:35.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.737+0000 7f1d2b59e640 1 -- 172.21.15.18:0/693326379 shutdown_connections 2024-09-19T10:05:35.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T10:05:35.737+0000 7f1d2b59e640 1 -- 172.21.15.18:0/693326379 wait complete. 2024-09-19T10:05:36.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:35 smithi018 ceph-mon[30956]: pgmap v738: 65 pgs: 65 active+clean; 577 KiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T10:05:36.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:35 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/693326379' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T10:05:36.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:35 smithi049 ceph-mon[34858]: pgmap v738: 65 pgs: 65 active+clean; 577 KiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T10:05:36.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:35 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/693326379' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T10:05:36.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:35 smithi162 ceph-mon[35174]: pgmap v738: 65 pgs: 65 active+clean; 577 KiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T10:05:36.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:35 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/693326379' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T10:05:36.408 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T10:05:36.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T10:05:36.470 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T10:05:36.497 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T10:05:36.498 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T10:05:36.514 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T10:05:36.530 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T10:05:36.553 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T10:05:36.553 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T10:05:36.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.a 2024-09-19T10:05:36.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:36 smithi018 systemd[1]: Stopping Ceph mon.a for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:05:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:36 smithi018 ceph-mon[30956]: from='client.? 172.21.15.18:0/693326379' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T10:05:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:36 smithi018 ceph-mon[30956]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T10:05:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:36 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T10:05:36.847+0000 7f15e7bc1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:05:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:36 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T10:05:36.847+0000 7f15e7bc1640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T10:05:37.136 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:36 smithi018 podman[113851]: 2024-09-19 10:05:36.919839138 +0000 UTC m=+0.172025726 container died f2f6048d23fd9748f5263094c6f5a26bf3bf68c9e01815f28daa420aa8376411 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T10:05:37.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:36 smithi049 ceph-mon[34858]: from='client.? 172.21.15.18:0/693326379' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T10:05:37.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:36 smithi049 ceph-mon[34858]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T10:05:37.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:36 smithi162 ceph-mon[35174]: from='client.? 172.21.15.18:0/693326379' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T10:05:37.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:36 smithi162 ceph-mon[35174]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T10:05:37.635 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:37 smithi018 podman[113851]: 2024-09-19 10:05:37.397749999 +0000 UTC m=+0.649936587 container cleanup f2f6048d23fd9748f5263094c6f5a26bf3bf68c9e01815f28daa420aa8376411 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T10:05:37.636 INFO:journalctl@ceph.mon.a.smithi018.stdout:Sep 19 10:05:37 smithi018 bash[113851]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-a 2024-09-19T10:05:37.841 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T10:05:37.880 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:05:37.880 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T10:05:37.880 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T10:05:37.880 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.b 2024-09-19T10:05:38.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:37 smithi049 systemd[1]: Stopping Ceph mon.b for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:05:38.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:38 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-b[34854]: 2024-09-19T10:05:38.207+0000 7fa73267c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:05:38.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:38 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-b[34854]: 2024-09-19T10:05:38.207+0000 7fa73267c640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T10:05:38.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:38 smithi049 podman[69856]: 2024-09-19 10:05:38.320286823 +0000 UTC m=+0.241133557 container died 9465dea0d5d4160ef4d074d850fd3d9dc33c9c5c9366f6f5efd892f2aafbc8e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-19T10:05:39.285 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:39 smithi049 podman[69856]: 2024-09-19 10:05:39.007247812 +0000 UTC m=+0.928094535 container cleanup 9465dea0d5d4160ef4d074d850fd3d9dc33c9c5c9366f6f5efd892f2aafbc8e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:05:39.285 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 19 10:05:39 smithi049 bash[69856]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-b 2024-09-19T10:05:39.416 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T10:05:39.466 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:05:39.466 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T10:05:39.466 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T10:05:39.466 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.c 2024-09-19T10:05:39.792 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:39 smithi162 systemd[1]: Stopping Ceph mon.c for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:05:40.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-c[35169]: 2024-09-19T10:05:39.789+0000 7f0a55758640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:05:40.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-c[35169]: 2024-09-19T10:05:39.789+0000 7f0a55758640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T10:05:40.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:39 smithi162 podman[70460]: 2024-09-19 10:05:39.9529773 +0000 UTC m=+0.293985869 container died af4f767de581f4b3a5f07f4cf656bf1aee92b94058d58a8215d993a30580a553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T10:05:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:40 smithi162 podman[70460]: 2024-09-19 10:05:40.429097538 +0000 UTC m=+0.770106097 container cleanup af4f767de581f4b3a5f07f4cf656bf1aee92b94058d58a8215d993a30580a553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T10:05:40.663 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 10:05:40 smithi162 bash[70460]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mon-c 2024-09-19T10:05:40.864 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T10:05:40.912 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:05:40.912 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T10:05:40.912 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T10:05:40.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.x 2024-09-19T10:05:41.238 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 10:05:40 smithi018 systemd[1]: Stopping Ceph mgr.x for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:05:41.512 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 10:05:41 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x[31180]: 2024-09-19T10:05:41.233+0000 7f7f2612e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:05:41.513 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 10:05:41 smithi018 podman[113985]: 2024-09-19 10:05:41.266172998 +0000 UTC m=+0.157250217 container died b85b3a7035bbb9b049886077b0cbd0cc2a83327a8165ad7e0f097dcd107348b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T10:05:41.820 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 10:05:41 smithi018 podman[113985]: 2024-09-19 10:05:41.601636467 +0000 UTC m=+0.492713678 container cleanup b85b3a7035bbb9b049886077b0cbd0cc2a83327a8165ad7e0f097dcd107348b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T10:05:41.820 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 10:05:41 smithi018 bash[113985]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x 2024-09-19T10:05:42.083 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Sep 19 10:05:41 smithi018 podman[113997]: 2024-09-19 10:05:41.817902655 +0000 UTC m=+0.549857170 container remove b85b3a7035bbb9b049886077b0cbd0cc2a83327a8165ad7e0f097dcd107348b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T10:05:42.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T10:05:42.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:05:42.126 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T10:05:42.127 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T10:05:42.127 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.y 2024-09-19T10:05:42.451 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 10:05:42 smithi049 systemd[1]: Stopping Ceph mgr.y for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:05:42.731 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 10:05:42 smithi049 podman[69978]: 2024-09-19 10:05:42.449472801 +0000 UTC m=+0.120943600 container died 9075f74b746c6ba8668bf7d00b0b8c45a372d4fd8d0a934a56eaa9d513a9196b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T10:05:43.151 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 10:05:42 smithi049 podman[69978]: 2024-09-19 10:05:42.828675264 +0000 UTC m=+0.500146064 container cleanup 9075f74b746c6ba8668bf7d00b0b8c45a372d4fd8d0a934a56eaa9d513a9196b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T10:05:43.151 INFO:journalctl@ceph.mgr.y.smithi049.stdout:Sep 19 10:05:42 smithi049 bash[69978]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-y 2024-09-19T10:05:43.413 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T10:05:43.450 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:05:43.450 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T10:05:43.450 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T10:05:43.450 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.z 2024-09-19T10:05:43.797 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 10:05:43 smithi162 systemd[1]: Stopping Ceph mgr.z for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:05:44.086 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 10:05:43 smithi162 podman[70580]: 2024-09-19 10:05:43.796088682 +0000 UTC m=+0.152067456 container died 5ca5d81821838b281778830cf5296d7619af881131bf52fad64149649ba24b01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T10:05:44.413 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 10:05:44 smithi162 podman[70580]: 2024-09-19 10:05:44.166663828 +0000 UTC m=+0.522642601 container cleanup 5ca5d81821838b281778830cf5296d7619af881131bf52fad64149649ba24b01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:05:44.413 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 10:05:44 smithi162 bash[70580]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mgr-z 2024-09-19T10:05:44.594 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T10:05:44.628 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:05:44.628 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T10:05:44.628 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T10:05:44.628 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.0 2024-09-19T10:05:44.941 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:44 smithi018 systemd[1]: Stopping Ceph osd.0 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:05:45.385 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:44 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0[44812]: 2024-09-19T10:05:44.937+0000 7f7e4f360640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:05:45.386 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:44 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0[44812]: 2024-09-19T10:05:44.937+0000 7f7e4f360640 -1 osd.0 87 *** Got signal Terminated *** 2024-09-19T10:05:45.386 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:44 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0[44812]: 2024-09-19T10:05:44.937+0000 7f7e4f360640 -1 osd.0 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:05:50.767 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:50 smithi018 podman[114104]: 2024-09-19 10:05:50.486192202 +0000 UTC m=+5.654679127 container died 3a916090ffd9d7ee5bcea107a527e54fd215c6ad1fa552c518bc70698a864a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T10:05:51.135 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:50 smithi018 podman[114104]: 2024-09-19 10:05:50.955570312 +0000 UTC m=+6.124057303 container cleanup 3a916090ffd9d7ee5bcea107a527e54fd215c6ad1fa552c518bc70698a864a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T10:05:51.136 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:50 smithi018 bash[114104]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0 2024-09-19T10:05:51.636 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:51 smithi018 podman[114122]: 2024-09-19 10:05:51.349489978 +0000 UTC m=+0.856479376 container remove 3a916090ffd9d7ee5bcea107a527e54fd215c6ad1fa552c518bc70698a864a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T10:05:52.054 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:51 smithi018 podman[114210]: 2024-09-19 10:05:51.733730179 +0000 UTC m=+0.109142137 container create 1c3dd44aad291d7a0ae159dc8c216ea9f3a4b3f669931d950fb28f711d2ed00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T10:05:52.055 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:51 smithi018 podman[114210]: 2024-09-19 10:05:51.641247326 +0000 UTC m=+0.016659260 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:05:52.055 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:51 smithi018 podman[114210]: 2024-09-19 10:05:51.969307923 +0000 UTC m=+0.344719849 container init 1c3dd44aad291d7a0ae159dc8c216ea9f3a4b3f669931d950fb28f711d2ed00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T10:05:52.055 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:51 smithi018 podman[114210]: 2024-09-19 10:05:51.972657983 +0000 UTC m=+0.348069899 container start 1c3dd44aad291d7a0ae159dc8c216ea9f3a4b3f669931d950fb28f711d2ed00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T10:05:52.055 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:52 smithi018 podman[114210]: 2024-09-19 10:05:52.05248305 +0000 UTC m=+0.427894977 container attach 1c3dd44aad291d7a0ae159dc8c216ea9f3a4b3f669931d950fb28f711d2ed00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T10:05:52.325 INFO:journalctl@ceph.osd.0.smithi018.stdout:Sep 19 10:05:52 smithi018 podman[114210]: 2024-09-19 10:05:52.177806937 +0000 UTC m=+0.553218853 container died 1c3dd44aad291d7a0ae159dc8c216ea9f3a4b3f669931d950fb28f711d2ed00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T10:05:52.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T10:05:52.867 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:05:52.867 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T10:05:52.867 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T10:05:52.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.1 2024-09-19T10:05:53.151 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:05:52 smithi049 systemd[1]: Stopping Ceph osd.1 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:05:53.431 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:05:53 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1[39373]: 2024-09-19T10:05:53.180+0000 7f12be49f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:05:53.431 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:05:53 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1[39373]: 2024-09-19T10:05:53.180+0000 7f12be49f640 -1 osd.1 87 *** Got signal Terminated *** 2024-09-19T10:05:53.431 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:05:53 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1[39373]: 2024-09-19T10:05:53.180+0000 7f12be49f640 -1 osd.1 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:05:59.102 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:05:58 smithi049 podman[70100]: 2024-09-19 10:05:58.731522132 +0000 UTC m=+5.664794040 container died 4dae0d201684510c2301091008f9f05d2426be4e3fdb610aec6324d5084d3322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T10:05:59.401 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:05:59 smithi049 podman[70100]: 2024-09-19 10:05:59.190413963 +0000 UTC m=+6.123685872 container cleanup 4dae0d201684510c2301091008f9f05d2426be4e3fdb610aec6324d5084d3322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T10:05:59.401 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:05:59 smithi049 bash[70100]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1 2024-09-19T10:05:59.901 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:05:59 smithi049 podman[70128]: 2024-09-19 10:05:59.616634965 +0000 UTC m=+0.879709118 container remove 4dae0d201684510c2301091008f9f05d2426be4e3fdb610aec6324d5084d3322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T10:06:00.241 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:05:59 smithi049 podman[70217]: 2024-09-19 10:05:59.877152605 +0000 UTC m=+0.016226340 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:06:00.241 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:06:00 smithi049 podman[70217]: 2024-09-19 10:06:00.017836636 +0000 UTC m=+0.156910403 container create 7276acd7ad9068e18267c89eea670e3568720ea12d7ba23adc3bf0cef14aaf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T10:06:00.651 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:06:00 smithi049 podman[70217]: 2024-09-19 10:06:00.236903591 +0000 UTC m=+0.375977316 container init 7276acd7ad9068e18267c89eea670e3568720ea12d7ba23adc3bf0cef14aaf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T10:06:00.651 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:06:00 smithi049 podman[70217]: 2024-09-19 10:06:00.240586347 +0000 UTC m=+0.379660078 container start 7276acd7ad9068e18267c89eea670e3568720ea12d7ba23adc3bf0cef14aaf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T10:06:00.651 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:06:00 smithi049 podman[70217]: 2024-09-19 10:06:00.328475198 +0000 UTC m=+0.467548931 container attach 7276acd7ad9068e18267c89eea670e3568720ea12d7ba23adc3bf0cef14aaf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T10:06:00.651 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 10:06:00 smithi049 podman[70217]: 2024-09-19 10:06:00.434591321 +0000 UTC m=+0.573665055 container died 7276acd7ad9068e18267c89eea670e3568720ea12d7ba23adc3bf0cef14aaf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T10:06:01.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T10:06:01.097 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:06:01.097 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T10:06:01.098 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T10:06:01.098 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.2 2024-09-19T10:06:01.413 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:01 smithi162 systemd[1]: Stopping Ceph osd.2 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:06:01.676 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:01 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2[40216]: 2024-09-19T10:06:01.451+0000 7f2de8290640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:06:01.677 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:01 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2[40216]: 2024-09-19T10:06:01.451+0000 7f2de8290640 -1 osd.2 87 *** Got signal Terminated *** 2024-09-19T10:06:01.677 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:01 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2[40216]: 2024-09-19T10:06:01.451+0000 7f2de8290640 -1 osd.2 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:06:07.155 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:06 smithi162 podman[70703]: 2024-09-19 10:06:06.877399315 +0000 UTC m=+5.584430050 container died 3120b7ba7436f9860c556e5e61489303a92dab6648929c843ab8fc510877c384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T10:06:07.413 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:07 smithi162 podman[70703]: 2024-09-19 10:06:07.252644507 +0000 UTC m=+5.959675243 container cleanup 3120b7ba7436f9860c556e5e61489303a92dab6648929c843ab8fc510877c384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T10:06:07.413 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:07 smithi162 bash[70703]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2 2024-09-19T10:06:07.873 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:07 smithi162 podman[70731]: 2024-09-19 10:06:07.528995675 +0000 UTC m=+0.649268925 container remove 3120b7ba7436f9860c556e5e61489303a92dab6648929c843ab8fc510877c384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:06:08.150 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:07 smithi162 podman[70820]: 2024-09-19 10:06:07.871280187 +0000 UTC m=+0.112529721 container create 1d9c4e6c76f4aa981bb531cb7171ff1bffb9b76ee8c00fa87d15ed4e709ea5c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T10:06:08.150 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:07 smithi162 podman[70820]: 2024-09-19 10:06:07.774659928 +0000 UTC m=+0.015909462 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:06:08.414 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:08 smithi162 podman[70820]: 2024-09-19 10:06:08.148724831 +0000 UTC m=+0.389974365 container init 1d9c4e6c76f4aa981bb531cb7171ff1bffb9b76ee8c00fa87d15ed4e709ea5c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T10:06:08.414 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:08 smithi162 podman[70820]: 2024-09-19 10:06:08.152395585 +0000 UTC m=+0.393645120 container start 1d9c4e6c76f4aa981bb531cb7171ff1bffb9b76ee8c00fa87d15ed4e709ea5c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T10:06:08.414 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:08 smithi162 podman[70820]: 2024-09-19 10:06:08.240468147 +0000 UTC m=+0.481717683 container attach 1d9c4e6c76f4aa981bb531cb7171ff1bffb9b76ee8c00fa87d15ed4e709ea5c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T10:06:08.414 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 10:06:08 smithi162 podman[70820]: 2024-09-19 10:06:08.34699444 +0000 UTC m=+0.588243987 container died 1d9c4e6c76f4aa981bb531cb7171ff1bffb9b76ee8c00fa87d15ed4e709ea5c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T10:06:08.902 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T10:06:08.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:06:08.941 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T10:06:08.941 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T10:06:08.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.3 2024-09-19T10:06:09.252 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:08 smithi018 systemd[1]: Stopping Ceph osd.3 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:06:09.523 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:06:09.249+0000 7f02d8a24640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:06:09.523 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:06:09.249+0000 7f02d8a24640 -1 osd.3 87 *** Got signal Terminated *** 2024-09-19T10:06:09.523 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:09 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:06:09.249+0000 7f02d8a24640 -1 osd.3 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:06:10.885 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:10 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:06:10.713+0000 7f02d5029640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:49.400593+0000 front 2024-09-19T10:05:49.400661+0000 (oldest deadline 2024-09-19T10:06:10.500726+0000) 2024-09-19T10:06:12.136 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:11 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:06:11.698+0000 7f02d5029640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:49.400593+0000 front 2024-09-19T10:05:49.400661+0000 (oldest deadline 2024-09-19T10:06:10.500726+0000) 2024-09-19T10:06:12.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:11 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:11.676+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:12.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:12 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:12.254+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:13.135 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:12 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:06:12.659+0000 7f02d5029640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:49.400593+0000 front 2024-09-19T10:05:49.400661+0000 (oldest deadline 2024-09-19T10:06:10.500726+0000) 2024-09-19T10:06:13.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:12 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:12.720+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:13.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:13.205+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:14.136 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:13 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3[51458]: 2024-09-19T10:06:13.708+0000 7f02d5029640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:49.400593+0000 front 2024-09-19T10:05:49.400661+0000 (oldest deadline 2024-09-19T10:06:10.500726+0000) 2024-09-19T10:06:14.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:13 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:13.714+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:14.150 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:13 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:13.742+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:14.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:14 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:14.182+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:14.825 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:14 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:14.706+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:14.825 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:14 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:14.479+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:15.110 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:14 smithi018 podman[114323]: 2024-09-19 10:06:14.822909257 +0000 UTC m=+5.671525672 container died e45c74c603a906c56c5aa4b19bd4ac493f61177af27f30612e6136dde089b122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T10:06:15.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:14 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:14.721+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:15.385 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:15 smithi018 podman[114323]: 2024-09-19 10:06:15.299385873 +0000 UTC m=+6.148002286 container cleanup e45c74c603a906c56c5aa4b19bd4ac493f61177af27f30612e6136dde089b122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T10:06:15.386 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:15 smithi018 bash[114323]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3 2024-09-19T10:06:15.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:15 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:15.167+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:15.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:15 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:15.218+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:15.738 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:15 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:15.447+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:15.739 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:15 smithi018 podman[114350]: 2024-09-19 10:06:15.555755406 +0000 UTC m=+0.728219962 container remove e45c74c603a906c56c5aa4b19bd4ac493f61177af27f30612e6136dde089b122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T10:06:16.036 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:15 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:15.736+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:16.037 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:15 smithi018 podman[114441]: 2024-09-19 10:06:15.791832555 +0000 UTC m=+0.016793797 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:06:16.037 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:15 smithi018 podman[114441]: 2024-09-19 10:06:15.893248028 +0000 UTC m=+0.118209269 container create 5b9818f9976458cddee88950f411fc25913210e5bbb0660e6c08745d93321b23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T10:06:16.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:15 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:15.767+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:16.354 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:16 smithi018 podman[114441]: 2024-09-19 10:06:16.162754573 +0000 UTC m=+0.387715815 container init 5b9818f9976458cddee88950f411fc25913210e5bbb0660e6c08745d93321b23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T10:06:16.354 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:16 smithi018 podman[114441]: 2024-09-19 10:06:16.166099423 +0000 UTC m=+0.391060665 container start 5b9818f9976458cddee88950f411fc25913210e5bbb0660e6c08745d93321b23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T10:06:16.354 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:16 smithi018 podman[114441]: 2024-09-19 10:06:16.2376076 +0000 UTC m=+0.462568857 container attach 5b9818f9976458cddee88950f411fc25913210e5bbb0660e6c08745d93321b23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T10:06:16.635 INFO:journalctl@ceph.osd.3.smithi018.stdout:Sep 19 10:06:16 smithi018 podman[114441]: 2024-09-19 10:06:16.352827115 +0000 UTC m=+0.577788373 container died 5b9818f9976458cddee88950f411fc25913210e5bbb0660e6c08745d93321b23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T10:06:16.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:16 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:16.442+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:16.663 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:16 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:16.180+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:16.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:16 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:16.193+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:16.951 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:16 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:16.757+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:16.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T10:06:17.009 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:06:17.010 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T10:06:17.010 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T10:06:17.010 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.4 2024-09-19T10:06:17.055 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:16 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:16.799+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:17.311 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:17 smithi049 systemd[1]: Stopping Ceph osd.4 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:06:17.413 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:17 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:17.139+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:17.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:17 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:17.224+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:17.651 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:17 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4[46340]: 2024-09-19T10:06:17.309+0000 7f4ff767c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:06:17.651 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:17 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4[46340]: 2024-09-19T10:06:17.309+0000 7f4ff767c640 -1 osd.4 87 *** Got signal Terminated *** 2024-09-19T10:06:17.651 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:17 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4[46340]: 2024-09-19T10:06:17.309+0000 7f4ff767c640 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:06:17.711 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:17 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:17.399+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:18.135 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:17 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:17.709+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:18.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:17 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:17.825+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:18.413 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:18 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:18.156+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:18.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:18 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:18.265+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:18.689 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:18 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:18.390+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:19.135 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:18 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:18.686+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:19.150 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:18 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:18.848+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:19.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:19 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:19.372+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:19.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:19 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:19.372+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:19.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:19 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:19.220+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:19.664 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:19 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:19.183+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:19.664 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:19 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:19.183+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:20.026 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:19 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:19.661+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:20.151 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:19 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4[46340]: 2024-09-19T10:06:19.755+0000 7f4ff3c81640 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:53.722678+0000 front 2024-09-19T10:05:53.722612+0000 (oldest deadline 2024-09-19T10:06:18.923342+0000) 2024-09-19T10:06:20.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:19 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:19.813+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:20.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:20 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:20.247+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:20.413 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:20 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:20.135+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:20.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:20 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:20.135+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:20.608 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:20 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:20.349+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:20.609 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:20 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:20.349+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:20.885 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:20 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:20.689+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:21.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:20 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:20.802+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:21.151 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:20 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4[46340]: 2024-09-19T10:06:20.735+0000 7f4ff3c81640 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:53.722678+0000 front 2024-09-19T10:05:53.722612+0000 (oldest deadline 2024-09-19T10:06:18.923342+0000) 2024-09-19T10:06:21.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:21 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:21.221+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:21.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:21 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:21.105+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:21.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:21 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:21.105+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:21.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:21 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:21.142+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:21.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:21 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:21.367+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:21.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:21 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:21.367+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:22.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:21 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:21.655+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:22.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:21 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:21.655+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:22.151 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:21 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4[46340]: 2024-09-19T10:06:21.730+0000 7f4ff3c81640 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:53.722678+0000 front 2024-09-19T10:05:53.722612+0000 (oldest deadline 2024-09-19T10:06:18.923342+0000) 2024-09-19T10:06:22.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:21 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:21.812+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:22.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:22 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:22.107+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:22.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:22 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:22.199+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:22.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:22 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:22.100+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:22.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:22 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:22.100+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:22.703 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:22 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:22.396+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:22.703 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:22 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:22.396+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:23.045 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:22 smithi049 podman[70319]: 2024-09-19 10:06:22.746542887 +0000 UTC m=+5.542929802 container died 03861a50d5fd38b947f86bc22484119a522e9d2e3e9b9aae168c36b0be6d7900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T10:06:23.045 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:22 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:22.763+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:23.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:22 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:22.700+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:23.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:22 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:22.700+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:23.344 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:23 smithi049 podman[70319]: 2024-09-19 10:06:23.14192275 +0000 UTC m=+5.938309664 container cleanup 03861a50d5fd38b947f86bc22484119a522e9d2e3e9b9aae168c36b0be6d7900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T10:06:23.345 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:23 smithi049 bash[70319]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4 2024-09-19T10:06:23.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:23 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:23.155+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:23.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:23 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:23.230+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:23.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:23 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:23.230+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:23.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:23 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:23.100+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:23.415 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:23 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:23.100+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:23.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:23 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:23.366+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:23.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:23 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:23.366+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:23.650 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:23 smithi049 podman[70334]: 2024-09-19 10:06:23.342818395 +0000 UTC m=+0.591236179 container remove 03861a50d5fd38b947f86bc22484119a522e9d2e3e9b9aae168c36b0be6d7900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T10:06:24.064 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:23 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:23.812+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:24.065 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:23 smithi049 podman[70425]: 2024-09-19 10:06:23.677230372 +0000 UTC m=+0.016366514 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:06:24.065 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:23 smithi049 podman[70425]: 2024-09-19 10:06:23.776966414 +0000 UTC m=+0.116102543 container create 981c3729d229afb6eadddf235df6d9e7ab90c2579a223402effd2f0ac7a5d254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:06:24.065 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:23 smithi049 podman[70425]: 2024-09-19 10:06:23.979302983 +0000 UTC m=+0.318439112 container init 981c3729d229afb6eadddf235df6d9e7ab90c2579a223402effd2f0ac7a5d254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T10:06:24.065 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:23 smithi049 podman[70425]: 2024-09-19 10:06:23.982765234 +0000 UTC m=+0.321901363 container start 981c3729d229afb6eadddf235df6d9e7ab90c2579a223402effd2f0ac7a5d254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T10:06:24.065 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:24 smithi049 podman[70425]: 2024-09-19 10:06:24.062554375 +0000 UTC m=+0.401690505 container attach 981c3729d229afb6eadddf235df6d9e7ab90c2579a223402effd2f0ac7a5d254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T10:06:24.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:23 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:23.716+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:24.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:23 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:23.716+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:24.401 INFO:journalctl@ceph.osd.4.smithi049.stdout:Sep 19 10:06:24 smithi049 podman[70425]: 2024-09-19 10:06:24.179447529 +0000 UTC m=+0.518583659 container died 981c3729d229afb6eadddf235df6d9e7ab90c2579a223402effd2f0ac7a5d254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T10:06:24.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:24 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:24.200+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:24.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:24 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:24.211+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:24.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:24 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:24.211+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:24.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:24 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:24.104+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:24.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:24 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:24.104+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:24.635 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:24 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:24.372+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:24.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:24 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:24.372+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:24.789 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:24 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:24.582+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:24.818 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T10:06:24.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:06:24.858 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T10:06:24.859 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T10:06:24.859 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.5 2024-09-19T10:06:25.135 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:24 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:24.747+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:25.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:24 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:24.747+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:25.150 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:24 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:24.785+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:25.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:24 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:24.785+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:25.163 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:24 smithi162 systemd[1]: Stopping Ceph osd.5 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:06:25.163 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:25 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:25.056+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:25.163 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:25 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:25.056+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:25.635 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:25.337+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:25.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:25.337+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:25.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:25 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:25.226+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:25.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:25 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:25.200+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:25.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:25 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:25.200+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:25.664 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:25 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:25.170+0000 7f60fb2b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:06:25.664 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:25 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:25.170+0000 7f60fb2b6640 -1 osd.5 87 *** Got signal Terminated *** 2024-09-19T10:06:25.664 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:25 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:25.170+0000 7f60fb2b6640 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:06:25.820 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:25 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:25.561+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:26.135 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:25.752+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:26.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:25 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:25.753+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:26.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:25 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:25.818+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:26.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:25 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:25.818+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:26.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:26 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:26.196+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:26.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:26 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:26.219+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:26.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:26 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:26.219+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:26.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:26 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:26.013+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:26.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:26 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:26.013+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:26.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:26 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:26.288+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:26.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:26 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:26.288+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:26.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:26 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:26.602+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:26.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:26 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:26.833+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:26.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:26 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:26.833+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:27.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:26 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:26.769+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:27.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:26 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:26.769+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:27.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:27 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:27.237+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:27.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:26 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:26.997+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:27.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:26 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:26.997+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:27.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:27 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:27.198+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:27.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:27 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:27.198+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:27.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:27 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:27.320+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:27.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:27 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:27.320+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:27.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:27 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:27.618+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:27.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:27 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:27.793+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:27.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:27 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:27.793+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:28.135 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:27 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:27.819+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:28.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:27 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:27.819+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:28.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:27 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:27.819+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:01.619702+0000 front 2024-09-19T10:06:01.619723+0000 (oldest deadline 2024-09-19T10:06:26.919661+0000) 2024-09-19T10:06:28.417 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:28 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:28.215+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:28.471 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:28 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:28.215+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:28.472 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:28 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:28.042+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:28.472 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:28 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:28.042+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:28.473 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:28 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:28.042+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.324452+0000 front 2024-09-19T10:06:05.324436+0000 (oldest deadline 2024-09-19T10:06:27.624587+0000) 2024-09-19T10:06:28.473 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:28 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:28.195+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:28.473 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:28 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:28.195+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:28.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:28.332+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:28.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:28.332+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:28.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:28 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:28.622+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:28.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:28 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:28.622+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:28.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:28 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:28.775+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:28.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:28 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:28.775+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:29.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:28.856+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:29.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:28.856+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:29.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:28 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:28.856+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:01.619702+0000 front 2024-09-19T10:06:01.619723+0000 (oldest deadline 2024-09-19T10:06:26.919661+0000) 2024-09-19T10:06:29.413 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:28 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:28.998+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:29.413 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:28 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:28.998+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:29.413 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:28 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:28.998+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.324452+0000 front 2024-09-19T10:06:05.324436+0000 (oldest deadline 2024-09-19T10:06:27.624587+0000) 2024-09-19T10:06:29.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:29.163+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:29.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:29.163+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:29.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:29.210+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:29.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:29.210+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:29.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:29 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:29.210+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:29.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:29.381+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:29.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:29.381+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:29.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:29.617+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:29.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:29.617+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:29.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:29.771+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:29.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:29 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:29.771+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:30.351 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:29.901+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:30.351 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:29.901+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:30.351 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:29 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:29.901+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:01.619702+0000 front 2024-09-19T10:06:01.619723+0000 (oldest deadline 2024-09-19T10:06:26.919661+0000) 2024-09-19T10:06:30.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:30.166+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:30.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:30.166+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:30.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:30.223+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:30.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:30.223+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:30.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:30.223+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:30.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:30.026+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.421788+0000 front 2024-09-19T10:05:48.421765+0000 (oldest deadline 2024-09-19T10:06:14.321923+0000) 2024-09-19T10:06:30.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:30.026+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.023163+0000 front 2024-09-19T10:05:56.023233+0000 (oldest deadline 2024-09-19T10:06:18.923030+0000) 2024-09-19T10:06:30.414 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:30 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5[46728]: 2024-09-19T10:06:30.026+0000 7f60f38b3640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.324452+0000 front 2024-09-19T10:06:05.324436+0000 (oldest deadline 2024-09-19T10:06:27.624587+0000) 2024-09-19T10:06:30.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:30 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:30.348+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:30.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:30 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:30.348+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:30.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:30 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:30.348+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:30.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:30 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:30.641+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:30.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:30 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:30.641+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:30.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:30 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:30.753+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:30.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:30 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:30.753+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:30.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:30 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:30.753+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:30.948 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:30 smithi162 podman[70927]: 2024-09-19 10:06:30.662929635 +0000 UTC m=+5.604237179 container died 6631fbacbf7958544985c1d8c2ab7e52e17895c3430901957e39ae385549d4de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T10:06:31.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:30 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:30.875+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:31.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:30 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:30.875+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:31.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:30 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:30.875+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:01.619702+0000 front 2024-09-19T10:06:01.619723+0000 (oldest deadline 2024-09-19T10:06:26.919661+0000) 2024-09-19T10:06:31.207 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:31 smithi162 podman[70927]: 2024-09-19 10:06:31.044542277 +0000 UTC m=+5.985849813 container cleanup 6631fbacbf7958544985c1d8c2ab7e52e17895c3430901957e39ae385549d4de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T10:06:31.207 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:31 smithi162 bash[70927]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5 2024-09-19T10:06:31.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:31 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:31.342+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:31.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:31 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:31.342+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:31.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:31 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:31.342+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:31.656 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:31 smithi162 podman[70947]: 2024-09-19 10:06:31.312684832 +0000 UTC m=+0.647877552 container remove 6631fbacbf7958544985c1d8c2ab7e52e17895c3430901957e39ae385549d4de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T10:06:31.657 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:31 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:31.204+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:31.657 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:31 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:31.204+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:31.657 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:31 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:31.262+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:31.657 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:31 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:31.262+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:31.657 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:31 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:31.262+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:31.913 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:31 smithi162 podman[71037]: 2024-09-19 10:06:31.655099757 +0000 UTC m=+0.101020076 container create a94620e7330121e2722783c56b2a439d36fad51b4fe91b009b90ef89eee4045d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T10:06:31.913 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:31 smithi162 podman[71037]: 2024-09-19 10:06:31.570401127 +0000 UTC m=+0.016321447 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:06:31.914 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:31 smithi162 podman[71037]: 2024-09-19 10:06:31.849394731 +0000 UTC m=+0.295315052 container init a94620e7330121e2722783c56b2a439d36fad51b4fe91b009b90ef89eee4045d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T10:06:31.914 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:31 smithi162 podman[71037]: 2024-09-19 10:06:31.852652503 +0000 UTC m=+0.298572831 container start a94620e7330121e2722783c56b2a439d36fad51b4fe91b009b90ef89eee4045d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T10:06:32.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:31 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:31.684+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:32.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:31 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:31.684+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:32.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:31 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:31.708+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:32.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:31 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:31.708+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:32.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:31 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:31.708+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:32.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:31 smithi162 podman[71037]: 2024-09-19 10:06:31.9325331 +0000 UTC m=+0.378453430 container attach a94620e7330121e2722783c56b2a439d36fad51b4fe91b009b90ef89eee4045d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T10:06:32.223 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 10:06:32 smithi162 podman[71037]: 2024-09-19 10:06:32.043280919 +0000 UTC m=+0.489201240 container died a94620e7330121e2722783c56b2a439d36fad51b4fe91b009b90ef89eee4045d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T10:06:32.300 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:31 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:31.896+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:32.300 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:31 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:31.896+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:32.300 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:31 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:31.896+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:01.619702+0000 front 2024-09-19T10:06:01.619723+0000 (oldest deadline 2024-09-19T10:06:26.919661+0000) 2024-09-19T10:06:32.635 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:32.297+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:32.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:32.297+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:32.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:32.297+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:32.646 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:32.251+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:32.646 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:32.251+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:32.646 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:32.220+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:32.646 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:32.220+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:32.646 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:32 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:32.220+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:32.668 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T10:06:32.705 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:06:32.706 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T10:06:32.706 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T10:06:32.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.6 2024-09-19T10:06:33.003 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:32 smithi018 systemd[1]: Stopping Ceph osd.6 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:06:33.003 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:32.923+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:33.003 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:32.923+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:33.003 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:32 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:32.923+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:01.619702+0000 front 2024-09-19T10:06:01.619723+0000 (oldest deadline 2024-09-19T10:06:26.919661+0000) 2024-09-19T10:06:33.003 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:33 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:33.000+0000 7f6212ef7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:06:33.003 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:33 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:33.000+0000 7f6212ef7640 -1 osd.6 87 *** Got signal Terminated *** 2024-09-19T10:06:33.003 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:33 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:33.000+0000 7f6212ef7640 -1 osd.6 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:06:33.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:32 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:32.677+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:33.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:32 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:32.677+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:33.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:32 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:32.727+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:33.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:32 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:32.727+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:33.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:32 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:32.727+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:33.635 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:33 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:33.279+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:33.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:33 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:33.279+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:33.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:33 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:33.279+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:33.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:33 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:33.206+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:33.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:33 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:33.206+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:33.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:33 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:33.184+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:33.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:33 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:33.184+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:33.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:33 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:33.184+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:34.152 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:33 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:33.706+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:34.152 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:33 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:33.706+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:34.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:33 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:33.775+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:34.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:33 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:33.775+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:34.153 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:33 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:33.775+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:34.237 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:33 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:33.896+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:34.237 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:33 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:33.896+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:34.237 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:33 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:33.896+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:01.619702+0000 front 2024-09-19T10:06:01.619723+0000 (oldest deadline 2024-09-19T10:06:26.919661+0000) 2024-09-19T10:06:34.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:34 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:34.234+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:34.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:34 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:34.234+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:34.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:34 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:34.234+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:34.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:34 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:34.179+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:34.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:34 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:34.179+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:34.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:34 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:34.171+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:34.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:34 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:34.171+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:34.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:34 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:34.171+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:35.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:34.732+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:35.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:34.732+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:35.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:34.750+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:35.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:34.750+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:35.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:34 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:34.750+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:35.281 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:34 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:34.946+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:35.282 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:34 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:34.946+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:35.282 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:34 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:34.946+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:01.619702+0000 front 2024-09-19T10:06:01.619723+0000 (oldest deadline 2024-09-19T10:06:26.919661+0000) 2024-09-19T10:06:35.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:35 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:35.144+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:35.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:35 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:35.144+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:35.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:35 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:35.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:35.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:35 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:35.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:35.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:35 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:35.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:35.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:35 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:35.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:35.635 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:35 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:35.279+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:35.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:35 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:35.279+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:35.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:35 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:35.279+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:35.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:35.724+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:35.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:35.724+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:35.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:35.771+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:35.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:35.771+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:35.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:35 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:35.771+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:36.247 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:35 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:35.973+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:36.247 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:35 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:35.973+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:36.247 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:35 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:35.973+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:01.619702+0000 front 2024-09-19T10:06:01.619723+0000 (oldest deadline 2024-09-19T10:06:26.919661+0000) 2024-09-19T10:06:36.247 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:35 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:35.973+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.820410+0000 front 2024-09-19T10:06:12.820372+0000 (oldest deadline 2024-09-19T10:06:35.120553+0000) 2024-09-19T10:06:36.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:36 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:36.142+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:36.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:36 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:36.142+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:36.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:36 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:36.142+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:36.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:36 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:36.188+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:36.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:36 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:36.188+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:36.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:36 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:36.188+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:36.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:36 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:36.188+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:36.635 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:36 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:36.244+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:36.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:36 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:36.244+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:36.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:36 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:36.244+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:36.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:36 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:36.244+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:37.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:36 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:36.701+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:37.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:36 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:36.701+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:37.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:36 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:36.790+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:37.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:36 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:36.790+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:37.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:36 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:36.790+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:37.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:37 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:37.252+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:37.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:37 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:37.252+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:37.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:37 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:37.252+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:37.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:37 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:37.252+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:37.386 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:37 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:37.019+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.817414+0000 front 2024-09-19T10:05:48.817390+0000 (oldest deadline 2024-09-19T10:06:12.917481+0000) 2024-09-19T10:06:37.386 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:37 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:37.019+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:55.718952+0000 front 2024-09-19T10:05:55.718902+0000 (oldest deadline 2024-09-19T10:06:21.619127+0000) 2024-09-19T10:06:37.386 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:37 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:37.019+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:01.619702+0000 front 2024-09-19T10:06:01.619723+0000 (oldest deadline 2024-09-19T10:06:26.919661+0000) 2024-09-19T10:06:37.386 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:37 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-19T10:06:37.019+0000 7f620b4f4640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.820410+0000 front 2024-09-19T10:06:12.820372+0000 (oldest deadline 2024-09-19T10:06:35.120553+0000) 2024-09-19T10:06:37.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:37 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:37.187+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:37.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:37 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:37.187+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:37.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:37 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:37.187+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:37.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:37 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:37.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:37.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:37 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:37.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:37.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:37 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:37.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:37.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:37 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:37.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:38.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:37 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:37.702+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:38.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:37 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:37.702+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:38.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:37 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:37.702+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:13.876916+0000 front 2024-09-19T10:06:13.876834+0000 (oldest deadline 2024-09-19T10:06:37.376770+0000) 2024-09-19T10:06:38.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:37 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:37.812+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:38.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:37 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:37.812+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:38.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:37 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:37.813+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:38.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:38 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:38.180+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:38.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:38 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:38.180+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:38.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:38 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:38.180+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:38.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:38 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:38.128+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:38.415 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:38 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:38.128+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:38.415 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:38 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:38.128+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:38.415 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:38 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:38.128+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:38.621 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:38 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:38.276+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:38.621 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:38 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:38.276+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:38.621 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:38 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:38.276+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:38.621 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:38 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:38.276+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:38.878 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:38 smithi018 podman[114543]: 2024-09-19 10:06:38.619183317 +0000 UTC m=+5.708745397 container died 1855421b6e0abdc372d1b6d67a3d9ff295a5583901994ca3f399fce02fe51be1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T10:06:39.135 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:38 smithi018 podman[114543]: 2024-09-19 10:06:38.967249645 +0000 UTC m=+6.056811724 container cleanup 1855421b6e0abdc372d1b6d67a3d9ff295a5583901994ca3f399fce02fe51be1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:06:39.136 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:38 smithi018 bash[114543]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6 2024-09-19T10:06:39.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:38 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:38.664+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:39.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:38 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:38.664+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:39.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:38 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:38.664+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:13.876916+0000 front 2024-09-19T10:06:13.876834+0000 (oldest deadline 2024-09-19T10:06:37.376770+0000) 2024-09-19T10:06:39.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:38 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:38.798+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:39.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:38 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:38.798+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:39.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:38 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:38.798+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:39.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:38 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:38.798+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:39.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:39 smithi018 podman[114560]: 2024-09-19 10:06:39.147940772 +0000 UTC m=+0.522095329 container remove 1855421b6e0abdc372d1b6d67a3d9ff295a5583901994ca3f399fce02fe51be1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T10:06:39.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:39 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:39.266+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:39.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:39 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:39.266+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:39.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:39 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:39.266+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:39.597 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:39 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:39.266+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:39.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:39.192+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:39.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:39.192+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:39.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:39.192+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:39.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:39.172+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:39.665 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:39.172+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:39.665 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:39.172+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:39.665 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:39 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:39.172+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:39.885 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:39 smithi018 podman[114651]: 2024-09-19 10:06:39.594392695 +0000 UTC m=+0.112967502 container create d19c9b29d2547923244fc6c90dee9d74f2a486f45ef773d77bd1c382f7f08772 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T10:06:39.886 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:39 smithi018 podman[114651]: 2024-09-19 10:06:39.4981662 +0000 UTC m=+0.016741008 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:06:39.886 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:39 smithi018 podman[114651]: 2024-09-19 10:06:39.813435489 +0000 UTC m=+0.332010299 container init d19c9b29d2547923244fc6c90dee9d74f2a486f45ef773d77bd1c382f7f08772 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T10:06:39.886 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:39 smithi018 podman[114651]: 2024-09-19 10:06:39.816888463 +0000 UTC m=+0.335463278 container start d19c9b29d2547923244fc6c90dee9d74f2a486f45ef773d77bd1c382f7f08772 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T10:06:39.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:39.630+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:39.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:39.630+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:39.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:39.630+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:13.876916+0000 front 2024-09-19T10:06:13.876834+0000 (oldest deadline 2024-09-19T10:06:37.376770+0000) 2024-09-19T10:06:39.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:39.820+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:39.902 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:39.820+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:39.902 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:39.820+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:39.902 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:39.820+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:40.284 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:39 smithi018 podman[114651]: 2024-09-19 10:06:39.918888161 +0000 UTC m=+0.437462970 container attach d19c9b29d2547923244fc6c90dee9d74f2a486f45ef773d77bd1c382f7f08772 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T10:06:40.284 INFO:journalctl@ceph.osd.6.smithi018.stdout:Sep 19 10:06:40 smithi018 podman[114651]: 2024-09-19 10:06:40.009490283 +0000 UTC m=+0.528065094 container died d19c9b29d2547923244fc6c90dee9d74f2a486f45ef773d77bd1c382f7f08772 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T10:06:40.619 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:40 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:40.281+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:40.619 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:40 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:40.281+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:40.619 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:40 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:40.281+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:40.619 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:40 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:40.281+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:40.639 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T10:06:40.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:40 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:40.170+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:40.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:40 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:40.170+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:40.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:40 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:40.170+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:40.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:40 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:40.191+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:40.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:40 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:40.191+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:40.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:40 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:40.191+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:40.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:40 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:40.191+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:40.679 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:06:40.680 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T10:06:40.680 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T10:06:40.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.7 2024-09-19T10:06:41.144 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:40 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:40.651+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:41.144 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:40 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:40.651+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:41.144 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:40 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:40.651+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:13.876916+0000 front 2024-09-19T10:06:13.876834+0000 (oldest deadline 2024-09-19T10:06:37.376770+0000) 2024-09-19T10:06:41.144 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:40 smithi049 systemd[1]: Stopping Ceph osd.7 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:06:41.145 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:41 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:41.141+0000 7fe781727640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:06:41.145 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:41 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:41.141+0000 7fe781727640 -1 osd.7 87 *** Got signal Terminated *** 2024-09-19T10:06:41.145 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:41 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:41.141+0000 7fe781727640 -1 osd.7 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:06:41.145 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:40 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:40.855+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:41.145 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:40 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:40.855+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:41.145 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:40 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:40.855+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:41.145 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:40 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:40.855+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:41.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:41 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:41.171+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:41.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:41 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:41.171+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:41.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:41 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:41.171+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:41.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:41 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:41.153+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:41.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:41 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:41.153+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:41.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:41 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:41.153+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:41.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:41 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:41.153+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:41.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:41 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:41.295+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:41.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:41 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:41.295+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:41.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:41 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:41.295+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:41.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:41 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:41.295+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:42.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:41 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:41.668+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:42.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:41 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:41.668+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:42.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:41 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:41.668+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:13.876916+0000 front 2024-09-19T10:06:13.876834+0000 (oldest deadline 2024-09-19T10:06:37.376770+0000) 2024-09-19T10:06:42.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:41 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:41.866+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:42.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:41 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:41.866+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:42.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:41 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:41.866+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:42.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:41 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:41.866+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:42.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:42 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:42.197+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:42.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:42 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:42.197+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:42.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:42 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:42.197+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:42.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:42 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:42.160+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:42.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:42 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:42.160+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:42.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:42 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:42.160+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:42.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:42 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:42.160+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:42.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:42 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:42.329+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:42.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:42 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:42.329+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:42.637 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:42 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:42.329+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:42.637 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:42 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:42.329+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:43.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:42.650+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:43.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:42.650+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:43.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:42.650+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:13.876916+0000 front 2024-09-19T10:06:13.876834+0000 (oldest deadline 2024-09-19T10:06:37.376770+0000) 2024-09-19T10:06:43.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:42.891+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:43.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:42.891+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:43.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:42.891+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:43.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:42.891+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:43.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:43 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:43.325+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:43.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:43 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:43.325+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:43.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:43 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:43.325+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:43.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:43 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:43.325+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:43.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:43 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:43.223+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:43.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:43 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:43.223+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:43.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:43 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:43.223+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:43.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:43 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:43.206+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:43.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:43 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:43.206+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:43.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:43 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:43.206+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:43.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:43 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:43.206+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:44.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:43 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:43.650+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:44.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:43 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:43.650+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:44.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:43 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:43.650+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:13.876916+0000 front 2024-09-19T10:06:13.876834+0000 (oldest deadline 2024-09-19T10:06:37.376770+0000) 2024-09-19T10:06:44.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:43 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:43.888+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:44.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:43 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:43.888+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:44.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:43 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:43.888+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:44.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:43 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:43.888+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:44.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:43 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:43.888+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:44.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:44 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:44.289+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:44.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:44 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:44.289+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:44.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:44 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:44.289+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:44.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:44 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:44.289+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:44.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:44 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:44.177+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:44.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:44 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:44.177+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:44.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:44 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:44.177+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:44.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:44 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:44.171+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:44.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:44 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:44.171+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:44.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:44 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:44.171+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:44.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:44 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:44.171+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:44.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:44 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:44.171+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:45.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:44 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:44.651+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:45.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:44 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:44.651+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:45.151 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:44 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:44.651+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:13.876916+0000 front 2024-09-19T10:06:13.876834+0000 (oldest deadline 2024-09-19T10:06:37.376770+0000) 2024-09-19T10:06:45.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:44 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:44.840+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:45.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:44 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:44.840+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:45.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:44 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:44.840+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:45.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:44 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:44.840+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:45.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:44 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:44.840+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:45.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:45 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:45.137+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:45.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:45 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:45.137+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:45.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:45 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:45.137+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:45.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:45 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:45.157+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:45.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:45 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:45.157+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:45.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:45 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:45.157+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:45.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:45 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:45.157+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:45.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:45 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:45.157+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:45.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:45 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:45.265+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:45.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:45 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:45.265+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:45.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:45 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:45.265+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:45.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:45 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:45.265+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:45.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:45 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:45.637+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.474142+0000 front 2024-09-19T10:05:57.474168+0000 (oldest deadline 2024-09-19T10:06:24.475031+0000) 2024-09-19T10:06:45.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:45 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:45.637+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:04.475685+0000 front 2024-09-19T10:06:04.475498+0000 (oldest deadline 2024-09-19T10:06:28.575588+0000) 2024-09-19T10:06:45.902 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:45 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:45.637+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:13.876916+0000 front 2024-09-19T10:06:13.876834+0000 (oldest deadline 2024-09-19T10:06:37.376770+0000) 2024-09-19T10:06:45.902 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:45 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7[53336]: 2024-09-19T10:06:45.637+0000 7fe779d24640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:17.377142+0000 front 2024-09-19T10:06:17.377068+0000 (oldest deadline 2024-09-19T10:06:44.977631+0000) 2024-09-19T10:06:45.902 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:45 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:45.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:45.902 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:45 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:45.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:45.902 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:45 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:45.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:45.902 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:45 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:45.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:45.902 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:45 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:45.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:46.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:46 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:46.100+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:46.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:46 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:46.100+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:46.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:46 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:46.100+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:46.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:46 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:46.192+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:46.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:46 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:46.192+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:46.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:46 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:46.192+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:46.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:46 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:46.192+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:46.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:46 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:46.192+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:46.635 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:46 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:46.276+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:46.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:46 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:46.276+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:46.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:46 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:46.276+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:46.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:46 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:46.276+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:46.901 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:46 smithi049 podman[70540]: 2024-09-19 10:06:46.558619053 +0000 UTC m=+5.675325077 container died b9b79ced0580455164ac7f1e052e140d2b2afdbe4802519ecc8749560743f5f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-19T10:06:46.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:46 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:46.759+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:46.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:46 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:46.759+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:46.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:46 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:46.759+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:46.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:46 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:46.759+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:46.902 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:46 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:46.759+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:47.312 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:47 smithi049 podman[70540]: 2024-09-19 10:06:47.051001868 +0000 UTC m=+6.167707881 container cleanup b9b79ced0580455164ac7f1e052e140d2b2afdbe4802519ecc8749560743f5f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T10:06:47.312 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:47 smithi049 bash[70540]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7 2024-09-19T10:06:47.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:47 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:47.150+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:47.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:47 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:47.150+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:47.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:47 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:47.150+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:47.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:47 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:47.150+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:22.001465+0000 front 2024-09-19T10:06:22.001476+0000 (oldest deadline 2024-09-19T10:06:46.701377+0000) 2024-09-19T10:06:47.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:47 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:47.184+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:47.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:47 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:47.184+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:47.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:47 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:47.184+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:47.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:47 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:47.184+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:47.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:47 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:47.184+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:47.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:47 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:47.284+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:47.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:47 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:47.284+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:47.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:47 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:47.284+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:47.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:47 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:47.284+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:47.651 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:47 smithi049 podman[70557]: 2024-09-19 10:06:47.310596226 +0000 UTC m=+0.746722511 container remove b9b79ced0580455164ac7f1e052e140d2b2afdbe4802519ecc8749560743f5f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T10:06:47.999 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:47 smithi049 podman[70643]: 2024-09-19 10:06:47.585421705 +0000 UTC m=+0.016857864 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:06:47.999 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:47 smithi049 podman[70643]: 2024-09-19 10:06:47.686292787 +0000 UTC m=+0.117728944 container create 12f8d4e8b7771c5f1dc250d471b6c9a6a131f0fbd9d92b07aa78bf25075013d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T10:06:47.999 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:47 smithi049 podman[70643]: 2024-09-19 10:06:47.913742639 +0000 UTC m=+0.345178800 container init 12f8d4e8b7771c5f1dc250d471b6c9a6a131f0fbd9d92b07aa78bf25075013d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T10:06:47.999 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:47 smithi049 podman[70643]: 2024-09-19 10:06:47.917042061 +0000 UTC m=+0.348478234 container start 12f8d4e8b7771c5f1dc250d471b6c9a6a131f0fbd9d92b07aa78bf25075013d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:06:47.999 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:47 smithi049 podman[70643]: 2024-09-19 10:06:47.997040174 +0000 UTC m=+0.428476345 container attach 12f8d4e8b7771c5f1dc250d471b6c9a6a131f0fbd9d92b07aa78bf25075013d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T10:06:48.000 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:47 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:47.755+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:48.000 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:47 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:47.755+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:48.000 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:47 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:47.755+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:48.000 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:47 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:47.755+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:48.000 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:47 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:47.755+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:48.400 INFO:journalctl@ceph.osd.7.smithi049.stdout:Sep 19 10:06:48 smithi049 podman[70643]: 2024-09-19 10:06:48.116220964 +0000 UTC m=+0.547657123 container died 12f8d4e8b7771c5f1dc250d471b6c9a6a131f0fbd9d92b07aa78bf25075013d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T10:06:48.413 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:48.149+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:48.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:48.149+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:48.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:48.149+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:48.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:48.149+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:22.001465+0000 front 2024-09-19T10:06:22.001476+0000 (oldest deadline 2024-09-19T10:06:46.701377+0000) 2024-09-19T10:06:48.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:48.221+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:48.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:48.221+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:48.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:48.221+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:48.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:48.221+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:48.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:48 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:48.221+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:48.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:48 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:48.240+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:48.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:48 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:48.240+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:48.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:48 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:48.240+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:48.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:48 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:48.240+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:48.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T10:06:48.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:06:48.820 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T10:06:48.821 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T10:06:48.821 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.8 2024-09-19T10:06:49.123 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:48 smithi162 systemd[1]: Stopping Ceph osd.8 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:06:49.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:48 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:48.748+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:49.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:48 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:48.748+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:49.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:48 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:48.748+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:49.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:48 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:48.748+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:49.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:48 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:48.748+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:49.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:49.269+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:49.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:49.269+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:49.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:49.269+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:49.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:49.269+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:49.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:49.269+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:49.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:49.120+0000 7f9251f85640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:06:49.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:49.120+0000 7f9251f85640 -1 osd.8 87 *** Got signal Terminated *** 2024-09-19T10:06:49.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:49.120+0000 7f9251f85640 -1 osd.8 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:06:49.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:49.160+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:49.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:49.160+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:49.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:49.160+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:49.415 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:49 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:49.160+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:22.001465+0000 front 2024-09-19T10:06:22.001476+0000 (oldest deadline 2024-09-19T10:06:46.701377+0000) 2024-09-19T10:06:49.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:49 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:49.245+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:49.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:49 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:49.245+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:49.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:49 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:49.245+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:49.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:49 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:49.245+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:50.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:49 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:49.751+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:50.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:49 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:49.751+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:50.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:49 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:49.751+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:50.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:49 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:49.751+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:50.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:49 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:49.751+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:50.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:50 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:50.267+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:50.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:50 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:50.267+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:50.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:50 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:50.267+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:50.637 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:50 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:50.267+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:50.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:50 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:50.190+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:50.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:50 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:50.190+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:50.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:50 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:50.190+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:50.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:50 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:50.190+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:22.001465+0000 front 2024-09-19T10:06:22.001476+0000 (oldest deadline 2024-09-19T10:06:46.701377+0000) 2024-09-19T10:06:50.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:50 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:50.250+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:50.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:50 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:50.250+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:50.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:50 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:50.250+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:50.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:50 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:50.250+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:50.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:50 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:50.250+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:51.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:50 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:50.761+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:51.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:50 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:50.761+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:51.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:50 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:50.761+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:51.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:50 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:50.761+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:51.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:50 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:50.761+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:51.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:51 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:51.222+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:51.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:51 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:51.222+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:51.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:51 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:51.222+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:51.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:51 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:51.222+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:51.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:51 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:51.222+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:06:51.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:51 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:51.198+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:51.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:51 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:51.198+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:51.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:51 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:51.198+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:51.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:51 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:51.198+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:22.001465+0000 front 2024-09-19T10:06:22.001476+0000 (oldest deadline 2024-09-19T10:06:46.701377+0000) 2024-09-19T10:06:51.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:51 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:51.201+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:51.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:51 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:51.201+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:51.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:51 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:51.201+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:51.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:51 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:51.201+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:51.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:51 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:51.201+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:52.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:51 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:51.802+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:52.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:51 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:51.802+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:52.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:51 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:51.802+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:52.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:51 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:51.802+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:52.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:51 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:51.802+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:52.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:52 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:52.200+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:52.637 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:52 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:52.200+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:52.637 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:52 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:52.200+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:52.637 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:52 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:52.200+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:52.638 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:52 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:52.200+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:06:52.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:52.192+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:52.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:52.192+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:52.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:52.192+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:52.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:52.192+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:22.001465+0000 front 2024-09-19T10:06:22.001476+0000 (oldest deadline 2024-09-19T10:06:46.701377+0000) 2024-09-19T10:06:52.664 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:52.192+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:26.701758+0000 front 2024-09-19T10:06:26.701793+0000 (oldest deadline 2024-09-19T10:06:51.401835+0000) 2024-09-19T10:06:52.665 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:52.179+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:52.665 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:52.179+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:52.665 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:52.179+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:52.665 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:52.179+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:52.665 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:52.179+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:52.665 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:52 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:52.179+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:06:53.052 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:52 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:52.772+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:53.052 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:52 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:52.772+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:53.052 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:52 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:52.772+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:53.053 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:52 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:52.772+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:53.053 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:52 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:52.772+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:53.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:53.140+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:53.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:53.140+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:53.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:53.140+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:53.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:53.140+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:53.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:53.140+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:53.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:53.140+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:06:53.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:53.201+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.597473+0000 front 2024-09-19T10:05:57.597489+0000 (oldest deadline 2024-09-19T10:06:21.097284+0000) 2024-09-19T10:06:53.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:53.201+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:02.198170+0000 front 2024-09-19T10:06:02.198116+0000 (oldest deadline 2024-09-19T10:06:28.098316+0000) 2024-09-19T10:06:53.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:53.201+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:12.799437+0000 front 2024-09-19T10:06:12.799467+0000 (oldest deadline 2024-09-19T10:06:35.699426+0000) 2024-09-19T10:06:53.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:53.201+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:22.001465+0000 front 2024-09-19T10:06:22.001476+0000 (oldest deadline 2024-09-19T10:06:46.701377+0000) 2024-09-19T10:06:53.415 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:53 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8[53749]: 2024-09-19T10:06:53.201+0000 7f924e58a640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:26.701758+0000 front 2024-09-19T10:06:26.701793+0000 (oldest deadline 2024-09-19T10:06:51.401835+0000) 2024-09-19T10:06:53.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:53.169+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:53.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:53.169+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:53.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:53.169+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:53.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:53.169+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:53.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:53 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:53.169+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:06:54.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:53 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:53.776+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:54.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:53 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:53.776+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:54.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:53 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:53.776+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:54.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:53 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:53.776+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:54.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:53 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:53.776+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:54.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:54 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:54.169+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:54.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:54 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:54.169+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:54.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:54 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:54.169+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:54.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:54 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:54.169+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:54.636 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:54 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:54.169+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:06:54.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:54 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:54.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:54.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:54 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:54.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:54.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:54 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:54.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:54.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:54 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:54.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:54.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:54 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:54.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:54.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:54 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:54.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:06:54.947 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:54 smithi162 podman[71141]: 2024-09-19 10:06:54.672733442 +0000 UTC m=+5.659576693 container died dbae38d8f31136d2f314c69feabb8ce32f8e9beb91652cf977b394e7c4e4c689 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T10:06:55.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:54 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:54.812+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:55.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:54 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:54.812+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:55.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:54 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:54.812+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:55.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:54 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:54.812+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:55.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:54 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:54.812+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:55.230 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:55 smithi162 podman[71141]: 2024-09-19 10:06:55.044956875 +0000 UTC m=+6.031800123 container cleanup dbae38d8f31136d2f314c69feabb8ce32f8e9beb91652cf977b394e7c4e4c689 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T10:06:55.230 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:55 smithi162 bash[71141]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8 2024-09-19T10:06:55.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:55 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:55.125+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:55.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:55 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:55.125+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:55.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:55 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:55.125+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:55.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:55 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:55.125+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:55.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:55 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:55.125+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:06:55.663 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:55 smithi162 podman[71156]: 2024-09-19 10:06:55.345964491 +0000 UTC m=+0.673236265 container remove dbae38d8f31136d2f314c69feabb8ce32f8e9beb91652cf977b394e7c4e4c689 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T10:06:55.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:55 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:55.226+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:55.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:55 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:55.226+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:55.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:55 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:55.226+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:55.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:55 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:55.226+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:55.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:55 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:55.226+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:55.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:55 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:55.226+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:06:56.042 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:55 smithi162 podman[71243]: 2024-09-19 10:06:55.609217898 +0000 UTC m=+0.015935516 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:06:56.043 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:55 smithi162 podman[71243]: 2024-09-19 10:06:55.713459551 +0000 UTC m=+0.120177167 container create 416e58c2b46c116a191a796e745d800c4b876e3a7be66c29fe2c9afdae7b937b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T10:06:56.043 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:55 smithi162 podman[71243]: 2024-09-19 10:06:55.949237721 +0000 UTC m=+0.355955339 container init 416e58c2b46c116a191a796e745d800c4b876e3a7be66c29fe2c9afdae7b937b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T10:06:56.043 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:55 smithi162 podman[71243]: 2024-09-19 10:06:55.952579361 +0000 UTC m=+0.359296979 container start 416e58c2b46c116a191a796e745d800c4b876e3a7be66c29fe2c9afdae7b937b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T10:06:56.043 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:56 smithi162 podman[71243]: 2024-09-19 10:06:56.040977335 +0000 UTC m=+0.447694967 container attach 416e58c2b46c116a191a796e745d800c4b876e3a7be66c29fe2c9afdae7b937b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T10:06:56.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:55 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:55.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:56.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:55 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:55.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:56.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:55 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:55.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:56.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:55 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:55.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:56.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:55 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:55.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:56.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:55 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:55.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:06:56.385 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:56 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:56.084+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:56.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:56 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:56.084+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:56.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:56 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:56.084+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:56.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:56 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:56.084+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:56.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:56 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:56.084+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:06:56.414 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 10:06:56 smithi162 podman[71243]: 2024-09-19 10:06:56.148341983 +0000 UTC m=+0.555059751 container died 416e58c2b46c116a191a796e745d800c4b876e3a7be66c29fe2c9afdae7b937b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T10:06:56.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:56 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:56.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:56.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:56 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:56.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:56.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:56 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:56.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:56.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:56 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:56.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:56.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:56 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:56.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:56.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:56 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:56.180+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:06:56.760 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T10:06:56.798 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:06:56.799 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T10:06:56.799 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T10:06:56.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.9 2024-09-19T10:06:57.104 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:56 smithi018 systemd[1]: Stopping Ceph osd.9 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:06:57.104 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:57.070+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:57.104 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:57.070+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:57.104 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:57.070+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:57.105 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:57.070+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:57.105 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:57.070+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:06:57.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:56 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:56.823+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:57.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:56 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:56.823+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:57.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:56 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:56.823+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:57.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:56 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:56.823+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:57.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:56 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:56.823+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:57.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:56 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:56.823+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:06:57.385 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:57.101+0000 7fe070ee8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:06:57.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:57.101+0000 7fe070ee8640 -1 osd.9 87 *** Got signal Terminated *** 2024-09-19T10:06:57.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:57 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:57.101+0000 7fe070ee8640 -1 osd.9 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:06:57.392 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:57 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:57.133+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:57.393 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:57 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:57.133+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:57.393 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:57 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:57.133+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:57.393 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:57 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:57.133+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:57.393 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:57 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:57.133+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:57.393 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:57 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:57.133+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:06:58.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:57 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:57.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:58.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:57 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:57.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:58.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:57 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:57.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:58.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:57 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:57.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:58.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:57 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:57.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:58.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:57 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:57.831+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:06:58.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:58 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:58.079+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:58.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:58 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:58.079+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:58.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:58 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:58.079+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:58.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:58 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:58.079+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:58.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:58 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:58.079+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:06:58.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:58 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:58.141+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:58.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:58 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:58.141+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:58.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:58 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:58.141+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:58.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:58 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:58.141+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:58.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:58 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:58.141+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:58.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:58 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:58.141+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:06:59.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:58 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:58.798+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:06:59.225 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:58 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:58.798+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:06:59.225 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:58 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:58.798+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:06:59.225 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:58 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:58.798+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:06:59.225 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:58 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:58.798+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:06:59.225 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:58 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:58.798+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:06:59.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:59 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:59.055+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:06:59.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:59 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:59.055+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:06:59.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:59 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:59.055+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:06:59.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:59 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:59.055+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:06:59.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:06:59 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:06:59.055+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:06:59.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:59 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:59.111+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:06:59.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:59 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:59.111+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:06:59.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:59 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:59.111+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:06:59.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:59 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:59.111+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:06:59.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:59 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:59.111+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:06:59.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:06:59 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:06:59.111+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:00.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:59 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:59.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:00.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:59 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:59.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:00.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:59 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:59.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:00.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:59 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:59.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:00.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:59 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:59.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:00.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:06:59 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:06:59.791+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:00.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:00 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:00.033+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:07:00.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:00 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:00.033+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:07:00.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:00 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:00.033+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:07:00.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:00 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:00.033+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:07:00.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:00 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:00.033+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:07:00.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:00 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:00.154+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:00.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:00 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:00.154+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:00.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:00 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:00.154+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:00.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:00 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:00.154+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:00.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:00 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:00.154+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:00.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:00 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:00.154+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:01.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:00 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:00.760+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:01.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:00 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:00.760+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:01.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:00 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:00.760+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:01.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:00 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:00.760+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:01.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:00 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:00.760+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:01.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:00 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:00.760+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:01.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:00 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:00.760+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:34.954173+0000 front 2024-09-19T10:06:34.954156+0000 (oldest deadline 2024-09-19T10:07:00.254001+0000) 2024-09-19T10:07:01.385 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:01.075+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:07:01.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:01.075+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:07:01.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:01.075+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:07:01.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:01.075+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:07:01.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:01.075+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:07:01.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:01 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:01.075+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:35.592611+0000 front 2024-09-19T10:06:35.592583+0000 (oldest deadline 2024-09-19T10:07:00.892643+0000) 2024-09-19T10:07:01.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:01 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:01.199+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:01.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:01 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:01.199+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:01.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:01 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:01.199+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:01.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:01 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:01.199+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:01.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:01 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:01.199+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:01.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:01 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:01.199+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:02.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:01 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:01.777+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:02.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:01 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:01.777+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:02.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:01 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:01.777+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:02.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:01 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:01.777+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:02.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:01 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:01.777+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:02.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:01 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:01.777+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:02.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:01 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:01.777+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:34.954173+0000 front 2024-09-19T10:06:34.954156+0000 (oldest deadline 2024-09-19T10:07:00.254001+0000) 2024-09-19T10:07:02.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:02 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:02.054+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:48.485167+0000 front 2024-09-19T10:05:48.485579+0000 (oldest deadline 2024-09-19T10:06:13.785275+0000) 2024-09-19T10:07:02.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:02 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:02.054+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.186500+0000 front 2024-09-19T10:05:57.186526+0000 (oldest deadline 2024-09-19T10:06:18.886551+0000) 2024-09-19T10:07:02.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:02 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:02.054+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.188768+0000 front 2024-09-19T10:06:05.188635+0000 (oldest deadline 2024-09-19T10:06:29.888580+0000) 2024-09-19T10:07:02.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:02 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:02.054+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:11.589303+0000 front 2024-09-19T10:06:11.589478+0000 (oldest deadline 2024-09-19T10:06:35.689414+0000) 2024-09-19T10:07:02.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:02 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:02.054+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.191963+0000 front 2024-09-19T10:06:29.191889+0000 (oldest deadline 2024-09-19T10:06:50.891806+0000) 2024-09-19T10:07:02.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:02 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9[64834]: 2024-09-19T10:07:02.054+0000 7fe06d4ed640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:35.592611+0000 front 2024-09-19T10:06:35.592583+0000 (oldest deadline 2024-09-19T10:07:00.892643+0000) 2024-09-19T10:07:02.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:02 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:02.197+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:02.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:02 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:02.197+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:02.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:02 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:02.197+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:02.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:02 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:02.197+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:02.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:02 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:02.197+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:02.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:02 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:02.197+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:02.885 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:02 smithi018 podman[114766]: 2024-09-19 10:07:02.628378689 +0000 UTC m=+5.620917639 container died 660f3fae54bfab5121da6232996eeba2a5132fbe409d684883f726feee54d58b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T10:07:03.106 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:02 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:02.767+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:03.106 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:02 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:02.767+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:03.106 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:02 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:02.767+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:03.106 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:02 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:02.767+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:03.107 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:02 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:02.767+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:03.107 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:02 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:02.767+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:03.107 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:02 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:02.767+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:34.954173+0000 front 2024-09-19T10:06:34.954156+0000 (oldest deadline 2024-09-19T10:07:00.254001+0000) 2024-09-19T10:07:03.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:03 smithi018 podman[114766]: 2024-09-19 10:07:03.050903512 +0000 UTC m=+6.043442460 container cleanup 660f3fae54bfab5121da6232996eeba2a5132fbe409d684883f726feee54d58b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T10:07:03.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:03 smithi018 bash[114766]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9 2024-09-19T10:07:03.386 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:03 smithi018 podman[114781]: 2024-09-19 10:07:03.25224207 +0000 UTC m=+0.625956075 container remove 660f3fae54bfab5121da6232996eeba2a5132fbe409d684883f726feee54d58b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:07:03.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:03 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:03.235+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:03.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:03 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:03.235+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:03.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:03 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:03.235+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:03.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:03 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:03.235+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:03.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:03 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:03.235+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:03.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:03 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:03.235+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:03.886 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:03 smithi018 podman[114872]: 2024-09-19 10:07:03.59484287 +0000 UTC m=+0.103969438 container create 7e78a119767f132d193346bce6dea12e9f7932b7bc38a9c0744deef25d619f3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T10:07:03.886 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:03 smithi018 podman[114872]: 2024-09-19 10:07:03.506891682 +0000 UTC m=+0.016018178 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:07:03.886 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:03 smithi018 podman[114872]: 2024-09-19 10:07:03.830559448 +0000 UTC m=+0.339685952 container init 7e78a119767f132d193346bce6dea12e9f7932b7bc38a9c0744deef25d619f3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T10:07:03.886 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:03 smithi018 podman[114872]: 2024-09-19 10:07:03.833871804 +0000 UTC m=+0.342998304 container start 7e78a119767f132d193346bce6dea12e9f7932b7bc38a9c0744deef25d619f3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T10:07:04.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:03 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:03.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:04.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:03 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:03.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:04.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:03 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:03.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:04.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:03 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:03.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:04.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:03 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:03.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:04.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:03 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:03.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:04.152 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:03 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:03.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:34.954173+0000 front 2024-09-19T10:06:34.954156+0000 (oldest deadline 2024-09-19T10:07:00.254001+0000) 2024-09-19T10:07:04.376 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:03 smithi018 podman[114872]: 2024-09-19 10:07:03.913759421 +0000 UTC m=+0.422885931 container attach 7e78a119767f132d193346bce6dea12e9f7932b7bc38a9c0744deef25d619f3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T10:07:04.376 INFO:journalctl@ceph.osd.9.smithi018.stdout:Sep 19 10:07:04 smithi018 podman[114872]: 2024-09-19 10:07:04.029993874 +0000 UTC m=+0.539120371 container died 7e78a119767f132d193346bce6dea12e9f7932b7bc38a9c0744deef25d619f3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T10:07:04.662 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T10:07:04.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:04 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:04.246+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:04.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:04 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:04.246+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:04.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:04 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:04.247+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:04.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:04 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:04.247+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:04.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:04 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:04.247+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:04.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:04 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:04.247+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:04.704 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:04.704 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T10:07:04.705 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T10:07:04.705 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.10 2024-09-19T10:07:05.014 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:04 smithi049 systemd[1]: Stopping Ceph osd.10 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:05.014 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:04 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:04.770+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:05.014 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:04 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:04.770+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:05.014 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:04 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:04.770+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:05.014 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:04 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:04.770+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:05.014 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:04 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:04.770+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:05.014 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:04 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:04.770+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:05.015 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:04 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:04.770+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:34.954173+0000 front 2024-09-19T10:06:34.954156+0000 (oldest deadline 2024-09-19T10:07:00.254001+0000) 2024-09-19T10:07:05.015 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:05 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:05.010+0000 7fe19877a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:05.015 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:05 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:05.010+0000 7fe19877a640 -1 osd.10 87 *** Got signal Terminated *** 2024-09-19T10:07:05.015 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:05 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:05.010+0000 7fe19877a640 -1 osd.10 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:07:05.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:05 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:05.206+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:05.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:05 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:05.206+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:05.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:05 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:05.206+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:05.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:05 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:05.206+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:05.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:05 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:05.206+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:05.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:05 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:05.206+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:06.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:05 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:05.809+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:06.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:05 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:05.809+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:06.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:05 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:05.809+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:06.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:05 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:05.809+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:06.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:05 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:05.809+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:06.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:05 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:05.809+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:06.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:05 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:05.809+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:34.954173+0000 front 2024-09-19T10:06:34.954156+0000 (oldest deadline 2024-09-19T10:07:00.254001+0000) 2024-09-19T10:07:06.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:06 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:06.187+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:06.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:06 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:06.187+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:06.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:06 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:06.187+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:06.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:06 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:06.187+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:06.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:06 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:06.187+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:06.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:06 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:06.187+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:07.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:06 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:06.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:07.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:06 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:06.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:07.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:06 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:06.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:07.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:06 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:06.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:07.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:06 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:06.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:07.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:06 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:06.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:07.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:06 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:06.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:34.954173+0000 front 2024-09-19T10:06:34.954156+0000 (oldest deadline 2024-09-19T10:07:00.254001+0000) 2024-09-19T10:07:07.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:07 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:07.193+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:07.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:07 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:07.193+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:07.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:07 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:07.193+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:07.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:07 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:07.193+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:07.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:07 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:07.194+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:07.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:07 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:07.194+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:08.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:07 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:07.738+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:08.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:07 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:07.738+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:08.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:07 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:07.738+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:08.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:07 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:07.738+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:08.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:07 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:07.738+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:08.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:07 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:07.738+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:08.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:07 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:07.738+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:34.954173+0000 front 2024-09-19T10:06:34.954156+0000 (oldest deadline 2024-09-19T10:07:00.254001+0000) 2024-09-19T10:07:08.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:08 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:08.155+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:08.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:08 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:08.155+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:08.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:08 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:08.155+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:08.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:08 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:08.155+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:08.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:08 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:08.155+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:08.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:08 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:08.155+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:08.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:08 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:08.155+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6820 osd.7 since back 2024-09-19T10:06:45.728713+0000 front 2024-09-19T10:06:45.728689+0000 (oldest deadline 2024-09-19T10:07:08.028545+0000) 2024-09-19T10:07:09.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:08 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:08.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:09.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:08 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:08.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:09.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:08 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:08.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:09.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:08 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:08.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:09.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:08 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:08.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:09.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:08 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:08.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:09.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:08 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:08.781+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:34.954173+0000 front 2024-09-19T10:06:34.954156+0000 (oldest deadline 2024-09-19T10:07:00.254001+0000) 2024-09-19T10:07:09.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:09 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:09.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:09.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:09 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:09.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:09.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:09 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:09.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:09.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:09 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:09.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:09.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:09 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:09.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:09.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:09 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:09.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:09.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:09 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:09.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6820 osd.7 since back 2024-09-19T10:06:45.728713+0000 front 2024-09-19T10:06:45.728689+0000 (oldest deadline 2024-09-19T10:07:08.028545+0000) 2024-09-19T10:07:10.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:09 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:09.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:45.848138+0000 front 2024-09-19T10:05:45.847943+0000 (oldest deadline 2024-09-19T10:06:11.147946+0000) 2024-09-19T10:07:10.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:09 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:09.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:56.949595+0000 front 2024-09-19T10:05:56.949613+0000 (oldest deadline 2024-09-19T10:06:24.550140+0000) 2024-09-19T10:07:10.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:09 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:09.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:05.651152+0000 front 2024-09-19T10:06:05.651270+0000 (oldest deadline 2024-09-19T10:06:30.351090+0000) 2024-09-19T10:07:10.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:09 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:09.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:10.852263+0000 front 2024-09-19T10:06:10.852133+0000 (oldest deadline 2024-09-19T10:06:38.452365+0000) 2024-09-19T10:07:10.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:09 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:09.807+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.452710+0000 front 2024-09-19T10:06:18.452676+0000 (oldest deadline 2024-09-19T10:06:43.752778+0000) 2024-09-19T10:07:10.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:09 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:09.808+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:29.053787+0000 front 2024-09-19T10:06:29.053707+0000 (oldest deadline 2024-09-19T10:06:54.953571+0000) 2024-09-19T10:07:10.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:09 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10[59953]: 2024-09-19T10:07:09.808+0000 7fe194d7f640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-09-19T10:06:34.954173+0000 front 2024-09-19T10:06:34.954156+0000 (oldest deadline 2024-09-19T10:07:00.254001+0000) 2024-09-19T10:07:10.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:10 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:10.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:10.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:10 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:10.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:10.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:10 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:10.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:10.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:10 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:10.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:10.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:10 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:10.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:10.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:10 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:10.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:10.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:10 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:10.164+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6820 osd.7 since back 2024-09-19T10:06:45.728713+0000 front 2024-09-19T10:06:45.728689+0000 (oldest deadline 2024-09-19T10:07:08.028545+0000) 2024-09-19T10:07:10.846 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:10 smithi049 podman[70760]: 2024-09-19 10:07:10.586102116 +0000 UTC m=+5.678963889 container died caeddc6853e35d27354b0e034f7b744e591f94f1dda1b2fb880f29e40db0e690 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T10:07:11.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:10 smithi049 podman[70760]: 2024-09-19 10:07:10.94391407 +0000 UTC m=+6.036775841 container cleanup caeddc6853e35d27354b0e034f7b744e591f94f1dda1b2fb880f29e40db0e690 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T10:07:11.151 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:10 smithi049 bash[70760]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10 2024-09-19T10:07:11.571 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:11 smithi049 podman[70778]: 2024-09-19 10:07:11.228491038 +0000 UTC m=+0.638782767 container remove caeddc6853e35d27354b0e034f7b744e591f94f1dda1b2fb880f29e40db0e690 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T10:07:11.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:11 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:11.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:11.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:11 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:11.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:11.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:11 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:11.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:11.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:11 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:11.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:11.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:11 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:11.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:11.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:11 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:11.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:11.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:11 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:11.161+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6820 osd.7 since back 2024-09-19T10:06:45.728713+0000 front 2024-09-19T10:06:45.728689+0000 (oldest deadline 2024-09-19T10:07:08.028545+0000) 2024-09-19T10:07:11.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:11 smithi049 podman[70862]: 2024-09-19 10:07:11.472235805 +0000 UTC m=+0.016191925 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:07:11.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:11 smithi049 podman[70862]: 2024-09-19 10:07:11.570572585 +0000 UTC m=+0.114528707 container create a813bedc060135c7e1f696d8c268bf5a931180a1e60f9f02d5fbeb5961f8dfa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T10:07:11.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:11 smithi049 podman[70862]: 2024-09-19 10:07:11.797965978 +0000 UTC m=+0.341922112 container init a813bedc060135c7e1f696d8c268bf5a931180a1e60f9f02d5fbeb5961f8dfa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T10:07:11.901 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:11 smithi049 podman[70862]: 2024-09-19 10:07:11.801266485 +0000 UTC m=+0.345222605 container start a813bedc060135c7e1f696d8c268bf5a931180a1e60f9f02d5fbeb5961f8dfa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T10:07:12.364 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:11 smithi049 podman[70862]: 2024-09-19 10:07:11.906631557 +0000 UTC m=+0.450587691 container attach a813bedc060135c7e1f696d8c268bf5a931180a1e60f9f02d5fbeb5961f8dfa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T10:07:12.364 INFO:journalctl@ceph.osd.10.smithi049.stdout:Sep 19 10:07:12 smithi049 podman[70862]: 2024-09-19 10:07:12.007189806 +0000 UTC m=+0.551145928 container died a813bedc060135c7e1f696d8c268bf5a931180a1e60f9f02d5fbeb5961f8dfa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T10:07:12.663 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:12 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:12.168+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:12.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:12 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:12.168+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:12.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:12 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:12.168+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:12.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:12 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:12.168+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:12.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:12 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:12.168+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:12.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:12 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:12.168+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:12.664 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:12 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:12.168+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6820 osd.7 since back 2024-09-19T10:06:45.728713+0000 front 2024-09-19T10:06:45.728689+0000 (oldest deadline 2024-09-19T10:07:08.028545+0000) 2024-09-19T10:07:12.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T10:07:12.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:12.718 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T10:07:12.718 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T10:07:12.719 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.11 2024-09-19T10:07:13.014 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:12 smithi162 systemd[1]: Stopping Ceph osd.11 for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:13.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:13.012+0000 7fd6fd903640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:13.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:13.012+0000 7fd6fd903640 -1 osd.11 87 *** Got signal Terminated *** 2024-09-19T10:07:13.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:13.012+0000 7fd6fd903640 -1 osd.11 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T10:07:13.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:13.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:13.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:13.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:13.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:13.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:13.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:13.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:13.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:13.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:13.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:13.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:13.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:13 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:13.149+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6820 osd.7 since back 2024-09-19T10:06:45.728713+0000 front 2024-09-19T10:06:45.728689+0000 (oldest deadline 2024-09-19T10:07:08.028545+0000) 2024-09-19T10:07:14.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:14 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:14.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:14.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:14 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:14.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:14.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:14 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:14.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:14.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:14 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:14.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:14.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:14 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:14.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:14.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:14 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:14.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:14.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:14 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:14.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6820 osd.7 since back 2024-09-19T10:06:45.728713+0000 front 2024-09-19T10:06:45.728689+0000 (oldest deadline 2024-09-19T10:07:08.028545+0000) 2024-09-19T10:07:15.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:15 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:15.115+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:15.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:15 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:15.115+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:15.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:15 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:15.115+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:15.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:15 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:15.115+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:15.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:15 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:15.115+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:15.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:15 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:15.115+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:15.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:15 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:15.115+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6820 osd.7 since back 2024-09-19T10:06:45.728713+0000 front 2024-09-19T10:06:45.728689+0000 (oldest deadline 2024-09-19T10:07:08.028545+0000) 2024-09-19T10:07:15.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:15 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:15.115+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.8 since back 2024-09-19T10:06:51.330012+0000 front 2024-09-19T10:06:51.330062+0000 (oldest deadline 2024-09-19T10:07:14.830266+0000) 2024-09-19T10:07:16.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:16 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:16.148+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:16.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:16 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:16.148+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:16.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:16 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:16.148+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:16.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:16 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:16.148+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:16.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:16 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:16.148+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:16.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:16 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:16.148+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:16.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:16 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:16.148+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6820 osd.7 since back 2024-09-19T10:06:45.728713+0000 front 2024-09-19T10:06:45.728689+0000 (oldest deadline 2024-09-19T10:07:08.028545+0000) 2024-09-19T10:07:16.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:16 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:16.148+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.8 since back 2024-09-19T10:06:51.330012+0000 front 2024-09-19T10:06:51.330062+0000 (oldest deadline 2024-09-19T10:07:14.830266+0000) 2024-09-19T10:07:17.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:17 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:17.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-09-19T10:05:47.519159+0000 front 2024-09-19T10:05:47.519187+0000 (oldest deadline 2024-09-19T10:06:12.219367+0000) 2024-09-19T10:07:17.413 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:17 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:17.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6804 osd.1 since back 2024-09-19T10:05:57.222348+0000 front 2024-09-19T10:05:57.222210+0000 (oldest deadline 2024-09-19T10:06:23.122227+0000) 2024-09-19T10:07:17.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:17 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:17.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T10:06:03.122546+0000 front 2024-09-19T10:06:03.122634+0000 (oldest deadline 2024-09-19T10:06:29.022757+0000) 2024-09-19T10:07:17.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:17 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:17.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-09-19T10:06:09.023419+0000 front 2024-09-19T10:06:09.023427+0000 (oldest deadline 2024-09-19T10:06:34.923470+0000) 2024-09-19T10:07:17.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:17 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:17.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6812 osd.4 since back 2024-09-19T10:06:18.424692+0000 front 2024-09-19T10:06:18.424784+0000 (oldest deadline 2024-09-19T10:06:43.724476+0000) 2024-09-19T10:07:17.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:17 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:17.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T10:06:27.026202+0000 front 2024-09-19T10:06:27.026230+0000 (oldest deadline 2024-09-19T10:06:51.726199+0000) 2024-09-19T10:07:17.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:17 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:17.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.49:6820 osd.7 since back 2024-09-19T10:06:45.728713+0000 front 2024-09-19T10:06:45.728689+0000 (oldest deadline 2024-09-19T10:07:08.028545+0000) 2024-09-19T10:07:17.414 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:17 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11[60350]: 2024-09-19T10:07:17.137+0000 7fd6f9f08640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.8 since back 2024-09-19T10:06:51.330012+0000 front 2024-09-19T10:06:51.330062+0000 (oldest deadline 2024-09-19T10:07:14.830266+0000) 2024-09-19T10:07:18.840 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:18 smithi162 podman[71358]: 2024-09-19 10:07:18.569714091 +0000 UTC m=+5.656954801 container died 8c0ad36cfe92900009c498e1edc03f22cbcd3e75cf7e9b45d8c0b210946fe439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:07:19.163 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:18 smithi162 podman[71358]: 2024-09-19 10:07:18.936430487 +0000 UTC m=+6.023671187 container cleanup 8c0ad36cfe92900009c498e1edc03f22cbcd3e75cf7e9b45d8c0b210946fe439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2) 2024-09-19T10:07:19.163 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:18 smithi162 bash[71358]: ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11 2024-09-19T10:07:19.547 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:19 smithi162 podman[71374]: 2024-09-19 10:07:19.212843735 +0000 UTC m=+0.644552393 container remove 8c0ad36cfe92900009c498e1edc03f22cbcd3e75cf7e9b45d8c0b210946fe439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T10:07:19.859 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:19 smithi162 podman[71460]: 2024-09-19 10:07:19.448655907 +0000 UTC m=+0.015980990 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T10:07:19.859 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:19 smithi162 podman[71460]: 2024-09-19 10:07:19.55515198 +0000 UTC m=+0.122477086 container create 60a9254402504d7e09f4477d10cd58bc8bc4c689dbb006742cc404c8b92cd5e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T10:07:19.860 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:19 smithi162 podman[71460]: 2024-09-19 10:07:19.765697817 +0000 UTC m=+0.333022881 container init 60a9254402504d7e09f4477d10cd58bc8bc4c689dbb006742cc404c8b92cd5e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T10:07:19.860 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:19 smithi162 podman[71460]: 2024-09-19 10:07:19.768931959 +0000 UTC m=+0.336257030 container start 60a9254402504d7e09f4477d10cd58bc8bc4c689dbb006742cc404c8b92cd5e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T10:07:19.860 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:19 smithi162 podman[71460]: 2024-09-19 10:07:19.857369566 +0000 UTC m=+0.424694643 container attach 60a9254402504d7e09f4477d10cd58bc8bc4c689dbb006742cc404c8b92cd5e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T10:07:20.163 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 10:07:19 smithi162 podman[71460]: 2024-09-19 10:07:19.968137215 +0000 UTC m=+0.535462289 container died 60a9254402504d7e09f4477d10cd58bc8bc4c689dbb006742cc404c8b92cd5e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T10:07:20.564 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T10:07:20.603 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:20.603 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T10:07:20.604 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T10:07:20.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.a 2024-09-19T10:07:20.885 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:07:20 smithi018 systemd[1]: Stopping Ceph mds.a for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:21.156 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:07:20 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a[71815]: 2024-09-19T10:07:20.908+0000 7f594a1ab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:21.156 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:07:20 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a[71815]: 2024-09-19T10:07:20.908+0000 7f594a1ab640 -1 mds.a *** got signal Terminated *** 2024-09-19T10:07:25.319 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:07:24 smithi018 podman[114973]: 2024-09-19 10:07:24.917209977 +0000 UTC m=+4.108226253 container died 6ba4d341ef5b535c75834e058b896f9b744536a3bd0bfc79014cc7abe093c2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T10:07:25.320 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:07:25 smithi018 podman[114973]: 2024-09-19 10:07:25.317560998 +0000 UTC m=+4.508577276 container cleanup 6ba4d341ef5b535c75834e058b896f9b744536a3bd0bfc79014cc7abe093c2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:07:25.635 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:07:25 smithi018 bash[114973]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a 2024-09-19T10:07:25.636 INFO:journalctl@ceph.mds.a.smithi018.stdout:Sep 19 10:07:25 smithi018 podman[114997]: 2024-09-19 10:07:25.54401824 +0000 UTC m=+0.616891812 container remove 6ba4d341ef5b535c75834e058b896f9b744536a3bd0bfc79014cc7abe093c2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T10:07:25.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T10:07:25.734 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:25.734 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T10:07:25.734 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T10:07:25.734 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.d 2024-09-19T10:07:26.057 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 10:07:25 smithi018 systemd[1]: Stopping Ceph mds.d for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:26.386 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 10:07:26 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-d[70628]: 2024-09-19T10:07:26.054+0000 7f2b1e198640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:26.386 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 10:07:26 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-d[70628]: 2024-09-19T10:07:26.054+0000 7f2b1e198640 -1 mds.d *** got signal Terminated *** 2024-09-19T10:07:30.331 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 10:07:30 smithi018 podman[115104]: 2024-09-19 10:07:30.067132516 +0000 UTC m=+4.105859769 container died 5a4381de00b26bb8bc7bea0aa97c251e7b721e966c49469bfa8371d4f08b465c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T10:07:30.635 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 10:07:30 smithi018 podman[115104]: 2024-09-19 10:07:30.512830226 +0000 UTC m=+4.551557505 container cleanup 5a4381de00b26bb8bc7bea0aa97c251e7b721e966c49469bfa8371d4f08b465c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T10:07:30.636 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 10:07:30 smithi018 bash[115104]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-d 2024-09-19T10:07:30.955 INFO:journalctl@ceph.mds.d.smithi018.stdout:Sep 19 10:07:30 smithi018 podman[115116]: 2024-09-19 10:07:30.689200083 +0000 UTC m=+0.616682648 container remove 5a4381de00b26bb8bc7bea0aa97c251e7b721e966c49469bfa8371d4f08b465c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T10:07:30.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T10:07:30.994 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:30.994 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T10:07:30.995 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T10:07:30.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.g 2024-09-19T10:07:31.310 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:07:31 smithi018 systemd[1]: Stopping Ceph mds.g for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:31.635 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:07:31 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g[71433]: 2024-09-19T10:07:31.307+0000 7fe98a315640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:31.636 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:07:31 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g[71433]: 2024-09-19T10:07:31.307+0000 7fe98a315640 -1 mds.g *** got signal Terminated *** 2024-09-19T10:07:34.061 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:07:33 smithi018 podman[115226]: 2024-09-19 10:07:33.79569919 +0000 UTC m=+2.580564937 container died cb39f182c715c1c22e3b34ee06a06cb934b2dd53a0ae16bfd52ef50736a803d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T10:07:34.386 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:07:34 smithi018 podman[115226]: 2024-09-19 10:07:34.12499512 +0000 UTC m=+2.909860861 container cleanup cb39f182c715c1c22e3b34ee06a06cb934b2dd53a0ae16bfd52ef50736a803d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T10:07:34.386 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:07:34 smithi018 bash[115226]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g 2024-09-19T10:07:34.386 INFO:journalctl@ceph.mds.g.smithi018.stdout:Sep 19 10:07:34 smithi018 podman[115240]: 2024-09-19 10:07:34.292776033 +0000 UTC m=+0.499234251 container remove cb39f182c715c1c22e3b34ee06a06cb934b2dd53a0ae16bfd52ef50736a803d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T10:07:34.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T10:07:34.552 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:34.552 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T10:07:34.553 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T10:07:34.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.j 2024-09-19T10:07:34.872 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 10:07:34 smithi018 systemd[1]: Stopping Ceph mds.j for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:35.135 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 10:07:34 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-j[70215]: 2024-09-19T10:07:34.869+0000 7fa7cf204640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:35.136 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 10:07:34 smithi018 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-j[70215]: 2024-09-19T10:07:34.869+0000 7fa7cf204640 -1 mds.j *** got signal Terminated *** 2024-09-19T10:07:38.707 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 10:07:38 smithi018 podman[115348]: 2024-09-19 10:07:38.432044754 +0000 UTC m=+3.659334910 container died 80f52a23bad7fbdcd1245b74b4031b08f2ff713b69fcc580effb87cd1df135eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T10:07:39.136 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 10:07:38 smithi018 podman[115348]: 2024-09-19 10:07:38.803077853 +0000 UTC m=+4.030368009 container cleanup 80f52a23bad7fbdcd1245b74b4031b08f2ff713b69fcc580effb87cd1df135eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T10:07:39.136 INFO:journalctl@ceph.mds.j.smithi018.stdout:Sep 19 10:07:38 smithi018 bash[115348]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-j 2024-09-19T10:07:39.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T10:07:39.433 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:39.433 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T10:07:39.433 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T10:07:39.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.b 2024-09-19T10:07:39.721 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 10:07:39 smithi049 systemd[1]: Stopping Ceph mds.b for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:39.991 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 10:07:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b[65464]: 2024-09-19T10:07:39.717+0000 7fe438e2a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:39.991 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 10:07:39 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b[65464]: 2024-09-19T10:07:39.717+0000 7fe438e2a640 -1 mds.b *** got signal Terminated *** 2024-09-19T10:07:42.088 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 10:07:41 smithi049 podman[70963]: 2024-09-19 10:07:41.79619069 +0000 UTC m=+2.168977921 container died 1b78794f50922d915961d30abe46648db776bc28e7aee4cd58ef2741ef2fff9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T10:07:42.401 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 10:07:42 smithi049 podman[70963]: 2024-09-19 10:07:42.184541797 +0000 UTC m=+2.557329012 container cleanup 1b78794f50922d915961d30abe46648db776bc28e7aee4cd58ef2741ef2fff9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T10:07:42.401 INFO:journalctl@ceph.mds.b.smithi049.stdout:Sep 19 10:07:42 smithi049 bash[70963]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-b 2024-09-19T10:07:42.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T10:07:42.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:42.639 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T10:07:42.639 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T10:07:42.639 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.e 2024-09-19T10:07:42.975 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 10:07:42 smithi049 systemd[1]: Stopping Ceph mds.e for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:43.401 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 10:07:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e[64849]: 2024-09-19T10:07:42.970+0000 7f765326f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:43.401 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 10:07:42 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e[64849]: 2024-09-19T10:07:42.971+0000 7f765326f640 -1 mds.e *** got signal Terminated *** 2024-09-19T10:07:46.066 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 10:07:45 smithi049 podman[71095]: 2024-09-19 10:07:45.785740525 +0000 UTC m=+2.924690977 container died 47c0c5eac077a1ec90f44a131207ea74bd083d65e03287a1d42bc699e298b54f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T10:07:46.400 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 10:07:46 smithi049 podman[71095]: 2024-09-19 10:07:46.16299393 +0000 UTC m=+3.301944381 container cleanup 47c0c5eac077a1ec90f44a131207ea74bd083d65e03287a1d42bc699e298b54f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T10:07:46.400 INFO:journalctl@ceph.mds.e.smithi049.stdout:Sep 19 10:07:46 smithi049 bash[71095]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-e 2024-09-19T10:07:46.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T10:07:46.597 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:46.597 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T10:07:46.598 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T10:07:46.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.h 2024-09-19T10:07:46.919 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 10:07:46 smithi049 systemd[1]: Stopping Ceph mds.h for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:47.401 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 10:07:46 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h[65151]: 2024-09-19T10:07:46.915+0000 7f60bac6d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:47.401 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 10:07:46 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h[65151]: 2024-09-19T10:07:46.915+0000 7f60bac6d640 -1 mds.h *** got signal Terminated *** 2024-09-19T10:07:50.053 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 10:07:49 smithi049 podman[71217]: 2024-09-19 10:07:49.789333878 +0000 UTC m=+2.970321828 container died 9c2cae7447ec885437250e2abf0d9bd28e1908d5b927fafdfd6bb078bc18195c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T10:07:50.401 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 10:07:50 smithi049 podman[71217]: 2024-09-19 10:07:50.149793136 +0000 UTC m=+3.330781083 container cleanup 9c2cae7447ec885437250e2abf0d9bd28e1908d5b927fafdfd6bb078bc18195c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T10:07:50.401 INFO:journalctl@ceph.mds.h.smithi049.stdout:Sep 19 10:07:50 smithi049 bash[71217]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-h 2024-09-19T10:07:50.595 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T10:07:50.628 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:50.629 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T10:07:50.629 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T10:07:50.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.k 2024-09-19T10:07:50.956 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 10:07:50 smithi049 systemd[1]: Stopping Ceph mds.k for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:51.401 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 10:07:50 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k[64538]: 2024-09-19T10:07:50.952+0000 7f1f35ff0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:51.401 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 10:07:50 smithi049 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k[64538]: 2024-09-19T10:07:50.952+0000 7f1f35ff0640 -1 mds.k *** got signal Terminated *** 2024-09-19T10:07:54.065 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 10:07:53 smithi049 podman[71335]: 2024-09-19 10:07:53.784588823 +0000 UTC m=+2.934486772 container died 5017f0fbc729cf898dfb7fcb2a663f4412d5035d42c7f3f213b35fbc744e1fbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T10:07:54.390 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 10:07:54 smithi049 podman[71335]: 2024-09-19 10:07:54.153368608 +0000 UTC m=+3.303266556 container cleanup 5017f0fbc729cf898dfb7fcb2a663f4412d5035d42c7f3f213b35fbc744e1fbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:07:54.391 INFO:journalctl@ceph.mds.k.smithi049.stdout:Sep 19 10:07:54 smithi049 bash[71335]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-k 2024-09-19T10:07:54.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T10:07:54.575 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:54.575 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T10:07:54.575 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T10:07:54.576 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.c 2024-09-19T10:07:54.913 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:07:54 smithi162 systemd[1]: Stopping Ceph mds.c for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:55.177 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:07:55 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c[65198]: 2024-09-19T10:07:55.007+0000 7f3e5b9d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:55.177 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:07:55 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c[65198]: 2024-09-19T10:07:55.007+0000 7f3e5b9d4640 -1 mds.c *** got signal Terminated *** 2024-09-19T10:07:58.127 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:07:57 smithi162 podman[71561]: 2024-09-19 10:07:57.78411696 +0000 UTC m=+3.021057336 container died 63e882ce8d8fcc4fb15f9d80cb59ed94cb214f7d5aabe60074ca9a257448b606 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T10:07:58.413 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:07:58 smithi162 podman[71561]: 2024-09-19 10:07:58.223668413 +0000 UTC m=+3.460608800 container cleanup 63e882ce8d8fcc4fb15f9d80cb59ed94cb214f7d5aabe60074ca9a257448b606 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T10:07:58.414 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:07:58 smithi162 bash[71561]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c 2024-09-19T10:07:58.666 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T10:07:58.689 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:07:58 smithi162 podman[71586]: 2024-09-19 10:07:58.424828143 +0000 UTC m=+0.630079379 container remove 63e882ce8d8fcc4fb15f9d80cb59ed94cb214f7d5aabe60074ca9a257448b606 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T10:07:58.689 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:07:58 smithi162 systemd[1]: ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-19T10:07:58.689 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:07:58 smithi162 systemd[1]: Stopped Ceph mds.c for 5b174660-766b-11ef-bceb-c7b262605968. 2024-09-19T10:07:58.689 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 10:07:58 smithi162 systemd[1]: ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.c.service: Consumed 1min 6.438s CPU time. 2024-09-19T10:07:58.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:07:58.702 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T10:07:58.703 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T10:07:58.703 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.f 2024-09-19T10:07:59.030 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 10:07:58 smithi162 systemd[1]: Stopping Ceph mds.f for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:07:59.413 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 10:07:59 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f[64898]: 2024-09-19T10:07:59.027+0000 7ff0d1b8c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:07:59.413 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 10:07:59 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f[64898]: 2024-09-19T10:07:59.027+0000 7ff0d1b8c640 -1 mds.f *** got signal Terminated *** 2024-09-19T10:08:02.054 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 10:08:01 smithi162 podman[71697]: 2024-09-19 10:08:01.781974585 +0000 UTC m=+2.865691751 container died 121aadc42177c510d232acd6a72ca6a28fbda297bc34205e4d3d427508106ffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T10:08:02.413 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 10:08:02 smithi162 podman[71697]: 2024-09-19 10:08:02.160383339 +0000 UTC m=+3.244100504 container cleanup 121aadc42177c510d232acd6a72ca6a28fbda297bc34205e4d3d427508106ffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T10:08:02.413 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 10:08:02 smithi162 bash[71697]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-f 2024-09-19T10:08:02.552 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T10:08:02.586 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:08:02.586 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T10:08:02.586 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T10:08:02.586 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.i 2024-09-19T10:08:03.163 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 10:08:02 smithi162 systemd[1]: Stopping Ceph mds.i for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:08:03.163 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 10:08:02 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i[65501]: 2024-09-19T10:08:02.913+0000 7fe81ae5f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:08:03.163 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 10:08:02 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i[65501]: 2024-09-19T10:08:02.913+0000 7fe81ae5f640 -1 mds.i *** got signal Terminated *** 2024-09-19T10:08:05.913 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 10:08:05 smithi162 podman[71815]: 2024-09-19 10:08:05.782388762 +0000 UTC m=+2.975779330 container died bb436781b811fdffee53a617f9d77fdc558b46a68d0c3e1c3ad56f31b862ed40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T10:08:06.413 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 10:08:06 smithi162 podman[71815]: 2024-09-19 10:08:06.238884604 +0000 UTC m=+3.432275174 container cleanup bb436781b811fdffee53a617f9d77fdc558b46a68d0c3e1c3ad56f31b862ed40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T10:08:06.413 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 10:08:06 smithi162 bash[71815]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-i 2024-09-19T10:08:06.656 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T10:08:06.689 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:08:06.689 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T10:08:06.689 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T10:08:06.689 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.l 2024-09-19T10:08:07.027 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 10:08:06 smithi162 systemd[1]: Stopping Ceph mds.l for 5b174660-766b-11ef-bceb-c7b262605968... 2024-09-19T10:08:07.413 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 10:08:07 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l[64599]: 2024-09-19T10:08:07.025+0000 7f088836b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T10:08:07.413 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 10:08:07 smithi162 ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l[64599]: 2024-09-19T10:08:07.025+0000 7f088836b640 -1 mds.l *** got signal Terminated *** 2024-09-19T10:08:10.070 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 10:08:09 smithi162 podman[71937]: 2024-09-19 10:08:09.783569419 +0000 UTC m=+2.871081967 container died f09fc438a8109d09d8d8bbc9c5c45d0186e937599f2428e10cdbadc388628e35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:08:10.395 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 10:08:10 smithi162 podman[71937]: 2024-09-19 10:08:10.175774667 +0000 UTC m=+3.263287201 container cleanup f09fc438a8109d09d8d8bbc9c5c45d0186e937599f2428e10cdbadc388628e35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T10:08:10.395 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 10:08:10 smithi162 bash[71937]: ceph-5b174660-766b-11ef-bceb-c7b262605968-mds-l 2024-09-19T10:08:10.517 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b174660-766b-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T10:08:10.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T10:08:10.550 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T10:08:10.551 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b174660-766b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T10:08:10.762 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T10:08:13.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b174660-766b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T10:08:13.606 INFO:teuthology.orchestra.run.smithi049.stdout:Deleting cluster with fsid: 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T10:08:16.188 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b174660-766b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T10:08:16.391 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T10:08:18.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T10:08:18.779 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T10:08:18.813 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T10:08:18.842 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T10:08:18.844 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928/remote/smithi018/crash 2024-09-19T10:08:18.845 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/crash -- . 2024-09-19T10:08:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:tar: /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T10:08:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:tar: Error is not recoverable: exiting now 2024-09-19T10:08:18.877 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928/remote/smithi049/crash 2024-09-19T10:08:18.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/crash -- . 2024-09-19T10:08:18.923 INFO:teuthology.orchestra.run.smithi049.stderr:tar: /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T10:08:18.923 INFO:teuthology.orchestra.run.smithi049.stderr:tar: Error is not recoverable: exiting now 2024-09-19T10:08:18.925 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928/remote/smithi162/crash 2024-09-19T10:08:18.926 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/crash -- . 2024-09-19T10:08:18.998 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/5b174660-766b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T10:08:18.999 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-09-19T10:08:19.000 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T10:08:19.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T10:08:19.050 INFO:tasks.cephadm:Compressing logs... 2024-09-19T10:08:19.051 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T10:08:19.054 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T10:08:19.056 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T10:08:19.079 INFO:teuthology.orchestra.run.smithi018.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T10:08:19.079 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T10:08:19.079 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T10:08:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T10:08:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T10:08:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T10:08:19.082 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T10:08:19.082 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T10:08:19.082 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T10:08:19.082 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mon.a.log: 82.3% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T10:08:19.082 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T10:08:19.082 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.log 2024-09-19T10:08:19.086 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T10:08:19.091 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T10:08:19.108 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T10:08:19.108 INFO:teuthology.orchestra.run.smithi162.stderr:: No such file or directory 2024-09-19T10:08:19.108 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T10:08:19.108 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T10:08:19.108 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T10:08:19.108 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T10:08:19.108 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T10:08:19.108 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T10:08:19.108 INFO:teuthology.orchestra.run.smithi162.stderr: 82.7% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T10:08:19.109 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T10:08:19.109 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.log 2024-09-19T10:08:19.109 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T10:08:19.109 INFO:teuthology.orchestra.run.smithi162.stderr: 90.5% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T10:08:19.109 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.log: 86.4% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T10:08:19.109 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T10:08:19.109 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T10:08:19.109 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T10:08:19.109 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T10:08:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.log: 86.4% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T10:08:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T10:08:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.d.log: 90.9% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T10:08:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T10:08:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mgr.x.log: 94.4% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T10:08:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T10:08:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T10:08:19.114 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T10:08:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T10:08:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:: No such file or directory 2024-09-19T10:08:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T10:08:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T10:08:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T10:08:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T10:08:19.115 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T10:08:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T10:08:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T10:08:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T10:08:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T10:08:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T10:08:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.8% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T10:08:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.log 2024-09-19T10:08:19.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mgr.y.log: 90.9% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T10:08:19.117 INFO:teuthology.orchestra.run.smithi049.stderr: 92.9% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T10:08:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T10:08:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T10:08:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.h.log: 86.4% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T10:08:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T10:08:19.117 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T10:08:19.119 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mgr.z.log: 93.0% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T10:08:19.119 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T10:08:19.125 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T10:08:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T10:08:19.140 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T10:08:19.151 INFO:teuthology.orchestra.run.smithi162.stderr: 94.5% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T10:08:19.152 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T10:08:19.153 INFO:teuthology.orchestra.run.smithi018.stderr: 92.6% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 94.5% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T10:08:19.153 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T10:08:19.160 INFO:teuthology.orchestra.run.smithi049.stderr: 94.5% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T10:08:19.164 INFO:teuthology.orchestra.run.smithi162.stderr: 92.6% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T10:08:19.175 INFO:teuthology.orchestra.run.smithi049.stderr: 92.7% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T10:08:19.193 INFO:teuthology.orchestra.run.smithi162.stderr: 94.6% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T10:08:19.208 INFO:teuthology.orchestra.run.smithi049.stderr: 92.7% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T10:08:19.397 INFO:teuthology.orchestra.run.smithi018.stderr: 90.4% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T10:08:19.621 INFO:teuthology.orchestra.run.smithi162.stderr: 91.6% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T10:08:19.634 INFO:teuthology.orchestra.run.smithi049.stderr: 91.6% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T10:08:20.090 INFO:teuthology.orchestra.run.smithi018.stderr: 90.3% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T10:08:23.502 INFO:teuthology.orchestra.run.smithi018.stderr: 93.1% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T10:08:25.443 INFO:teuthology.orchestra.run.smithi049.stderr: 93.3% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T10:08:25.474 INFO:teuthology.orchestra.run.smithi162.stderr: 93.0% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T10:08:25.536 INFO:teuthology.orchestra.run.smithi049.stderr: 93.1% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T10:08:25.791 INFO:teuthology.orchestra.run.smithi018.stderr: 93.1% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T10:08:25.983 INFO:teuthology.orchestra.run.smithi049.stderr: 93.0% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T10:08:25.997 INFO:teuthology.orchestra.run.smithi162.stderr: 93.1% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T10:08:26.109 INFO:teuthology.orchestra.run.smithi018.stderr: 93.1% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T10:08:26.123 INFO:teuthology.orchestra.run.smithi018.stderr: 93.3% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T10:08:26.125 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T10:08:26.125 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m7.058s 2024-09-19T10:08:26.126 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m25.651s 2024-09-19T10:08:26.126 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.915s 2024-09-19T10:08:26.286 INFO:teuthology.orchestra.run.smithi162.stderr: 93.1% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T10:08:26.520 INFO:teuthology.orchestra.run.smithi162.stderr: 93.1% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T10:08:28.330 INFO:teuthology.orchestra.run.smithi049.stderr: 93.2% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T10:08:32.646 INFO:teuthology.orchestra.run.smithi162.stderr: 97.4% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T10:08:32.648 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-19T10:08:32.648 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m13.577s 2024-09-19T10:08:32.648 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m40.586s 2024-09-19T10:08:32.648 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m1.566s 2024-09-19T10:11:17.348 INFO:teuthology.orchestra.run.smithi049.stderr: 93.9% -- replaced with /var/log/ceph/5b174660-766b-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T10:11:17.350 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-09-19T10:11:17.350 INFO:teuthology.orchestra.run.smithi049.stderr:real 2m58.279s 2024-09-19T10:11:17.350 INFO:teuthology.orchestra.run.smithi049.stderr:user 3m21.152s 2024-09-19T10:11:17.350 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m6.439s 2024-09-19T10:11:17.351 INFO:tasks.cephadm:Archiving logs... 2024-09-19T10:11:17.351 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928/remote/smithi018/log 2024-09-19T10:11:17.557 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T10:11:21.318 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928/remote/smithi049/log 2024-09-19T10:11:21.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T10:11:49.274 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928/remote/smithi162/log 2024-09-19T10:11:49.276 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T10:11:54.127 INFO:tasks.cephadm:Removing cluster... 2024-09-19T10:11:54.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b174660-766b-11ef-bceb-c7b262605968 --force 2024-09-19T10:11:54.341 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T10:11:54.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b174660-766b-11ef-bceb-c7b262605968 --force 2024-09-19T10:11:54.860 INFO:teuthology.orchestra.run.smithi049.stdout:Deleting cluster with fsid: 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T10:11:55.392 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b174660-766b-11ef-bceb-c7b262605968 --force 2024-09-19T10:11:55.595 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: 5b174660-766b-11ef-bceb-c7b262605968 2024-09-19T10:11:55.896 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T10:11:55.896 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T10:11:55.917 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T10:11:55.935 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T10:11:55.951 INFO:tasks.cephadm:Teardown complete 2024-09-19T10:11:55.951 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T10:11:55.963 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T10:11:55.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T10:11:55.966 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T10:11:55.977 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T10:11:56.082 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T10:11:56.093 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T10:11:56.093 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T10:11:56.096 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T10:11:56.098 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T10:11:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-19T10:11:56.112 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-09-19T10:11:56.113 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-19T10:11:56.116 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T10:11:56.116 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-09-19T10:11:56.116 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +497us[ +505us] +/- 57ms 2024-09-19T10:11:56.116 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -1168us[-1168us] +/- 62ms 2024-09-19T10:11:56.116 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +764us[ +764us] +/- 81ms 2024-09-19T10:11:56.116 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T10:11:56.119 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T10:11:56.119 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-19T10:11:56.119 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 +510us[ +539us] +/- 57ms 2024-09-19T10:11:56.119 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -1147us[-1118us] +/- 62ms 2024-09-19T10:11:56.119 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +787us[ +815us] +/- 81ms 2024-09-19T10:11:56.119 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T10:11:56.119 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T10:11:56.119 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-19T10:11:56.120 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 +530us[ +584us] +/- 57ms 2024-09-19T10:11:56.120 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -1130us[-1077us] +/- 62ms 2024-09-19T10:11:56.120 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +803us[ +856us] +/- 81ms 2024-09-19T10:11:56.120 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T10:11:56.120 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T10:11:56.131 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T10:11:56.131 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T10:11:56.142 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T10:11:56.250 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T10:11:56.324 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T10:11:56.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T10:11:56.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:11:56.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T10:11:56.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:11:56.454 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T10:11:56.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:11:56.483 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T10:11:56.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T10:11:56.506 INFO:teuthology.task.internal:Duration was 2180.833251 seconds 2024-09-19T10:11:56.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T10:11:56.517 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T10:11:56.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T10:11:56.520 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T10:11:56.522 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T10:11:56.560 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T10:11:56.562 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T10:11:56.564 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T10:11:56.943 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T10:11:56.944 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T10:11:56.944 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T10:11:57.005 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T10:11:57.005 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T10:11:57.033 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T10:11:57.034 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T10:11:57.060 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T10:11:57.060 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T10:11:57.064 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T10:11:57.077 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T10:11:57.127 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T10:11:57.127 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T10:11:57.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T10:11:57.148 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T10:11:58.520 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T10:11:59.142 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T10:11:59.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T10:11:59.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T10:11:59.203 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T10:11:59.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T10:11:59.587 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:11:59.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:11:59.593 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:11:59.617 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-19T10:11:59.619 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-09-19T10:11:59.621 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-19T10:11:59.728 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:11:59.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:11:59.746 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:11:59.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:11:59.764 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:11:59.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:11:59.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T10:11:59.959 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T10:11:59.960 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928/remote/smithi018 2024-09-19T10:11:59.960 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T10:12:00.042 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928/remote/smithi049 2024-09-19T10:12:00.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T10:12:00.090 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911928/remote/smithi162 2024-09-19T10:12:00.091 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T10:12:00.132 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T10:12:00.132 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T10:12:00.136 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T10:12:00.138 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T10:12:00.187 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T10:12:00.200 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T10:12:00.200 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T10:12:00.214 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T10:12:00.214 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T10:12:00.217 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T10:12:00.219 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T10:12:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 10:12 /home/ubuntu/cephtest 2024-09-19T10:12:00.236 INFO:teuthology.orchestra.run.smithi049.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 10:12 /home/ubuntu/cephtest 2024-09-19T10:12:00.247 INFO:teuthology.orchestra.run.smithi162.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 10:12 /home/ubuntu/cephtest 2024-09-19T10:12:00.247 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T10:12:00.258 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T10:12:00.292 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} duration: 2180.8332509994507 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T10:12:00.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T10:12:00.370 INFO:teuthology.run:pass